infra: add console log artifacts to all mobile integration test workflows#1714
Merged
Conversation
Throwaway commit to validate C++ log capture on Device Farm. Do NOT merge -- delete branch after verification. Made-with: Cursor
Pull bare_console.log from the app's documents directory at the end of each iOS test run and write it to $DEVICEFARM_LOG_DIR so it appears in customer artifacts. Throwaway -- delete branch after verification. Made-with: Cursor
The Bare worklet flushes logs to disk on a 2s timer. Without a pause, pullFile in the WDIO after hook could retrieve a stale file missing the final log entries (inference completion, errors).
browser.pullFile returns base64 which WDIO debug-logs in full, bloating the Appium output artifact. Replace with raw HTTP to Appium to bypass WDIO command logging. Also add --max-time 300 to all curl commands in the download steps as a safety net against any future hangs.
Wire up the same bare-log pullFile (via raw HTTP to bypass WDIO debug log bloat) and 3s flush pause in the iOS WDIO after hooks for whisper, NMT, parakeet, onnx-tts, and decoder-audio workflows. Also add --max-time 300 to all curl commands in their download steps.
Add two-tier artifact downloads to all 9 mobile test workflows: - "Console Logs" (small): bare_console.log (iOS C++ logs), test spec output, and logcat (Android) for quick debugging - "Full Device Farm Logs" (big): all artifacts for deep investigation Also adds bare_console.log capture to llamacpp-embed and diffusion workflows, curl --max-time 300 safety net, and resets TEST_FRAMEWORK_REF back to main now that qvac-test-addon-mobile#36 is merged. Made-with: Cursor
…logs Device Farm bundles $DEVICEFARM_LOG_DIR files into Customer_Artifacts.zip, so bare_console.log was not appearing as a standalone file. The extract step now unzips Customer_Artifacts.zip files and pulls bare_console.log into the console-logs artifact with device-prefixed names. Made-with: Cursor
Console logs artifact now contains only the essentials: - bare_console.log (iOS C++ logs, extracted from Customer_Artifacts.zip) - Logcat (Android native logs) - appium.log (Appium server logs, extracted from Customer_Artifacts.zip) Removed test spec output from console logs -- those stay in full logs. Made-with: Cursor
…kflows The sanity-checks job uses sparse-checkout but only included the package directory. Custom actions (yamlfmt, run-lint-and-unit-tests) were missing from the checkout, causing "Can't find action.yml" errors. Made-with: Cursor
…n-pr workflows" This reverts commit 0428671.
…variant suffix) Made-with: Cursor
Device Farm zips nest files under Host_Machine_Files/$DEVICEFARM_LOG_DIR/ so flat path checks never found bare_console.log or appium.log. Made-with: Cursor
Device Farm Customer_Artifacts.zip nests files under Host_Machine_Files/$DEVICEFARM_LOG_DIR/ - use find to locate bare_console.log and appium.log at any depth inside the zip. Made-with: Cursor
olyasir
approved these changes
Apr 23, 2026
Contributor
Tier-based Approval Status |
Proletter
approved these changes
Apr 23, 2026
Contributor
❌ E2E Mobile Test Results - iOSOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
Contributor
❌ E2E Mobile Test Results - AndroidOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
Contributor
❌ E2E Mobile Test Results - iOSOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
Contributor
❌ E2E Mobile Test Results - AndroidOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
Contributor
❌ E2E Mobile Test Results - iOSOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
Contributor
❌ E2E Mobile Test Results - AndroidOverall Status: FAILED Test Summary
Links
Automated E2E mobile testing powered by AWS Device Farm |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
bare_console.log(C++ native logs forwarded via Bare RPC) andappium.logLogcatfiles (native C++ logs) andappium.log--max-time 300to allcurlcommands in the Device Farm log download steps to prevent CI hangsWorkflows updated
integration-mobile-test-qvac-lib-infer-llamacpp-llm.ymlintegration-mobile-test-qvac-lib-infer-llamacpp-embed.ymlintegration-mobile-test-qvac-lib-infer-nmtcpp.ymlintegration-mobile-test-qvac-lib-infer-whispercpp.ymlintegration-mobile-test-qvac-lib-infer-parakeet.ymlintegration-mobile-test-qvac-lib-infer-onnx-tts.ymlintegration-mobile-test-lib-infer-diffusion.ymlintegration-mobile-test-qvac-lib-decoder-audio.ymlintegration-mobile-test-ocr-onnx.ymlTest plan
on-pr-*workflows on this branchbare_console.logcontains real C++ native logs for all 9 iOS buildsLogcatfiles contain real Android system/native logs for all 9 Android buildsappium.logpresent in all artifacts