QVAC-17801 feat: add mobile Parakeet RTF reporting#1723
Merged
Conversation
Run Parakeet RTF benchmarks through the mobile Device Farm workflow and combine desktop and mobile artifacts into a single report so cross-platform performance is visible in one place. Made-with: Cursor
Contributor
Tier-based Approval Status |
Mirror OCR's mobile reporting approach by isolating the RTF benchmark into dedicated Device Farm perf runs while keeping the regular mobile suite separate, then only extract benchmark artifacts from the perf lane. Made-with: Cursor
Replace bash mapfile usage with portable while-read loops for macOS runners and refresh AWS credentials before the long Device Farm monitor and log download phases so the split perf/regular workflow can run to completion. Made-with: Cursor
Make the addon-side mobile wrappers read testFilter.txt and skip non-selected tests with zero-failure summaries so the perf and regular Device Farm lanes can actually execute different subsets without requiring framework changes. Made-with: Cursor
Made-with: Cursor
Made-with: Cursor
Preview deployments for qvac-docs-staging ⚡️
Commit: Deployment ID: Static site name: |
Made-with: Cursor
Made-with: Cursor
Made-with: Cursor
GustavoA1604
approved these changes
Apr 29, 2026
tobi-legan
approved these changes
Apr 29, 2026
Contributor
Author
|
/review |
Contributor
|
/review |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🎯 What problem does this PR solve?
📝 How does it solve it?
scripts/test-utils/performance-reporter.js.[PERF_REPORT_START]/[PERF_CHUNK]markers from mobile Device Farm logs and extracts them withscripts/perf-report/extract-from-log.js.scripts/perf-report/render-step-summary.js.scripts/perf-report/aggregate-parakeet-rtf.jsso the unified Parakeet report can include desktop RTF artifacts and mobileperformance-report.jsonartifacts.parakeet-unified-performance-report.{md,json,html}.pull_request_targetcombine job.🧪 How was it tested?
npm run lintinpackages/qvac-lib-infer-parakeetnpm run test:mobile:validateinpackages/qvac-lib-infer-parakeetnode --check scripts/perf-report/aggregate-parakeet-rtf.jsnpx standard scripts/perf-report/aggregate-parakeet-rtf.js✅ Validation Matrix
perf-report-parakeet-Android-56,console-logs-parakeet-Android,devicefarm-logs-parakeet-Androidperf-report-parakeet-iOS-56,console-logs-parakeet-iOS,devicefarm-logs-parakeet-iOSrtf-results-*artifactsparakeet-unified-performance-report📊 Latest Mobile Perf Report Check
perf-report-parakeet-Android-56Latest Sample Metrics
Made with Cursor