-
Notifications
You must be signed in to change notification settings - Fork 373
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Use new CI workflows for pull-request and merge to main (#1955)
on_pull_request.yml includes the following pieces: - reusable_checks.yml -- Run all of the lints, code-formatting, tests, etc. - reusable_build_and_test_wheels.yml -- Configured in a "minimal" mode with SDK includes end-to-end test and produces an rrd. - reusable_build_web.yml -- Verifies we can build the wasm - reusable_upload_web.yml -- Uploads the RRD and Wasm to app.rerun.io to confirm the demo works as well as support notebook testing. - reusable_pr_summary.yml -- Create a manifest page with a link to the on_push_main.yml includes the following pieces: - reusable_checks.yml -- Run all of the lints, code-formatting, tests, etc. - reusable_bench.yml -- Run the benchmarks - reusable_build_and_test_wheels.yml -- Builds wheels for all platforms - reusable_upload_wheel.yml -- Uploads the all the wheels to gcloud - reusable_build_web.yml -- Builds the wasm bundle - reusable_upload_web.yml -- Uploads the RRD and Wasm to app.rerun.io - reusable_pip_index.yml -- Generates a pip index page which can be used to install packages with, e.g.
- Loading branch information
Showing
17 changed files
with
525 additions
and
1,104 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,52 @@ | ||
| name: Pull-Request | ||
|
|
||
| on: | ||
| pull_request: | ||
| types: | ||
| - opened | ||
| - synchronize | ||
|
|
||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.ref }} | ||
| cancel-in-progress: true | ||
|
|
||
| # These jobs use fairly short names as they are a prefix in the display hierarchy | ||
| jobs: | ||
| checks: | ||
| name: Checks | ||
| uses: ./.github/workflows/reusable_checks.yml | ||
| secrets: inherit | ||
|
|
||
|
|
||
| min-test-wheel: | ||
| name: 'Minimum Wheel' | ||
| uses: ./.github/workflows/reusable_build_and_test_wheels.yml | ||
| with: | ||
| SAVE_CACHE: false | ||
| PLATFORM: linux | ||
| MATURIN_FEATURE_FLAGS: '--no-default-features --features extension-module' | ||
| WHEEL_ARTIFACT_NAME: '' # the min-test wheel isn't used for anything | ||
| RRD_ARTIFACT_NAME: linux-rrd-fast | ||
| secrets: inherit | ||
|
|
||
| build-web: | ||
| name: 'Build Web' | ||
| uses: ./.github/workflows/reusable_build_web.yml | ||
| secrets: inherit | ||
|
|
||
| upload-web: | ||
| name: 'Upload Web' | ||
| needs: [min-test-wheel, build-web] | ||
| uses: ./.github/workflows/reusable_upload_web.yml | ||
| with: | ||
| RRD_ARTIFACT_NAME: linux-rrd-fast | ||
| UPLOAD_COMMIT_OVERRIDE: ${{ github.event.pull_request.head.sha }} | ||
| secrets: inherit | ||
|
|
||
| save-pr-summary: | ||
| name: 'Save PR Summary' | ||
| needs: [upload-web] | ||
| uses: ./.github/workflows/reusable_pr_summary.yml | ||
| with: | ||
| PR_NUMBER: ${{ github.event.pull_request.number }} | ||
| secrets: inherit |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,173 @@ | ||
| name: Pull-Request | ||
|
|
||
| on: | ||
| push: | ||
| branches: | ||
| - "main" | ||
|
|
||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.ref }} | ||
| cancel-in-progress: true | ||
|
|
||
| jobs: | ||
| checks: | ||
| name: Checks | ||
| uses: ./.github/workflows/reusable_checks.yml | ||
| secrets: inherit | ||
|
|
||
| benches: | ||
| name: Benchmarks | ||
| uses: ./.github/workflows/reusable_bench.yml | ||
| with: | ||
| SAVE_BENCHES: true | ||
| BENCH_NAME: main | ||
| COMPARE_TO: main | ||
| secrets: inherit | ||
|
|
||
| deploy-docs: | ||
| needs: [checks, benches] | ||
| name: Deploy Docs | ||
| uses: ./.github/workflows/reusable_deploy_docs.yml | ||
| with: | ||
| PY_DOCS_VERSION_NAME: "HEAD" | ||
| UPDATE_LATEST: false | ||
| secrets: inherit | ||
|
|
||
| build-web: | ||
| name: 'Build Web' | ||
| uses: ./.github/workflows/reusable_build_web.yml | ||
| secrets: inherit | ||
|
|
||
| upload-web: | ||
| name: 'Upload Web' | ||
| needs: [build-linux, build-web] | ||
| uses: ./.github/workflows/reusable_upload_web.yml | ||
| with: | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| MARK_PRERELEASE_FOR_MAINLINE: true | ||
| secrets: inherit | ||
|
|
||
| build-linux: | ||
| needs: [checks] | ||
| name: 'Linux: Build/Test Wheels' | ||
| uses: ./.github/workflows/reusable_build_and_test_wheels.yml | ||
| with: | ||
| PLATFORM: linux | ||
| WHEEL_ARTIFACT_NAME: linux-wheel | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| secrets: inherit | ||
|
|
||
| build-windows: | ||
| needs: [checks] | ||
| name: 'Windows: Build/Test Wheels' | ||
| uses: ./.github/workflows/reusable_build_and_test_wheels.yml | ||
| with: | ||
| PLATFORM: windows | ||
| WHEEL_ARTIFACT_NAME: windows-wheel | ||
| RRD_ARTIFACT_NAME: '' | ||
| secrets: inherit | ||
|
|
||
| build-macos-arm: | ||
| needs: [checks] | ||
| name: 'Macos-Arm: Build/Test Wheels' | ||
| uses: ./.github/workflows/reusable_build_and_test_wheels.yml | ||
| with: | ||
| PLATFORM: macos-arm | ||
| WHEEL_ARTIFACT_NAME: macos-arm-wheel | ||
| RRD_ARTIFACT_NAME: '' | ||
| secrets: inherit | ||
|
|
||
| build-macos-intel: | ||
| needs: [checks] | ||
| name: 'Macos-Intel: Build/Test Wheels' | ||
| uses: ./.github/workflows/reusable_build_and_test_wheels.yml | ||
| with: | ||
| PLATFORM: macos-intel | ||
| WHEEL_ARTIFACT_NAME: 'macos-intel-wheel' | ||
| RRD_ARTIFACT_NAME: '' | ||
| secrets: inherit | ||
|
|
||
| upload-wheels-linux: | ||
| name: 'Linux: Upload Wheels' | ||
| needs: [build-linux] | ||
| uses: ./.github/workflows/reusable_upload_wheels.yml | ||
| with: | ||
| WHEEL_ARTIFACT_NAME: linux-wheel | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| secrets: inherit | ||
|
|
||
| upload-wheels-windows: | ||
| name: 'Windows: Upload Wheels' | ||
| needs: [build-linux, build-windows] | ||
| uses: ./.github/workflows/reusable_upload_wheels.yml | ||
| with: | ||
| WHEEL_ARTIFACT_NAME: windows-wheel | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| secrets: inherit | ||
|
|
||
| upload-wheels-macos-arm: | ||
| name: 'Macos-Arm: Upload Wheels' | ||
| needs: [build-linux, build-macos-arm] | ||
| uses: ./.github/workflows/reusable_upload_wheels.yml | ||
| with: | ||
| WHEEL_ARTIFACT_NAME: macos-arm-wheel | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| secrets: inherit | ||
|
|
||
| upload-wheels-macos-intel: | ||
| name: 'Macos-Intel: Upload Wheels' | ||
| needs: [build-linux, build-macos-intel] | ||
| uses: ./.github/workflows/reusable_upload_wheels.yml | ||
| with: | ||
| WHEEL_ARTIFACT_NAME: macos-intel-wheel | ||
| RRD_ARTIFACT_NAME: linux-rrd | ||
| secrets: inherit | ||
|
|
||
| generate-pip-index: | ||
| name: 'Generate Pip Index' | ||
| needs: [upload-wheels-linux, upload-wheels-windows, upload-wheels-macos-arm, upload-wheels-macos-intel] | ||
| uses: ./.github/workflows/reusable_pip_index.yml | ||
| secrets: inherit | ||
|
|
||
| pre-release: | ||
| name: Pre Release | ||
| needs: [upload-web, generate-pip-index] | ||
| runs-on: "ubuntu-latest" | ||
| steps: | ||
| - name: Add SHORT_SHA env property with commit short sha | ||
| run: echo "SHORT_SHA=`echo ${{github.sha}} | cut -c1-7`" >> $GITHUB_ENV | ||
|
|
||
| # First delete the old prerelease. If we don't do this, we don't get things like | ||
| # proper source-archives and changelog info. | ||
| # https://github.com/dev-drprasad/delete-tag-and-release | ||
| - uses: dev-drprasad/[email protected] | ||
| with: | ||
| tag_name: prerelease | ||
| delete_release: true | ||
| env: | ||
| GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
|
|
||
| # Create the actual prerelease | ||
| # https://github.com/ncipollo/release-action | ||
| - name: GitHub Release | ||
| uses: ncipollo/[email protected] | ||
| with: | ||
| body: | | ||
| This is a prerelease. It is not intended for production use. | ||
| Please report any issues you find. | ||
| ## Example Hosted App | ||
| https://app.rerun.io/commit/${{ env.SHORT_SHA }} | ||
| ## Wheels can be installed with: | ||
| ``` | ||
| pip install --pre -f https://build.rerun.io/commit/${{ env.SHORT_SHA}}/wheels --upgrade rerun-sdk | ||
| ``` | ||
| prerelease: true | ||
| name: "Development Build" | ||
| tag: "prerelease" | ||
| token: ${{ secrets.GITHUB_TOKEN }} | ||
| generateReleaseNotes: true | ||
| allowUpdates: true | ||
| removeArtifacts: true | ||
| replacesArtifacts: true |
Oops, something went wrong.