Skip to content

Conversation

@wesm
Copy link
Member

@wesm wesm commented Sep 7, 2019

This will help with making the Arrow community aware of extra-CI jobs that are failing.

It's intended to be used like this

JOB_NAME=$(python crossbow.py latest-prefix nightly)
python crossbow.py report $JOB_NAME

Example output: https://gist.github.com/wesm/6271bedaa4c49c675e12050784d847f4

It's a bit tedious to test. Someone (me?) will need to set up a cron job to send a daily e-mail about the nightlies running on https://github.com/ursa-labs/crossbow

@kszucs
Copy link
Member

kszucs commented Sep 8, 2019

Did some refactoring in #5296, I'll rebase it.

@fsaintjacques
Copy link
Contributor

You can use travis for cron scheduling.

@wesm
Copy link
Member Author

wesm commented Sep 8, 2019

Don't think Travis will work. The polling may need to run longer than 1 hour

@wesm wesm closed this Sep 9, 2019
kszucs added a commit that referenced this pull request Sep 10, 2019
This is a rebased version of #5319. Crossbow had a major refactoring in #5296 so the two implementation have diverged.

Closes #5332 from kszucs/crossbow-report and squashes the following commits:

ed62de4 <Krisztián Szűcs> unused import
76a3269 <Krisztián Szűcs> share output redirection; use pass_obj instead of pass_context
9a0069c <Krisztián Szűcs> start incrementing from 0
16015d2 <Krisztián Szűcs> merge tests.yaml with tasks.yaml
00f5766 <Krisztián Szűcs> latest-prefix
162a0fb <Krisztián Szűcs> polling
1a8790f <Wes McKinney> Add polling logic to wait for job completion
6aa2a7e <Wes McKinney> Test disabling stop_if_pending
3e4580a <Wes McKinney> Implement e-mail report for a Crossbow job

Lead-authored-by: Krisztián Szűcs <[email protected]>
Co-authored-by: Wes McKinney <[email protected]>
Signed-off-by: Krisztián Szűcs <[email protected]>
pprudhvi pushed a commit to pprudhvi/arrow that referenced this pull request Sep 16, 2019
This is a rebased version of apache#5319. Crossbow had a major refactoring in apache#5296 so the two implementation have diverged.

Closes apache#5332 from kszucs/crossbow-report and squashes the following commits:

ed62de4 <Krisztián Szűcs> unused import
76a3269 <Krisztián Szűcs> share output redirection; use pass_obj instead of pass_context
9a0069c <Krisztián Szűcs> start incrementing from 0
16015d2 <Krisztián Szűcs> merge tests.yaml with tasks.yaml
00f5766 <Krisztián Szűcs> latest-prefix
162a0fb <Krisztián Szűcs> polling
1a8790f <Wes McKinney> Add polling logic to wait for job completion
6aa2a7e <Wes McKinney> Test disabling stop_if_pending
3e4580a <Wes McKinney> Implement e-mail report for a Crossbow job

Lead-authored-by: Krisztián Szűcs <[email protected]>
Co-authored-by: Wes McKinney <[email protected]>
Signed-off-by: Krisztián Szűcs <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants