Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI test windows://python/ray/tests:test_chaos is consistently_failing #48462

Open
can-anyscale opened this issue Oct 31, 2024 · 69 comments
Open

CI test windows://python/ray/tests:test_chaos is consistently_failing #48462

can-anyscale opened this issue Oct 31, 2024 · 69 comments
Labels
bug Something that is supposed to be working; but isn't ci-test core Issues that should be addressed in Ray Core flaky-tracker Issue created via Flaky Test Tracker https://flaky-tests.ray.io/ jira-core P2 Important issue, but not time-critical ray-test-bot Issues managed by OSS test policy stability windows

Comments

@can-anyscale
Copy link
Collaborator

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/6764#0192df0b-ab32-4549-87ec-93ed1d48495d
- https://buildkite.com/ray-project/postmerge/builds/6687#0192c628-b1f1-4810-b85b-89e232c09daa
- https://buildkite.com/ray-project/postmerge/builds/6674#0192c100-5a80-4b1f-aa79-4d74a3444c8c

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy
@can-anyscale can-anyscale added bug Something that is supposed to be working; but isn't ci-test core Issues that should be addressed in Ray Core flaky-tracker Issue created via Flaky Test Tracker https://flaky-tests.ray.io/ ray-test-bot Issues managed by OSS test policy stability triage Needs triage (eg: priority, bug/not-bug, and owning component) weekly-release-blocker Issues that will be blocking Ray weekly releases labels Oct 31, 2024
@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/6773#0192e10f-5136-4f72-9ceb-4ba819013cef

@can-anyscale can-anyscale reopened this Nov 14, 2024
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/6950#01932759-3d09-403d-bf4a-6cac5e0931fd
- https://buildkite.com/ray-project/postmerge/builds/6940#01932423-0fe5-4a60-ad11-bc6af97f4e2e
- https://buildkite.com/ray-project/postmerge/builds/6913#01931d0d-5429-4da0-8e90-95a3250cffb4
- https://buildkite.com/ray-project/postmerge/builds/6902#01930e76-7b14-4570-b6be-193c3eb126c0

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/6955#0193294a-36be-4349-8bdd-63c96c9af2cf

@can-anyscale can-anyscale reopened this Nov 18, 2024
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/6982#01934041-2ff5-444f-a946-797ba1677b0c
- https://buildkite.com/ray-project/postmerge/builds/6950#01932759-3d09-403d-bf4a-6cac5e0931fd
- https://buildkite.com/ray-project/postmerge/builds/6940#01932423-0fe5-4a60-ad11-bc6af97f4e2e

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@jjyao jjyao added P2 Important issue, but not time-critical and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Nov 18, 2024
@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/6987#019341fb-358d-4373-8ca6-fc53293ed9a7

@can-anyscale can-anyscale reopened this Nov 26, 2024
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7087#01936526-ecd4-47e6-beb1-00ac7d54a1bd
- https://buildkite.com/ray-project/postmerge/builds/7052#019354d8-31dc-4b7c-950d-71c6c430b08c
- https://buildkite.com/ray-project/postmerge/builds/7044#0193516b-83de-4b4a-89e8-0d7bb4b629f9

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7096#019369e4-8205-4405-aba7-0a8c774eb82c

@can-anyscale can-anyscale reopened this Nov 27, 2024
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7103#01936a4c-f3e3-47d9-a7b0-89e277e9c4cb
- https://buildkite.com/ray-project/postmerge/builds/7087#01936526-ecd4-47e6-beb1-00ac7d54a1bd
- https://buildkite.com/ray-project/postmerge/builds/7052#019354d8-31dc-4b7c-950d-71c6c430b08c
- https://buildkite.com/ray-project/postmerge/builds/7044#0193516b-83de-4b4a-89e8-0d7bb4b629f9

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

1 similar comment
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7103#01936a4c-f3e3-47d9-a7b0-89e277e9c4cb
- https://buildkite.com/ray-project/postmerge/builds/7087#01936526-ecd4-47e6-beb1-00ac7d54a1bd
- https://buildkite.com/ray-project/postmerge/builds/7052#019354d8-31dc-4b7c-950d-71c6c430b08c
- https://buildkite.com/ray-project/postmerge/builds/7044#0193516b-83de-4b4a-89e8-0d7bb4b629f9

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7107#01936c51-4a88-4c41-86fe-a1abc04db33d

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7108#01936e98-a21d-4143-9269-a31334ddd44a

@can-anyscale can-anyscale reopened this Jan 28, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7945#0194ab87-9535-445b-95ad-6e922df160c3
- https://buildkite.com/ray-project/postmerge/builds/7926#0194a660-f567-4ee7-8874-1e1b45893252
- https://buildkite.com/ray-project/postmerge/builds/7905#019495db-c931-4dee-9734-954a03abb5c3

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7949#0194ade6-d0a5-4e8d-9e13-d3b6d66369e3

@can-anyscale can-anyscale changed the title CI test windows://python/ray/tests:test_chaos is flaky CI test windows://python/ray/tests:test_chaos is consistently_failing Jan 29, 2025
@can-anyscale can-anyscale reopened this Jan 29, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is consistently_failing. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7965#0194af9c-ce67-48f7-9b49-a9037627bae1
- https://buildkite.com/ray-project/postmerge/builds/7959#0194af18-6fc2-437d-a909-16f79bc69a1e
- https://buildkite.com/ray-project/postmerge/builds/7959#0194aebe-6fd0-417e-aab8-84d403a86253

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7965#0194b310-052d-4e14-96a8-a1e92d12d16d

@can-anyscale can-anyscale changed the title CI test windows://python/ray/tests:test_chaos is consistently_failing CI test windows://python/ray/tests:test_chaos is flaky Jan 30, 2025
@can-anyscale can-anyscale reopened this Jan 30, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7979#0194b4c2-8119-4702-b8cd-b2e760f96e77
- https://buildkite.com/ray-project/postmerge/builds/7965#0194af9c-ce67-48f7-9b49-a9037627bae1
- https://buildkite.com/ray-project/postmerge/builds/7959#0194af18-6fc2-437d-a909-16f79bc69a1e
- https://buildkite.com/ray-project/postmerge/builds/7959#0194aebe-6fd0-417e-aab8-84d403a86253

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7985#0194b870-e95a-42ab-b354-394b52e496a9

@can-anyscale can-anyscale reopened this Jan 31, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/7991#0194b9e9-2a7e-4a14-a54f-bad9143f1b93
- https://buildkite.com/ray-project/postmerge/builds/7979#0194b4c2-8119-4702-b8cd-b2e760f96e77
- https://buildkite.com/ray-project/postmerge/builds/7965#0194af9c-ce67-48f7-9b49-a9037627bae1
- https://buildkite.com/ray-project/postmerge/builds/7959#0194af18-6fc2-437d-a909-16f79bc69a1e

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/7998#0194beaa-5b1e-4a7f-9762-1fb41c29fbf9

@can-anyscale can-anyscale reopened this Feb 4, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/8023#0194ce80-33d8-4172-b88b-8c248a830293
- https://buildkite.com/ray-project/postmerge/builds/8017#0194cda6-c8b8-4a44-8a74-fd2cda44fc34
- https://buildkite.com/ray-project/postmerge/builds/8014#0194ca6e-5566-4868-b48b-48726f5ad4b2
- https://buildkite.com/ray-project/postmerge/builds/7991#0194b9e9-2a7e-4a14-a54f-bad9143f1b93

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/8045#0194d271-2056-4728-b50d-bbfdd4e15341

@can-anyscale
Copy link
Collaborator Author

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/8052#0194d2fb-3cf5-432f-b588-026ea0e7068f

@can-anyscale can-anyscale changed the title CI test windows://python/ray/tests:test_chaos is flaky CI test windows://python/ray/tests:test_chaos is consistently_failing Feb 5, 2025
@can-anyscale can-anyscale reopened this Feb 5, 2025
@can-anyscale
Copy link
Collaborator Author

CI test windows://python/ray/tests:test_chaos is consistently_failing. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/8063#0194d3e1-f945-4613-bc0e-b305b0b6785a
- https://buildkite.com/ray-project/postmerge/builds/8063#0194d3a8-3a84-4a46-8f68-8c24c2aeb258
- https://buildkite.com/ray-project/postmerge/builds/8023#0194ce80-33d8-4172-b88b-8c248a830293
- https://buildkite.com/ray-project/postmerge/builds/8017#0194cda6-c8b8-4a44-8a74-fd2cda44fc34

DataCaseName-windows://python/ray/tests:test_chaos-END
Managed by OSS Test Policy

@can-anyscale
Copy link
Collaborator Author

Blamed commit: 27e5850 found by bisect job https://buildkite.com/ray-project/release-tests-bisect/builds/2001

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something that is supposed to be working; but isn't ci-test core Issues that should be addressed in Ray Core flaky-tracker Issue created via Flaky Test Tracker https://flaky-tests.ray.io/ jira-core P2 Important issue, but not time-critical ray-test-bot Issues managed by OSS test policy stability windows
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@mattip @jjyao @MengjinYan @dayshah @can-anyscale