Skip to content

ci: tests now run with HF_DATASETS_CACHE to speed up e2e time#41

Merged
terrykong merged 4 commits intomainfrom
functional-fix
Mar 24, 2025
Merged

ci: tests now run with HF_DATASETS_CACHE to speed up e2e time#41
terrykong merged 4 commits intomainfrom
functional-fix

Conversation

@terrykong
Copy link
Collaborator

@terrykong terrykong commented Mar 24, 2025

What does this PR do ?

Previously our functional tests timedout b/c it had to fetch all the datasets. This change adds HF_DATASETS_CACHE to avoid downloading squad/openmath over and over.

Issues

List issues that this PR closes (syntax):

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this 

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

@github-actions github-actions bot added the CI Relating to CI label Mar 24, 2025
@terrykong terrykong marked this pull request as draft March 24, 2025 06:15
@terrykong terrykong changed the title ci: functional tests should run with HF_DATASETS_CACHE ci: tests now run with HF_DATASETS_CACHE/UV_CACHE_DIR to speed up Mar 24, 2025
@terrykong terrykong changed the title ci: tests now run with HF_DATASETS_CACHE/UV_CACHE_DIR to speed up ci: tests now run with HF_DATASETS_CACHE to speed up Mar 24, 2025
Signed-off-by: Terry Kong <terryk@nvidia.com>

now run grpo

Signed-off-by: Terry Kong <terryk@nvidia.com>

more args

Signed-off-by: Terry Kong <terryk@nvidia.com>

trying again

Signed-off-by: Terry Kong <terryk@nvidia.com>

trying with ultra short uv cache dirname

Signed-off-by: Terry Kong <terryk@nvidia.com>

lower val batches b/c took 10min to do val

Signed-off-by: Terry Kong <terryk@nvidia.com>

give this a shot

Signed-off-by: Terry Kong <terryk@nvidia.com>

With all datasets downloaded, re-enable functional tests

Signed-off-by: Terry Kong <terryk@nvidia.com>

lint

Signed-off-by: Terry Kong <terryk@nvidia.com>

fix some stuff

Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
@terrykong terrykong changed the title ci: tests now run with HF_DATASETS_CACHE to speed up ci: tests now run with HF_DATASETS_CACHE to speed up e2e time Mar 24, 2025
Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
@terrykong terrykong marked this pull request as ready for review March 24, 2025 22:39
@terrykong terrykong requested a review from parthchadha March 24, 2025 22:50
@terrykong terrykong enabled auto-merge (squash) March 24, 2025 23:18
@terrykong terrykong merged commit 6a324e8 into main Mar 24, 2025
15 checks passed
@terrykong terrykong deleted the functional-fix branch March 24, 2025 23:22
KiddoZhu pushed a commit that referenced this pull request May 6, 2025
Signed-off-by: Terry Kong <terryk@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Relating to CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants