Skip to content

Conversation

@xuzhao9
Copy link
Contributor

@xuzhao9 xuzhao9 commented Apr 7, 2023

Add v3 score field to the torch-nightly test.

Test plan:

$ python run_benchmark.py torch-nightly -c v3-cuda-tests.yaml --score ~/work/tb-v3/nightly/metrics-20230407145303.json
TorchBench score: 1000.0.

After changing the test latency to a larger value:

$ python run_benchmark.py torch-nightly -c v3-cuda-tests.yaml --score ~/work/tb-v3/nightly/metrics-20230407145303-larger.json
TorchBench score: 992.4067135827728.

After changing the test latency to a smaller value:

$ python run_benchmark.py torch-nightly -c v3-cuda-tests.yaml --score ~/work/tb-v3/nightly/metrics-20230407145303-smaller.json
TorchBench score: 1024.4664975604358.

@xuzhao9 xuzhao9 requested a review from weiwangmeta April 7, 2023 17:32
@xuzhao9 xuzhao9 changed the title Add v3 score field to the test [torch-nightly] Add v3 score field Apr 7, 2023
@facebook-github-bot
Copy link
Contributor

@xuzhao9 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@xuzhao9 merged this pull request in 90f07fd.

@xuzhao9 xuzhao9 deleted the xz9/add-v3-score branch April 7, 2023 19:34
cclauss pushed a commit to cclauss/benchmark that referenced this pull request Jan 22, 2025
* fix pytorch#1446 by removing the address operator

* add test

* format

---------

Co-authored-by: Thomas <[email protected]>
Co-authored-by: Dominic Hamon <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants