remove-occupancy-nvrtc-dependency

[yanqinz2]

Before submitting

• I agree to license this contribution under the terms of LICENSE.txt.
• I ran pre-commit run and committed any formatting changes.
• I added GitHub labels: one cat-*, one or more mod-*, and one orig-* (see label list).

Affected area

Summary

Remove nvrtc dependency when calculating the occupancy map, to fix the ci issue

Related issues

API and compatibility impact

Testing

Summary by CodeRabbit

• Performance

  • Improved GPU occupancy detection for newer SM90-class devices by using precompiled resources, reducing runtime compilation overhead.
  • Added cached detection of each device’s multiprocessor count for faster repeated queries.

• Compatibility

  • Added reliable fallback occupancy behavior for older GPU architectures, including support for single-cluster workloads.

[coderabbitai]

📝 Walkthrough

Walkthrough

Changes

Device-Aware Occupancy Probing

Layer / File(s)	Summary
Multiprocessor count query python/cudnn/frost/device.py	Adds a cached CUDA driver query for a device’s multiprocessor count.
Occupancy map capability handling python/cudnn/frost/occupancy.py	Uses precompiled SM90 PTX for occupancy probing and returns fallback values for devices below SM90.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: anerudhan

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Description check	⚠️ Warning	The description includes a summary but omits the affected area, rationale, API impact, and testing details.	Select the affected area and complete the Why, API and compatibility impact, and Testing sections.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Title check	✅ Passed	The title clearly and concisely states that the NVRTC dependency is removed from occupancy processing.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}

[Anerudhan]

@cudnn-ci-bot run frost

[cudnn-ci-bot]

🚀 Running mirror pipeline

Branch: cudnn-gh/pr-494-ef71629
Pipeline: 61448138
Targets: frost