[Bugfix] Fix Sparse24 Compressed Tensors models

[kylesayrs]

Purpose

• Fix sparse24 compressed tensors models

Background

#30141 introduced a check against config_groups in the compressed tensors config. However, the config_groups field is not populated in the case of sparse24 models.

This regression should have been caught by tests/quantization/test_compressed_tensors.py::test_compressed_tensors_2of4_sparse, however this test is skipped by the CI because the CI runs with CC<90. A broader discussion should be had as to whether quantization tests should be run with higher CC, likely accompanied with a pruning of existing quantization tests.

Changes

• Check for existence of config_groups field before filtering out Attention groups
• Change sparse24 CC logic to check for exactly hopper (sparse24 kernels are not forwards compatible)

Testing

• test_compressed_tensors_2of4_sparse and test_compressed_tensors_2of4_sparse_compressed previously failed but now passes on hopper machine
• Tested sanity with nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e on hopper machine

[gemini-code-assist]

Code Review

This pull request addresses a regression that caused a KeyError when loading sparse24 compressed tensor models. The fix involves adding a check to ensure the config_groups key exists in the configuration dictionary before attempting to process it. This is a correct and necessary change that prevents the crash. The implementation is clear and directly solves the issue. I approve these changes.

[kylesayrs]

@dsikka @tlrmchlsmth

[mgoin]

Can we just remove 24 sparsity instead?