[Test] Sweep the MQA logits indexer's M and N across prefill and decode - #5434

[Test] Sweep the MQA logits indexer's M and N across prefill and decode#5434

zhiding512 wants to merge 2 commits into

mainROCm/aiter:mainfrom

zhiding512/mqa-logits-op-testROCm/aiter:zhiding512/mqa-logits-op-testCopy head branch name to clipboard