AMMO toolkit with _GLIBCXX_USE_CXX11_ABI=0 #744
-
Hello everyone, Our LLM service, built on TensorRT-LLM and several libraries, now requires integration with the AMMO toolkit for model quantization. However, we've run into a challenge with the toolkit being released with We're wondering if there's a version of the AMMO library compatible with prebuilt PyTorch, thus eliminating the dependency on Any insights or guidance on this matter would be greatly appreciated. Thanks |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
@chenxu2048 Thanks |
Beta Was this translation helpful? Give feedback.
@chenxu2048
Can you share the concrete context/steps of reproducing your issue?
We have prepared PIP wheel package(wo CXX11 ABI) which depends on the installation of AMMO package and it works. I want to learn more of your concrete issues here.
Thanks
June