Change the repository type filter
All
Repositories list
540 repositories
- CUDA Core Compute Libraries
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- AIStore: scalable storage for AI applications
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
- BioNeMo Framework: For building and adapting AI models in drug discovery at scale
- CUDA Templates for Linear Algebra Subroutines
- NVIDIA device plugin for Kubernetes
spark-rapids-examples
Publick8s-operator-libs
Public- C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows
- the LLM vulnerability scanner
- TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
- Scalable data pre processing and curation toolkit for LLMs