Pinned Loading

1. large_language_monkeys large_language_monkeys Public

   Python 58 9

2. Archon Archon Public

   Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.

   Python 134 8

3. CATS CATS Public

   Python 20 5

4. hydragen hydragen Public

   Hydragen: High-Throughput LLM Inference with Shared Prefixes

   Python 26 3