Popular repositories Loading

1. LLMCompiler LLMCompiler Public

   [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

   Python 1.7k 123

2. SqueezeLLM SqueezeLLM Public

   [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

   Python 697 48

3. TinyAgent TinyAgent Public

   [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!

   Python 425 69

4. KVQuant KVQuant Public

   [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

   Python 362 31

5. LLM2LLM LLM2LLM Public

   [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

   Python 186 14

6. SqueezedAttention SqueezedAttention Public

   SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference

   Python 50 8