Pinned Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++ 103 21

2. ollama ollama Public

   Forked from ollama/ollama

   Get up and running with Llama 3, Mistral, Gemma, and other large language models.

   Go 30 14

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 1

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 2