Best GitHub Repos

The 12 best GitHub repos for LLM serving

Browse all top repos for LLM serving

12 repos

Ollama

★ 180k · Go · Active

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

LLM serving

llama.cpp

★ 125k · C++ · Active

A few options to get llama.cpp installed on your machine: Visit https://llama.

LLM serving

vLLM

★ 89k · Python · Active

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM serving

Unsloth

★ 74k · Python · Active

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

LLM serving

GPT4Free

★ 67k · Python · Active

The official gpt4free repository. various collection of powerful language models. opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

LLM serving

LiteLLM

★ 57k · Python · Active

The fastest, litest AI Gateway. Rust core with Python SDK.

LLM serving

AirLLM

★ 32k · Jupyter Notebook · Active

AirLLM 70B inference with single 4GB GPU

LLM serving

Gitleaks

★ 29k · Go · Active

Find secrets with Gitleaks

LLM servingDeveloper tools

Dyad

★ 21k · TypeScript · Active

Local, open-source AI app builder for power users v0 / Lovable / Replit / Bolt alternative Star if you like it!

AI interfacesLLM serving

Skypilot

★ 11k · Python · Active

The AI Compute Platform for frontier teams.

LLM servingLearning

ClawRouter

★ 6.6k · TypeScript · Active

The agent-native LLM router for autonomous agents. 66 models (8 free), <1ms local routing, USDC payments on Base & Solana via x402.

LLM serving

LM Studio CLI

★ 5.2k · TypeScript · Active

lms - Command Line Tool for LM Studio Built with lmstudio.

LLM serving