GitHub Trending Archive

LLM Inference GitHub Trending Projects

Based on the 2026-07-21 board, 3 popular repositories related to LLM Inference are included.

LLM inference, model serving, and production applications.

LLM Inference related repositories

bojieli/ai-agent-book

Open-source book covering AI Agent design principles and engineering practice with 10 chapters and 88 experiments.

LanguagePython · Total Stars14,344 · Today:+4,434

AstrBotDevs/AstrBot

Open-source AI agent framework integrating IM platforms and LLMs for building chatbots.

LanguagePython · Total Stars37,447 · Today:+416

AlexsJones/llmfit

A Rust terminal tool that detects hardware and scores LLM models to find the best fit for your system.

LanguageRust · Total Stars30,179 · Today:+194

Trend in recent 7 valid days

Explore other topics