开源精选 · 开源大模型

最好的开源大模型

每日更新。60 个项目,按 star 排序,并核对 fork 与维护活跃度。

开源大模型 镇场榜

成熟且仍在更新的项目。GitHub 上标注了 large-language-models, local-llm。

  1. langflow-ai/langflow Python ★ 155,670 本周 +346

    Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

  2. rasbt/LLMs-from-scratch Jupyter Notebook ★ 106,533 本周 +392

    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

  3. mlabonne/llm-course ★ 83,584 本周 +301 最近提交在半年前

    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  4. hiyouga/LlamaFactory Python ★ 75,476 本周 +149

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  5. binary-husky/gpt_academic Python ★ 71,475 本周 +86 最近提交在半年前

    为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

  6. bojieli/ai-agent-book Python ★ 54,228 本周 +1,440

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

  7. HKUDS/nanobot Python ★ 49,034 本周 +236

    Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps

  8. ray-project/ray Python ★ 44,029 本周 +57

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  9. HKUDS/LightRAG Python ★ 40,136 本周 +142

    [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

  10. google/langextract Python ★ 38,949 本周 +42

    A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

  11. langfuse/langfuse TypeScript ★ 35,828 本周 +352

    🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

  12. agentscope-ai/agentscope Python ★ 33,257 本周 +409

    Build and run agents you can see, understand and trust.

  13. aishwaryanr/awesome-generative-ai-guide HTML ★ 29,811 本周 +110

    A one stop repository for generative AI research updates, interview resources, notebooks and much more!

  14. HandsOnLLM/Hands-On-Large-Language-Models Jupyter Notebook ★ 29,588 本周 +76

    Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

  15. deepset-ai/haystack Python ★ 26,742 本周 +63

    Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

  16. mozilla-ai/llamafile C++ ★ 26,243 本周 +58

    Distribute and run LLMs with a single file.

  17. dipakkr/awesome-ai-engineering ★ 22,382 本周 +59

    🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.

  18. QwenLM/Qwen Python ★ 21,916 本周 +37 最近提交在半年前

    The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

  19. AI4Finance-Foundation/FinGPT Jupyter Notebook ★ 21,404 本周 +38

    FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

  20. stefan-jansen/machine-learning-for-trading Jupyter Notebook ★ 21,349 本周 +103

    Code for Machine Learning for Trading, 3rd edition - from data sourcing to live execution.

  21. stas00/ml-engineering Python ★ 19,524 本周 +122

    Machine Learning Engineering Open Book

  22. ymcui/Chinese-LLaMA-Alpaca Python ★ 18,930 本周 +4

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

  23. NVIDIA/Megatron-LM Python ★ 18,153 本周 +70

    Ongoing research training transformer models at scale

  24. :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  25. camel-ai/camel Python ★ 17,887 本周 +74

    🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

  26. GoogleCloudPlatform/generative-ai Jupyter Notebook ★ 17,803 本周 +25

    Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform

  27. GreyDGL/PentestGPT Python ★ 15,947 本周 +145

    Automated Penetration Testing Agentic Framework Powered by Large Language Models

  28. Lightning-AI/litgpt Python ★ 13,705 本周 +12

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  29. neuml/txtai Python ★ 13,018 本周 +29

    💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  30. steven2358/awesome-generative-ai ★ 12,738 本周 +26

    A curated list of modern Generative Artificial Intelligence projects and services

  31. Pocket Flow: Codebase to Tutorial

  32. sapientinc/HRM Python ★ 12,656 本周 +6 最近提交在半年前

    Hierarchical Reasoning Model Official Release

  33. OpenMOSS/MOSS Python ★ 12,264 本周 +4

    An open-source, tool-augmented conversational language model from Fudan University

  34. FareedKhan-dev/train-llm-from-scratch Python ★ 12,128 本周 +121

    A straightforward method for training your LLM, from downloading data to generating text.

  35. The-Pocket/PocketFlow Python ★ 11,243 本周 +22

    Pocket Flow: 100-line LLM framework. Let Agents build Agents!

  36. KalyanKS-NLP/llm-engineer-toolkit ★ 10,889 本周 +9

    A curated list of 120+ LLM libraries category wise.

  37. Mooler0410/LLMsPracticalGuide ★ 10,204 最近提交在半年前

    A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

  38. OpenRLHF/OpenRLHF Python ★ 10,088 本周 +15

    An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

  39. Tiiny-AI/PowerInfer C++ ★ 9,828 本周 +11

    High-speed Large Language Model Serving for Local Deployment

  40. yzhao062/anomaly-detection-resources Python ★ 9,413 本周 +10 最近提交在半年前

    Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!

开源大模型 新秀榜

近 90 天新建、涨势最猛的项目。

  1. syv-ai/HyperQwen Python ★ 2,009 本周 +109

    Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

  2. TokenRhythm/NeoHorse Python ★ 1,730 本周 +57

    NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness.

  3. youngyangyang04/llm-master ★ 1,284 本周 +145

    大模型(LLM)全栈学习路线与中文教程🔥:覆盖 Prompt Engineering、RAG、AI Agent、MCP、微调、模型部署、Transformer、AI 编程与大厂面试,从入门到生产实践。

  4. StayLameBro/backburner Python ★ 1,008 本周 +153

    Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

  5. peonist-ai/halogen-flash-server Shell ★ 976 本周 +97

    The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

  6. gavamedia/deltafin Rust ★ 849 本周 +21

    Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

  7. mw00/project-maya C++ ★ 840 本周 +763

    Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

  8. whitecircle/halo Python ★ 824 本周 +7

    Halo is an open-source framework built by White Circle for training large language and multimodal models

  9. xinxuxin/keystone-bench Python ★ 713 本周 +124 star 涨幅快过 fork

    A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

  10. leonickson1/Swiftlet Swift ★ 659 本周 +5

    Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

  11. Nehanth/pooled JavaScript ★ 588 本周 +14

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

  12. amitshekhariitbhu/ai-engineering-course Markdown ★ 529 本周 +15

    AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Networks, and Transformers to LLMs, Fine-Tuning, RAG, AI Agents, LLM Inference, Evaluation, AI Safety, and AI System Design.

  13. Yzw202011/OmniSpace Python ★ 514 本周 +108

    本地优先的全栈 AI 创作工作站:AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块;vLLM / llama.cpp / Transformers 多引擎本地推理,显存智能调度、舱壁隔离自愈、仅供学习使用,欢迎交流指正。(最新进度(除插件系统)受到协议限制,暂时无法提交到仓库)

  14. carloslfu/slotstream Swift ★ 467 本周 +46

    Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to 64 GB. One native Swift binary on MLX and Metal, no Python, offline. Works with Claude Code, Codex and Ollama or OpenAI clients.

  15. prabanta-dev/janas C ★ 391 本周 +359

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

  16. Wassimyounes01/qwen38-uncensored JavaScript ★ 361 本周 +28

    Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack. Official 3.8 weights, not a 3.6 retitle.

  17. TaoLiveAIGC/TLive-Omni Python ★ 354 本周 +2 star 涨幅快过 fork

    TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming

  18. amitshekhariitbhu/llm-inference-engineering Markdown ★ 319 本周 +17

    Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

  19. ThinkOffApp/CarWatch Python ★ 298 本周 +4

    Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

  20. ANDRETRIPOL/OpenGhost JavaScript ★ 268 本周 +22

    Open desktop AI agent for Windows, macOS and Linux, written from scratch: its own agent engine, its own browser tooling and its own drawing engine that shows what it explains.

这份榜单怎么来的

候选来自 GitHub 话题标签 large-language-models, local-llm。star 数与周增长取自 GitHub 官方的 star 历史接口,因此数字与 GitHub 自己的口径一致。榜单收录活跃、话题数量至多 20 个的仓库。某个项目的 star 数相对 fork 数明显偏高时会被标注,可结合仓库活动进一步了解原因。