tensorchord /Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
★ 5,977⑂ 1,341👁 68⑃ 1,101● 35▤ 0
+0
Daily
5,977
stars
1,341
forks
68
watchers
1,101
prs
35
issues
0
releases
README
Awesome LLMOps
An awesome & curated list of the best LLMOps tools for developers.
[!NOTE]
Contributions are most welcome, please adhere to the contribution guidelines.
Table of Contents
- Awesome LLMOps
- Table of Contents
- Model
- Large Language Model
- CV Foundation Model
- Audio Foundation Model
- Robotics Foundation Model
- Serving
- Large Model Serving
- Frameworks/Servers for Serving
- Security
- Frameworks for LLM security
- Observability
- LLMOps
- Search
- Vector search
- Code AI
- Training
- IDEs and Workspaces
- Foundation Model Fine Tuning
- Frameworks for Training
- Experiment Tracking
- Visualization
- Model Editing
- Data
- Data Management
- Data Storage
- Data Tracking
- Feature Engineering
- Data/Feature enrichment
- Large Scale Deployment
- ML Platforms
- Workflow
- Scheduling
- Model Management
- Performance
- ML Compiler
- Profiling
- AutoML
- Optimizations
- Federated ML
- Awesome Lists
Model
Large Language Model
| Project | Details | Repository |
| ----------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------- |
| Alpaca | Code and documentation to train Stanford's Alpaca models, and generate the data. | !GitHub Badge |
| BELLE | A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca. | !GitHub Badge |
| Bloom | BigScience Large Open-science Open-access Multilingual Language Model | !GitHub Badge |
| dolly | Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform | !GitHub Badge |
| Falcon 40B | Falcon-40B-Instruct is a 40B parameters causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under Top issues
#547Add Dakera — self-hosted AI agent memory server (open core)0 comments · 2026-06-04#493Would an inference cost calculator fit this list?1 comments · 2026-05-20#314Add StoryRoute - production LLMOps travel storytelling app1 comments · 2026-03-22#185feat: Make sub-categories1 comments · 2024-12-23#769Resource suggestion: TANCO Skills for LLMOps guardrails, signal review, and verification0 comments · 2026-08-23#766Add Tokenade under Optimizations — cuts tokens sent by AI coding agents0 comments · 2026-08-21#698Add CorpusIQ -- MCP server for business data (Stripe, GA4, Shopify, 36 APIs)0 comments · 2026-07-26#650Add AI Router to AI Gateways / Managed gateway tooling0 comments · 2026-07-10