Human-Agent-Society /reef
Infrastructure for continually self‑improving agents
★ 7,829⑂ 739👁 512⑃ 1,033● 415▤ 5
+6
Daily
+40
Weekly
7,829
stars
739
forks
512
watchers
1,033
prs
415
issues
5
releases
README
Infrastructure for continually self‑improving agents English | 中文 Reef is the first open-source infrastructure for continual self-improving agents. It connects agent inference, feedback, learning, and versioned delivery. Use it to train model weights with Slime and SGLang, or improve an agent's harness, including its prompts, rules, and skills. 🚀 Get started | 🗺️ Roadmap | 🗓️ Office Hours | 📣 Launch post | 💬 Join Discord | 📱 Join WeChat Group 📰 News - 2026-11: We are refactoring Reef to a control plane + workers architecture. Some recipes and examples can fail on main until the refactor is complete. If a recipe fails, please open an issue. - 2026-11: A scenario can split its traffic across its served artifacts 1227, also through Semantic Router 859. The new python harness adapter evolves a Python program 1242. - 2026-10: Tinker runs as a training component 901. Episodes and agents can run in Modal Sandboxes 942. The artifact repository can live on Hugging Face 1003. New recipe: OPD 683. - 2026-09: reef-infra v0.1.0 is on PyPI. New recipes: GEPA, SDFT, SDPO and Meta-Harness. Reef serves the OpenAI Responses API at /v1/responses 528. - 2026-08: Reef is open source. Read the launch post. 🎯 When to use Reef Use Reef when you want your agent to keep improving simply by learning from how you interact with your agent. | Your goal | Learning path | What you need | |---|---|---| | Keep getting stronger model designed for you | Model weight training | A trainable model, a supported GPU stack, and feedback your recipe can use | | Get your harness to self-improve | Harness optimization | A model endpoint, representative tasks, and an evaluator; no local training GPUs | | Scientific discoveries | Test-time training | An execution environment, a correctness checker, and a measurable objective | 🧩 How Reef fits your stack | Ability | Inference engine (vLLM, SGLang, …) | RL training framework (Slime, veRL, AReaL, …) | Reef | |---|:---:|:---:|:---:| | Serves live traffic | ✅ | ❌ | ✅ | | Trains weights | ❌ | ✅ | ✅ | | Version management | ❌ | ❌ | ✅ | | Stays live through updates | ❌ | ❌ | ✅ | | Evolves beyond weights (skills, harness) | ❌ | ❌ | ✅ | 🔄 How it works Reef processes each learning cycle in four steps. The table also shows which modules implement each step. | Step | What happens | Where it lives | |---|---|---| | 1 · Serve | Serve agent requests and record interactions. | service/ — agent requests and interaction recordsinference/ — inference and artifact updates | | 2 · Observe | Match feedback to recorded interactions. | storage/records.py — stored interactions and feedbackrecord2sample/ — feedback matching, eligibility, and samples | | 3 · Grow | Produce an update from eligible records. | recipe/ — recipe integrationtrain/ — the training pipeline, job data, and training jobs | | 4 · Commit | Apply the configured selection policy and publish accepted updates. | evaluat
Top issues
#749[Community] Multimodal Roadmap (Draft)12 comments · 2026-10-10#645Reef daily activity report9 comments · 2026-09-24#1140[RFC] Keep every training sample as a data item, let each job name its samples, and give training backends one contract7 comments · 2026-11-03#938[RFC] Evolve harnesses through one workspace protocol for methods, evaluation, and templates5 comments · 2026-10-27#818[Community] Reef office hour agendas and minutes4 comments · 2026-10-15#748[RFC] Run each Reef component as a separately managed service4 comments · 2026-10-10#466[RFC] Evaluation-calibrated adaptive KL for online policy updates4 comments · 2026-09-14#1086[Task] Skill evolution: survey, then one recipe on an A workload (#1081 E)3 comments · 2026-11-02
Discussions
#165Show us what you are building with Reef0 comments · 2026-09-02#164Introduce yourself to the Reef community0 comments · 2026-09-02#163Welcome to Human Agent Society Discussions0 comments · 2026-09-02
Latest release
v0.1.3 v0.1.3 2026-10-14Highlights - Split training data preparation into record-to-record, record-to-task, and task-to-batch stages (766). - Add OPD recipes, generated-task training, and AutoEnvScaling examples (683, 707, 755, 790, 791). - Let recipes choose the training method for each job (695). - Support Slime weight publication to vLLM through the disk transport (710). - Share sandbox execution through Harbor environments (803). - Fix interrupted training recovery, engine startup port conflicts, relative artifact work directories, and OpenRouter web-search streams (728, 730, 723, 712, 769). Upgrade notes Thi
相关报道 (3)
News & coverage (5)
NatureSCSFish2025: a large dataset from South China sea for coral reef fish identification2025-08-17Science | AAASSeabirds boost coral reef resilience2023-12-06FrontiersFinding patterns of atoll morphometrics at a range of spatial scales2023-03-09NVIDIA DeveloperReal-Time AI Model Aims to Help Protect the Great Barrier Reef2022-06-02WCS NewsroomWORLD OCEANS DAY NEWS: Online Data Platform Gives Scientists New Tool For Understanding Climate Change Impacts on Coral Reefs2019-06-08