+0
Daily
+0
Weekly
+0
Monthly
7,834
stars
499
forks
106
watchers
271
prs
294
issues
0
releases
README
 English  | 中文
Building the Next Generation of Open-Source and Bilingual LLMs
🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel
👩🚀 Ask questions or discuss ideas on GitHub
👋 Join us on 👾 Discord or 💬 WeChat
📝 Check out Yi Tech Report
📚 Grow at Yi Learning Hub
💪 Learn at Yi Tech Blog
📕 Table of Contents
- What is Yi?
- Introduction
- Models
- Chat models
- Base models
- Model info
- News
- How to use Yi?
- Quick start
- Choose your path
- pip
- docker
- llama.cpp
- conda-lock
- Web demo
- Fine-tuning
- Quantization
- Deployment
- FAQ
- Learning hub
- Why Yi?
- Ecosystem
- Upstream
- Downstream
- Serving
- Quantization
- Fine-tuning
- API
- Benchmarks
- Base model performance
- Chat model performance
- Tech report
- Citation
- Who can use Yi?
- Misc.
- Acknowledgements
- Disclaimer
- License
What is Yi?
Introduction
- 🤖 The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI.
- 🙌 Targeted as a bilingual language model and trained on 3T multilingual corpus, the Yi series models become one of the strongest LLM worldwide, showing promise in language understanding, commonsense reasoning, reading comprehension, and more. For example,
- Yi-34B-Chat model landed in second place (following GPT-4 Turbo), outperforming other LLMs (such as GPT-4, Mixtral, Claude) on the AlpacaEval Leaderboard (based on data available up to January 2024).
- Yi-34B model ranked first among all existing open-source models (such as Falcon-180B, Llama-70B, Claude) in both English and Chinese on various benchmarks, including Hugging Face Open LLM Leaderboard (pre-trained) and C-Eval (based on data available up to November 2023).
- 🙏 (Credits to Llama) Thanks to the Transformer and Llama open-source communities, as they reduce the efforts required to build from scratch and enable the utilization of the same tools within the AI ecosystem.
If you're interested in Yi's adoption of Llama architecture and license usage policy, see Yi's relation with Llama. ⬇️
💡 TL;DR
The Yi series models adopt the same model architecture as Llama but are NOT derivatives of Llama.
- Both Yi and Llama are based on the Transformer structure, which has been the standard architecture for large language models since 2018.
- Grounded in the Transformer architecture, Llama has become a new cornerstone for the majority of state-of-the-art open-source models due to its excellent stability, reliable convergence, and robust compatibility. This positions Llama as the recognized foundational framework for models including Yi.
- Thanks to the Transformer and Llama architectures, other models can leverage their power, reducing the effort required to build from scratch and enabling the utilization of