+2
Daily
9,471
stars
742
forks
106
watchers
71
prs
194
issues
6
releases
README
WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions
🏠 Home Page
🤗 HF Repo • 🐦 Twitter • 📃 [WizardLM] @ICLR2024 • 📃 [WizardCoder] @ICLR2024 • 📃 [WizardMath]
👋 Join our Discord
Unofficial Video Introductions
Thanks to the enthusiastic friends, their video introductions are more lively and interesting.
1. NEW WizardLM 70b 🔥 Giant Model...Insane Performance
2. GET WizardLM NOW! 7B LLM KING That Can Beat ChatGPT! I'm IMPRESSED!
3. WizardLM: Enhancing Large Language Models to Follow Complex Instructions
4. WizardCoder AI Is The NEW ChatGPT's Coding TWIN!
News
- 🔥🔥🔥[2024/01/04] We released WizardCoder-33B-V1.1 trained from deepseek-coder-33b-base, the SOTA OSS Code LLM on EvalPlus Leaderboard, achieves 79.9 pass@1 on HumanEval, 73.2 pass@1 on HumanEval-Plus, 78.9 pass@1 on MBPP, and 66.9 pass@1 on MBPP-Plus. WizardCoder-33B-V1.1 outperforms ChatGPT 3.5, Gemini Pro, and DeepSeek-Coder-33B-instruct on HumanEval and HumanEval-Plus pass@1. WizardCoder-33B-V1.1 is comparable with ChatGPT 3.5, and surpasses Gemini Pro on MBPP and MBPP-Plus pass@1.
- [2023/08/26] We released WizardCoder-Python-34B-V1.0 , which achieves the 73.2 pass@1 and surpasses GPT4 (2023/03/15), ChatGPT-3.5, and Claude2 on the HumanEval Benchmarks. For more details, please refer to WizardCoder.
- [2023/06/16] We released WizardCoder-15B-V1.0 , which surpasses Claude-Plus (+6.8), Bard (+15.3) and InstructCodeT5+ (+22.3) on the HumanEval Benchmarks. For more details, please refer to WizardCoder.
| Model | Checkpoint | Paper | HumanEval | HumanEval+ | MBPP | MBPP+ |
| ----- |------| ---- |------|-------| ----- | ----- |
| GPT-4-Turbo (Nov 2023) | - | - | 85.4 | 81.7 | 83.0 | 70.7 |
| GPT-4 (May 2023) | - | - | 88.4 | 76.8 | - | - |
| GPT-3.5-Turbo (Nov 2023) | - | - | 72.6 | 65.9 | 81.7 | 69.4 |
| Gemini Pro | - | - | 63.4 | 55.5 | 72.9 | 57.9 |
| DeepSeek-Coder-33B-instruct | - | - | 78.7 | 72.6 | 78.7 | 66.7 |
| WizardCoder-33B-V1.1 | 🤗 HF Link | 📃 [WizardCoder] | 79.9 | 73.2 | 78.9 | 66.9 |
| WizardCoder-Python-34B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 73.2 | 64.6 | 73.2 | 59.9 |
| WizardCoder-15B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 59.8 | 52.4 | -- | -- |
| WizardCoder-Python-13B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 64.0 | -- | -- | -- |
| WizardCoder-Python-7B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 55.5 | -- | -- | -- |
| WizardCoder-3B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 34.8 | -- | -- | -- |
| WizardCoder-1B-V1.0 | 🤗 HF Link | 📃 [WizardCoder] | 23.8 | -- | -- | -- |
- [12/19/2023] 🔥 We released WizardMath-7B-V1.1 trained from Mistral-7B, the SOTA 7B math LLM, achieves 83.2 pass@1 on GSM8k, and 33.0 pass@1 on MATH.
- [12/19/2023] 🔥 WizardMath-7B-V1.1 outperforms ChatGPT 3.5, Gemini Pro, Mixtral MOE, and Claude Instant on GSM8K pass@1.
- [12/19/2023] 🔥 WizardMath-7B-V1.1 is comparable with ChatGPT 3.5, Gemini PrTop issues
#4Remove "As an AI language model..." from dataset.14 comments · 2023-04-26#5978k evolved code instructions12 comments · 2023-06-15#99Licensing10 comments · 2023-06-28#79finetune on WizardCoder-15B-V1.09 comments · 2023-06-20#38from train import smart_tokenizer_and_embedding_resize7 comments · 2023-05-30#7Model does not obey follow up instructions very well(at all), compared to Vicuna for example7 comments · 2023-04-26#200How can I use multiple GPUs for inference.6 comments · 2023-09-04#140Batch inference6 comments · 2023-07-31
Latest release
Release v1.6 v1.6 2023-08-27🚀Major Update: Introducing WizardCoder 34B trained from Code Llama WizardCoder-34B surpasses GPT-4, ChatGPT-3.5 and Claude-2 on HumanEval with 73.2% pass@1 - 🖥️Demo: http://47.103.63.15:50085/ - 🏇Model Weights: https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0