+1
Daily
5,770
stars
493
forks
48
watchers
30
prs
358
issues
0
releases
README
🛠️ToolBench🤖 !Dialogues !Dialogues !Dialogues !Dialogues !Dialogues !Dialogues Model • Data Release • Web Demo • Tool Eval • Paper • Citation 🔨This project (ToolLLM) aims to construct open-source, large-scale, high-quality instruction tuning SFT data to facilitate the construction of powerful LLMs with general tool-use capability. We aim to empower open-source LLMs to master thousands of diverse real-world APIs. We achieve this by collecting a high-quality instruction-tuning dataset. It is constructed automatically using the latest ChatGPT (gpt-3.5-turbo-16k), which is upgraded with enhanced function call capabilities. We provide the dataset, the corresponding training and evaluation scripts, and a capable model ToolLLaMA fine-tuned on ToolBench. 2024.8 Update We have updated the RapidAPI server with a new IP, please make sure you get the latest code. You can also build it locally using codes here. 💁♂️💁💁♀️ Join Us on Discord! Read this in 中文. What's New - [2024/3/17] Welcome to StableToolBench: A stable and reliable local toolbench server based on API response simulation. Dive deeper into the tech behind StableToolBench with paper here and explore more on the project homepage. Codes are available here. - [2023/9/29] A new version ToolEval which is more stable and covers more models including GPT4! Please refer to ToolEval for more details. Besides, ToolLLaMA-2-7b-v2 is released with stronger tool-use capabilities. Please use the ToolLLaMA-2-7b-v2 model to reproduce our latest experimental results with the new version ToolEval. - [2023/8/30] Data updation, with more than 120,000 solution path annotations and intact reasoning thoughts! Please find data.zip on Google Drive. - [2023/8/8] No more hallucination! ToolLLaMA-2-7b-v1 (fine-tuned from LLaMA-2-7b) is released with lower API hallucination than ChatGPT. - [2023/8/4] We provide RapidAPI backend service to free you from using your own RapidAPI key and subscribing the APIs. Please fill out our form. We will review it as soon as possible and send you the ToolBench key to get start on it! - [2023/8/1] Our paper is released. - [2023/7/27] New version ToolBench is released. ✨Here is an overview of the dataset construction, training, and evaluation. ✨✨Features: - API Collection: we gather 16464 representational state transfer (REST) APIs from RapidAPI, a platform that hosts massive real-world APIs provided by developers. - Instruction Generation: we curate instructions that involve both single-tool and multi-tool scenarios. - Answer Annotation: we develop a novel depth-first search based decision tree (DFSDT) to bolster the planning and reasoning ability of LLMs, which significantly improves the annotation efficiency and successfully annotates those complex instructions that cannot be answered with CoT or ReACT. We provide responses that not only include the final answer but also incorporate the model's reasoning process, tool execution, and tool e
Top issues
#293Server挂了12 comments · 2024-08-01#342API Key8 comments · 2025-03-21#303Get refused connecting to the toolbench server6 comments · 2024-09-02#174{'message': 'You are not subscribed to this API.'}6 comments · 2023-10-10#373API Key Request5 comments · 2026-01-19#256ToolBench server returns 500 for all requests5 comments · 2024-04-03#141启动server5 comments · 2023-09-12#330g3测试数据3 comments · 2024-12-23