+0
Daily
5,606
stars
901
forks
56
watchers
0
prs
13
issues
0
releases
README
SmolVLM real-time camera demo !demo This repository is a simple demo for how to use llama.cpp server with SmolVLM 500M to get real-time object detection How to setup 1. Install llama.cpp 2. Run llama-server -hf ggml-org/SmolVLM-500M-Instruct-GGUF Note: you may need to add -ngl 99 to enable GPU (if you are using NVidia/AMD/Intel GPU) Note (2): You can also try other models here 3. Open index.html 4. Optionally change the instruction (for example, make it returns JSON) 5. Click on "Start" and enjoy
Top issues
#6Ollama instead of llama.cpp10 comments · 2025-05-13#13Failed to parse messages: Unsupported content part type5 comments · 2025-05-16#9运行后模型一直在回复一些不相干的话语,描述的精准度很差很差3 comments · 2025-05-14#4Run this on Apple Silicon ?2 comments · 2025-05-13#19有人知道如何让模型使用指定的语言回复吗,比如中文?1 comments · 2025-06-03#12Could it used under a normal computer without the GPU? Thanks.1 comments · 2025-05-15#8Getting a JSON response1 comments · 2025-05-13#20Potential Application as Computer Using Agent or low delay Gaming Agent0 comments · 2025-12-19