ngxson /smolvlm-realtime-webcam

Real-time webcam demo with SmolVLM and llama.cpp server

★ 5,606⑂ 901👁 56⑃ 0● 13▤ 0
HTMLNOASSERTIONCreated 2025-05-12github.ngxson.com/smolvlm-realtime-webcam/
+0
Daily
5,606
stars
901
forks
56
watchers
0
prs
13
issues
0
releases

README

SmolVLM real-time camera demo

!demo

This repository is a simple demo for how to use llama.cpp server with SmolVLM 500M to get real-time object detection

 How to setup

1. Install llama.cpp
2. Run llama-server -hf ggml-org/SmolVLM-500M-Instruct-GGUF  
   Note: you may need to add -ngl 99 to enable GPU (if you are using NVidia/AMD/Intel GPU)  
   Note (2): You can also try other models here
3. Open index.html
4. Optionally change the instruction (for example, make it returns JSON)
5. Click on "Start" and enjoy

Top issues

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON