Package · Apache-2.0
A local-first, license-aware Python framework for serving modern computer vision models through a unified Python API, CLI, and HTTP REST gateway. 39 commercial-safe core models. No data leaves your machine.
VisionServeX is an open-source Python framework for running modern computer vision models locally and exposing them through a stable HTTP API. It works as a local model gateway: start it once, call any supported model through one clean API, on your own hardware, with no data leaving your machine.
Every model in the registry carries an explicit license classification, an honest availability status, and a clear commercial posture. Blockers are documented — not hidden. If a model is unavailable, VisionServeX tells you exactly why and what to do next.
pip install 'visionservex[hf,rfdetr]'
The base package requires Python 3.10+ and PyTorch. Optional extras ([hf],
[rfdetr], [server], [anomaly], [dino])
activate specific model families on demand.
visionservex --version visionservex getting-started # personalized setup guide # Detection (RF-DETR, no token needed) visionservex detect rfdetr-small image.jpg # Segmentation (SAM2.1, no token needed) visionservex sam-family smoke-test sam2.1-hiera-small image.jpg # HTTP gateway visionservex serve # http://127.0.0.1:8080 curl -F "[email protected]" -F "model_id=rfdetr-small" \ http://127.0.0.1:8080/detect | jq
from visionservex import VisionModel, VSX
# Direct inference (no server needed)
result = VisionModel("rfdetr-small").predict("image.jpg")
result.to_json()
# SAM2 segmentation
VSX.sam("sam2.1-hiera-small").segment("image.jpg", box=[10, 20, 200, 220])
# DINOv2 embedding (Apache-2.0, no token required)
VSX.dino("dinov2-base").embed("image.jpg")
D-FINE (n/s/m/l/x variants)RF-DETR (nano/small/medium/large)[hf] or [rfdetr]SAM v1, SAM 2, SAM 2.1 — promptable, no tokenRF-DETR-Seg — instance segmentationSAM3 / SAM3.1 — BYOT gated (HF token + license)MedSAM — medical, research onlyDINOv2 (s/b/l/g) — Apache-2.0, no tokenCLIP, SigLIP2 — no tokenDINOv3 — BYOT gated[hf]Grounding DINO (tiny, swin-b) — no tokenOWL-ViT, OWLv2 — no token[hf]Florence-2 (base, large)[hf] in isolated envSwinV2, ConvNeXtV2, MaxViT — no tokendepth-anything-small — no tokenDINOv3 + CHMv2 DPT — BYOT depth headPatchCore, PaDiM via anomalib[anomaly]127.0.0.1:8080 by default[server]Every model in VisionServeX's registry is explicitly classified into one of four categories:
| Category | Runs locally? | Token needed? | Commercial-safe? |
|---|---|---|---|
| Commercial-safe core (39 models) | Yes | No | Yes (Apache-2.0 / MIT) |
| BYOT gated (SAM3, SAM3.1, DINOv3) | Yes, after access | Yes (HF token + upstream license) | Depends on upstream license you accepted |
| Research / non-commercial | Maybe | Maybe | No |
| External API only | No local weights | Provider key | Depends on provider terms |
The commercial-safe core includes SAM v1/2/2.1, DINOv2, RF-DETR family, Grounding DINO (open variants), Florence-2, CLIP, OWLv2, SigLIP2, SwinV2, ConvNeXtV2, and more — no token required; weights download from official upstream sources on demand.
SAM3, SAM3.1, and DINOv3 are gated on Hugging Face. VisionServeX provides a clean BYOT path: supply your own HF token, accept the upstream license once, and weights stay in your local cache.
# Connect your HF token visionservex hf connect --token-env HF_TOKEN # Check status (no download) visionservex hf status visionservex hf check-model facebook/sam3 # Pull after accepting the upstream license visionservex model pull sam3-base --accept-upstream-license visionservex model doctor sam3-base
127.0.0.1 by default; images never leave your machinepip install visionservex