Best Open-Source Inference platforms options.
Candidates with open-source, open-weight, downloadable pretrained, or self-hosted signals from source metadata. Automated radar for model serving, serverless inference, GPU clouds, routers, gateways, and local inference engines. Rankings use existing source-backed radar data and do not invent prices, benchmark scores, release dates, or capabilities.
NVIDIA NIM Model Catalog
Highest automated fit score using source-backed task evidence and radar signals.
NVIDIA NIM Model Catalog
Strong candidate when the source metadata indicates API or hosted-service availability.
NVIDIA NIM Model Catalog
Strong candidate when open weights, GitHub, permissive license, or self-hosting signals are visible.
| # | Candidate | Type | Access | Source | Fit | Updated | Why it matched | Evidence |
|---|---|---|---|---|---|---|---|---|
| 01 | NVIDIA NIM Model CatalogNVIDIA inference platform | service | Free endpoint | Official inference catalog | Score77 | Jun 26, 2026 | Matched inference platform, model serving; 3 source links; official inference catalog signal; access model: Free endpoint | build.nvidia.com |
| 02 | OpenVINO Open Model ZooIntel OpenVINO model zoo | service | Downloadable pretrained | Official model zoo | Score70 | Jun 26, 2026 | Matched model serving, local inference; 2 source links; official model zoo signal; access model: Downloadable pretrained | github.com |
| 03 | STM32 AI Model ZooSTMicroelectronics model zoo | service | Downloadable pretrained | Official model zoo | Score64 | Jun 26, 2026 | Matched local inference, quantization; 1 source link; official model zoo signal; access model: Downloadable pretrained | github.com |
| 04 | earlvanze/sage-routerPython repository | repo | Open source | GitHub | Score56 | Jul 2, 2026 | Matched model router, llm gateway, ollama; 1 source link; access model: Open source; open weights signal | github.com |
Track Inference platforms changes
The model, API, pricing and tooling changes that matter, in one morning email with links to the original sources. Free, unsubscribe in one click.
Prefer topic alerts or a custom RSS feed?