alphastorm/omp-ninfer

Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.

Score70Python48 stars+0 stars / 7dOpen source

Why this repo matters

Latest release 0d ago, 10 developer signals, 1 package/install signals

Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state. (48 stars, 5 forks, Python, fresh release, 6 AI signals, 6 developer signals). Latest release: v0.17.0.

Repo analysis

Oh My Pi NInfer with Qwen3.8 27B Local Inference

The alphastorm/omp-ninfer repository provides durable local inference for Oh My Pi, integrating NInfer with the Qwen3.8 27B model. It is designed to run on a single RTX 3090, 4090, or 5090 GPU and supports restart-resumable OpenAI-compatible API responses.