Janus
A Go server that runs local GGUF models and exposes them through an OpenAI-compatible API.
SITE CAPTUREBased on information published on the service's website. Selection and review policy
WHAT IT DOES
What does it do?
Janus runs local GGUF models on a GPU or CPU as a single Go binary. Its API can be called from curl, PowerShell, scripts, or clients such as Cursor and Cline. Getting-started instructions are available for Windows, Linux, and macOS.
KEY FEATURES
Key features
- Runs GGUF models on a computer's GPU or CPU.
- Provides an OpenAI-compatible API.
- Allows API calls from command-line tools and scripts.
- Connects to Cursor, Cline, and other OpenAI clients.