Jinfer
A modular AI inference engine that runs entirely inside the JVM without a sidecar
SITE CAPTUREBased on information published on the service's website. Selection and review policy
WHAT IT DOES
What does it do?
Jinfer is an AI inference engine for the JVM that provides chat, vision, embeddings, and text-to-speech. It integrates with Spring AI and LangChain4j and can read and write GGUF and Safetensors formats in pure Java. With GraalVM Native Image, it can be built as a single self-contained binary that runs without a JVM.
KEY FEATURES
Key features
- Chat, vision, embedding, and text-to-speech inference
- Integration with Spring AI and LangChain4j
- Quantized matrix multiplication routines
- Customizable TikToken-compatible tokenizer
- Reading and writing GGUF and Safetensors
- Creation of self-contained binaries with GraalVM Native Image