huggingface
Mica, a 4B decision model that returns a probability for each allowed answer.
SITE CAPTUREBased on information published on the service's website. Selection and review policy
WHAT IT DOES
What does it do?
Mica v0.5-4B accepts input of up to 32k tokens, a question, and allowed answers, then returns a probability for each answer. It does not generate free-form text, so its output does not need separate parsing. Low-confidence cases can be deferred using a threshold. Instructions are provided for using it through llama.cpp, Ollama, and other tools.
KEY FEATURES
Key features
- Return a probability for each specified answer
- Accept logs, traces, documents, and JSON as input
- Apply multiple questions to one input
- Flag low-confidence cases with abstain_threshold
- Run the model with llama.cpp and Ollama