S
SARVAM AI / sarvamai/prism · API sarvam-prism

Sarvam Prism

Sarvam AI decision model released on November 3 and based on Sarvam 105B. It processes state, questions and options and returns probabilities in a single pass. It neither generates free text nor accepts images. FP8 weights are published and the API uses sarvam-prism through POST /v2/systemone.

01 / SUMMARY

The essential

ORIENTATIONDecisions with calibrated probabilities

Primary use stated or inferred cautiously from official documentation.

CONTEXTAPI: 32,768 tokens per question; weights: 131,072

Maximum input capacity when published by the source.

EXITProbability per option, without text generation

Documented maximum generation limit.

ACCESSHugging Face and Sarvam API

Verified availability channels.

MODEL TYPEClassification and decision

Primary functional family and verified specialties.

LICENSEApache 2.0

Declared terms for API access, model weights, or self-hosting.

02 / TECHNICAL SHEET

Limits and integration

API IDsarvamai/prism · API sarvam-prism
Model typeClassification and decision
Access modelOpen weights
LicenseApache 2.0
DeploymentSelf-hosted
Release03 NOV 2026
Knowledge cutoffNot published
EntranceText · JSON
ExitProbabilities and typed values
Context windowAPI: 32,768 tokens per question; weights: 131,072
maximum outputProbability per option, without text generation
ReasoningNot published
Published tools
Structured OutingsNot published
Batch processingNot published
Prompt cacheNot published
Fine-tuningNot published
Verified platformsHugging Face · PyTorch
BEST SUITED FOR

Request classification, moderation, selection among options and assessment of agent runs. Supports choice, yes/no and ordered-scale questions. Confidence must be validated in the real domain; a high probability does not replace available evidence or eliminate bias risk.

WORTH MONITORING

The API limits each question to 32,768 tokens, while the weights document 131,072. These channels must not be confused. Local code uses a custom FP8 format, around 106 GB of disk and about 120 GB of free GPU memory. It is not loaded as AutoModelForCausalLM. Speed was validated on B200.

03 / CAPABILITIES

What it can do

01

Orientation

Request classification, moderation, selection among options and assessment of agent runs. Supports choice, yes/no and ordered-scale questions. Confidence must be validated in the real domain; a high probability does not replace available evidence or eliminate bias risk.

02

Context

API: 32,768 tokens per question; weights: 131,072 · Probability per option, without text generation

03

Tools and integration

Not published

04

Access

Hugging Face and Sarvam API

Input modalities
TextJSON
04 / PRICES

Documented cost

ConceptWorthUnit/condition
Standard input4 INR / 1M tokens in the APIStandard API rate
Cached inputNot publishedReading reused prefixes
Cache write or storageNot publishedThe condition varies by provider
Standard output0 INR for output in the APIMay include reasoning tokens
Batch inputNot publishedAsynchronous processing
Batch outputNot publishedAsynchronous processing

Sarvam lists 4 INR per million input tokens and 0 INR for output tokens. This is decision API billing, not a price for generated text. Local deployment adds infrastructure and operations. No USD conversion is invented and GPU resources are not assumed to be free.

i Prices change and may depend on level, region or context length. Check the source before making a decision.

05 / EVALUATIONS

How to read the results

“

The provider reports an average of 71.8 across three decision indices. The card records 44 ms median and 420 ms at the 95th percentile over one thousand sequential requests after loading on a B200. These are provider tests and do not guarantee network latency or performance on other infrastructure.

BenchmarkResultMetricSource
Sarvam Prism decision indices average71,8 / 100ScoreView source ↗
Sarvam Prism sequential B200 median latency44 msMedian; lower is betterView source ↗

Inferama only highlights a “best result” when the metric, test set, configuration, and date allow for an equivalent comparison. The supplier's figures are presented as claims from its own source.

06 / VERSIONS

Chronology

Sarvam Prism

Version added to Inferama's verified catalog.

07 / SOURCES

Traceability