DOCUMENTED BENCHMARK

SingProbe response safety 8-benchmark suite

Published results and conditions declared by their sources. Figures are comparable only when version, configuration, metric and date match.

01 / RESULTS

Published measurements

ModelOrganizationResultMetricConditions
SingProbe DeepSeek-V4.1-Flash-1017inclusionAI0.8668F1Query F1 over six benchmarks and response-safety F1 over eight, equally weighted by benchmark with one threshold selected per suite. Hallucination AUC covers six benchmarks. These are not universal probabilities or Inferama evaluations.
SingProbe Ling-3.1-flash-1019inclusionAI0.8707F1Query F1 over six benchmarks and response-safety F1 over eight, equally weighted by benchmark with one threshold selected per suite. Hallucination AUC covers six benchmarks. These are not universal probabilities or Inferama evaluations.
02 / INTERPRETATION

Before comparing

01

Exact version

Check the model identifier, date and whether the alias can change.

02

Equivalent configuration

Review tools, effort, number of attempts, prompt and inference budget.

03

Transfer to your use case

Validate the result with tasks, languages, formats and errors representative of your product.

03 / METHOD

From benchmark to reproducible decision

A public benchmark provides guidance, but does not replace an evaluation with your data, tools, budget, and error tolerance.

01

Identify the exact version

A moving alias and a snapshot may produce different results. Record the model, date, and provider.

02

Reconstruct the conditions

Prompt, reasoning, tools, number of attempts, and budget must be equivalent for comparison.

03

Look for uncertainty

A small difference may disappear between runs. Keep samples, dispersion, and failures, not just the average.

04

Check transferability

Validate whether the improvement holds across languages, formats, and real cases close to your product.

A metric is only useful when we know the task, the conditions, and the error that matters. The result begins with the design of the test.

04 / SOURCES

Traceability