Ai2
AI2 / allenai/Bolmo-1B-Stage1

Bolmo 1B Stage 1

Ai2 checkpoint included in the public release of October 7, 2026, alongside the publication of Bolmo in Nature. It is an autoregressive model that processes text as UTF-8 bytes through local components, dynamic pooling and a global model. The verified modality is text-to-text: potential future extensions to images or audio are not available capabilities. The repository creation date in August is not used as the release date.

01 / SUMMARY

The essential

ORIENTATIONByte-level base model

Primary use stated or inferred cautiously from official documentation.

CONTEXT4,096 internal positions; variable byte length

Maximum input capacity when published by the source.

EXITmax_new_tokens counts bytes; maximum not published

Documented maximum generation limit.

ACCESSHugging Face · downloadable checkpoint

Verified availability channels.

MODEL TYPEText and reasoning

Primary functional family and verified specialties.

LICENSEApache 2.0

Declared terms for API access, model weights, or self-hosting.

02 / TECHNICAL SHEET

Limits and integration

API IDallenai/Bolmo-1B-Stage1
Model typeText and reasoning
Access modelOpen weights
LicenseApache 2.0
DeploymentSelf-hosted with Transformers and xlstm
Release07 OCT 2026
Knowledge cutoffNot published
EntranceText
ExitText
Context window4,096 internal positions; variable byte length
maximum outputmax_new_tokens counts bytes; maximum not published
ReasoningBase model; reasoning effort not published
Published tools
Structured OutingsNot published
Batch processingNot published
Prompt cacheNot published
Fine-tuningNot published
Verified platformsHugging Face · Transformers
BEST SUITED FOR

Research into tokenization, spelling, whitespace, unusual strings and dynamic compression. The profile identifies the exact checkpoint and training stage; the declared language is English. Bwen derives from Qwen3 8B Base and Blama from Llama 3 8B; Bolmo 1B and 7B start from Olmo. Do not confuse these base models with instruction-tuned assistants.

WORTH MONITORING

Stage 1 checkpoints keep the original global model frozen; they are not equivalent to their fully trained versions. The configuration declares internal model positions, not a guaranteed input-byte limit. max_new_tokens measures bytes, not the commercial tokens of other APIs. The official example uses trust_remote_code: review the code and pin a revision before running it. Models can produce harmful content, biases and incorrect claims without safety filtering.

03 / CAPABILITIES

What it can do

01

Orientation

Research into tokenization, spelling, whitespace, unusual strings and dynamic compression. The profile identifies the exact checkpoint and training stage; the declared language is English. Bwen derives from Qwen3 8B Base and Blama from Llama 3 8B; Bolmo 1B and 7B start from Olmo. Do not confuse these base models with instruction-tuned assistants.

02

Context

4,096 internal positions; variable byte length · max_new_tokens counts bytes; maximum not published

03

Tools and integration

Not published

04

Access

Hugging Face · downloadable checkpoint

Input modalities
Text
04 / PRICES

Documented cost

ConceptWorthUnit/condition
Standard inputNo published official API rateStandard API rate
Cached inputNot publishedReading reused prefixes
Cache write or storageNot publishedThe condition varies by provider
Standard outputSelf-hosted infrastructure costMay include reasoning tokens
Batch inputNot publishedAsynchronous processing
Batch outputNot publishedAsynchronous processing

We have not verified a commercial endpoint or an official per-token rate. Numeric cost fields remain empty: downloadable weights do not mean free inference. Budget for memory, compute and maintenance. The documentation uses Python 3.11, Transformers 4.57.3 and xlstm 2.0.4. Bwen and Bolmo Stage 1 declare Apache 2.0; Blama retains Llama 3 Community License, with its own conditions. Also review Ai2’s responsible use guidelines.

i Prices change and may depend on level, region or context length. Check the source before making a decision.

05 / EVALUATIONS

How to read the results

“

Ai2 reports aggregate results and describes improvements in byte-level modeling, but we have not verified comparable numerical scores for this checkpoint. We do not transfer results between Bwen, Blama, Bolmo or between Stage 1 and full training. Our own evaluation is pending. For reproduction, retain revision, stage, data, compression, generated bytes, hardware and latency; normalize units before comparing with subword-token models.

i No verified numerical scores per checkpoint; Inferama evaluation pending.

Inferama only highlights a “best result” when the metric, test set, configuration, and date allow for an equivalent comparison. The supplier's figures are presented as claims from its own source.

06 / VERSIONS

Chronology

Bolmo 1B Stage 1

Stage 1: trained byte-level components; global model parameters unchanged.

ANALYSIS

Related analysis

07 / SOURCES

Traceability