`mistralai/mistral-small-24b-instruct-2501` behavioral LLM fingerprint

This page breaks down the exact reference that VerifyLLMAPI uses for mistralai/mistral-small-24b-instruct-2501: 120 normalized answers across eight low-entropy probes, plus its nearest enrolled models by mean Jensen–Shannon divergence.

Fingerprint summary

Reference answers: 120
Samples per cell: 15–15
Nearest model: mistralai/mistral-medium-3-5
Nearest mean JSD: 0.653735

The most concentrated cell was color-random|zh: 蓝 held 40.0% of its answers and entropy measured 2.556 bits. The broadest cell was animal-random|ru at 3.774 bits.

Against the closest enrolled model, animal-random|ru contributed the largest cell distance at JSD 1.000000. This is a descriptive comparison, not proof that either API route serves a named checkpoint.

Completeness: the author dataset allows up to 15 valid answers per selected cell in reference half A. This model contains 120/120 across the eight cells. We show the actual denominator for every share.

The eight test requests

The research pipeline sent each user prompt with a one-answer system constraint, temperature 1, a 16-token output cap, and reasoning disabled. VerifyLLMAPI uses the same prompt text and normalization target.

Cell	Task	Exact request text	Normalization and n
`animal-random\|en`	Random animal · English	Name a random animal. System constraint Answer with a single word or a single number only. Output nothing else: no explanation, no punctuation, no quotation marks.	word · 15/15 reference samples
`word-random\|en`	Random word · English	Name a random word. System constraint Answer with a single word or a single number only. Output nothing else: no explanation, no punctuation, no quotation marks.	word · 15/15 reference samples
`animal-random\|ru`	Random animal · Russian	Назови случайное животное. System constraint Отвечай только одним словом или одним числом. Не выводи ничего больше: без объяснений, без знаков препинания, без кавычек.	word · 15/15 reference samples
`animal-random\|ar`	Random animal · Arabic	اذكر حيواناً عشوائياً. System constraint أجب بكلمة واحدة أو رقم واحد فقط. لا تكتب أي شيء آخر: لا شرح ولا علامات ترقيم ولا علامات اقتباس.	word · 15/15 reference samples
`letter-random\|zh`	Random character · Chinese	说出一个随机的汉字。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	grapheme · 15/15 reference samples
`animal-random\|zh`	Random animal · Chinese	说出一个随机的动物。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	word · 15/15 reference samples
`letter-random\|ar`	Random letter · Arabic	اذكر حرفاً عشوائياً من الحروف الأبجدية. System constraint أجب بكلمة واحدة أو رقم واحد فقط. لا تكتب أي شيء آخر: لا شرح ولا علامات ترقيم ولا علامات اقتباس.	grapheme · 15/15 reference samples
`color-random\|zh`	Random color · Chinese	说出一个随机的颜色。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	word · 15/15 reference samples

Response distributions

These are normalized reference-half counts from the published OpenRouter dataset. The tables contain aggregate values, not user data or a live VerifyLLMAPI scan.

1. animal-random|en

Random animal, English. 15 valid reference answers produced 11 normalized values. The mode was koala at 3/15 (20.0%); entropy was 3.273 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for animal-random|en
Normalized response	Count	Share
`koala`	3	20.0%
`squirrel`	3	20.0%
`badger`	1	6.7%
`bird`	1	6.7%
`caiman`	1	6.7%
`deer`	1	6.7%
`elephant`	1	6.7%
`emu`	1	6.7%
`giraffe`	1	6.7%
`leopard`	1	6.7%
`ostrich`	1	6.7%

2. word-random|en

Random word, English. 15 valid reference answers produced 9 normalized values. The mode was elephant at 6/15 (40.0%); entropy was 2.740 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for word-random|en
Normalized response	Count	Share
`elephant`	6	40.0%
`whisper`	2	13.3%
`apple`	1	6.7%
`banana`	1	6.7%
`gittern`	1	6.7%
`salmon`	1	6.7%
`table`	1	6.7%
`unicorn`	1	6.7%
`whistle`	1	6.7%

3. animal-random|ru

Random animal, Russian. 15 valid reference answers produced 14 normalized values. The mode was олень at 2/15 (13.3%); entropy was 3.774 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for animal-random|ru
Normalized response	Count	Share
`олень`	2	13.3%
`волк`	1	6.7%
`кит`	1	6.7%
`лама`	1	6.7%
`лемур`	1	6.7%
`леопард`	1	6.7%
`лось`	1	6.7%
`льв`	1	6.7%
`медведь`	1	6.7%
`олени`	1	6.7%
`с`	1	6.7%
`слeон`	1	6.7%
`собака`	1	6.7%
`сове`	1	6.7%

4. animal-random|ar

Random animal, Arabic. 15 valid reference answers produced 13 normalized values. The mode was جمل at 2/15 (13.3%); entropy was 3.640 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for animal-random|ar
Normalized response	Count	Share
`جمل`	2	13.3%
`كلب`	2	13.3%
`kav`	1	6.7%
`kongo`	1	6.7%
`أيلو`	1	6.7%
`بومه`	1	6.7%
`تك`	1	6.7%
`سلحفاة`	1	6.7%
`قرد`	1	6.7%
`كونيو`	1	6.7%
`نمر`	1	6.7%
`يام`	1	6.7%
`吸血鬼蝙蝠`	1	6.7%

5. letter-random|zh

Random character, Chinese. 15 valid reference answers produced 12 normalized values. The mode was 山 at 3/15 (20.0%); entropy was 3.457 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for letter-random|zh
Normalized response	Count	Share
`山`	3	20.0%
`龙`	2	13.3%
`丁`	1	6.7%
`悦`	1	6.7%
`日`	1	6.7%
`林`	1	6.7%
`水`	1	6.7%
`渊`	1	6.7%
`聪`	1	6.7%
`草`	1	6.7%
`通`	1	6.7%
`风`	1	6.7%

6. animal-random|zh

Random animal, Chinese. 15 valid reference answers produced 11 normalized values. The mode was 狮子 at 4/15 (26.7%); entropy was 3.240 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for animal-random|zh
Normalized response	Count	Share
`狮子`	4	26.7%
`熊`	2	13.3%
`熊猫`	1	6.7%
`狗`	1	6.7%
`猫`	1	6.7%
`蓝鲸`	1	6.7%
`蜗牛`	1	6.7%
`金丝猴`	1	6.7%
`长颈鹿`	1	6.7%
`鱼`	1	6.7%
`鹰`	1	6.7%

7. letter-random|ar

Random letter, Arabic. 15 valid reference answers produced 13 normalized values. The mode was b at 2/15 (13.3%); entropy was 3.640 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for letter-random|ar
Normalized response	Count	Share
`b`	2	13.3%
`ق`	2	13.3%
`j`	1	6.7%
`r`	1	6.7%
`z`	1	6.7%
`إ`	1	6.7%
`ب`	1	6.7%
`ت`	1	6.7%
`ج`	1	6.7%
`د`	1	6.7%
`ر`	1	6.7%
`ع`	1	6.7%
`ل`	1	6.7%

8. color-random|zh

Random color, Chinese. 15 valid reference answers produced 8 normalized values. The mode was 蓝 at 6/15 (40.0%); entropy was 2.556 bits.

mistralai/mistral-small-24b-instruct-2501 response distribution for color-random|zh
Normalized response	Count	Share
`蓝`	6	40.0%
`绿`	3	20.0%
`瑰红`	1	6.7%
`紫`	1	6.7%
`紫色`	1	6.7%
`红色`	1	6.7%
`蓝色`	1	6.7%
`黄`	1	6.7%

Three nearest enrolled references

We compute base-2 JSD for each of the eight categorical distributions, then average the eight distances. A lower value means more similar answer frequencies within this product reference. It does not identify an unknown route by itself.

Rank	Reference model	Mean 8-cell JSD
1	`mistralai/mistral-medium-3-5`	0.653735
2	`z-ai/glm-4.5-air`	0.668336
3	`mistralai/mistral-small-3.2-24b-instruct`	0.674933

How many live requests does verification use?

Profile	Cells × samples	Fresh model requests	Same-data EER
Quick, default complete check	4 × 5	20	11.8%
Standard	8 × 5	40	8.1%
Paper budget	8 × 15	120	6.7%

The current-Agent workflow starts with quick. Each answer comes from a fresh Codex or Claude Code process that reuses host-managed login. These requests can consume host allowance or provider balance.

What this fingerprint can and cannot show

The reference records behavior observed through OpenRouter in the author dataset. Provider wrappers, model updates, decoding, and date can move a distribution.
The author collection set temperature 1 and disabled reasoning. Current-Agent mode labels sampling as a host default because supported Agent CLIs expose no temperature flag.
The eight high-gap cells and product thresholds use the same public cohort. Their EER values are calibration results, not an independent production accuracy claim.
A nearest reference is a similarity result. VerifyLLMAPI returns INCONCLUSIVE when the claimed route lacks an enrolled fingerprint.

Primary sources, license, and reproducibility

Tomas Bruckner, One Token Is Enough: Fingerprinting and Verifying Large Language Models from Single-Token Output Distributions, arXiv:2607.10252v1.
Author dataset and derived results, DOI 10.5281/zenodo.21278557, CC BY 4.0.
Author collection and analysis software, DOI 10.5281/zenodo.21278793, MIT.
VerifyLLMAPI atlas JSON, built from reference pamela-openrouter-2026-07-8cell-ref-a, SHA-256 51f3f63cbcfb56b151055d2d10e36a9cc2f0644cc68b580784853d68951fa866.

Page evidence SHA-256: 657897b8225f5b2cc0471dfe1ded5a35f2ff71e352ebf50bab0b2f55033550c7. This hash covers the model ID, eight cell metrics, nearest references, and strongest cell difference in the generated atlas.

Run a current-Agent model check