`nousresearch/hermes-3-llama-3.1-70b` behavioral LLM fingerprint

This page breaks down the exact reference that VerifyLLMAPI uses for nousresearch/hermes-3-llama-3.1-70b: 100 normalized answers across eight low-entropy probes, plus its nearest enrolled models by mean Jensen–Shannon divergence.

Fingerprint summary

Reference answers: 100
Samples per cell: 5–15
Nearest model: meta-llama/llama-3.3-70b-instruct
Nearest mean JSD: 0.646971

The most concentrated cell was color-random|zh: 蓝色 held 66.7% of its answers and entropy measured 0.918 bits. The broadest cell was letter-random|zh at 3.374 bits.

Against the closest enrolled model, letter-random|zh contributed the largest cell distance at JSD 1.000000. This is a descriptive comparison, not proof that either API route serves a named checkpoint.

Completeness: the author dataset allows up to 15 valid answers per selected cell in reference half A. This model contains 100/120 across the eight cells. We show the actual denominator for every share.

The eight test requests

The research pipeline sent each user prompt with a one-answer system constraint, temperature 1, a 16-token output cap, and reasoning disabled. VerifyLLMAPI uses the same prompt text and normalization target.

Cell	Task	Exact request text	Normalization and n
`animal-random\|en`	Random animal · English	Name a random animal. System constraint Answer with a single word or a single number only. Output nothing else: no explanation, no punctuation, no quotation marks.	word · 8/15 reference samples
`word-random\|en`	Random word · English	Name a random word. System constraint Answer with a single word or a single number only. Output nothing else: no explanation, no punctuation, no quotation marks.	word · 5/15 reference samples
`animal-random\|ru`	Random animal · Russian	Назови случайное животное. System constraint Отвечай только одним словом или одним числом. Не выводи ничего больше: без объяснений, без знаков препинания, без кавычек.	word · 15/15 reference samples
`animal-random\|ar`	Random animal · Arabic	اذكر حيواناً عشوائياً. System constraint أجب بكلمة واحدة أو رقم واحد فقط. لا تكتب أي شيء آخر: لا شرح ولا علامات ترقيم ولا علامات اقتباس.	word · 12/15 reference samples
`letter-random\|zh`	Random character · Chinese	说出一个随机的汉字。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	grapheme · 15/15 reference samples
`animal-random\|zh`	Random animal · Chinese	说出一个随机的动物。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	word · 15/15 reference samples
`letter-random\|ar`	Random letter · Arabic	اذكر حرفاً عشوائياً من الحروف الأبجدية. System constraint أجب بكلمة واحدة أو رقم واحد فقط. لا تكتب أي شيء آخر: لا شرح ولا علامات ترقيم ولا علامات اقتباس.	grapheme · 15/15 reference samples
`color-random\|zh`	Random color · Chinese	说出一个随机的颜色。 System constraint 只用一个词或一个数字回答。不要输出任何其他内容：不要解释，不要标点符号，不要引号。	word · 15/15 reference samples

Response distributions

These are normalized reference-half counts from the published OpenRouter dataset. The tables contain aggregate values, not user data or a live VerifyLLMAPI scan.

1. animal-random|en

Random animal, English. 8 valid reference answers produced 4 normalized values. The mode was kangaroo at 4/8 (50.0%); entropy was 1.750 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for animal-random|en
Normalized response	Count	Share
`kangaroo`	4	50.0%
`giraffe`	2	25.0%
`raccoon`	1	12.5%
`sloth`	1	12.5%

2. word-random|en

Random word, English. 5 valid reference answers produced 5 normalized values. The mode was caterpillar at 1/5 (20.0%); entropy was 2.322 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for word-random|en
Normalized response	Count	Share
`caterpillar`	1	20.0%
`scissors`	1	20.0%
`umbrella`	1	20.0%
`unpredictability`	1	20.0%
`zephyr`	1	20.0%

3. animal-random|ru

Random animal, Russian. 15 valid reference answers produced 9 normalized values. The mode was слон at 5/15 (33.3%); entropy was 2.866 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for animal-random|ru
Normalized response	Count	Share
`слон`	5	33.3%
`енот`	2	13.3%
`кошка`	2	13.3%
`ежик`	1	6.7%
`жираф`	1	6.7%
`кролик`	1	6.7%
`лев`	1	6.7%
`лось`	1	6.7%
`медведь`	1	6.7%

4. animal-random|ar

Random animal, Arabic. 12 valid reference answers produced 6 normalized values. The mode was زرافة at 5/12 (41.7%); entropy was 2.284 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for animal-random|ar
Normalized response	Count	Share
`زرافة`	5	41.7%
`كänguru`	2	16.7%
`كلب`	2	16.7%
`سerval`	1	8.3%
`فيل`	1	8.3%
`قطةwidgetitemmorelinktext`	1	8.3%

5. letter-random|zh

Random character, Chinese. 15 valid reference answers produced 12 normalized values. The mode was 中 at 4/15 (26.7%); entropy was 3.374 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for letter-random|zh
Normalized response	Count	Share
`中`	4	26.7%
`临`	1	6.7%
`乐`	1	6.7%
`修`	1	6.7%
`吉`	1	6.7%
`夜`	1	6.7%
`幸`	1	6.7%
`燎`	1	6.7%
`物`	1	6.7%
`玄`	1	6.7%
`美`	1	6.7%
`鹤`	1	6.7%

6. animal-random|zh

Random animal, Chinese. 15 valid reference answers produced 11 normalized values. The mode was 企鹅 at 4/15 (26.7%); entropy was 3.240 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for animal-random|zh
Normalized response	Count	Share
`5`	1	6.7%
`企鹅`	4	26.7%
`海马`	2	13.3%
`大熊猫`	1	6.7%
`大象`	1	6.7%
`孔雀`	1	6.7%
`狮子`	1	6.7%
`猕猴`	1	6.7%
`猴子`	1	6.7%
`虎鲸`	1	6.7%
`袋鼠`	1	6.7%

7. letter-random|ar

Random letter, Arabic. 15 valid reference answers produced 9 normalized values. The mode was ط at 4/15 (26.7%); entropy was 2.974 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for letter-random|ar
Normalized response	Count	Share
`ط`	4	26.7%
`ر`	2	13.3%
`س`	2	13.3%
`ق`	2	13.3%
`أ`	1	6.7%
`ت`	1	6.7%
`ص`	1	6.7%
`ك`	1	6.7%
`ن`	1	6.7%

8. color-random|zh

Random color, Chinese. 15 valid reference answers produced 2 normalized values. The mode was 蓝色 at 10/15 (66.7%); entropy was 0.918 bits.

nousresearch/hermes-3-llama-3.1-70b response distribution for color-random|zh
Normalized response	Count	Share
`蓝色`	10	66.7%
`绿色`	5	33.3%

Three nearest enrolled references

We compute base-2 JSD for each of the eight categorical distributions, then average the eight distances. A lower value means more similar answer frequencies within this product reference. It does not identify an unknown route by itself.

Rank	Reference model	Mean 8-cell JSD
1	`meta-llama/llama-3.3-70b-instruct`	0.646971
2	`nousresearch/hermes-4-70b`	0.656368
3	`openai/gpt-4o-mini`	0.657784

How many live requests does verification use?

Profile	Cells × samples	Fresh model requests	Same-data EER
Quick, default complete check	4 × 5	20	11.8%
Standard	8 × 5	40	8.1%
Paper budget	8 × 15	120	6.7%

The current-Agent workflow starts with quick. Each answer comes from a fresh Codex or Claude Code process that reuses host-managed login. These requests can consume host allowance or provider balance.

What this fingerprint can and cannot show

The reference records behavior observed through OpenRouter in the author dataset. Provider wrappers, model updates, decoding, and date can move a distribution.
The author collection set temperature 1 and disabled reasoning. Current-Agent mode labels sampling as a host default because supported Agent CLIs expose no temperature flag.
The eight high-gap cells and product thresholds use the same public cohort. Their EER values are calibration results, not an independent production accuracy claim.
A nearest reference is a similarity result. VerifyLLMAPI returns INCONCLUSIVE when the claimed route lacks an enrolled fingerprint.

Primary sources, license, and reproducibility

Tomas Bruckner, One Token Is Enough: Fingerprinting and Verifying Large Language Models from Single-Token Output Distributions, arXiv:2607.10252v1.
Author dataset and derived results, DOI 10.5281/zenodo.21278557, CC BY 4.0.
Author collection and analysis software, DOI 10.5281/zenodo.21278793, MIT.
VerifyLLMAPI atlas JSON, built from reference pamela-openrouter-2026-07-8cell-ref-a, SHA-256 51f3f63cbcfb56b151055d2d10e36a9cc2f0644cc68b580784853d68951fa866.

Page evidence SHA-256: d2c23c7e144bbda8535072c28fbebaddc5895fca8b353bd744b7ec9c6382aeef. This hash covers the model ID, eight cell metrics, nearest references, and strongest cell difference in the generated atlas.

Run a current-Agent model check