Bitbench.org

Bitcoin AI Benchmark

Results About

BSVv1.1.0

BSV Data Protocols

Tests parsing of MAP, B, AIP, Sigma, BAP, and Run protocols from raw hex.

Results

Comparable within version 1.1.0. Earlier: v2025-12-18

Version 1.1.0 not run yet.

The questions changed in v1.1.0, so earlier scores aren't comparable. Fund this version to run the new set.

View v2025-12-18 results

Funding

$0.00 raised$13.39 goal

$13.39 left to reach the goal. Results publish automatically once funded and run.

Donation address

Models

141 models run against this suite, the full current-model registry.

Show all models

claude-sonnet-5

claude-fable-5

claude-opus-4.8-fast

claude-opus-4.8

claude-opus-4.7-fast

claude-opus-4.7

claude-sonnet-4.6

claude-opus-4.6

claude-4.5-opus

claude-4.5-opus-thinking-high

claude-haiku-4.5

claude-sonnet-4.5

claude-opus-4.1

gpt-5.6-luna-pro

gpt-5.6-luna

gpt-5.6-terra-pro

gpt-5.6-terra

gpt-5.6-sol-pro

gpt-5.6-sol

gpt-chat-latest

gpt-5.5-pro

gpt-5.5

gpt-5.4-nano

gpt-5.4-mini

gpt-5.4-pro

gpt-5.4

gpt-5.3-chat

gpt-5.3-codex

gpt-5.2-codex

gpt-5.2-chat

gpt-5.2-pro

gpt-5.2-none

gpt-5.2-xhigh

gpt-5.2-high

gpt-5.1-codex-max

gpt-5.1-low

gpt-5.1-default

gpt-5.1-high

gpt-5.1-chat

gpt-5.1-codex

gpt-5.1-codex-mini

gpt-oss-safeguard-20b

o3-deep-research

o4-mini-deep-research

gpt-5-pro

gpt-5-codex

gpt-5-chat

gpt-5-minimal

gpt-5-default

gpt-5-high

gpt-5-mini

gpt-5-nano

gpt-oss-120b

gpt-oss-20b

gemini-3.5-flash

gemini-3.1-flash-lite

gemma-4-26b-a4b-it

gemma-4-31b-it

gemini-3.1-flash-lite-preview

gemini-3.1-pro-preview-customtools

gemini-3.1-pro-preview

gemini-3-flash-high

gemini-3-flash-low

gemini-2.5-flash-lite

grok-4.5

grok-build-0.1

grok-4.3

grok-4.20-multi-agent

grok-4.20

deepseek-v4-pro

deepseek-v4-flash

deepseek-v3.2

deepseek-v3.2-thinking-high

deepseek-v3.2-exp

deepseek-v3.1-terminus

deepseek-v3.1

deepseek-v3.1-thinking

qwen3.7-plus

qwen3.7-max

qwen3.5-plus-20260420

qwen3.6-flash

qwen3.6-35b-a3b

qwen3.6-max-preview

qwen3.6-27b

qwen3.6-plus

qwen3.5-9b

qwen3.5-35b-a3b

qwen3.5-27b

qwen3.5-122b-a10b

qwen3.5-flash-02-23

qwen3.5-plus-02-15

qwen3.5-397b-a17b

qwen3-max-thinking

qwen3-coder-next

qwen3-vl-32b-instruct

qwen3-vl-8b-thinking

qwen3-vl-8b-instruct

qwen3-vl-30b-a3b-thinking

qwen3-vl-30b-a3b-instruct

qwen3-vl-235b-a22b-thinking

qwen3-vl-235b-a22b-instruct

qwen3-max

qwen3-coder-plus

qwen3-coder-flash

qwen3-next-80b-a3b-thinking

qwen3-next-80b-a3b-instruct

qwen-plus-2025-07-28

qwen-plus-2025-07-28:thinking

qwen3-30b-a3b-thinking-2507

qwen3-coder-30b-a3b-instruct

qwen3-30b-a3b-instruct-2507

qwen3-235b-a22b-thinking-2507

qwen3-coder

qwen3-235b-a22b-2507

kimi-k2.7-code

kimi-k2.6

kimi-k2.5

kimi-k2-thinking

kimi-k2-0905

mistral-medium-3-5

mistral-small-2603

devstral-2512

ministral-14b-2512

ministral-8b-2512

ministral-3b-2512

mistral-large-2512

voxtral-small-24b-2507

mistral-medium-3.1

codestral-2508

glm-5.2

glm-5.1

glm-5v-turbo

glm-5-turbo

glm-5

glm-4.7-flash

glm-4.7

glm-4.6v

glm-4.6

glm-4.5v

glm-4.5

glm-4.5-air

Questions

6 prompts, version 1.1.0

Analyze the following OP_RETURN script hex and identify the protocol and the value of the 'app' field: `6a223150755161374b36324d694b43747373534c4b79316b683536575755374d74555235035345540361707008746f6e6963706f7704747970650b6f666665725f636c69636b`

Construct the raw hex for a 'B' protocol OP_RETURN output containing the text 'Hello world' with content-type 'text/plain' and encoding 'utf8'. The B protocol prefix is `19HxigV4QyBv3tHpQVcUEQyq1pzZVdoAut`. (Do not include the length byte for the OP_RETURN itself, just start with 6a...)

Identify the protocol and the application name from this script snippet: `6a0372756e01050c63727970746f666967687473`

What is the 5-byte hex prefix for the Sigma protocol (signatures) in an OP_RETURN script?

In the AIP (Author Identity Protocol), what is the specific Bitcom prefix address used to identify the protocol?

What does BAP stand for in the context of Bitcoin data protocols, and what is its primary function?

Full item bank in the repository