Lightning Network - BitbenchLightning Network
BOLT specs, channel management, routing, HTLCs, and LND/CLN APIs.
Results
Comparable within version 1.1.0.
Not run yet.
Fund this benchmark to run 5 prompts across 141 models. An operator runs the suite locally once funded; results then appear here.
gemini-3.1-flash-lite-preview
gemini-3.1-pro-preview-customtools
deepseek-v3.2-thinking-high
qwen3-vl-30b-a3b-thinking
qwen3-vl-30b-a3b-instruct
qwen3-vl-235b-a22b-thinking
qwen3-vl-235b-a22b-instruct
qwen3-next-80b-a3b-thinking
qwen3-next-80b-a3b-instruct
qwen-plus-2025-07-28:thinking
qwen3-30b-a3b-thinking-2507
qwen3-coder-30b-a3b-instruct
qwen3-30b-a3b-instruct-2507
qwen3-235b-a22b-thinking-2507
Questions
5 prompts, version 1.1.01What BOLT specification defines the peer protocol for channel establishment?
2In Lightning, what is the name of the contract that ensures atomic payments across multiple hops?
3Per BOLT 7, the `htlc_maximum_msat` field in a channel_update must not exceed what?
4In LND, what gRPC method is used to open a channel with another node?
5What is the purpose of the `payment_secret` field introduced in BOLT 11 invoices?
Full item bank in the repository