Start with why anyone would want to. Paul frames it as a decentralization problem rather than a capability one.
“If you want to make a fully decentralized application and you want to use agents, you have to call out to a central service like OpenAI’s or Anthropic’s. These are centralized control points that mean the app is no longer decentralized.”
So the goal is a contract that can reason over messy real-world input without importing a single point of failure. Getting there broke four things.
Determinism. Two validators running the same prompt against the same model will normally return different text, and a network cannot vote on output it cannot reproduce. Paul was surprised this was solvable. “I didn’t think you could run LLMs in deterministic modes, but you can. It’s brand new research.” Somnia’s fix is fixed seeds and temperature zero so every validator produces byte-identical output. Cost of getting it wrong: inference calls fail non-deterministically and every application built on them is unreliable in production.
Validator hardware. Consensus now requires GPU-equipped compute nodes inside the validator set. Cost of getting it wrong: the validator set concentrates around whoever can afford the hardware, and the decentralization argument that justified the whole design collapses.
Metering. An LLM call is orders of magnitude more expensive than an EVM opcode and needs its own gas model. Somnia’s documentation prices a JSON API call at 0.03 per validator, an LLM inference at 0.07, and a website parse at 0.10, with a default subcommittee of three. Cost of getting it wrong: either inference is free and the network is trivially spammed, or it is priced like compute and nobody builds on it.
Latency. Inference is asynchronous. The contract calls createRequest(), gets a request ID back immediately, and receives the answer later through a handleResponse() callback that can return Success, Failed, or TimedOut. Cost of getting it wrong: developers write contracts that assume a synchronous answer and discover the failure path in production.
Note what the pricing table implies. Every inference is paid for three times, once per validator in the subcommittee, and that multiple is the price of the trust guarantee.
Verification is never free. It is only ever cheaper than the alternative.
Building on an agentic L1 and struggling to explain the architecture to anyone outside engineering? Book a free 30-minute go-to-market call. No pitch deck. No obligation.