"Internet Court" for AI agents
A startup by GenLayer aims to resolve future AI agent disputes via an AI jury
An article in Forbes thinks an agent-driven world is “in the not-too-distant future.”
In such a world, AI agents representing you will be interfacing with other agents representing people selling you goods or services. According to the consulting firm McKinsey, these agents could facilitate $3 to $5 trillion in consumer transactions by 2030. And according to a startup called GenLayer, agents will need a way to resolve disputes.
Enter: “Internet Court,” GenLayer’s vision of a system that resolves agent-to-agent disputes without human involvement. An AI jury, made up of five randomly selected blockchain participants each running a different AI model (Claude, GPT, etc.), “evaluates the evidence and delivers a verdict in minutes.” If they can’t agree, the jury continues to expand until it can. These jury mechanics are based on a theory that as more independent evaluators are added, the likelihood of getting the “correct answer” goes up. The system could also help agents create contracts in advance, to minimize disputes happening at all.
To understand this vision, you need to understand how AI agents differ from chatbots: basically, you give them a task or delegate an entire area of responsibility, and they act autonomously to manage it in the way they think is best. This is sometimes successful, and sometimes ... not. In one costly failure, AI trading agent Bankr was tricked into sending an attacker about $200k in digital currency.
It’s not clear whether an agent-driven world will come to pass, though as I’ve covered previously, AI agents are already empowered to do everything from stock trading to shopping. It’s possible humans will decide there’s too much of an ick factor and limit agent use. But if the world GenLayer imagines does emerge, people might have little choice but to rely on automated arbitration services like its Internet Court idea, which is backed by 26 crypto and AI companies. After all, there’s no easy, non-automated way to handle millions of AI agents taking a potentially very high volume of quick actions across multiple platforms.
There’s also no easy, automated way to handle this. The COO of a New York-based crypto venture firm, Lindsay Lin, points out a problem with GenLayer’s jury approach, questioning the assumption that different AI models (for example, Claude and GPT) are different enough to be considered independent evaluators:
A lot of LLMs can be correlated because they share training data and common failure modes, whereas humans tend to be more independent.
A Stanford professor adds that AIs might hallucinate, or work from corrupted training data.
My take: if you want to feel we’re headed toward a dystopian future rather than just intellectualize it, this article is worth a read. In addition to agentic commerce with disputes handled by agent juries, the piece also mentions emerging marketplaces launched by OKX, one of GenLayer’s backers, “where agents can hire other agents to perform paid tasks.” An agent-driven world isn’t what I’m most worried about — it’s small potatoes compared to the extinction risk leading experts fear — but it does give me a visceral shudder.
The analyses and opinions expressed on AI StopWatch reflect the views of the individual contributors and the sources they cover, and should not be taken as official positions of the Machine Intelligence Research Institute.