The Grid has introduced a new AI inference marketplace that promises to optimize costs for users by routing requests to the cheapest qualified model based on task requirements and quality tier. By allowing users to select from different levels of quality—Standard, Prime, or Max—the system replaces traditional fixed-rate vendor models with live pricing that reflects market supply and demand. Each tier is backed by a quality assurance mechanism, ensuring that only models meeting the specified performance standards can compete for requests. The service is compatible with both OpenAI and Anthropic formats, enabling users to integrate it with minimal changes to existing setups. New accounts currently receive credits for the first 200 million tokens.

The Grid: The Grid is a spot market for AI inference that routes user requests to competing suppliers based on selected task types and quality tiers. It acts as an intermediary layer, checking supplier qualifications against benchmark floors before routing to the lowest-cost eligible option. In the provided news, The Grid is positioned as an alternative to fixed-rate vendor cards from providers like OpenAI or Anthropic, allowing dynamic market pricing while maintaining quality standards.
Hermes Agent: Hermes Agent is an agentic tool that operates locally on a user’s machine, such as an Ubuntu setup, to handle tasks like support ticket classification and report generation. It integrates directly with The Grid as a custom AI provider for inference calls without needing local models or GPU resources. The news highlights a quick setup process where Hermes Agent routes requests through The Grid while keeping the agent running locally.

Compatibility: The Grid supports both OpenAI Chat Completions and Anthropic Messages API formats through a single API key and instrument strings.
Integration Ease: Existing client code can migrate to The Grid by changing the base URL and model name, with support for various agent tools and harnesses including CrewAI and OpenClaw.
Quality Assurance: The Grid maintains tier-specific quality floors by continuously auditing suppliers against benchmarks such as the Intelligence Index, removing those that fall below requirements.