Etched has announced its first inference system, coming out of stealth mode after raising $800 million and securing over $1 billion in customer contracts. The new system, which has already shown promising early performance in tests, features the AA-AgentPerf benchmark, designed to measure the number of agents operating per megawatt of power. This development aligns with current market trends highlighting a growing demand for dedicated inference hardware, particularly among hardware startups focused on optimizing transformer models in the AI sector. The first racks are set to ship this summer.

Etched: Etched is a startup building specialized hardware systems optimized for large-scale AI inference workloads, particularly transformer-based models. The company recently emerged from stealth mode with announcements of its initial rack-scale inference products following successful chip development and customer validations. This directly ties into the news as Etched is announcing the launch of its first inference system and upcoming shipments.

Market Trends: Demand for dedicated inference hardware is driving new entrants focused on transformer model optimization in the AI sector.
AI Hardware Development: Specialized ASIC designs for AI inference are gaining traction among hardware startups aiming for efficiency gains over general-purpose processors.