Google is currently in discussions with Marvell to develop new AI chips intended for inference applications. This move aligns with the broader trend among cloud giants like Google and Amazon, which are increasingly focusing on cost metrics such as cost-per-token and total cost of ownership, thus favoring custom ASICs over general-purpose GPUs for inference tasks. Additionally, Marvell’s strategic importance has been highlighted by Nvidia’s recent $2 billion investment in the company and the establishment of the NVLink Fusion partnership, which aims to integrate third-party accelerators into Nvidia’s ecosystem, indicating Marvell’s pivotal role in the evolving AI infrastructure landscape.
Google: Google is a technology conglomerate that develops consumer and enterprise software, cloud services, and semiconductor chips including Tensor Processing Units (TPUs) for AI workloads. In this news, Google is actively diversifying its AI chip supply chain by negotiating with Marvell for customized TPU development and specialized inference chips, signaling a strategic shift away from reliance on a single supplier.
Marvell: Marvell Technology is a semiconductor company specializing in custom silicon design, storage controllers, and AI infrastructure components. Marvell is positioned in these negotiations as a design service provider to help Google develop customized TPUs and inference-optimized chips, building on its growing prominence in the AI ASIC ecosystem following Nvidia’s recent $2 billion strategic investment.
`json
{
“AI Inference Economics”: “Cloud giants including Google, Amazon, and Microsoft are shifting competition metrics from peak computing power to cost-per-token and total cost of ownership, making custom ASICs more attractive than general-purpose GPUs for inference workloads.”,
“Supply Chain Diversification”: “Google renewed its cooperation agreement with Broadcom while simultaneously entering negotiations with Marvell, demonstrating a deliberate strategy to avoid supplier concentration in critical AI chip development.”
}
`
