SemiAnalysis reports that Google is moving forward at full speed with externalizing its TPU inference capacity through a platform called InferenceX, making its custom chips available to outside customers. The move marks a strategic shift from using TPUs exclusively for internal workloads to competing directly with Nvidia in the inference-as-a-service market. Details on pricing and initial customers were included in the SemiAnalysis analysis.
Google externalizing TPU inference capacity introduces a significant new competitor to Nvidia-based cloud inference services, potentially reshaping how AI companies procure compute for production workloads. If InferenceX gains traction, it could redirect billions in inference spending away from GPU-based cloud providers.
Named company Google, named platform InferenceX, and the strategic significance of TPU externalization triggered selection. SemiAnalysis provided the detailed technical and market framing that elevated this above general AI infrastructure coverage.