What Groq does
Groq is an AI infrastructure company focused on low-latency, energy-efficient inference. Its central hardware concept is the Language Processing Unit (LPU), a purpose-built processor architecture designed for AI inference workloads such as large language model (LLM) token generation. Groq makes inference available through GroqCloud and an accompanying API, and it also sells dedicated bare-metal infrastructure and an inference/control stack as part of its “Groq Platform” offerings.
Strategically, Groq positions itself as an “inference neocloud” that integrates infrastructure, an inference stack, and enterprise governance/control for deploying real-time AI applications. Groq also expanded its ecosystem alignment with NVIDIA through a non-exclusive licensing agreement for Groq inference technology (announced in December 2025) and later through NVIDIA’s NVIDIA Cloud Partner (NCP) certification (August 2026).