AI inference is nothing more than a fancy term for a trained AI model making decisions based on new data or inputs. When ChatGPT generates a unique response to user input it has never seen before, ...

It’s not often that senior executives from a chip company celebrate when a rival unveils a new piece of hardware, but that’s the odd position Cerebras cofounder and CTO Sean Lie admitted finding ...

The Christmas Eve agreement—billed as Nvidia’s biggest deal in its three-decade history—landed at a precarious moment for Groq. Now Nvidia is betting on Groq’s inference-speed tech inside a newly ...

Back in late December, Nvidia did a $20 billion “acquihire” of most of the development team at Groq and licensed the technology underlying its LPU dataflow engines for doing AI inference. We expected ...

Nvidia won the first round in the artificial-intelligence investment boom, but it is entering a new phase where it’s seeing a lot more competition as AI workloads shift. Last year, Nvidia paid $20 ...

NVIDIA is officially announcing its new Vera Rubin platform at GTC today, positioning the release as the next frontier for "agentic AI". The sprawling announcements (NVIDIA put out a fully twenty ...

Nvidia isn't wasting time showcasing the benefits of its enhanced relationship with Groq. CEO Jensen Huang introduced the Groq 3 language processing unit for accelerating inference, or the process of ...

Groq has reportedly requested Samsung Electronics' foundry division to increase wafer production for its inference AI chips, reflecting the booming market demand. Industry sources expect Samsung's ...

Nvidia's $20 billion Groq deal signals an important shift in the AI market. AI workloads are moving from model training to real-time inference as the main focus. Specialized inference chips like ...

Today’s 2-Minute Tech Briefing from the New York Stock Exchange covers three IT headlines: Morgan Stanley warns over 200,000 European banking jobs could vanish by 2030 as AI and branch closures ...

What happens when a tech giant like NVIDIA, already dominating the AI hardware space, makes a bold $20 billion move to license innovative technology from an ambitious startup? Matt Wolfe breaks down ...