The $20 Billion Bet On Inference: What Every AI Infrastructure Team Needs To Get Right

Every ChatGPT query, every AI agent action, every generated video is based on inference. Training a model is a one-time ...

OpenAI ditches Nvidia for faster AI inference chips, threatening chipmaker's dominance

Nvidia remains dominant in chips for training large AI models, while inference has become a new front in the competition.

The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
Observer

Microsoft’s Maia Chip Targets A.I. Inference as Big Tech Rethinks Training

A.I. chip, Maia 200, calling it “the most efficient inference system” the company has ever built. The Satya Nadella -led tech ...

Former Cohere exec Sara Hooker has raised $50 million for her AI startup Adaption Labs—a bet on smaller, smarter models

Hooker says she wants to "eliminate prompt engineering" with AI models that intuitively adapt to varying tasks ...

AI inference startup Baseten hits $5B valuation in $300M round backed by Nvidia

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities ...
Semiconductor Engineering

Ultra-low-bit LLM Inference Allows AI-PC CPUs And Discrete Client GPUs To Approach High-end GPU-Level (Intel)

A new technical paper titled “Pushing the Envelope of LLM Inference on AI-PC and Intel GPUs” was published by researcher at ...
ZDNet

Nvidia doubles down on AI language models and inference as a substrate for the Metaverse, in data centers, the cloud and at the edge

Machine learning, task automation and robotics are already widely used in business. These and other AI technologies are about to multiply, and we look at how organizations can best take advantage of ...
Business Wire

Vultr Launches Cloud Inference to Simplify Model Deployment and Automatically Scale AI Applications Globally

WEST PALM BEACH, Fla.--(BUSINESS WIRE)--Vultr, the world’s largest privately-held cloud computing platform, today announced the launch of Vultr Cloud Inference. This new serverless platform ...

Microsoft announces powerful new chip for AI inference

Microsoft has announced the launch of its latest chip, the Maia 200, which the company describes as a silicon workhorse ...