Inference
-
AI
Why the first GPU financiers are turning to inference chips in a $400 million deal
General Compute, an AI-inference cloud startup, has secured a $400 million loan from Upper90, a technology investment firm. It could…
Read More » -
AI
Hot French startup ZML releases free product to speed inference across lots of AI chips
The days of Nvidia’s unparalleled market dominance are not over, but challengers and choices are coming from all directions. ZMLa…
Read More » -
AI
AI inference startup Baseten reportedly raising $1.5B months after its last mega-round
AI inference company Baseten is about to close a stunning $1.5 billion funding round at a $13 billion valuation. reports…
Read More » -
AI
AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say
Modal laboratoriesa startup specializing in AI inference infrastructure is talking to venture capital firms about a new round at a…
Read More » -
AI
Microsoft announces powerful new chip for AI inference
Microsoft has announced the launch of its latest chip, the Maia 200, which the company describes as a silicon workhorse…
Read More » -
AI
Sources: Project SGLang spins out as RadixArk with $400M valuation as inference market explodes
A pattern is emerging in the world of AI infrastructure: popular open source tools are transforming into venture-backed startups worth…
Read More » -
AI
Together AI's ATLAS adaptive speculator delivers 400% inference speedup by learning from workloads in real-time
Companies expanding AI implementations are hitting an invisible performance wall. The perpetrator? Static speculators who cannot keep up with the…
Read More » -
AI
The Hidden Costs of AI: Securing Inference in an Age of Attacks
This article is part of VentureBeat’s special issue, “The Real Cost of AI: Performance, Efficiency and ROI at Scale.” Read more from…
Read More » -
AI
Databricks, Noma Tackle CISOs’ AI Inference Nightmare
Become a member of our daily and weekly newsletters for the latest updates and exclusive content about leading AI coverage.…
Read More » -
AI
AI Inference at Scale: Exploring NVIDIA Dynamo’s High-Performance Architecture
As artificial intelligence (AI) technology progresses, the need for efficient and scalable inference solutions has grown rapidly. It is soon…
Read More »