AKOOL today announced a major breakthrough in AI video infrastructure with the launch of its production-grade video inference ...

Snowflake Inc. today said it’s integrating technology into some of its hosted large language models that it says can significantly reduce the cost and time required for artificial intelligence ...

Designing AI/ML inferencing chips is emerging as a huge challenge due to the variety of applications and the highly specific power and performance needs for each of them. Put simply, one size does not ...

U.K.-based artificial intelligence inference chip startup Fractile Ltd. said today it has closed on a $220 million Series B ...

A food fight erupted at the AI HW Summit earlier this year, where three companies all claimed to offer the fastest AI processing. All were faster than GPUs. Now Cerebras has claimed insanely fast AI ...

The AI boom shows no signs of slowing, but while training gets most of the headlines, it’s inferencing where the real business impact happens. Every time a chatbot answers, a fraud alert triggers or a ...

Chipmakers are getting ready to debut inference chips for endpoint devices, even though the rest of the machine-learning ecosystem has yet to be established. Whatever infrastructure does exist today ...

“I get asked all the time what I think about training versus inference – I'm telling you all to stop talking about training versus inference.” So declared OpenAI VP Peter Hoeschele at Oracle’s AI ...

Microsoft has unveiled its Maia 200 inferencing chip. Built on TSMC’s 3nm technology, the hyperscaler described the accelerator as an “AI inference powerhouse” that has been “engineered to ...