Just a few weeks after AMD inked a deal with Cerebras to boost the inference capabilities of the upcoming Helios rack-scale system, it has acquired Taalas, a startup that designs chips specifically for inference-related workloads. Taalas bakes AI models directly into silicon chips, and AMD has just inked a definitive agreement to acquire it AMD has just signed an agreement to acquire Taalas in a move designed to complement its Helios systems. For the benefit of those who might not be aware, Taalas eliminates the so-called memory wall - an increasingly common situation where the GPUs sit idle as they […]

Read full article at https://wccftech.com/amd-snaps-up-taalas-weeks-after-cerebras-deal-chasing-chips-that-bake-ai-models-into-silicon/

AMD announced that it will acquire Taalas to build future model-specific AI inference chips that are purpose built to accelerate single models

The post AMD to Acquire Taalas for Model Specific AI Inference Chips appeared first on ServeTheHome.

Well, it appears that the chip startup Taalas has found a solution to LLM response latency and performance by creating dedicated hardware that 'hardwires' AI models. Taalas Manages to Achieve 10x Higher TPS With Meta's Llama 8B LLM, That Too With 20x Lower Production Costs When you look at today's world of AI compute, latency is emerging as a massive constraint for modern-day compute providers, mainly because, in an agentic environment, the primary moat lies in token-per-second (TPS) figures and how quickly you can get a task done. One solution the industry sees is integrating SRAM into their offerings, and […]

Read full article at https://wccftech.com/this-new-ai-chipmaker-taalas-hard-wires-ai-models-into-silicon-to-make-them-faster/