AMD has introduced a new plugin called vLLM-ATOM, which supercharges AI LLMs while supporting its Instinct MI350 and MI400 GPUs. AMD Offers Big Boost To AI LLMs With Its vLLM-ATOM Plugin That Works Seamlessly With vLLM & Accelerates AI Inference Performance The vLLM-ATOM is a purpose-built plugin that aims to improve inference performance across various AI LLMs. It is designed around AMD's high-performance Instinct GPU accelerators, such as the MI350 and MI400 series, running both as a standalone inference server or through seamless integration as a plugin backend. This allows users to take full advantage of AMD's native model and […]

Read full article at https://wccftech.com/amd-vllm-atom-plugin-supercharges-deepseek-r1-kimi-k2-gpt-oss-120b-ai-llm-inference-on-instinct-mi350-mi400/

AMD's MI450 GPUs are now being sampled to customers, and there's already huge interest in the MI500 series within AI Inference data centers. Customers Are Lining Up To Deploy AMD's MI450 GPUs As Sampling Begins, Next-Gen MI500 Also Gains Traction In The "AI Inferencing" Segment During the Q1 2026 earnings call, AMD CEO Dr. Lisa Su confirmed that they have started sampling the first Instinct MI450 GPUs to "lead" customers, and the chips remain on track for deployments at various data centers in the Helios rack, which will see production shipments commence in the second half of this year. Several […]

Read full article at https://wccftech.com/amd-sampling-mi450-gpus-engaged-with-customers-on-mi500-largest-ai-deployments-are-for-inference/