Red Hat Acquires Neural Magic to Boost AI in Hybrid Cloud Environments
January 14, 2025Matt Hicks, Red Hat's CEO, emphasized the importance of Neural Magic's expertise in developing generative AI tailored to meet unique customer requirements for workload tuning and training.
The acquisition is expected to enhance operational efficiencies through improved fine-tuning capabilities and a broader ecosystem, providing customers with more choices in AI solutions.
Integrating Neural Magic's technology aims to deliver high-performance AI workloads that cater to a variety of customer needs, from data centers to edge deployments.
Red Hat has acquired Neural Magic, a company known for its expertise in generative AI performance engineering and model optimization, to bolster its AI capabilities in hybrid cloud environments.
The acquisition, which was first announced in late 2024, did not disclose a purchase price, although Neural Magic had previously raised $50 million in venture capital.
The acquisition process was likely facilitated by the relationship between Red Hat and Neural Magic, as the latter's former CEO, Brian Stevens, previously served as CTO and executive VP at Red Hat.
Red Hat's strategy includes offering open-source AI models that range from one billion to hundreds of billions of parameters, designed to operate in diverse environments such as corporate data centers and edge computing.
Neural Magic also contributes to the open-source vLLM project, which facilitates open model serving and increases accessibility for AI workloads.
Neural Magic's model compression techniques will allow for reduced size and computational requirements without significant accuracy loss, making AI more accessible and cost-effective.
Both Matt Hicks and Brian Stevens expressed optimism about the partnership's potential to reduce friction in enterprise AI deployment and highlighted a shared vision for an open future in AI.
Organizations will benefit from enhanced fine-tuning capabilities, enabling them to customize large language models securely for private data and specific use cases.
Red Hat aims to deliver operational and infrastructure efficiencies through improved inference performance engineering, further solidifying its position in the AI market.
Summary based on 5 sources
Get a daily email with more Tech stories
Sources
Business Wire • Jan 13, 2025
Red Hat Completes Acquisition of Neural Magic to Fuel Optimized Generative AI Innovation Across the Hybrid CloudZDNET • Jan 14, 2025
Red Hat bets big on AI with its Neural Magic acquisitionThe Fast Mode • Jan 15, 2025
Red Hat Acquires Neural Magic to Advance Generative AI Efficiency & Accessibility