Intel launches 5th Gen Xeon processors with AI acceleration

Intel unveiled 5th Gen Xeon processors with AI acceleration in every core on the chip, with the first processors hitting the market in 2024.

Intel CEO Pat Gelsinger introduced the processors at the company’s AI Everywhere event.

The 5th Gen Intel Xeon processors, formerly codenamed Emerald Rapids, herald a new era in computing, the company said. These processors, designed for artificial intelligence, high-performance computing, networking, storage, databases, and security, bring forth improvements aimed at boosting performance while curbing total cost of ownership (TCO).

Sandra Rivera, Intel’s executive vice president and general manager of Data Center and AI Group, emphasized the significance of this launch in a statement.

“Built for AI, our 5th Gen Intel Xeon processors provide greater performance to customers deploying AI capabilities across cloud, network, and edge use cases. We’re launching 5th Gen Intel Xeon on a proven foundation that will enable rapid adoption and scale at lower TCO,” she said.

Key features of 5th Gen Xeon processors

• AI Acceleration in Every Core: These processors are optimized for AI workloads, offering up to 42% higher inference performance and minimal latency on large language models. They enable end-to-end AI processing without requiring additional accelerators, making AI tasks more efficient.
• Performance and Efficiency Gains: Compared to the previous generation, these processors deliver an average performance gain of 21% for general compute performance. They also offer a 36% increase in performance per watt across various customer workloads, leading to significant efficiency improvements.
• Enhanced Capabilities: With support for up to 64 cores per CPU, increased last-level cache, eight channels of DDR5, and higher memory transfer speeds, these processors offer improved performance and bandwidth. They also enable compatibility with CXL Type 3 workflows through leading cloud service providers.
• Security Enhancements: The processors come with Intel Trust Domain Extensions (Intel TDX), offering increased confidentiality and security at the VM level, ensuring enhanced privacy and control over data.

The 5th Gen Xeon processors, pin-compatible with the previous generation, will be available in single- and dual-socket systems from leading OEMs like Cisco, Dell, HPE, Lenovo, and others by the first quarter of 2024. Major cloud service providers will announce availability of instances based on these processors throughout the year.

Intel said plans to stay true to its roadmap commitments by introducing Sierra Forest, focused on E-core efficiency with up to 288 cores, in the first half of 2024. Following closely will be Granite Rapids, emphasizing P-core performance.