Intel bets big on AI with third-gen Xeons tuned for deep learning, VMs, in-memory databases, analytics

There's also a Stratix FPGA designed with AI tasks in mind

Intel plans to debut its third-generation "Cooper Lake" Xeon Scalable processors today, alongside revised Optane memory, 3D NAND SSDs, and an FPGA tuned for AI workloads.

"We've got over 35 million Xeon Scalable processors deployed and Xeon is the foundation of the world's data-centric infrastructure," Lisa Spelman, corporate veep and general manager of Intel's Xeon and memory group, told a media briefing on Monday. "The third gen really evolves our four and eight-socket processor offerings."

Intel's third-generation Xeon Scalable processors, now shipping to corporate customers, are designed for data centers and networking environments, particularly those that handle workloads associated with deep learning, virtual machines, in-memory databases, and analytics.

The 14nm "Cooper Lake" Xeons offer up to 28 cores per processor and up to 224 cores per chip in an eight-socket configuration. There's also a four-socket configuration, and Intel plans to deliver 10nm one and two-socket configurations ("Ice Lake") soon, with a next-generation Xeon release called "Sapphire Lake" scheduled for 2021.

Intel initially hoped to ship 10nm chips in 2015 and finally managed to do so for its Core processor line last fall.

The "Cooper Lake" chips support up to six Ultra Path Interconnect (UPI) channels; up to six channels of DDR4-3200 MT/s; 16Gb DIMMs, with up to 256GB DDR4 DIMMs per socket; and Intel Advanced Vector Extensions 512 (AVX-512).

The server chips have gained support for bfloat16, a custom encoding format for representing numbers in 16 bits that's used for machine learning and Vector Neural Network Instructions. Together, these AI-oriented enhancements are referred to as Intel Deep Learning Boost, a feature set introduced in 2019.

Intel 3rd Gen Xeon, graphic

Intel's slide on its third-gen Xeon server processors ... Click to enlarge

In conjunction with Intel-optimized distributions of AI frameworks like TensorFlow and PyTorch, customers can look forward to more efficient number crunching. Intel claims its Deep Learning Boost iteration can deliver 1.93x faster training for image classification and 1.87x faster inference performance for image classification, compared to the previous Xeon generation.

More generally, Intel says third-gen Xeons manage 1.9x performance on "popular workloads" and up to 2.2x more VMs compared to four-socket server chips from five years ago.

Chipzilla is also revealing its Stratix 20 NX FPGAs, the company's first FPGA tuned specifically for AI tasks. The FPGAs implement arrays of lower-precision tensor arithmetic blocks intended to handle calculations involving matrices and vectors. Intel claims its specialized FPGAs deliver 15X more INT8 throughput than its Stratix 10 FPGA, which implements a digital signal processing block rather than a tensor block.

"The introduction of the AI tensor block delivers as much as a 15X for performance gain for AI applications and brings new innovative capability to Intel's broad silicon and software portfolio for AI," said David Moore, corporate VP and general manager of Intel's Programmable Solutions Group.

Stratix 20 NX, due anytime between July and December, also includes 3D stacked HBM2 high-bandwidth DRAM so large AI models can be stored on chip and supports transceiver data rates of up to 57.8Gbps using PAM4 [PDF] encoding.

To complement its four-socket Xeons, Intel is shipping its Optane Persistent Memory 200 series, which, when wedded to compatible Intel processors, offers up to 3TB of PMem per socket and total memory capacity of 4.5TB per socket, including DRAM.

Lastly, Intel is making its 3D NAND SSDs – D7-P5500 and SSD D7-P5600 – available. They include a power loss data protection scheme and various firmware enhancements like dynamic namespace management, additional security features, improved SMART monitoring, Telemetry 2.0, and optimize TRIM architecture. ®

Broader topics

Other stories you might like

  • Monero-mining botnet targets Windows, Linux web servers
    Sysrv-K malware infects unpatched tin, Microsoft warns

    The latest variant of the Sysrv botnet malware is menacing Windows and Linux systems with an expanded list of vulnerabilities to exploit, according to Microsoft.

    The strain, which Microsoft's Security Intelligence team calls Sysrv-K, scans the internet for web servers that have security holes, such as path traversal, remote file disclosure, and arbitrary file download bugs, that can be exploited to infect the machines.

    The vulnerabilities, all of which have patches available, include flaws in WordPress plugins such as the recently uncovered remote code execution hole in the Spring Cloud Gateway software tracked as CVE-2022-22947 that Uncle Sam's CISA warned of this week.

    Continue reading
  • Red Hat Kubernetes security report finds people are the problem
    Puny human brains baffled by K8s complexity, leading to blunder fears

    Kubernetes, despite being widely regarded as an important technology by IT leaders, continues to pose problems for those deploying it. And the problem, apparently, is us.

    The open source container orchestration software, being used or evaluated by 96 per cent of organizations surveyed [PDF] last year by the Cloud Native Computing Foundation, has a reputation for complexity.

    Witness the sarcasm: "Kubernetes is so easy to use that a company devoted solely to troubleshooting issues with it has raised $67 million," quipped Corey Quinn, chief cloud economist at IT consultancy The Duckbill Group, in a Twitter post on Monday referencing investment in a startup called Komodor. And the consequences of the software's complication can be seen in the difficulties reported by those using it.

    Continue reading
  • Infosys skips government meeting – and collecting government taxes
    Tax portal wobbles, again

    Services giant Infosys has had a difficult week, with one of its flagship projects wobbling and India's government continuing to pressure it over labor practices.

    The wobbly projext is India's portal for filing Goods and Services Tax returns. According to India's Central Board of Indirect Taxes and Customs (CBIC), the IT services giant reported a "technical glitch" that meant auto-populated forms weren't ready for taxpayers. The company was directed to fix it and CBIC was faced with extending due dates for tax payments.

    Continue reading
  • Google keeps legacy G Suite alive and free for personal use

    Google has quietly dropped its demand that users of its free G Suite legacy edition cough up to continue enjoying custom email domains and cloudy productivity tools.

    This story starts in 2006 with the launch of “Google Apps for Your Domain”, a bundle of services that included email, a calendar, Google Talk, and a website building tool. Beta users were offered the service at no cost, complete with the ability to use a custom domain if users let Google handle their MX record.

    The service evolved over the years and added more services, and in 2020 Google rebranded its online productivity offering as “Workspace”. Beta users got most of the updated offerings at no cost.

    Continue reading
  • GNU Compiler Collection adds support for China's LoongArch CPU family
    MIPS...ish is on the march in the Middle Kingdom

    Version 12.1 of the GNU Compiler Collection (GCC) was released this month, and among its many changes is support for China's LoongArch processor architecture.

    The announcement of the release is here; the LoongArch port was accepted as recently as March.

    China's Academy of Sciences developed a family of MIPS-compatible microprocessors in the early 2000s. In 2010 the tech was spun out into a company callled Loongson Technology which today markets silicon under the brand "Godson". The company bills itself as working to develop technology that secures China and underpins its ability to innovate, a reflection of Beijing's believe that home-grown CPU architectures are critical to the nation's future.

    Continue reading

Biting the hand that feeds IT © 1998–2022