Netlist goes virtual and dense with server memory

So much for that Cisco UCS memory advantage

Netlist, a publicly traded company based in Irvine, California that was founded in 2000 and that you have probably never heard of, will probably make a big splash at the SC09 supercomputing trade show next week. Netlist, which makes memory modules on an OEM basis for various companies, said Wednesday that in December it will roll out a virtualized, dense memory DDR3 module that will be able to trick servers into having more main memory than they are supposed to.

The ability to offer more memory capacity on an x64 server than is allowed in standard boxes is, of course, one of the key selling points of Cisco Systems' B250-M1 blade server in the "California" Unified Computing System and its rack-based sibling, the C250-M1. Both of these machines are equipped with a special memory ASIC that allows Cisco's two-socket Xeon 5500 servers to address up to 384GB of main memory, when a standard server tops out at 96GB in machines with 12 memory slots and at 144GB in machines with 18 slots using very pricey 8GB DIMMs. With the memory extender ASIC on the B250 and C250 servers, Cisco can use less capacious and cheaper 2GB and 4GB DIMMs to get a given capacity, and do so for a lot less money - between a quarter and a third of the price of other server platforms that have to resort to denser and more expensive memory.

Enter Netlist with its HyperCloud memory modules - which, by the way, will plug into any server and which will do essentially the same trick as Cisco is pulling, but do so inside the memory module rather than on the motherboard.

Netlist got its start in 2000 doing custom printed circuit board design, and a "netlist," according to Paul Duran, director of business development at the company, is akin to a bill of materials for all of the connectivity on a PCB. A few years back, when dense rack and blade servers started going volume, Netlist became a specialist in making very low profile memory on an OEM basis for blade server makers. (The company does not disclose who its customers are, but they're probably the usual suspects.) The company also developed a memory packaging technology called Planar-X, which allows for two PCBs loaded with memory chips to be packaged together relatively inexpensively to share a single memory slot. This technique is cheaper and more reliable, according to Duran, than some of the dual-die packaging techniques memory module makers use to make dense memory cards out of low density and cheaper memory chips.

With the HyperCloud memory, Netlist has created its own memory virtualization ASIC and is plunking it onto planar or Planar-X DDR3 memory modules, depending on what server makers want to deploy.

Using the Planar-X double-board designs, Netlist can take 1Gb memory chips and make an 8GB memory module that costs only 20 to 30 per cent more than a standard 4GB module using 1Gb chips; using 2Gb chips, it can make a 16GB module, something no one else can do yet.

But this is not the neat bit.

In the current Nehalem Xeon designs, there is a limit to the number of ranks of memory that each memory channel can address. A standard DDR3 DIMM has four ranks of memory (two arrays of chips linked together on each side of the module) and each memory channel in the processor's integrated memory controllers can only address eight ranks per channel. With three channels per Nehalem processor, you top out at 96GB of main memory using four-rank 8GB DDR3 DIMMs, which aren't even available yet - and even then they are, they will be wicked expensive. And on the machines that have 18 memory slots, offering 144GB of memory capacity using 8GB DIMMs, you have to slow the memory down because there is a cap on the bandwidth the Xeon 5500s and their memory controllers will allow - 800 MT/sec, which means it has to run at 800MHz instead of 1.33GHz. This obviously has a big effect on performance.

The HyperCloud 2 vRank DDR3 DIMMs have two special ASICs. The first, a register device, presents four physical ranks of memory as two virtual ones to the memory controller on an x64 processor (it works with either Xeon or Opteron processors, and any DDR3 memory controller, for that matter). This allows the doubling-up of memory modules per channel. And, thanks to the Planar-X packaging, Netlist can put twice as much physical memory in a slot. The other ASIC is an isolation device that makes four memory slots look like one as far as the memory controllers and memory bandwidth are concerned, allowing for main memory to run at the full 1.33GHz speed, even on a system with 18 slots that is fully populated. The maximum of 384GB per two-socket server assumed 24 memory slots.

Duran says that Netlist will be making the first batches of HyperCloud memory using Hynix memory chips, and that the plan is to charge a slight premium (that's the 20 to 30 per cent mentioned above) for this memory compared to the prevailing spot prices for unvirtualized 4GB and 8GB DDR3 memory modules. The company can probably charge more for 16GB modules, since no one has these yet.

What's the net effect of using HyperCloud memory? Duran cooked up this comparison: take 60 Xeon-based servers, each with 48 virtual machines allocated with 4GB. By installing HyperCloud memory and doubling up memory capacity, the number of servers can be cut in half (assuming memory, not CPU capacity, is the main bottleneck for virtualization). If you assume that - and maybe that is rational and maybe not, but that is certainly Cisco's sales pitch - then using HyperCloud memory on those Xeon rack servers cuts the number of servers in half, power consumption by 36 per cent, and cuts hardware and software costs at the data center level by around 20 per cent. Memory is a big component of a server's price these days, and Netlist is charging a premium for its virtualized memory; hence, even when you cut the server count in half, the iron cost doesn't come down as much as you might expect.

The one cost that Duran did not calculate was savings in power and cooling, but the HyperCloud memory burns under 10 watts for a 16GB module, and in general, for a given capacity, a HyperCloud module will burn 2 to 3 watts less than a standard DDR3 module. And because HyperCloud memory can run at the full 1.33GHz speed, regardless of the capacity in the box, there should be a sizeable performance boost on applications that are sensitive to memory bandwidth - maybe as high as 50 per cent, says Duran.

Netlist plans to start sampling HyperCloud memory modules to OEM customers beginning in December, and expects volume production to begin in the first quarter of 2010. You can bet that more than one server maker will be lining up to give the product a spin as they try to push Cisco back into its networking space. ®

Narrower topics

Other stories you might like

  • How ICE became a $2.8b domestic surveillance agency
    Your US tax dollars at work

    The US Immigration and Customs Enforcement (ICE) agency has spent about $2.8 billion over the past 14 years on a massive surveillance "dragnet" that uses big data and facial-recognition technology to secretly spy on most Americans, according to a report from Georgetown Law's Center on Privacy and Technology.

    The research took two years and included "hundreds" of Freedom of Information Act requests, along with reviews of ICE's contracting and procurement records. It details how ICE surveillance spending jumped from about $71 million annually in 2008 to about $388 million per year as of 2021. The network it has purchased with this $2.8 billion means that "ICE now operates as a domestic surveillance agency" and its methods cross "legal and ethical lines," the report concludes.

    ICE did not respond to The Register's request for comment.

    Continue reading
  • Fully automated AI networks less than 5 years away, reckons Juniper CEO
    You robot kids, get off my LAN

    AI will completely automate the network within five years, Juniper CEO Rami Rahim boasted during the company’s Global Summit this week.

    “I truly believe that just as there is this need today for a self-driving automobile, the future is around a self-driving network where humans literally have to do nothing,” he said. “It's probably weird for people to hear the CEO of a networking company say that… but that's exactly what we should be wishing for.”

    Rahim believes AI-driven automation is the latest phase in computer networking’s evolution, which began with the rise of TCP/IP and the internet, was accelerated by faster and more efficient silicon, and then made manageable by advances in software.

    Continue reading
  • Pictured: Sagittarius A*, the supermassive black hole at the center of the Milky Way
    We speak to scientists involved in historic first snap – and no, this isn't the M87*

    Astronomers have captured a clear image of the gigantic supermassive black hole at the center of our galaxy for the first time.

    Sagittarius A*, or Sgr A* for short, is 27,000 light-years from Earth. Scientists knew for a while there was a mysterious object in the constellation of Sagittarius emitting strong radio waves, though it wasn't really discovered until the 1970s. Although astronomers managed to characterize some of the object's properties, experts weren't quite sure what exactly they were looking at.

    Years later, in 2020, the Nobel Prize in physics was awarded to a pair of scientists, who mathematically proved the object must be a supermassive black hole. Now, their work has been experimentally verified in the form of the first-ever snap of Sgr A*, captured by more than 300 researchers working across 80 institutions in the Event Horizon Telescope Collaboration. 

    Continue reading
  • Shopping for malware: $260 gets you a password stealer. $90 for a crypto-miner...
    We take a look at low, low subscription prices – not that we want to give anyone any ideas

    A Tor-hidden website dubbed the Eternity Project is offering a toolkit of malware, including ransomware, worms, and – coming soon – distributed denial-of-service programs, at low prices.

    According to researchers at cyber-intelligence outfit Cyble, the Eternity site's operators also have a channel on Telegram, where they provide videos detailing features and functions of the Windows malware. Once bought, it's up to the buyer how victims' computers are infected; we'll leave that to your imagination.

    The Telegram channel has about 500 subscribers, Team Cyble documented this week. Once someone decides to purchase of one or more of Eternity's malware components, they have the option to customize the final binary executable for whatever crimes they want to commit.

    Continue reading
  • Ukrainian crook jailed in US for selling thousands of stolen login credentials
    Touting info on 6,700 compromised systems will get you four years behind bars

    A Ukrainian man has been sentenced to four years in a US federal prison for selling on a dark-web marketplace stolen login credentials for more than 6,700 compromised servers.

    Glib Oleksandr Ivanov-Tolpintsev, 28, was arrested by Polish authorities in Korczowa, Poland, on October 3, 2020, and extradited to America. He pleaded guilty on February 22, and was sentenced on Thursday in a Florida federal district court. The court also ordered Ivanov-Tolpintsev, of Chernivtsi, Ukraine, to forfeit his ill-gotten gains of $82,648 from the credential theft scheme.

    The prosecution's documents [PDF] detail an unnamed, dark-web marketplace on which usernames and passwords along with personal data, including more than 330,000 dates of birth and social security numbers belonging to US residents, were bought and sold illegally.

    Continue reading

Biting the hand that feeds IT © 1998–2022