AI’s hunger for both power and memory, plus the resulting supply crisis of the latter, has led to many industry players engaging in a spot of creative problem solving. Case in point, Micron and Meta have collaborated on an experimental data centre roll out of low power DRAM.
Micron has developed SOCAMM2, a fresh form factor for LPDDR5X that is a “modular, serviceable module designed for servers.” Testing used “Meta’s open-source DCPerf benchmark suite, which reflects production environments across a hyperscale fleet,” and found that this low-power DRAM module “consumes approximately one-third the power of DDR5.” According to Micron’s white paper report, that accounts for under 7% of total system power.
The white paper goes on to elaborate that LPDDR5X’s “reduced operating voltage and advanced signalling allows bandwidth to scale without a corresponding rise in power consumption, resulting in better bandwidth-per-watt performance than conventional server memory.” Basically, data centres can install more low power DRAM without also hiking up power-related operating costs.
The AI industry potentially switching away from DDR5 may sound like good news in the short term for memory-starved PC gamers, but the full picture is a little more complex. For one thing, ramping up production of low power DRAM will likely divert already stretched resources away from DDR5 manufacturing, leaving PC gamers in largely the same position. For another, low power DRAM tends to be used in mobile devices like phones and tablets, so consumers could still feel the pinch there.