Network Entropy is Decomposing Memory

The article title, “Network Entropy is Decomposing Memory,” may call up ghoulish images from a B-Horror movie, but it shouldn’t. It refers to a positive dynamic described by Rob Gingell, the former chief engineer at Sun Microsystems. He said that “Over time networks have this property of wanting to decompose things into constituent parts, have those parts get specialized and then reintegrated.”
text box of the network entropy process - decompose, specialize, reintegrate
This network entropy process has occurred many times. Some have described it as a pendulum swinging between centralized computing and decentralized computing. But Greg Papadopoulos, former CTO at Sun Microsystems, sees it differently. “I think it’s a spiral upwards and we come to a place and we look down and it looks familiar. You know, where you’ll say, oh I see, here’s a 3270 connected to a mainframe. Well, that looks like a browser connected to a web server.”

The Network is the Computer®

DCIG’s current research into composable infrastructure has taken me back to the early days of my IT career. I managed DEC VAX minicomputers. At that time, the phrase “The Network is the Computer®” described the vision of Sun Microcomputers. Today, it is a trademark of Cloudflare, Inc. Whoever owns the trademark, it was—and is—a powerful concept that continues to shape computer architectures and IT careers.

Network Entropy has Decomposed Servers, Storage, Compute and Networking

The most common terminology used for network entropy is virtualization. We have experienced server virtualization, storage virtualization, network virtualization, and even memory virtualization for decades now. Indeed, the initials of the operating system used by the first computer systems I managed stood for Virtual Memory System.
More recently, the rise of GPUs, SmartNICs, ASICs, FPGAs, IPUs and other specialized processors demonstrates the network entropy effect on computing resources. When applied to networking, the industry appears to be coalescing around the term DPU. A DPU is a programmable processor with acceleration engines for moving data around the data center. DPUs handle various security, communication, and storage functions.

Network Entropy is Decomposing Memory

Network entropy is now decomposing memory. Though we are still in the early phases of a persistent-memory-enabled revolution in performance, cost, and capacity, multiple vendors are now shipping storage class memory in their enterprise servers and storage systems. The revolution has begun.
Memory is the last critical infrastructure component that needs to become virtualized and composable to better enable the data-intensive processing demands of modern applications.” – Bernie Wu, VP of Business Development, MemVerge

Specialization – The Decades-long Search for Next-Generation Memory

Key infrastructure providers such as Intel, IBM, Micron, and Samsung have long recognized that DRAM technology is approaching limits in both capacity and bandwidth. A significant aspect of that next generation is that it is nonvolatile. It retains data in the absence of power.
These companies have for decades been exploring alternate memory technologies. These specialized technologies include MRAM, FRAM, ReRAM, and PCM. For a long time, these research efforts did not make it out of the lab and into general availability. That has changed.

Storage Class Memory is Here in Production Volumes

Today multiple providers are shipping what is popularly called “storage class memory” in production volumes. These memories come from multiple major chip foundries, including TSMC, Samsung, Global Foundries.
In terms of shipped capacity, the initial SCM leaders are 3D XPoint (Intel Optane) and MRAM. In 2021, MRAM shipments crossed the 100 TB threshold, and 3D XPoint shipments are estimated at 1,000 petabytes.

Reintegration – Memory Advances are Reshaping Storage and Data Center Architectures

Making big memory broadly available to a wide range of standard workloads requires an ecosystem beyond the storage class memory itself. Standards, plugfests, and hackathons all play a role in the reintegration process.
Standards such as DDR5, PCIe 5.0, CXL, Gen-Z, and NVMe are essential enablers of the next-generation data center. All these technologies are now available for integration into systems.

Call it What You Will, This is a Big Deal

These standards enable large amounts of DRAM and SCM to be disaggregated, pooled, and accessed via either CXL or even more widely via Gen-Z. This is new!

chart of the new memory pyramid -

The industry has coalesced around these standards, but not around what to call this new memory entity. Candidates include:

  • Big memory
  • Fabric-attached memory
  • Memory virtualization
  • Shared far memory
  • Software-defined memory

Whatever terminology we use, these technologies are about to reshape storage and data center architectures. For the first time, memory is becoming a networked resource. Within the data center, this gives new meaning to the phrase, “The Network is the Computer®.”

What to do now

Today, we are at the turning of the tide for storage and data center architectures. The time has come for enterprise technologists to look for high-value tactical wins. They should also begin planning infrastructure refreshes around a composable, data-centric, big memory architecture.

Keep Up to Date with DCIG

To be notified of new DCIG articles, reports, and webinars, sign up for DCIG’s free weekly Newsletter.
Technology providers interested in licensing DCIG TOP 5 reports or having DCIG produce custom reports, please contact DCIG for more information
Resources:
“The Network is the Computer,” https://blog.cloudflare.com/the-network-is-the-computer/
“The Network is the Computer: A Conversation with Greg Papadopoulos,” https://blog.cloudflare.com/greg-papadopoulos/
“Experienced Business Development Leader Bernie Wu Joins MemVerge,” https://www.prnewswire.com/news-releases/experienced-business-development-leader-bernie-wu-joins-memverge-301377021.html
“Dynamic Trends in Nonvolatile Memory Technologies,” https://www.snia.org/sites/default/files/PM-Summit/2021/snia-pm-cs-summit-Coughlin-Handy-Dynamic-Trends-2021.pdf
“Four Top Use Cases for Big Memory Today and Tomorrow,” https://www.snia.org/educational-library/four-top-use-cases-big-memory-today-and-tomorrow-2021
Editors Note: MemVerge is a DCIG client. However, no vendor sponsored this article. 

Click Here to Signup for the DCIG Newsletter!

Categories

DCIG Newsletter Signup

Thank you for your interest in DCIG research and analysis.

Please sign up for the free DCIG Newsletter to have new analysis delivered to your inbox each week.