Samsung Unveils Shinebolt: Game-Changing Next-Gen HBM3E DRAM for AI & HPC
During its Memory Tech Day 2023, Samsung introduced Shinebolt, their revolutionary next-generation HBM3E DRAM. Building upon their expertise in commercializing the industry’s first HBM2 and spearheading HBM market development for high-performance computing (HPC) in 2016, Samsung now unveils Shinebolt, poised to power next-generation AI applications, drive down total cost of ownership (TCO), and accelerate inference and training of AI models in data centers.
Samsung’s HBM3E boasts exceptional data transfer rates exceeding 1.2 terabytes per second (TBps), thanks to its remarkable 9.8 gigabits per second (Gbps) per pin performance. To enable higher-layer stacks and improve thermal characteristics, Samsung has enhanced its non-conductive film (NCF) technology by eliminating gaps between chip layers and boosting thermal conductivity.
Excitingly, Samsung showcased other impressive products at the event as well. The 32Gb DDR5 DRAM, which touts the highest capacity in the industry, the market’s first 32Gbps GDDR7, and the petabyte-scale PBSSD, delivering significant advancements in server application storage capabilities.
According to Samsung, GDDR7 memory is expected to outperform the currently available 24 Gbps GDDR6 DRAM by 40% while employing 20% less power. Achieving up to 1.5 TB/s of bandwidth with a 384-bit bus interface solution, the initial devices will offer transfer speeds of up to 32 Gbps—a remarkable 33% improvement over GDDR6 memory.
Furthermore, the GDDR7 memory will exhibit 20% greater efficiency, which is particularly remarkable considering how much power memory consumes on high-end GPUs. Reports suggest that the Samsung GDDR7 DRAM will feature specialized technology for high-speed workloads, along with a low-operating voltage alternative designed for power-conscious applications like laptops.
Samsung’s commitment to pushing the boundaries of technological innovation is evident in the unveiling of Shinebolt and other groundbreaking developments. With their advanced memory solutions, Samsung is undoubtedly poised to revolutionize AI and HPC, providing faster and more efficient computing power for a wide range of applications.