Samsung doubles down in HBM race with largest memory

The world’s No. 1 memory chip producer has developed the industry’s biggest 36 GB 12-layer HBM3E

Samsung's HBM3E 12H (Courtesy of Samsung Electronics)
Samsung's HBM3E 12H (Courtesy of Samsung Electronics)
Chae-Yeon Kim 3
2024-02-27 17:00:07 why29@hankyung.com
Korean chipmakers

Samsung Electronics Co. has developed the industry’s first 36-gigabyte (GB) 12-layer high-value, high-performance memory chip in a bid to restore its reputation as a memory giant in the burgeoning high bandwidth memory (HBM) market currently led by its crosstown rival SK Hynix Inc.

The South Korean chip juggernaut on Tuesday unveiled its fifth-generation HBM product, the HBM3E 12H, which is composed of 12 layers of dynamic random-access memory chips stacked horizontally that boasts the industry’s largest memory capacity of 36 GB for HBM.

The new HBM product’s capacity and performance have improved by more than 50% than its predecessor, the eight-layer HBM3 8H, said the company.

With its most advanced HBM chip, Samsung Electronics is going all out to snatch the crown from its local rival SK Hynix in the HBM market.

The world’s No. 1 memory company said it has already provided HBM3E 12H samples to its customers and plans to mass-produce the chips in the first half of this year.

HBM is a high-value, high-performance memory chip made of vertically interconnected multiple DRAM chips, which significantly speed up data processing compared with general DRAM products, while reducing latency, power and size.

Its demand is rapidly growing as such high-performance chips are essential technology to drive the artificial intelligence revolution.

SK Hynix's HBM3 (Courtesy of SK Hynix)
SK Hynix's HBM3 (Courtesy of SK Hynix)

The global HBM market is currently commanded by SK Hynix, the world’s first memory vendor to develop the first-generation HBM chip in 2013 and unveiled succeeding products – the HBM2, HBM2E and the latest and fourth-generation HBM3 chips – in the following years.

It developed the world’s first 12-layer HBM3 with a 24 GB memory capacity in April last year and HBM3E chips four months later.

According to market tracker TrendForce, SK Hynix led the HBM market with a 50% market share as of 2022, followed by Samsung (40%) and Micron Technology Inc. (10%).

SIXTH-GENERATION HBM IN 2026

Samsung Electronics uses advanced thermal compression non-conductive film (TC NCF) to make the height of its newest 12-layer HBM3E product the same as that of the eighth-layer ones.

It also trims the NCF materials' thickness to reduce the gap between chips the industry’s smallest at 7 micrometers (µm), while also eliminating voids between layers, the company said.  

SamsunElectronicss' semiconductor manufacturing site in Hwaseong (Courtesy of Samsung Electronics)
SamsunElectronicss' semiconductor manufacturing site in Hwaseong (Courtesy of Samsung Electronics)

During the chip bonding process, the company uses smaller bumps for signaling and larger ones for heat dissipation, which improve the high-performance chip’s production yields.

The HBM3E 12H provides an all-time high bandwidth of up to 1,280 gigabytes per second (GB/s), meaning that with the chip, about 40 UHD movies with a 30GB capacity each can be downloaded per second.

When used in AI applications, it is estimated that the average speed for AI training can be increased by 34% from the HBM3 8H, the company said.

“This new memory solution forms part of our drive toward developing core technologies for high-stack HBM and providing technological leadership for the high-capacity HBM market in the AI era,” Bae Yongcheol, executive vice president of Memory Product Planning at Samsung Electronics, said in a statement.

As the AI chip market is expected to grow tenfold by 2030, Samsung Electronics plans to more than double its HBM capacity this year from last year to lift its HBM output to the industry’s largest.

Its development of the sixth-generation HBM, the HBM4 chip, is also underway to meet the targets to provide its samples in 2025 and mass-produce them in 2026, Samsung Electronics said.  

The company is also set to develop a new chip fabrication process to eliminate the gap between chips in the HBM4 16H product line.  

Write to Chae-Yeon Kim at why29@hankyung.com


Sookyung Seo edited this article.

SK Hynix swings to profit; sees 60% surge in HBM demand

SK Hynix swings to profit; sees 60% surge in HBM demand

SK Hynix Inc. turned a profit in the last quarter of 2023, reversing losses over the past four quarters as high-performance chips such as double data rate 5 (DDR5) and high bandwidth memory 3 (HBM3) drove rapid sales growth, the company said on Thursday.The stronger-than-expected res

Samsung to double HBM chip production to lead on-device AI chip era

Samsung to double HBM chip production to lead on-device AI chip era

▲ Prepared for the AI Revolution! Explore Samsung Semiconductor's Exclusive CES 2024 Showcase! LAS VEGAS – Samsung Electronics Co., the world’s largest memory chipmaker, plans to more than double its high bandwidth memory (HBM) chip production volume as it aims to take the lead in t

Samsung, SK pin hopes on HBM sales with Nvidia's new AI chip

Samsung, SK pin hopes on HBM sales with Nvidia's new AI chip

Nvidia's H200 Tensor Core GPU (Photo captured from Nvidia's website) South Korean memory chipmakers like Samsung Electronics Co. and SK Hynix Inc. have high hopes for fast growth in their high-bandwidth memory (HBM) sales as US fabless chip designer Nvidia Corp. on Monday introduced its new art

Samsung Elec to launch HBM4 in 2025 to win war in AI sector

Samsung Elec to launch HBM4 in 2025 to win war in AI sector

Hwang Sang-joon, executive vice president of DRAM product & technology at Samsung (Courtesy of Samsung) Samsung Electronics Co., the world’s top memory chipmaker, aims to introduce sixth-generation top-performance High Bandwidth Memory4 (HBM4) DRAM chips in 2025 to win the intensifyin

HBM market to nearly double; next-gen DRAM to revive demand: KIW

HBM market to nearly double; next-gen DRAM to revive demand: KIW

SK Hynix Inc. and Samsung Electronics Co. are confident that a new memory chip market renaissance is just around the corner thanks to the generative artificial intelligence sensation, which is expediting the development of customized, high-performance next-generation chips.“An AI server

Samsung, SK Hynix in next-generation HBM chip supremacy war

Samsung, SK Hynix in next-generation HBM chip supremacy war

SK Hynix develops the industry's first HBM DRAM chip in 2013 Samsung Electronics Co. and SK Hynix Inc. – the world’s two largest memory chipmakers – have fiercely competed to advance their chip stacking technology to cut costs and improve performance.With the takeoff of ChatGP

(* comment hide *}