High-bandwidth memory (HBM) is a form of DRAM in which several memory dies are stacked vertically and linked by through-silicon vias, then mounted next to a processor on a shared interposer using advanced packaging. The very wide connection between memory and processor gives far greater bandwidth, and better energy efficiency per bit, than memory on separate modules. The standard is set by the industry body JEDEC, and successive generations include HBM3, HBM3E and HBM4.
HBM became an investment theme because AI accelerators, such as data-centre GPUs, need it to feed their compute units during model training and inference. Only three semiconductor makers produce it at scale, SK hynix, Samsung and Micron, and it is harder to make than ordinary DRAM, so supply has constrained AI chip output. Its higher prices have also reshaped profits across the memory industry and the wider AI infrastructure supply chain.
Ref 1300000264