Samsung unveils new high-bandwidth memory chip with integrated AI processing

Samsung is one of the leading memory chip manufacturers and recorded a strong 26% increase in operating profit in the fourth quarter of 2020. The company plans to continue this trend and today launched the world’s first HBM (High Bandwidth Memory) chip. Significantly improved performance and power efficiency thanks to the integrated artificial intelligence (AI) processing unit.

The new memory chip is officially called HBM-PIM, with PIM standing for Processing In-Memory Architecture. How is it different from existing chip solutions? Samsung explained in an official blog post that the Neumann architecture uses separate processors and memory units for data processing tasks.

According to the company, this method can create a “bottleneck that slows down the system” as data is constantly passed back and forth between the two units. Samsung tried to solve exactly this problem with its new HBM-PIM chip. Installing a DRAM-optimized AI engine within the memory bank “enables parallel processing and minimizes data movement,” according to the blog post.

This AI processing unit was added to the company’s HBM2 Aquabolt solution introduced in 2018. Samsung claims that overall performance is more than doubled and power consumption is reduced by 70%. This could be a game-changer for AI applications, as no hardware or software changes are required. Simply replace your existing HBM system.

Currently, Samsung says its HBM-PIM chip is being tested by leading AI solution providers around the world. These chips are expected to be delivered to customers for testing and validation in the first half of 2021.