A Stealth Startup Thinks It Just Hacked the Memory

What happened

An ambitious chip startup that has spent more than seven years quietly trying to redesign the architecture for computer memory has just come out of stealth mode and believes its new approach can help ease the global memory-chip shortage—provided it can produce its technology at scale.

“For a long time our thinking was that we’d work on SRAM first and then follow up with DRAM and HBM,” says Debo Olaosebikan, a Kepler Computing cofounder and its chief executive officer. “But with the launch of ChatGPT [in 2022] and the explosion of demand for an HBM alternative, we started working on our HBM road map.

” “We didn’t go in thinking that this would be a replacement for DRAM or a replacement for SRAM,” says Srini Ananth, managing director at Intel Capital. ” In bypassing ultraviolet lithography, Kepler is one of a few tech startups working to avoid one of the major bottlenecks in semiconductor manufacturing.

The startup claims it can produce SRAM that achieves the same density as 2-nanometer or 3-nanometer chips without having to invest in EUV. “Kepler’s approach is at the sweet spot of our strategy,” says Ed Kaste, senior vice president of GlobalFoundries’ CMOS business. ” Kepler’s overarching pitch is that the accelerated computing market shouldn’t have to wait for brand-new memory fabs to be built in order to meet demand.

Instead, new approaches to building memory within existing fabs can increase supply. Their approach is twofold. In terms of improving HBM, Kepler says it has developed a novel 3D-manufacturing technique that fits more memory chips within a fixed footprint. The core compute can then sit closer to the memory, so the data travel between the two uses less energy.

Why it matters

Kepler Computing, a San Jose, California–based startup founded in 2018 by a team of physicists and computer scientists, says it has developed a new architecture for high-bandwidth memory (HBM) that directly addresses some of the chip supply bottlenecks that are constraining the computing market.

While chipmakers typically rely on expensive extreme ultraviolet lithography (EUV) to shrink the transistors on a chip, thereby packing more technology into the same amount of space, Kepler claims that its “3D stacking” approach and a proprietary new material allow it to increase density without relying on EUV at all—and it can work with existing semiconductor fabrication plants.

Kepler says it has made similar gains for the high-speed cache memory typically used in CPUs, GPUs, and XPUs. This so-called SRAM sits within the core of a chip die in order to cut down on data transfer times. HBM, by contrast, uses stacks of DRAM, which is a separate memory component of chips. The company has raised $468 million in funding over the past few years from big-name backers.

This includes GlobalFoundries, Intel Capital, AMD Ventures, the British investment fund Baillie Gifford, and Bill Gates, through his private Gates Frontier fund. ” For now, much of Kepler’s testing is happening in Singapore, which is where GlobalFoundries—a manufacturing partner and investor of $50 million—has a facility.

Over the past two years Kepler has been building out what it refers to as “mini fabs,” where it produces its memory chips in conjunction with Global Foundries’ 28-nanometer chips. ) Kepler and its investors say the startup’s new approach to building memory chips couldn’t come at a better time.

The global memory chip shortage has reaffirmed at least two realities about the market: Building new fabs is hugely expensive and painstaking, and the demands around certain kinds of memory tend to be cyclical. In a data-center-driven, AI-crazed world, HBM has become the memory du jour. A semiconductor process chamber used by Kepler in its dedicated fab for developing next-generation memory devices.

Some of the world’s leading memory makers, including SK Hynix and Micron, have been racing to build multibillion-dollar fabs in order to meet demand, wagering that even by the time those facilities are operational, the industry will still be looking for high-bandwidth memory.

What to watch

Their ultimate goal is to move data around in HBM with the amount of energy that’s comparable to SRAM, all while keeping HBM’s large capacity. Specialized process-development equipment used by Kepler in its dedicated test fab. Kepler also says it has improved the density of SRAM using ferroelectrics, which can read and write data at lower voltages than the mechanisms typically used to process and store data in semiconductors.

The startup did this by developing a new, low-voltage, composite material that works with this ferroelectric approach. Sasi Manipatruni, a Kepler cofounder and its chief technology officer, says the Kepler team went through 35 iterations of composites before they landed on a material class that they thought would make memory chips easier and cheaper to make.