Why don't GPU/TPU manufacturers commoditize their RAM complement

Question

Wouldn't say nvidia sell more GPU's if RAM prices were lowered? What prevents them from buying up IP / RAM fab labs and commoditizing the blueprints for its manufacture? Perhaps to the public at large, or perhaps just relicensing it for very low prices to entities in friendly nations?

theandrewbailey · Accepted Answer

RAM isn't their business, and that market has lots of ups and downs. What happens to Nvidia's hypothetical RAM investments when the AI rush is over and RAM is cheap and can't compete in that market? They've come to the logical conclusion to let the RAM companies do their thing.

Sevii · Answer

RAM is already a commodity.

kristianp · Answer

In terms of data centre gpus, HBM is far from a commodity as only a one or two manufacturers can fabricate the stacks of RAM.https://newsletter.semianalysis.com/p/scaling-the-memory-wal...