AI7/10
Analysis Estimates Infrastructure Needed to Serve 100 Million Muse Users
Kenneth Auchenberg highlights a back-of-envelope estimate of compute for Meta's Muse at 100 million daily users, citing roughly 65,000 CPUs and 75PB of DRAM, about $2.8B in CPU and memory costs. He argues agentic computing will strain CPU and memory supply.
Original post · 1 min read
For Muse to serve 100M users, Meta needs:
- 25M live VM's = about 65K CPUs.
- 25M live VMs * 3GB = 75PB of physical DRAM.
At the current public pricing, that is ~$2.8B in just CPUs and memory.
As we enter an agent-first world, we need more efficient ways to run agentic compute, as we simply won't have enough CPUs and memory.
Building something? I'd love to talk to you!
- 25M live VM's = about 65K CPUs.
- 25M live VMs * 3GB = 75PB of physical DRAM.
At the current public pricing, that is ~$2.8B in just CPUs and memory.
As we enter an agent-first world, we need more efficient ways to run agentic compute, as we simply won't have enough CPUs and memory.
Building something? I'd love to talk to you!
Freda Duan @FredaDuanA humble attempt to est. the infra required to serve 100M DAU @Muse
Rough conclusion is:
1 GW of power to serve 100M DAU in the base case, of which only ~0.1 GW comes from the CPU/VM layer. Depending on the # of reasoning-equivalent model calls one Muse DAU generates per day, 3-4GW is entirely plausible. Maybe that’s why @Meta is rumored to be adding 7-10GW of compute next year.
The sandbox layer = sub $1B of CPU content and ~$2B of DRAM content, which is much smaller than many expected.
Lot of moving assumptions. Welcome all feedbacks/ pushbacks.
------
Two very different pieces of infr…
♥ 420 · ⟲ 21 · 👁 312.4KView on X ↗
