Startup swaps costly AI GPUs for Arm cores and up to 128TB of cheap LPDDR6 RAM instead of expensive HBM to smash through the memory wall

Image for article Startup swaps costly AI GPUs for Arm cores and up to 128TB of cheap LPDDR6 RAM instead of expensive HBM to smash through the memory wall
News Source : TechRadar

News Summary

  • Majestic Labs is a startup founded in 2023 by former Google and Meta engineers.
  • The Prometheus server swaps GPUs for Ignite AI Processing Units combining Arm cores with RISC-V vector and tensor engines.
  • Each Prometheus server can house up to 12 AIUs, sharing between 8 TB and 128 TB of LPDDR6 memory across one contiguous, coherent pool.
  • Majestic claims its architecture delivers over 50 times more fast memory than that rival configuration, alongside 1.7 times its interconnect bandwidth.

Must read Articles