News Summary

• TurboQuant, Google's new AI memory compression algorithm, is called "Pied Piper" The joke is a reference to the fictional startup Pied Piper that was the focus of HBO's "Silicon Valley" TV series that ran from 2014 to 2019.
• Google Research described the technology as a novel way to shrink AI’s working memory without impacting performance.
• If successfully implemented in the real world, TurboQuant could make AI cheaper to run by reducing its runtime “working memory” — known as the KV cache — by “at least 6x”