A startup claims it broke through a bottleneck thats holding back LLMs

Image for article A startup claims it broke through a bottleneck thats holding back LLMs
News Source : MIT Technology Review

News Summary

  • Miami-based AI startup Subquadratic came out of stealth mode last month with a huge claim.
  • It announced that it had solved a mathematical bottleneck that had been holding back large language models for almost a decade.
  • The company at first provided little evidence for its claims beyond a handful of self-published test scores.
  • A month on, the company has published more information about its model, including the results of additional independent tests run by third-party firm Appen.
  • The results suggest that the company’s claims might be worth paying attention to.
SubQ wont replace existing top models across the board, but it could offer huge increases in speed at a fraction of the typical cost for certain tasks.

Must read Articles