Sam Altman Size of LLMs wont matter as much moving forward

News Summary

  • And most people aren’t willing to do that,” he said.When asked about the letter that requested that OpenAI pause for six months, he defended his company’s approach, while agreeing with some parts of the letter.“There’s parts of the thrust [of the letter] that I really agree with.
  • I don’t think the [suggestions in the] letter is the ultimate way to address it,” he said.Altman says he’s being open about the safety issues and the limitations of the current model because he believes it’s the right thing to do.
  • “I think we’re at the end of the era where it’s gonna be these giant models, and we’ll make them better in other ways,” Altman said.He sees size as a false measurement of model quality and compares it to the chip speed races we used to see.
  • But unfortunately, I think the letter is missing most technical nuance about where we need to pause — an earlier version of the letter claimed we were training GPT-5.
  • “I think there’s been way too much focus on parameter count, maybe parameter count will trend up for sure.
  • So I think moving with caution, and an increasing rigor for safety issues is really important.
When OpenAI cofounder and CEO Sam Altman speaks these days, it makes sense to listen. His latest venture has been on everyones lips since the release of GPT4 and ChatGPT, one of the most sophistica [+4010 chars]