News Summary

• Amazon invited me on a private tour of the chip development lab at the heart of the OpenAI deal.
• Industry experts are watching Amazon’s Trainium chip, created at that facility, for its implications for lower-cost AI inference.
• Inference — the process of actually running an AI model to generate responses — is currently the biggest performance bottleneck in the industry.
• Amazon says its new chips running on its new specialty Trn3 UltraServers cost up to 50% less to run for comparable performance than using classic cloud servers.