Learning to use local AI is exciting, overwhelming, and frustrating
News Source : The Verge
News Summary
- It’s increasingly possible to run powerful models locally to see what they’re capable of.
- Hermes is a self-hosted AI agent desktop app that works on macOS, Windows, and Linux.
- Since this M5 Ultra Mac Studio has 256GB of unified memory, I could run just about any model I want.
- It wasn’t long to get up and running with Hermes and Qwen, and even make them controllable via my phone by using a Telegram bot.
Learning to use local AI is exciting, overwhelming, and frustrating Its like using cloudbased AI tools, but the privacy makes it more appealing.
Never miss a story from us, subscribe to our newsletter