Tom Fenton moves from local AI concepts to hands-on tools for matching LLMs to hardware, running local chatbots with Ollama and benchmarking AI performance.
Convenience costs you with Plex, but the alternatives require more work.
AWS launched Lambda MicroVMs, a new serverless compute primitive that runs each user session or AI agent in its own ...
Local AI inference at 32B-parameter quality, no cloud API required: University of Waterloo researchers released PAW on July 2 ...
Ollama made local AI feel less like a developer experiment and more like something I could actually use on my PC.
I ran Google's Gemma AI locally on a cheap mini PC, and it handled more of my everyday ChatGPT tasks than I expected.