I have been getting pretty deep into local LLMs lately, and it has been a great experience overall. I even went so far as trying to run models directly on my phone for a while, which works, but it is not exactly ideal.