Summary
In this blog post, Jamie Tanna discusses his experience with locally-hosted Large Language Models (LLMs) after initially exploring AI for interview preparation. He shares the challenges faced, including environmental and ethical concerns, and the learning curve when using LLMs locally. Tanna also highlights his hardware choices, software stack, and interesting use cases such as reviewing contracts and coding assistance. While he is hesitant about increasing local model use, he emphasizes the importance of understanding AI technology and maintaining control over productivity tools.