I don’t have many specific requirements, and GPT4All is working mostly well for me so far. That said, my latest use case for GPT4All is to help me plan a new Python-based project with examples as code snippets, and it lacks a specific quality of life feature, that is the “Copy Code” button.
There is an open issue on GPT4All’s GitHub, but as there is no guarantee that feature will ever be implemented, I thought I’d take this opportunity to explore if there are any other tools out there like GPT4All that offer a ChatGPT-like experience in the local environment. I’m neither a professional developer nor a sysadmin, so a lot of self hosting guides go over my head, which is what drew me to GPT4All in the first place, as it’s very accessible to non-developers like myself. That said, I’m open to suggestions and willing to learn new skills if that’s what it takes.
I’m running on Linux w/ AMD hardware: Ryzen 7 5800X3D processor + Radeon RX 6750 XT.
Any suggestions? Thanks in advance!
VSCode with the open source Cline extension. Easily the best open option, works everywhere. Excellent coding and planning agent, I use it for everything
If I go the VSCode/Codium route, would I also need to look into something like Ollama to actually drive the LLMs?
Yes Cline supports pretty much every LLM API, local model, etc. But if you’re serious about having an AI assistant that actually works, it’s unlikely you’ll be able to run it locally rn. Your best cheap/free-ish option is the Google models. The best overall is still Anthropic