Jump to content

Open Source AI Assistant


Recently I've replaced Github's copilot with tabbyml. it is an opensourced, locally run ai assistant. it works fairly well, it does have some limits and its not quite as good as github's copilot. but imho it has several advantages over copilot and other ai assistants for coding. the biggest benefit to me is that it is free and offers most of the features the other do. the second is the privacy of my data, it doesn't feed back to the models as i understand it, so your code is safe.


the installation and using of it is pretty straight forward. the more powerful nvidia gpu you have, the larger the models you can run and the more "accurate" they will be. currently i run a 3B model on my nvidia rtx 3050 with 4gb, it struggles a little bit, but it does remarkably well imho. so if you have a rtx 4060 with more than 8gb of video ram, you'd probably have no trouble running most of the models. check the link out above and give it a go.

User Feedback

Recommended Comments

There are no comments to display.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Add a comment...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...