You must log in or register to comment.
If you have 16GB of ram you can already run the smaller models. And these have become quite competent with recent releases.
LM studio or JanAI work very nicely for me as well.
If you have 16GB of ram you can already run the smaller models. And these have become quite competent with recent releases.
LM studio or JanAI work very nicely for me as well.