The subplebbit I linked is all about running LLMs on your local machine (and has a nice community of model creators and tuners, e.g., to remove censorship and shitlib bias). Technically you can set it up however you want, that said it's challenging to run multiple at once.
By default it's not set up to run multiple LLMs and have them talk to eachother though.
The subplebbit I linked is all about running LLMs on your local machine (and has a nice community of model creators and tuners, e.g., to remove censorship and shitlib bias). Technically you can set it up however you want, that said it's challenging to run multiple at once.
By default it's not set up to run multiple LLMs and have them talk to eachother though.
How difficult is it to do in Linux???
I'm not like an Expert in Linux, but I can add and remove Progs and such....
Most of this stuff works the same or better on Linux. If you can install python packages you'll be fine.
Oh like some games that need Python in order to run correctly....
Got it, thanQs Fren....