minus-squareMajorSauce@sh.itjust.workstoAsk Lemmy@lemmy.world•What can an individual do to fight against tech billionaires?linkfedilinkarrow-up1·edit-28 days agoYou would benefit from it with some GPU offloading, this would considerably accelerate the speed of the answers. But you only need enough RAM to load the model at the bare minimum. linkfedilink
minus-squareMajorSauce@sh.itjust.workstoAsk Lemmy@lemmy.world•What can an individual do to fight against tech billionaires?linkfedilinkarrow-up1·8 days agodeleted by creator linkfedilink
minus-squareMajorSauce@sh.itjust.workstoAsk Lemmy@lemmy.world•What can an individual do to fight against tech billionaires?linkfedilinkarrow-up2·8 days agoTry hosting locally DeepSync R1, for me the results are similar to ChatGPT without needing to send any into on the internet. LM Studio is a good start. linkfedilink
You would benefit from it with some GPU offloading, this would considerably accelerate the speed of the answers. But you only need enough RAM to load the model at the bare minimum.