

Nope.
Just a guy shilling for gun ownership, tech privacy, and trans rights.
I’m open for chats on mastodon https://hachyderm.io/
my blog: thinkstoomuch.net
My email: nags@thinkstoomuch.net
Always looking for penpals!


Nope.
For simply productivity like Copilot or Text Gen like ChatGPT.
It absolutely is doable on a local GPU.
Source: I do it.
Sure I can’t do auto running simulations to find new drugs and protein sequencing or whatever. But it helps me code. It helps me digest software manuals. That’s honestly all I want
Also, massive compute projects for the @home project are good?
Local LLMs runs fine on a 5 year old GPU, a 3060 12 gig. I am getting performance on par with cloud ran models. I’m upgrading to a 5060ti just because I wanted to play with image Gen.
Which is funny since that does solve a lot of the problems.
If it’s completely open source at least.
Like OS data sets and model that can be ran locally means it’s not trained on stolen data and it’s not spying on people for more data.
And if it runs locally on a GPU, it’s no worse for the environment than gaming. Really the big problem with the data center compute is the infrastructure of getting that data around.


I just assume anything that promises free stuff on Instagram reels is in fact a scam or a hack.
Also I’m not getting on that shit site to confirm it’s true.


Lots of places do a better job providing DRM free or DRM Lite ebooks (Chicago press only ties your name to the files so you’d have to doxx yourself to share it, but you can share it), but the sheer library of self published books on Amazon is hard to find.
There’s an author I’ve become good friends with who I pay him (in coffee) for his books because I disagree with giving Amazon a cent. But he noted that’s just where the masses are still and it’s hard to break that momentum.


What’s happening in Ukraine sucks
That doesn’t contradict the sentiment that borders are generally arbitrary lines designed to divide us.
Using a Russian sure to get free books doesn’t hurt Ukraine unless these are all like infected with Russian turbo malware or something
I’m a simple man.
I got to thepiratebay.org
I download what I want and put it on a jellyfin server
I never want much just some albums or a couple movies.
Its good enough and I’m pretty happy I don’t do anything crazy. I shouldn’t be watching this much TV as it is!