PrimaCora@lemmy.fmhy.mltoFediverse@lemmy.world•Would there be any benifit to host another instance?English
12·
1 year agoCould even run the instance from your phone or whatever device used to look at Lemmy
Could even run the instance from your phone or whatever device used to look at Lemmy
T-Mobile doesn’t even let me setup auto pay. I’m a Sprint customer that got converted. Sprint app no longer works, T-Mobile doesn’t recognize me.
I still get the removed but it makes me pay manually, using the short code from the phone app… And since I can’t see it get into the account, can’t pay off or buy my current phone.
Once I get time off near August I hope to deal with that. And after, may just switch to something like mint. Hardly use any data, text, or talk, just needed phone financing and insurance.
You can’t pirate their models, and even if they leaked, running them would need an expensive machine.
There are lots of open source models. They can get close but are limited by your hardware.
If you want close to GPT, there is the falcon 40b model. You’ll need something with more than 24 GB VRAM or deep down cpu offload with 128 GB RAM, I think, maybe 64.
With 24 GB VRAM you can do a 30B and so on…
For reference, the GPT models are like 135B. So a100 nvlink territory.