[ home / overboard ] [ soy / qa / raid / r ] [ int / pol ] [ a / an / asp / biz / mtv / r9k / tech / v / sude / x ] [ q / news / chive / rules / pass / bans / status ] [ wiki ]

A banner for soyjak.party

/tech/ - Soyence and Technology

Download more RAM for your Mac here
Catalog
Email
Subject
Comment
File
Password (For file deletion.)

File: 1786993964272h.png 📥︎ (102.02 KB, 2000x2000) ImgOps

 â„–39364[Quote]

Remote thin clients are the best forward for most usecases and enthusiasts and goymers can't stand it for some reason. Why are we wasting so many resources making desktops and laptops and consoles that squeeze maybe 5% of the potential of the silicon over it's lifespan? The best way to do it are giant mainframes that can take advantage of scaling, and then remoting in with devices that's only job is to stream video from and IO to the server. Their battery life could be days, they could indestructible, cheap, and immune to obsolescence.
>I don't want to be a rentcuck for compute
Self host you dumb nigger. Imagine being able to bring your desktop and everything on your home network anywhere on the planet. Imagine being able to pitch into a group of friends or family to buy a top of the line computer that you can all use at once. My dream in the future is to have 13 kids and have them all seamlessly share a dual EPYC system with like 8 GPUs that I also use for AI and whatever other homelab shit

 â„–39370[Quote]

didnt linux tech tips try dis doe
Although it could be good
Also obviously with that server, just host the entire internet for your children (manpages, package repos, muh wikipedia or whatever + muh llm since u got 999 gpus)

 â„–39371[Quote]

>>39364 (OP)
Ive been thinking of doing this instead of buying a (very expensive) laptop for my uni.
Save up for a gigaPC that i run remotely on, and even a 70B ai model. And use the old used laptop my sweet old grandmother wanted to give me to access it.
Question is, what is the appropiate hardware for this? My original plan is to just add 2x rtx 3090's to my current gaming pc i got and run with that. But it would be cool to hear some other, more scalable setups for this.

 â„–39373[Quote]

>>39371
>70b ai model
Well currently the best you could realistically run on that tier of machine would be qwen3.8-flash-next
Although for a system you could obviously have like 256gb+ of sys ram + about 32-64gb of vram (buying either rtx 3080 20gbs, or older radeon pro / nvidia tesla cards)

 â„–39374[Quote]

>>39371
Be careful with limited PCIe bandwidth and your usecase. Level1techs has some good vids about homelab AI stuff. Some things like PCIe switches are really neat

 â„–39375[Quote]

>>39371
sadly 3090s have shot up from like 500 bucks to 1000 because of muh ai jeets, yet all other cards are unaffected
avoid radeon i would say

 â„–39376[Quote]

>>39375
however you could consider it, idfk

 â„–39377[Quote]

>>39375
>>39374
>>39373
thanks for the info, il look further into it. and i meant 30b parameter models, idk why i said 70b
should i just start building the machine now? or wait for the ram prices to drop? i consulted my teacher and they said you only need the beefy hardware in 2 years. i have quite a bit of money saved up for this, but idfk if it would be retarded to spend a fortune now and barely need the compute when i could wait and spend it on better and cheaper hardware later (or get raped with whatever price influx will happen then)



[Return][Catalog][Go to top][Post a Reply]
Delete Post [ ]
[ home / overboard ] [ soy / qa / raid / r ] [ int / pol ] [ a / an / asp / biz / mtv / r9k / tech / v / sude / x ] [ q / news / chive / rules / pass / bans / status ] [ wiki ]