[ home / overboard ] [ soy / qa / raid / r ] [ ss / craft ] [ int / pol ] [ a / an / asp / biz / mtv / r9k / tech / v / sude / x ] [ q / news / chive / rules / pass / bans / status ] [ wiki / booru / irc ]

A banner for soyjak.party

/pol/ - International /Pol/itics & /Bant/er

18+ | Politics & countrywars
Catalog
Name
Email
Subject
Comment
Flag
File
Password (For file deletion.)

File: ClipboardImage.png 📥︎ (14.96 KB, 268x278) ImgOps

 â„–2594516[Quote]

I just locally ran gpt-oss 120b locally with 20 tokens/second speed. Just on vulkan drivers, on llama.cpp. if i can get rocm running right, I can likely triple that tokens value.

Im living in the future unlike you troglodytes.

 â„–2594522[Quote]

>locally
>locally
>inb4
Shut up

 â„–2594538[Quote]

And I mean, if I can get the other 100b~ models to run at a similar speed, I dont really give a fuck about getting rocm to work.


[Return][Catalog][Go to top][Post a Reply]
Delete Post [ ]
[ home / overboard ] [ soy / qa / raid / r ] [ ss / craft ] [ int / pol ] [ a / an / asp / biz / mtv / r9k / tech / v / sude / x ] [ q / news / chive / rules / pass / bans / status ] [ wiki / booru / irc ]