POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish · 14 hours agoHave you found any cool uses/life hacks for AI?message-squaremessage-square52fedilinkarrow-up156arrow-down113
arrow-up143arrow-down1message-squareHave you found any cool uses/life hacks for AI?POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish · 14 hours agomessage-square52fedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkarrow-up1·8 hours agoNvidia. Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up. I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well… But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.
Nvidia.
Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up.
I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well…
But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.