zlacker

[parent] [thread] 2 comments
1. jay_ky+(OP)[view] [source] 2025-06-02 21:29:28
Yeah, I'm ready to jump in, but I need an agent running on my hardware at home without internet access.

How far away are we from that? How many RYX 50s do I need?

This is a serious question btw.

replies(2): >>pixl97+T2 >>guywit+q3
◧
2. pixl97+T2[view] [source] 2025-06-02 21:45:10
>>jay_ky+(OP)
It's unfortunate that AMD isn't in on the AI stuff, because they are releasing a 96GB card ($10k so it's pricey currently) which would drop the number you need.
◧
3. guywit+q3[view] [source] 2025-06-02 21:47:58
>>jay_ky+(OP)
I mean it depends on the model; some people running deepseek report they have better performance at home running on a CPU with lots of ram (think a few hundred gigabytes). Even when running locally vram is more relevant than the performance of the GPU. That said I'm really not the person to ask about this, as I don't have AI agents running amuck on my machine yet
[go to top]