zlacker

[parent] [thread] 2 comments
1. seanmc+(OP)[view] [source] 2026-02-05 01:27:40
> (ones you run on beefy 128GB+ RAM machines)

PC or Mac? A PC, ya, no way, not without beefy GPUs with lots of VRAM. A mac? Depends on the CPU, an M3 Ultra with 128GB of unified RAM is going to get closer, at least. You can have decent experiences with a Max CPU + 64GB of unified RAM (well, that's my setup at least).

replies(1): >>Quantu+21
2. Quantu+21[view] [source] 2026-02-05 01:36:12
>>seanmc+(OP)
Which models do you use, and how do you run them?
replies(1): >>seanmc+ro
◧◩
3. seanmc+ro[view] [source] [discussion] 2026-02-05 05:16:56
>>Quantu+21
I have a M3 max 64GB.

For VS Code code completion in Continue using a Qwen3-coder 7b model. For CLI work Qwen coder 32b for sidebar. 8 bit quant for both.

I need to take a look at Qwen3-coder-next, it is supposed to have made things much faster with a larger model.

[go to top]