zlacker

>>daniel+(OP)
will this run on an apple m4 air with 32gb ram?

Im currently using qwen 2.5 16b , and it works really well

>>ionwak+1o
No, at Q2 you are looking at a size of about 26gb-30gb. Q3 exceeds it, you might run it, but the result might vary. Best to run a smaller model like qwen3-32b/30b at Q6