zlacker
[parent]
[thread]
0 comments
1. redrov+(OP)
[view]
[source]
2026-02-03 19:41:39
I have a 3090 and a 4090 and it all fits in in VRAM with Q4_0 and quantized KV, 96k ctx. 1400 pp, 80 tps.
[go to top]