zlacker

[parent] [thread] 0 comments
1. LTL_FT+(OP)[view] [source] 2026-01-28 17:11:15
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.
[go to top]