zlacker

[parent] [thread] 1 comments
1. spott+(OP)[view] [source] 2023-08-01 18:25:03
Are you talking poor utilization from a "we have a bunch of GPUs sitting idle" sense, or poor utilization from a performance standpoint (can't keep their opus fed with data kinda thing)?
replies(1): >>paul-n+TU
2. paul-n+TU[view] [source] 2023-08-01 21:58:39
>>spott+(OP)
Kinda both honestly, but more of the fact that code isn’t great for optimising GPUs at run time. For instance no batching, or not realising the CPU is actually the bottleneck
[go to top]