This benchmark is not very useful. To get any real insights, you'd have to benchmark every single line of the prediction function (called "api") to see where the slowdown is actually coming from
https://github.com/postgresml/postgresml/blob/15c8488ade86b0...Everything else is just speculation.