zlacker

>>cheese+(OP)
> We were cautious to only run after each model’s training cutoff dates for the LLM models

Grok is constantly training and/or it has access to websearch internally.

You cannot backtest LLMs. You can only "live" test them going forward.

>>mlmonk+M4
Via api you can turn off websearch internally. We provided all the models with their own custom tools that only provided data up to the date of the backtest.

>>cheese+I6
But Grok is internally training on Tweets etc. continuously.