zlacker

[parent] [thread] 0 comments
1. rastri+(OP)[view] [source] 2026-01-11 11:18:47
Statelessness simplifies scaling and operational complexity. They cache the system prompt, but otherwise each request is fully self-contained. It’s an obvious tradeoff, and I wouldn’t be surprised if they move toward some form of server-side state or delta encoding once the product stabilizes.
[go to top]