zlacker

1. Whenever AI is used closed loop, with human feedback and a human checking the output for quality/hallucinations and then passing it along, it's often fine.

2. Whenever it is used totally on its own, with no humans in the loop, it's awful and shit like this happens.

Yet, every AI company seems to want to pretend we're ready for #2, they market their products as #2, they convince their C-suite customers that their companies should buy #2, and it's total bullshit--we're so far from that. AI tools can barely augment a human in the driver's seat. It's not even close to being ready to operate on its own.