zlacker

I would expect these bots will be calling an ordering backend API which will validate the price of the items and the total. Are you suggesting people will plug open ended APIs that allow the bots to charge any amount without validations?

I think the first step will be replacing frontends with these bots, so most of the business logic should still apply and this won't be a valid attack vector. Horrible UX tho, as the transaction will fail.

>>alonso+(OP)
>> Are you suggesting people will plug open ended APIs that allow the bots to charge any amount without validations?

Certainly. A good example (not an Orderbot, but real world exploit) was "Chat with Code" Plugin, where ChatGPT was given full access to the Github API (which allowed to do many other things then reading code):

https://embracethered.com/blog/posts/2023/chatgpt-chat-with-...

If there are backend APIs, there will be an API to change a price or overwrite a price for a promotion and maybe the Orderbot will just get the context of a Swagger file (or other API documentation) and then know how to call APIs. I'm not saying every LLM driven Orderbot will have this problem, but it will be something to look for during security reviews and pentests.