Give the chatbot API access to make tickets and it could be used as a more intelligent "FAQ linker" which is what most older non-GPT chatbots did. It can figure out if the issue is a common one and link to the FAQ/spit out the relevant FAQ answer, or make the ticket if not.
Seems like a decent middle ground between "this chat bot is actively making this issue take longer to resolve" and "Oops looks like the chat bot deleted my entire account "somehow."