>>gsuuon+(OP)
You might want to investigate MUDs ('Multiple User Dungeons') more closely. The rules of the game define the locations and items and such, but the character dialogue is between real people. By substituting LLMs for real players within the game, you may be able to enforce a greater level of consistency (the LLMs can't break the rules) and context (the MUD can usually describe one's entire state, which would allow you to prompt your LLM at the beginning of each turn with all the important facts).
I don't really have enough patience for MUDs myself, but they are a continually popular form of role-playing game since they were invented over 50 years ago.