zlacker

Was there a lot of video game dialogue in the training text?

Palumpolum is a locale in Final Fantasy XIII, itself named after the characters Palum and Porom from Final Fantasy IV.

Shakuras is a locale in StarCraft, the planet to which the Protoss Dark Templar retreated after their schism with the Khalai of Aiur.

>>bitwiz+(OP)
My model is bolted onto GPT-2 which is trained on internet text; I think some of these examples are coming from there.