I noticed early on that GPT35 can successfully create a false sentence but has a whole lot of trouble creating an invalid syllogism, and tends to end up making false but valid ones. Not sure if that's changed but it's interesting what that might say about its training.