It is entirely possible a program that spits out the complete code for a nuclear targeting system should not be released in the wild.
Bigger concern would be the construction of a bomb, which, still, takes a lot of hard to hide resources.
I'm more worried about other kinds of weapons, but at the same time I really don't like the idea of censoring the science of nature from people.
I think the only long term option is to beef up defenses.
There are many people that would do great things with god-like powers, but more than enough that would be terrible.
Monumental, like the invention of language or math, but not like a god.
Now, I feel even just "OK" agential AI would represent god-like abilities. Being able to spawn digital homunculi that do your bidding for relatively cheap and with limited knowledge and skill required on the part of the conjuror.
Again, this is very subjective. You might feel that god-like means an entity that can build Dyson Spheres and bend reality to it's will. That is certainly god-like, but just a much higher threshold than what I'd use.