> ...or we could collectively agree (with the backing power of a new organization like the one suggested below) that the rate of growth in AI capability at the frontier is limited to a certain rate per year.
Why would they want to limit the growth rate of their cutting edge to a fixed rate if this effort wasn't genuine? This would just give all the other providers time to catch up, which is an undesirable business decision.