The main reason to worry, though, is not the proprietary monetization of "AI" algorithms: Just like it was not an algorithm (pagerank) but the invention of adtech that spawned surveillance capitalism, here too the main question is what sort of "disruption" can this tech facilitate, as in which social contract will be violated in order to "create value".
"Success" in "tech" has for a long time been predicated on the absence of any regulation, pushback or controls when applying software technology in social / economic spheres previously operating under different moral conventions. In the name of "not stiffling innovation".
Ironically our main protection is that we may actually now live a "scorched Earth" environment. The easy disruptions are done and "tech innovation" is bumping against domains (finance, medical) that are "sensitive".
Nowadays, companies and politicians, if one could make such a distinction just for the sake of the argument, will always tout the "job creation" aspect of a certain capitalistic endeavour. Give it a few months/years and we will hear the phrase "job elimination" more and more, from cashiers becoming "consultants" to the elimination of 90+% of interface jobs and beyond: does there really need to be a human hand to push the button for espresso? does there really need to be a bipedal human to move a package from A to B in a warehouse?
[1] https://arstechnica.com/information-technology/2023/02/robot...