It is (was?) easy to control your browser's history. It is impossible to control what these devices send to google/amazon.
Your browser's search history only gets populated when you, well, search. These devices are collecting information 24/7, regardless if you are actively engaged with them.