zlacker

Very interesting point. I'm aware of the Microsoft UI Automation interface, which at least on Windows I think does exactly this: https://en.wikipedia.org/wiki/Microsoft_UI_Automation - and most Windows UI test-automation tools depend on this.