It really sounded like people from central casting. The fact that is was exactly that is hilarious to me.
Your point is well advised!
There were already AI products with exactly this behavior (perhaps sans multi-modality) prior to OpenAI's demo. Some of them were even open source. And these products will cater to the things we care about: local, niche, privacy-respecting, with bespoke domain expertise.