zlacker

The thing about giving your application a button that costs you a cent or two every time a user clicks on it is, then your application has a button that costs you a cent or two every time a user clicks on it.

>>bunder+(OP)
For the usecase of "How do I do thing X in Excell" you could probably get pretty far with just adding a small, local LLM running on the user's machine.

That would move the cost of running the model to the end user but it would also mean giving up all the data they can from running prompts remotely.

It would probably also make Office users more productive rather than replacing them completely and that's not the vision that Microsoft's actual customers are sold on.