That is a pretty good use case. In fact, if your prompt is very long, you will need to summarize it (with an LLM).
Also, when you fine-tune the LLM, you can also use an LLM to summarize or concatenate content that you train it on (e.g. rewrite this content in the style of a human having a conversation with a computer)