2. If anyone is observing significant gains from incorporating knowledge graphs into the retrieval step, what kind of a knowledge graph are you working with, what is your retrieval algorithm, and what technology are you using to store it?
I'm not using that in my own experiments since I don't want to worry about the performance of running a model on production, but seems worth a try.