Well, yes and no. I can see how it's a burden, but they're also the people with the most hands-on experience. If they won't explain, how can anyone else learn?
Because it is a serious problem, and not solving it is not acceptable. Of course men, or whichever the privileged group in any particular case is, have a responsibility to listen and learn, but that only works if someone is willing to explain.
Although I'd love to agree that it's the responsibility of the oppressor or privileged group to fix the problem, it has got to be a collective responsibility. You can't help people without the involvement of the people you're trying to help.
Take a sociology class at your local community college, read a book, read some blogs/articles by women, people of color, and other minorities.
There are a lot of really good ways to learn from the people who have taken the time to write/speak about the issues they face.