You forgot to mention the part where Australia immediately held an election. The poor victimised Labour party, who you would have us believe was wrongly removed, lost the vote by a landslide.
If the people wanted Whitlam's government, and thought it was a grave injustice, they would have voted them back in. They were clearly unpopular given the election results. The end result was decided by the people, not the Queen/Governor General/Liberals.