It is a problem once the ratio of money in to money out diverges from previous projections, such as due to unbudgeted increases in proportions of non working and/or lower earning populations.
Then you have to start adjusting the money in (higher taxes) and money out (reduced benefits), and different people in different ages/income/wealth levels start having different opinions.