People not looking for a job aren't included in that 5%, to be considered unemployed you have to be working less than 2 hours a week and looking for work.
More importantly that figure doesn't include the underemployed, those working at least 2 hours but looking for more.