Obviously “home life” encompasses many things like parental involvement, stability of family relationships, socioeconomic status, etc. And it’s not the only factor of course.
So the question is hardly uncalled for IMO. Could have been worded in a less accusatory tone though! The person was pretty rude.