The other responses are correct, but they're not including an important detail. Reddit was originally a replacement for all of the niche bulletin board sites that had cropped up around the internet. It was a way to create and manage a community without the cost and technical expertise required for phpBB. It also gave you access to existing users without them having to create a new account.
All of those previous Bulletin Board sites did not host images themselves either.