Ok, so this closet isn't exactly a closet. It's more of a shack that looks a lot like a closet inside.

So Hilbert wasn't living in a closet inside a house, it's just a closet on stilts.