Well, yes, if he punched the building to knock it down, and he punches it on the bottom, the building would fall on him.

I'll make a picture to show this if you want.