As a child in the 60s our family had a book about a boy named Marvin. Marvin leaned against a brick building. Adults who went by kept telling him to go home. He would reply that if he did, the building would fall down. He finally left, and the building fell down.
It was a hard cover book with a picture of a little boy learning on a brick wall on the front. Our version was similar in size to the Dr. Seuss books. 
I would love to find a copy to read to my grandsons!