In the 1970s, beside the prevalence of cars, there were two more factors hollowing out cities: "white flight" and the fear of a nuclear war. A nuke hitting Manhattan would certainly affect more people that a nuke hitting some suburbia, and why would a nuke be targeted there in the first place?

The fear was real :(