Although he may have developed much of the physics and saw that it was possible, Einstien didn't invent the atomic bomb and he developed the physics before he got to the US.

I think that he is arguing that there are certain things you need to have organised in society to give the space for more advanced development, irrespective of individual brilliance.