It makes some sense that you want to have pedestrians crossing as fast as possible.

It's not an offense in my country. It is also not a term you learn in school. So when I was in the US for the first time, and had a policeman shouting "No Jaywalking", I had no idea what he meant.