The incident happened at Second Avenue between East 122nd and East 123rd Street around 2 p.m.
Two pedestrians and the driver of the van were rushed to the hospital with non life-threatening injuries.
The force of the crash knocked a portion of the scaffolding down.
Police called a Level 1 mobilization for crowd control.
The cause of the accident is under investigation.
----------
* More Manhattan news
* Send us a news tip
* Download the abc7NY app for breaking news alerts