It happened at about 2:30 Sunday morning as the man was walking northbound on the highway between Castle Hill Avenue and White Plains Road.
Police say the man was struck by multiple vehicles, none of which remained at the scene.
Police believe he may have been hit first by a truck. He was pronounced dead at the scene.
The identity of the victim has not yet been released.
The NYPD's Highway Collision Investigation Squad is investigating.