Authorities were visible in the area, showing the image of the attacker.
New surveillance video released Tuesday night shows a fairly clear image of the suspect walking down the street.
Another video, the building's security video, shows the suspect dragging the 85-year-old woman by her neck at 5:40 a.m. on Memorial Day. The streets were nearly empty.
"It's unbelievably peaceful," neighborhood resident Matthew Perry said. "It's quiet. It feels great to be out in the morning at that time."
The woman was walking, her morning exercise, heading south on Madison Avenue. When she got to East 83rd Street, the man grabbed her. Police say he pulled her to the side of a building and down some stairs, where he sexually assaulted her.
For most of the day, a police van circled, blaring a description of the suspect over a loudspeaker. At the same time, officers fanned out across the neighborhood, description in hand.
Neighbors are troubled by the news.
"I just, why would anyone want to do that to an 85-year-old?" one neighbor said.
"It's disturbing," resident Alan Greenstein said. "It's very disturbing, in this day and age, that something like that can still happen."
"Eighty-five years old? I mean, seriously, that's beyond imagining," Perry said.
The woman is recovering in the hospital.
The suspect is described as a light-skinned Hispanic man, 25 to 30 years old, about 5-foot-10 with a thin build. He was last seen wearing a white tank top, and he has several tattoos.
Anyone with information in regards to this incident is asked to call Crime stoppers at 1-800-577-TIPS (8477). You can also submit tips by logging onto the Crime stoppers website at WWW.NYPDCRIMESTOPPERS.COM or by texting tips to 274637 (CRIMES) then enter TIP577.