Police say Francisco Flores is the man seen in surveillance video of the attack.
He allegedly followed the victim into his apartment on West 18th Street in Chelsea.
The elderly man was pushed to the ground and robbed of a bag containing a bible and a pair of glasses.
The fall left him with a broken hip.
Police say Flores lives two blocks from where the attack happened.