It happened Wednesday near West 72nd Street and Columbus Avenue around 11 a.m.
Police say the suspect snatched a purse from an older woman who was sitting down. The victim pointed her out to the mounted officer.
In the bodycam footage posted to NYPD's X account, someone can be heard telling the officer that their bag was stolen.
As soon as the officer spotted the suspect, he began yelling for the suspect to stop while Kelly the horse began galloping along West 72nd Street.
With the help of a witness, the officer and Kelly the horse were able to stop the suspect and recover the purse.
Felicia Field, 44, was placed under arrest, ending the horseplay. She is charged with grand larceny and false impersonation.
Field has 14 prior arrests and is on lifetime parole for a fatal robbery of a livery driver in April of 2000.
Police say she was charged with false impersonation because she gave the wrong name upon arrest.
----------
* Get Eyewitness News Delivered
* More Manhattan news
* Send us a news tip
* Download the abc7NY app for breaking news alerts on the go
* Download our connected TV app