The suspect is identified as Sam Chatman.
He is accused of robbing banks in the Flatiron District and the Bronx less than two hours apart.
In both cases, police say he showed the teller a gun and demanded cash.
The FBI says Chatman has robbed at least four banks in all.