Police say they found a black wig, sunglasses, a Dolce & Gabbana hat and a black jacket in the minivan he was driving.
Authorities say the 39-year-old told them he robbed four banks in New Jersey and three in Connecticut, and attempted to rob another in New Jersey.
The Jersey City resident is charged only with Monday's attempted heist. More charges are expected.