A portion of the front door and wall of the the Chase Bank branch on 48th Street in Maspeth had been knocked out overnight.
Police say the suspects fled the scene early Friday, and left the backhoe running. The machine was reported missing from a nearby construction site.
Police say it's unclear if any money was taken.
Detectives say it's part of a pattern of several smash-and-grab thefts. The suspects use tools, vehicles or construction equipment to break into ATMs.
Most thefts occur in the early morning hours. They're mostly in Brooklyn and Queens.