The 39-year-old man was awaiting arraignment Sunday in a Nassau County court.
Police say he tried to use the farm implement to break down the door of a house on Fulton Avenue in Roosevelt on Saturday.
A 58-year-old woman was home and called police. She and the man know each other.
Police say they found him nearby, riding a bicycle that had been reported stolen earlier in the day.
He has been arrested on attempted burglary and other charges. He's awaiting arraignment.