The pastor at Saint Gerard Majella in Hollis says church surveillance video shows the woman breaking into the parking lot in the middle of the night.
He says she destroyed or damaged rosary stations, parish signs and the sprinkler system.
The pastor says the same woman also hit the Sunday before that.
He says fundraising paid for the damaged items, which makes this especially difficult.
"This is hard, this is a kick in the stomach," said Father JosephJude Gannon. "It's a kick in the stomach for all of us here because we are such a welcoming community
The pastor says it will take about $10,000 to replace the items.
The NYPD CrimeStoppers Bureau released a photo of the suspect and offered a reward of up to $2,500 for an arrest and conviction.
* More Queens news
* Send us a news tip
* Download the abc7NY app for breaking news alerts
* Follow us on YouTube