The suspect is the church's former janitor.
Suffolk County investigators say Steven Krasowsky broke into the Our Lady of Grace Church in West Babylon early Sunday morning.
Police say Krasowsky tried but failed to break into the church safe and was reportedly caught on tape leaving the scene.
