The 78-year-old retired monsignor, Thomas Brady, the former pastor of Good Shepherd Parish in Marine Park, was taken into custody Friday.
Police say one of the incidents took place Thursday morning at the church where Brady still lives in the rectory.
He is now facing a string of charges.