Police say six caskets were pulled from the walls of the mausoleum.
The damage was discovered Tuesday morning by security guards.
It's unclear if anything was removed, but the incident is being investigated as a burglary.
The cemetery is filled with notable residents.
Police are not saying which mausoleum was vandalized.