Officials said the fisherman was wading in the waters off the Sandy Hook National Gateway Recreation Area.
At some point around 8 a.m., the surf pulled him out to sea and he drowned.
The man's body was recovered.
Police have not released the man's name.
* More New Jersey news
* Send us a news tip
* Download the abc7NY app for breaking news alerts