He was reportedly swimming with his wife and another couple when they lost sight of him.
Officials say they called 911, and NYPD divers quickly arrived to scour the waters.
The divers did not immediately find the man.
It was not known why he was swimming in the middle of the night.
NEW YORK AND TRI-STATE AREA NEWS