The 12-inch main has been shut down, and an 8-inch main at the intersection of 5th and Jefferson is also out of service.
United Water emergency crews responded quickly to investigate the site and begin repairs.
As a result of the shutdown, customers between Jefferson and Madison and at the intersection of Jefferson and 5th are without water.
Bottled water has been provided to the residents and is available in the lobby of 420 Jefferson Street.
Hoboken police and fire departments, and Office of Emergency Management are working with United Water to ensure residents' safety.
As a result of the repairs, 5th Street between Jefferson and Madison is shutdown.