The incident happened in Hoboken on Hudson Street around 6:30 a.m. Saturday.
Police say it's a 12-inch main.
Authorities closed roads north of 11th street from Washington Street to the Hudson River.
They also shut off water service in the area as they worked to fix it.
No word yet on what caused the break or when it could be repaired.
MORE NEWS | Crash with police cruiser sends SUV into Long Island home; Car and house catch fire, officer airlifted