Developer Bruce Ratner has proposed building office towers, apartments and an arena for the New Jersey Nets.
A state agency will seize the property, which will then be controlled by Ratner's development company.
Opponents lamented the judge's decision, but said two other court cases could stop the project "dead in its tracks."
Ratner plans to hold a groundbreaking on March 11.