The Port Authority and the Durst Organization have decided the eatery would be a money loser.
The original Windows on the World was destroyed and nearly 150 people killed on September 11th.
Executive Director Chris Ward says the authority, which owns the trade center site, was committed to finding the best and most practical use for the space.
"We don't build vanity projects at the top of tall buildings," he said.
