Police in North Bergen responded after getting a call that the man was stabbing himself and threatening others.
Officers tried to subdue the 47-year-old with pepper spray, but he wouldn't drop the knife.
Cops say when he lunged at them, they opened fire, shooting him in the chest.
He was pronounced dead at a local hospital.
The shooting is still under investigation.
Get Eyewitness News Delivered