New Rochelle Police describe the man, who is identified as 48-year-old Samuel Cruz, as "emotionally disturbed".
After police forced their way into his Hickory Street apartment, they say they tried to subdue him with a taser, but that didn't work.
When Cruz allegedly came at police with a knife, an officer fired a single shot, killing him.
It is still unclear who made the original call to police.