It happened Saturday morning in White Plains.
Police say the 68-year-old man attacked them after they confronted him at his home.
They also say an officer shot him, after they tried to take the suspect down with a taser.
Police say the man lived close to their headquarters and that they knew of him before the shooting.