The men got into the dispute, possibly over a parking spot, at the intersection of Sutphin Boulevard and Yates Road just after 1 a.m.
The off-duty officer said the other man produced a knife and lunged at him.
He said he told the man to drop the knife and when he did not, he shot him once in the chest.
The wounded man was taken to Jamaica Medical Center in stable condition.
