Police say Roy Sutherland of Uniondale asked the boy if he had money, and when he didn't answer, Sutherland abandoned him in Freeport.
The boy's grandmother had hired the cab to take him home to Roosevelt.
His mother says he has trouble communicating.
Sutherland, 66, will be arraigned on charges of endangering a child later this month.
