A few hundred supporters cheered and held up signs as James stepped off a bus in Newark.
James was convicted in April 2008, stemming from charges that he abused his office by steering city-owned land to his then-mistress.
He received a 27-month term and must serve the remainder of his sentence at a halfway house in Newark.