The 3-year-old Nova Scotia duck tolling retriever was spotted jumping from one broken piece of ice to another until a man in a kayak finally coaxed it to shore.
The dog, named Pifis, had been missing for nine days before he was found on Lake Michigan.
Television cameras captured his rescue on Friday afternoon, alerting owner Nerijius Steponavicious that Pifis was alive.
Kayaker Dave Kehnast and animal control chased Pifis for about an hour before they were able to save him.
Steponavicious said he wants to buy Kehnast dinner.
"I really thank him," Steponavicious said. "Don't know what would have happened."
Steponavicious had to wait until Monday to pick Pifis up so he could be neutered as required by city law.