Kelly is a retired Marine general who has served as chief of staff since July 2017. Trump didn't immediately name Kelly's replacement but teased that an announcement will be made in the coming days.
Trump called Kelly, who had previously served as secretary of homeland security, "a great guy."
SEE ALSO: John Kelly and other notable Trump administration resignations, firings
The West Wing shake-up comes as Trump is anticipating the challenge of governing and oversight when Democrats take control of the House in January, and as gears up for his own campaign for re-election in 2020.
Secretary of Homeland Security John F. Kelly has been named as the new White House Chief of Staff
The Associated Press contributed to this report.