Mayor Adams losing patience amid federal investigation into his administration