Kelly on Wednesday appointed three former federal prosecutors to the committee.
The group will start work immediately and spend six months looking into whether crimes are being misclassified. It will review the department's Compstat crime reporting system, and members will attend department meetings on precinct crime statistics.
Kelly said integrity in the reporting system is essential to maintain public confidence.
The move comes after allegations that some members of the department felt pressure to downgrade crimes to make their precincts seem safer.