The accident happened at 988 Myrtle Avenue in the Bedford Stuyvesant section of Brooklyn.
Officials are investigating what caused the repairman to fall just after 9:30 a.m.
He was rushed to Woodhull Hospital and pronounced dead.
His name has not been released.
The building is the Brooklyn Community Correctional Center, which is a halfway house for released prisoners.