The incident happened Sunday morning in an alley on Weeks Avenue in the Claremont section.
Investigators say the man grabbed the young girl, covered her mouth and put a gun to her head.
He then forced her to the back of a home where he sexually assaulted her, according to police.
The victim was treated at the hospital.