The residents were evacuated from an apartment building on Cabrini Avenue, after the collapse at an adjacent building on Pinehurst Avenue.
The building manager says a fire escape was ripped off a wall of the apartment building.
The collapse also blew out windows and buckled parts of the bottom two floors.
About 100 residents were displaced by the 4 a.m. collapse, which affected 35 apartments that face the rear courtyard.
Though the majority of residents had returned as of Saturday evening, three units are still off-limits because of damage.
There were no reports of any injuries.
The Red Cross has opened a center on Wadsworth Avenue to provide food and shelter to residents who were displaced.
The super of the damaged building says there have been previous concerns about the wall which the owners of the property had begun to address.
Engineers will assess the structural integrity and shore up the building before the lengthy cleanup and repair process can begin.
The cause of the collapse is still under investigation.