Investigators charged Hanks Johnson, 52, of Manhattan with criminal trespassing.
Police took him into custody after someone called 911 on Saturday night.
The New York Post reports Johnson was caught trying to gain entry into the luxury building, where Swift owns three apartments.
She also owns a townhouse next door.
OTHER NEWS | Former NYPD cop pleads guilty in alleged murder-for-hire plot
* Get Eyewitness News Delivered
* More Manhattan news
* Send us a news tip
* Download the abc7NY app for breaking news alerts
* Follow us on YouTube
Submit a News Tip