The incident happened as the man worked near 86th Street around 12:45 p.m. Monday.
He was pinned under the slab for 20 minutes before he could be freed.
An FDNY spokesperson said the victim suffered non-life-threatening back and leg injuries.
He was taken to New York Hospital in serious but stable condition.
Get Eyewitness News Delivered