BALTIMORE -- Miguel Gonzalez had already done enough to earn a handshake from manager Buck Showalter and a seat in the dugout for a job well done.
Except, after throwing 94 pitches over six innings, the right-hander wasn't quite finished.
"He wouldn't let me go get him," Showalter said.
Gonzalez justified the decision by striking out the side in the seventh, and the Baltimore Orioles held on to beat the New York Yankees 4-3 Tuesday night.
Gonzalez (1-1) finished with a career-high 10 strikeouts. He gave up four hits, a walk and one run.
"Against the Yankees, you can't give in," he said. "Every pitch has to be a quality pitch. Make sure you do your job and keep your team in the ballgame."
Gonzalez wasn't going to leave after six innings unless Showalter tied him to the bench.
"That's what we want as starting pitchers; we want to go deep in ballgames," Gonzalez said. "I was happy he gave me the chance to go out there again."
Adam Jones homered and drove in two runs for the Orioles, and Caleb Joseph contributed two hits and an RBI.
Kevin Gausman gave up two runs in the eighth, and Zach Britton got four outs for his second save.
Yankees starter CC Sabathia (0-2) yielded four runs and seven hits in seven innings, walking one and striking out seven. Although he is 18-7 against the Orioles, the left-hander is 0-5 with a 5.48 ERA in his last seven starts in Baltimore.
In his first outing of the season, Sabathia gave up four earned runs in 5 2/3 innings against Toronto.
"I thought he was good again," manager Joe Girardi said. "He gave up a few hard hit balls. I like the way he is throwing."
Sabathia was seeking his first win since April 24, 2014, after missing most of last season with a knee injury.
"I'm feeling pretty good," Sabathia said. "I'm commanding the ball pretty good. I just need to tighten up a few things."
Alex Rodriguez was not in the Yankees' the starting lineup for the first time this season. The 39-year-old is seeking a return to form after being suspended last season for drug use.
He entered as a pinch hitter with two outs and none on in the ninth. Rodriguez received jeers from many in the crowd of 19,283 before bouncing out to shortstop.
Jones put the Orioles up 1-0 in the first inning with his fourth home run in five games. He added a sacrifice fly in the third after Sabathia issued a leadoff walk.
Baltimore made it 3-0 in the fourth when Delmon Young singled, moved up on a wild pitch and scored on a two-out single by Joseph.
Gonzalez retired 10 straight batters before Jacoby Ellsbury led off the sixth with a single. With two outs, Mark Teixeira hit an RBI double.
Joseph led off the seventh with his first career triple and Everth Cabrera brought him home with a fly ball.
"That last inning, giving up that triple, really made the difference in the game," Sabathia said. "I just need to make a better pitch there."
New York closed to 4-3 in the eighth. Chase Headley singled in a run and scored when Alejandro De Aza dropped a fly to left.
FAULTY FIELDING
Yankees: New York made two errors, giving the Yankees 11 in eight games.
Orioles: Showalter thought the error De Aza received after chasing the ball near the warning track should have been called a hit. It was only Baltimore's third error this season.
TRAINER'S ROOM
Yankees: OF Brett Gardner took the night off after being struck in the right wrist Tuesday by a pitch from Wei-Yin Chen.
Orioles: C Matt Wieters (elbow surgery) took five at-bats as a DH in extended spring training and threw from 150 feet. Showalter says Wieters could soon begin a rehabilitation assignment.
ON DECK
Yankees: RHP Nathan Eovaldi makes his second start since coming to the Yankees from the Marlins in an offseason trade.
Orioles: RHP Bud Norris, who got hit hard in Baltimore's home opener against Toronto, seeks to put a major dent in his 24.00 ERA.