NEW YORK -- Eventually, if the New York Yankees kept playing close game after close game, they were going to lose one of them. And eventually, if the Toronto Blue Jays played enough games at Yankee Stadium, they were going to win one of them.

Eventually was Saturday.

The Yankees were held to only a pair of two-run homers, and they lost 6-4 to the Blue Jays. It was the Yankees' first loss since Monday, ending a string of four straight wins by one run or two, and it was the Blue Jays' first win in New York since Aug. 29, 2013, ending a string of 17 consecutive losses.

Brian McCann hit one of the home runs, but his inexperience at first base also led to the Blue Jays scoring a tie-breaking run in the seventh inning. Toronto's Dan Johnson hit a three-run blast off Jeff Francis in the top of the ninth, and Carlos Beltran's long ball in the bottom of the ninth only slightly helped the Yankees' run differential (now minus-27).

Another good start: The Yankees keep churning the rotation, but they also keep getting decent starts. Left-hander Chris Capuano, the 11th different starter used this season, allowed just two runs in six innings against the Blue Jays on Saturday. Capuano was taking Chase Whitley's place in the rotation.

In the 14 games since Masahiro Tanaka went on the disabled list, Yankees starters have combined for a 2.46 ERA.

Feeling at home: McCann isn't having a great first year with the Yankees, but he is doing one thing the Yankees expected: hitting home runs at Yankee Stadium. McCann's two-run shot Saturday was his team-leading ninth at home. Meanwhile, McCann has homered just twice in 185 plate appearances on the road.

Not feeling at home: McCann was signed to be a catcher, but with Mark Teixeira hurting and Francisco Cervelli doing well, he has been a first baseman this week. His inexperience there showed a couple of times Saturday -- most significantly in the seventh inning, when he not only couldn't take advantage of a Blue Jays baserunning blunder (when Melky Cabrera wandered too far off third base) but couldn't even get an out on what was a simple ground ball.

Then, with the bases loaded and one out, McCann made contact with second baseman Brian Roberts as Roberts was trying to field a ball off Dan Johnson's bat. The result was that the Yankees again didn't get an out, and the Blue Jays took the lead.

Shift buster: When teams go into a drastic shift with three infielders on the right side and no one at third base, fans always ask, "If they're going to give you a single, why don't you just bunt?" Well, Chase Headley did in the fourth inning Saturday and got an easy hit. The timing was good, with nobody out and the bases empty, but the Yankees weren't able to turn the hit into a run.

The bunt single was Headley's only hit Saturday, but it meant he has hit safely in each of his first five games as a Yankee.

Settle down: After Capuano hit Jose Bautista with a pitch in the top of the first inning, Blue Jays starter Drew Hutchison hit Carlos Beltran in the bottom of the first. Beltran seemed to take exception, and plate umpire Alan Porter was concerned enough that he issued an official warning to both dugouts.

Hutchison also hit Cervelli with two out in the sixth, but he wasn't ejected since it was clearly unintentional. Yankees manager Joe Girardi still came out to talk to Porter about it.

What's next: The Yankees close out this successful 10-game homestand with a Sunday afternoon (1:05 p.m. ET) game against the Blue Jays. Shane Greene (2-1, 2.79) and J.A. Happ (8-5, 4.55) are the scheduled starters. The Yankees then leave for Texas to begin a six-game trip that will also take them to Boston.