THE CHALKBOARD
The Anatomy of a
Super Bowl Upset
Joe Flacco may not have the style of Broadway Joe, but according to coaching
statistics Flacco now has a Super Bowl upset almost as big as Namath's toppling
of the Colts, 16-7, in Super Bowl 3.
Flacco and the Ravens 34-31 victory over the 49ers ranks as the sixth biggest
upset in Super Bowl history when measured by the regular season play design
edge that the loser/favorite held over the winner/underdog. In 2012, San
Francisco was .0621 better (in other words, 6.21 percent better) designed than
its opponents while Baltimore was only .0073 better (in other words less than 1
percent better) designed than its opponents. Thus, the 49ers held a 5.48
percent design edge (.0621 - .0073) edge on the Ravens.
In the Super Bowl, the team with the regular season design edge is 31-16 (.660
winning percentage). Thus, it's surprising when the team with this edge loses
in the Super Bowl. Using QC's coaching statistics, here is a table showing the
biggest upsets in Super Bowl history with the underdog's play design deficit, H
A:
SB No.
|
Underdog
|
Favorite
|
SB Line
|
SB TO
|
Dog's HA Deficit
|
42
|
NY Giants 17
|
N. England 14
|
NE -14
|
E
|
-.0968
|
36
|
N. England 20
|
St. Louis 17
|
St. L -14
|
-3
|
-.0809
|
15
|
Oakland 27
|
Philadelphia 10
|
Phil -3
|
-4
|
-.0665
|
3
|
NY Jets 16
|
Baltimore 7
|
Balt -17
|
-4
|
-.0556
|
23
|
San Francisco 20
|
Cincinnati 16
|
Cin +7
|
E
|
-.0551
|
47
|
Baltimore 34
|
San Francisco 31
|
SF -4
|
-1
|
-.0548
|
19
|
San Francisco 38
|
Miami 16
|
Mia +3
|
E
|
-.0361
|
5
|
Baltimore 16
|
Dallas 13
|
Dal -1
|
+3
|
-.0352
|
4
|
Kansas City 23
|
Minnesota 7
|
Minn -10
|
-4
|
-.0244
|
32
|
Denver 31
|
Green Bay 24
|
GB -12
|
-1
|
-.0244
|
As you can see, Super
Bowl teams with a big regular season play design edge tend to beat themselves
with turnovers more than underdogs beat them with great game plans. Sure, there
is more than one recipe for an upset. The Giants stunning victory over the
unbeaten Patriots in Super Bowl 42 was unaided by a turnover edge and a wacky
touchdown pass that was deflected twice to Colts tight end John Mackey
propelled Baltimore to victory in Super Bowl 5.
And it is surprising to see that Bill Walsh and Joe Montana actually had a
significant play design deficit to overcome against Dan Marino and Boomer
Esiason in Super Bowls 19 and 23, respectively. But it is not surprising
that--with two weeks to prepare--they figured out how to do so even without the
help of a turnover edge. (Although, they did not do so well enough in Super
Bowl 23 to cover the 7 points of faith the books placed in them to do so.)
But in 60 percent of the biggest upsets in Super Bowl history, including three
of the four biggest, turnovers clearly were the cause of the upset.
Another interesting fact about Super Bowl upsets is that such upsets are
randomly scattered throughout the game's history. Generally, an upset is no
more likely to occur today than it was in the first decade of the game 's
existence.
Last week, in the aftermath of the Ravens upset, Aaron Schatz speculated that
perhaps today the regular season doesn't mean as much as it once did.
"Once upon a time, the NFL playoffs were fairly predictable,"
Schatz wrote. "[I]f you made a list of the top
five teams in the league by conventional wisdom, usually one of those teams
would end the season with the Lombardi trophy.
"For some reason, it seems like regular-season performance [recently] has
become useless in predicting which team will win a championship. All you have
to do is get into the tournament, and you can toss everything else
out."
Not so fast. As pointed out above, the Super Bowl team with the better regular
season play design has won 2 out of every 3 Super Bowls consistently throughout
history. Further, if you look at the teams with the least regular season design
edge who have reached the Super Bowl, it becomes even more clear that the idea
that the regular season is not worth as much today as it used to be is an
illusion. Here is a list of those teams:
SB No.
|
Underdog (Record)
|
Reg. Season
HA Edge
|
SB Line
|
SB TO
|
SB Result
|
42
|
NY Giants (10-6)
|
-.0171
|
+14
|
E
|
W (17-14)
|
34
|
Tennessee (13-3)
|
-.0015
|
+7
|
E
|
L (23-16)
|
31
|
N. England (11-5)
|
-.0003
|
+14
|
-4
|
L (35-21)
|
35
|
Baltimore (12-4)
|
.0029
|
-3
|
+5
|
W (34-7)
|
14
|
LA Rams (9-7)
|
.0035
|
+11
|
+2
|
L (31-19)
|
29
|
San Diego (11-5)
|
.0044
|
+18
|
-3
|
L (49-26)
|
36
|
N. England (11-5)
|
.0054
|
+14
|
+3
|
W (20-17)
|
15
|
Oakland (11-5)
|
.0064
|
+3
|
+4
|
W (27-10)
|
47
|
Baltimore (10-6)
|
.0073
|
+4
|
+1
|
W (34-31)
|
43
|
Arizona (9-7)
|
.0108
|
+6.5
|
-1
|
L (27-23)
|
What this table shows
is that the illusionary "devaluation of the regular season" is mostly
nothing more than the product of NFL realignment and playoff expansion. Prior
to Super Bowl 13, only one wild-card team qualified for the playoffs.
Unsurprisingly, the first mediocre team to reach the Super Bowl as measured by
regular season play design differential did not show up until Super Bowl 14
when the Los Angeles Rams took advantage of an unusually weak NFC to make
it.
Moreover, under the pre-Super Bowl 13 playoff format and divisional alignments,
the SB42 Giants (10-6), SB43 Cardinals (9-7) and SB47 Ravens (10-6) would not
even have qualified for the playoffs, assuming that the Ravens were in the same
division with either New England or Houston this year as they may well have
been under the old alignment format. Thus, the only mediocre or worse team to
"fluke into" the Super Bowl with less than 11 wins remains the SB14
Los Angeles Rams (9-7), who only had to win two games to do it.
What about the SB46 New York Giants you ask? The QuantCoach is glad you
did.
The SB46 Giants had a mediocre 9-7 regular season record, but their .0330
regular season play design edge was better than 27 other teams that reached the
Super Bowl and better than 8 other teams that won the Super Bowl (SB9
Pittsburgh; SB15 Oakland; SB18 LA Raiders; SB23 San Francisco; SB35 Baltimore;
SB36 New England; SB42 NY Giants; SB47 Baltimore).
Through the lens of coaching statistics, the SB46 Giants were not a mediocre
regular season team nor was their 21-17 win over New England in the Super Bowl
an upset as New York enjoyed a slightly larger play design edge over their
regular season opponents (.0330) than the Patriots did (.0272).
What got all 10 teams in the table above to the Super Bowl and enabled four of
the five who prevailed in the Super Bowl to win football's ultimate game was
their ability to avoid turnovers. The table below summarizes each team's
regular season, NFC or AFC playoffs, and Super Bowl turnover differentials:
SB No.
|
Underdog (Record)
|
Reg TO +/-
|
Playoff TO +/-
|
SB TO +/-
|
SB Result
|
42
|
NY Giants (10-6)
|
-9
|
+5
|
E
|
W (17-14)
|
34
|
Tennessee (13-3)
|
+18
|
+7
|
E
|
L (23-16)
|
31
|
N. England (11-5)
|
+7
|
+2
|
-4
|
L (35-21)
|
35
|
Baltimore (12-4)
|
+23
|
+5
|
+5
|
W (34-7)
|
14
|
LA Rams (9-7)
|
-8
|
-1
|
+2
|
L (31-19)
|
29
|
San Diego (11-5)
|
+9
|
-3
|
-3
|
L (49-26)
|
36
|
N. England (11-5)
|
+7
|
+3
|
+3
|
W (20-17)
|
15
|
Oakland (11-5)
|
+8
|
+6
|
+4
|
W (27-10)
|
47
|
Baltimore (10-6)
|
+9
|
+5
|
+1
|
W (34-31)
|
43
|
Arizona (9-7)
|
E
|
+9
|
-1
|
L (27-23)
|
As you can see, all of
these teams except the SB13 LA Rams, SB42 NY Giants, and SB43 Cardinals were
solidly turnover positive during the regular season and the Giants and
Cardinals were excessively turnover positive in their NFC playoff runs that got
them to the Super Bowl. Moreover, when turnover subsidies ran out in the Super
Bowl for SB29 San Diego, SB31 New England, SB34 Tennessee and SB43 Arizona,
they lost. Only the SB42 Giants were able to pull the upset without turnover
subsidies.
The final element that explains Super Bowl upsets is the diffusion of play
design knowledge since Walsh's retirement after the 49ers "upset" of
the Bengals in Super Bowl 23, the fifth biggest upset in Super Bowl history
from the perspective of coaching statistics.
As you can see, mediocre teams reached the Super Bowl only twice (SB14 LA Rams
and SB15 Oakland) in the first 28 Super Bowls (3.57% of Super Bowl participants
during that period), but have reached the Super Bowl eight times in the last 19
Super Bowls (21% of all Super Bowl participants during that period). NFL
playoff expansion, playoff realignment, and turnovers undoubtedly explain the
vast majority of this increase.
But the spread of football knowledge also has played a role.
Counterintuitively, as the table below shows, 70 percent of the Super Bowl
teams with the largest regular season play design edges over regular season
opponents participated in Super Bowl 7 or earlier, the "run first, pass
second" NFL era of Vince Lombardi. These teams included both participants
in Super Bowls 1 and 2 and both participants in Super Bowl 7, the year the NFL
moved the hashmarks closer to the center of the field and Miami's Larry Cszonka
and Washington's Larry Brown ran wild.
SB No.
|
Team (Record)
|
Reg. Season
HA Edge
|
SB Line
|
SB TO
|
SB Result
|
3
|
Baltimore (13-1)
|
.1316
|
-17
|
-4
|
L (16-7)
|
2
|
Green Bay (9-4-1)
|
.1270
|
-17
|
+3
|
W (33-14)
|
1
|
Green Bay (12-2)
|
.1254
|
-13
|
E
|
W (35-10)
|
24
|
San Francisco (14-2)
|
.1068
|
-12
|
+4
|
W (55-10)
|
1
|
Kansas City (11-2-1)
|
.1015
|
+17
|
E
|
L (35-10)
|
7
|
Miami (14-0)
|
.0988
|
+2
|
+1
|
W (14-7)
|
26
|
Washington (14-2)
|
.0976
|
-7
|
+4
|
W (37-24)
|
19
|
Miami (14-2)
|
.0972
|
+3
|
E
|
L (38-16)
|
2
|
Oakland (13-1)
|
.0951
|
+13
|
-3
|
L (33-14)
|
7
|
Washington (11-3)
|
.0916
|
-2
|
-1
|
L (14-7)
|
The only two teams to
make the list from the Post-Bill Walsh era are the SB24 49ers and the SB26
Redskins, generally considered the two teams in the discussion for the greatest
team of the Post-Walsh Era.
But this is not the end of the story. As the table below shows, coaching
statistics again reverse field and demonstrate that the five biggest Super Bowl
differences between regular season play design edges over regular season
opponents have occurred in the "pass-first, run-second" Post-Walsh
Era, including the SB34 & SB36 St. Louis "Greatest Show on Turf"
and the SB42 unbeaten Patriots.
What this shows is that Walsh's design, to some extent, commoditized the NFL
and made it easier for mediocre teams to prevail in 3 or 4 straight games if
they just avoided turnovers and were solid in the kicking game. This hypothesis
is further strengthened by the fact that the great increase in mediocre teams
reaching the Super Bowl did not begin until Super Bowl 29, approximately six
years after Walsh retired and his knowledge had fully diffused throughout the
NFL.
SB No.
|
Team (Record)
|
Super Bowl
HA Edge
|
SB Line
|
SB TO
|
SB Result
|
42
|
New England (16-0)
|
.0968
|
-14
|
E
|
L (17-14)
|
34
|
St. Louis (13-3)
|
.0839
|
-7
|
E
|
W (23-16)
|
36
|
St. Louis (14-2)
|
.0808
|
-14
|
-3
|
L (20-17)
|
24
|
San Francisco (14-2)
|
.0801
|
-12
|
+4
|
W (55-10)
|
29
|
San Francisco (13-3)
|
.0724
|
-18
|
+3
|
W (49-26)
|
15
|
Philadelphia (12-4)
|
.0665
|
-3
|
-4
|
L (27-10)
|
31
|
Green Bay (13-3)
|
.0651
|
-14
|
+4
|
W (35-21)
|
14
|
Pittsburgh (12-4)
|
.0620
|
-11
|
-2
|
W (35-19)
|
3
|
Baltimore (13-1)
|
.0566
|
-17
|
-4
|
L (16-7)
|
23
|
Cincinnati (12-4)
|
.0551
|
+7
|
E
|
L (20-16)
|
47
|
San Francisco (11-4-1)
|
.0548
|
-4
|
-1
|
L (34-31)
|
As you can see, in
their loss to the Ravens, the 49ers had the 11th largest regular season play
design edge ever in the Super Bowl. But if you look closer you notice something
very interesting.
San Francisco's Super Bowl design edge is the first edge that is primarily
based on innovation in the running game since the great Bill Walsh took off his
whistle for the final time at the end of Super Bowl 23.
This delicious fact presents the question that will dominate the 2013
off-season: What is the shelf-life of this design edge? Will the edge be there
in San Francisco (or Washington or Carolina or Seattle or Philadelphia or
somewhere else) next year?
Is the NFL at the threshhold of its first sea change in design since Walsh's
49ers won Super Bowl 16 and launched the current era of NFL design that is
based on throwing the football?
Time, of course, will provide the definitive answers to these questions.
So the QuantCoach hopes to see you back here the Sunday after Labor Day when we
start to get the answers.
(Archives Home)
|