The changing relationship between goals and winning in Gary Bettman's NHL
In the course of researching for my ongoing (trust me!) series on Shot Quality vs. Quantity, I have attempted to identify successful regular season teams. For this purpose I have singled out three considerably-overlapping groups: President's Trophy winners or equivalent (first overall, or OV), teams with the best Goal Differential (GD = GF - GA), and teams with the best Goal Ratio (GR = GF:GA). It stands to reason that the teams which are most successful at scoring and preventing goals will have the most success in the standings, right?
Not so fast. This is Gary Bettman's NHL, where logic and reason take a back seat to forced parity and imaginary goals and standings points. In my research - which is ultimately directed towards playoff success - I filtered out the ersatz goals that are credited for shootouts, however those results still have their effect in the standings since 2005. I didn't even try to filter out overtime goals against, which affect GD and GR but have not been punished in the standings since 1999. Therefore the study period of 1983-2009 can be broken down thusly:
- 1983-1999: Goodness, normalcy, and logic prevail (every game worth two (2) points)
- 1999-2004: Bettman Point Ver 1.0 (third point awarded in some overtime games)
- 2004-2005: No fucking hockey
- 2005-2009: Bettman Point Ver 2.0 (third point awarded in all overtime games)
It's an interesting exercise to see how GD and GR have translated to standings success over those 25 years. The graph up top shows how the President's Trophy winners have fared over the study period. The Y axis is rank in the league in each category, with all teams by definition being #1 in the standings (green pyramids).
The divergence between Real goals and standings success has been, predictably, growing during the Bettman Era. Here's the average rank in each category for the regular season champions:
| Period | OV | GD | GR |
| 1983-1999 | 1.0 | 1.19 | 1.25 |
| 1999-2004 | 1.0 | 1.4 | 1.6 |
| 2004-2005 | 0 | 0 | 0 |
| 2005-2009 | 1.0 | 2.0 | 2.75 |
Here is the same data sorted by (Real) Goal Ratio. From 1983-99, The team leading the league in this department had never finished worse than second overall with the vast majority (13 of 16) finishing first. In the Bettman Point era, just 3 of 9 teams that led the league in Goal Ratio won the President's Trophy.
Finally, above is the same information for Goal Differential. It's very similar to the previous diagram because in 22 years of the 25 the same team led the league in both categories. Just the '86 Oilers, '91 Kings (both Gretzky teams) as well as the '03 Senators muscle their way to the top in GD despite having a (slightly) inferior GR. That relationship remains rock solid. What is changing/diminishing is the effectiveness of outscoring w.r.t. the standings.
Here's the average rank in each category for the league leaders in goal differential:
| Period | GD | GR | OV |
| 1983-1999 | 1.0 | 1.13 | 1.25 |
| 1999-2004 | 1.0 | 1.2 | 2.4 |
| 2004-2005 | 0 | 0 | 0 |
| 2005-2009 | 1.0 | 1.0 | 3.5 |
Of particular note, the Ottawa Senators led the NHL for FOUR consecutive seasons 2002-07. The Sens are an interesting case, a mammoth outlier with one measly President's Trophy (and zero Stanley Cups) to show for their outscoring ways. Bizarre to see them lead the league in both GD and GR in '04, '06, '07, yet finish sixth, second, and a shocking ninth in the overall standings in those seasons. Not surprisingly, their overtime record was a poor 7-12-26, and their shootout mark an abysmal 4-12 over the last two of those years. What's more surprising is their inability to produce better results in the postseason, in which Real Hockey is played until games are decided. In handicapping for playoff pools I have always preferred the team with the better goal differential regardless of standings, but it seems the Ottawa Senators have somehow managed to underachieve in both the regular season and the playoffs.
In each of the graphs we see increasing instability in the relationship between goal scoring/prevention - the staples of successful hockey - and results in the regular season standings. Winning strategies increasingly rely on playing the system, as opposed to simply playing hockey.
18 comments
|
1 recs |
Do you like this story?
Comments
Very nicely done Bruce.
I am wondering though if there’s any way we could find out if the trend you’ve pointed out is more a result of greater parity in the league (due to the salary cap) or the bonus points that teams now see in OT.
Author at Pensburgh.com
The greater parity is due to the salary cap AND the bonus points awarded for reaching OT. Which is the greater factor is an open question.
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 17, 2010 6:47 PM MDT up reply actions
Goal Ratio?
Would you mind defining “Goal Ratio” or what you mean by that? How would that be different then GD?
Also now that the Hawks have won, where do they fit in your scatter plot?
http://assets.sbnation.com/assets/366125/scc_scatter.jpg
One of the things I noticed is how different the Hawks played in the playoffs compared to the regular season. So have you compared how the teams in your list related their season to playoff numbers?
1) Thanks Dale. I noticed the deficiency and had just edited to add a definition, but Sum has got it: Goal Ratio is GF:GA and Goal Differential is GF – GA. Usually but not quite always the best team at one is the best at the other. But to illustrate I’ll use one of the seasons where the leaders in the two categories were different:
1985-86 Edmonton Oilers: 426 GF, 310 GA
GR = 426/310 = 1.374
GD = 426 – 310 = +116
1985-86 Philadelphia Flyers: 335 GF, 241 GA
GR = 335/241 = 1.390
GD = 335 – 241 = +94
The Oilers were more prolific and outscored by a wider gross margin, but because their games were higher scoring each individual goal had slightly less value which is where Goal Ratio is a useful alternate measuring stick.
2) The Blackhawks had a goal ratio of 262/203 = 1.291 in 2009-10. More than all of that margin was on the shots clock, where Hawks outshot their opponents by a massive 2798 to 2058, for a shots ratio of 1.360. Their shooting percentage was actually slightly worse than their opponents at 9.36% vs. 9.86%, for a Sh% ratio was 0.949. So they would be plotted at X = 1.360, Y = 0.949, out towards the right edge a little below the centre line. They’re not quite as extreme an outshooter as the 2007-08 Red Wings, who are the square out near the right edge of the diagram, but they would cozy up next to the first large diamond a little further in, which represents the 2003 New Jersey Devils (X = 1.348, Y = 0.965)
3) It’s true (some) teams play different in the playoffs than the regular season. That was why I was unsatisfied in Part One that I was judging Stanley Cup teams based on their regular season shots and percentages. Hell, they don’t even play by the same rules in the regular season! I plan to address this in a future instalment(s) of my Shot Qual v. Quan series, by specifically examining playoff shots data. Apples v. apples and all that.
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 18, 2010 12:19 AM MDT up reply actions
Randomness?
Bruce,
Aside from the obvious innumeracy of awarding 3 points for some games and 2 for others,
I suspect what you’re seeing is an increase in randomness. Bill James noticed some time ago that deviations from his Pythagorean Projection http://en.wikipedia.org/wiki/Pythagorean_expectation, we’re often the results of the one run games. Teams that won or lost excessively in 1 run games typically regressed to the mean the following season. Winning in OT fits that.
The OT goal is more nearly random than outscoring the opponent over 60 minutes. Shootouts are more random yet. Skill matters, but you know about small samples.
In short, that extra standings point is awarded by little more than a coin toss. Basically that’s Flyers v Rangers in the playoffs at all this year. One of these days, two teams will make the playoffs at the expense of a third by signing a non-aggression pact, and ending regulation in a 0-0 tie. Yea, I’m no fan of this system.
Meminisse Sed Providere
Thanks TartanBill. Back in the day I used to read the Bill James Baseball Abstract from cover to cover two or three times a season, learned a lot about ways to think about numbers. James (used to?) refer to the bounceback from teams that serious over/under performed their Pythagorean expectation, as the Johnson Effect.
But it sure in hell doesn’t explain the Ottawa Senators!
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 18, 2010 10:08 PM MDT up reply actions
Really good article Bruce. You may already have this in the works, but i was curious about which of these measures seems to be a better predictor of playoff success since the lockout. I would assume that GD is the best and that SP is the worst but it would be interesting to see if that’s been true over the last five seasons.
Thanks, Scott, that is an excellent idea which has given me an idea of my own as to how to address it. As you know I’m more about interpreting past results than I am into predicting future performance, but in this case we could use known regular season performance to “predict” immediately subsequent known playoff performance. Or not. It’ll be interesting to see if there are Any strong trends.
Which “SP” are you referring to, btw? Sh%, Sv%, or some combination of the two (PDO #, C&B #)? It’ll be interesting to see if your assumptions hold. Of course GD should be a higher order indicator since (to oversimplify) it’s measured in goals, not shots. And it seems to me the team with more goals wins a lot more games than the team with more shots. :D
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 20, 2010 1:50 AM MDT up reply actions
Ha! I meant “Standings Points.” Sorry for the confusion.
by Scott Reynolds on Jun 20, 2010 2:30 AM MDT up reply actions
That’s funny. What a versatile acronym. :)
But you still gave me an idea for a methodology. By all means, a comp between standings points and goal differential/ratio as a playoff predictor should prove interesting. Watch this space.
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 20, 2010 11:48 AM MDT up reply actions
Bruce,
Looks like Ottawa lost too many games, 25, in regulation for a team with that goal differential that year 2006-7.
I did a quick count, 13 1 goal losses, 10 wins. 9 losses in SO or OT, only 4 wins. That’s 22 of their 25 losses by 1 goal or OT vice 13 wins. Yikes! that’s way below projection. If those broke down like their overall win/loss they run away with the President’s trophy.
I haven’t looked at the other seasons, but they couldn’t have been that bad. I’d have work out standard deviations, but it looks like just a run of bad luck, Couldn’t have been that bad. I wonder what the Spearman’s correlation across the league looks like.
Meminisse Sed Providere
I’m pretty sure that Bruce’s point is that they aren’t as bad as their record implies and that records in general are becoming a less useful measure of which teams are actually good at playing hockey.
by Scott Reynolds on Jun 19, 2010 6:44 PM MDT up reply actions
Yes, that is indeed the point. On Gary Bettman’s watch regular season hockey has gradually diverged from pure hockey into a mutant variation.
Ottawa would have underformed their Pythagorean win expectation on the basis of their shitty record in one-goal games — an outscoring team should win More than their share of those — and their bad OT (2-3-8) and absymal shootout (2-6) record just made a bad situation worse. I’d say there’s enough of a persistent pattern there to suggest that Ottawa actually did underperform any time a team really gave them a battle — see Toronto in the playoffs year after discouraging year, when the Sens quite simply folded under the pressure each and every time. But when they were on their game and rolling, they could really run up a score.
The other odd thing about 2006-07 was that no fewer than Eleven teams wound up between 104 and 113 points, so a little underperformance dropped the Sens a long way. Even under Bettman’s Bizarro Rules, the chances of a team leading the league in goal differential and finishing ninth (!!) have to be mighty small. I’m still shaking my head as I think about that one.
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 19, 2010 11:23 PM MDT up reply actions
And on that I think he’s right. But I’m a quant, I like to know how much. ;) It really looks like a big part of that Ottawa outlier was losses in regulation. If I had time, I’d look at the records in regulation and OT and SO separately. I suspect little correlation.
Meminisse Sed Providere
There’s little correlation as a general rule, esp. when it comes to shootouts. The ‘07-08 Oiler still hold some sort of record with their 15 wins in 19 shootouts in ’07-08, which was the only reason the team even got within sniffing distance of the postseason, cuz they weren’t very good at all at the 5-on-5 game. Whereas Ottawa was arguably the best club in the league in the years around the lockout, and they went 2-6, 2-6 in the first two years of the shootout. So they cost themselves a few standings points right there with results that I didn’t even consider! I can’t get past 1 “goal” on 0 shots, the data is corrupted right there, so for my shots project the shootout goals had to go. But their effect is right there in the standings, which I am basically arguing have themselves been corrupted.
Btw, I followed your lead and looked up Ottawa’s record in one-goal games in 2003-04, the year they finished sixth despite leading the league in both GD and GR. Sure enough, they posted an abysmal 9-17 mark, including losing their first TEN one-goal games of the season. Their season started with these scores (OTT first): 5-2, 2-3, 3-4, 3-0, 4-1, 5-1, 6-2, 2-3 …
Now whether that is just random dice coming up snake eyes or whether that’s some sort of collective character flaw inherent to that Ottawa Senators team I’ll leave for you to decide. ;) Kind of interesting that it happened to the same team more than once.
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Jun 20, 2010 2:25 AM MDT up reply actions
When I eyeballed the 2006-7 standings what struck me was the number of teams that appeared to do better than expectation. As you pointed out OT and shootouts have weakened the link between goal differential and standings points. The data show it and the mechanism is pretty obvious.
Meminisse Sed Providere

by 


































