Quick: What is the biggest hindrance to the usefulness of statistics in flat track roller derby?
Give up? The answer is sample size.
Let's look at a sport known for it's use of statistics: baseball. In baseball, an everyday player will come up to bat about 600 times over a 6-month season. A regular starting pitcher will face a lot more hitters than that: 800 is common, and several pitchers reach 900 each year. With such gigantic samples, it's easy to draw definable conclusions from even a single month's statistics. Once you get around 100 plate appearances, you can start evaluating and make adjustments throughout the season.
So how long does it take for a jammer to rack up 100 jams? One year, and that's if she's lucky. Unfortunately, you need to evaluate your team a lot more often than once a year. So most of your mid-year stat analysis is going to be based on insufficient sample sizes. Some of the data is pointing at a trend, but anomalous jams are throwing off the math. How do you tell a good differential built on consistency from a bad differential skewed by 1 or 2 big jams?
The answer is so simple that I can't imagine why I didn't think of tracking it earlier: Look at the jam win-loss record. In nearly every jam, both teams take the track with one goal in mind. No, that goal is not to get lead jammer; that's just a means to an end. Any team would let the opponent ultimately get lead jammer if it means that they can score 5 points before that happens. The goal is to win the jam. Tracking jam wins and jam losses is a simple way of seeing how often you are successful at achieving that goal.
Time to play make believe: You're evaluating a new jammer's performance in last Saturday's bout. Do you want her to be a regular part of the 3-jammer rotation in the upcoming tournament, or a secondary jammer who you can put in here and there to fill holes? Do you want to rely on her in a key situation to come through with a good jam?
Let's say the jammer in question had these 8 jam results last weekend: 0-4, 0-2, LJ 3-0, 0-0, LJ 24-0, 0-4, 0-9, LJ 0-0.
Her line would look like this: 3 for 8, 27 points, +8 differential. Pretty solid, eh? Not the best lead jam percentage, but still pretty good overall. A jammer you can count on in an important jam?
What about her jam wins and losses? 2 Jam Wins, 4 Jam Losses.
Well now, he have a red flag here. The win-loss record points to inconsistency. She scored the vast majority of her points in a single jam where she only had to skate laps while the opposing 2-pack was helpless. Apart from that jam, she struggled. Is this a jammer you want on the line in a tie game with 2:45 to play? The result of this jam could mean the difference between winning and losing the bout, and she appears to be twice as likely to lose the jam as she is to win it.
Obviously, I tailored the hypothetical situation here to make my point, but it still remains valid. A jammer with a positive differential who has won more jams than she has lost has been consistently good. A positive differential jammer who has lost jams more often than winning has probably gotten lucky. Of course, the other side of that is true as well. You could have a jammer with a negative differential who has more jam wins than jam losses and is being undervalued due to a couple bad jams.
Yes, there are several factors you should take into consideration before you choose who's in your main jammer rotation. (Which skaters are improving the fastest? Who is still recovering from an injury?) There are even more things you have think about when you decide who gets the star in a critical game situation. (How have each of your jammers been skating today? Who is rested and ready to go?) Still, I think consistency statistics like jam wins and jam losses can be helpful in evaluating skaters, lines, and teams as a whole.
Wednesday, January 25, 2012
Monday, January 23, 2012
Roller Derby and Civil Procedure
Here's a new one.
A University of South Carolina law professor is teaching a class about the parallels between lawyering and roller derby.
I'm not sure what to make of this. The seminar will have course credit attached to it, but it seems more like a really clever way to get people to watch roller derby and relate it to something they know. It also kind of seems like a Mickey Mouse course.
Not that I'm complaining by any means. I'm smiling as I write this, but it's a sly, "stealing from the cookie jar" kind of smile... Maybe I should have been a lawyer.
Anyway, I'll just choose to take this as further proof that roller derby is conquering the world.
A University of South Carolina law professor is teaching a class about the parallels between lawyering and roller derby.
I'm not sure what to make of this. The seminar will have course credit attached to it, but it seems more like a really clever way to get people to watch roller derby and relate it to something they know. It also kind of seems like a Mickey Mouse course.
Not that I'm complaining by any means. I'm smiling as I write this, but it's a sly, "stealing from the cookie jar" kind of smile... Maybe I should have been a lawyer.
Anyway, I'll just choose to take this as further proof that roller derby is conquering the world.
Thursday, January 19, 2012
Initial Pack Strength/Advantage
Well, this is my first post so I might as well lead with what I know best: statistics. Gather 'round all ye derby stats geeks who happen onto this post somehow. I'd like to tell you about stat ideas I've come up with in an attempt to further the understanding of modern, flat track roller derby.
Let's start with a stat I call "Initial Pack Strength" or iPS. Basically, it's the number of pack skaters (pivot + blockers) on the track at the start of the jam. If you take the iPS for each team, you can also see who has the numbers advantage in the pack before the jammers are released. This is a related stat I call "Initial Pack Advantage" or iPA.
So, iPA = (your iPS) - (opponent's iPS). It's essentially a differential for the pack strength of both teams. +1 means you outnumber your opponent by 1 skater. -2 represents your pack being outnumbered by 2 blockers.
In tracking this, it has become very apparent to me that pack advantage matters a lot. I don't have any specific data ready to give you right now, but logic dictates that pack advantage = easier to succeed in roller derby. So, when a jammer grabs lead or even forces a 0-0 jam when her pack is outnumbered, it's a win. You can even take the total iPA in all of the jams and weigh it against her statistics to see just how well she did with what was dealt her.
"Jammer X only grabbed lead 3 out of 7 times, but she has a total iPA of -5. That's pretty damn good considering she was constantly outnumbered."
"Jammer Y may have gotten lead 7 of 10 times, but she was usually on the advantage. Her total iPA was +9, so a 70% lead jam percentage isn't anything special."
-But that kind of analysis begs the question: What is average? What can you realistically expect to get out of a pack advantage? Well, that's a question I've been thinking a lot about lately. I have a possible attempt to solve it in mind, but it will take a lot of work. If I decide to do it, you can expect a series of posts about it.
My main purpose for tracking these stats is to try and take the situation into account when analyzing skaters, lines, and jams. If your jammer takes lead when facing a 4-pack and only aided by a 2-pack, it's a big play. On the other side, if your pack surrenders lead with a +2 iPA, that's a definite problem.
Logically, you'd also think the best teams are the ones who can operate well when outnumbered. Every roller derby bout played by WFTDA rules sees an increase in penalties in the second half. The teams who manage their penalties well, and those who perform well with smaller packs, are the teams who succeed. Obviously, endurance and conditioning matter a lot to a team's performance in the second period. All things being equal though (such as intraleague season or high level tournament play), it might be more accurate to think of a team as "manages penalties and plays well short-handed" rather than the cliché: "second half team."
In my opinion, pack strength and advantage statistics are definitely worth looking at when trying to figure out how skaters or lines perform based on the situations they are in, and in examining why teams excel or struggle in the second period.
Let's start with a stat I call "Initial Pack Strength" or iPS. Basically, it's the number of pack skaters (pivot + blockers) on the track at the start of the jam. If you take the iPS for each team, you can also see who has the numbers advantage in the pack before the jammers are released. This is a related stat I call "Initial Pack Advantage" or iPA.
So, iPA = (your iPS) - (opponent's iPS). It's essentially a differential for the pack strength of both teams. +1 means you outnumber your opponent by 1 skater. -2 represents your pack being outnumbered by 2 blockers.
In tracking this, it has become very apparent to me that pack advantage matters a lot. I don't have any specific data ready to give you right now, but logic dictates that pack advantage = easier to succeed in roller derby. So, when a jammer grabs lead or even forces a 0-0 jam when her pack is outnumbered, it's a win. You can even take the total iPA in all of the jams and weigh it against her statistics to see just how well she did with what was dealt her.
"Jammer X only grabbed lead 3 out of 7 times, but she has a total iPA of -5. That's pretty damn good considering she was constantly outnumbered."
"Jammer Y may have gotten lead 7 of 10 times, but she was usually on the advantage. Her total iPA was +9, so a 70% lead jam percentage isn't anything special."
-But that kind of analysis begs the question: What is average? What can you realistically expect to get out of a pack advantage? Well, that's a question I've been thinking a lot about lately. I have a possible attempt to solve it in mind, but it will take a lot of work. If I decide to do it, you can expect a series of posts about it.
My main purpose for tracking these stats is to try and take the situation into account when analyzing skaters, lines, and jams. If your jammer takes lead when facing a 4-pack and only aided by a 2-pack, it's a big play. On the other side, if your pack surrenders lead with a +2 iPA, that's a definite problem.
Logically, you'd also think the best teams are the ones who can operate well when outnumbered. Every roller derby bout played by WFTDA rules sees an increase in penalties in the second half. The teams who manage their penalties well, and those who perform well with smaller packs, are the teams who succeed. Obviously, endurance and conditioning matter a lot to a team's performance in the second period. All things being equal though (such as intraleague season or high level tournament play), it might be more accurate to think of a team as "manages penalties and plays well short-handed" rather than the cliché: "second half team."
In my opinion, pack strength and advantage statistics are definitely worth looking at when trying to figure out how skaters or lines perform based on the situations they are in, and in examining why teams excel or struggle in the second period.
Subscribe to:
Posts (Atom)