[caption id=“attachment_1459” align=“aligncenter” width=“912”]
The signature Hole 4 at Blue Ribbon Pines in East Bethel, Minnesota. Photo: Blue Ribbon Pines Disc Golf Club[/caption]
When Nate Sexton mentioned that the Disc Golf Pro Tour’s most recent course was playing a bit lighter than he felt it should for a pro caliber event, he was promptly heckled by a local during the next round. Meanwhile, another tour promoter released a Twitter poll asking for people’s opinions on the proper number of holes for an event, then later mentioned the relatively short distance of one of its shots.
So just how well did Blue Ribbon Pines - set in an unconventional 22-hole layout - perform as a test of skill for pro players during last weekend’s Majestic? Some new statistics made possible by the advent of widely available hole-by-hole scores from UDisc Live and PDGA Live Scoring will help answer this question.
Scoring Spread Width
A hole needs to give out more than one score to be able to sort players by skill. The wider the Scoring Spread, the fewer ties among players. Scoring Spread Width assigns a precise value to the number of different scores a hole (or course) gives out to a group of players. For example, if a hole gives out 50 percent 3s and 50 percent 4s, its Scoring Spread Width is 2.
The Scoring Spread Widths for the holes at Blue Ribbon Pines (based on the 7,106 scores reported to UDisc Live during The Majestic) were:
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 |
| 2.3 | 2.6 | 4.1 | 3.9 | 3.2 | 3.4 | 2.2 | 3.8 | 3.0 | 2.8 | 2.7 | 3.9 | 3.2 | 3.2 | 2.1 | 3.2 | 2.8 | 2.9 | 2.2 | 2.7 | 2.9 | 3.3 |
This is one aspect of the performance of these holes. For now, we can only compare these holes to each other, because Scoring Spread Width depends on the particular mix of players contributing the data.
Scoring Spread Width of Total Scores
The sole job of a tournament is to break ties, based on skills exhibited. The tournament starts with all players tied. After each hole that is played, there are fewer and fewer ties. Fewer ties means we have more information about the players’ performances that day.
The measure that sums up how much information is in the final scores is Scoring Spread Width of Total Scores. For The Majestic, this was 54.4. Another way to express this is that the typical player ended up tied with 2.2 other players.
That figure by itself is not real helpful in evaluating the performance of the course, because it depends on the number of rounds and the diversity of player skills.
What we can use Scoring Spread Width of Total Scores for is evaluating the degree to which each hole contributed to the final results. A hole that gives out a lot of different scores and does so in a non-random fashion is pumping more information into the system than a hole that gives out few scores randomly.
To stabilize and standardize the results, we look at the Scoring Spread Width of Total Scores for a large number of combinations of 72 players for one round.
Contribution to Scoring Spread Width of Total Scores
We can determine how big a role each hole played in setting the final scores. To do this, we look at the Scoring Spread Width of Total Scores both with and without the hole being examined. If the Scoring Spread of Total Scores is wider with the hole than without it, then that hole has made a positive Contribution to the Scoring Spread Width of Total Scores. The bigger the contribution, the more important that hole was.
If the data is available to compute it, this is the single most important statistic for evaluating hole performance.
Here are the Contributions to the Scoring Spread Width of Total Scores for the holes used during The Majestic at Blue Ribbon Pines (based on scores from UDisc Live), in percent:
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 |
| 2.2 | 3.5 | 5.8 | 5.9 | 5.2 | 3.3 | 2.4 | 3.0 | 2.8 | 2.4 | 2.9 | 5.3 | 2.9 | 3.5 | 4.3 | 3.0 | 3.5 | 1.8 | 2.7 | 3.9 | 3.0 | 3.0 |
Holes 3 and 4 - and, to a lesser extent, 15 - contributed the most to Scoring Spread at The Majestic, making them indispensable.
Luck
A wide Scoring Spread is no good if it is a result of that hole assigning scores by mere luck. Scores that are assigned by luck tend to muddle and compress the total scores of the field.
At this point, some readers will protest that more luck means more widely-distributed scores, which means more different scores. That would be true if holes were very, very precise about giving out scores according to skill. For example, if all the holes gave all their lowest scores only to the best players, there would have been 22 players tied at a score of 51, and another 22 tied at 52. In that kind of a world, more luck would break some ties and create a wider distribution of total scores. However, in the real world, most players can get most of the scores any hole can give out, so the less luck, the fewer ties.
Fortunately, we can use the impact of luck on the lumpiness of total scores to measure the luckiness of each hole.
Using each hole’s set of scores, we compare how the actual allocation of scores compares to all possible allocations of those same scores. If the actual allocation beats all other possible allocations, there was no luck involved in setting that allocation – it had to be done according to some skill that is being measured by that hole. At the other extreme, a completely random allocation of scores would be expected to beat only half of all possible allocations.
The fewer scores a hole hands out, the harder it is for that hole to prove it is not lucky. Disc golf holes in general give out only a few different scores, so there will almost always be a significant element of luck.
The holes at Blue Ribbon Pines allocated their scores better than the following percentages of all possible allocations:
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 |
| 73 | 82 | 89 | 89 | 88 | 82 | 74 | 81 | 81 | 73 | 80 | 88 | 81 | 82 | 81 | 82 | 82 | 74 | 78 | 82 | 80 | 82 |
The stretch of Holes 3-5 proved to be least affected by “luck.” Again, because the results depend on the particular mix of players, these values can only be used for comparing the holes on this course to each other.
Summary Charts
The following charts present a few of the stats for comparing holes to each other. In both, up and right is “better”.
In this case, it’s easy to see which holes separated scores by accounting for skill more than luck: Holes 3-5, and 12. These holes were all Par 4s measuring longer than 400 feet, with 5 and 12 topping 600 feet.
Comparing to Other Courses
If we find the scoring distribution for a prototypical player of a specified rating, holes can be compared across courses.
Unfortunately, the statistics for Luck and Contribution lose their meaning for a single rating. However, Average Score, Scoring Spread Width, and Par can be computed and compared from tournament to tournament, or course to course.
If we have hole lengths, we can also compute the expected score for a wide open hole of that length, and compute Trouble by subtracting the expected score for a wide open flat hole, from the actual Average Score.
Exact Par can also be computed from the scoring distribution. Exact Par is calculated from the percentile of throws that were good enough to score par on a hole. The integer part of Exact Par is what par should be on the hole, and the value to the right of the decimal point shows how close the hole is to being a higher par hole.
Here are the Average Score, Trouble, Scoring Spread Width, Exact Par and the complete distribution for 1000-rated players for Blue Ribbon Pines during the 2016 Majestic:
| Hole | Average | Trouble | Scoring Spread Width | Exact par | 1s | 2s | 3s | 4s | 5s | 6s | 7+ |
| 1 | 2.40 | 0.12 | 2.11 | 2.84 | 0% | 62% | 35% | 2% | 0% | 0% | 0% |
| 2 | 2.32 | 0.31 | 1.99 | 2.66 | 0% | 70% | 28% | 2% | 0% | 0% | 0% |
| 3 | 3.92 | 1.57 | 3.76 | 4.24 | 0% | 2% | 36% | 40% | 15% | 5% | 3% |
| 4 | 4.09 | 1.36 | 3.47 | 4.35 | 0% | 0% | 28% | 42% | 24% | 6% | 0% |
| 5 | 3.88 | 0.95 | 2.89 | 4.15 | 0% | 0% | 30% | 55% | 11% | 3% | 1% |
| 6 | 3.09 | 0.71 | 3.00 | 3.37 | 0% | 20% | 55% | 23% | 2% | 0% | 1% |
| 7 | 2.41 | 0.43 | 2.13 | 2.88 | 0% | 61% | 37% | 2% | 0% | 0% | 0% |
| 8 | 4.07 | 1.49 | 3.09 | 4.22 | 0% | 0% | 21% | 59% | 14% | 5% | 1% |
| 9 | 3.12 | 0.68 | 2.58 | 3.30 | 0% | 12% | 67% | 18% | 2% | 1% | 0% |
| 10 | 2.56 | 0.45 | 2.57 | 3.12 | 0.4% | 52% | 38% | 9% | 0% | 0% | 0% |
| 11 | 2.59 | 0.45 | 2.44 | 3.09 | 0% | 48% | 46% | 6% | 0% | 0% | 0% |
| 12 | 3.92 | 0.96 | 3.43 | 4.25 | 0% | 0% | 38% | 39% | 16% | 6% | 1% |
| 13 | 3.83 | 0.44 | 3.21 | 4.00 | 0% | 0% | 42% | 36% | 18% | 4% | 0% |
| 14 | 2.76 | 0.57 | 2.92 | 3.40 | 0% | 52% | 21% | 26% | 1% | 0% | 0% |
| 15 | 2.76 | 0.19 | 2.08 | 3.05 | 0% | 27% | 69% | 3% | 0% | 0% | 0% |
| 16 | 3.03 | 0.74 | 3.03 | 3.36 | 0% | 24% | 51% | 22% | 2% | 0% | 0% |
| 17 | 2.84 | 0.59 | 2.73 | 3.20 | 0% | 31% | 55% | 13% | 1% | 0% | 0% |
| 18 | 2.94 | 0.62 | 2.87 | 3.24 | 0% | 26% | 57% | 14% | 3% | 0% | 0% |
| 19 | 2.50 | 0.11 | 2.14 | 3.02 | 0% | 52% | 47% | 2% | 0% | 0% | 0% |
| 20 | 2.49 | 0.32 | 2.37 | 2.96 | 0% | 58% | 38% | 3% | 0% | 1% | 0% |
| 21 | 3.44 | 1.11 | 2.31 | 3.58 | 0% | 0% | 63% | 32% | 5% | 0% | 0% |
| 22 | 3.04 | 0.70 | 3.19 | 3.48 | 0% | 30% | 39% | 30% | 1% | 0% | 0% |
| All | 3.09 | 0.68 | 2.74 | 67 | 0% | 29% | 43% | 22% | 5% | 1% | 0% |
| Ex. P2s | 3.24 | 0.76 | 2.87 | 59 | 0% | 21% | 45% | 26% | 6% | 2% | 0% |
For comparison, here are the same values for the 2016 Vibram Open at Maple Hill.
| Hole | Average | Trouble | Scoring Spread Width | Exact par | 1s | 2s | 3s | 4s | 5s | 6s | 7+ |
| 1 | 4.01 | 0.50 | 2.71 | 4.17 | 0% | 0% | 19% | 64% | 13% | 3% | 1% |
| 2 | 2.92 | 0.58 | 2.49 | 3.19 | 0% | 22% | 64% | 13% | 1% | 0% | 0% |
| 3 | 2.99 | 0.56 | 2.53 | 3.23 | 0% | 18% | 65% | 15% | 1% | 0% | 0% |
| 4 | 2.82 | 0.77 | 2.65 | 3.15 | 0% | 31% | 58% | 9% | 2% | 0% | 0% |
| 5 | 2.68 | 0.65 | 3.20 | 3.25 | 1% | 55% | 26% | 13% | 2% | 1% | 1% |
| 6 | 3.57 | 1.35 | 3.59 | 3.75 | 0% | 7% | 46% | 31% | 12% | 3% | 0% |
| 7 | 3.32 | 1.04 | 2.62 | 3.44 | 0% | 5% | 66% | 23% | 5% | 1% | 0% |
| 8 | 2.60 | 0.24 | 2.82 | 2.89 | 1% | 59% | 19% | 20% | 1% | 0% | 0% |
| 9 | 3.52 | 1.18 | 2.81 | 3.67 | 0% | 2% | 56% | 33% | 7% | 2% | 0% |
| 10 | 3.74 | 1.13 | 2.61 | 4.09 | 0% | 0% | 37% | 55% | 7% | 1% | 0% |
| 11 | 3.76 | 0.45 | 2.42 | 4.07 | 0% | 0% | 32% | 61% | 6% | 0% | 0% |
| 12 | 3.93 | 0.95 | 2.59 | 4.15 | 0% | 0% | 23% | 63% | 13% | 2% | 0% |
| 13 | 3.07 | 0.58 | 2.40 | 3.26 | 0% | 12% | 70% | 17% | 2% | 0% | 0% |
| 14 | 3.08 | 0.41 | 3.28 | 3.43 | 0% | 25% | 46% | 25% | 3% | 1% | 0% |
| 15 | 2.91 | 0.55 | 2.79 | 3.25 | 0% | 28% | 55% | 17% | 1% | 0% | 0% |
| 16 | 3.23 | 0.48 | 2.84 | 3.41 | 0% | 11% | 62% | 22% | 5% | 0% | 0% |
| 17 | 3.56 | 0.55 | 2.39 | 3.83 | 0% | 0% | 50% | 45% | 5% | 0% | 0% |
| 18 | 3.80 | 0.82 | 3.12 | 3.92 | 0% | 0% | 46% | 30% | 22% | 1% | 0% |
| All | 3.31 | 0.71 | 2.77 | 57 | 0% | 15% | 47% | 31% | 6% | 1% | 0% |
Using these numbers, we see that there were four holes at Blue Ribbon Pines that could arguably be considered Par 2s, compared to zero for Maple Hill.
One way to compare these is to consider the four par 2s at Blue Ribbon Pines to be “bonus” holes. For difficulty, then, we find:
- The 18 non-par 2 BRP holes had a Scratch Scoring Average (SSA) of 58.4.
- Maple Hill had a higher SSA at 59.5 .
- When the par 2 holes at BRP are included, the SSA for BRP is 68.0 .
Direct Comparison of Course Effectiveness
While the stats above give an idea of which holes should perform better, what really matters is how well they actually perform. The only way to make this comparison for two different courses is to see what happened for a common set of players.
There were 121 rounds recorded at each tournament for players who played both the Vibram Open and The Majestic this year. There were 99 additional rounds which were played by players with the same rating as a player at the other tournament.
Using data from these rounds, we can directly compare the performances of the two courses. This takes into account not just the scoring spread of each hole, but also how well those scores were allocated, and any synergies between holes.
Maple Hill generated a Scoring Spread Width of Total Scores of 17.5 for the standardized one round of 72 players.
The 18 holes at Blue Ribbon Pines that are not par 2s generated a Spread of 17.9 for the standardized one round of 72 players.
The 22 holes at Blue Ribbon Pines generated a Spread of 19.1 for the standardized one round of 72 players.
So, the conclusion is that the 18 non-par 2 holes at Blue Ribbon Pines were slightly more effective at sorting Pro Tour players than the 18 holes at Maple Hill, even though these 18 BRP holes had a lower SSA than Maple Hill. With the four par 2 holes included, the BRP course was significantly more effective at sorting players – as would be expected because the SSA was much higher and there were more holes.
Direct Comparison of Holes
By combining all 40 holes from both courses together into one virtual course, we can stage a 40-way battle to determine the most effective holes. (As an aside, this 40-hole course produces a Spread of 26.3 on an SSA of 127.5.)
Here are the results, ranked by Contribution to Scoring Spread Width of Total 40-hole Scores.
| Contribution | Hole | Contribution | Hole |
| -3.3% | BRP1 | 0.0% | BRP12 |
| -3.3% | MH17 | 0.3% | BRP2 |
| -2.2% | MH14 | 0.4% | MH7 |
| -2.0% | BRP5 | 0.4% | MH1 |
| -1.7% | MH16 | 0.4% | MH11 |
| -1.6% | MH2 | 0.4% | MH10 |
| -1.4% | BRP7 | 0.5% | MH9 |
| -1.4% | MH3 | 0.6% | BRP19 |
| -1.1% | BRP13 | 0.8% | BRP17 |
| -1.1% | MH6 | 1.0% | BRP18 |
| -0.9% | BRP4 | 1.0% | BRP3 |
| -0.9% | MH4 | 1.0% | MH5 |
| -0.8% | BRP9 | 1.0% | BRP14 |
| -0.5% | MH18 | 1.3% | BRP20 |
| -0.4% | BRP11 | 1.4% | BRP16 |
| -0.3% | MH8 | 1.6% | MH15 |
| -0.3% | MH13 | 1.8% | BRP15 |
| -0.3% | BRP8 | 2.0% | BRP10 |
| -0.2% | MH12 | 2.8% | BRP21 |
| -0.1% | BRP6 | 4.4% | BRP22 |
Here is a chart showing the components of a good hole, Scoring Spread Width and Minimal Luck. (Up and to the right is “good”.)
Of note, Blue Ribbon Pines’ 22nd hole was also one of the playoff holes at the event. Based on these metrics, it was a good choice for inclusion in overtime, and not just because of its proximity to the gallery.
Next Step
The course owners could look at these statistics and target a few holes in the lower left quadrant - Blue Ribbon Pines Hole 1 (which was also featured prominently during The Majestic’s playoff) and Maple Hill’s 17th, for example - to try to improve.
The hole-by-hole scores can help with this effort, too. But that is another article.
Originally published at: http://discgolf.ultiworld.com/2016/08/04/statistical-breakdown-blue-ribbon-pines/