homepage/content/blog/2022-10-09-CLRG-Scoring/index.md

5.4 KiB

title date stylesheets scripts
CLRG Scoring Analyzed 2022-10-09
toys.css
speculator.mjs
scorecard.mjs

Let's take a look how how CLRG does its scoring! With math!

I'm going to only view this mathematically. I know there's a lot of other stuff that goes on, like line-ups. I'm only going to look at this with numbers.

How CLRG Scoring Works

As I am given to understand, the scoring works like so:

  1. Adjudicators give you a "raw score": a real number between 0 and 100
  2. The scoring system ranks each dancer per adjudicator, based on raw scores
  3. These rankings are mapped into "award points"
  4. All of a dancer's award points are summed
  5. Final ranking is determined by comparing total award points

Raw Scoring

The way raw scores translate into rankings and award points is a little confusing, so I've made a little tool you can play with to get a feel for how it works. Essentially, it's a way of normalizing places to an adjudicator: score weights are only relative to the judge that assigns them.

Adjudicator A can assign scores between 80 and 100; adjudicator B can assign scores between 1 and 40; and they'll both have a first, second, third, fourth place, etc. These places then get translated into award points.

Award Points

Award points are handed out based on ranking against other dancers for that adjudicator. I obtained these values from a FeisWorx results page for my kid:

RankingAward Points

If there's a 2-way, 3-way, or n-way tie, all tied dancers get the average of the next 2, 3, or n award points, and the next 2, 3, or n rankings are skipped.

Award Points artifacts

One quirk of awards points is that for any given overall score, there are only a handful of possible judge rankings that could have led to it. That means you can make some guesses about how each judge ranked an individual dancer, based on only their total award points.

Here's a handy calculator! It (currently) doesn't consider the possibility of a tie.

CLRG Award Points Speculator
Points:
Possible Rankings
Computing: this could take a while!

What's with these values?

At first glance, the award points look like the output of an exponential function.

{{

}}

In an effort to figure out where these numbers came from, I ran some curve fitting against the data. Here's the best I could come up with:

Ranking range Award Points Function Type of function
1 - 11 100 * x^-0.358 Exponential
12 - 50 51 - x Linear
51 - 60 14.2 - 0.46x + 0.00385x Polynomial
61 - 100 1 - x/100 Linear

If you, dear reader, are a mathematician, I would love to hear your thoughts on why they went with this algorithm.

There are a few points to note here:

  • 1st place is a huge deal. Disproportionately huge.
  • Places 2-10 are similarly big deals compared to places 3-11.
  • Places 12-50 operate the way most people probably assume ranking works: linearly.
  • Places 51-60 are a second degree polynomial, but it doesn't matter much for so few points.
  • Places 61-100 are all less than 1 point. If you're a judge trying to tank a top dancer, anywhere in this range is equivalent to anywhere else.

Consequences of Exponential Award Points

Playing around with this, I've found a few interesting consequences of the exponential growth in the top 11 places.

1st place is super important

1st place is weighted so heavily that it's almost impossible to overcome without your own 1st.

Take for example this scenario, in which Adjudicator 1 has promised to give 1st place to Alice:

Alice Bob
Adj. 1
Adj. 2
Adj. 3
Award Points
Ranking