Ok, so The Toy wasn't something that was just recently introduced. Evidently this name has been around for quite some time. So, we'll just stick with that.
Anyways, in another topic the idea that the ratings could be flawed because of arbitrary numbers that are sometimes assigned to teams. Since someone (now, me) does have to set up the pre-season rankings, which @granger agrees are "just a guess... nothing more. something to get the system started", I wondered how much affect that might have on the outcome of the rankings, especially this late in the season. It's worth noting that the pre-season rankings are the only time the ratings are altered by a human. After that, it's all left up to The
Anyways, since I'm new to the internal workings of the rankings, and really wanted to answer this question for myself just as much as for anyone else, I decided to run a few tests.
Because the schools being discussed in the topic that sparked this idea were the top 3 schools in division 2, the schools being altered for the tests are Motley County, Strawn, and Richland Springs. No other school's rating, or rank, was changed from what it was to start this season.
The results show the school's rating in comparison to what their rating is at the time of this post. In other words, the results show what the outcome would be at this exact point in the season had I interfered more with the pre-season data, as compared to the way they are currently on the site.
For the first test, I took 200 points off of each of the top 3 D2 schools' (Motley, Strawn, Richland) pre-season rating. Keep in mind this is the only time that the rankings are altered by human at any point during the season, and 200 points would be a very dramatic decrease that simply wouldn't happen. I wouldn't lower a school by 200 points even if I knew they were losing all 6 starters. Anyways, I then re-ran the rankings as I normally would.
Motley County's rating dropped from a 391.9 to a 378.83. Oddly enough, though, this would have them sitting at 2nd overall instead of 3rd.
Strawn dropped from 368.78 to 358.08. Their overall dropped from #7 to #10.
Richland Springs went from 351.82 to a 347.99 and their remained the same at #18.
Next I removed 100 points from each of the schools.
This time Motley County dropped from 391.9 to 383.76. Their overall ranking remained unchanged at #3.
Strawn went from 368.78 to 362.29 and their ranking fell from #7 to #9.
Richland Springs went from 351.82 to 350.21 and their ranking rose from #18 to #17.
In the next test I changed Motley County's rating to a 59, which would put them in last place to start the season.
In this test Motley County's rating ended up being a 381.25 (-10.65), and they (again) went from #3 to #2 overall.
Because of the affect that Motley's lower ranking had on other teams, Strawn's rating also went down to 361.19 (-7.59) and they fell from #7 to #8 overall.
Richland Springs also took a slight hit to their rating, lowering them to 350.34 (-1.48), and bringing them up (again) to #17.
In the final test I kept Motley County at a 59 rating (last place overall). Then I bumped Strawn up 100 points, putting them well into 1st place overall.
This time Motley County landed at a 383.67 (-8.23) and #2 overall.
Strawn ended up with a 377.25 (+8.47) and was sitting at #4 overall.
Richland Springs got a 355.56 (+3.74) and was sitting at #17 overall.
So, to summarize, I'd say human interaction has very little affect on the rankings, especially as the season progresses. The fact that there was less than a 4% change in all ratings, even with very drastic changes to the pre-season ratings should put to bed the idea that The
I think it's fair to say that what matters to The