ISU Posts "Calculation Error" in GPF FD

Discussion in 'Great Skate Debate' started by soxxy, Dec 29, 2011.

  1. soxxy

    soxxy Guest

  2. Louise

    Louise Banned Member

    560
    73
    0
    Oh boy, can you imagine if this happened a couple weeks after the Olympics and the results were different? Not good. Reminds me somewhat of how Hamm won his all around Oly title by mathematical error.
     
  3. peibeck

    peibeck Letting Poje be on top

    17,289
    5,347
    113
    Hmmm, I wonder how could the calculation error have been in the program for only one comp?

    I foresee lots of :drama: already.
     
  4. Lacey

    Lacey Well-Known Member

    9,001
    873
    113
    Wow, just wow.
     
  5. Japanfan

    Japanfan Well-Known Member

    13,003
    1,801
    113
    Scott Moir must be feeling very vindicated and having a very good day.

    What does 'previous' mean? It would seem it refers to a rule change that was implemented this season? In that case, might there not be calculation errors in other programs as well?
     
    PeterG and (deleted member) like this.
  6. The Accordion

    The Accordion Well-Known Member

    3,459
    899
    113
    Aha! A pissoff!
     
  7. aka_gerbil

    aka_gerbil Rooting for the Underdogs

    1,589
    134
    0
    It seems that the GOE for combination lifts was changed in the rules between last season and this season, but that change somehow didn't make it into the sekret computer.

    They said that they went back through other results from this season and didn't find another instance where the miscalculation affected the placements.
     
  8. shuilee

    shuilee Well-Known Member

    3,167
    122
    63
    I wonder if Weaver & Poje should have won NHK gold medal over Shibs because of the computer bug.....they did lose by 0.1...they'll have to review all the competitions this year!

    Hopefully someone knows more about the details of this error. What element specifically was it, and did they use the wrong GoE multiplication factor, etc?
     
  9. caseyedwards

    caseyedwards Well-Known Member

    6,573
    276
    83
    Interesting! So D/W has been beaten this season in something! VM is closer.
     
    Last edited: Dec 29, 2011
  10. modern_muslimah

    modern_muslimah Thinking of witty user title and coming up blank

    3,970
    495
    83
    V/M and D/W were always very close this season. The difference would've been 0.5 points. Either way, these two teams are going to be neck and neck the entire season and probably all the way to Sochi.
     
    flutzilla1 and (deleted member) like this.
  11. Louise

    Louise Banned Member

    560
    73
    0
    RIGHT!!! :rofl::rofl::rofl::rofl:
     
  12. danafan

    danafan Canadian ladies ├╝ber

    3,653
    821
    113
    Placements, sure but what about accurate season and personal best scores? Will they be corrected?

    Is there any current avenue for skaters or coaches to protest such errors in relative real time?
     
  13. overedge

    overedge Well-Known Member

    18,189
    2,768
    113
    And I believe that fairies live in the woods and that Donald Trump is going to give me all his money tomorrow.
     
  14. iggie

    iggie Well-Known Member

    1,452
    91
    48
    they only did random checks of previous events, nothing thorough.
     
  15. Macassar88

    Macassar88 Well-Known Member

    1,843
    123
    63
    Weaver and Poje did two simple lifts instead of a combo
     
  16. Jenna

    Jenna Well-Known Member

    7,139
    313
    83
    Interesting...

    Imagine if it changed the overall result. I just can't believe things like this happen..
     
  17. aka_gerbil

    aka_gerbil Rooting for the Underdogs

    1,589
    134
    0
    I should have read a little closer.

    As for the rest of it, I said that they said they checked. Not that they actually did. :p

    At any rate, I'm sure everyone, their dog, and their grandmother are re-checking their scores themselves if they think they might benefit.

    I wonder what else is wrong in the computer...
     
  18. Aussie Willy

    Aussie Willy Well-Known Member

    18,142
    2,173
    113
    It would be a simple matter of once you have changed the particular value in the system that you then it would automatically recalculate the results for each event that this applied to. So it is quite feasible that they haven't found any other problems with other events.

    However many updates do get issued during the year for the software with various adjustments and corrections. So it is not unusual for this to happen.
     
  19. iggie

    iggie Well-Known Member

    1,452
    91
    48
    feasible, but this is what the isu wrote:
     
  20. overedge

    overedge Well-Known Member

    18,189
    2,768
    113
    So how are the ice dancers supposed to be reassured by a "random check"? What if a team's result is wrong and it wasn't one of the results that was randomly chosen? What if a team's placement is correct but the actual score isn't? Yet again, the ISU acts like everyone is supposed to be satisfied with what is really a completely inadequate response.

    The ISU needs to go back and recalculate the results of every program in every competition where the sekret computer was programmed with this error. It's the only fair way to resolve the situation.
     
  21. kwanfan1818

    kwanfan1818 I <3 Kozuka

    20,930
    3,798
    113
    Any dance team who is concerned and to whom it is applicable will check their own protocols and raise the issue if there is one, especially if the scores could be borderline for making the GP minimum (not yet set for 2012) or top 24 SB.

    ETA: A random check is the usual test done for transactions that are calculated before a change was made, to confirm that the old calculations are valid.
     
    Last edited: Dec 29, 2011
  22. love_skate2011

    love_skate2011 Well-Known Member

    1,627
    134
    63
    hmmm. interesting
    anybody by how many points
    maybe they will post a corrected result. lol
     
  23. The Accordion

    The Accordion Well-Known Member

    3,459
    899
    113
    LUCKY! :)
     
  24. overedge

    overedge Well-Known Member

    18,189
    2,768
    113
    Random sampling may be the usual method of testing, but random sampling is not appropriate in situations like this, because of the potential consequences associated with results that weren't chosen in the sample.
     
  25. Japanfan

    Japanfan Well-Known Member

    13,003
    1,801
    113
    ITA.

    But didn't this check apply to programs skated after the change was made?

    It's true that any teams which were affected will let the ISU show and request an adjustment. However, the ISU is responsible to thoroughly investigate the issue as the ISU made the mistake. I would think it is very easy for them to search their records and identify the teams which did a combination lift, then examine the scores.
     
  26. kwanfan1818

    kwanfan1818 I <3 Kozuka

    20,930
    3,798
    113
    Testing works on the same principal as an audit: a small sample checked is indicative of the whole.

    There are at least two possibilities for what they did, and since the ISU is inarticulate in general about what it is doing, it's hard to tell exactly what the circumstances are.

    For example, it's possible that the correct GOE (variable) was in the system before a change was made, reverting it to the old value. Part of regression testing after the variable is corrected is to do a random test among data that should not be changed, to be sure they haven't changed.

    Another possibility is that they changed a global reference used each time the element appeared in the records or, more likely, through an update script that recalculated either all entries in the database for that element using the new GOE variable.

    Before a script is run, they likely would do a query to see how many records should be updated.

    Then they'd run a script like: Where Element = [Lift Abbreviation] recalculate element score using new GOE info and then calculate new final score.

    The script returns stats such as the number of records updated with the matching criteria, which is compared to the original query. If 153 records matched the query, and 153 records were updated, the assumption is the update worked. They could also capture the old and new scores and compare them in a report.

    If there were hundreds of entries using that element, they would randomly check a subset of those entries, because if the script worked for one, and on the correct number of records, it should work the same way for them all.
     
  27. manhn

    manhn Well-Known Member

    9,456
    2,071
    113
    I don't know. I can imagine the media/public reaction had the error occurred in a bigger event like Worlds or the Olympics--not that the GPF is exactly tiny--if Cinquata said "Well, this is how accountants do it!"
     
  28. kwanfan1818

    kwanfan1818 I <3 Kozuka

    20,930
    3,798
    113
    Accountants are good enough for Miss America :) (And "Battle of the Blades".) But, of course, accountants aren't the only people who do internal audits. They'd have to say, "Google does it this way."
     
  29. casken

    casken Well-Known Member

    6,780
    1,085
    113
    Well this explains the sudden reemergence of combo lifts in Shpilband FD's.
     
  30. DORISPULASKI

    DORISPULASKI Watching submarine races

    9,924
    1,442
    113
    But it doesn't explain why no one noticed the scores were wrongt after the first competitions of the year and complain publicly.

    In each calculation, the high & low judge's score is dropped, so for counting scores at Skate America, D&W's rotational lift got 5.5, with all 3's, base level 4.0. So max GOE 1.5, and for two such lifts, 11.0.

    P&B's combo lift got 9.70 with all twos, on a base level of 8. That's .85 per GOE level, so you can extrapolate that for all 3's, a combo lift would have a GOE of 2.55, and the max score 10.55 rounded down to 10.5, for a perfect combo lift.

    So you could see the scoring was the same as last year at the very first event of the season.


    In fact, looking at any combo lift, you could see that the GOE given was less than the average of the scores given, meaning that the GOE had not been corrected to give +3 for a perfect lift (it still was 2.5). All 1's would give +.85, rather than 1.0, as it now should.

    And that it did not affect just V&M, but every skater at every level that included a combo lift in their program, at every event using the sportcentric software.

    (And in fact, I made such a check at that time, and thought, I guess they decided not to fix the lift scoring discrepancy, rather than thinking the program was not fixed)
     
    Last edited: Dec 29, 2011