Event 3
Teams
The submission window was June 15-16, 2023.
Scoring
Division 1, 2, and 3 rankings will be determined based upon the total score (Market Surplus, zms in the Formulation Document). Only zms values that are positive for feasible solutions will be counted. All other results will be treated as 0.0.
Division 4, 5, and 6 rankings are based on the count of top scores for each scenario in Divisions 1, 2, and 3.
See the Scoring document for details. Only Divisions 1- 3 will receive prizes in Event 3.
Leaderboard Rankings
Ensemble is the set of best scores for the grouping. The Sum of all scores column is provided for comparison. There are prizes in 6 categories. Note on the 23,643-bus network: No team achieved a positive zms value within the normal time limits (10-min, 2- and 4-hours) so qualified teams (ones without errors) were rerun with an extended 72-hour time limit. This resulted in some positive values for Division 1 but not for Divisions 2 or 3.
The original scores were posted June 27, 2023 and updated July 5, 2023 after further analysis (no prize positions changed).
| rank | Team | Division 1 Score | rank | Team | Division 2 Score | rank | Team | Division 3 Score | rank | Team | Total Score |
| Ensemble | 8,366,505,894.08 | Ensemble | 45,392,323,039.87 | Ensemble | 119,081,057,736.73 | Ensemble | 172,839,886,670.68 | ||||
| 1 ($50k) | YongOptimization | 7,606,138,398.62 | 1 ($50k) | GravityX | 44,872,372,904.66 | 1 ($50k) | GOT-BSI-OPF | 117,254,151,916.59 | 1 | GravityX | 166,290,652,929.77 |
| 2 ($45k) | GOT-BSI-OPF | 6,006,599,759.55 | ARPA-e Benchmark | 43,957,716,246.18 | 2 ($45k) | Electric-Stampede | 117,096,274,302.41 | ARPA-e Benchmark | 165,346,802,801.11 | ||
| 3 ($40k) | TIM-GO | 5,940,683,381.40 | 2 ($45k) | YongOptimization | 43,053,048,132.25 | 3 ($40k) | GravityX | 116,616,725,305.77 | 2 | Electric-Stampede | 165,241,066,949.84 |
| 4 ($35k) | Electric-Stampede | 5,613,382,812.56 | 3 ($40k) | Artelys_Columbia | 42,723,304,643.63 | 4 ($35k) | TIM-GO | 116,247,981,958.14 | 3 | GOT-BSI-OPF | 164,845,906,519.46 |
| ARPA-e Benchmark | 5,597,348,953.39 | 4 ($35k) | Electric-Stampede | 42,531,409,834.87 | ARPA-e Benchmark | 115,791,737,601.53 | 4 | Artelys_Columbia | 162,042,513,091.29 | ||
| 5 ($30k) | GravityX | 4,801,554,719.34 | 5 ($30k) | GOT-BSI-OPF | 41,585,154,843.32 | 5 ($30k) | Artelys_Columbia | 115,051,119,529.63 | 5 | YongOptimization | 159,412,655,667.69 |
| 6 | Artelys_Columbia | 4,268,088,918.03 | 6 | TIM-GO | 31,177,177,783.85 | 6 | YongOptimization | 108,753,469,136.82 | 6 | TIM-GO | 153,365,843,123.39 |
| 7 | The Blackouts | 3,423,331,947.08 | 7 | The Blackouts | 27,970,766,364.91 | 7 | The Blackouts | 55,728,033,177.80 | 7 | The Blackouts | 87,122,131,489.79 |
| 8 | LLGoMax | 2,420,831,208.22 | 8 | LLGoMax | 12,878,766,096.67 | 8 | LLGoMax | 28,571,412,154.26 | 8 | LLGoMax | 43,871,009,459.15 |
| 9 | Gatorgar | 909,330,224.59 | 9 | Gatorgar | 7,374,196,735.08 | 9 | Gatorgar | 26,089,373,562.80 | 9 | Gatorgar | 34,372,900,522.47 |
| 10 | Argonauts | 12,509,120.78 | 10 | quasiGrad | 2,351,133,176.70 | 10 | Argonauts | 6,744,007,362.14 | 10 | Argonauts | 8,777,331,942.38 |
| 11 | PACE | 0.00 | 11 | Argonauts | 2,020,815,459.46 | 11 | quasiGrad | 965,678,384.51 | 11 | quasiGrad | 3,316,811,561.21 |
| PGWOpt | 0.00 | 12 | PACE | 0.00 | 12 | PACE | 0.00 | 12 | PACE | 0.00 | |
| quasiGrad | 0.00 | PGWOpt | 0.00 | PGWOpt | 0.00 | PGWOpt | 0.00 |
Best scores will not be used in the awarding of prizes for Event 3, as stated in the scoring document. They will be used in Event 4. In the event of a tie, the amount available to the tied positions will be shared.
| rank | Team | Division 4 Firsts | rank | Team | Division 5 Firsts | rank | Team | Division 6 Firsts | rank | Team | Total Firsts |
| 1 | YongOptimization | 22 | 1 | GOT-BSI-OPF | 37 | 1 | GOT-BSI-OPF | 26 | 1 | GOT-BSI-OPF | 69 |
| 2 | GravityX | 9 | 2 | TIM-GO | 8 | 2 | GravityX | 3 | 2 | YongOptimization | 24 |
| 3 | GOT-BSI-OPF | 6 | 3 | GravityX | 5 | TIM-GO | 3 | 3 | GravityX | 17 | |
| TIM-GO | 6 | 4 | Artelys_Columbia | 2 | 4 | The Blackouts | 2 | TIM-GO | 17 | ||
| 5 | Electric-Stampede | 2 | 5 | Electric-Stampede | 1 | 5 | Artelys_Columbia | 1 | 5 | The Blackouts | 4 |
| 6 | The Blackouts | 1 | The Blackouts | 1 | YongOptimization | 1 | 6 | Artelys_Columbia | 3 | ||
| 7 | Argonauts | 0 | YongOptimization | 1 | 7 | Argonauts | 0 | Electric-Stampede | 3 | ||
| Artelys_Columbia | 0 | 8 | Argonauts | 0 | Electric-Stampede | 0 | 8 | Argonauts | 0 | ||
| Gatorgar | 0 | Gatorgar | 0 | Gatorgar | 0 | Gatorgar | 0 | ||||
| LLGoMax | 0 | LLGoMax | 0 | LLGoMax | 0 | LLGoMax | 0 | ||||
| PACE | 0 | PACE | 0 | PACE | 0 | PACE | 0 | ||||
| PGWOpt | 0 | PGWOpt | 0 | PGWOpt | 0 | PGWOpt | 0 | ||||
| quasiGrad | 0 | quasiGrad | 0 | quasiGrad | 0 | quasiGrad | 0 |
The following lists the number of times a team produced a Top 5 result when the Benchmark is excluded. Note that some scenarios did not have 5 non-zero results. The fact that 10 of the 13 competing teams achieved a top 5 result speaks to the quality of the competing teams.
| Team | Top 5 Scores |
| GravityX | 117 |
| GOT-BSI-OPF | 112 |
| Electric-Stampede | 106 |
| TIM-GO | 104 |
| YongOptimization | 103 |
| Artelys_Columbia | 46 |
| The Blackouts | 46 |
| Gatorgar | 21 |
| LLGoMax | 4 |
| quasiGrad | 2 |
Prizes
Event 3 prizes are subject to review and approval by ARPA-E.
| Team | $k |
| GOT-BSI-OPF | 125 |
| GravityX | 120 |
| Electric-Stampede | 115 |
| YongOptimization | 95 |
| TIM-GO | 75 |
| Artelys_Columbia | 70 |
| total | 600 |
Metrics
Other metrics also provide insight into the performance of the teams.
Scaled Scores
In this next table, a scaled score is the scenario score as in Divisions 1-3, but divided by the best score (Benchmark is excluded) for that scenario before summing. This gives more weight to the smaller problems. The ensemble score becomes the number of scenarios being summed and is not given.
| D1 rank | Team | Div. 1 Scaled Score | D2 rank | Team | Div. 2 Scaled Score | D3 rank | Team | Div. 3 Scaled Score | rank | Team | Total Scaled Score |
| 1 | TIM-GO | 41.29 | 1 | GravityX | 54.58 | 1 | GOT-BSI-OPF | 35.89 | 1 | TIM-GO | 125.55 |
| 2 | YongOptimization | 40.09 | ARPA-e Benchmark | 53.59 | 2 | Electric-Stampede | 35.37 | ARPA-e Benchmark | 124.11 | ||
| 3 | Electric-Stampede | 37.50 | 2 | GOT-BSI-OPF | 53.27 | 3 | GravityX | 35.23 | 2 | Electric-Stampede | 124.01 |
| ARPA-e Benchmark | 35.62 | 3 | YongOptimization | 51.38 | ARPA-e Benchmark | 34.89 | 3 | GOT-BSI-OPF | 123.15 | ||
| 4 | GOT-BSI-OPF | 33.99 | 4 | Electric-Stampede | 51.14 | 4 | TIM-GO | 34.68 | 4 | YongOptimization | 123.08 |
| 5 | GravityX | 31.25 | 5 | Artelys_Columbia | 50.66 | 5 | Artelys_Columbia | 34.04 | 5 | GravityX | 121.07 |
| 6 | Artelys_Columbia | 30.90 | 6 | TIM-GO | 49.58 | 6 | YongOptimization | 31.60 | 6 | Artelys_Columbia | 115.60 |
| 7 | The Blackouts | 21.88 | 7 | The Blackouts | 36.93 | 7 | The Blackouts | 27.33 | 7 | The Blackouts | 86.14 |
| 8 | LLGoMax | 4.26 | 8 | Gatorgar | 11.70 | 8 | Gatorgar | 12.75 | 8 | Gatorgar | 25.21 |
| 9 | Gatorgar | 0.76 | 9 | Argonauts | 11.60 | 9 | Argonauts | 10.08 | 9 | Argonauts | 21.96 |
| 10 | Argonauts | 0.28 | 10 | LLGoMax | 5.82 | 10 | LLGoMax | 2.34 | 10 | LLGoMax | 12.42 |
| 11 | PACE | 0 | 11 | quasiGrad | 4.58 | 11 | quasiGrad | 1.00 | 11 | quasiGrad | 5.58 |
| PGWOpt | 0 | 12 | PACE | 0 | 12 | PACE | 0 | 12 | PACE | 0 | |
| quasiGrad | 0 | PGWOpt | 0 | PGWOpt | 0 | PGWOpt | 0 |
Top 5 Results for Every Scenario
Following is the list of scenarios used by Event 3 and the scores and times for the 5 best performers on each scenario. Benchmark results have been excluded except for the very last scenario where it came in last. Some scenarios did not have 5 positive results and those cases are left empty. The column on the right, where the best result is divided by the second best result and added to minus one, gives an estimate of how difficult the scenario is based on the assumption that two teams producing close results is easier than than one where the results are not as close. The values range from 4.08e-1 (hard) to 2.40e-5 (easy), a spread of four orders of magnitude. The 30 scenarios with SW=0 (column 3) did not allow switching; all others, SW=1, do allow switching. Most teams did not attempt to use switching and their results in the two cases should be the same, which is a metric of the reproducibility of results on this platform.
We are leaving all of the scenarios in the Sandbox (reference E3.1) in preparation for Event 4. The 6708-bus system is taken from industry and, while available in the Sandbox, only the zms will be made available after a run and it will not be included in any downloadable file.
| model | SW | best team | best score | sec. used | 2nd best team | 2nd best score | sec. used | 3rd best team | 3rd best score | sec. used | 4th best team | 4th best score | sec. used | 5th best team | 5th best score | sec. used | s1/s2 - 1 | |
| C3E3N00073D2 | 231 | 1 | GOT-BSI-OPF | 149,123,373 | 54 | Gatorgar | 148,902,872 | 5,507 | Electric-Stampede | 148,803,593 | 65 | TIM-GO | 148,699,691 | 56 | YongOptimization | 148,558,393 | 40 | 1.48E-03 |
| C3E3N00073D2 | 232 | 1 | GOT-BSI-OPF | 168,147,580 | 60 | Electric-Stampede | 167,939,992 | 52 | TIM-GO | 167,853,578 | 57 | GravityX | 167,639,766 | 47 | The Blackouts | 167,416,625 | 7,204 | 1.24E-03 |
| C3E3N00073D2 | 233 | 1 | GOT-BSI-OPF | 231,488,013 | 64 | TIM-GO | 231,177,150 | 60 | Gatorgar | 230,985,199 | 3,569 | Electric-Stampede | 230,862,785 | 55 | The Blackouts | 230,832,460 | 1,124 | 1.34E-03 |
| C3E3N00073D2 | 236 | 1 | GravityX | 165,829,559 | 50 | GOT-BSI-OPF | 165,808,466 | 46 | Gatorgar | 165,788,531 | 3,728 | Electric-Stampede | 165,475,573 | 42 | TIM-GO | 165,424,540 | 70 | 1.27E-04 |
| C3E3N00073D2 | 237 | 1 | GOT-BSI-OPF | 166,893,856 | 43 | Electric-Stampede | 166,670,485 | 37 | GravityX | 166,610,061 | 51 | TIM-GO | 166,556,493 | 57 | The Blackouts | 166,165,876 | 7,221 | 1.34E-03 |
| C3E3N00073D2 | 238 | 1 | GOT-BSI-OPF | 168,841,652 | 50 | TIM-GO | 168,490,517 | 63 | Gatorgar | 168,369,441 | 3,795 | YongOptimization | 168,286,617 | 39 | The Blackouts | 168,132,698 | 7,209 | 2.08E-03 |
| C3E3N00073D2 | 241 | 1 | GOT-BSI-OPF | 148,898,189 | 56 | Gatorgar | 148,699,013 | 4,176 | Electric-Stampede | 148,688,412 | 45 | GravityX | 148,539,449 | 49 | TIM-GO | 148,529,907 | 53 | 1.34E-03 |
| C3E3N00073D2 | 242 | 1 | GOT-BSI-OPF | 168,085,572 | 50 | Electric-Stampede | 167,918,576 | 44 | TIM-GO | 167,779,022 | 57 | GravityX | 167,773,033 | 48 | Gatorgar | 167,702,775 | 4,036 | 9.95E-04 |
| C3E3N00073D2 | 243 | 1 | GOT-BSI-OPF | 231,013,539 | 42 | TIM-GO | 230,800,294 | 61 | Electric-Stampede | 230,719,458 | 42 | Gatorgar | 230,600,556 | 4,236 | GravityX | 230,499,308 | 48 | 9.24E-04 |
| C3E3N00073D2 | 246 | 1 | GOT-BSI-OPF | 163,364,785 | 43 | Gatorgar | 163,312,997 | 3,741 | GravityX | 163,189,858 | 49 | TIM-GO | 162,974,662 | 58 | The Blackouts | 162,592,132 | 7,214 | 3.17E-04 |
| C3E3N00073D2 | 247 | 1 | GOT-BSI-OPF | 164,090,827 | 40 | GravityX | 163,694,922 | 48 | TIM-GO | 163,656,858 | 59 | The Blackouts | 163,361,748 | 7,212 | Electric-Stampede | 163,314,414 | 46 | 2.42E-03 |
| C3E3N00073D2 | 248 | 1 | GOT-BSI-OPF | 166,080,970 | 77 | TIM-GO | 165,649,948 | 69 | Gatorgar | 165,601,632 | 4,706 | YongOptimization | 165,567,105 | 34 | The Blackouts | 165,380,042 | 7,205 | 2.60E-03 |
| C3E3N00073D3 | 231 | 1 | GOT-BSI-OPF | 537,501,355 | 34 | Electric-Stampede | 536,889,862 | 62 | Gatorgar | 536,616,064 | 3,078 | TIM-GO | 536,269,999 | 54 | GravityX | 536,077,088 | 42 | 1.14E-03 |
| C3E3N00073D3 | 232 | 1 | GOT-BSI-OPF | 575,003,114 | 50 | Gatorgar | 574,286,828 | 2,847 | Electric-Stampede | 574,045,828 | 39 | TIM-GO | 573,702,676 | 55 | GravityX | 573,591,734 | 42 | 1.25E-03 |
| C3E3N00073D3 | 233 | 1 | GOT-BSI-OPF | 777,215,141 | 56 | TIM-GO | 776,479,451 | 96 | GravityX | 776,039,514 | 41 | Electric-Stampede | 775,480,670 | 36 | Gatorgar | 774,847,826 | 3,287 | 9.47E-04 |
| C3E3N00073D3 | 236 | 1 | GOT-BSI-OPF | 482,194,945 | 40 | Gatorgar | 482,164,315 | 2,676 | GravityX | 481,701,280 | 42 | TIM-GO | 480,732,796 | 56 | Electric-Stampede | 480,250,134 | 35 | 6.35E-05 |
| C3E3N00073D3 | 237 | 1 | GOT-BSI-OPF | 484,569,630 | 49 | Gatorgar | 483,679,956 | 2,809 | GravityX | 483,233,868 | 43 | Electric-Stampede | 482,751,732 | 34 | TIM-GO | 482,684,697 | 56 | 1.84E-03 |
| C3E3N00073D3 | 238 | 1 | GOT-BSI-OPF | 489,118,994 | 45 | YongOptimization | 488,385,429 | 24 | Gatorgar | 488,352,073 | 2,969 | GravityX | 488,036,577 | 44 | TIM-GO | 487,143,605 | 57 | 1.50E-03 |
| C3E3N00073D3 | 241 | 1 | GOT-BSI-OPF | 534,208,541 | 39 | Gatorgar | 533,552,130 | 2,886 | GravityX | 533,379,382 | 42 | Electric-Stampede | 532,878,432 | 39 | TIM-GO | 532,835,732 | 53 | 1.23E-03 |
| C3E3N00073D3 | 242 | 1 | GOT-BSI-OPF | 571,853,170 | 35 | Gatorgar | 571,476,292 | 3,011 | GravityX | 571,299,913 | 42 | Electric-Stampede | 571,016,181 | 35 | TIM-GO | 570,369,432 | 72 | 6.59E-04 |
| C3E3N00073D3 | 243 | 1 | GOT-BSI-OPF | 772,893,900 | 39 | GravityX | 772,504,137 | 44 | TIM-GO | 772,299,585 | 56 | Gatorgar | 771,169,312 | 2,646 | The Blackouts | 770,413,001 | 1,986 | 5.05E-04 |
| C3E3N00073D3 | 246 | 1 | GOT-BSI-OPF | 594,171,826 | 38 | Gatorgar | 593,777,983 | 2,613 | GravityX | 593,473,994 | 41 | TIM-GO | 592,872,428 | 98 | The Blackouts | 591,686,542 | 14,430 | 6.63E-04 |
| C3E3N00073D3 | 247 | 1 | GOT-BSI-OPF | 597,784,445 | 52 | Gatorgar | 596,660,892 | 3,253 | TIM-GO | 596,589,734 | 59 | GravityX | 595,935,972 | 42 | The Blackouts | 595,058,158 | 7,914 | 1.88E-03 |
| C3E3N00073D3 | 248 | 1 | GOT-BSI-OPF | 601,977,226 | 55 | TIM-GO | 600,916,978 | 63 | Gatorgar | 600,812,688 | 3,013 | GravityX | 600,371,957 | 41 | YongOptimization | 600,331,653 | 21 | 1.76E-03 |
| C3E3N00617D1 | 1 | 1 | GravityX | 45,283,533 | 117 | YongOptimization | 45,279,189 | 42 | TIM-GO | 45,274,759 | 102 | GOT-BSI-OPF | 44,798,078 | 36 | Artelys_Columbia | 44,510,108 | 95 | 9.59E-05 |
| C3E3N00617D2 | 1 | 1 | GravityX | 275,911,451 | 296 | YongOptimization | 275,864,132 | 241 | TIM-GO | 275,737,343 | 205 | The Blackouts | 275,363,223 | 7,218 | quasiGrad | 274,627,236 | 7,099 | 1.72E-04 |
| C3E3N00617D3 | 1 | 1 | GravityX | 967,609,873 | 345 | The Blackouts | 967,586,640 | 14,408 | YongOptimization | 967,434,056 | 158 | GOT-BSI-OPF | 967,322,206 | 50 | TIM-GO | 967,087,142 | 184 | 2.40E-05 |
| C3E3N01576D1 | 27 | 1 | TIM-GO | 100,953,249 | 381 | GOT-BSI-OPF | 99,005,474 | 123 | Electric-Stampede | 98,008,234 | 363 | LLGoMax | 97,817,486 | 19 | YongOptimization | 97,443,913 | 42 | 1.97E-02 |
| C3E3N01576D2 | 27 | 1 | TIM-GO | 564,297,765 | 861 | YongOptimization | 551,568,231 | 162 | GravityX | 546,973,916 | 941 | Artelys_Columbia | 528,889,280 | 1,866 | Electric-Stampede | 498,408,879 | 6,473 | 2.31E-02 |
| C3E3N01576D2 | 31 | 1 | TIM-GO | 476,493,812 | 946 | YongOptimization | 456,192,781 | 168 | GravityX | 455,489,718 | 999 | Artelys_Columbia | 447,073,685 | 1,820 | Electric-Stampede | 426,618,211 | 6,193 | 4.45E-02 |
| C3E3N01576D2 | 32 | 1 | TIM-GO | 639,899,314 | 1,071 | YongOptimization | 622,321,015 | 134 | GravityX | 617,019,219 | 1,033 | Artelys_Columbia | 606,669,858 | 2,036 | GOT-BSI-OPF | 587,841,311 | 394 | 2.82E-02 |
| C3E3N01576D2 | 33 | 1 | TIM-GO | 939,975,921 | 887 | GravityX | 930,175,962 | 1,006 | YongOptimization | 913,781,285 | 146 | Artelys_Columbia | 907,737,834 | 2,608 | Electric-Stampede | 884,190,524 | 5,590 | 1.05E-02 |
| C3E3N01576D2 | 36 | 1 | TIM-GO | 649,374,891 | 896 | YongOptimization | 645,348,766 | 142 | GravityX | 637,730,426 | 910 | Artelys_Columbia | 624,676,007 | 2,230 | Electric-Stampede | 600,376,123 | 6,041 | 6.24E-03 |
| C3E3N01576D2 | 41 | 1 | TIM-GO | 473,592,026 | 978 | YongOptimization | 453,171,417 | 180 | GravityX | 452,578,396 | 942 | Artelys_Columbia | 447,208,129 | 1,857 | quasiGrad | 422,689,119 | 6,310 | 4.51E-02 |
| C3E3N01576D2 | 42 | 1 | TIM-GO | 636,763,019 | 939 | YongOptimization | 623,630,988 | 132 | GravityX | 619,458,800 | 921 | Artelys_Columbia | 610,131,227 | 1,877 | Electric-Stampede | 592,425,500 | 2,720 | 2.11E-02 |
| C3E3N01576D2 | 43 | 1 | TIM-GO | 937,483,054 | 942 | GravityX | 931,152,043 | 926 | YongOptimization | 913,226,314 | 142 | Artelys_Columbia | 907,759,204 | 2,601 | GOT-BSI-OPF | 834,401,687 | 207 | 6.80E-03 |
| C3E3N01576D3 | 27 | 1 | TIM-GO | 1,902,536,789 | 882 | Artelys_Columbia | 1,870,128,427 | 1,429 | Electric-Stampede | 1,848,144,169 | 2,449 | YongOptimization | 1,847,204,221 | 150 | GravityX | 1,838,699,537 | 1,032 | 1.73E-02 |
| C3E3N04224D1 | 131 | 1 | YongOptimization | 90,179,983 | 69 | GravityX | 88,629,206 | 255 | GOT-BSI-OPF | 86,030,271 | 108 | TIM-GO | 83,047,781 | 411 | Electric-Stampede | 80,126,336 | 102 | 1.75E-02 |
| C3E3N04224D1 | 131 | 0 | YongOptimization | 90,178,854 | 69 | GravityX | 88,629,206 | 257 | GOT-BSI-OPF | 86,030,271 | 111 | TIM-GO | 83,047,320 | 415 | Electric-Stampede | 80,126,336 | 64 | 1.75E-02 |
| C3E3N04224D1 | 132 | 1 | YongOptimization | 93,039,506 | 66 | GravityX | 91,199,461 | 242 | GOT-BSI-OPF | 89,738,658 | 120 | TIM-GO | 86,881,471 | 394 | Electric-Stampede | 84,005,963 | 79 | 2.02E-02 |
| C3E3N04224D1 | 132 | 0 | YongOptimization | 93,030,819 | 66 | GravityX | 91,105,795 | 237 | GOT-BSI-OPF | 89,738,658 | 131 | TIM-GO | 86,905,526 | 389 | Electric-Stampede | 84,005,963 | 97 | 2.11E-02 |
| C3E3N04224D1 | 133 | 1 | GOT-BSI-OPF | 122,522,087 | 116 | GravityX | 121,423,489 | 253 | YongOptimization | 115,399,847 | 67 | TIM-GO | 114,650,165 | 385 | Artelys_Columbia | 112,462,138 | 573 | 9.05E-03 |
| C3E3N04224D1 | 133 | 0 | GOT-BSI-OPF | 122,522,087 | 116 | GravityX | 121,423,656 | 264 | YongOptimization | 115,383,630 | 67 | TIM-GO | 114,646,660 | 397 | Artelys_Columbia | 112,460,436 | 577 | 9.05E-03 |
| C3E3N04224D1 | 136 | 1 | YongOptimization | 93,363,716 | 66 | GOT-BSI-OPF | 90,608,771 | 130 | GravityX | 89,317,510 | 250 | TIM-GO | 87,378,935 | 387 | Electric-Stampede | 84,571,190 | 82 | 3.04E-02 |
| C3E3N04224D1 | 136 | 0 | YongOptimization | 93,355,276 | 65 | GOT-BSI-OPF | 90,608,771 | 123 | GravityX | 89,317,510 | 242 | TIM-GO | 87,378,935 | 387 | Electric-Stampede | 84,571,190 | 84 | 3.03E-02 |
| C3E3N04224D1 | 137 | 1 | YongOptimization | 93,701,264 | 66 | GOT-BSI-OPF | 90,765,409 | 159 | GravityX | 89,317,759 | 241 | TIM-GO | 87,828,712 | 393 | Electric-Stampede | 84,570,378 | 88 | 3.23E-02 |
| C3E3N04224D1 | 137 | 0 | YongOptimization | 93,698,553 | 66 | GOT-BSI-OPF | 90,765,409 | 123 | GravityX | 89,320,665 | 251 | TIM-GO | 87,852,782 | 391 | Electric-Stampede | 84,570,378 | 91 | 3.23E-02 |
| C3E3N04224D1 | 138 | 1 | YongOptimization | 94,068,159 | 65 | GOT-BSI-OPF | 90,982,581 | 144 | GravityX | 88,863,086 | 247 | TIM-GO | 88,257,936 | 386 | Electric-Stampede | 84,752,488 | 124 | 3.39E-02 |
| C3E3N04224D1 | 138 | 0 | YongOptimization | 94,056,489 | 66 | GOT-BSI-OPF | 90,982,581 | 137 | GravityX | 88,858,533 | 263 | TIM-GO | 88,257,936 | 388 | Electric-Stampede | 84,752,488 | 98 | 3.38E-02 |
| C3E3N04224D1 | 141 | 1 | YongOptimization | 90,583,952 | 72 | GravityX | 86,806,922 | 263 | GOT-BSI-OPF | 86,344,240 | 128 | TIM-GO | 83,433,650 | 455 | Electric-Stampede | 80,311,725 | 112 | 4.35E-02 |
| C3E3N04224D1 | 141 | 0 | YongOptimization | 90,579,363 | 70 | GravityX | 86,850,618 | 253 | GOT-BSI-OPF | 86,344,240 | 107 | TIM-GO | 83,433,959 | 393 | Electric-Stampede | 80,311,725 | 79 | 4.29E-02 |
| C3E3N04224D1 | 142 | 1 | YongOptimization | 93,541,419 | 65 | GOT-BSI-OPF | 90,044,439 | 107 | GravityX | 89,135,842 | 247 | TIM-GO | 87,203,396 | 404 | Electric-Stampede | 84,204,856 | 70 | 3.88E-02 |
| C3E3N04224D1 | 142 | 0 | YongOptimization | 93,537,657 | 68 | GOT-BSI-OPF | 90,044,439 | 125 | GravityX | 89,135,842 | 246 | TIM-GO | 87,203,396 | 395 | Electric-Stampede | 84,204,856 | 67 | 3.88E-02 |
| C3E3N04224D1 | 143 | 1 | GOT-BSI-OPF | 122,844,233 | 128 | GravityX | 121,733,783 | 264 | YongOptimization | 116,277,963 | 69 | TIM-GO | 114,926,334 | 394 | Artelys_Columbia | 112,766,556 | 573 | 9.12E-03 |
| C3E3N04224D1 | 143 | 0 | GOT-BSI-OPF | 122,844,233 | 129 | GravityX | 121,722,741 | 275 | YongOptimization | 116,261,226 | 68 | TIM-GO | 114,950,582 | 386 | Artelys_Columbia | 112,764,873 | 575 | 9.21E-03 |
| C3E3N04224D1 | 146 | 1 | GravityX | 107,337,735 | 246 | YongOptimization | 105,278,364 | 75 | GOT-BSI-OPF | 104,754,126 | 121 | TIM-GO | 100,484,227 | 419 | Artelys_Columbia | 98,307,726 | 567 | 1.96E-02 |
| C3E3N04224D1 | 146 | 0 | GravityX | 107,337,735 | 265 | YongOptimization | 105,241,436 | 67 | GOT-BSI-OPF | 104,754,126 | 120 | TIM-GO | 100,484,785 | 379 | Artelys_Columbia | 98,305,810 | 571 | 1.99E-02 |
| C3E3N04224D1 | 147 | 1 | GravityX | 107,464,709 | 242 | YongOptimization | 105,641,184 | 68 | GOT-BSI-OPF | 104,909,070 | 126 | TIM-GO | 100,577,314 | 398 | Artelys_Columbia | 98,375,231 | 573 | 1.73E-02 |
| C3E3N04224D1 | 147 | 0 | GravityX | 107,470,713 | 261 | YongOptimization | 105,606,069 | 69 | GOT-BSI-OPF | 104,909,070 | 129 | TIM-GO | 100,592,836 | 395 | Artelys_Columbia | 98,415,252 | 572 | 1.77E-02 |
| C3E3N04224D1 | 148 | 1 | GravityX | 107,734,920 | 257 | YongOptimization | 106,380,433 | 68 | GOT-BSI-OPF | 105,168,412 | 109 | TIM-GO | 100,857,865 | 385 | Artelys_Columbia | 98,680,341 | 572 | 1.27E-02 |
| C3E3N04224D1 | 148 | 0 | GravityX | 107,730,958 | 260 | YongOptimization | 106,331,488 | 69 | GOT-BSI-OPF | 105,168,412 | 114 | TIM-GO | 100,857,371 | 420 | Artelys_Columbia | 98,680,341 | 573 | 1.32E-02 |
| C3E3N04224D2 | 131 | 1 | GOT-BSI-OPF | 493,975,199 | 217 | GravityX | 491,573,490 | 942 | YongOptimization | 491,313,673 | 194 | The Blackouts | 476,359,249 | 7,205 | Electric-Stampede | 467,768,388 | 2,426 | 4.89E-03 |
| C3E3N04224D2 | 131 | 0 | GOT-BSI-OPF | 493,975,199 | 182 | GravityX | 491,573,490 | 952 | YongOptimization | 491,250,163 | 197 | Electric-Stampede | 467,768,388 | 2,419 | TIM-GO | 447,740,949 | 1,699 | 4.89E-03 |
| C3E3N04224D2 | 132 | 1 | GOT-BSI-OPF | 546,184,045 | 218 | GravityX | 543,886,985 | 1,075 | YongOptimization | 537,152,855 | 186 | The Blackouts | 528,570,520 | 7,220 | Electric-Stampede | 520,135,035 | 2,209 | 4.22E-03 |
| C3E3N04224D2 | 132 | 0 | GOT-BSI-OPF | 546,184,045 | 222 | GravityX | 543,886,985 | 978 | YongOptimization | 537,054,474 | 187 | The Blackouts | 528,570,520 | 7,202 | Electric-Stampede | 520,135,035 | 2,183 | 4.22E-03 |
| C3E3N04224D2 | 133 | 1 | GOT-BSI-OPF | 718,912,247 | 218 | GravityX | 717,042,528 | 977 | Electric-Stampede | 695,847,277 | 1,517 | YongOptimization | 675,880,565 | 181 | TIM-GO | 660,821,048 | 2,316 | 2.61E-03 |
| C3E3N04224D2 | 133 | 0 | GOT-BSI-OPF | 718,912,247 | 180 | GravityX | 717,042,528 | 1,100 | Electric-Stampede | 695,847,277 | 1,545 | The Blackouts | 692,422,164 | 7,205 | YongOptimization | 675,785,053 | 178 | 2.61E-03 |
| C3E3N04224D2 | 136 | 1 | GOT-BSI-OPF | 541,352,271 | 185 | GravityX | 539,065,946 | 1,000 | YongOptimization | 531,951,068 | 192 | The Blackouts | 526,225,750 | 7,217 | Electric-Stampede | 515,211,012 | 2,372 | 4.24E-03 |
| C3E3N04224D2 | 136 | 0 | GOT-BSI-OPF | 541,352,271 | 182 | GravityX | 539,065,946 | 977 | YongOptimization | 531,832,931 | 178 | The Blackouts | 525,247,561 | 7,202 | Electric-Stampede | 515,211,012 | 2,457 | 4.24E-03 |
| C3E3N04224D2 | 137 | 1 | GOT-BSI-OPF | 541,824,816 | 183 | GravityX | 539,540,090 | 1,062 | YongOptimization | 532,878,166 | 186 | Electric-Stampede | 515,906,482 | 2,178 | TIM-GO | 488,772,869 | 1,560 | 4.23E-03 |
| C3E3N04224D2 | 137 | 0 | GOT-BSI-OPF | 541,824,816 | 177 | GravityX | 539,540,090 | 1,006 | YongOptimization | 532,771,277 | 184 | Electric-Stampede | 515,906,482 | 2,169 | TIM-GO | 488,772,869 | 1,588 | 4.23E-03 |
| C3E3N04224D2 | 138 | 1 | GOT-BSI-OPF | 542,294,770 | 187 | GravityX | 539,945,118 | 1,002 | YongOptimization | 532,855,870 | 191 | Electric-Stampede | 516,090,977 | 2,337 | TIM-GO | 489,359,210 | 1,465 | 4.35E-03 |
| C3E3N04224D2 | 138 | 0 | GOT-BSI-OPF | 542,294,770 | 194 | GravityX | 539,945,118 | 1,059 | YongOptimization | 532,763,319 | 191 | The Blackouts | 529,462,871 | 7,212 | Electric-Stampede | 516,090,977 | 2,359 | 4.35E-03 |
| C3E3N04224D2 | 141 | 1 | GOT-BSI-OPF | 493,882,256 | 164 | GravityX | 491,497,131 | 1,006 | YongOptimization | 491,346,959 | 195 | Electric-Stampede | 467,709,275 | 2,511 | TIM-GO | 447,726,363 | 1,485 | 4.85E-03 |
| C3E3N04224D2 | 141 | 0 | GOT-BSI-OPF | 493,882,256 | 167 | GravityX | 491,497,131 | 1,029 | YongOptimization | 491,276,164 | 190 | The Blackouts | 479,406,298 | 7,211 | Electric-Stampede | 467,709,275 | 2,448 | 4.85E-03 |
| C3E3N04224D2 | 142 | 1 | GOT-BSI-OPF | 546,092,625 | 193 | GravityX | 543,797,861 | 1,057 | YongOptimization | 536,672,746 | 184 | Electric-Stampede | 517,279,714 | 3,077 | TIM-GO | 493,275,369 | 1,452 | 4.22E-03 |
| C3E3N04224D2 | 142 | 0 | GOT-BSI-OPF | 546,092,625 | 196 | GravityX | 543,797,861 | 1,006 | YongOptimization | 536,565,367 | 189 | Electric-Stampede | 517,279,714 | 2,349 | The Blackouts | 516,369,664 | 7,201 | 4.22E-03 |
| C3E3N04224D2 | 143 | 1 | GOT-BSI-OPF | 718,817,451 | 178 | GravityX | 716,941,079 | 971 | Electric-Stampede | 695,531,528 | 1,498 | The Blackouts | 692,511,102 | 7,222 | YongOptimization | 674,538,675 | 180 | 2.62E-03 |
| C3E3N04224D2 | 143 | 0 | GOT-BSI-OPF | 718,817,451 | 178 | GravityX | 716,941,079 | 1,005 | Electric-Stampede | 695,531,528 | 1,576 | YongOptimization | 674,491,772 | 178 | TIM-GO | 660,415,986 | 1,586 | 2.62E-03 |
| C3E3N04224D2 | 146 | 1 | GOT-BSI-OPF | 543,626,423 | 192 | GravityX | 541,335,277 | 1,016 | YongOptimization | 531,834,039 | 186 | The Blackouts | 525,458,852 | 7,201 | Electric-Stampede | 514,532,411 | 2,577 | 4.23E-03 |
| C3E3N04224D2 | 146 | 0 | GOT-BSI-OPF | 543,626,423 | 201 | GravityX | 541,335,277 | 1,053 | YongOptimization | 531,726,791 | 184 | The Blackouts | 525,458,852 | 7,215 | Electric-Stampede | 514,532,411 | 2,494 | 4.23E-03 |
| C3E3N04224D2 | 147 | 1 | GOT-BSI-OPF | 544,117,830 | 191 | GravityX | 541,810,526 | 978 | YongOptimization | 532,948,653 | 185 | The Blackouts | 526,207,105 | 7,206 | Electric-Stampede | 512,604,301 | 2,554 | 4.26E-03 |
| C3E3N04224D2 | 147 | 0 | GOT-BSI-OPF | 544,117,830 | 188 | GravityX | 541,810,526 | 995 | YongOptimization | 532,849,138 | 185 | The Blackouts | 523,947,941 | 7,224 | Electric-Stampede | 512,604,301 | 2,585 | 4.26E-03 |
| C3E3N04224D2 | 148 | 1 | GOT-BSI-OPF | 544,549,055 | 205 | GravityX | 542,237,466 | 1,090 | YongOptimization | 533,932,982 | 239 | The Blackouts | 526,699,871 | 7,202 | Electric-Stampede | 517,258,675 | 2,523 | 4.26E-03 |
| C3E3N04224D2 | 148 | 0 | GOT-BSI-OPF | 544,549,055 | 196 | GravityX | 542,237,466 | 1,007 | YongOptimization | 533,819,054 | 195 | The Blackouts | 525,934,900 | 7,217 | Electric-Stampede | 517,258,675 | 2,542 | 4.26E-03 |
| C3E3N04224D3 | 131 | 1 | GOT-BSI-OPF | 1,610,765,883 | 186 | YongOptimization | 1,603,683,234 | 134 | The Blackouts | 1,602,295,910 | 14,416 | GravityX | 1,599,358,838 | 1,200 | Electric-Stampede | 1,519,089,656 | 2,555 | 4.42E-03 |
| C3E3N04224D3 | 131 | 0 | GOT-BSI-OPF | 1,610,765,883 | 178 | YongOptimization | 1,603,373,731 | 136 | The Blackouts | 1,601,252,118 | 14,405 | Electric-Stampede | 1,519,089,656 | 2,582 | TIM-GO | 1,444,311,074 | 1,563 | 4.61E-03 |
| C3E3N04224D3 | 132 | 1 | The Blackouts | 1,932,504,047 | 14,417 | GOT-BSI-OPF | 1,932,051,178 | 180 | GravityX | 1,917,656,769 | 1,376 | YongOptimization | 1,893,674,796 | 133 | Electric-Stampede | 1,866,416,228 | 2,117 | 2.34E-04 |
| C3E3N04224D3 | 132 | 0 | The Blackouts | 1,932,504,047 | 14,415 | GOT-BSI-OPF | 1,932,051,178 | 166 | GravityX | 1,917,204,060 | 1,495 | YongOptimization | 1,893,194,915 | 132 | Electric-Stampede | 1,866,416,228 | 2,111 | 2.34E-04 |
| C3E3N04224D3 | 133 | 1 | GOT-BSI-OPF | 2,484,971,373 | 169 | The Blackouts | 2,430,748,912 | 14,427 | Electric-Stampede | 2,414,498,218 | 1,642 | GravityX | 2,367,094,029 | 1,289 | YongOptimization | 2,332,524,035 | 129 | 2.23E-02 |
| C3E3N04224D3 | 133 | 0 | GOT-BSI-OPF | 2,484,971,373 | 179 | The Blackouts | 2,430,748,912 | 14,427 | Electric-Stampede | 2,414,498,218 | 1,651 | GravityX | 2,367,260,371 | 1,185 | YongOptimization | 2,332,169,555 | 123 | 2.23E-02 |
| C3E3N04224D3 | 141 | 1 | GOT-BSI-OPF | 1,611,201,046 | 173 | YongOptimization | 1,603,212,415 | 140 | The Blackouts | 1,591,050,554 | 14,402 | GravityX | 1,577,801,318 | 2,554 | Electric-Stampede | 1,538,000,920 | 2,534 | 4.98E-03 |
| C3E3N04224D3 | 141 | 0 | GOT-BSI-OPF | 1,611,201,046 | 174 | The Blackouts | 1,605,376,377 | 14,426 | YongOptimization | 1,603,027,457 | 141 | GravityX | 1,599,853,883 | 1,182 | Electric-Stampede | 1,538,000,920 | 2,462 | 3.63E-03 |
| C3E3N04224D3 | 142 | 1 | GOT-BSI-OPF | 1,932,503,857 | 163 | GravityX | 1,918,367,930 | 1,470 | The Blackouts | 1,902,851,759 | 14,422 | YongOptimization | 1,896,004,520 | 133 | Electric-Stampede | 1,860,944,549 | 2,041 | 7.37E-03 |
| C3E3N04224D3 | 142 | 0 | GOT-BSI-OPF | 1,932,503,857 | 176 | The Blackouts | 1,931,059,063 | 14,406 | GravityX | 1,918,547,734 | 1,351 | YongOptimization | 1,895,644,329 | 131 | Electric-Stampede | 1,860,944,549 | 2,078 | 7.48E-04 |
| C3E3N04224D3 | 143 | 1 | GOT-BSI-OPF | 2,485,396,890 | 176 | The Blackouts | 2,461,714,107 | 14,412 | Electric-Stampede | 2,415,012,847 | 1,827 | GravityX | 2,367,663,822 | 1,179 | YongOptimization | 2,336,396,533 | 130 | 9.62E-03 |
| C3E3N04224D3 | 143 | 0 | GOT-BSI-OPF | 2,485,396,890 | 171 | The Blackouts | 2,429,918,074 | 14,404 | Electric-Stampede | 2,415,012,847 | 1,773 | GravityX | 2,367,490,701 | 1,231 | YongOptimization | 2,335,857,550 | 124 | 2.28E-02 |
| C3E3N06049D1 | 31 | 1 | GOT-BSI-OPF | 102,243,983 | 124 | TIM-GO | 101,092,307 | 573 | Electric-Stampede | 98,798,985 | 175 | Artelys_Columbia | 92,180,811 | 567 | The Blackouts | 66,434,047 | 607 | 1.14E-02 |
| C3E3N06049D1 | 32 | 1 | Electric-Stampede | 122,649,785 | 253 | GravityX | 122,221,408 | 549 | TIM-GO | 121,920,694 | 572 | GOT-BSI-OPF | 117,101,237 | 141 | Artelys_Columbia | 112,158,070 | 572 | 3.50E-03 |
| C3E3N06049D1 | 33 | 1 | TIM-GO | 151,075,969 | 574 | Artelys_Columbia | 150,284,171 | 595 | Electric-Stampede | 148,365,468 | 220 | GravityX | 140,582,104 | 394 | YongOptimization | 139,068,968 | 146 | 5.27E-03 |
| C3E3N06049D1 | 41 | 1 | GOT-BSI-OPF | 102,347,236 | 187 | TIM-GO | 101,144,415 | 574 | Electric-Stampede | 98,831,245 | 121 | Artelys_Columbia | 92,181,280 | 409 | The Blackouts | 64,484,914 | 616 | 1.19E-02 |
| C3E3N06049D1 | 42 | 1 | Electric-Stampede | 122,649,788 | 97 | TIM-GO | 122,037,490 | 574 | GravityX | 118,784,855 | 550 | GOT-BSI-OPF | 118,119,387 | 159 | Artelys_Columbia | 112,159,740 | 601 | 5.02E-03 |
| C3E3N06049D1 | 43 | 1 | GravityX | 151,341,588 | 412 | TIM-GO | 151,058,268 | 574 | Artelys_Columbia | 150,382,633 | 565 | Electric-Stampede | 148,365,469 | 119 | YongOptimization | 139,068,966 | 198 | 1.88E-03 |
| C3E3N06049D2 | 31 | 1 | GOT-BSI-OPF | 606,942,932 | 268 | GravityX | 605,974,276 | 1,813 | Electric-Stampede | 599,385,335 | 1,845 | TIM-GO | 592,333,066 | 5,450 | Artelys_Columbia | 589,542,108 | 7,125 | 1.60E-03 |
| C3E3N06049D2 | 32 | 1 | GravityX | 674,915,263 | 1,434 | GOT-BSI-OPF | 674,436,584 | 1,183 | Electric-Stampede | 673,318,708 | 1,549 | TIM-GO | 659,788,473 | 5,256 | Artelys_Columbia | 659,208,037 | 7,143 | 7.10E-04 |
| C3E3N06049D2 | 33 | 1 | Electric-Stampede | 822,978,465 | 1,212 | GravityX | 818,836,164 | 1,463 | TIM-GO | 808,513,904 | 7,162 | YongOptimization | 761,348,427 | 292 | GOT-BSI-OPF | 753,761,481 | 498 | 5.06E-03 |
| C3E3N06049D2 | 41 | 1 | GOT-BSI-OPF | 606,972,272 | 280 | GravityX | 605,592,962 | 2,173 | TIM-GO | 592,390,071 | 4,808 | Electric-Stampede | 592,245,070 | 2,102 | Artelys_Columbia | 589,613,748 | 7,113 | 2.28E-03 |
| C3E3N06049D2 | 42 | 1 | GravityX | 674,712,180 | 1,524 | GOT-BSI-OPF | 674,168,566 | 1,020 | Electric-Stampede | 669,455,541 | 1,930 | TIM-GO | 659,822,815 | 5,329 | Artelys_Columbia | 659,231,705 | 7,140 | 8.06E-04 |
| C3E3N06049D2 | 43 | 1 | GravityX | 819,062,587 | 1,415 | Electric-Stampede | 810,559,462 | 1,538 | TIM-GO | 808,825,408 | 6,348 | GOT-BSI-OPF | 775,354,479 | 525 | YongOptimization | 701,153,834 | 514 | 1.05E-02 |
| C3E3N06049D3 | 31 | 1 | GOT-BSI-OPF | 2,139,695,192 | 254 | GravityX | 2,139,416,069 | 1,629 | Electric-Stampede | 2,120,175,058 | 2,916 | TIM-GO | 2,087,185,225 | 4,821 | Artelys_Columbia | 2,079,717,738 | 12,660 | 1.30E-04 |
| C3E3N06049D3 | 32 | 1 | GOT-BSI-OPF | 2,376,893,238 | 249 | GravityX | 2,376,532,512 | 1,485 | Electric-Stampede | 2,373,647,827 | 1,382 | TIM-GO | 2,320,899,494 | 4,357 | Artelys_Columbia | 2,319,283,861 | 14,215 | 1.52E-04 |
| C3E3N06049D3 | 33 | 1 | GOT-BSI-OPF | 2,632,941,304 | 232 | Electric-Stampede | 2,630,343,616 | 1,257 | GravityX | 2,627,665,564 | 1,266 | TIM-GO | 2,577,961,797 | 3,381 | Artelys_Columbia | 2,575,951,555 | 6,063 | 9.88E-04 |
| C3E3N06049D3 | 41 | 1 | GravityX | 2,139,643,021 | 1,799 | GOT-BSI-OPF | 2,139,284,533 | 245 | Electric-Stampede | 2,121,264,815 | 2,748 | TIM-GO | 2,087,364,084 | 4,722 | Artelys_Columbia | 2,079,855,200 | 13,698 | 1.68E-04 |
| C3E3N06049D3 | 42 | 1 | GravityX | 2,377,380,481 | 1,263 | GOT-BSI-OPF | 2,376,877,199 | 228 | Electric-Stampede | 2,374,459,677 | 1,253 | TIM-GO | 2,321,060,013 | 4,315 | Artelys_Columbia | 2,319,393,799 | 10,599 | 2.12E-04 |
| C3E3N06049D3 | 43 | 1 | GOT-BSI-OPF | 2,633,055,828 | 272 | GravityX | 2,627,788,975 | 1,269 | Electric-Stampede | 2,615,238,158 | 874 | TIM-GO | 2,578,205,164 | 3,716 | Artelys_Columbia | 2,576,141,419 | 4,177 | 2.00E-03 |
| C3E3N06708D1 | 11 | 1 | The Blackouts | 772,735,655 | 606 | YongOptimization | 754,040,950 | 371 | GOT-BSI-OPF | 749,048,114 | 299 | LLGoMax | 628,597,652 | 246 | 2.48E-02 | |||
| C3E3N06708D1 | 12 | 1 | GravityX | 589,673,052 | 596 | The Blackouts | 582,437,354 | 611 | YongOptimization | 564,407,277 | 488 | GOT-BSI-OPF | 61,155,628 | 602 | 1.24E-02 | |||
| C3E3N06708D1 | 13 | 1 | YongOptimization | 878,146,714 | 454 | GOT-BSI-OPF | 868,297,697 | 621 | LLGoMax | 748,477,057 | 246 | Electric-Stampede | 64,919,783 | 113 | 1.13E-02 | |||
| C3E3N06708D2 | 11 | 1 | The Blackouts | 4,267,629,755 | 7,223 | Artelys_Columbia | 4,253,188,549 | 4,189 | YongOptimization | 4,243,876,367 | 954 | GOT-BSI-OPF | 4,228,937,133 | 549 | GravityX | 4,221,495,887 | 4,469 | 3.40E-03 |
| C3E3N06708D2 | 12 | 1 | Artelys_Columbia | 3,940,374,300 | 6,077 | The Blackouts | 3,938,603,187 | 7,217 | YongOptimization | 3,914,885,528 | 1,005 | GravityX | 3,896,916,974 | 4,162 | Electric-Stampede | 3,891,902,751 | 399 | 4.50E-04 |
| C3E3N06708D2 | 13 | 1 | Artelys_Columbia | 4,589,920,245 | 6,573 | YongOptimization | 4,564,855,525 | 990 | GravityX | 4,537,488,819 | 5,883 | Electric-Stampede | 4,532,755,923 | 463 | LLGoMax | 2,659,594,699 | 495 | 5.49E-03 |
| C3E3N06708D3 | 11 | 1 | TIM-GO | 15,133,671,214 | 10,971 | Artelys_Columbia | 15,121,010,339 | 14,343 | YongOptimization | 15,119,335,897 | 882 | GOT-BSI-OPF | 15,118,194,337 | 194 | GravityX | 14,969,971,997 | 4,603 | 8.37E-04 |
| C3E3N06708D3 | 12 | 1 | Artelys_Columbia | 13,603,436,169 | 7,583 | TIM-GO | 13,584,367,177 | 13,983 | YongOptimization | 13,580,766,233 | 915 | GOT-BSI-OPF | 13,580,225,862 | 272 | GravityX | 13,449,027,457 | 4,549 | 1.40E-03 |
| C3E3N06708D3 | 13 | 1 | TIM-GO | 17,034,327,810 | 12,347 | YongOptimization | 17,018,091,397 | 878 | GOT-BSI-OPF | 17,017,049,508 | 273 | Artelys_Columbia | 16,987,159,888 | 14,344 | GravityX | 16,843,067,491 | 5,696 | 9.54E-04 |
| C3E3N06717D1 | 31 | 1 | YongOptimization | 134,137,561 | 441 | TIM-GO | 131,050,097 | 583 | Electric-Stampede | 126,597,786 | 116 | 2.36E-02 | ||||||
| C3E3N06717D1 | 32 | 1 | YongOptimization | 147,243,632 | 471 | TIM-GO | 146,683,126 | 575 | Electric-Stampede | 144,627,453 | 104 | 3.82E-03 | ||||||
| C3E3N06717D1 | 33 | 1 | TIM-GO | 220,286,792 | 580 | Electric-Stampede | 207,703,550 | 117 | YongOptimization | 147,839,309 | 545 | 6.06E-02 | ||||||
| C3E3N06717D1 | 41 | 1 | YongOptimization | 138,448,314 | 457 | TIM-GO | 136,634,897 | 580 | Electric-Stampede | 126,713,191 | 195 | 1.33E-02 | ||||||
| C3E3N06717D1 | 42 | 1 | YongOptimization | 156,209,041 | 449 | TIM-GO | 154,479,858 | 576 | Electric-Stampede | 145,780,697 | 98 | 1.12E-02 | ||||||
| C3E3N06717D1 | 43 | 1 | TIM-GO | 224,122,124 | 581 | Electric-Stampede | 214,323,217 | 144 | YongOptimization | 162,725,189 | 623 | 4.57E-02 | ||||||
| C3E3N06717D1 | 46 | 1 | TIM-GO | 156,932,909 | 577 | YongOptimization | 154,196,442 | 482 | Electric-Stampede | 150,710,426 | 162 | 1.77E-02 | ||||||
| C3E3N06717D1 | 47 | 1 | YongOptimization | 162,542,585 | 450 | TIM-GO | 161,279,556 | 588 | Electric-Stampede | 152,574,717 | 109 | 7.83E-03 | ||||||
| C3E3N06717D1 | 48 | 1 | YongOptimization | 164,750,180 | 590 | TIM-GO | 163,121,957 | 577 | Electric-Stampede | 153,278,480 | 112 | 9.98E-03 | ||||||
| C3E3N08316D1 | 1 | 1 | YongOptimization | 1,189,381,421 | 168 | TIM-GO | 1,179,768,680 | 523 | GravityX | 1,158,730,927 | 526 | Electric-Stampede | 1,158,237,777 | 257 | Artelys_Columbia | 1,146,380,102 | 573 | 8.15E-03 |
| C3E3N08316D2 | 1 | 1 | YongOptimization | 7,151,907,899 | 778 | TIM-GO | 7,089,733,833 | 4,022 | Electric-Stampede | 7,031,087,369 | 491 | GravityX | 6,967,777,381 | 1,760 | Artelys_Columbia | 6,958,626,896 | 5,771 | 8.77E-03 |
| C3E3N08316D3 | 1 | 1 | YongOptimization | 25,006,688,340 | 411 | TIM-GO | 24,801,222,604 | 3,384 | Electric-Stampede | 24,615,159,176 | 1,231 | Artelys_Columbia | 24,614,791,366 | 10,270 | GravityX | 24,358,609,275 | 1,634 | 8.28E-03 |
| C3E3N23643D1 | 3 | 1 | TIM-GO | 100,626,358 | 9,360 | Artelys_Columbia | 71,473,854 | 12,782 | ARPA-e Benchmark | 61,152,071 | 8871 | 4.08E-01 | ||||||
| ensemble 1 | 172,839,886,671 | 128,424 | ensemble 2 | 171,853,935,731 | 257,357 | ensemble 3 | 170,591,422,499 | 177,948 | e2/e3 - 1 | 7.40E-03 | e1/e2 -1 | 5.74E-03 | ||||||
| max (hard) | 4.08E-01 | |||||||||||||||||
| min (easy) | 2.40E-05 |
Run Times
The time required to solve these problems in the real world is limited by operational constraints. Here we compare the run times used by each team to solve each set of problems; only the times used to find positive values of zms are used. This can distort the results of teams that solve only a few (or no) small problems. The Blackouts appeared to run until they reached the time limit in all cases. All runs were made on the same hardware platform. Individual scenario times are given in the Top 5 table above.
| D1 rank | Div. 1 Hours | D2 rank | Team | Div. 2 Hours | D3 rank | Team | Div. 3 Hours | rank | Team | Total Hours | |
| 1 | Artelys_Columbia | 8.63 | 1 | The Blackouts | 75.34 | 1 | The Blackouts | 99.78 | 1 | The Blackouts | 180.75 |
| 2 | ARPA-e Benchmark | 8.48 | 2 | Artelys_Columbia | 36.95 | 2 | Argonauts | 40.28 | 2 | Artelys_Columbia | 82.26 |
| 3 | TIM-GO | 7.94 | 3 | ARPA-e Benchmark | 32.31 | 3 | Artelys_Columbia | 36.68 | 3 | ARPA-e Benchmark | 70.63 |
| 4 | The Blackouts | 5.63 | 4 | Electric-Stampede | 27.43 | 4 | ARPA-e Benchmark | 29.84 | 4 | Argonauts | 64.46 |
| 5 | GravityX | 2.64 | 5 | Argonauts | 24.03 | 5 | TIM-GO | 23.48 | 5 | TIM-GO | 55.06 |
| 6 | YongOptimization | 2.35 | 6 | TIM-GO | 23.64 | 6 | GravityX | 12.69 | 6 | Electric-Stampede | 40.40 |
| 7 | GOT-BSI-OPF | 1.68 | 7 | GravityX | 16.39 | 7 | Electric-Stampede | 11.57 | 7 | GravityX | 31.72 |
| 8 | Electric-Stampede | 1.40 | 8 | Gatorgar | 14.11 | 8 | Gatorgar | 10.14 | 8 | Gatorgar | 24.41 |
| 9 | LLGoMax | 0.21 | 9 | quasiGrad | 8.97 | 9 | quasiGrad | 3.99 | 9 | quasiGrad | 12.96 |
| 10 | Gatorgar | 0.17 | 10 | GOT-BSI-OPF | 5.37 | 10 | YongOptimization | 2.44 | 10 | GOT-BSI-OPF | 8.67 |
| 11 | Argonauts | 0.15 | 11 | YongOptimization | 3.75 | 11 | GOT-BSI-OPF | 1.63 | 11 | YongOptimization | 8.54 |
| 12 | PACE | 0.00 | 12 | LLGoMax | 0.71 | 12 | LLGoMax | 0.37 | 12 | LLGoMax | 1.29 |
| 13 | PGWOpt | 0.00 | 13 | PACE | 0.00 | 13 | PACE | 0.00 | 13 | PACE | 0.00 |
| 14 | quasiGrad | 0.00 | 14 | PGWOpt | 0.00 | 14 | PGWOpt | 0.00 | 14 | PGWOpt | 0.00 |
| Div. 1 Hours Used | 39.25 | Div. 2 Hours Used | 269.00 | Div. 3 Hours Used | 272.89 | Total Hours Used | 581.15 |
Speed
Here we define speed as zms / runtime in seconds. This adds a performance element to getting the best solution. This table is similar the Top 5 Results table above, but the Benchmark is completely excluded.
| model | scenario | SW | best team | best speed | 2nd best team | 2nd best speed | 3rd best team | 3rd best speed | 4th best team | 4th best speed | 5th best team | 5th best speed | s1/s2 - 1 |
| C3E3N00073D2 | 231 | 1 | Artelys_Columbia | 3,826,769 | YongOptimization | 3,713,960 | GravityX | 3,029,119 | GOT-BSI-OPF | 2,761,544 | TIM-GO | 2,655,352 | 3.04E-02 |
| C3E3N00073D2 | 232 | 1 | YongOptimization | 4,523,012 | Artelys_Columbia | 4,146,435 | GravityX | 3,566,804 | Electric-Stampede | 3,229,615 | TIM-GO | 2,944,800 | 9.08E-02 |
| C3E3N00073D2 | 233 | 1 | YongOptimization | 5,856,828 | Artelys_Columbia | 5,617,077 | GravityX | 4,708,703 | Electric-Stampede | 4,197,505 | TIM-GO | 3,852,952 | 4.27E-02 |
| C3E3N00073D2 | 236 | 1 | Artelys_Columbia | 4,564,286 | YongOptimization | 4,318,116 | Electric-Stampede | 3,939,895 | GOT-BSI-OPF | 3,604,532 | GravityX | 3,316,591 | 5.70E-02 |
| C3E3N00073D2 | 237 | 1 | Electric-Stampede | 4,504,608 | YongOptimization | 4,147,504 | Artelys_Columbia | 4,052,901 | GOT-BSI-OPF | 3,881,252 | GravityX | 3,266,864 | 8.61E-02 |
| C3E3N00073D2 | 238 | 1 | Artelys_Columbia | 4,434,388 | YongOptimization | 4,315,041 | GravityX | 3,426,475 | GOT-BSI-OPF | 3,376,833 | TIM-GO | 2,674,453 | 2.77E-02 |
| C3E3N00073D2 | 241 | 1 | YongOptimization | 3,617,538 | Artelys_Columbia | 3,346,548 | Electric-Stampede | 3,304,187 | GravityX | 3,031,417 | TIM-GO | 2,802,451 | 8.10E-02 |
| C3E3N00073D2 | 242 | 1 | YongOptimization | 4,291,279 | Artelys_Columbia | 4,259,232 | Electric-Stampede | 3,816,331 | GravityX | 3,495,272 | GOT-BSI-OPF | 3,361,711 | 7.52E-03 |
| C3E3N00073D2 | 243 | 1 | YongOptimization | 5,856,414 | GOT-BSI-OPF | 5,500,322 | Electric-Stampede | 5,493,320 | Artelys_Columbia | 5,229,781 | GravityX | 4,802,069 | 6.47E-02 |
| C3E3N00073D2 | 246 | 1 | Artelys_Columbia | 4,618,495 | Electric-Stampede | 3,936,746 | YongOptimization | 3,863,134 | GOT-BSI-OPF | 3,799,181 | GravityX | 3,330,405 | 1.73E-01 |
| C3E3N00073D2 | 247 | 1 | GOT-BSI-OPF | 4,102,271 | Artelys_Columbia | 4,057,184 | YongOptimization | 3,706,949 | Electric-Stampede | 3,550,313 | GravityX | 3,410,311 | 1.11E-02 |
| C3E3N00073D2 | 248 | 1 | YongOptimization | 4,869,621 | Electric-Stampede | 3,517,295 | GravityX | 3,509,298 | Artelys_Columbia | 3,323,985 | TIM-GO | 2,400,724 | 3.84E-01 |
| C3E3N00073D3 | 231 | 1 | YongOptimization | 26,793,802 | Artelys_Columbia | 18,946,714 | GOT-BSI-OPF | 15,808,863 | GravityX | 12,763,740 | TIM-GO | 9,930,926 | 4.14E-01 |
| C3E3N00073D3 | 232 | 1 | YongOptimization | 26,020,704 | Artelys_Columbia | 18,314,397 | Electric-Stampede | 14,719,124 | GravityX | 13,656,946 | GOT-BSI-OPF | 11,500,062 | 4.21E-01 |
| C3E3N00073D3 | 233 | 1 | YongOptimization | 40,571,871 | Artelys_Columbia | 26,623,187 | Electric-Stampede | 21,541,130 | GravityX | 18,927,793 | GOT-BSI-OPF | 13,878,842 | 5.24E-01 |
| C3E3N00073D3 | 236 | 1 | YongOptimization | 22,826,990 | Artelys_Columbia | 14,803,674 | Electric-Stampede | 13,721,432 | GOT-BSI-OPF | 12,054,874 | GravityX | 11,469,078 | 5.42E-01 |
| C3E3N00073D3 | 237 | 1 | YongOptimization | 20,968,110 | Artelys_Columbia | 15,305,689 | Electric-Stampede | 14,198,580 | GravityX | 11,237,997 | GOT-BSI-OPF | 9,889,176 | 3.70E-01 |
| C3E3N00073D3 | 238 | 1 | YongOptimization | 20,349,393 | Artelys_Columbia | 15,486,037 | GravityX | 11,091,740 | GOT-BSI-OPF | 10,869,311 | Electric-Stampede | 9,710,864 | 3.14E-01 |
| C3E3N00073D3 | 241 | 1 | YongOptimization | 25,258,721 | Artelys_Columbia | 18,083,952 | GOT-BSI-OPF | 13,697,655 | Electric-Stampede | 13,663,550 | GravityX | 12,699,509 | 3.97E-01 |
| C3E3N00073D3 | 242 | 1 | YongOptimization | 27,017,104 | Artelys_Columbia | 19,366,085 | GOT-BSI-OPF | 16,338,662 | Electric-Stampede | 16,314,748 | GravityX | 13,602,379 | 3.95E-01 |
| C3E3N00073D3 | 243 | 1 | YongOptimization | 36,419,773 | Artelys_Columbia | 26,519,191 | Electric-Stampede | 21,390,915 | GOT-BSI-OPF | 19,817,792 | GravityX | 17,556,912 | 3.73E-01 |
| C3E3N00073D3 | 246 | 1 | YongOptimization | 27,997,649 | Artelys_Columbia | 20,986,426 | Electric-Stampede | 17,343,463 | GOT-BSI-OPF | 15,636,101 | GravityX | 14,474,975 | 3.34E-01 |
| C3E3N00073D3 | 247 | 1 | YongOptimization | 29,700,626 | Artelys_Columbia | 20,351,764 | Electric-Stampede | 17,434,446 | GravityX | 14,188,952 | GOT-BSI-OPF | 11,495,855 | 4.59E-01 |
| C3E3N00073D3 | 248 | 1 | YongOptimization | 28,587,222 | Artelys_Columbia | 20,508,776 | GravityX | 14,643,218 | Electric-Stampede | 13,239,841 | GOT-BSI-OPF | 10,945,040 | 3.94E-01 |
| C3E3N00617D1 | 1 | 1 | LLGoMax | 5,600,140 | GOT-BSI-OPF | 1,244,391 | YongOptimization | 1,078,076 | Artelys_Columbia | 468,527 | TIM-GO | 443,870 | 3.50E+00 |
| C3E3N00617D2 | 1 | 1 | LLGoMax | 12,377,999 | GOT-BSI-OPF | 2,990,122 | TIM-GO | 1,345,060 | YongOptimization | 1,144,664 | GravityX | 932,133 | 3.14E+00 |
| C3E3N00617D3 | 1 | 1 | LLGoMax | 48,412,784 | GOT-BSI-OPF | 19,346,444 | YongOptimization | 6,123,000 | TIM-GO | 5,255,908 | Artelys_Columbia | 4,027,834 | 1.50E+00 |
| C3E3N01576D1 | 27 | 1 | LLGoMax | 5,148,289 | YongOptimization | 2,320,093 | GOT-BSI-OPF | 804,923 | GravityX | 364,921 | Electric-Stampede | 269,995 | 1.22E+00 |
| C3E3N01576D2 | 27 | 1 | YongOptimization | 3,404,742 | GOT-BSI-OPF | 1,043,071 | TIM-GO | 655,398 | GravityX | 581,269 | Artelys_Columbia | 283,435 | 2.26E+00 |
| C3E3N01576D2 | 31 | 1 | YongOptimization | 2,715,433 | GOT-BSI-OPF | 1,030,341 | TIM-GO | 503,693 | GravityX | 455,946 | Artelys_Columbia | 245,645 | 1.64E+00 |
| C3E3N01576D2 | 32 | 1 | YongOptimization | 4,644,187 | GOT-BSI-OPF | 1,491,983 | LLGoMax | 1,352,275 | TIM-GO | 597,478 | GravityX | 597,308 | 2.11E+00 |
| C3E3N01576D2 | 33 | 1 | YongOptimization | 6,258,776 | LLGoMax | 5,905,207 | GOT-BSI-OPF | 4,441,561 | TIM-GO | 1,059,725 | GravityX | 924,628 | 5.99E-02 |
| C3E3N01576D2 | 36 | 1 | YongOptimization | 4,544,710 | GOT-BSI-OPF | 1,682,796 | LLGoMax | 1,511,371 | TIM-GO | 724,749 | GravityX | 700,803 | 1.70E+00 |
| C3E3N01576D2 | 41 | 1 | YongOptimization | 2,517,619 | GOT-BSI-OPF | 803,362 | TIM-GO | 484,245 | GravityX | 480,444 | Artelys_Columbia | 240,823 | 2.13E+00 |
| C3E3N01576D2 | 42 | 1 | YongOptimization | 4,724,477 | GOT-BSI-OPF | 1,538,027 | LLGoMax | 1,210,877 | TIM-GO | 678,129 | GravityX | 672,594 | 2.07E+00 |
| C3E3N01576D2 | 43 | 1 | YongOptimization | 6,431,171 | LLGoMax | 6,123,204 | GOT-BSI-OPF | 4,030,926 | GravityX | 1,005,564 | TIM-GO | 995,205 | 5.03E-02 |
| C3E3N01576D3 | 27 | 1 | YongOptimization | 12,314,695 | GOT-BSI-OPF | 6,541,474 | TIM-GO | 2,157,071 | GravityX | 1,781,686 | Artelys_Columbia | 1,308,697 | 8.83E-01 |
| C3E3N04224D1 | 131 | 1 | YongOptimization | 1,306,956 | GOT-BSI-OPF | 796,577 | Electric-Stampede | 785,552 | GravityX | 347,566 | TIM-GO | 202,063 | 6.41E-01 |
| C3E3N04224D1 | 131 | 0 | YongOptimization | 1,306,940 | Electric-Stampede | 1,251,974 | GOT-BSI-OPF | 775,047 | GravityX | 344,861 | TIM-GO | 200,114 | 4.39E-02 |
| C3E3N04224D1 | 132 | 1 | YongOptimization | 1,409,689 | Electric-Stampede | 1,063,367 | GOT-BSI-OPF | 747,822 | GravityX | 376,857 | TIM-GO | 220,511 | 3.26E-01 |
| C3E3N04224D1 | 132 | 0 | YongOptimization | 1,409,558 | Electric-Stampede | 866,041 | GOT-BSI-OPF | 685,028 | GravityX | 384,413 | TIM-GO | 223,408 | 6.28E-01 |
| C3E3N04224D1 | 133 | 1 | YongOptimization | 1,722,386 | Electric-Stampede | 1,226,665 | GOT-BSI-OPF | 1,056,225 | GravityX | 479,935 | TIM-GO | 297,793 | 4.04E-01 |
| C3E3N04224D1 | 133 | 0 | YongOptimization | 1,722,144 | Electric-Stampede | 1,226,665 | GOT-BSI-OPF | 1,056,225 | GravityX | 459,938 | TIM-GO | 288,783 | 4.04E-01 |
| C3E3N04224D1 | 136 | 1 | YongOptimization | 1,414,602 | Electric-Stampede | 1,031,356 | GOT-BSI-OPF | 696,991 | GravityX | 357,270 | TIM-GO | 225,785 | 3.72E-01 |
| C3E3N04224D1 | 136 | 0 | YongOptimization | 1,436,235 | Electric-Stampede | 1,006,800 | GOT-BSI-OPF | 736,657 | GravityX | 369,081 | TIM-GO | 225,785 | 4.27E-01 |
| C3E3N04224D1 | 137 | 1 | YongOptimization | 1,419,716 | Electric-Stampede | 961,027 | GOT-BSI-OPF | 570,852 | GravityX | 370,613 | TIM-GO | 223,483 | 4.77E-01 |
| C3E3N04224D1 | 137 | 0 | YongOptimization | 1,419,675 | Electric-Stampede | 929,345 | GOT-BSI-OPF | 737,930 | GravityX | 355,859 | TIM-GO | 224,687 | 5.28E-01 |
| C3E3N04224D1 | 138 | 1 | YongOptimization | 1,447,202 | Electric-Stampede | 683,488 | GOT-BSI-OPF | 631,823 | GravityX | 359,770 | TIM-GO | 228,648 | 1.12E+00 |
| C3E3N04224D1 | 138 | 0 | YongOptimization | 1,425,098 | Electric-Stampede | 864,821 | GOT-BSI-OPF | 664,106 | GravityX | 337,865 | TIM-GO | 227,469 | 6.48E-01 |
| C3E3N04224D1 | 141 | 1 | YongOptimization | 1,258,110 | Electric-Stampede | 717,069 | GOT-BSI-OPF | 674,564 | GravityX | 330,064 | TIM-GO | 183,371 | 7.55E-01 |
| C3E3N04224D1 | 141 | 0 | YongOptimization | 1,293,991 | Electric-Stampede | 1,016,604 | GOT-BSI-OPF | 806,956 | GravityX | 343,283 | TIM-GO | 212,300 | 2.73E-01 |
| C3E3N04224D1 | 142 | 1 | YongOptimization | 1,439,099 | Electric-Stampede | 1,202,927 | GOT-BSI-OPF | 841,537 | GravityX | 360,874 | TIM-GO | 215,850 | 1.96E-01 |
| C3E3N04224D1 | 142 | 0 | YongOptimization | 1,375,554 | Electric-Stampede | 1,256,789 | GOT-BSI-OPF | 720,356 | GravityX | 362,341 | TIM-GO | 220,768 | 9.45E-02 |
| C3E3N04224D1 | 143 | 1 | YongOptimization | 1,685,188 | GOT-BSI-OPF | 959,721 | Electric-Stampede | 927,191 | GravityX | 461,113 | TIM-GO | 291,691 | 7.56E-01 |
| C3E3N04224D1 | 143 | 0 | YongOptimization | 1,709,724 | Electric-Stampede | 1,122,931 | GOT-BSI-OPF | 952,281 | GravityX | 442,628 | TIM-GO | 297,799 | 5.23E-01 |
| C3E3N04224D1 | 146 | 1 | YongOptimization | 1,403,712 | Electric-Stampede | 1,198,494 | GOT-BSI-OPF | 865,737 | GravityX | 436,332 | TIM-GO | 239,819 | 1.71E-01 |
| C3E3N04224D1 | 146 | 0 | YongOptimization | 1,570,768 | Electric-Stampede | 1,214,059 | GOT-BSI-OPF | 872,951 | GravityX | 405,048 | TIM-GO | 265,131 | 2.94E-01 |
| C3E3N04224D1 | 147 | 1 | YongOptimization | 1,553,547 | Electric-Stampede | 1,015,573 | GOT-BSI-OPF | 832,612 | GravityX | 444,069 | TIM-GO | 252,707 | 5.30E-01 |
| C3E3N04224D1 | 147 | 0 | YongOptimization | 1,530,523 | Electric-Stampede | 973,258 | GOT-BSI-OPF | 813,249 | GravityX | 411,765 | TIM-GO | 254,665 | 5.73E-01 |
| C3E3N04224D1 | 148 | 1 | YongOptimization | 1,564,418 | GOT-BSI-OPF | 964,848 | Electric-Stampede | 740,274 | GravityX | 419,202 | TIM-GO | 261,968 | 6.21E-01 |
| C3E3N04224D1 | 148 | 0 | YongOptimization | 1,541,036 | Electric-Stampede | 1,068,350 | GOT-BSI-OPF | 922,530 | GravityX | 414,350 | TIM-GO | 240,137 | 4.42E-01 |
| C3E3N04224D2 | 131 | 1 | YongOptimization | 2,532,545 | GOT-BSI-OPF | 2,276,383 | GravityX | 521,840 | TIM-GO | 285,367 | Electric-Stampede | 192,815 | 1.13E-01 |
| C3E3N04224D2 | 131 | 0 | GOT-BSI-OPF | 2,714,149 | YongOptimization | 2,493,656 | GravityX | 516,359 | TIM-GO | 263,532 | Artelys_Columbia | 234,473 | 8.84E-02 |
| C3E3N04224D2 | 132 | 1 | YongOptimization | 2,887,919 | GOT-BSI-OPF | 2,505,431 | GravityX | 505,941 | TIM-GO | 333,366 | Electric-Stampede | 235,462 | 1.53E-01 |
| C3E3N04224D2 | 132 | 0 | YongOptimization | 2,871,949 | GOT-BSI-OPF | 2,460,288 | GravityX | 556,122 | TIM-GO | 311,675 | Artelys_Columbia | 242,758 | 1.67E-01 |
| C3E3N04224D2 | 133 | 1 | YongOptimization | 3,734,147 | GOT-BSI-OPF | 3,297,763 | GravityX | 733,923 | Electric-Stampede | 458,700 | Artelys_Columbia | 301,805 | 1.32E-01 |
| C3E3N04224D2 | 133 | 0 | GOT-BSI-OPF | 3,993,957 | YongOptimization | 3,796,545 | GravityX | 651,857 | Electric-Stampede | 450,387 | Artelys_Columbia | 328,233 | 5.20E-02 |
| C3E3N04224D2 | 136 | 1 | GOT-BSI-OPF | 2,926,228 | YongOptimization | 2,770,578 | GravityX | 539,066 | TIM-GO | 326,406 | Electric-Stampede | 217,205 | 5.62E-02 |
| C3E3N04224D2 | 136 | 0 | YongOptimization | 2,987,825 | GOT-BSI-OPF | 2,974,463 | GravityX | 551,756 | TIM-GO | 308,077 | Artelys_Columbia | 222,094 | 4.49E-03 |
| C3E3N04224D2 | 137 | 1 | GOT-BSI-OPF | 2,960,791 | YongOptimization | 2,864,936 | GravityX | 508,042 | TIM-GO | 313,316 | Electric-Stampede | 236,872 | 3.35E-02 |
| C3E3N04224D2 | 137 | 0 | GOT-BSI-OPF | 3,061,157 | YongOptimization | 2,895,496 | GravityX | 536,322 | TIM-GO | 307,791 | Electric-Stampede | 237,855 | 5.72E-02 |
| C3E3N04224D2 | 138 | 1 | GOT-BSI-OPF | 2,899,972 | YongOptimization | 2,789,821 | GravityX | 538,867 | TIM-GO | 334,034 | Artelys_Columbia | 232,482 | 3.95E-02 |
| C3E3N04224D2 | 138 | 0 | GOT-BSI-OPF | 2,795,334 | YongOptimization | 2,789,337 | GravityX | 509,863 | TIM-GO | 306,424 | Artelys_Columbia | 225,453 | 2.15E-03 |
| C3E3N04224D2 | 141 | 1 | GOT-BSI-OPF | 3,011,477 | YongOptimization | 2,519,728 | GravityX | 488,566 | TIM-GO | 301,499 | Electric-Stampede | 186,264 | 1.95E-01 |
| C3E3N04224D2 | 141 | 0 | GOT-BSI-OPF | 2,957,379 | YongOptimization | 2,585,664 | GravityX | 477,645 | TIM-GO | 278,957 | Artelys_Columbia | 229,226 | 1.44E-01 |
| C3E3N04224D2 | 142 | 1 | YongOptimization | 2,916,700 | GOT-BSI-OPF | 2,829,495 | GravityX | 514,473 | TIM-GO | 339,721 | Artelys_Columbia | 189,253 | 3.08E-02 |
| C3E3N04224D2 | 142 | 0 | YongOptimization | 2,838,970 | GOT-BSI-OPF | 2,786,187 | GravityX | 540,555 | TIM-GO | 312,397 | Artelys_Columbia | 228,115 | 1.89E-02 |
| C3E3N04224D2 | 143 | 1 | GOT-BSI-OPF | 4,038,300 | YongOptimization | 3,747,437 | GravityX | 738,353 | Electric-Stampede | 464,307 | TIM-GO | 422,261 | 7.76E-02 |
| C3E3N04224D2 | 143 | 0 | GOT-BSI-OPF | 4,038,300 | YongOptimization | 3,789,280 | GravityX | 713,374 | Electric-Stampede | 441,327 | TIM-GO | 416,404 | 6.57E-02 |
| C3E3N04224D2 | 146 | 1 | YongOptimization | 2,859,323 | GOT-BSI-OPF | 2,831,388 | GravityX | 532,810 | TIM-GO | 336,231 | Artelys_Columbia | 218,490 | 9.87E-03 |
| C3E3N04224D2 | 146 | 0 | YongOptimization | 2,889,820 | GOT-BSI-OPF | 2,704,609 | GravityX | 514,089 | TIM-GO | 310,466 | Artelys_Columbia | 251,709 | 6.85E-02 |
| C3E3N04224D2 | 147 | 1 | YongOptimization | 2,880,804 | GOT-BSI-OPF | 2,848,784 | GravityX | 553,998 | TIM-GO | 337,405 | Artelys_Columbia | 239,566 | 1.12E-02 |
| C3E3N04224D2 | 147 | 0 | GOT-BSI-OPF | 2,894,244 | YongOptimization | 2,880,266 | GravityX | 544,533 | TIM-GO | 314,695 | Artelys_Columbia | 222,093 | 4.85E-03 |
| C3E3N04224D2 | 148 | 1 | GOT-BSI-OPF | 2,656,337 | YongOptimization | 2,234,029 | GravityX | 497,466 | TIM-GO | 335,841 | Artelys_Columbia | 216,790 | 1.89E-01 |
| C3E3N04224D2 | 148 | 0 | GOT-BSI-OPF | 2,778,312 | YongOptimization | 2,737,534 | GravityX | 538,468 | TIM-GO | 339,086 | Artelys_Columbia | 257,259 | 1.49E-02 |
| C3E3N04224D3 | 131 | 1 | YongOptimization | 11,967,785 | GOT-BSI-OPF | 8,660,032 | GravityX | 1,332,799 | TIM-GO | 918,773 | Electric-Stampede | 594,556 | 3.82E-01 |
| C3E3N04224D3 | 131 | 0 | YongOptimization | 11,789,513 | GOT-BSI-OPF | 9,049,247 | TIM-GO | 924,063 | Artelys_Columbia | 789,070 | Electric-Stampede | 588,338 | 3.03E-01 |
| C3E3N04224D3 | 132 | 1 | YongOptimization | 14,238,156 | GOT-BSI-OPF | 10,733,618 | GravityX | 1,393,646 | TIM-GO | 1,184,232 | Electric-Stampede | 881,633 | 3.27E-01 |
| C3E3N04224D3 | 132 | 0 | YongOptimization | 14,342,386 | GOT-BSI-OPF | 11,638,863 | GravityX | 1,282,411 | TIM-GO | 1,279,875 | Artelys_Columbia | 960,861 | 2.32E-01 |
| C3E3N04224D3 | 133 | 1 | YongOptimization | 18,081,582 | GOT-BSI-OPF | 14,703,973 | GravityX | 1,836,380 | TIM-GO | 1,647,531 | Electric-Stampede | 1,470,462 | 2.30E-01 |
| C3E3N04224D3 | 133 | 0 | YongOptimization | 18,960,728 | GOT-BSI-OPF | 13,882,522 | GravityX | 1,997,688 | Artelys_Columbia | 1,796,215 | TIM-GO | 1,762,386 | 3.66E-01 |
| C3E3N04224D3 | 141 | 1 | YongOptimization | 11,451,517 | GOT-BSI-OPF | 9,313,301 | TIM-GO | 1,092,601 | GravityX | 617,777 | Electric-Stampede | 606,946 | 2.30E-01 |
| C3E3N04224D3 | 141 | 0 | YongOptimization | 11,368,989 | GOT-BSI-OPF | 9,259,776 | GravityX | 1,353,514 | TIM-GO | 1,068,339 | Artelys_Columbia | 800,928 | 2.28E-01 |
| C3E3N04224D3 | 142 | 1 | YongOptimization | 14,255,673 | GOT-BSI-OPF | 11,855,852 | GravityX | 1,305,012 | TIM-GO | 1,226,455 | Artelys_Columbia | 987,829 | 2.02E-01 |
| C3E3N04224D3 | 142 | 0 | YongOptimization | 14,470,567 | GOT-BSI-OPF | 10,980,136 | GravityX | 1,420,095 | TIM-GO | 1,328,348 | Artelys_Columbia | 1,103,545 | 3.18E-01 |
| C3E3N04224D3 | 143 | 1 | YongOptimization | 17,972,281 | GOT-BSI-OPF | 14,121,573 | GravityX | 2,008,197 | TIM-GO | 1,768,251 | Electric-Stampede | 1,321,846 | 2.73E-01 |
| C3E3N04224D3 | 143 | 0 | YongOptimization | 18,837,561 | GOT-BSI-OPF | 14,534,485 | GravityX | 1,923,226 | Artelys_Columbia | 1,732,518 | TIM-GO | 1,665,987 | 2.96E-01 |
| C3E3N06049D1 | 31 | 1 | GOT-BSI-OPF | 824,548 | Electric-Stampede | 564,566 | TIM-GO | 176,426 | Artelys_Columbia | 162,576 | The Blackouts | 109,447 | 4.61E-01 |
| C3E3N06049D1 | 32 | 1 | GOT-BSI-OPF | 830,505 | Electric-Stampede | 484,782 | GravityX | 222,626 | TIM-GO | 213,148 | Artelys_Columbia | 196,081 | 7.13E-01 |
| C3E3N06049D1 | 33 | 1 | YongOptimization | 952,527 | GOT-BSI-OPF | 825,652 | Electric-Stampede | 674,388 | GravityX | 356,807 | TIM-GO | 263,199 | 1.54E-01 |
| C3E3N06049D1 | 41 | 1 | Electric-Stampede | 816,787 | GOT-BSI-OPF | 547,311 | Artelys_Columbia | 225,382 | TIM-GO | 176,210 | The Blackouts | 104,683 | 4.92E-01 |
| C3E3N06049D1 | 42 | 1 | Electric-Stampede | 1,264,431 | GOT-BSI-OPF | 742,889 | GravityX | 215,972 | TIM-GO | 212,609 | Artelys_Columbia | 186,622 | 7.02E-01 |
| C3E3N06049D1 | 43 | 1 | Electric-Stampede | 1,246,769 | GOT-BSI-OPF | 756,186 | YongOptimization | 702,369 | GravityX | 367,334 | Artelys_Columbia | 266,164 | 6.49E-01 |
| C3E3N06049D2 | 31 | 1 | GOT-BSI-OPF | 2,264,712 | GravityX | 334,238 | Electric-Stampede | 324,870 | TIM-GO | 108,685 | Artelys_Columbia | 82,743 | 5.78E+00 |
| C3E3N06049D2 | 32 | 1 | GOT-BSI-OPF | 570,107 | GravityX | 470,652 | YongOptimization | 441,457 | Electric-Stampede | 434,680 | TIM-GO | 125,531 | 2.11E-01 |
| C3E3N06049D2 | 33 | 1 | YongOptimization | 2,607,358 | GOT-BSI-OPF | 1,513,577 | Electric-Stampede | 679,025 | GravityX | 559,697 | TIM-GO | 112,889 | 7.23E-01 |
| C3E3N06049D2 | 41 | 1 | GOT-BSI-OPF | 2,167,758 | Electric-Stampede | 281,753 | GravityX | 278,690 | YongOptimization | 168,282 | TIM-GO | 123,209 | 6.69E+00 |
| C3E3N06049D2 | 42 | 1 | GOT-BSI-OPF | 660,950 | YongOptimization | 577,097 | GravityX | 442,725 | Electric-Stampede | 346,868 | TIM-GO | 123,817 | 1.45E-01 |
| C3E3N06049D2 | 43 | 1 | GOT-BSI-OPF | 1,476,866 | YongOptimization | 1,364,113 | GravityX | 578,843 | Electric-Stampede | 527,022 | TIM-GO | 127,414 | 8.27E-02 |
| C3E3N06049D3 | 31 | 1 | GOT-BSI-OPF | 8,423,997 | GravityX | 1,313,331 | YongOptimization | 1,275,839 | Electric-Stampede | 727,083 | TIM-GO | 432,936 | 5.41E+00 |
| C3E3N06049D3 | 32 | 1 | GOT-BSI-OPF | 9,545,756 | Electric-Stampede | 1,717,545 | GravityX | 1,600,359 | YongOptimization | 1,415,330 | TIM-GO | 532,683 | 4.56E+00 |
| C3E3N06049D3 | 33 | 1 | GOT-BSI-OPF | 11,348,885 | Electric-Stampede | 2,092,557 | GravityX | 2,075,565 | YongOptimization | 1,796,511 | TIM-GO | 762,485 | 4.42E+00 |
| C3E3N06049D3 | 41 | 1 | GOT-BSI-OPF | 8,731,774 | GravityX | 1,189,351 | Electric-Stampede | 771,930 | TIM-GO | 442,051 | Artelys_Columbia | 151,836 | 6.34E+00 |
| C3E3N06049D3 | 42 | 1 | GOT-BSI-OPF | 10,424,900 | Electric-Stampede | 1,895,020 | GravityX | 1,882,328 | YongOptimization | 1,873,532 | TIM-GO | 537,905 | 4.50E+00 |
| C3E3N06049D3 | 43 | 1 | GOT-BSI-OPF | 9,680,352 | Electric-Stampede | 2,992,263 | GravityX | 2,070,756 | TIM-GO | 693,812 | Artelys_Columbia | 616,744 | 2.24E+00 |
| C3E3N06708D1 | 11 | 1 | LLGoMax | 2,555,275 | GOT-BSI-OPF | 2,505,178 | YongOptimization | 2,032,455 | The Blackouts | 1,275,141 | 2.00E-02 | ||
| C3E3N06708D1 | 12 | 1 | YongOptimization | 1,156,572 | GravityX | 989,384 | The Blackouts | 953,253 | GOT-BSI-OPF | 101,587 | 1.69E-01 | ||
| C3E3N06708D1 | 13 | 1 | LLGoMax | 3,042,590 | YongOptimization | 1,934,244 | GOT-BSI-OPF | 1,398,225 | Electric-Stampede | 574,511 | 5.73E-01 | ||
| C3E3N06708D2 | 11 | 1 | Electric-Stampede | 9,519,490 | GOT-BSI-OPF | 7,702,982 | LLGoMax | 6,354,581 | YongOptimization | 4,448,508 | Artelys_Columbia | 1,015,323 | 2.36E-01 |
| C3E3N06708D2 | 12 | 1 | Electric-Stampede | 9,754,142 | YongOptimization | 3,895,408 | GravityX | 936,309 | GOT-BSI-OPF | 698,014 | Artelys_Columbia | 648,408 | 1.50E+00 |
| C3E3N06708D2 | 13 | 1 | Electric-Stampede | 9,789,970 | LLGoMax | 5,372,919 | YongOptimization | 4,610,965 | GOT-BSI-OPF | 2,847,123 | GravityX | 771,288 | 8.22E-01 |
| C3E3N06708D3 | 11 | 1 | GOT-BSI-OPF | 77,928,837 | Electric-Stampede | 40,529,635 | LLGoMax | 17,456,955 | YongOptimization | 17,142,104 | GravityX | 3,252,221 | 9.23E-01 |
| C3E3N06708D3 | 12 | 1 | GOT-BSI-OPF | 49,927,301 | Electric-Stampede | 38,158,725 | YongOptimization | 14,842,367 | LLGoMax | 12,191,343 | GravityX | 2,956,480 | 3.08E-01 |
| C3E3N06708D3 | 13 | 1 | GOT-BSI-OPF | 62,333,515 | Electric-Stampede | 48,937,884 | YongOptimization | 19,382,792 | GravityX | 2,956,999 | TIM-GO | 1,379,633 | 2.74E-01 |
| C3E3N06717D1 | 31 | 1 | Electric-Stampede | 1,091,360 | YongOptimization | 304,167 | TIM-GO | 224,786 | 2.59E+00 | ||||
| C3E3N06717D1 | 32 | 1 | Electric-Stampede | 1,390,649 | YongOptimization | 312,619 | TIM-GO | 255,101 | 3.45E+00 | ||||
| C3E3N06717D1 | 33 | 1 | Electric-Stampede | 1,775,244 | TIM-GO | 379,805 | YongOptimization | 271,265 | 3.67E+00 | ||||
| C3E3N06717D1 | 41 | 1 | Electric-Stampede | 649,811 | YongOptimization | 302,950 | TIM-GO | 235,577 | 1.14E+00 | ||||
| C3E3N06717D1 | 42 | 1 | Electric-Stampede | 1,487,558 | YongOptimization | 347,904 | TIM-GO | 268,194 | 3.28E+00 | ||||
| C3E3N06717D1 | 43 | 1 | Electric-Stampede | 1,488,356 | TIM-GO | 385,752 | YongOptimization | 261,196 | 2.86E+00 | ||||
| C3E3N06717D1 | 46 | 1 | Electric-Stampede | 930,311 | YongOptimization | 319,910 | TIM-GO | 271,981 | 1.91E+00 | ||||
| C3E3N06717D1 | 47 | 1 | Electric-Stampede | 1,399,768 | YongOptimization | 361,206 | TIM-GO | 274,285 | 2.88E+00 | ||||
| C3E3N06717D1 | 48 | 1 | Electric-Stampede | 1,368,558 | TIM-GO | 282,707 | YongOptimization | 279,238 | 3.84E+00 | ||||
| C3E3N08316D1 | 1 | 1 | YongOptimization | 7,079,651 | Electric-Stampede | 4,506,762 | LLGoMax | 3,656,202 | GOT-BSI-OPF | 2,488,669 | TIM-GO | 2,255,772 | 5.71E-01 |
| C3E3N08316D2 | 1 | 1 | Electric-Stampede | 14,319,934 | GOT-BSI-OPF | 9,239,987 | YongOptimization | 9,192,684 | LLGoMax | 9,150,134 | GravityX | 3,958,964 | 5.50E-01 |
| C3E3N08316D3 | 1 | 1 | YongOptimization | 60,843,524 | LLGoMax | 35,087,169 | GOT-BSI-OPF | 34,318,388 | Electric-Stampede | 19,996,068 | GravityX | 14,907,350 | 7.34E-01 |
| C3E3N23643D1 | 3 | 1 | TIM-GO | 10,751 | Artelys_Columbia | 5,592 | 9.23E-01 | ||||||
| ensemble 1 | 1,186,583,188 | ensemble 2 | 791,518,866 | ensemble 3 | 347,747,810 | e1/e2 -1 | 4.99E-01 | e2/e3 - 1 | 1.28E+00 | ||||
| max (hard) | 6.69E+00 | ||||||||||||
| min (easy) | 2.15E-03 |
The following table is similar to the Top 5 Scores excluding Benchmark table above but instead of Scores, the measure is Speed from the table above.
| Team | No. of top 5 speeds |
| YongOptimization | 129 |
| GOT-BSI-OPF | 123 |
| GravityX | 118 |
| TIM-GO | 106 |
| Electric-Stampede | 99 |
| Artelys_Columbia | 64 |
| LLGoMax | 18 |
| The Blackouts | 4 |