Challenge 2 Trial 3 supplemental information

Below is how each team ranked for the synthetic and industry data subsets. Ensemble is the set of best scores for a Division.

MSgain for 54 synthetic Trial 3 scenarios
Division 1 Division 2 Division 3 Division 4
Ensemble 207,215,328 Ensemble 210,524,387 Ensemble 206,581,708 Ensemble 210,300,837
NU_Columbia_Artelys 164,422,061 NU_Columbia_Artelys 175,809,366 NU_Columbia_Artelys 166,014,926 NU_Columbia_Artelys 175,277,306
Electric Stampede 160,074,394 GravityX 165,284,311 Electric Stampede 160,074,393 GravityX 158,950,379
GravityX 144,350,499 GMI-GO 138,248,441 Pearl Street Technologies 132,110,858 GMI-GO 138,246,369
Pearl Street Technologies 132,110,858 Electric Stampede 137,131,802 Gordian Knot 124,813,483 Electric Stampede 136,584,841
Gordian Knot 124,909,479 Pearl Street Technologies 132,110,858 GravityX 118,690,610 Pearl Street Technologies 132,110,858
GOT-BSI-OPF 106,879,083 magos 129,848,583 GOT-BSI-OPF 106,879,083 magos 129,848,583
GMI-GO 66,976,214 ARPA-e Benchmark 122,490,777 GMI-GO 66,990,303 ARPA-e Benchmark 122,474,239
ARPA-e Benchmark 49,947,791 GOT-BSI-OPF 106,879,083 ARPA-e Benchmark 47,329,390 GOT-BSI-OPF 106,879,083
magos 41,153,405 SUGAR-CMU 103,993,746 magos 41,153,405 SUGAR-CMU 103,781,578
SUGAR-CMU 32,697,483 Gordian Knot 84,243,295 Monday Mornings 34,767,209 Monday Mornings 87,323,154
Monday Mornings 29,979,326 Monday Mornings 78,087,182 SUGAR-CMU 32,664,818 Gordian Knot 80,928,506
GERS USA 23,967,660 GERS USA 22,664,924 GERS USA 23,333,573 GERS USA 25,273,414
CasePower 0 CasePower 0 CasePower 0 CasePower 0
GO-SNIP 0 GO-SNIP 0 GO-SNIP 0 GO-SNIP 0
M&H Grid Solutions 0 M&H Grid Solutions 0 M&H Grid Solutions 0 M&H Grid Solutions 0

 

MSgain for 12 industry Trial 3 scenarios
Division 1 Division 2 Division 3 Division 4
Ensemble 33,070,297 Ensemble 33,493,321 Ensemble 33,047,706 Ensemble 33,494,193
GMI-GO 32,601,792 GMI-GO 32,603,023 GMI-GO 32,603,190 GMI-GO 32,602,575
magos 31,606,787 NU_Columbia_Artelys 32,442,503 magos 31,606,787 NU_Columbia_Artelys 32,444,380
Electric Stampede 30,490,271 magos 31,405,385 Electric Stampede 30,491,255 magos 31,405,385
Pearl Street Technologies 29,765,198 Electric Stampede 30,589,892 Pearl Street Technologies 29,765,198 Electric Stampede 30,625,634
GravityX 27,124,069 Pearl Street Technologies 29,765,198 GravityX 25,272,039 Pearl Street Technologies 29,765,198
Gordian Knot 21,414,419 Monday Mornings 27,430,577 Gordian Knot 22,485,213 GravityX 28,047,097
Monday Mornings 12,021,269 GravityX 25,309,843 Monday Mornings 12,878,364 Monday Mornings 27,678,676
NU_Columbia_Artelys 5,497,046 Gordian Knot 24,170,932 NU_Columbia_Artelys 5,482,625 ARPA-e Benchmark 23,866,397
GOT-BSI-OPF 1,001,921 ARPA-e Benchmark 23,865,824 GOT-BSI-OPF 1,001,921 Gordian Knot 22,014,066
GERS USA 81,289 GOT-BSI-OPF 1,958,507 GERS USA 81,268 GOT-BSI-OPF 1,958,507
ARPA-e Benchmark 0 GERS USA 81,197 ARPA-e Benchmark 0 GERS USA 81,243
CasePower 0 CasePower 0 CasePower 0 CasePower 0
GO-SNIP 0 GO-SNIP 0 GO-SNIP 0 GO-SNIP 0
M&H Grid Solutions 0 M&H Grid Solutions 0 M&H Grid Solutions 0 M&H Grid Solutions 0
SUGAR-CMU 0 SUGAR-CMU 0 SUGAR-CMU 0 SUGAR-CMU 0

Best Scores

This table gives the number of best scenario scores a team achieved in each division and overall.

team Division 1 team Division 2 team Division 3 team Division 4 team  All Divisions
GravityX 32 GravityX 37 GravityX 23 GravityX 32 GravityX 124
NU_Columbia_Artelys 17 NU_Columbia_Artelys 23 NU_Columbia_Artelys 20 NU_Columbia_Artelys 26 NU_Columbia_Artelys 86
GMI-GO 6 Pearl Street Technologies 5 GMI-GO 7 Pearl Street Technologies 5 Pearl Street Technologies 20
Pearl Street Technologies 5 GMI-GO 1 Electric Stampede 5 Electric Stampede 1 GMI-GO 15
Gordian Knot 4     Pearl Street Technologies 5 GMI-GO 1 Electric Stampede 8
Electric Stampede 2     Gordian Knot 3 Gordian Knot 1 Gordian Knot 8
        Monday Mornings 3     Monday Mornings 3

The following lists the best MSgain1 for each scenario and the its percent increase over the second best, MSgain2 for each division. Industry datasets are highlighted.

Top 2 Division 1 Scenario Scores
model scenario Team 1 MSgain1  Team 2 MSgain2  (g1/g2)-1
C2T3N02020 6 GravityX 2,198,099 NU_Columbia_Artelys 2,197,574 0.02%
C2T3N02020 9 GravityX 2,139,741 GMI-GO 2,137,600 0.10%
C2T3N02020 13 GravityX 1,642,256 GMI-GO 1,640,277 0.12%
C2T3N02020 207 GravityX 131,005 NU_Columbia_Artelys 130,977 0.02%
C2T3N02020 222 GravityX 443,018 NU_Columbia_Artelys 443,009 0.00%
C2T3N03022 122 NU_Columbia_Artelys 1,991,572 GravityX 1,567,072 27.09%
C2T3N03022 162 GravityX 1,420,593 NU_Columbia_Artelys 1,344,156 5.69%
C2T3N03022 292 NU_Columbia_Artelys 1,801,741 GravityX 1,790,802 0.61%
C2T3N03022 362 GravityX 1,548,013 NU_Columbia_Artelys 1,412,549 9.59%
C2T3N03022 812 GravityX 1,453,858 NU_Columbia_Artelys 1,452,673 0.08%
C2T3N03593 2 Pearl Street Technologies 301,931 GravityX 275,578 9.56%
C2T3N03593 5 Pearl Street Technologies 308,089 GravityX 278,909 10.46%
C2T3N03593 9 Pearl Street Technologies 309,576 magos 231,398 33.78%
C2T3N03593 10 Pearl Street Technologies 347,879 GravityX 342,178 1.67%
C2T3N03593 22 Pearl Street Technologies 332,916 GravityX 329,276 1.11%
C2T3N04200 9 GravityX 1,572,644 Electric Stampede 1,570,365 0.15%
C2T3N04200 16 GravityX 1,644,605 Gordian Knot 1,636,101 0.52%
C2T3N04200 28 GravityX 1,637,435 NU_Columbia_Artelys 1,636,598 0.05%
C2T3N04200 59 GravityX 1,683,572 NU_Columbia_Artelys 1,682,406 0.07%
C2T3N04200 83 GravityX 2,052,282 Gordian Knot 2,040,869 0.56%
C2T3N04917 72 NU_Columbia_Artelys 2,318,938 Electric Stampede 1,803,703 28.57%
C2T3N04917 112 NU_Columbia_Artelys 3,973,674 Pearl Street Technologies 2,980,147 33.34%
C2T3N04917 132 NU_Columbia_Artelys 2,427,851 Electric Stampede 1,831,817 32.54%
C2T3N04917 192 NU_Columbia_Artelys 2,240,765 Electric Stampede 1,835,154 22.10%
C2T3N04917 602 GravityX 1,849,845 Electric Stampede 1,755,868 5.35%
C2T3N06100 14 NU_Columbia_Artelys 1,104,561 GravityX 1,104,545 0.00%
C2T3N06100 39 GravityX 1,931,978 Gordian Knot 1,927,229 0.25%
C2T3N06100 101 GravityX 1,238,118 NU_Columbia_Artelys 1,235,350 0.22%
C2T3N06100 112 GravityX 1,073,478 NU_Columbia_Artelys 1,072,552 0.09%
C2T3N06100 115 GravityX 929,249 Gordian Knot 925,218 0.44%
C2T3N07000 11 GravityX 2,431,945 NU_Columbia_Artelys 2,422,586 0.39%
C2T3N07000 20 GravityX 2,883,094 Electric Stampede 2,847,804 1.24%
C2T3N07000 56 GravityX 2,637,142 Electric Stampede 2,605,230 1.22%
C2T3N07000 60 GravityX 2,914,744 Electric Stampede 2,902,781 0.41%
C2T3N07000 65 GravityX 2,771,725 NU_Columbia_Artelys 2,767,467 0.15%
C2T3N08300 27 NU_Columbia_Artelys 3,315,363 GravityX 3,315,024 0.01%
C2T3N08300 32 GravityX 2,997,665 NU_Columbia_Artelys 2,986,226 0.38%
C2T3N08300 34 GravityX 2,606,036 NU_Columbia_Artelys 2,600,840 0.20%
C2T3N08300 52 NU_Columbia_Artelys 2,995,999 GravityX 2,995,524 0.02%
C2T3N08300 91 GravityX 2,500,679 NU_Columbia_Artelys 2,497,430 0.13%
C2T3N10000 502 GravityX 1,747,519 NU_Columbia_Artelys 1,640,156 6.55%
C2T3N10000 510 GravityX 2,367,158 NU_Columbia_Artelys 2,272,157 4.18%
C2T3N10000 602 GravityX 1,862,938 NU_Columbia_Artelys 1,859,590 0.18%
C2T3N10000 713 GravityX 2,497,739 NU_Columbia_Artelys 2,496,443 0.05%
C2T3N10000 723 NU_Columbia_Artelys 2,890,257 Electric Stampede 2,609,717 10.75%
C2T3N12209 6 NU_Columbia_Artelys 1,405,736 magos 1,390,478 1.10%
C2T3N12209 14 NU_Columbia_Artelys 236,989 Electric Stampede 230,325 2.89%
C2T3N12209 27 NU_Columbia_Artelys 222,283 Electric Stampede 216,921 2.47%
C2T3N12209 32 GravityX 206,345 NU_Columbia_Artelys 197,360 4.55%
C2T3N12209 63 NU_Columbia_Artelys 263,785 Electric Stampede 254,083 3.82%
C2T3N16955 5 GravityX 12,060,966 GMI-GO 12,036,977 0.20%
C2T3N16955 6 GMI-GO 12,037,007 GravityX 11,979,190 0.48%
C2T3N22700 2 GMI-GO 1,682,191 Electric Stampede 1,639,027 2.63%
C2T3N22700 3 GMI-GO 1,271,340 Electric Stampede 1,236,658 2.80%
C2T3N22700 4 GMI-GO 1,482,517 Pearl Street Technologies 1,471,856 0.72%
C2T3N22700 7 GMI-GO 1,623,969 Electric Stampede 1,594,007 1.88%
C2T3N22700 8 GMI-GO 1,311,915 Electric Stampede 1,271,550 3.17%
C2T3N30000 631 Gordian Knot 1,839,321 Electric Stampede 1,740,169 5.70%
C2T3N30000 635 Gordian Knot 1,685,038 Pearl Street Technologies 1,288,666 30.76%
C2T3N30000 714 Gordian Knot 1,991,516 GravityX 1,492,468 33.44%
C2T3N30000 724 Gordian Knot 1,851,699 Electric Stampede 1,840,654 0.60%
C2T3N30000 740 Electric Stampede 2,026,511 Pearl Street Technologies 1,477,280 37.18%
C2T3N31777 3 Electric Stampede 2,566,668 NU_Columbia_Artelys 2,554,950 0.46%
C2T3N31777 8 NU_Columbia_Artelys 26,141,714 GravityX 26,055,068 0.33%
C2T3N31777 10 NU_Columbia_Artelys 25,991,224 GravityX 25,905,784 0.33%
C2T3N31777 12 NU_Columbia_Artelys 25,847,308 Electric Stampede 25,406,779 1.73%
    Ensemble 207,215,328 Ensemble 2 200,711,179 3.24%

 

Top 2 Division 2 Scenario Scores
model scenario Team 1 MSgain1  Team 2 MSgain2  (g1/g2)-1
C2T3N02020 6 GravityX 2,198,099 NU_Columbia_Artelys 2,197,574 0.02%
C2T3N02020 9 GravityX 2,139,741 GMI-GO 2,137,600 0.10%
C2T3N02020 13 GravityX 1,642,256 GMI-GO 1,640,277 0.12%
C2T3N02020 207 GravityX 131,005 NU_Columbia_Artelys 130,977 0.02%
C2T3N02020 222 GravityX 443,018 NU_Columbia_Artelys 443,009 0.00%
C2T3N03022 122 NU_Columbia_Artelys 2,058,098 GravityX 1,690,483 21.75%
C2T3N03022 162 GravityX 1,420,593 NU_Columbia_Artelys 1,410,141 0.74%
C2T3N03022 292 NU_Columbia_Artelys 1,801,742 GravityX 1,790,802 0.61%
C2T3N03022 362 GravityX 1,548,011 NU_Columbia_Artelys 1,509,830 2.53%
C2T3N03022 812 NU_Columbia_Artelys 1,452,673 GravityX 1,441,592 0.77%
C2T3N03593 2 Pearl Street Technologies 301,931 GravityX 261,814 15.32%
C2T3N03593 5 Pearl Street Technologies 308,089 NU_Columbia_Artelys 249,461 23.50%
C2T3N03593 9 Pearl Street Technologies 309,576 NU_Columbia_Artelys 243,947 26.90%
C2T3N03593 10 Pearl Street Technologies 347,879 NU_Columbia_Artelys 291,239 19.45%
C2T3N03593 22 Pearl Street Technologies 332,916 GravityX 307,538 8.25%
C2T3N04200 9 GravityX 1,572,644 Electric Stampede 1,570,365 0.15%
C2T3N04200 16 GravityX 1,644,605 NU_Columbia_Artelys 1,638,159 0.39%
C2T3N04200 28 GravityX 1,637,435 NU_Columbia_Artelys 1,636,422 0.06%
C2T3N04200 59 GravityX 1,683,572 NU_Columbia_Artelys 1,677,284 0.37%
C2T3N04200 83 GravityX 2,052,282 Gordian Knot 2,040,869 0.56%
C2T3N04917 72 NU_Columbia_Artelys 2,331,772 Electric Stampede 1,814,683 28.49%
C2T3N04917 112 NU_Columbia_Artelys 3,985,178 Pearl Street Technologies 2,980,147 33.72%
C2T3N04917 132 NU_Columbia_Artelys 2,437,566 Electric Stampede 1,822,615 33.74%
C2T3N04917 192 NU_Columbia_Artelys 2,264,676 Pearl Street Technologies 1,335,974 69.52%
C2T3N04917 602 GravityX 1,849,845 NU_Columbia_Artelys 1,695,442 9.11%
C2T3N06100 14 NU_Columbia_Artelys 1,104,797 GravityX 1,104,545 0.02%
C2T3N06100 39 GravityX 1,931,978 NU_Columbia_Artelys 1,928,073 0.20%
C2T3N06100 101 GravityX 1,238,118 NU_Columbia_Artelys 1,235,350 0.22%
C2T3N06100 112 GravityX 1,073,478 NU_Columbia_Artelys 1,073,360 0.01%
C2T3N06100 115 NU_Columbia_Artelys 929,550 GravityX 929,249 0.03%
C2T3N07000 11 GravityX 2,431,945 NU_Columbia_Artelys 2,427,779 0.17%
C2T3N07000 20 GravityX 2,882,973 NU_Columbia_Artelys 2,872,622 0.36%
C2T3N07000 56 GravityX 2,637,145 NU_Columbia_Artelys 2,618,531 0.71%
C2T3N07000 60 GravityX 2,914,744 NU_Columbia_Artelys 2,901,688 0.45%
C2T3N07000 65 GravityX 2,771,725 NU_Columbia_Artelys 2,767,467 0.15%
C2T3N08300 27 NU_Columbia_Artelys 3,315,363 GravityX 3,315,024 0.01%
C2T3N08300 32 GravityX 2,997,665 NU_Columbia_Artelys 2,986,226 0.38%
C2T3N08300 34 NU_Columbia_Artelys 2,606,627 GravityX 2,606,036 0.02%
C2T3N08300 52 NU_Columbia_Artelys 2,995,999 GravityX 2,995,524 0.02%
C2T3N08300 91 GravityX 2,500,679 NU_Columbia_Artelys 2,498,467 0.09%
C2T3N10000 502 GravityX 1,745,442 NU_Columbia_Artelys 1,670,881 4.46%
C2T3N10000 510 GravityX 2,365,667 NU_Columbia_Artelys 2,331,411 1.47%
C2T3N10000 602 NU_Columbia_Artelys 1,940,780 GravityX 1,912,475 1.48%
C2T3N10000 713 GravityX 2,562,353 NU_Columbia_Artelys 2,551,947 0.41%
C2T3N10000 723 GravityX 2,978,658 NU_Columbia_Artelys 2,911,434 2.31%
C2T3N12209 6 NU_Columbia_Artelys 1,405,783 GravityX 1,403,384 0.17%
C2T3N12209 14 NU_Columbia_Artelys 236,989 Electric Stampede 230,325 2.89%
C2T3N12209 27 NU_Columbia_Artelys 222,283 Electric Stampede 216,921 2.47%
C2T3N12209 32 GravityX 206,221 NU_Columbia_Artelys 198,147 4.07%
C2T3N12209 63 NU_Columbia_Artelys 264,156 GravityX 256,465 3.00%
C2T3N16955 5 NU_Columbia_Artelys 12,091,194 GMI-GO 12,036,984 0.45%
C2T3N16955 6 NU_Columbia_Artelys 12,094,621 GravityX 12,045,794 0.41%
C2T3N22700 2 NU_Columbia_Artelys 1,738,916 GMI-GO 1,682,365 3.36%
C2T3N22700 3 GMI-GO 1,273,411 Electric Stampede 1,264,321 0.72%
C2T3N22700 4 NU_Columbia_Artelys 1,571,200 GMI-GO 1,483,202 5.93%
C2T3N22700 7 NU_Columbia_Artelys 1,766,303 GMI-GO 1,624,263 8.74%
C2T3N22700 8 NU_Columbia_Artelys 1,357,284 GMI-GO 1,312,071 3.45%
C2T3N30000 631 GravityX 2,160,344 NU_Columbia_Artelys 2,137,499 1.07%
C2T3N30000 635 GravityX 2,136,291 NU_Columbia_Artelys 2,034,088 5.02%
C2T3N30000 714 GravityX 2,321,442 NU_Columbia_Artelys 2,247,552 3.29%
C2T3N30000 724 GravityX 2,526,316 NU_Columbia_Artelys 2,447,463 3.22%
C2T3N30000 740 GravityX 2,266,886 NU_Columbia_Artelys 2,244,639 0.99%
C2T3N31777 3 GravityX 2,722,680 NU_Columbia_Artelys 2,720,901 0.07%
C2T3N31777 8 GravityX 26,224,767 NU_Columbia_Artelys 26,141,692 0.32%
C2T3N31777 10 GravityX 26,091,569 NU_Columbia_Artelys 25,991,313 0.39%
C2T3N31777 12 GravityX 26,024,842 GMI-GO 25,813,642 0.82%
    Ensemble 210,524,387 Ensemble 2 205,129,364 2.63%

 

Top 2 Division 3 Scenario Scores
model scenario Team 1 MSgain1  Team 2 MSgain2  (g1/g2)-1
C2T3N02020 6 GravityX 2,198,096 NU_Columbia_Artelys 2,197,608 0.02%
C2T3N02020 9 GravityX 2,139,741 GMI-GO 2,137,600 0.10%
C2T3N02020 13 GravityX 1,642,256 GMI-GO 1,640,277 0.12%
C2T3N02020 207 GravityX 131,004 NU_Columbia_Artelys 130,977 0.02%
C2T3N02020 222 GravityX 443,022 NU_Columbia_Artelys 443,004 0.00%
C2T3N03022 122 NU_Columbia_Artelys 1,941,278 GMI-GO 1,342,058 44.65%
C2T3N03022 162 NU_Columbia_Artelys 1,271,459 GMI-GO 834,566 52.35%
C2T3N03022 292 NU_Columbia_Artelys 1,756,948 Electric Stampede 1,373,588 27.91%
C2T3N03022 362 GravityX 1,400,411 GMI-GO 912,437 53.48%
C2T3N03022 812 GravityX 1,453,649 NU_Columbia_Artelys 1,452,807 0.06%
C2T3N03593 2 Pearl Street Technologies 301,931 Monday Mornings 280,865 7.50%
C2T3N03593 5 Pearl Street Technologies 308,089 GravityX 286,468 7.55%
C2T3N03593 9 Pearl Street Technologies 309,576 NU_Columbia_Artelys 234,030 32.28%
C2T3N03593 10 Pearl Street Technologies 347,879 NU_Columbia_Artelys 276,236 25.94%
C2T3N03593 22 Pearl Street Technologies 332,916 GravityX 284,909 16.85%
C2T3N04200 9 Monday Mornings 1,574,677 Electric Stampede 1,570,365 0.27%
C2T3N04200 16 Monday Mornings 1,646,456 GravityX 1,642,836 0.22%
C2T3N04200 28 GravityX 1,637,435 NU_Columbia_Artelys 1,636,327 0.07%
C2T3N04200 59 GravityX 1,683,572 NU_Columbia_Artelys 1,682,405 0.07%
C2T3N04200 83 GravityX 2,050,665 Gordian Knot 2,040,869 0.48%
C2T3N04917 72 NU_Columbia_Artelys 2,316,367 Electric Stampede 1,803,703 28.42%
C2T3N04917 112 NU_Columbia_Artelys 3,984,262 Pearl Street Technologies 2,980,147 33.69%
C2T3N04917 132 NU_Columbia_Artelys 2,427,474 Electric Stampede 1,831,817 32.52%
C2T3N04917 192 NU_Columbia_Artelys 2,248,119 Electric Stampede 1,835,154 22.50%
C2T3N04917 602 GravityX 1,818,570 Electric Stampede 1,755,868 3.57%
C2T3N06100 14 GravityX 1,105,026 NU_Columbia_Artelys 1,104,560 0.04%
C2T3N06100 39 GravityX 1,932,517 Monday Mornings 1,928,932 0.19%
C2T3N06100 101 GravityX 1,238,673 NU_Columbia_Artelys 1,238,134 0.04%
C2T3N06100 112 GravityX 1,073,992 Gordian Knot 1,069,377 0.43%
C2T3N06100 115 Monday Mornings 927,118 Gordian Knot 925,218 0.21%
C2T3N07000 11 GravityX 2,431,945 NU_Columbia_Artelys 2,421,855 0.42%
C2T3N07000 20 GravityX 2,847,875 Electric Stampede 2,847,804 0.00%
C2T3N07000 56 Electric Stampede 2,605,230 Gordian Knot 2,558,300 1.83%
C2T3N07000 60 Electric Stampede 2,902,781 NU_Columbia_Artelys 2,901,352 0.05%
C2T3N07000 65 GravityX 2,771,725 NU_Columbia_Artelys 2,771,041 0.02%
C2T3N08300 27 GravityX 3,315,024 NU_Columbia_Artelys 3,313,200 0.06%
C2T3N08300 32 NU_Columbia_Artelys 2,997,759 GravityX 2,997,665 0.00%
C2T3N08300 34 GravityX 2,605,994 NU_Columbia_Artelys 2,600,852 0.20%
C2T3N08300 52 NU_Columbia_Artelys 2,995,586 GravityX 2,995,524 0.00%
C2T3N08300 91 GravityX 2,500,679 NU_Columbia_Artelys 2,497,272 0.14%
C2T3N10000 502 GravityX 1,747,782 NU_Columbia_Artelys 1,641,017 6.51%
C2T3N10000 510 GravityX 2,367,504 NU_Columbia_Artelys 2,274,160 4.10%
C2T3N10000 602 NU_Columbia_Artelys 1,859,659 Electric Stampede 1,816,026 2.40%
C2T3N10000 713 NU_Columbia_Artelys 2,496,453 Electric Stampede 2,384,551 4.69%
C2T3N10000 723 NU_Columbia_Artelys 2,890,730 Electric Stampede 2,609,717 10.77%
C2T3N12209 6 NU_Columbia_Artelys 1,405,486 magos 1,390,478 1.08%
C2T3N12209 14 NU_Columbia_Artelys 236,672 Electric Stampede 230,325 2.76%
C2T3N12209 27 NU_Columbia_Artelys 217,490 Electric Stampede 216,921 0.26%
C2T3N12209 32 NU_Columbia_Artelys 191,676 Electric Stampede 191,371 0.16%
C2T3N12209 63 NU_Columbia_Artelys 262,794 Electric Stampede 254,083 3.43%
C2T3N16955 5 GMI-GO 12,036,778 GravityX 11,971,908 0.54%
C2T3N16955 6 GMI-GO 12,037,781 GravityX 12,023,009 0.12%
C2T3N22700 2 GMI-GO 1,682,609 Electric Stampede 1,639,027 2.66%
C2T3N22700 3 GMI-GO 1,271,226 Electric Stampede 1,236,658 2.80%
C2T3N22700 4 GMI-GO 1,482,885 Pearl Street Technologies 1,471,856 0.75%
C2T3N22700 7 GMI-GO 1,623,969 Electric Stampede 1,594,007 1.88%
C2T3N22700 8 GMI-GO 1,312,067 Electric Stampede 1,271,550 3.19%
C2T3N30000 631 Gordian Knot 1,839,321 Electric Stampede 1,740,169 5.70%
C2T3N30000 635 Gordian Knot 1,685,038 Pearl Street Technologies 1,288,666 30.76%
C2T3N30000 714 Gordian Knot 1,901,662 GravityX 1,499,230 26.84%
C2T3N30000 724 Electric Stampede 1,840,654 GOT-BSI-OPF 1,734,848 6.10%
C2T3N30000 740 Electric Stampede 2,026,511 Pearl Street Technologies 1,477,280 37.18%
C2T3N31777 3 Electric Stampede 2,566,668 NU_Columbia_Artelys 2,556,026 0.42%
C2T3N31777 8 NU_Columbia_Artelys 26,143,938 GravityX 26,055,122 0.34%
C2T3N31777 10 NU_Columbia_Artelys 25,988,873 GravityX 25,905,803 0.32%
C2T3N31777 12 NU_Columbia_Artelys 25,847,706 Electric Stampede 25,406,779 1.74%
    Ensemble 206,581,708 Ensemble 2 198,658,596 3.99%

 

Top 2 Division 4 Scenario Scores
model scenario Team 1 MSgain1  Team 2 MSgain2  (g1/g2)-1
C2T3N02020 6 GravityX 2,198,096 NU_Columbia_Artelys 2,197,608 0.02%
C2T3N02020 9 GravityX 2,139,741 GMI-GO 2,137,600 0.10%
C2T3N02020 13 GravityX 1,642,256 GMI-GO 1,640,277 0.12%
C2T3N02020 207 GravityX 131,004 NU_Columbia_Artelys 130,977 0.02%
C2T3N02020 222 GravityX 443,022 NU_Columbia_Artelys 443,004 0.00%
C2T3N03022 122 NU_Columbia_Artelys 2,058,148 Electric Stampede 1,583,270 29.99%
C2T3N03022 162 NU_Columbia_Artelys 1,410,167 GMI-GO 834,566 68.97%
C2T3N03022 292 NU_Columbia_Artelys 1,801,804 Electric Stampede 1,374,660 31.07%
C2T3N03022 362 NU_Columbia_Artelys 1,509,830 GMI-GO 912,437 65.47%
C2T3N03022 812 NU_Columbia_Artelys 1,452,807 GravityX 1,433,481 1.35%
C2T3N03593 2 Pearl Street Technologies 301,931 GravityX 261,819 15.32%
C2T3N03593 5 Pearl Street Technologies 308,089 NU_Columbia_Artelys 249,464 23.50%
C2T3N03593 9 Pearl Street Technologies 309,576 NU_Columbia_Artelys 243,934 26.91%
C2T3N03593 10 Pearl Street Technologies 347,879 NU_Columbia_Artelys 290,403 19.79%
C2T3N03593 22 Pearl Street Technologies 332,916 GravityX 307,538 8.25%
C2T3N04200 9 Electric Stampede 1,570,365 NU_Columbia_Artelys 1,567,066 0.21%
C2T3N04200 16 GravityX 1,642,836 Gordian Knot 1,636,101 0.41%
C2T3N04200 28 GravityX 1,637,435 NU_Columbia_Artelys 1,636,327 0.07%
C2T3N04200 59 GravityX 1,683,572 NU_Columbia_Artelys 1,682,405 0.07%
C2T3N04200 83 GravityX 2,050,665 Gordian Knot 2,040,869 0.48%
C2T3N04917 72 NU_Columbia_Artelys 2,331,889 Electric Stampede 1,814,777 28.49%
C2T3N04917 112 NU_Columbia_Artelys 4,015,696 Pearl Street Technologies 2,980,147 34.75%
C2T3N04917 132 NU_Columbia_Artelys 2,437,905 Electric Stampede 1,825,339 33.56%
C2T3N04917 192 NU_Columbia_Artelys 2,264,791 Pearl Street Technologies 1,335,974 69.52%
C2T3N04917 602 GravityX 1,813,470 NU_Columbia_Artelys 1,695,442 6.96%
C2T3N06100 14 GravityX 1,105,025 NU_Columbia_Artelys 1,104,560 0.04%
C2T3N06100 39 GravityX 1,932,517 Gordian Knot 1,927,229 0.27%
C2T3N06100 101 GravityX 1,238,689 NU_Columbia_Artelys 1,238,134 0.04%
C2T3N06100 112 GravityX 1,074,007 NU_Columbia_Artelys 1,069,692 0.40%
C2T3N06100 115 Gordian Knot 925,218 GravityX 920,406 0.52%
C2T3N07000 11 GravityX 2,431,945 Monday Mornings 2,431,471 0.02%
C2T3N07000 20 NU_Columbia_Artelys 2,873,288 GravityX 2,855,784 0.61%
C2T3N07000 56 NU_Columbia_Artelys 2,632,413 Gordian Knot 2,558,300 2.90%
C2T3N07000 60 NU_Columbia_Artelys 2,901,352 GravityX 2,883,451 0.62%
C2T3N07000 65 GravityX 2,771,725 NU_Columbia_Artelys 2,771,041 0.02%
C2T3N08300 27 GravityX 3,315,024 NU_Columbia_Artelys 3,313,200 0.06%
C2T3N08300 32 NU_Columbia_Artelys 2,997,759 GravityX 2,997,665 0.00%
C2T3N08300 34 GravityX 2,605,994 NU_Columbia_Artelys 2,600,852 0.20%
C2T3N08300 52 NU_Columbia_Artelys 2,995,863 GravityX 2,995,524 0.01%
C2T3N08300 91 GravityX 2,500,679 NU_Columbia_Artelys 2,497,272 0.14%
C2T3N10000 502 GravityX 1,745,704 NU_Columbia_Artelys 1,641,017 6.38%
C2T3N10000 510 GravityX 2,366,637 NU_Columbia_Artelys 2,274,168 4.07%
C2T3N10000 602 GravityX 1,920,006 NU_Columbia_Artelys 1,859,787 3.24%
C2T3N10000 713 GravityX 2,562,680 NU_Columbia_Artelys 2,496,453 2.65%
C2T3N10000 723 GravityX 2,979,256 NU_Columbia_Artelys 2,890,692 3.06%
C2T3N12209 6 NU_Columbia_Artelys 1,405,805 magos 1,390,478 1.10%
C2T3N12209 14 NU_Columbia_Artelys 236,672 Electric Stampede 230,325 2.76%
C2T3N12209 27 NU_Columbia_Artelys 217,490 Electric Stampede 216,921 0.26%
C2T3N12209 32 NU_Columbia_Artelys 191,676 Electric Stampede 191,371 0.16%
C2T3N12209 63 NU_Columbia_Artelys 263,111 Electric Stampede 254,083 3.55%
C2T3N16955 5 NU_Columbia_Artelys 12,089,641 GravityX 12,058,338 0.26%
C2T3N16955 6 NU_Columbia_Artelys 12,094,169 GMI-GO 12,037,549 0.47%
C2T3N22700 2 NU_Columbia_Artelys 1,739,404 GMI-GO 1,682,272 3.40%
C2T3N22700 3 GMI-GO 1,273,224 Electric Stampede 1,264,321 0.70%
C2T3N22700 4 NU_Columbia_Artelys 1,571,575 GMI-GO 1,483,204 5.96%
C2T3N22700 7 NU_Columbia_Artelys 1,767,030 GMI-GO 1,624,415 8.78%
C2T3N22700 8 NU_Columbia_Artelys 1,358,760 GMI-GO 1,311,996 3.56%
C2T3N30000 631 GravityX 2,159,822 NU_Columbia_Artelys 2,073,814 4.15%
C2T3N30000 635 GravityX 2,136,115 NU_Columbia_Artelys 2,042,364 4.59%
C2T3N30000 714 GravityX 2,321,438 NU_Columbia_Artelys 2,251,940 3.09%
C2T3N30000 724 GravityX 2,527,095 NU_Columbia_Artelys 2,380,577 6.15%
C2T3N30000 740 GravityX 2,266,138 NU_Columbia_Artelys 2,179,378 3.98%
C2T3N31777 3 NU_Columbia_Artelys 2,728,904 GravityX 2,629,317 3.79%
C2T3N31777 8 GravityX 26,172,270 NU_Columbia_Artelys 26,143,788 0.11%
C2T3N31777 10 GravityX 26,075,273 NU_Columbia_Artelys 25,991,313 0.32%
C2T3N31777 12 GravityX 25,993,557 GMI-GO 25,813,488 0.70%
    Ensemble 210,300,837 Ensemble 2 202,833,434 3.68%

Division Differences

One would expect that Divisions 2 or 4, with a 60-minute time limit, would have better MSgain  values than those achieved by Divisions 1 or 3, with a 5-minute time limit, at least for sufficiently large problems. The Competition is also interested in whether or not transmission line and transformer switching can further improve MSgain. The following tables look at these differences, at least from the perspective of the composite MSgain  values.

all 66 scenarios
5 minutes vs. 60 minutes   transmission line and transformer switching allowed vs. transmission line and transformer switching NOT allowed
Division 2 - Division 1   Division 4 - Division 3   Division 3 - Division 1   Division 4 - Division 2
ARPA-e Benchmark 96,408,809   ARPA-e Benchmark 99,011,246   Monday Mornings 5,644,978   Monday Mornings 9,484,071
magos 88,493,776   magos 88,493,776   NU_Columbia_Artelys 1,578,444   GERS USA 2,608,536
SUGAR-CMU 71,296,264   GMI-GO 71,255,450   Gordian Knot 974,798   CasePower 0
GMI-GO 71,273,458   SUGAR-CMU 71,116,760   GMI-GO 15,488   GO-SNIP 0
Monday Mornings 63,517,164   Monday Mornings 67,356,257   Electric Stampede 984   GOT-BSI-OPF 0
NU_Columbia_Artelys 38,332,762   GravityX 43,034,828   CasePower 0   M&H Grid Solutions 0
GravityX 19,119,586   NU_Columbia_Artelys 36,224,136   GO-SNIP 0   magos 0
Ensemble 3,309,059   Ensemble 3,719,129   GOT-BSI-OPF 0   Pearl Street Technologies 0
GOT-BSI-OPF 956,587   GERS USA 1,939,815   M&H Grid Solutions 0   GMI-GO -2,520
CasePower 0   GOT-BSI-OPF 956,587   magos 0   ARPA-e Benchmark -15,964
GO-SNIP 0   CasePower 0   Pearl Street Technologies 0   SUGAR-CMU -212,169
M&H Grid Solutions 0   GO-SNIP 0   SUGAR-CMU -32,665   Ensemble -223,550
Pearl Street Technologies 0   M&H Grid Solutions 0   Ensemble -633,621   Electric Stampede -511,219
GERS USA -1,302,828   Pearl Street Technologies 0   GERS USA -634,108   NU_Columbia_Artelys -530,182
Electric Stampede -22,842,970   Electric Stampede -23,355,173   ARPA-e Benchmark -2,618,401   GravityX -3,596,677
Gordian Knot -37,909,671   Gordian Knot -44,356,124   GravityX -27,511,920   Gordian Knot -5,471,655

 

54 synthetic  scenarios
5 minutes vs. 60 minutes   transmission line and transformer switching allowed vs. transmission line and transformer switching NOT allowed
Division 2 - Division 1   Division 4 - Division 3   Division 3 - Division 1   Division 4 - Division 2
magos 88,695,178   magos 88,695,178   Monday Mornings 4,787,883   Monday Mornings 9,235,972
ARPA-e Benchmark 72,542,986   ARPA-e Benchmark 75,144,849   NU_Columbia_Artelys 1,592,866   GERS USA 2,608,490
SUGAR-CMU 71,296,264   GMI-GO 71,256,065   GMI-GO 14,089   CasePower 0
GMI-GO 71,272,227   SUGAR-CMU 71,116,760   CasePower 0   GO-SNIP 0
Monday Mornings 48,107,856   Monday Mornings 52,555,945   GO-SNIP 0   GOT-BSI-OPF 0
GravityX 20,933,812   GravityX 40,259,770   GOT-BSI-OPF 0   M&H Grid Solutions 0
NU_Columbia_Artelys 11,387,305   NU_Columbia_Artelys 9,262,380   M&H Grid Solutions 0   magos 0
Ensemble 2,886,034   Ensemble 3,272,642   magos 0   Pearl Street Technologies 0
CasePower 0   GERS USA 1,939,841   Pearl Street Technologies 0   GMI-GO -2,072
GO-SNIP 0   CasePower 0   Electric Stampede 0   ARPA-e Benchmark -16,538
GOT-BSI-OPF 0   GO-SNIP 0   SUGAR-CMU -32,665   SUGAR-CMU -212,169
M&H Grid Solutions 0   GOT-BSI-OPF 0   Gordian Knot -95,996   Ensemble -224,422
Pearl Street Technologies 0   M&H Grid Solutions 0   Ensemble -611,030   NU_Columbia_Artelys -532,060
GERS USA -1,302,736   Pearl Street Technologies 0   GERS USA -634,087   Electric Stampede -546,961
Electric Stampede -22,942,592   Electric Stampede -23,489,553   ARPA-e Benchmark -2,618,401   Gordian Knot -3,314,789
Gordian Knot -40,666,183   Gordian Knot -43,884,977   GravityX -25,659,889   GravityX -6,333,932

 

12 industry  scenarios
5 minutes vs. 60 minutes   transmission line and transformer switching allowed vs. transmission line and transformer switching NOT allowed
Division 2 - Division 1   Division 4 - Division 3   Division 3 - Division 1   Division 4 - Division 2
NU_Columbia_Artelys 26,945,457   NU_Columbia_Artelys 26,961,756   Gordian Knot 1,070,794   GravityX 2,737,255
ARPA-e Benchmark 23,865,824   ARPA-e Benchmark 23,866,397   Monday Mornings 857,095   Monday Mornings 248,099
Monday Mornings 15,409,308   Monday Mornings 14,800,312   GMI-GO 1,398   Electric Stampede 35,742
Gordian Knot 2,756,513   GravityX 2,775,059   Electric Stampede 984   NU_Columbia_Artelys 1,877
GOT-BSI-OPF 956,587   GOT-BSI-OPF 956,587   ARPA-e Benchmark 0   Ensemble 872
Ensemble 423,024   Ensemble 446,487   CasePower 0   ARPA-e Benchmark 573
Electric Stampede 99,622   Electric Stampede 134,380   GO-SNIP 0   GERS USA 46
GMI-GO 1,231   CasePower 0   GOT-BSI-OPF 0   CasePower 0
CasePower 0   GO-SNIP 0   M&H Grid Solutions 0   GO-SNIP 0
GO-SNIP 0   M&H Grid Solutions 0   magos 0   GOT-BSI-OPF 0
M&H Grid Solutions 0   Pearl Street Technologies 0   Pearl Street Technologies 0   M&H Grid Solutions 0
Pearl Street Technologies 0   SUGAR-CMU 0   SUGAR-CMU 0   magos 0
SUGAR-CMU 0   GERS USA -25   GERS USA -21   Pearl Street Technologies 0
GERS USA -92   GMI-GO -615   NU_Columbia_Artelys -14,422   SUGAR-CMU 0
magos -201,403   magos -201,403   Ensemble -22,591   GMI-GO -448
GravityX -1,814,226   Gordian Knot -471,147   GravityX -1,852,030   Gordian Knot -2,156,866