Event 4

Teams

Teams Participating in Challenge 3 Event 4
Event 4 Team Name Lead Affiliation Team Lead Members          
ARPA-e Benchmark Los Alamos National Laboratory # Carleton Coffrin Robert Parker          
Artelys_Columbia Artelys $ Richard A Waltz Daniel Bienstock          
Electric-Stampede University of Texas - Austin $ Javad Mohammadi Kyri Baker Constance Crozier Hussein Sharadga      
Gatorgar University of Florida $ Yongpei Guan Lei Fan Mingze Li Weihang Ren      
GOT-BSI-OPF Global Optimal Technology, Inc.  $ Hsiao-Dong Chiang Pat Causgrove Bin Wang Lin Zeng      
GravityX Individual Hassan Hijazi -          
LLGoMax Lawrence Livermore National Laboratory $ Ignacio Aravena Solis Rod Frowd Shmuel Oren Alex Papalexopoulos      
Occam's razor Individual Wenyuan Tang -          
PACE IncSys  $ Robin Podmore Roozbeh Khodadadeh Chris Mosier        
PGWOpt University of Pittsburgh $ Masoud Barati Nina Fatehi Sattiago Grijalva Masoud H. Nazari Samuel Talkington Jorge Fernandez  
quasiGrad Individual Samuel Chevalier -          
The Blackouts University of Tennessee: Knoxville $ James Ostrowski Marzieh Bakhshi Christopher Ginart William Hart Bernard Knueven Jonathan Schrock Jean-Paul Watson
TIM-GO Massachusetts Institute of Technology $ Xu (Andy) Sun Matthew Brun Xin Chen Dirk Lauinger Thomas Lee    
YongOptimization Mississippi State University $ Yong Fu Lin Gong Yehong Peng Fasiha Zainab      
  # not competing for prizes
$ recipient of FOA award		              

The submission window was August 31-September 4, 2023. 

Scoring

Division 1, 2, and 3 rankings will be determined based upon the total score (Market Surplus, zms in the Formulation Document). Only zms values that are positive for feasible solutions will be counted. All other results will be treated as 0.0. 

Division 4, 5, and 6 rankings are based on the count of top scores for each scenario in Divisions 1, 2, and 3.

See the Scoring document for details. All Divisions in Event 4 will receive prizes. The Benchmark score is included for reference. The Benchmark had only a single best score but it was excluded from the counts.

LEADERBOARD RANKINGS

Ensemble is the set of best scores for the grouping. The Sum of all scores data is provided for comparison. There are  prizes in 6 categories; 3 for sum of scores and 3 for number of best scores. There are 283 scenarios in Division 1, and 192 in both Divisions 2 and 3 for a total of 667 scenarios. A total of 669 scenarios was run for each team but no one produced a positive Market Surplus for Divisions 2 and 3 for scenario 4 of the 23,643-bus network so it is ignored.

The scores were posted September 21, 2023.

  Team Division 1 Score     Best Score Counts          
Rank Ensemble 45,868,476,979 $k            Rank Team Division 4 $k                 
                    1 GOT-BSI-OPF 45,197,083,660 100                       1 YongOptimization 156 100        
                    2 YongOptimization 44,591,294,554 90                       2 TIM-GO 39 90        
                    3 TIM-GO 43,872,727,267 80                       3 GravityX 37 80        
                    4 Occams razor 42,019,935,603 70                       4 GOT-BSI-OPF 28 70        
                    5 Artelys_Columbia 41,955,425,465 60                       5 The Blackouts 16 60        
  GravityX 41,087,358,059     Occams razor 3          
  ARPA-e Benchmark 40,701,382,819     Artelys_Columbia 2          
  Electric-Stampede 33,703,941,022     Gatorgar 1          
  quasiGrad 31,487,865,583     LLGoMax 1          
  LLGoMax 20,921,886,558     ARPA-e Benchmark 0          
  The Blackouts 16,248,312,869     Electric-Stampede 0          
  Gatorgar 2,441,251,911     PACE 0          
  PACE 0     PGWOpt 0          
  PGWOpt 0     quasiGrad 0          
          total 283          
  Team Division 2 Score                  
Rank Ensemble 163,579,841,300 $k             Rank Team Division 5 $k                 
                    1 GOT-BSI-OPF 162,941,475,726 100                      1 YongOptimization 78 100        
                    2 TIM-GO 162,270,256,651 90                      2 GravityX 38 90        
                    3 YongOptimization 160,165,088,341 80                      3 TIM-GO 23 80        
                    4 Artelys_Columbia 157,359,267,058 70                      4 The Blackouts 18 70        
                    5 GravityX 156,131,225,903 60                      5 Artelys_Columbia 17 60        
  ARPA-e Benchmark 156,014,230,887     GOT-BSI-OPF 15          
  quasiGrad 155,168,735,676     Gatorgar 2          
  Occams razor 145,494,618,835     Occams razor 1          
  Electric-Stampede 139,357,283,507     ARPA-e Benchmark 0          
  LLGoMax 116,812,192,654     Electric-Stampede 0          
  The Blackouts 114,098,832,983     LLGoMax 0          
  Gatorgar 10,263,109,863     PACE 0          
  PACE 0     PGWOpt 0          
  PGWOpt 0     quasiGrad 0          
          total 192          
  Team Division 3 Score                  
Rank Ensemble 914,989,287,571 $k            Rank Team Division 6 $k                 
                    1 TIM-GO 912,962,663,505 100                       1 YongOptimization 97 100        
                    2 GOT-BSI-OPF 912,210,419,977 90                       2 GravityX 30 90        
                    3 YongOptimization 898,403,594,134 80                       3 TIM-GO 27 80        
  ARPA-e Benchmark 894,700,110,522                         4 The Blackouts 22 70        
                    4 Artelys_Columbia 890,938,692,881 70                       5 Artelys_Columbia 10 60        
                    5 Occams razor 859,382,611,148 60   GOT-BSI-OPF 4          
  Electric-Stampede 789,564,018,403     LLGoMax 2          
  LLGoMax 743,755,130,133     ARPA-e Benchmark 0          
  GravityX 615,756,357,772     Electric-Stampede 0          
  quasiGrad 507,656,713,708     Gatorgar 0          
  The Blackouts 460,293,789,185     Occams razor 0          
  Gatorgar 43,077,987,783     PACE 0          
  PACE 0     PGWOpt 0          
  PGWOpt 0     quasiGrad 0          
          total 192          
    sorted by score/count -- all divisions                  
  Team Div. 1-3 Total Score Total       Total        
Rank Ensemble 1,124,437,605,850 $k            Rank Team Div. 4-6 Total $k                 
                   1 GOT-BSI-OPF 1,120,348,979,364 290                      1 YongOptimization 331 300        
                   2 TIM-GO 1,119,105,647,423 270                      2 GravityX 105 260        
                   3 YongOptimization 1,103,159,977,029 250                      3 TIM-GO 89 250        
  ARPA-e Benchmark 1,091,415,724,228                        4 The Blackouts 56 200        
                   4 Artelys_Columbia 1,090,253,385,404 200                      5 GOT-BSI-OPF 47 70        
                   5 Occams razor 1,046,897,165,587 130   Artelys_Columbia 29 120        
  Electric-Stampede 962,625,242,933     Occams razor 4          
  LLGoMax 881,489,209,344     Gatorgar 3          
  GravityX 812,974,941,733 60   LLGoMax 3          
  quasiGrad 694,313,314,967     ARPA-e Benchmark 0          
  The Blackouts 590,640,935,037     Electric-Stampede 0          
  Gatorgar 55,782,349,558     PACE 0          
  PACE 0     PGWOpt 0          
  PGWOpt 0     quasiGrad 0          
    total  $1,200k   total   667 $1,200k        
                       
    sorted by $ value -- all divisions                  
  Team Div. 1-3 Total Score $k              Team Div. 4-6 Count $k.           Total Prizes  
                    1 GOT-BSI-OPF 1,120,348,979,364 290                      1 YongOptimization 331 300   Team $k               
                    2 TIM-GO 1,119,105,647,423 270                      2 GravityX 105 260   YongOptimization 550  
                    3 YongOptimization 1,103,159,977,029 250                      3 TIM-GO 89 250   TIM-GO 520  
                    4 Artelys_Columbia 1,090,253,385,404 200                      4 The Blackouts 56 200   GOT-BSI-OPF 360  
                    5 Occams razor 1,046,897,165,587 130                      5 Artelys_Columbia 29 120   Artelys_Columbia 320  
                    6 GravityX 812,974,941,733 60                      6 GOT-BSI-OPF 47 70   GravityX 320  
  ARPA-e Benchmark 1,091,415,724,228 0           The Blackouts 200  
  Electric-Stampede 962,625,242,933 0           Occams razor 130  
  LLGoMax 881,489,209,344 0           total    $2,400k  
  quasiGrad 694,313,314,967 0                
  The Blackouts 590,640,935,037 0                

ARPA-E has reviewed and approved the prizes.

The following table is presented for comparison only; it has no impact on awarding prizes although the column listing the number of best scores is the same as the results in the count of all divisions above. The single Benchmark best score for C3E4N06708D3 scenario 126 switching allowed has been removed, but the results for second best, third, etc. are as they occurred. One scenario only had 4 positive scores. That 71% of the teams had at least one best score and 86% had at least one second best score speaks to the quality and diversity of the submissions.

  nth best score count  
Team 1 2 3 4 5 1-5                   
ARPA-e Benchmark 0 12 27 58 114 211
Artelys_Columbia 29 24 25 43 47 168
Electric-Stampede 0 2 7 7 61 77
Gatorgar 3 8 7 8 2 28
GOT-BSI-OPF 47 137 150 99 81 514
GravityX 105 125 142 134 60 566
LLGoMax 3 20 37 25 57 142
Occams razor 4 21 48 88 93 254
quasiGrad 0 2 4 18 41 65
The Blackouts 56 20 12 19 32 139
TIM-GO 89 120 129 134 70 542
YongOptimization 331 176 79 34 8 628
total   667 667 667 667 666 3334

Download (202 kB) the Excel Spreadsheet (3/19/2024 version) with individual scenario details. Previous version had some SW0 and SW1 values inverted.