ANL-CEEESA/MIPLearn
1
0
Fork 0
mirror of https://github.com/ANL-CEEESA/MIPLearn.git synced 2025-12-06 17:38:51 -06:00
Code Issues Packages Projects Releases Wiki Activity

Update TSP benchmarks

Browse Source
This commit is contained in:
Alinson S. Xavier
2020-03-05 16:34:59 -06:00
parent 303750a7dd
commit 37795fe013
4 changed files with 202 additions and 202 deletions
Download Patch File Download Diff File Expand all files Collapse all files

102
benchmark/tsp/ChallengeA/benchmark_baseline.csv
View File

@@ -1,51 +1,51 @@
,Solver,Instance,Wallclock Time,Lower Bound,Upper Bound,Gap,Nodes,Mode,Sense,Relative Lower Bound,Relative Upper Bound,Relative Wallclock Time,Relative Gap,Relative Nodes
0,baseline,0,36.53329420089722,13540.0,13540.0,0.0,850.0,exact,min,1.0,1.0,1.0,,1.0
1,baseline,1,18.817906141281128,13567.0,13567.0,0.0,210.0,exact,min,1.0,1.0,1.0,,1.0
2,baseline,2,41.11200523376465,13562.0,13562.0,0.0,454.0,exact,min,1.0,1.0,1.0,,1.0
3,baseline,3,32.86961388587952,13522.0,13522.0,0.0,977.0,exact,min,1.0,1.0,1.0,,1.0
4,baseline,4,26.034526586532593,13534.0,13534.0,0.0,396.0,exact,min,1.0,1.0,1.0,,1.0
5,baseline,5,49.52316498756409,13532.0,13532.0,0.0,591.0,exact,min,1.0,1.0,1.0,,1.0
6,baseline,6,43.27228236198425,13535.0,13535.0,0.0,2292.0,exact,min,1.0,1.0,1.0,,1.0
7,baseline,7,38.22899675369263,13613.0,13613.0,0.0,104.0,exact,min,1.0,1.0,1.0,,1.0
8,baseline,8,57.10530495643616,13580.0,13580.0,0.0,2520.0,exact,min,1.0,1.0,1.0,,1.0
9,baseline,9,32.9139928817749,13583.000000000002,13584.0,7.362143856277559e-05,1150.0,exact,min,1.0,1.0,1.0,1.0,1.0
10,baseline,10,54.779502391815186,13578.0,13578.0,0.0,5650.0,exact,min,1.0,1.0,1.0,,1.0
11,baseline,11,15.760047912597656,13575.0,13575.0,0.0,137.0,exact,min,1.0,1.0,1.0,,1.0
12,baseline,12,32.83225607872009,13544.0,13544.0,0.0,995.0,exact,min,1.0,1.0,1.0,,1.0
13,baseline,13,18.5905544757843,13534.0,13534.0,0.0,1.0,exact,min,1.0,1.0,1.0,,1.0
14,baseline,14,26.83425283432007,13551.0,13551.0,0.0,180.0,exact,min,1.0,1.0,1.0,,1.0
15,baseline,15,43.79837608337402,13593.999998910032,13593.999998910032,0.0,866.0,exact,min,1.0,1.0,1.0,,1.0
16,baseline,16,88.94579243659973,13594.0,13594.0,0.0,3845.0,exact,min,1.0,1.0,1.0,,1.0
17,baseline,17,46.35858511924744,13543.0,13543.0,0.0,609.0,exact,min,1.0,1.0,1.0,,1.0
18,baseline,18,26.682329416275024,13524.0,13525.0,7.394262052647145e-05,1.0,exact,min,1.0,1.0,1.0,1.0,1.0
19,baseline,19,22.814379453659058,13564.0,13564.0,0.0,212.0,exact,min,1.0,1.0,1.0,,1.0
20,baseline,20,53.294482946395874,13569.0,13569.0,0.0,553.0,exact,min,1.0,1.0,1.0,,1.0
21,baseline,21,47.91645574569702,13566.0,13566.0,0.0,427.0,exact,min,1.0,1.0,1.0,,1.0
22,baseline,22,23.47979474067688,13565.0,13565.0,0.0,1.0,exact,min,1.0,1.0,1.0,,1.0
23,baseline,23,34.00282287597656,13579.0,13580.0,7.364312541424258e-05,795.0,exact,min,1.0,1.0,1.0,1.0,1.0
24,baseline,24,26.307467222213745,13543.0,13543.0,0.0,72.0,exact,min,1.0,1.0,1.0,,1.0
25,baseline,25,30.169880151748657,13541.0,13542.0,7.384978952809984e-05,185.0,exact,min,1.0,1.0,1.0,1.0,1.0
26,baseline,26,22.108322381973267,13531.0,13532.0,7.390436774813391e-05,1.0,exact,min,1.0,1.0,1.0,1.0,1.0
27,baseline,27,30.187870264053345,13521.0,13522.0,7.395902669920864e-05,639.0,exact,min,1.0,1.0,1.0,1.0,1.0
28,baseline,28,28.049314975738525,13571.0,13571.0,0.0,698.0,exact,min,1.0,1.0,1.0,,1.0
29,baseline,29,14.55678105354309,13595.0,13595.0,0.0,3192.0,exact,min,1.0,1.0,1.0,,1.0
30,baseline,30,43.23353409767151,13577.0,13577.0,0.0,194.0,exact,min,1.0,1.0,1.0,,1.0
31,baseline,31,22.519271850585938,13582.0,13582.0,0.0,202.0,exact,min,1.0,1.0,1.0,,1.0
32,baseline,32,42.938852071762085,13524.0,13524.0,0.0,45.0,exact,min,1.0,1.0,1.0,,1.0
33,baseline,33,55.740468978881836,13548.0,13548.0,0.0,1122.0,exact,min,1.0,1.0,1.0,,1.0
34,baseline,34,39.5752170085907,13557.0,13557.0,0.0,918.0,exact,min,1.0,1.0,1.0,,1.0
35,baseline,35,59.18739986419678,13568.0,13568.0,0.0,242.0,exact,min,1.0,1.0,1.0,,1.0
36,baseline,36,37.398855447769165,13554.0,13554.0,0.0,427.0,exact,min,1.0,1.0,1.0,,1.0
37,baseline,37,25.6471529006958,13532.0,13532.0,0.0,1173.0,exact,min,1.0,1.0,1.0,,1.0
38,baseline,38,18.585349082946777,13514.0,13514.0,0.0,222.0,exact,min,1.0,1.0,1.0,,1.0
39,baseline,39,19.149864196777344,13538.0,13538.0,0.0,137.0,exact,min,1.0,1.0,1.0,,1.0
40,baseline,40,23.872825860977173,13578.0,13578.0,0.0,1.0,exact,min,1.0,1.0,1.0,,1.0
41,baseline,41,22.637821435928345,13526.0,13526.0,0.0,1.0,exact,min,1.0,1.0,1.0,,1.0
42,baseline,42,27.237576961517334,13529.0,13529.0,0.0,294.0,exact,min,1.0,1.0,1.0,,1.0
43,baseline,43,62.30587673187256,13565.0,13565.0,0.0,1889.0,exact,min,1.0,1.0,1.0,,1.0
44,baseline,44,26.792277336120605,13553.0,13553.0,0.0,277.0,exact,min,1.0,1.0,1.0,,1.0
45,baseline,45,16.130266189575195,13521.0,13521.0,0.0,49.0,exact,min,1.0,1.0,1.0,,1.0
46,baseline,46,27.59492301940918,13542.0,13543.0,7.38443361394181e-05,18.0,exact,min,1.0,1.0,1.0,1.0,1.0
47,baseline,47,37.25418496131897,13564.0,13564.0,0.0,91.0,exact,min,1.0,1.0,1.0,,1.0
48,baseline,48,25.38289999961853,13552.0,13552.0,0.0,1399.0,exact,min,1.0,1.0,1.0,,1.0
49,baseline,49,41.491984605789185,13524.0,13524.0,0.0,54.0,exact,min,1.0,1.0,1.0,,1.0
,Solver,Instance,Wallclock Time,Lower Bound,Upper Bound,Gap,Nodes,Mode,Sense,Predicted LB,Predicted UB,Relative Lower Bound,Relative Upper Bound,Relative Wallclock Time,Relative Gap,Relative Nodes
0,baseline,0,29.597511053085327,13540.0,13540.0,0.0,1488.0,exact,min,,,1.0,1.0,1.0,,1.0
1,baseline,1,100.47623896598816,13567.0,13567.0,0.0,5209.0,exact,min,,,1.0,1.0,1.0,,1.0
2,baseline,2,95.63535189628601,13562.0,13562.0,0.0,5738.0,exact,min,,,1.0,1.0,1.0,,1.0
3,baseline,3,116.40385484695435,13522.0,13522.0,0.0,4888.0,exact,min,,,1.0,1.0,1.0,,1.0
4,baseline,4,52.82231903076172,13534.0,13534.0,0.0,2432.0,exact,min,,,1.0,1.0,1.0,,1.0
5,baseline,5,130.4400429725647,13532.0,13532.0,0.0,5217.0,exact,min,,,1.0,1.0,1.0,,1.0
6,baseline,6,138.90338110923767,13535.0,13535.0,0.0,5910.0,exact,min,,,1.0,1.0,1.0,,1.0
7,baseline,7,162.50647616386414,13613.0,13613.0,0.0,5152.0,exact,min,,,1.0,1.0,1.0,,1.0
8,baseline,8,135.88944792747498,13579.999997631374,13579.999997631372,-1.3394620057902246e-16,6720.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
9,baseline,9,62.36928915977478,13583.999994506432,13583.999994506432,0.0,3583.0,exact,min,,,1.0,1.0,1.0,,1.0
10,baseline,10,248.86321592330933,13577.0,13578.0,7.365397363187744e-05,13577.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
11,baseline,11,64.44093084335327,13574.999997985586,13574.999997985586,0.0,3149.0,exact,min,,,1.0,1.0,1.0,,1.0
12,baseline,12,74.64304614067078,13544.0,13544.0,0.0,4925.0,exact,min,,,1.0,1.0,1.0,,1.0
13,baseline,13,60.252323150634766,13534.0,13534.0,0.0,4007.0,exact,min,,,1.0,1.0,1.0,,1.0
14,baseline,14,151.05377101898193,13550.0,13551.0,7.380073800738008e-05,5389.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
15,baseline,15,94.33260798454285,13593.0,13594.0,7.356727727506805e-05,4240.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
16,baseline,16,112.65512180328369,13594.0,13594.0,0.0,5678.0,exact,min,,,1.0,1.0,1.0,,1.0
17,baseline,17,94.68812704086304,13543.0,13543.0,0.0,4110.0,exact,min,,,1.0,1.0,1.0,,1.0
18,baseline,18,119.84407782554626,13525.0,13525.0,0.0,4925.0,exact,min,,,1.0,1.0,1.0,,1.0
19,baseline,19,96.70060396194458,13564.0,13564.0,0.0,4242.0,exact,min,,,1.0,1.0,1.0,,1.0
20,baseline,20,206.73002099990845,13569.0,13569.0,0.0,5164.0,exact,min,,,1.0,1.0,1.0,,1.0
21,baseline,21,101.60346388816833,13566.0,13566.0,0.0,3797.0,exact,min,,,1.0,1.0,1.0,,1.0
22,baseline,22,39.24613690376282,13565.0,13565.0,0.0,1434.0,exact,min,,,1.0,1.0,1.0,,1.0
23,baseline,23,89.74621176719666,13580.0,13580.0,0.0,3758.0,exact,min,,,1.0,1.0,1.0,,1.0
24,baseline,24,69.45808696746826,13542.999999999996,13542.999999999998,1.343121467581671e-16,3608.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
25,baseline,25,130.97386503219604,13542.0,13542.0,0.0,6687.0,exact,min,,,1.0,1.0,1.0,,1.0
26,baseline,26,98.3358142375946,13531.999999377458,13531.99999937746,1.3442132749257606e-16,5284.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
27,baseline,27,101.37863302230835,13521.0,13522.0,7.395902669920864e-05,3512.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
28,baseline,28,47.17776012420654,13571.0,13571.0,0.0,2742.0,exact,min,,,1.0,1.0,1.0,,1.0
29,baseline,29,122.19579315185547,13594.0,13594.9999861121,7.356084390904645e-05,5138.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
30,baseline,30,159.65594601631165,13577.0,13577.0,0.0,5170.0,exact,min,,,1.0,1.0,1.0,,1.0
31,baseline,31,64.20995998382568,13582.0,13582.0,0.0,2716.0,exact,min,,,1.0,1.0,1.0,,1.0
32,baseline,32,73.25116801261902,13523.0,13524.0,7.394808844191378e-05,2705.0,exact,min,,,1.0,1.0,1.0,1.0,1.0
33,baseline,33,73.00323796272278,13548.0,13548.0,0.0,3823.0,exact,min,,,1.0,1.0,1.0,,1.0
34,baseline,34,75.30102896690369,13557.0,13557.0,0.0,2495.0,exact,min,,,1.0,1.0,1.0,,1.0
35,baseline,35,95.78053402900696,13567.999997100109,13567.999997100109,0.0,5380.0,exact,min,,,1.0,1.0,1.0,,1.0
36,baseline,36,59.77940106391907,13553.999999666667,13553.999999666667,0.0,2236.0,exact,min,,,1.0,1.0,1.0,,1.0
37,baseline,37,111.62521696090698,13532.0,13532.0,0.0,4730.0,exact,min,,,1.0,1.0,1.0,,1.0
38,baseline,38,101.59809303283691,13514.0,13514.0,0.0,4724.0,exact,min,,,1.0,1.0,1.0,,1.0
39,baseline,39,136.7306661605835,13538.0,13538.0,0.0,5301.0,exact,min,,,1.0,1.0,1.0,,1.0
40,baseline,40,96.18307614326477,13578.0,13578.0,0.0,5286.0,exact,min,,,1.0,1.0,1.0,,1.0
41,baseline,41,193.25571990013123,13526.0,13526.0,0.0,8946.0,exact,min,,,1.0,1.0,1.0,,1.0
42,baseline,42,98.80436420440674,13529.0,13529.0,0.0,2757.0,exact,min,,,1.0,1.0,1.0,,1.0
43,baseline,43,91.02266597747803,13565.0,13565.0,0.0,4119.0,exact,min,,,1.0,1.0,1.0,,1.0
44,baseline,44,44.981120109558105,13553.0,13553.0,0.0,1975.0,exact,min,,,1.0,1.0,1.0,,1.0
45,baseline,45,99.74598288536072,13521.0,13521.0,0.0,5262.0,exact,min,,,1.0,1.0,1.0,,1.0
46,baseline,46,70.65784502029419,13542.99999940547,13542.99999940547,0.0,3270.0,exact,min,,,1.0,1.0,1.0,,1.0
47,baseline,47,62.16441297531128,13564.0,13564.0,0.0,3631.0,exact,min,,,1.0,1.0,1.0,,1.0
48,baseline,48,190.54906916618347,13552.0,13552.0,0.0,9373.0,exact,min,,,1.0,1.0,1.0,,1.0
49,baseline,49,73.46178817749023,13524.0,13524.0,0.0,4053.0,exact,min,,,1.0,1.0,1.0,,1.0
1 Solver Instance Wallclock Time Lower Bound Upper Bound Gap Nodes Mode Sense Predicted LB Predicted UB Relative Lower Bound Relative Upper Bound Relative Wallclock Time Relative Gap Relative Nodes
2 0 baseline 0 36.53329420089722 29.597511053085327 13540.0 13540.0 0.0 850.0 1488.0 exact min 1.0 1.0 1.0 1.0
3 1 baseline 1 18.817906141281128 100.47623896598816 13567.0 13567.0 0.0 210.0 5209.0 exact min 1.0 1.0 1.0 1.0
4 2 baseline 2 41.11200523376465 95.63535189628601 13562.0 13562.0 0.0 454.0 5738.0 exact min 1.0 1.0 1.0 1.0
5 3 baseline 3 32.86961388587952 116.40385484695435 13522.0 13522.0 0.0 977.0 4888.0 exact min 1.0 1.0 1.0 1.0
6 4 baseline 4 26.034526586532593 52.82231903076172 13534.0 13534.0 0.0 396.0 2432.0 exact min 1.0 1.0 1.0 1.0
7 5 baseline 5 49.52316498756409 130.4400429725647 13532.0 13532.0 0.0 591.0 5217.0 exact min 1.0 1.0 1.0 1.0
8 6 baseline 6 43.27228236198425 138.90338110923767 13535.0 13535.0 0.0 2292.0 5910.0 exact min 1.0 1.0 1.0 1.0
9 7 baseline 7 38.22899675369263 162.50647616386414 13613.0 13613.0 0.0 104.0 5152.0 exact min 1.0 1.0 1.0 1.0
10 8 baseline 8 57.10530495643616 135.88944792747498 13580.0 13579.999997631374 13580.0 13579.999997631372 0.0 -1.3394620057902246e-16 2520.0 6720.0 exact min 1.0 1.0 1.0 1.0 1.0
11 9 baseline 9 32.9139928817749 62.36928915977478 13583.000000000002 13583.999994506432 13584.0 13583.999994506432 7.362143856277559e-05 0.0 1150.0 3583.0 exact min 1.0 1.0 1.0 1.0 1.0
12 10 baseline 10 54.779502391815186 248.86321592330933 13578.0 13577.0 13578.0 0.0 7.365397363187744e-05 5650.0 13577.0 exact min 1.0 1.0 1.0 1.0 1.0
13 11 baseline 11 15.760047912597656 64.44093084335327 13575.0 13574.999997985586 13575.0 13574.999997985586 0.0 137.0 3149.0 exact min 1.0 1.0 1.0 1.0
14 12 baseline 12 32.83225607872009 74.64304614067078 13544.0 13544.0 0.0 995.0 4925.0 exact min 1.0 1.0 1.0 1.0
15 13 baseline 13 18.5905544757843 60.252323150634766 13534.0 13534.0 0.0 1.0 4007.0 exact min 1.0 1.0 1.0 1.0
16 14 baseline 14 26.83425283432007 151.05377101898193 13551.0 13550.0 13551.0 0.0 7.380073800738008e-05 180.0 5389.0 exact min 1.0 1.0 1.0 1.0 1.0
17 15 baseline 15 43.79837608337402 94.33260798454285 13593.999998910032 13593.0 13593.999998910032 13594.0 0.0 7.356727727506805e-05 866.0 4240.0 exact min 1.0 1.0 1.0 1.0 1.0
18 16 baseline 16 88.94579243659973 112.65512180328369 13594.0 13594.0 0.0 3845.0 5678.0 exact min 1.0 1.0 1.0 1.0
19 17 baseline 17 46.35858511924744 94.68812704086304 13543.0 13543.0 0.0 609.0 4110.0 exact min 1.0 1.0 1.0 1.0
20 18 baseline 18 26.682329416275024 119.84407782554626 13524.0 13525.0 13525.0 7.394262052647145e-05 0.0 1.0 4925.0 exact min 1.0 1.0 1.0 1.0 1.0
21 19 baseline 19 22.814379453659058 96.70060396194458 13564.0 13564.0 0.0 212.0 4242.0 exact min 1.0 1.0 1.0 1.0
22 20 baseline 20 53.294482946395874 206.73002099990845 13569.0 13569.0 0.0 553.0 5164.0 exact min 1.0 1.0 1.0 1.0
23 21 baseline 21 47.91645574569702 101.60346388816833 13566.0 13566.0 0.0 427.0 3797.0 exact min 1.0 1.0 1.0 1.0
24 22 baseline 22 23.47979474067688 39.24613690376282 13565.0 13565.0 0.0 1.0 1434.0 exact min 1.0 1.0 1.0 1.0
25 23 baseline 23 34.00282287597656 89.74621176719666 13579.0 13580.0 13580.0 7.364312541424258e-05 0.0 795.0 3758.0 exact min 1.0 1.0 1.0 1.0 1.0
26 24 baseline 24 26.307467222213745 69.45808696746826 13543.0 13542.999999999996 13543.0 13542.999999999998 0.0 1.343121467581671e-16 72.0 3608.0 exact min 1.0 1.0 1.0 1.0 1.0
27 25 baseline 25 30.169880151748657 130.97386503219604 13541.0 13542.0 13542.0 7.384978952809984e-05 0.0 185.0 6687.0 exact min 1.0 1.0 1.0 1.0 1.0
28 26 baseline 26 22.108322381973267 98.3358142375946 13531.0 13531.999999377458 13532.0 13531.99999937746 7.390436774813391e-05 1.3442132749257606e-16 1.0 5284.0 exact min 1.0 1.0 1.0 1.0 1.0
29 27 baseline 27 30.187870264053345 101.37863302230835 13521.0 13522.0 7.395902669920864e-05 639.0 3512.0 exact min 1.0 1.0 1.0 1.0 1.0
30 28 baseline 28 28.049314975738525 47.17776012420654 13571.0 13571.0 0.0 698.0 2742.0 exact min 1.0 1.0 1.0 1.0
31 29 baseline 29 14.55678105354309 122.19579315185547 13595.0 13594.0 13595.0 13594.9999861121 0.0 7.356084390904645e-05 3192.0 5138.0 exact min 1.0 1.0 1.0 1.0 1.0
32 30 baseline 30 43.23353409767151 159.65594601631165 13577.0 13577.0 0.0 194.0 5170.0 exact min 1.0 1.0 1.0 1.0
33 31 baseline 31 22.519271850585938 64.20995998382568 13582.0 13582.0 0.0 202.0 2716.0 exact min 1.0 1.0 1.0 1.0
34 32 baseline 32 42.938852071762085 73.25116801261902 13524.0 13523.0 13524.0 0.0 7.394808844191378e-05 45.0 2705.0 exact min 1.0 1.0 1.0 1.0 1.0
35 33 baseline 33 55.740468978881836 73.00323796272278 13548.0 13548.0 0.0 1122.0 3823.0 exact min 1.0 1.0 1.0 1.0
36 34 baseline 34 39.5752170085907 75.30102896690369 13557.0 13557.0 0.0 918.0 2495.0 exact min 1.0 1.0 1.0 1.0
37 35 baseline 35 59.18739986419678 95.78053402900696 13568.0 13567.999997100109 13568.0 13567.999997100109 0.0 242.0 5380.0 exact min 1.0 1.0 1.0 1.0
38 36 baseline 36 37.398855447769165 59.77940106391907 13554.0 13553.999999666667 13554.0 13553.999999666667 0.0 427.0 2236.0 exact min 1.0 1.0 1.0 1.0
39 37 baseline 37 25.6471529006958 111.62521696090698 13532.0 13532.0 0.0 1173.0 4730.0 exact min 1.0 1.0 1.0 1.0
40 38 baseline 38 18.585349082946777 101.59809303283691 13514.0 13514.0 0.0 222.0 4724.0 exact min 1.0 1.0 1.0 1.0
41 39 baseline 39 19.149864196777344 136.7306661605835 13538.0 13538.0 0.0 137.0 5301.0 exact min 1.0 1.0 1.0 1.0
42 40 baseline 40 23.872825860977173 96.18307614326477 13578.0 13578.0 0.0 1.0 5286.0 exact min 1.0 1.0 1.0 1.0
43 41 baseline 41 22.637821435928345 193.25571990013123 13526.0 13526.0 0.0 1.0 8946.0 exact min 1.0 1.0 1.0 1.0
44 42 baseline 42 27.237576961517334 98.80436420440674 13529.0 13529.0 0.0 294.0 2757.0 exact min 1.0 1.0 1.0 1.0
45 43 baseline 43 62.30587673187256 91.02266597747803 13565.0 13565.0 0.0 1889.0 4119.0 exact min 1.0 1.0 1.0 1.0
46 44 baseline 44 26.792277336120605 44.981120109558105 13553.0 13553.0 0.0 277.0 1975.0 exact min 1.0 1.0 1.0 1.0
47 45 baseline 45 16.130266189575195 99.74598288536072 13521.0 13521.0 0.0 49.0 5262.0 exact min 1.0 1.0 1.0 1.0
48 46 baseline 46 27.59492301940918 70.65784502029419 13542.0 13542.99999940547 13543.0 13542.99999940547 7.38443361394181e-05 0.0 18.0 3270.0 exact min 1.0 1.0 1.0 1.0 1.0
49 47 baseline 47 37.25418496131897 62.16441297531128 13564.0 13564.0 0.0 91.0 3631.0 exact min 1.0 1.0 1.0 1.0
50 48 baseline 48 25.38289999961853 190.54906916618347 13552.0 13552.0 0.0 1399.0 9373.0 exact min 1.0 1.0 1.0 1.0
51 49 baseline 49 41.491984605789185 73.46178817749023 13524.0 13524.0 0.0 54.0 4053.0 exact min 1.0 1.0 1.0 1.0