Model & Solve Track Final Results
Contents
Overall
System |
Total |
Instance |
Time |
clasp |
2431 |
1432 |
999 |
schroeder |
1953 |
1140 |
813 |
bpsolver |
1878 |
1064 |
814 |
ezcsp |
1773 |
993 |
780 |
idp |
1442 |
918 |
524 |
fastdownward |
367 |
217 |
150 |
Final results by categories
P |
|
NP |
|
Beyond NP |
Optimization |
||||||||||||
System |
Total Score |
Inst. Score |
Time Score |
System |
Total Score |
Inst. Score |
Time Score |
System |
Total Score |
Inst. Score |
Time Score |
System |
Total Score |
Inst. Score |
Time Score |
Edit conflict - other version:
clasp |
497 |
290 |
207 |
clasp |
1481 |
848 |
633 |
clasp |
110 |
60 |
50 |
clasp |
343 |
234 |
109 |
bpsolver |
459 |
253 |
206 |
ezcsp |
1419 |
786 |
633 |
bpsolver |
86 |
43 |
43 |
schroeder |
325 |
220 |
105 |
schroeder |
404 |
240 |
164 |
schroeder |
1224 |
680 |
544 |
idp |
0 |
0 |
0 |
bpsolver |
207 |
161 |
46 |
ezcsp |
320 |
173 |
147 |
idp |
1127 |
680 |
447 |
fastdownward |
0 |
0 |
0 |
idp |
140 |
121 |
19 |
fastdownward |
181 |
100 |
81 |
bpsolver |
1126 |
607 |
519 |
ezcsp |
0 |
0 |
0 |
fastdownward |
81 |
47 |
34 |
idp |
175 |
117 |
58 |
fastdownward |
105 |
70 |
35 |
schroeder |
0 |
0 |
0 |
ezcsp |
34 |
34 |
0 |
P Problems
System |
Total |
Reachability |
Company Controls |
Grammar-Based IE |
Hydraulic Leaking |
Hydraulic Planning |
Stable Marriage |
Partner Units Polynomial |
|
clasp |
Total |
497 |
87 |
89 |
80 |
78 |
100 |
25 |
38 |
Instance |
290 |
50 |
50 |
50 |
50 |
50 |
17 |
23 |
|
Time |
207 |
37 |
39 |
30 |
28 |
50 |
8 |
15 |
|
bpsolver |
Total |
459 |
90 |
68 |
96 |
100 |
100 |
5 |
- |
Instance |
253 |
50 |
50 |
50 |
50 |
50 |
3 |
- |
|
Time |
206 |
40 |
18 |
46 |
50 |
50 |
2 |
- |
|
schroeder |
Total |
404 |
- |
84 |
80 |
76 |
100 |
25 |
39 |
Instance |
240 |
- |
50 |
50 |
50 |
50 |
17 |
23 |
|
Time |
164 |
- |
34 |
30 |
26 |
50 |
8 |
16 |
|
ezcsp |
Total |
320 |
- |
- |
- |
99 |
99 |
87 |
35 |
Instance |
173 |
- |
- |
- |
50 |
50 |
50 |
23 |
|
Time |
147 |
- |
- |
- |
49 |
49 |
37 |
12 |
|
fastdownward |
Total |
181 |
- |
- |
- |
87 |
94 |
- |
- |
Instance |
100 |
- |
- |
- |
50 |
50 |
- |
- |
|
Time |
81 |
- |
- |
- |
37 |
44 |
- |
- |
|
idp |
Total |
175 |
76 |
- |
- |
- |
- |
72 |
27 |
Instance |
117 |
50 |
- |
- |
- |
- |
50 |
17 |
|
Time |
58 |
26 |
- |
- |
- |
- |
22 |
10 |
NP Problems
System |
Total |
Generalized Slitherlink |
Fastfood Optimality Check |
Sokoban Decision |
Knight Tour |
Disjunctive Scheduling |
Packing Problem |
Labyrinth |
Numberlink |
Reverse Folding |
Hanoi Tower |
Magic Square Sets |
Airport Pickup |
Graph Colouring |
Solitaire |
Partner Units |
Weight-Assignment Tree |
Maze Generation |
Incremental Scheduling |
Tangram |
|
clasp |
Total |
1481 |
97 |
97 |
85 |
97 |
67 |
81 |
71 |
72 |
94 |
81 |
98 |
- |
51 |
73 |
79 |
56 |
97 |
85 |
100 |
Instance |
848 |
50 |
50 |
50 |
50 |
50 |
50 |
47 |
37 |
47 |
50 |
50 |
- |
37 |
40 |
50 |
43 |
50 |
47 |
50 |
|
Time |
633 |
47 |
47 |
35 |
47 |
17 |
31 |
24 |
35 |
47 |
31 |
48 |
- |
14 |
33 |
29 |
13 |
47 |
38 |
50 |
|
ezcsp |
Total |
1419 |
94 |
97 |
81 |
75 |
26 |
99 |
69 |
70 |
94 |
27 |
99 |
81 |
23 |
50 |
65 |
96 |
96 |
77 |
100 |
Instance |
786 |
50 |
50 |
50 |
40 |
13 |
50 |
43 |
37 |
47 |
23 |
50 |
50 |
13 |
30 |
50 |
50 |
50 |
40 |
50 |
|
Time |
633 |
44 |
47 |
31 |
35 |
13 |
49 |
26 |
33 |
47 |
4 |
49 |
31 |
10 |
20 |
15 |
46 |
46 |
37 |
50 |
|
schroeder |
Total |
1224 |
96 |
97 |
83 |
97 |
- |
83 |
68 |
72 |
80 |
77 |
98 |
- |
28 |
73 |
77 |
- |
95 |
- |
100 |
Instance |
680 |
50 |
50 |
50 |
50 |
- |
50 |
43 |
37 |
40 |
50 |
50 |
- |
20 |
40 |
50 |
- |
50 |
- |
50 |
|
Time |
544 |
46 |
47 |
33 |
47 |
- |
33 |
25 |
35 |
40 |
27 |
48 |
- |
8 |
33 |
27 |
- |
45 |
- |
50 |
|
idp |
Total |
1127 |
91 |
76 |
69 |
95 |
15 |
17 |
42 |
99 |
- |
74 |
93 |
- |
66 |
71 |
33 |
83 |
73 |
30 |
100 |
Instance |
680 |
50 |
50 |
43 |
50 |
13 |
13 |
27 |
50 |
- |
50 |
47 |
- |
47 |
40 |
30 |
50 |
50 |
20 |
50 |
|
Time |
447 |
41 |
26 |
26 |
45 |
2 |
4 |
15 |
49 |
- |
24 |
46 |
- |
19 |
31 |
3 |
33 |
23 |
10 |
50 |
|
bpsolver |
Total |
1126 |
* |
92 |
60 |
97 |
92 |
82 |
72 |
73 |
- |
- |
100 |
93 |
15 |
28 |
- |
97 |
49 |
76 |
100 |
Instance |
607 |
* |
50 |
30 |
50 |
50 |
43 |
40 |
37 |
- |
- |
50 |
50 |
10 |
20 |
- |
50 |
37 |
40 |
50 |
|
Time |
519 |
* |
42 |
30 |
47 |
42 |
39 |
32 |
36 |
- |
- |
50 |
43 |
5 |
8 |
- |
47 |
12 |
36 |
50 |
|
fastdownward |
Total |
105 |
- |
- |
* |
5 |
- |
- |
- |
- |
- |
27 |
- |
10 |
- |
63 |
- |
- |
- |
- |
- |
Instance |
70 |
- |
- |
* |
5 |
- |
- |
- |
- |
- |
23 |
- |
7 |
- |
35 |
- |
- |
- |
- |
- |
|
Time |
35 |
- |
- |
* |
0 |
- |
- |
- |
- |
- |
4 |
- |
3 |
- |
28 |
- |
- |
- |
- |
- |
Beyond NP Problems
System |
Total |
Strategic Companies |
Minimal Diagnosis |
|
clasp |
Total |
110 |
11 |
99 |
Instance |
60 |
10 |
50 |
|
Time |
50 |
1 |
49 |
|
bpsolver |
Total |
86 |
- |
86 |
Instance |
43 |
- |
43 |
|
Time |
43 |
- |
43 |
|
idp |
Total |
0 |
- |
- |
Instance |
0 |
- |
- |
|
Time |
0 |
- |
- |
|
fastdownward |
Total |
0 |
- |
- |
Instance |
0 |
- |
- |
|
Time |
0 |
- |
- |
|
ezcsp |
Total |
0 |
- |
- |
Instance |
0 |
- |
- |
|
Time |
0 |
- |
- |
|
schroeder |
Total |
0 |
- |
- |
Instance |
0 |
- |
- |
|
Time |
0 |
- |
- |
Optimization Problems
Edit conflict - your version:
clasp
497
290
207
clasp
1481
848
633
clasp
110
60
50
clasp
343
234
109
bpsolver
459
253
206
ezcsp
1419
786
633
bpsolver
86
43
43
schroeder
325
220
105
schroeder
404
240
164
schroeder
1224
680
544
idp
0
0
0
bpsolver
207
161
46
ezcsp
320
173
147
idp
1127
680
447
fastdownward
0
0
0
idp
140
121
19
fastdownward
181
100
81
bpsolver
1126
607
519
ezcsp
0
0
0
fastdownward
81
47
34
idp
175
117
58
fastdownward
105
70
35
schroeder
0
0
0
ezcsp
34
34
0
End of edit conflict