Experimental comparison between
|
| Benchmarks |
Legend:
vars...Boolean state variables / numerical state variables / Boolean inputs
size...number of locations of the CFG
times in seconds (ASPIC: total time (time for analysis))
?..."don't know" (property not proved, timed out after 600s, out of memory or crashed)
|
|
| | | ASPIC | nbACCel | Nbac |
| | vars | size | time | size | time | size | time |
| Gate 1 | 4/4/2 | 7 | ? | 5 | 0.73 | 24 | ? |
| Escalator 1 | 5/4/2 | 12 | 0.14 (0.04) | 9 | 0.49 | 22 | ? |
| Traffic 1 | 4/6/0 | 18 | 0.14 (0.01) | 16 | 0.19 | 5 | 3.49 |
| Traffic 2 | 4/8/0 | 18 | ? | 16 | 0.35 | 28 | ? |
| LCM Quest 0a-1 | 7/2/0 | 7 | 0.04 (0.01) | 5 | 0.04 | 5 | 0.05 |
| LCM Quest 0a-2 | 7/3/0 | 6 | 0.05 (0.01) | 4 | 0.05 | 8 | 0.19 |
| LCM Quest 0b-1 | 10/3/0 | 19 | 0.08 (0.01) | 12 | 0.08 | 9 | ? |
| LCM Quest 0b-2 | 10/4/0 | 17 | 0.09 (0.01) | 11 | 0.20 | 33 | ? |
| LCM Quest 0c-1 | 15/4/0 | 28 | 0.17 (0.01) | 16 | 0.16 | 8 | 0.86 |
| LCM Quest 0c-2 | 15/5/0 | 25 | 0.20 (0.05) | 14 | 0.24 | 50 | 14.8 |
| LCM Quest 1-1 | 16/5/0 | 114 | 1.99 (0.48) | 42 | 0.92 | 6 | 2.45 |
| LCM Quest 1-2 | 16/6/0 | 100 | ? | 34 | ? | >156 | ? |
| LCM Quest 1b-1 | 16/5/0 | 55 | 0.92 (0.04) | 29 | 0.37 | 15 | ? |
| LCM Quest 1b-2 | 16/5/0 | 45 | 0.76 (0.12) | 23 | 0.47 | 61 | ? |
| LCM Quest 2-1 | 17/6/0 | 247 | ? | 82 | 7.84 | 9 | 12.8 |
| LCM Quest 2-2 | 17/7/0 | 198 | ? | 62 | ? | >76 | ? |
| LCM Quest 3-1 | 25/5/0 | 483 | 26.5 (14.4) | 58 | 8.49 | 12 | 3.76 |
| LCM Quest 3-2 | 25/6/0 | 481 | ? | 54 | ? | >1173 | ? |
| LCM Quest 3b-1 | 26/6/0 | 1724 | ? | 170 | 43.8 | 14 | 19.1 |
| LCM Quest 3b-2 | 26/7/0 | 1710 | ? | 162 | ? | >32 | ? |
| LCM Quest 3c-1 | 26/6/0 | 1319 | ? | 130 | 34.2 | 9 | ? |
| LCM Quest 3c-2 | 26/7/0 | 1056 | ? | 98 | ? | >70 | ? |
| LCM Quest 3d-1 | 26/6/0 | 281 | ? | 81 | 5.43 | 49 | ? |
| LCM Quest 3d-2 | 26/7/0 | 266 | ? | 73 | ? | 446 | ? |
| LCM Quest 3e-1 | 27/7/0 | 638 | ? | 140 | 20.6 | 49 | ? |
| LCM Quest 3e-2 | 27/8/0 | 514 | ? | 110 | 6.46 | >28 | ? |
| LCM Quest 4-1 | 27/7/0 | 4482 | ? | 386 | 186 | 9 | 50.1 |
| LCM Quest 4-2 | 27/8/0 | 3586 | ? | 290 | ? | >6 | ? |
|