Skip to content
Snippets Groups Projects
Commit 820fa577 authored by Manos Koukoutos's avatar Manos Koukoutos Committed by Ravi
Browse files

Delete benchmark file

parent 2113abb6
No related branches found
No related tags found
No related merge requests found
Versions: X-X-N for CEGIS(o/n), grammar(o/n), max. size
✓ = Proof
? = no proof
x = invalid solution
F = Timeout/failed to synth.
===================================================================================================================================
Name | FDefs| Size | O-O-5 | O-O-7 | 0515ff9 | 75d4219 | 5a22c2f | 4cdcc91 | de6a3a0 | 4fd7f51 |
===================================================================================================================================
List.insert | 59 | 3 | ✓ | 0.8 | ✓ | 1.0 | ✓ | 0.7 | ✓ | 0.5 | ✓ | 0.5 | ✓ | 0.6 | ✓ | 0.6 | ✓ | 0.5 |
List.delete | 61 | 0 | ✓ | 4.5 | F | 30.1 | ✓ | 3.2 | ✓ | 5.4 | ✓ | 5.4 | ✓ | 6.3 | ✓ | 6.8 | ✓ | 7.0 |
List.union | 75 | 11 | ✓ | 7.1 | ✓ | 12.5 | ✓ | 3.5 | ✓ | 1.7 | ✓ | 1.9 | ✓ | 1.9 | ✓ | 1.9 | ✓ | 1.7 |
List.diff | 106 | 0 | ✓ | 6.1 | F | 31.8 | ✓ | 11.2 | ✓ | 9.1 | ✓ | 10.1 | ✓ | 10.8 | ✓ | 10.8 | ✓ | 10.1 |
List.split*(easier for O-O) | 96 | 24 | ✓ | 3.6 | ✓ | 5.3 | ✓ | 2.6 | ✓ | 2.2 | ✓ | 2.3 | ✓ | 2.6 | ✓ | 2.6 | ✓ | 3.5 |
List.listOfSize | 54 | 11 | | | | | | | | | | | | | ✓ | 1.5 | ✓ | 1.1 |
SortedList.insert | 91 | 0 | ? | 16.5 | F | 30.0 | ? | 23.6 | ? | 11.8 | ? | 11.8 | ? | 10.6 | ? | 11.0 | ? | 11.5 |
SortedList.insertAlways | 105 | 0 | ✓ | 20.5 | F | 30.0 | ✓ | 40.8 | ✓ | 22.2 | ✓ | 23.2 | ✓ | 21.9 | ✓ | 21.2 | ✓ | 23.7 |
SortedList.delete | 91 | 0 | ? | 7.9 | F | 30.0 | ? | 5.7 | ? | 9.5 | ? | 9.6 | ? | 10.2 | ? | 9.5 | ? | 10.4 |
SortedList.union | 138 | 11 | ✓ | 6.9 | ✓ | 15.1 | ✓ | 4.0 | ✓ | 2.1 | ✓ | 2.5 | ✓ | 3.6 | ✓ | 2.1 | ✓ | 3.2 |
SortedList.diff | 136 | 0 | ✓ | 5.9 | F | 51.7 | ✓ | 7.7 | ✓ | 7.0 | ✓ | 5.2 | ✓ | 8.0 | ✓ | 5.2 | ✓ | 5.8 |
SortedList.insertionSort | 125 | 10 | ✓ | 1.9 | ✓ | 3.5 | ✓ | 1.7 | ✓ | 1.3 | ✓ | 4.6 | ✓ | 3.2 | ✓ | 1.6 | ✓ | 4.3 |
StrictSortedList.insert | 91 | 0 | ✓ | 13.1 | F | 30.0 | ✓ | 23.4 | ✓ | 9.5 | ✓ | 9.9 | ✓ | 9.5 | ✓ | 10.2 | ✓ | 10.0 |
StrictSortedList.delete | 91 | 0 | ? | 10.2 | F | 30.0 | ✓ | 5.6 | ✓ | 12.7 | ✓ | 12.8 | ✓ | 12.4 | ✓ | 12.9 | ✓ | 12.9 |
StrictSortedList.union | 138 | 11 | ✓ | 7.6 | ✓ | 13.6 | ✓ | 4.7 | ✓ | 2.9 | ✓ | 2.1 | ✓ | 2.0 | ✓ | 2.1 | ✓ | 2.1 |
UnaryNumerals.add | 42 | 9 | ✓ | 4.3 | ✓ | 4.1 | ✓ | 2.2 | ✓ | 1.8 | ✓ | 1.7 | ✓ | 1.6 | ✓ | 1.8 | ✓ | 1.7 |
UnaryNumerals.distinct | 66 | 4 | ✓ | 2.4 | ✓ | 2.3 | ✓ | 1.1 | ✓ | 0.8 | ✓ | 0.9 | ✓ | 1.8 | ✓ | 1.9 | ✓ | 2.1 |
UnaryNumerals.mult | 64 | 10 | ✓ | 4.5 | ✓ | 10.5 | ✓ | 4.4 | ✓ | 3.5 | ✓ | 4.0 | ✓ | 4.3 | ✓ | 4.5 | ✓ | 4.4 |
BatchedQueue.enqueue | 89 | 20 | F | 30.0 | ? | 19.7 | ? | 10.0 | ? | 10.9 | ? | 10.6 | ? | 11.2 | ? | 11.1 | ? | 11.6 |
BatchedQueue.dequeue | 65 | 9 | ? | 14.3 | ? | 11.4 | ? | 13.3 | ? | 17.0 | ? | 17.3 | ? | 18.2 | ? | 18.2 | ? | 19.2 |
AddressBook.makeAddressBook | 42 | 0 | F | 14.3 | F | 30.0 | ✓ | 6.7 | ✓ | 6.3 | ✓ | 5.5 | ✓ | 3.9 | ✓ | 4.0 | ✓ | 4.3 |
AddressBook.merge | 99 | 11 | ? | 6.9 | ? | 9.5 | ? | 9.9 | ? | 13.4 | ? | 13.5 | ? | 13.5 | ? | 13.6 | ? | 13.4 |
RunLength.encode | 110 | 38 | | | | | ✓ | 54.0 | ✓ | 59.1 | ✓ | 42.9 | ✓ | 36.1 | ✓ | 24.7 | ✓ | 44.8 |
Diffs.diffs | 63 | 22 | | | | | ✓ | 20.0 | ✓ | 17.9 | ✓ | 16.5 | ✓ | 11.5 | ✓ | 11.8 | ✓ | 13.4 |
===================================================================================================================================
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment