Add initial scripts for continuous CBMC benchmarking

[peterschrammel]

I PR this now since I have little time for cleaning up the hack. Maybe someone else will pick it up and move it further.

An instance of this is running here: http://svcomp.cprover.org/

[lucasccordeiro]

Hi, We're right now in the process of submitting proposals for 3rd year projects for next academic year. If you provide a bit more background about your thoughts, I could try to get a 3rd year student to work on this for us. In particular, if we incorporate some "machine learning" in this continuous benchmarking, we could easily attract good students to work on this project. Cheers, Lucas Em ter, 12 de mar de 2019 às 22:19, Peter Schrammel < [email protected]> escreveu:

…

I PR this now since I have little time for cleaning up the hack. Maybe someone else will pick it up and move it further. An instance of this is running here: http://svcomp.cprover.org/ ------------------------------ You can view, comment on, or merge this pull request online at: #53 Commit Summary - Add initial scripts for continuous CBMC benchmarking File Changes - *A* continuous-benchmarking/README.md <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-0> (14) - *A* continuous-benchmarking/rename.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-1> (28) - *A* continuous-benchmarking/run-cbmc.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-2> (74) - *A* continuous-benchmarking/run-jbmc.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-3> (78) - *A* continuous-benchmarking/setup.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-4> (6) - *A* continuous-benchmarking/utils/bulkrename.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-5> (14) - *A* continuous-benchmarking/utils/rename2.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-6> (29) - *A* continuous-benchmarking/utils/rename3.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-7> (28) - *A* continuous-benchmarking/utils/run-binary.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-8> (104) - *A* continuous-benchmarking/www/server.js <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-9> (75) - *A* continuous-benchmarking/www/server.sh <https://github.com/diffblue/cprover-sv-comp/pull/53/files#diff-10> (2) Patch Links: - https://github.com/diffblue/cprover-sv-comp/pull/53.patch - https://github.com/diffblue/cprover-sv-comp/pull/53.diff — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#53>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADheHQJ6vjs6PKKCOG-YvAUdcN7AH46Gks5vWCftgaJpZM4br_3Y> .

-- Lucas C. Cordeiro​ https://ssvlab.github.io/lucasccordeiro/

[yumibagge]

🍒 I needed to run npm install -g express. Maybe nice to have this info in readme (or include in the setup script )