-
Notifications
You must be signed in to change notification settings - Fork 4
Home
Wongiseng edited this page Oct 10, 2013
·
40 revisions
#DuckTape
DuckTape is a platform to string together experiments from existing code base. It is designed for any of the following situations:
- You have a simple piece of code that you want to try out with different inputs (a parameter sweep)
- You have several interconnected pieces of code
- You have an experimental workflow with different pieces of code in different programming languages
- You have a piece of code that tests the limits of your computer. You'd like to do a parameter sweep on a cluster, without rewriting everything
The D2S platform allows you to take your code and with a few simple annotations, run it in a controlled environment. With the DuckTape you get:
- Complete separation of you code and your running parameters
- HTML Reports that offer quick insight into the result of a run
- Automatic provenance information generated based on PROV-O
- Command line programs can be used as modules for unsupported languages
- Support for modules in Java, (Python, Matlab under development)
- Scale your experiments from your laptop to a cluster with minimal effort (under development)
See the Quick Start for more instructions on how to start using DuckTape, for running existing workflow that we provide.
To use the DuckTape, you must (currently) perform the following steps:
- Use latest build of Ducktape by from our Maven
- Annotate your code to let the platform know which functions, classes and field to use
- Create a yaml file containing the parameters you'd like to run with.
- Run the platform using :
mvn exec:java -Dexec.mainClass=org.data2semantics.platform.run.Run
##Detailed Documentation
More documentation is provided here
The DuckTape is currently in development. A proof of concept is capable of running basic workflows. We expect to be releasing alpha level code at the end of 2013.