File tree Expand file tree Collapse file tree 1 file changed +4
-1
lines changed Expand file tree Collapse file tree 1 file changed +4
-1
lines changed Original file line number Diff line number Diff line change @@ -228,7 +228,10 @@ You are strongly recommended to use a sandbox such as [docker](https://docs.dock
228
228
# If you want to change the RAM address space limit (in MB, 128 GB by default): `--max-as-limit XXX`
229
229
# If you want to change the RAM data segment limit (in MB, 4 GB by default): `--max-data-limit`
230
230
# If you want to change the RAM stack limit (in MB, 4 MB by default): `--max-stack-limit`
231
- docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated
231
+ docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated.jsonl
232
+
233
+ # If you only want to check the ground truths
234
+ docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated.jsonl --check-gt-only
232
235
` ` `
233
236
234
237
...Or if you want to try it locally regardless of the risks ⚠️:
You can’t perform that action at this time.
0 commit comments