Skip to content

Commit 21af836

Browse files
committed
fix: print out failed tasks
1 parent 6762112 commit 21af836

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

bigcodebench/evaluate.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -150,10 +150,11 @@ def evaluate(flags):
150150
cprint(f"Groundtruth pass rate: {gt_pass_rate:.3f}", "green")
151151
else:
152152
cprint(f"Groundtruth pass rate: {gt_pass_rate:.3f}\nPlease be cautious!", "red")
153-
return
154153

155154
if len(failed_tasks) > 0:
156155
cprint(f"Failed tasks: {failed_tasks}", "red")
156+
157+
return
157158

158159
results = {
159160
"date": datetime.now().strftime("%Y-%m-%d %H:%M"),

0 commit comments

Comments
 (0)