Skip to content

Conversation

@chun61205
Copy link

@chun61205 chun61205 commented Jun 14, 2025

While using run_experiment, I discovered that even if the experiment completes successfully, the script will crash if the output file is not named final_info.json. This happens because the postprocessing logic assumes the presence of this file:

else:
with open(osp.join(cwd, f"run_{run_num}", "final_info.json"), "r") as f:
results = json.load(f)
results = {k: v["means"] for k, v in results.items()}
next_prompt = f"""Run {run_num} completed. Here are the results:

Therefore, this pr

  1. Adds an explicit check for the existence of final_info.json after a successful experiment run.
  2. Adds an extra prompt signal to remind the model (or agent) that experiment.py must generate final_info.json.

@chun61205 chun61205 marked this pull request as ready for review June 14, 2025 01:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant