Skip to content

Commit d22757a

Browse files
gurusha01claude
andcommitted
README: describe reward schemes by behavior, not internal version names
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 1beacfd commit d22757a

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -152,10 +152,10 @@ per task lives in `configs/`:
152152
uv run rl --config configs/prime_rl_v9.2_titanic_tree.toml
153153
```
154154

155-
The reward is computed from the best score reached anywhere in the episode's tree.
156-
Three schemes are available (`reward_scheme` in the config): `v6_binary`,
157-
`v7_fixed_tier`, and `v9_percentile` (a rolling-percentile threshold; the most
158-
used). Rollout logs go to `$AIR_ROLLOUT_LOG_DIR` (default `./rollout_logs`).
155+
The reward is computed from the best score reached anywhere in the episode's tree;
156+
the reward shaping is selectable via `reward_scheme` in the config (binary,
157+
fixed-tier, or rolling-percentile). Rollout logs go to `$AIR_ROLLOUT_LOG_DIR`
158+
(default `./rollout_logs`).
159159

160160
## Reproducing the paper figures
161161

0 commit comments

Comments
 (0)