Skip to content

Debug the Miniwob example #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 69 commits into
base: main
Choose a base branch
from
Open

Debug the Miniwob example #48

wants to merge 69 commits into from

Conversation

NicolasAG
Copy link
Collaborator

@NicolasAG NicolasAG commented Jun 16, 2025 •
edited
Loading

  • move the Miniwob agent example to domains/
  • update miniwob config to not use tool calling. Instead it uses json step predictions
  • scale up the number of env servers similarly to the number of actor vllm servers

@NicolasAG NicolasAG self-assigned this Jun 16, 2025
@NicolasAG NicolasAG marked this pull request as ready for review July 11, 2025 14:40
@NicolasAG NicolasAG requested review from AlexPiche and ollmer July 11, 2025 14:40
NicolasAG added 30 commits August 20, 2025 18:21
@NicolasAG
add massimo miniwob split
4101d77
@NicolasAG
cleanup
b00e476
@NicolasAG
update agent reflection node
0b56125
@NicolasAG
towards massimo setup
9b0a74c
@NicolasAG
Merge remote-tracking branch 'origin/main' into debug_miniwob
e6e735d
@NicolasAG
upd configs
ef46f39
@NicolasAG
upd
1274748
@NicolasAG
revert reward calculation
b16d45c
@NicolasAG
update massimo cfg to grpo
9e61c35
@NicolasAG
test with ppo
ef884f2
@NicolasAG
update configs
537ec7a
@NicolasAG
add retry mechanism for agent loop
7a4e73f
@NicolasAG
add 30min timeout to rollout function
42e811e
@NicolasAG
upd configs
a4e8f5f
@NicolasAG
upd
95b735b
@NicolasAG
upd configs
8616303
@NicolasAG
reduce n_env
923cf6a
@NicolasAG
boost preprocess power
44a033f
@NicolasAG
pop old data
2918d1f
@NicolasAG
do not save playwright traces & screenshots
dacaa1f
@NicolasAG
return empty aggregate stats if empty stats
fcee5ee
@NicolasAG
increase preprocessor power
631389f
@NicolasAG
better error handling
f791211
@NicolasAG
fix
c54d900
@NicolasAG
reduce timeouts
ea4918a
@NicolasAG
log number of groups done so far
e5fca10
@NicolasAG
log everything if populate_rl_data fails
df66a88
@NicolasAG
monitor env servers and reset if needed
c8d0171
@NicolasAG
better health message
981cd85
@NicolasAG
small fix
9c755ed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AlexPiche AlexPiche Awaiting requested review from AlexPiche

@ollmer ollmer Awaiting requested review from ollmer

Assignees

@NicolasAG NicolasAG

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@NicolasAG @ollmer