Skip to content

Conversation

@rodneykinney
Copy link
Member

@rodneykinney rodneykinney commented Aug 21, 2025

Bump astabench version to 0.1.0, the one without the solvers module.

Remove git authentication from Dockerfile

@rodneykinney
Copy link
Member Author

@mdarcy220 Maybe we can both work from this branch and push changes as we make them?

I will start by looking into the CI failure setting up the sandbox

@rodneykinney
Copy link
Member Author

Making any necessary changes to asta-bench in allenai/asta-bench#108. If we just make sure this pair of branches work together, we can merge them at the same time.

@mdarcy220
Copy link
Collaborator

thanks, this sounds like a good plan

I am diverted to paper work today but will hopefully be able to take a look tomorrow, spin up a full eval over the weekend to verify against existing results, and then if all goes well we can merge early Monday

@rodneykinney
Copy link
Member Author

rodneykinney commented Aug 22, 2025

Evals failing because https://huggingface.co/datasets/allenai/asta-bench is not public. Adding credentials temporarily to fix. Make a note to https://github.com/allenai/astabench-issues/issues/392 that this repo should be made public

Copy link
Collaborator

@mdarcy220 mdarcy220 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit: 🤞

@rodneykinney rodneykinney merged commit 526f68a into main Aug 25, 2025
4 checks passed
@rodneykinney rodneykinney deleted the debug branch August 25, 2025 19:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants