Skip to content

Commit 5ee31e4

Browse files
authored
add probes template (#215)
1 parent 9049d50 commit 5ee31e4

File tree

7 files changed

+9990
-0
lines changed

7 files changed

+9990
-0
lines changed

templates/probes/README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
# Probes
2+
3+
This folder contains a template for running experiments on probing / steering tasks.
4+
It is based on [this repo](https://github.com/jorispos/ConceptorSteering).
5+
We expect baseline score to be around 10%.
6+
7+
## Structure of the template
8+
9+
- `antonyms.json`. A list of antonym pairs.
10+
- `experiment.py`. The python file containing the code for the probing task.
11+
- `plot.py`. Empty file, to be filled automatically by the AI Scientist pipeline.
12+
- `prompt.json`. The prompts for the template.
13+
- `requirements.txt`. The dependencies for the template.
14+
- `seed_ideas.json`. A list of seed ideas for the AI Scientist pipeline.

0 commit comments

Comments
 (0)