[WIP] Python trace scoring candidate#1278

Draft

CLowbrow wants to merge 92 commits intomainfrom

alex/trace-in-scorer-python

Commits on Nov 9, 2025

kind of works
Alex Z
committed
trace scoring
Alex Z
committed

Commits on Nov 10, 2025

better api
Alex Z
committed

Commits on Nov 11, 2025

more changes
Alex Z
committed
better api
Alex Z
committed

Commits on Nov 20, 2025

Merge branch 'main' into alex/trace-in-scorer
Alex Z
committed

Commits on Nov 21, 2025

make trace context flush before fetching
Alex Z
committed

Commits on Dec 1, 2025

Merge branch 'main' into alex/trace-in-scorer
Alex Z
committed
rename
Alex Z
committed
jsdoc
Alex Z
committed

Commits on Dec 15, 2025

Merge branch 'main' into alex/trace-in-scorer
Alex Z
committed

Commits on Dec 16, 2025

cache v1
Alex Z
committed
tmp file
Alex Z
committed
flag
Alex Z
committed
bump vers to fix test
Alex Z
committed
major bump
Alex Z
committed
disable local cache
Alex Z
committed
otel support?
Alex Z
committed
turn off cache when otel is used
Alex Z
committed

Commits on Dec 17, 2025

remove console.log
Alex Z
committed
sensible new version
Alex Z
committed
Merge branch 'main' into alex/trace-in-scorer
Alex Z
committed
fix build
Alex Z
committed
try to fix web builds
Alex Z
committed
don't pass trace to scoring args
Alex Z
committed

Commits on Dec 19, 2025

Merge branch 'main' into alex/trace-in-scorer
Alex Z
committed

Commits on Dec 26, 2025

pass state into the trace object
Alex Z
committed
get passed in state
Alex Z
committed
make cache writes not block
Alex Z
committed
remove trace re-export
Alex Z
committed
fix test
Alex Z
committed
extend object fetcher
Alex Z
committed
refactors for objects
Alex Z
committed

Commits on Dec 29, 2025

state argument for init function
Alex Z
committed
forgot doc
Alex Z
committed
Merge branch 'main' into alex/trace-in-scorer
CLowbrow
authored
evaluator doesn't always have state
Alex Z
committed
console
Alex Z
committed

Commits on Dec 30, 2025

Merge branch 'main' into alex/trace-in-scorer
ankrgyl
committed

Commits on Dec 31, 2025

Commits on Jan 1, 2026

Commits on Jan 2, 2026

fix
ankrgyl
committed

Commits on Jan 3, 2026

Commits on Jan 9, 2026

Merge branch 'main' into alex/trace-in-scorer
ankrgyl
committed

Commits on Jan 10, 2026

only turn cache on for evals
Alex Z
committed

Commits on Jan 12, 2026

Commits on Jan 13, 2026

factor out cached span fetcher
ankrgyl
committed
spancache cleanup
Alex Z
committed
init cache in inner eval method
Alex Z
committed
handle parallell evals
Alex Z
committed
belt and suspenders
Alex Z
committed
remove logs
Alex Z
committed
use mergeDict
Alex Z
committed
cleanup
Alex Z
committed

Commits on Jan 14, 2026

Commits on Jan 15, 2026

Commits on Jan 16, 2026

Commits on Jan 20, 2026

Merge branch 'main' into alex/trace-in-scorer-python
ankrgyl
committed