Skip to content

Add Crashlytics agent evals #9516

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Nov 25, 2025
Merged

Add Crashlytics agent evals #9516

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
4935e25
Add agent evals for Crashlytics MCP workflows
schnecle Nov 10, 2025
fc5c92a
Update agent-evals to be a commonjs library
schnecle Nov 21, 2025
8d936cd
Spoof package.json for firebase-tools attempts to get the package name
samedson Nov 21, 2025
47ee082
Add functionality to remember information artificially, and add addit…
schnecle Nov 24, 2025
aca7728
Responding to code review comments.
schnecle Nov 24, 2025
2f675c7
Use readonly constructor argument rather than explicit property
schnecle Nov 24, 2025
c210cdc
Updating test expectation to better match current behavior
schnecle Nov 25, 2025
7def9f9
Rename renderTemplate to hydrateTemplate, add jsdoc for expectMemory …
schnecle Nov 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .eslintignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,7 @@ node_modules
standalone
templates
.firebase
scripts/agent-evals/output
scripts/agent-evals/node_modules
scripts/agent-evals/lib
scripts/agent-evals/templates
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ yarn.lock
scripts/*.json

lib/
!scripts/agent-evals/templates/crashlytics-flutter/lib/
dev/
clean/
.gemini/
1 change: 1 addition & 0 deletions .prettierignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
/scripts/frameworks-tests/vite-project/**
/scripts/webframeworks-deploy-tests/angular/**
/scripts/webframeworks-deploy-tests/nextjs/**
/scripts/agent-evals/output/**
/src/frameworks/docs/**
/prompts

Expand Down
2 changes: 1 addition & 1 deletion scripts/agent-evals/.mocharc.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
import:
- ./lib/helpers/mocha-bootstrap.js
- ./lib/scripts/agent-evals/src/helpers/mocha-bootstrap.js
timeout: 120000
recursive: true
node-options:
Expand Down
Loading
Loading