Skip to content

Commit 4f5d0e5

Browse files
schneclesamedson
andauthored
Add Crashlytics agent evals (#9516)
* Add agent evals for Crashlytics MCP workflows * Update agent-evals to be a commonjs library * Spoof package.json for firebase-tools attempts to get the package name * Add functionality to remember information artificially, and add additional test coverage across supported platforms * Responding to code review comments. * Use readonly constructor argument rather than explicit property * Updating test expectation to better match current behavior * Rename renderTemplate to hydrateTemplate, add jsdoc for expectMemory in gemini cli --------- Co-authored-by: samedson <[email protected]>
1 parent d64023c commit 4f5d0e5

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

47 files changed

+3575
-561
lines changed

.eslintignore

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,3 +5,7 @@ node_modules
55
standalone
66
templates
77
.firebase
8+
scripts/agent-evals/output
9+
scripts/agent-evals/node_modules
10+
scripts/agent-evals/lib
11+
scripts/agent-evals/templates

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ yarn.lock
2828
scripts/*.json
2929

3030
lib/
31+
!scripts/agent-evals/templates/crashlytics-flutter/lib/
3132
dev/
3233
clean/
3334
.gemini/

.prettierignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@
55
/scripts/frameworks-tests/vite-project/**
66
/scripts/webframeworks-deploy-tests/angular/**
77
/scripts/webframeworks-deploy-tests/nextjs/**
8+
/scripts/agent-evals/output/**
89
/src/frameworks/docs/**
910
/prompts
1011

scripts/agent-evals/.mocharc.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
import:
2-
- ./lib/helpers/mocha-bootstrap.js
2+
- ./lib/scripts/agent-evals/src/helpers/mocha-bootstrap.js
33
timeout: 120000
44
recursive: true
55
node-options:

0 commit comments

Comments
 (0)