Skip to content

This PR wires Mastra tracing to persistent PostgreSQL storage for local development #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
MabudAlam wants to merge 2 commits into
base: main
Choose a base branch
from
Open

This PR wires Mastra tracing to persistent PostgreSQL storage for local development #73

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
ff069f3
feat: add Mastra traces for debugging
MabudAlam May 23, 2026
90588a9
Merge remote-tracking branch 'origin/main' into add-traces
MabudAlam May 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions backend/package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,8 @@
"@clerk/backend": "^3.4.11",
"@fastify/cors": "^11.0.0",
"@mastra/core": "^1.36.0",
"@mastra/observability": "^1.13.0",
"@mastra/pg": "^1.11.1",
"@openrouter/ai-sdk-provider": "^2.9.0",
"ai": "^6.0.0",
"convex": "^1.39.1",
Expand Down
2 changes: 2 additions & 0 deletions backend/src/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ import { sendTransactionalEmail } from "./email/send.js";
import { datasetReadyTemplate } from "./email/templates/dataset-ready.js";
import { capture, shutdown as shutdownAnalytics } from "./analytics/posthog.js";
import { EVENTS } from "./analytics/events.js";
import { mastra } from "./mastra/index.js";

/** Domain part of an email, for analytics (we never log full addresses). */
function emailDomain(email: string): string {
Expand Down Expand Up @@ -539,6 +540,7 @@ await fastify.register(async (instance) => {

return reply.code(202).send({ success: true, runId: run.runId });
} catch (err) {
await mastra.observability.getDefaultInstance()?.flush();
const msg = err instanceof Error ? err.message : String(err);
if (msg.includes("validator") || msg.includes("Invalid")) {
return reply.code(400).send({ error: "Invalid datasetId" });
Expand Down
27 changes: 25 additions & 2 deletions backend/src/mastra/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,16 @@ import { Mastra } from "@mastra/core/mastra";
import { inferSchemaWorkflow } from "./workflows/infer-schema.js";
import { populateWorkflow } from "./workflows/populate.js";
import { updateWorkflow } from "./workflows/update.js";

import { PostgresStore } from '@mastra/pg'
import {
Observability,
MastraStorageExporter,
SensitiveDataFilter,
} from '@mastra/observability'
const storage = new PostgresStore({
id: 'mastra-pg-storage',
connectionString: process.env.MASTRA_DATABASE_URL!,
})
Comment on lines +11 to +14

@coderabbitai coderabbitai Bot May 23, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor | ⚡ Quick win

Missing validation for MASTRA_DATABASE_URL environment variable.

The non-null assertion (!) on process.env.MASTRA_DATABASE_URL will pass undefined to PostgresStore if the variable is missing, likely causing a cryptic connection error at runtime rather than a clear startup failure.

Consider validating this in env.ts alongside other required variables, or add a guard here:

Proposed fix 
+const mastraDbUrl = process.env.MASTRA_DATABASE_URL;
+if (!mastraDbUrl) {
+  throw new Error('MASTRA_DATABASE_URL environment variable is required');
+}
+
 const storage = new PostgresStore({
   id: 'mastra-pg-storage',
-  connectionString: process.env.MASTRA_DATABASE_URL!,
+  connectionString: mastraDbUrl,
 })
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
const storage = new PostgresStore({
id: 'mastra-pg-storage',
connectionString: process.env.MASTRA_DATABASE_URL!,
})
const mastraDbUrl = process.env.MASTRA_DATABASE_URL;
if (!mastraDbUrl) {
throw new Error('MASTRA_DATABASE_URL environment variable is required');
}
const storage = new PostgresStore({
id: 'mastra-pg-storage',
connectionString: mastraDbUrl,
})
🤖 Prompt for AI Agents 
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@backend/src/mastra/index.ts` around lines 12 - 15, The code uses a non-null
assertion for process.env.MASTRA_DATABASE_URL when constructing PostgresStore
(storage), which can pass undefined and produce cryptic runtime errors; replace
that with an explicit validation: read and validate MASTRA_DATABASE_URL (either
in env.ts alongside other vars or at the top of this module), throw a clear
startup Error if it's missing, and then pass the validated string into new
PostgresStore({ id: 'mastra-pg-storage', connectionString:
validatedMastraDatabaseUrl }); ensure you remove the trailing "!" and reference
the validated variable when creating storage.

/**
* Mastra registry.
*
Expand All @@ -16,4 +25,18 @@ import { updateWorkflow } from "./workflows/update.js";
*/
export const mastra = new Mastra({
workflows: { inferSchemaWorkflow, populateWorkflow, updateWorkflow },
});

storage,
observability: new Observability({

configs: {
default: {
serviceName: 'bigset',
exporters: [new MastraStorageExporter({ strategy: 'auto' })],
spanOutputProcessors: [
new SensitiveDataFilter(),
],
},
},
}),
});
2 changes: 2 additions & 0 deletions docker-compose.dev.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ services:
CLERK_PUBLISHABLE_KEY: ${NEXT_PUBLIC_CLERK_PUBLISHABLE_KEY:-}
OPENROUTER_API_KEY: ${OPENROUTER_API_KEY:-}
TINYFISH_API_KEY: ${TINYFISH_API_KEY:-}
MASTRA_DATABASE_URL: postgresql://bigset:bigset@db:5432/bigset_internal
# Transactional email — when unset, the email module no-ops.
RESEND_API_KEY: ${RESEND_API_KEY:-}
EMAIL_FROM: ${EMAIL_FROM:-BigSet <simantak@tinyfish.ai>}
Expand Down Expand Up @@ -65,6 +66,7 @@ services:
CONVEX_URL: http://convex:3210
CONVEX_SELF_HOSTED_ADMIN_KEY: ${CONVEX_SELF_HOSTED_ADMIN_KEY:-}
TINYFISH_API_KEY: ${TINYFISH_API_KEY:-}
MASTRA_DATABASE_URL: postgresql://bigset:bigset@db:5432/bigset_internal
depends_on:
convex:
condition: service_healthy
Comment on lines +69 to 72

@coderabbitai coderabbitai Bot May 23, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major | ⚡ Quick win

mastra service should depend on db for PostgreSQL connectivity.

The mastra service uses MASTRA_DATABASE_URL pointing to the db service, but only declares a dependency on convex. If mastra starts before db is healthy, the PostgreSQL connection will fail.

Proposed fix 
     depends_on:
+      db:
+        condition: service_healthy
       convex:
         condition: service_healthy
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
MASTRA_DATABASE_URL: postgresql://bigset:bigset@db:5432/bigset_internal
depends_on:
convex:
condition: service_healthy
MASTRA_DATABASE_URL: postgresql://bigset:bigset@db:5432/bigset_internal
depends_on:
db:
condition: service_healthy
convex:
condition: service_healthy
🤖 Prompt for AI Agents 
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docker-compose.dev.yml` around lines 58 - 61, The mastra service is missing a
dependency on the db service even though MASTRA_DATABASE_URL points at
PostgreSQL; update the mastra service's depends_on block to include db with
condition: service_healthy (in addition to the existing convex dependency) so
Docker Compose waits for the db to be healthy before starting mastra.

Expand Down