This project works through a small, fictional workflow-intake dataset with inconsistent records, missing ownership, unclear priority labels, and incomplete closure notes.
The focus is on the analysis process: identifying data-quality issues, defining clearer intake rules, documenting review steps, and producing simple reporting outputs.
A fictional operations team receives workflow records from multiple intake channels. The records are useful, but inconsistent. Some have missing ownership, inconsistent priority labels, duplicate indicators, vague descriptions, incomplete closure notes, and inconsistent system-area names.
Without a structured intake model and validation process, the team cannot reliably prioritize work, report KPIs, or identify process improvement opportunities.
- A fictional workflow-intake dataset
- Cleaning and validation scripts
- A data dictionary and JSON schema
- SQL examples for quality checks and KPI review
- Requirements, user stories, and acceptance criteria
- Prompt examples for classification and validation review
- Stakeholder and data-quality summaries
| Folder | Contents |
|---|---|
data/ |
Raw and processed fictional sample data |
schema/ |
JSON schema and data dictionary |
sql/ |
Table definitions, quality checks, KPI queries, and gap-analysis queries |
docs/ |
Requirements, process map, current/future analysis, API data-contract notes, validation, and audit trail |
prompts/ |
Prompt templates and review notes |
reports/ |
KPI, data-quality, and stakeholder summaries |
scripts/ |
Cleaning and validation scripts |
- Raw workflow intake records are received as CSV data.
- Cleaning logic normalizes priority, status, and system-area values.
- Validation logic flags missing fields, inconsistent values, ownership gaps, duplicate indicators, and closure documentation gaps.
- SQL examples query the cleaned data for quality checks, KPIs, and gap analysis.
- Analyst documentation translates findings into requirements, user stories, acceptance criteria, process improvements, and stakeholder summaries.
- Prompt examples outline classification, extraction, and validation-review support.
- Manual review remains required before final decisions.
Start with:
docs/business_context.mdREADME.mdschema/data_dictionary.mdreports/stakeholder_summary.mddocs/requirements.mddocs/user_stories.mddocs/acceptance_criteria.mdsql/02_data_quality_checks.sqldocs/api_data_contract.mdprompts/prompt_safety_notes.md
Then inspect the scripts and outputs.
From the repository root, run python .\scripts\clean_workflow_data.py, then run python .\scripts\validate_records.py.
Outputs:
data/processed/workflow_items_clean.csvdata/processed/workflow_items_validated.csvreports/data_quality_findings.md
This is a sample project using fictional sample data. It is not connected to a live ticketing system, production database, private employer system, or real customer environment.
Prompt examples are limited to classification, extraction, and validation-review support. They are not autonomous decision-making tools. Final classification, prioritization, and recommendations require manual review.
This repository uses fictional data to show a practical analysis workflow. It is not a production system.