Skip to content

Validate lecturer quality metrics accuracy #39

Description

@dcasota

Task Description

Human validation that lecturer-reported quality metrics match reality.

Validation Areas

  1. Grammar Issues: Spot-check 10-20 reported grammar issues

    • Are they real issues?
    • False positive rate?
  2. Markdown Issues: Verify markdown violations

    • Heading hierarchy correct?
    • Code block detection accurate?
  3. Link Issues: Verify orphan link detection

    • Are 404s real?
    • Any false positives?
  4. Quality Score: Validate overall quality score calculation

    • Does 85% → 95% improvement seem reasonable?
    • Are weightings appropriate?

Decision Points

  • Are metrics trustworthy for quality gates?
  • Should we adjust thresholds?
  • Ready for auditor integration?

Acceptance Criteria

  • ✅ Spot-checked sample issues
  • ✅ False positive rate <5%
  • ✅ Quality score methodology validated
  • ✅ Decision made on proceeding

Related

Labels

lecturer-integration, validation, decision-needed, high

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions