Skip to content

feat(ai): modified blur detector by adding edge density and flicker rate#918

Open
DhanviNautiyal wants to merge 2 commits into
vicharanashala:mainfrom
DhanviNautiyal:feature/background-blur-detection
Open

feat(ai): modified blur detector by adding edge density and flicker rate#918
DhanviNautiyal wants to merge 2 commits into
vicharanashala:mainfrom
DhanviNautiyal:feature/background-blur-detection

Conversation

@DhanviNautiyal

Copy link
Copy Markdown

Implement real-time detection of virtual background / software blur using edge AI in the browser.

Previously, blur detection relied only on Laplacian variance, which was insufficient for detecting virtual backgrounds or software-applied blur.

This update enhances detection by combining:

  • Laplacian variance (blur detection)
  • Sobel edge density (edge loss)
  • Background variance using segmentation mask
  • Frame-to-frame flicker detection

The detection runs fully on the client (Edge AI), ensuring privacy and real-time performance.

Key Changes

Frontend:

  • Enhanced BlurDetectorWorker.ts with:
    • Sobel operator for edge density
    • Background variance calculation
    • Weighted anomaly scoring
  • Updated BlurDetector.tsx:
    • Integrated MediaPipe Selfie Segmentation
    • Added throttling to anomaly reporting (5s interval)

Backend:

  • Reused existing BLUR_DETECTION anomaly pipeline
  • No schema changes required

Improvements

  • Detects virtual blur
  • Reduces false positives
  • Works in real-time
  • No backend video processing required

Dependencies

  • depends on: none

@github-actions github-actions Bot added frontend Changes to the frontend of the project dependencies Modifications to any frontend or backend external dependencies backend labels Apr 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend dependencies Modifications to any frontend or backend external dependencies frontend Changes to the frontend of the project

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant