Rosto Radar is a real-time road anomaly detection and mapping system built as part of our final year Computer Engineering project.
The goal is simple - To provide a cheap yet efficient solution for road anomaly detection, classification, mapping and closure in real-time. While most systems still rely on expensive survey vehicles or manual reporting, we aimed to build a scalable, crowd-sourced solution that works in real time.
Rosto Radar is an automated system that uses data from users' smartphones, specialised modules mounted on heavy/commercial vehicles, and vision modules mounted on UAVs or survey vehicles. It uses users' phones to map road anomalies like potholes, speed breakers, rumble strips, etc, and delivers real-time alerts to users about anomalies and provides authorities with a dedicated interface for locating, navigating to, and resolving these issues efficiently.
Find the full report here
Alternative link here
-
Real-time anomaly detection using:
- Smartphone sensors (Accelerometer, GPS)
- Custom MPU-6050 hardware modules on heavy/commercial vehicles
- UAV-based aerial image surveys
-
Dual ML Model System:
- Sensor data → CNN-based classifier
- Image data → YOLOv11 vision model
-
Dynamic routing:
- Choose routes based on shortest path (dijkstra) or least anomalies (dijkstra with added weight for anomalies)
-
Flutter mobile apps:
- User App: Live anomaly alerts, route planning
- Authority App: View & mark anomalies as fixed
-
Django-based backend:
- RESTful API
- JWT authentication
- PostgreSQL + PostGIS + Redis + Celery
- Tile server for map rendering
Frontend - Flutter (User & Admin Apps)
Backend - Django + Django REST Framework
Database - PostgreSQL + PostGIS
ML Models - YOLOv11 (Vision), CNN (Sensor), PyTorch
Hardware - ESP8266, MPU6050, Raspberry Pi Zero W, GPS
Deployment - NGINX, Gunicorn, Docker, Redis, Celery
Anomalies are displayed as clusters and reveal as you zoom into them, and their visibility can be toggled
Anomaly aware routes provide users a shortest route and a route that avoids anomalies but may be slightly longer
We also made an app to allow authorities to quickly find and fix anomalies, start a survey using the UAV, navigate to anomalies and more
Not all areas are easily accessible by ground vehicles. Some roads may be flooded, blocked, or unsafe for driving. In such cases, we used UAVs to survey and map these regions from above. Here's a picture of the drone we worked on.
This module performs the same core function as the smartphone sensors i.e. detecting road anomalies. However, it is a specialized, low-cost hardware unit specifically designed for this purpose. Its compact and durable design allows it to be easily mounted on public transport vehicles such as buses, trucks, or service fleets.