Skip to content

Feature Request: 360° Panoramic Image Annotation with LiDAR Point Cloud Overlay #10416

@sinjup

Description

@sinjup

Actions before raising this issue

  • I searched the existing issues and did not find anything similar.
  • I read/searched the docs

Is your feature request related to a problem? Please describe.

Use Case
We are working on a road quality inspection project where images are captured using a Ladybug 360° camera mounted on a survey vehicle, alongside a LiDAR scanner. We need annotators to be able to view and annotate directly on the 360° panoramic (equirectangular) image in an immersive viewer similar to Google Street View, with the LiDAR point cloud overlaid as context.

What we need

A 360° spherical viewer inside the annotation workspace where the user can look around using mouse drag and keyboard
Ability to draw annotations (polygons, bounding boxes) directly on the sphere surface
LiDAR point cloud overlay on the sphere so the user can click any point on the image and get its real-world depth/distance
What we have already done
We have embedded a basic panoramic viewer into CVAT (v2.58.1 self-hosted). The viewer renders the equirectangular image correctly as a sphere using THREE.js (already a dependency in cvat-canvas3d). However the standard annotation tools are not available in this view.

Is there an existing approach or branch in CVAT that handles equirectangular/spherical annotation?
Has anyone successfully overlaid the SVG annotation layer on top of a THREE.js WebGL canvas in CVAT?
What is the recommended approach for storing spherical annotations — equirectangular pixel coordinates, or spherical degrees (yaw/pitch)?
Are there plans to support 360° media types natively in a future CVAT release?

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions