Skip to content

cgtuebingen/ua3dscancomp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Latent Uncertainty-Aware Multi-View SDF Scan Completion

Watch Video

Authors: Faezeh Zakeri, Lukas Ruppert, Raphael Braun, and Hendrik P.A. Lensch

Code Repository: ua3dscancomp


Abstract

Imperfect reconstructions arising from occlusions, shadows, reflections, and other factors during 3D scanning often result in incomplete sections of the scanned object, with missing parts scattered randomly across its surface. We introduce an uncertainty-aware signed distance field (SDF) latent transformer that leverages uncertainty to identify and reconstruct missing parts based on the global shape of the incomplete scanned object and the immediate neighborhood of the affected regions. To our knowledge, we are the first to utilize uncertainties for SDF shape completion in the latent space. Our model has been trained on the entire Objaverse 1.0 dataset and demonstrates that our uncertainty-aware SDF completion method significantly outperforms previous works both numerically and visually.


Demo Gif

For high quality video, click here!

Ua3dscancomp Demo

Project Structure

├── data/
├── src/
├── docs/
├── requirements.txt
└── README.md

📦 Model Checkpoint

Shape Completion on Objaverse

Patchwise Variational Autoencoder (P-VAE) on Shapenet

Dataset

P-VAE

The source code for P-VAE can be taken from POC-SLT repository.

Running Instructions

  • Evaluation

    • You can evaluate via eval_config.py and given the model checkpoint above.
  • Train from scratch

On-the-Fly SDF Calculation

The code for this part will very soon be published in another github repository and will be linked here.

@article{Zakeri2026ua3dscancomp,
  author  = {Zakeri, Faezeh and Ruppert, Lukas, and Braun, Raphael, and Lensch, Hendrik P.A.},
  title   = {Latent Uncertainty-Aware Multi-View SDF Scan Completion},
  journal = {The IEEE/CVF Winter Conference on Applications of Computer Vision, WACV},
  year    = {2026},
  month   = {March 10},
  note    = {}
}

Releases

No releases published

Packages

 
 
 

Contributors