| CARVIEW |
3D Neural Edge Reconstruction
CVPR 2024
4Tübingen AI Center 5Utopilot 6Microsoft
Abstract
Real-world objects and environments are predominantly composed of edge features, including straight lines and curves. Such edges are crucial elements for various applications, such as CAD modeling, surface meshing, lane mapping, etc. However, existing traditional methods only prioritize lines over curves for simplicity in geometric modeling. To this end, we introduce EMAP, a new method for learning 3D edge representations with a focus on both lines and curves. Our method implicitly encodes 3D edge distance and direction in Unsigned Distance Functions (UDF) from multi-view edge maps. On top of this neural representation, we propose an edge extraction algorithm that robustly abstracts parametric 3D edges from the inferred edge points and their directions. Comprehensive evaluations demonstrate that our method achieves better 3D edge reconstruction on multiple challenging datasets. We further show that our learned UDF field enhances neural surface reconstruction by capturing more details.
Video
Overview
Our 3D neural edge reconstruction learns accurate 3D edge point locations and directions implicitly from multi-view edge maps through (1) UDF learning and (2) abstracts 3D parametric edges from the learned UDF field.
Results
Comparison on Replica_Edge Dataset
LIMAP and NEAT only reconstruct distinctive line segments, our method generates a more complete 3D edge map combining both line and curve features.
RGB
LIMAP
NEAT
Ours
Comparison on NEF-ABC_Edge Dataset
CAD Models
LIMAP
NEF
Ours
GT
Comparison on DTU_Edge Dataset
LIMAP
NEF
NEAT
Ours
Pseudio GT
BibTeX
@InProceedings{Li2024CVPR,
title={3D Neural Edge Reconstruction},
author={Li, Lei and Peng, Songyou and Yu, Zehao and Liu, Shaohui and Pautrat, R{\'e}mi and Yin, Xiaochuan and Pollefeys, Marc},
booktitle={IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
year={2024},
}