27. August 2020 - Providentia editors

Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems

Most intelligent transportation systems use a combination of radar sensors and cameras for robust vehicle perception. The calibration of these heterogeneous sensor types in an automatic fashion during system operation is challenging due to differing physical measurement principles and the high sparsity of traffic radars. We propose – to the best of our knowledge – the first data-driven method for automatic rotational radar-camera calibration without dedicated calibration targets. Our approach is based on a coarse and a fine convolutional neural network. We employ a boosting-inspired training algorithm, where we train the fine network on the residual error of the coarse network. Due to the unavailability of public datasets combining radar and camera measurements, we recorded our own real-world data. We demonstrate that our method is able to reach precise and robust sensor registration and show its generalization capabilities to different sensor alignments and perspectives.

TO THE PUBLICATION

FURTHER CURRENT TOPICS

9. October 2021

ITS World Congress: An industry on the way to the City Brain

Providentia++ will present the current state of research at the ITS World Congress. What consortium leader Prof. Alois Knoll expects from the leading congress for intelligent transport systems and what the external infrastructure has to do with a City Brain.

MORE >

6. August 2021

Expanding the A9 test field: Improvisation required

Expanding the A9 test section for autonomous and connected driving required a great deal of research and pragmatic decision-making. Now that it has been accomplished and the scientists are at work, we look back at eight challenges and their solutions.

MORE >

6. August 2021

Connected car services with great potential

Vehicle connectivity and automation is becoming increasingly important in the automotive industry. Particularly high growth potential is expected for connected car services, according to a recent study by IW Consult and Fraunhofer IAO.

MORE >