Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems
Most intelligent transportation systems use a combination of radar sensors and cameras for robust vehicle perception. The calibration of these heterogeneous sensor types in an automatic fashion during system operation is challenging due to differing physical measurement principles and the high sparsity of traffic radars. We propose – to the best of our knowledge – the first data-driven method for automatic rotational radar-camera calibration without dedicated calibration targets. Our approach is based on a coarse and a fine convolutional neural network. We employ a boosting-inspired training algorithm, where we train the fine network on the residual error of the coarse network. Due to the unavailability of public datasets combining radar and camera measurements, we recorded our own real-world data. We demonstrate that our method is able to reach precise and robust sensor registration and show its generalization capabilities to different sensor alignments and perspectives.
FURTHER CURRENT TOPICS
ITS World Congress: An industry on the way to the City Brain
Providentia++ will present the current state of research at the ITS World Congress. What consortium leader Prof. Alois Knoll expects from the leading congress for intelligent transport systems and what the external infrastructure has to do with a City Brain.
Expanding the A9 test field: Improvisation required
Expanding the A9 test section for autonomous and connected driving required a great deal of research and pragmatic decision-making. Now that it has been accomplished and the scientists are at work, we look back at eight challenges and their solutions.
Connected car services with great potential
Vehicle connectivity and automation is becoming increasingly important in the automotive industry. Particularly high growth potential is expected for connected car services, according to a recent study by IW Consult and Fraunhofer IAO.