Time-of-Flight (ToF) sensors and stereo vision systems are two widely used technologies for depth estimation. Due to their rather complementary strengths and limitations, the two sensors are often combined to infer more accurate depth maps. A key research issue in this field is how to estimate the reliability of the sensed depth data. While this problem has been widely studied for stereo systems, it has been seldom considered for ToF sensors. Therefore, starting from the work done for stereo data, in this paper, we firstly introduce novel confidence estimation techniques for ToF data. Moreover, we also show how by using learning-based confidence metrics jointly trained on the two sensors yields better performance. Finally, deploying different fusion frameworks, we show how confidence estimation can be exploited in order to guide the fusion of depth data fromthe two sensors. Experimental results show how accurate confidence cues allow outperforming state-of-the-art data fusion schemes even with the simplest fusion strategies known in the literature.

Confidence Estimation for ToF and Stereo Sensors and Its Application to Depth Data Fusion / Poggi, Matteo; Agresti, Gianluca; Tosi, Fabio; Zanuttigh, Pietro; Mattoccia, Stefano. - In: IEEE SENSORS JOURNAL. - ISSN 1530-437X. - ELETTRONICO. - 20:3(2020), pp. 1411-1421. [10.1109/JSEN.2019.2946591]

Confidence Estimation for ToF and Stereo Sensors and Its Application to Depth Data Fusion

Poggi, Matteo;Tosi, Fabio;Mattoccia, Stefano
2020

Abstract

Time-of-Flight (ToF) sensors and stereo vision systems are two widely used technologies for depth estimation. Due to their rather complementary strengths and limitations, the two sensors are often combined to infer more accurate depth maps. A key research issue in this field is how to estimate the reliability of the sensed depth data. While this problem has been widely studied for stereo systems, it has been seldom considered for ToF sensors. Therefore, starting from the work done for stereo data, in this paper, we firstly introduce novel confidence estimation techniques for ToF data. Moreover, we also show how by using learning-based confidence metrics jointly trained on the two sensors yields better performance. Finally, deploying different fusion frameworks, we show how confidence estimation can be exploited in order to guide the fusion of depth data fromthe two sensors. Experimental results show how accurate confidence cues allow outperforming state-of-the-art data fusion schemes even with the simplest fusion strategies known in the literature.
2020
Confidence Estimation for ToF and Stereo Sensors and Its Application to Depth Data Fusion / Poggi, Matteo; Agresti, Gianluca; Tosi, Fabio; Zanuttigh, Pietro; Mattoccia, Stefano. - In: IEEE SENSORS JOURNAL. - ISSN 1530-437X. - ELETTRONICO. - 20:3(2020), pp. 1411-1421. [10.1109/JSEN.2019.2946591]
Poggi, Matteo; Agresti, Gianluca; Tosi, Fabio; Zanuttigh, Pietro; Mattoccia, Stefano
File in questo prodotto:
File Dimensione Formato  
IEEE_Sensors_Journal_2020.pdf

accesso aperto

Tipo: Postprint
Licenza: Licenza per accesso libero gratuito
Dimensione 7.56 MB
Formato Adobe PDF
7.56 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/715050
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 19
  • ???jsp.display-item.citation.isi??? 19
social impact