Human action recognition plays a fundamental role in the design of smart solution for home environments, particularly in relation to ambient assisted living applications, where the support of an automated system could improve the quality of life of humans trying to interpret and anticipate user needs, recognizing unusual behaviors or preventing dangerous situations (e.g. falls). In this work the potentialities of the Kinect sensor are fully exploited to design a robust approach for activity recognition combining the analysis of skeleton and RGB data streams. The skeleton representation is designed to capture the most representative body postures, while the temporal evolution of actions is better highlighted by the representation obtained from RGB images. The experimental results confirm that the combination of these two data sources allow to capture highly discriminative features resulting in an approach able to achieve state-of-the-art performance on public benchmarks.

A multimodal approach for human activity recognition based on skeleton and RGB data / Franco, Annalisa; Magnani, Antonio; Maio, Dario. - In: PATTERN RECOGNITION LETTERS. - ISSN 0167-8655. - STAMPA. - 131:(2020), pp. 293-299. [10.1016/j.patrec.2020.01.010]

A multimodal approach for human activity recognition based on skeleton and RGB data

Franco, Annalisa
;
Magnani, Antonio;Maio, Dario
2020

Abstract

Human action recognition plays a fundamental role in the design of smart solution for home environments, particularly in relation to ambient assisted living applications, where the support of an automated system could improve the quality of life of humans trying to interpret and anticipate user needs, recognizing unusual behaviors or preventing dangerous situations (e.g. falls). In this work the potentialities of the Kinect sensor are fully exploited to design a robust approach for activity recognition combining the analysis of skeleton and RGB data streams. The skeleton representation is designed to capture the most representative body postures, while the temporal evolution of actions is better highlighted by the representation obtained from RGB images. The experimental results confirm that the combination of these two data sources allow to capture highly discriminative features resulting in an approach able to achieve state-of-the-art performance on public benchmarks.
2020
A multimodal approach for human activity recognition based on skeleton and RGB data / Franco, Annalisa; Magnani, Antonio; Maio, Dario. - In: PATTERN RECOGNITION LETTERS. - ISSN 0167-8655. - STAMPA. - 131:(2020), pp. 293-299. [10.1016/j.patrec.2020.01.010]
Franco, Annalisa; Magnani, Antonio; Maio, Dario
File in questo prodotto:
File Dimensione Formato  
Manuscript.pdf

accesso aperto

Tipo: Postprint
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione - Non commerciale - Non opere derivate (CCBYNCND)
Dimensione 690.03 kB
Formato Adobe PDF
690.03 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/718706
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 74
  • ???jsp.display-item.citation.isi??? 53
social impact