BackgroundAlthough digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates.MethodsTwenty healthy older adults, 20 people with Parkinson's disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated.ResultsWe identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture).Algorithms' performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms.ConclusionsOverall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms' performances.Trial registration ISRCTN - 12246987.

Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium / Micó-Amigo, M. Encarna; Bonci, Tecla; Paraschiv-Ionescu, Anisoara; Ullrich, Martin; Kirk, Cameron; Soltani, Abolfazl; Küderle, Arne; Gazit, Eran; Salis, Francesca; Alcock, Lisa; Aminian, Kamiar; Becker, Clemens; Bertuletti, Stefano; Brown, Philip; Buckley, Ellen; Cantu, Alma; Carsin, Anne-Elie; Caruso, Marco; Caulfield, Brian; Cereatti, Andrea; Chiari, Lorenzo; D’Ascanio, Ilaria; Eskofier, Bjoern; Fernstad, Sara; Froehlich, Marcel; Garcia-Aymerich, Judith; Hansen, Clint; Hausdorff, Jeffrey M.; Hiden, Hugo; Hume, Emily; Keogh, Alison; Kluge, Felix; Koch, Sarah; Maetzler, Walter; Megaritis, Dimitrios; Mueller, Arne; Niessen, Martijn; Palmerini, Luca; Schwickert, Lars; Scott, Kirsty; Sharrack, Basil; Sillén, Henrik; Singleton, David; Vereijken, Beatrix; Vogiatzis, Ioannis; Yarnall, Alison J.; Rochester, Lynn; Mazzà, Claudia; Del Din, Silvia; null, null. - In: JOURNAL OF NEUROENGINEERING AND REHABILITATION. - ISSN 1743-0003. - ELETTRONICO. - 20:(2023), pp. 78.1-78.26. [10.1186/s12984-023-01198-5]

Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium

Chiari, Lorenzo;D’Ascanio, Ilaria;Palmerini, Luca;
2023

Abstract

BackgroundAlthough digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates.MethodsTwenty healthy older adults, 20 people with Parkinson's disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated.ResultsWe identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture).Algorithms' performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms.ConclusionsOverall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms' performances.Trial registration ISRCTN - 12246987.
2023
Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium / Micó-Amigo, M. Encarna; Bonci, Tecla; Paraschiv-Ionescu, Anisoara; Ullrich, Martin; Kirk, Cameron; Soltani, Abolfazl; Küderle, Arne; Gazit, Eran; Salis, Francesca; Alcock, Lisa; Aminian, Kamiar; Becker, Clemens; Bertuletti, Stefano; Brown, Philip; Buckley, Ellen; Cantu, Alma; Carsin, Anne-Elie; Caruso, Marco; Caulfield, Brian; Cereatti, Andrea; Chiari, Lorenzo; D’Ascanio, Ilaria; Eskofier, Bjoern; Fernstad, Sara; Froehlich, Marcel; Garcia-Aymerich, Judith; Hansen, Clint; Hausdorff, Jeffrey M.; Hiden, Hugo; Hume, Emily; Keogh, Alison; Kluge, Felix; Koch, Sarah; Maetzler, Walter; Megaritis, Dimitrios; Mueller, Arne; Niessen, Martijn; Palmerini, Luca; Schwickert, Lars; Scott, Kirsty; Sharrack, Basil; Sillén, Henrik; Singleton, David; Vereijken, Beatrix; Vogiatzis, Ioannis; Yarnall, Alison J.; Rochester, Lynn; Mazzà, Claudia; Del Din, Silvia; null, null. - In: JOURNAL OF NEUROENGINEERING AND REHABILITATION. - ISSN 1743-0003. - ELETTRONICO. - 20:(2023), pp. 78.1-78.26. [10.1186/s12984-023-01198-5]
Micó-Amigo, M. Encarna; Bonci, Tecla; Paraschiv-Ionescu, Anisoara; Ullrich, Martin; Kirk, Cameron; Soltani, Abolfazl; Küderle, Arne; Gazit, Eran; Salis, Francesca; Alcock, Lisa; Aminian, Kamiar; Becker, Clemens; Bertuletti, Stefano; Brown, Philip; Buckley, Ellen; Cantu, Alma; Carsin, Anne-Elie; Caruso, Marco; Caulfield, Brian; Cereatti, Andrea; Chiari, Lorenzo; D’Ascanio, Ilaria; Eskofier, Bjoern; Fernstad, Sara; Froehlich, Marcel; Garcia-Aymerich, Judith; Hansen, Clint; Hausdorff, Jeffrey M.; Hiden, Hugo; Hume, Emily; Keogh, Alison; Kluge, Felix; Koch, Sarah; Maetzler, Walter; Megaritis, Dimitrios; Mueller, Arne; Niessen, Martijn; Palmerini, Luca; Schwickert, Lars; Scott, Kirsty; Sharrack, Basil; Sillén, Henrik; Singleton, David; Vereijken, Beatrix; Vogiatzis, Ioannis; Yarnall, Alison J.; Rochester, Lynn; Mazzà, Claudia; Del Din, Silvia; null, null
File in questo prodotto:
File Dimensione Formato  
Assessing real-world gait with digital technology Validation, insights and recommendations from the Mobilise-D consortium.pdf

accesso aperto

Descrizione: Article PDF
Tipo: Versione (PDF) editoriale
Licenza: Creative commons
Dimensione 3.95 MB
Formato Adobe PDF
3.95 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/963345
Citazioni
  • ???jsp.display-item.citation.pmc??? 9
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 10
social impact