Augmented reality (AR) technology is increasingly adopted in the surgical field and recently it has been also introduced in robotic-assisted urologic surgery. This work describes the design and development of an AR intraoperative guide system with stereoscopic visualization (SAR, stereoscopic augmented reality) for the Da Vinci surgical robot. As a major novelty, the developed SAR system allows the surgeon to have the virtual 3D model of patient anatomy superimposed on the real field, without losing the stereoscopic view of the operative field. The workflow starts with the 3D model generation of the anatomical district of interest for surgery, from patient diagnostic imaging. Then, the 3D model is uploaded in the developed SAR application, navigated using a 3D space mouse, and superimposed to the operative field using computer vision algorithms. The SAR system was tested during 30 robot-assisted surgeries, including 20 partial nephrectomies, 1 kidney explant, and 9 radical prostatectomies. The SAR guidance system received overall great appreciation from surgeons and helped in localizing hidden structures, such as arteries or tumoral masses, increasing the understanding of surgical anatomy with depth perception, and facilitating intraoperative navigation. Future efforts will be addressed to improve the automatic superimposition of digital 3D models on the intraoperative view.

STEREOSCOPIC AUGMENTED REALITY FOR INTRAOPERATIVE GUIDANCE IN ROBOTIC SURGERY / TARTARINI, LORENZO; RICCARDO, SCHIAVINA; BIANCHI, LORENZO; LODI, SIMONE; GAUDIANO, CATERINA; BORTOLANI, BARBARA; CERCENELLI, LAURA; BRUNOCILLA, EUGENIO; MARCELLI, EMANUELA. - In: JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY. - ISSN 0219-5194. - ELETTRONICO. - 23:06(2023), pp. 2340040.1-2340040.11. [10.1142/S0219519423400407]

STEREOSCOPIC AUGMENTED REALITY FOR INTRAOPERATIVE GUIDANCE IN ROBOTIC SURGERY

TARTARINI, LORENZO
Primo
;
RICCARDO, SCHIAVINA
Secondo
;
BIANCHI, LORENZO;LODI, SIMONE;BORTOLANI, BARBARA;CERCENELLI, LAURA
;
BRUNOCILLA, EUGENIO
Penultimo
;
MARCELLI, EMANUELA
Ultimo
2023

Abstract

Augmented reality (AR) technology is increasingly adopted in the surgical field and recently it has been also introduced in robotic-assisted urologic surgery. This work describes the design and development of an AR intraoperative guide system with stereoscopic visualization (SAR, stereoscopic augmented reality) for the Da Vinci surgical robot. As a major novelty, the developed SAR system allows the surgeon to have the virtual 3D model of patient anatomy superimposed on the real field, without losing the stereoscopic view of the operative field. The workflow starts with the 3D model generation of the anatomical district of interest for surgery, from patient diagnostic imaging. Then, the 3D model is uploaded in the developed SAR application, navigated using a 3D space mouse, and superimposed to the operative field using computer vision algorithms. The SAR system was tested during 30 robot-assisted surgeries, including 20 partial nephrectomies, 1 kidney explant, and 9 radical prostatectomies. The SAR guidance system received overall great appreciation from surgeons and helped in localizing hidden structures, such as arteries or tumoral masses, increasing the understanding of surgical anatomy with depth perception, and facilitating intraoperative navigation. Future efforts will be addressed to improve the automatic superimposition of digital 3D models on the intraoperative view.
2023
STEREOSCOPIC AUGMENTED REALITY FOR INTRAOPERATIVE GUIDANCE IN ROBOTIC SURGERY / TARTARINI, LORENZO; RICCARDO, SCHIAVINA; BIANCHI, LORENZO; LODI, SIMONE; GAUDIANO, CATERINA; BORTOLANI, BARBARA; CERCENELLI, LAURA; BRUNOCILLA, EUGENIO; MARCELLI, EMANUELA. - In: JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY. - ISSN 0219-5194. - ELETTRONICO. - 23:06(2023), pp. 2340040.1-2340040.11. [10.1142/S0219519423400407]
TARTARINI, LORENZO; RICCARDO, SCHIAVINA; BIANCHI, LORENZO; LODI, SIMONE; GAUDIANO, CATERINA; BORTOLANI, BARBARA; CERCENELLI, LAURA; BRUNOCILLA, EUGENIO; MARCELLI, EMANUELA
File in questo prodotto:
File Dimensione Formato  
JMMB-S-22-00622-14_merged.pdf

Open Access dal 16/05/2024

Tipo: Postprint
Licenza: Licenza per accesso libero gratuito
Dimensione 645.4 kB
Formato Adobe PDF
645.4 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/956745
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact