Multimodal interfaces go beyond the traditional interaction through keyboard and mouse by incorporating multiple modes of interaction, such as touch, voice, gesture, and even gaze, to create more intuitive and immersive user experiences. This paper investigates how TinyML can be employed for multimodal interfaces in the context of games. An endless game in which the character has to avoid obstacles and fight monsters to advance has been developed. An Arduino Nano 33 BLE Sense is then used as the input device for the game by recognizing the hand gestures of the players.

Xie, H., Hou, L.C., Chau, L.T., Weng, L.K., Wang, X., Guo, Y., et al. (2024). Multimodal Interface for Games: A Case Study with TinyML. 345 E 47TH ST, NEW YORK, NY 10017 USA : IEEE [10.1109/CCNC51664.2024.10454637].

Multimodal Interface for Games: A Case Study with TinyML

Delnevo G.;Ceccarini C.;
2024

Abstract

Multimodal interfaces go beyond the traditional interaction through keyboard and mouse by incorporating multiple modes of interaction, such as touch, voice, gesture, and even gaze, to create more intuitive and immersive user experiences. This paper investigates how TinyML can be employed for multimodal interfaces in the context of games. An endless game in which the character has to avoid obstacles and fight monsters to advance has been developed. An Arduino Nano 33 BLE Sense is then used as the input device for the game by recognizing the hand gestures of the players.
2024
2024 IEEE 21st Consumer Communications & Networking Conference (CCNC)
823
826
Xie, H., Hou, L.C., Chau, L.T., Weng, L.K., Wang, X., Guo, Y., et al. (2024). Multimodal Interface for Games: A Case Study with TinyML. 345 E 47TH ST, NEW YORK, NY 10017 USA : IEEE [10.1109/CCNC51664.2024.10454637].
Xie, H.; Hou, L. C.; Chau, L. T.; Weng, L. K.; Wang, X.; Guo, Y.; Delnevo, G.; Ceccarini, C.; Lam, C. T.; Tang, S. K.
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/1006998
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact