Covert speech, the mental imagery of speaking, has been studied increasingly to understand and decode thoughts in the context of brain-computer interfaces. In studies of speech comprehension, neural oscillations are thought to play a key role in the temporal encoding of speech. However, little is known about the role of oscillations in covert speech. In this study, we investigated the oscillatory involvements in covert speech and speech perception. Data were collected from 10 participants with 64 channel EEG. Participants heard the words, ‘blue’ and ‘orange’, and subsequently mentally rehearsed them. First, continuous wavelet transform was performed on epoched signals and subsequently two-tailed t-tests between two classes (tasks) were conducted to determine statistical differences in frequency and time (t-CWT). In the current experiment, a task comprised speech perception or covert rehearsal of a word while a condition was the discrimination between tasks. Features were extracted using t-CWT and subsequently classified using a support vector machine. θ and γ phase amplitude coupling (PAC) was also assessed within tasks and across conditions between perception and covert activities (i.e. cross-task). All binary classifications accuracies (80–90%) significantly exceeded chance level, supporting the use of t-CWT in determining relative oscillatory involvements. While the perception condition dynamically invoked all frequencies with more prominent θ and α activity, the covert condition favoured higher frequencies with significantly higher γ activity than perception. Moreover, the perception condition produced significant θ-γ PAC, possibly corroborating a reported linkage between syllabic and phonemic sampling. Although this coupling was found to be suppressed in the covert condition, we found significant cross-task coupling between perception θ and covert speech γ. Covert speech processing appears to be largely associated with higher frequencies of EEG. Importantly, the significant cross-task coupling between speech perception and covert speech, in the absence of within-task covert speech PAC, seems to support the notion that the γ- and θ-bands reflect, respectively, shared and unique encoding processes across tasks.

A comparison and classification of oscillatory characteristics in speech perception and covert speech / Moon J.; Orlandi S.; Chau T.. - In: BRAIN RESEARCH. - ISSN 0006-8993. - ELETTRONICO. - 1781:(2022), pp. 147778.1-147778.14. [10.1016/j.brainres.2022.147778]

A comparison and classification of oscillatory characteristics in speech perception and covert speech

Orlandi S.
Secondo
Writing – Review & Editing
;
2022

Abstract

Covert speech, the mental imagery of speaking, has been studied increasingly to understand and decode thoughts in the context of brain-computer interfaces. In studies of speech comprehension, neural oscillations are thought to play a key role in the temporal encoding of speech. However, little is known about the role of oscillations in covert speech. In this study, we investigated the oscillatory involvements in covert speech and speech perception. Data were collected from 10 participants with 64 channel EEG. Participants heard the words, ‘blue’ and ‘orange’, and subsequently mentally rehearsed them. First, continuous wavelet transform was performed on epoched signals and subsequently two-tailed t-tests between two classes (tasks) were conducted to determine statistical differences in frequency and time (t-CWT). In the current experiment, a task comprised speech perception or covert rehearsal of a word while a condition was the discrimination between tasks. Features were extracted using t-CWT and subsequently classified using a support vector machine. θ and γ phase amplitude coupling (PAC) was also assessed within tasks and across conditions between perception and covert activities (i.e. cross-task). All binary classifications accuracies (80–90%) significantly exceeded chance level, supporting the use of t-CWT in determining relative oscillatory involvements. While the perception condition dynamically invoked all frequencies with more prominent θ and α activity, the covert condition favoured higher frequencies with significantly higher γ activity than perception. Moreover, the perception condition produced significant θ-γ PAC, possibly corroborating a reported linkage between syllabic and phonemic sampling. Although this coupling was found to be suppressed in the covert condition, we found significant cross-task coupling between perception θ and covert speech γ. Covert speech processing appears to be largely associated with higher frequencies of EEG. Importantly, the significant cross-task coupling between speech perception and covert speech, in the absence of within-task covert speech PAC, seems to support the notion that the γ- and θ-bands reflect, respectively, shared and unique encoding processes across tasks.
2022
A comparison and classification of oscillatory characteristics in speech perception and covert speech / Moon J.; Orlandi S.; Chau T.. - In: BRAIN RESEARCH. - ISSN 0006-8993. - ELETTRONICO. - 1781:(2022), pp. 147778.1-147778.14. [10.1016/j.brainres.2022.147778]
Moon J.; Orlandi S.; Chau T.
File in questo prodotto:
File Dimensione Formato  
Moon_2022_Brain Research.pdf

accesso riservato

Tipo: Versione (PDF) editoriale
Licenza: Licenza per accesso riservato
Dimensione 4.68 MB
Formato Adobe PDF
4.68 MB Adobe PDF   Visualizza/Apri   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/875136
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 3
social impact