Text-to-audio synthesis (TTA) promises sound generation mediated solely by natural language. Like all generative deep learning techniques, it derives its world memory and semantic boundaries from the dataset with which it is trained. Following a humanistic tradition of critical algorithm analysis, this article examines the datasets employed by various text-to-audio synthesis models and how they are designed and manipulated by researchers. Datasets are not inert informational structures, but socio-technical objects involving specific symbolisations mediated by cultural, po litical, and industrial perspectives. A comparative study of label datasets, caption datasets, and algorithmically augmented datasets reveals the technical and ethical limitations associated with a quantitative approach to data collection. In contrast to a purely computational dataset evaluation paradigm, a qualitative analysis methodology is proposed to interpret the connotative capability of models and suggest alternative practices in the collection of information.

Ancona, R. (2024). Una prospettiva critica sui dataset per la sintesi text-to-audio.

Una prospettiva critica sui dataset per la sintesi text-to-audio

Riccardo Ancona
2024

Abstract

Text-to-audio synthesis (TTA) promises sound generation mediated solely by natural language. Like all generative deep learning techniques, it derives its world memory and semantic boundaries from the dataset with which it is trained. Following a humanistic tradition of critical algorithm analysis, this article examines the datasets employed by various text-to-audio synthesis models and how they are designed and manipulated by researchers. Datasets are not inert informational structures, but socio-technical objects involving specific symbolisations mediated by cultural, po litical, and industrial perspectives. A comparative study of label datasets, caption datasets, and algorithmically augmented datasets reveals the technical and ethical limitations associated with a quantitative approach to data collection. In contrast to a purely computational dataset evaluation paradigm, a qualitative analysis methodology is proposed to interpret the connotative capability of models and suggest alternative practices in the collection of information.
2024
Memorie proiettive/Projecting Memories. XXIV CIM – Colloquio di Informatica Musicale
107
114
Ancona, R. (2024). Una prospettiva critica sui dataset per la sintesi text-to-audio.
Ancona, Riccardo
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/1010833
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact