A widely adopted design paradigm for many-core accelerators features processing elements grouped in clusters. Due to area, power and design simplicity, processors in the same clusters are often not equipped with data-caches but rather share a tightly coupled data memory (TCDM). Even if the use of a TCDM is more energy and area efficient than a cache it requires a higher programming effort because memory needs to be explicitly managed with DMA-based L3 to TCDM copies. In this context Software Caches can be used to automatically transfer data between the local TCDM and the external memory, simplifying the task of the programmer. In this paper we present an implementation of Software Cache for the STMicroelectronics STHORM many-core accelerator, featuring a L1 TCDM shared by 16 processors in a cluster. Our main contribution is the design of a fast and thread-safe cache allowing parallel access from different processing elements inside the same cluster. We evaluate our implementation with micro-benchmarks as well as a real world application from the computer vision domain. Results show that a software cache provides major performance improvements with respect to L3 allocation of large data structures even when it is aggressively shared among many parallel threads.

A highly efficient, thread-safe software cache implementation for tightly-coupled multicore clusters2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors / Christian Pinto;Luca Benini. - STAMPA. - (2013), pp. 281-288. (Intervento presentato al convegno IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors (ASAP) tenutosi a Washington, DC nel JUN 05-07, 2013) [10.1109/ASAP.2013.6567591].

A highly efficient, thread-safe software cache implementation for tightly-coupled multicore clusters2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors

PINTO, CHRISTIAN;BENINI, LUCA
2013

Abstract

A widely adopted design paradigm for many-core accelerators features processing elements grouped in clusters. Due to area, power and design simplicity, processors in the same clusters are often not equipped with data-caches but rather share a tightly coupled data memory (TCDM). Even if the use of a TCDM is more energy and area efficient than a cache it requires a higher programming effort because memory needs to be explicitly managed with DMA-based L3 to TCDM copies. In this context Software Caches can be used to automatically transfer data between the local TCDM and the external memory, simplifying the task of the programmer. In this paper we present an implementation of Software Cache for the STMicroelectronics STHORM many-core accelerator, featuring a L1 TCDM shared by 16 processors in a cluster. Our main contribution is the design of a fast and thread-safe cache allowing parallel access from different processing elements inside the same cluster. We evaluate our implementation with micro-benchmarks as well as a real world application from the computer vision domain. Results show that a software cache provides major performance improvements with respect to L3 allocation of large data structures even when it is aggressively shared among many parallel threads.
2013
2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors
281
288
A highly efficient, thread-safe software cache implementation for tightly-coupled multicore clusters2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors / Christian Pinto;Luca Benini. - STAMPA. - (2013), pp. 281-288. (Intervento presentato al convegno IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors (ASAP) tenutosi a Washington, DC nel JUN 05-07, 2013) [10.1109/ASAP.2013.6567591].
Christian Pinto;Luca Benini
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/284921
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 2
social impact