Highly-parallelized simulation of a pixelated LArTPC on a GPU

The DUNE collaboration

doi:10.1088/1748-0221/18/04/P04034

Highly-parallelized simulation of a pixelated LArTPC on a GPU

The DUNE collaboration

University at Albany, Stony Brook University

CERN
University of Oxford
Fermi National Accelerator Laboratory
Universidad del Atlántico
Universidade Tecnológica Federal do Paraná
Georgian Technical University
Brookhaven National Laboratory
University of Bristol
Universidade Estadual de Campinas
University of Houston
Lawrence Berkeley National Laboratory
Variable Energy Cyclotron Centre India
University of Warwick
Université Grenoble Alpes
University of Rochester
University of Colorado Boulder
Kansas State University
Swiss Federal Institute of Technology Zurich
Augustana University
CIEMAT
University of Valencia
University of Santiago de Compostela
Argonne National Laboratory
Illinois Institute of Technology
University of Liverpool
STFC Rutherford Appleton Laboratory (RAL)
University of Ferrara
National Institute for Nuclear Physics
Université d'Antananarivo
Laboratório de Instrumentação e Física Experimental de Partículas
Joint Institute for Nuclear Research
Universidade Federal de Alfenas
SLAC National Accelerator Laboratory
University of Basel
Universidad de Colima
University of Manchester
Columbia University
Universidad EIA
University of Texas at Arlington
Tel Aviv University
University of Sussex
University of Cincinnati
Kyiv National Taras Shevchenko University
Institut de Physique des 2 Infinis de Lyon
Instituto Politécnico Nacional
CERN
University of Oxford
Fermi National Accelerator Laboratory
Lawrence Berkeley National Laboratory
University of Valencia
University of Liverpool
National Institute for Nuclear Physics
Laboratório de Instrumentação e Física Experimental de Partículas
Joint Institute for Nuclear Research
SLAC National Accelerator Laboratory
Columbia University
Tel Aviv University

Research output: Contribution to journal › Article › peer-review

7 Scopus citations

Abstract

The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we present the first implementation of a full microphysical simulator of a liquid argon time projection chamber (LArTPC) equipped with light readout and pixelated charge readout, developed for the DUNE Near Detector. The software is implemented with an end-to-end set of GPU-optimized algorithms. The algorithms have been written in Python and translated into CUDA kernels using Numba, a just-in-time compiler for a subset of Python and NumPy instructions. The GPU implementation achieves a speed up of four orders of magnitude compared with the equivalent CPU version. The simulation of the current induced on 10³ pixels takes around 1 ms on the GPU, compared with approximately 10 s on the CPU. The results of the simulation are compared against data from a pixel-readout LArTPC prototype.

Original language	English
Article number	P04034
Journal	Journal of Instrumentation
Volume	18
Issue number	4
DOIs	https://doi.org/10.1088/1748-0221/18/04/P04034
State	Published - Apr 1 2023

Keywords

Detector modelling and simulations II (electric fields, charge transport, multiplication and induction, pulse formation, electron emission, etc)
Noble liquid detectors (scintillation, ionization, double-phase
Simulation methods and programs
Time projection Chambers (TPC)

Access to Document

10.1088/1748-0221/18/04/P04034

Cite this

@article{66856d266241488387018bdee27e06ff,

title = "Highly-parallelized simulation of a pixelated LArTPC on a GPU",

abstract = "The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we present the first implementation of a full microphysical simulator of a liquid argon time projection chamber (LArTPC) equipped with light readout and pixelated charge readout, developed for the DUNE Near Detector. The software is implemented with an end-to-end set of GPU-optimized algorithms. The algorithms have been written in Python and translated into CUDA kernels using Numba, a just-in-time compiler for a subset of Python and NumPy instructions. The GPU implementation achieves a speed up of four orders of magnitude compared with the equivalent CPU version. The simulation of the current induced on 103 pixels takes around 1 ms on the GPU, compared with approximately 10 s on the CPU. The results of the simulation are compared against data from a pixel-readout LArTPC prototype.",

keywords = "Detector modelling and simulations II (electric fields, charge transport, multiplication and induction, pulse formation, electron emission, etc), Noble liquid detectors (scintillation, ionization, double-phase, Simulation methods and programs, Time projection Chambers (TPC)",

author = "\{The DUNE collaboration\} and \{Abed Abud\}, A. and B. Abi and R. Acciarri and Acero, \{M. A.\} and Adames, \{M. R.\} and G. Adamov and M. Adamowski and D. Adams and M. Adinolfi and C. Adriano and A. Aduszkiewicz and J. Aguilar and Z. Ahmad and J. Ahmed and B. Aimard and F. Akbar and K. Allison and \{Alonso Monsalve\}, S. and M. Alrashed and C. Alt and A. Alton and R. Alvarez and P. Amedo and J. Anderson and Andrade, \{D. A.\} and C. Andreopoulos and M. Andreotti and Andrews, \{M. P.\} and F. Andrianala and S. Andringa and N. Anfimov and \{Anic{\'e}zio Campanelli\}, \{W. L.\} and A. Ankowski and M. Antoniassi and M. Antonova and A. Antoshkin and S. Antusch and A. Aranda-Fernandez and L. Arellano and Arnold, \{L. O.\} and Arroyave, \{M. A.\} and J. Asaadi and A. Ashkenazi and L. Asquith and A. Aurisano and V. Aushev and D. Autiero and M. Ayala-Torres and F. Azfar and V. Jain and Jung, \{C. K.\} and C. Mcgrew and C. Riccio and R. Shrock",

note = "Publisher Copyright: {\textcopyright} 2023 CERN.",

year = "2023",

month = apr,

day = "1",

doi = "10.1088/1748-0221/18/04/P04034",

language = "English",

volume = "18",

journal = "Journal of Instrumentation",

issn = "1748-0221",

number = "4",

}

TY - JOUR

T1 - Highly-parallelized simulation of a pixelated LArTPC on a GPU

AU - The DUNE collaboration

AU - Abed Abud, A.

AU - Abi, B.

AU - Acciarri, R.

AU - Acero, M. A.

AU - Adames, M. R.

AU - Adamov, G.

AU - Adamowski, M.

AU - Adams, D.

AU - Adinolfi, M.

AU - Adriano, C.

AU - Aduszkiewicz, A.

AU - Aguilar, J.

AU - Ahmad, Z.

AU - Ahmed, J.

AU - Aimard, B.

AU - Akbar, F.

AU - Allison, K.

AU - Alonso Monsalve, S.

AU - Alrashed, M.

AU - Alt, C.

AU - Alton, A.

AU - Alvarez, R.

AU - Amedo, P.

AU - Anderson, J.

AU - Andrade, D. A.

AU - Andreopoulos, C.

AU - Andreotti, M.

AU - Andrews, M. P.

AU - Andrianala, F.

AU - Andringa, S.

AU - Anfimov, N.

AU - Anicézio Campanelli, W. L.

AU - Ankowski, A.

AU - Antoniassi, M.

AU - Antonova, M.

AU - Antoshkin, A.

AU - Antusch, S.

AU - Aranda-Fernandez, A.

AU - Arellano, L.

AU - Arnold, L. O.

AU - Arroyave, M. A.

AU - Asaadi, J.

AU - Ashkenazi, A.

AU - Asquith, L.

AU - Aurisano, A.

AU - Aushev, V.

AU - Autiero, D.

AU - Ayala-Torres, M.

AU - Azfar, F.

AU - Jain, V.

AU - Jung, C. K.

AU - Mcgrew, C.

AU - Riccio, C.

AU - Shrock, R.

PY - 2023/4/1

Y1 - 2023/4/1

N2 - The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we present the first implementation of a full microphysical simulator of a liquid argon time projection chamber (LArTPC) equipped with light readout and pixelated charge readout, developed for the DUNE Near Detector. The software is implemented with an end-to-end set of GPU-optimized algorithms. The algorithms have been written in Python and translated into CUDA kernels using Numba, a just-in-time compiler for a subset of Python and NumPy instructions. The GPU implementation achieves a speed up of four orders of magnitude compared with the equivalent CPU version. The simulation of the current induced on 103 pixels takes around 1 ms on the GPU, compared with approximately 10 s on the CPU. The results of the simulation are compared against data from a pixel-readout LArTPC prototype.

AB - The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we present the first implementation of a full microphysical simulator of a liquid argon time projection chamber (LArTPC) equipped with light readout and pixelated charge readout, developed for the DUNE Near Detector. The software is implemented with an end-to-end set of GPU-optimized algorithms. The algorithms have been written in Python and translated into CUDA kernels using Numba, a just-in-time compiler for a subset of Python and NumPy instructions. The GPU implementation achieves a speed up of four orders of magnitude compared with the equivalent CPU version. The simulation of the current induced on 103 pixels takes around 1 ms on the GPU, compared with approximately 10 s on the CPU. The results of the simulation are compared against data from a pixel-readout LArTPC prototype.

KW - Detector modelling and simulations II (electric fields, charge transport, multiplication and induction, pulse formation, electron emission, etc)

KW - Noble liquid detectors (scintillation, ionization, double-phase

KW - Simulation methods and programs

KW - Time projection Chambers (TPC)

UR - https://www.scopus.com/pages/publications/85160013107

U2 - 10.1088/1748-0221/18/04/P04034

DO - 10.1088/1748-0221/18/04/P04034

M3 - Article

SN - 1748-0221

VL - 18

JO - Journal of Instrumentation

JF - Journal of Instrumentation

IS - 4

M1 - P04034

ER -

Highly-parallelized simulation of a pixelated LArTPC on a GPU

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this