Geant4-FastSim - Fast inference of Diffusion models

Description

In high-energy physics experiments such as the Large Hadron Collider (LHC), some particles interact electromagnetically and/or hadronically with the material of the calorimeter, creating cascades of secondary particles, or showers. Describing the showering process relies on simulation methods that precisely define all particle interactions with matter. A detailed and accurate simulation is based on the Geant4 toolkit. The simulation of showers, with large amounts of particles created and tracked, is inherently slow. Alternatively, machine learning techniques such as generative models are used to speed up the generation of showers in a calorimeter, i.e., simulating the calorimeter response to certain particles.

Considering this, we are investigating a few different kinds of generative models such as VAE, VQ-VAE, and Diffusion based on transformer architecture. Diffusion models have proven to be significantly more accurate than others, which is what we need. However, these diffusion models come at the cost of slow inference. Therefore, this project aims to make the inference of diffusion models faster.

Furthermore, a byproduct of this project is that the student will get to work with diffusion transformer models which are currently at the forefront of AI research and learn to use them in the context of high-granularity shower data (a part of CaloChallenge).

First Steps

  1. Understand how transformers and diffusion models work.
  2. Understand the shower data.
  3. Propose ideas (with justification) for faster inference of diffusion models.

Project Milestones

Expected Results

A fast and accurate diffusion model for fast simulation of calorimetry showers.

Requirements

Evaluation Tasks and Timeline

  1. Find the test here. Please submit it via email by 9:00 CET 7th March 2024.
  2. We will make the selections based on the test and resume by 17:00 CET 8th March.
  3. Students should write a short proposal (2 pages max) describing how they would approach the problem. Submit this by 18th March. We advise you to not start working on the proposal before you hear from us on 8th March.
  4. We will do a second round of selection based on the short proposal. Then students will write the full proposal and submit it according to the official GSoC timeline.

Mentors

(Please don’t email before completing the test. It’s not possible to reply to everyone.)

Additional Information

Corresponding Project

Participating Organizations