AI summary · arXiv: 2112.05722v1 · hep-ph

SymmetryGAN: Symmetry Discovery with Deep Learning

Krish Desai, Benjamin Nachman, Jesse Thaler
Original paper · DOI 10.1103/physrevd.105.096031 Submitted to arXiv on 10 Dec. 2021 Published in Physical Review D (26 May. 2022) 19 pages, 17 figures License: CC BY 4.0

How to read this summary? Illustrated guide

The essentials

  • Authors explore the concept of symmetries in datasets
  • Symmetries of individual data elements can be characterized by their invariance under different transformations
  • Symmetries of an ensemble of data elements become ambiguous due to Jacobian factors introduced during coordinate changes
  • Authors propose a statistical definition of dataset symmetries involving inertial reference densities, drawing an analogy to inertial frames in classical mechanics
  • Introduce SymmetryGAN as a novel approach for discovering symmetries using deep learning techniques based on generative adversarial networks (GANs)
  • Performance of SymmetryGAN evaluated on Gaussian examples and demonstrates excellent empirical results consistent with expectations from the analytic loss landscape
  • Applied to simulated dijet events from the Large Hadron Collider (LHC) to showcase potential utility in high-energy collider physics applications
  • Procedures explored to infer underlying symmetry group from empirical data
  • Contributes to advancing understanding of dataset symmetries and provides a powerful tool for discovering and analyzing these symmetries using deep learning methods
  • Findings have implications for various fields where understanding and leveraging dataset symmetries are crucial for further research and applications.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: SymmetryGAN Deep Learning Dataset Symmetries Generative Adversarial Networks (GANs) Inertial Reference Densities

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
In the paper "SymmetryGAN: Symmetry Discovery with Deep Learning," authors Krish Desai, Benjamin Nachman, and Jesse Thaler explore the concept of symmetries in datasets. While the symmetries of individual data elements can be characterized by their invariance under different transformations, the symmetries of an ensemble of data elements become ambiguous due to Jacobian factors introduced during coordinate changes. To address this issue, the authors propose a rigorous statistical definition of dataset symmetries that involves inertial reference densities, drawing an analogy to inertial frames in classical mechanics. They introduce SymmetryGAN as a novel approach to automatically discover symmetries using deep learning techniques based on generative adversarial networks (GANs). The performance of SymmetryGAN is evaluated on Gaussian examples and demonstrates excellent empirical results consistent with expectations from the analytic loss landscape. Furthermore, it is applied to simulated dijet events from the Large Hadron Collider (LHC) to showcase its potential utility in high-energy collider physics applications. Beyond symmetry discovery, the paper explores procedures to infer the underlying symmetry group from empirical data. This work contributes to advancing our understanding of dataset symmetries and provides a powerful tool for discovering and analyzing these symmetries using deep learning methods. Overall, this paper presents a comprehensive investigation into dataset symmetries and introduces an innovative approach for their discovery and analysis. The findings have implications for various fields where understanding and leveraging dataset symmetries are crucial for further research and applications.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 1 free rewrite left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Continue with Google Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero Zotero guide
Citation alerts 49 papers already cite it: be emailed each new one. Citation alerts guide
Who works on it?

Among the 31 papers around this one, the name that comes back most: Roy T. Forestano (5 papers)

9 more people sign several of them. The full map adds their institutions and approaches, from the papers of the last years.

Continue with Google Create a free account: your first map is free
Weekly letter The latest letter of its field, "Particles, nuclei and gravitation this week" of 16 November 2026: Particles, nuclei and gravitation this week: Black-hole identities and the traces particles leave · Receive one by email for free

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Very close Cites this paper
    Latent Space Symmetry Discovery
    Jianwei Yang, Nima Dehmamy, R. Walters et al. · 2023 · International Conference on Machine Learning · cited 38 times · Not summarized yet
    Abstract

    Equivariant neural networks require explicit knowledge of the symmetry group. Automatic symmetry discovery methods aim to relax this constraint and learn invariance and equivariance from data. However, existing symmetry discovery methods are limited to simple linear symmetries and cannot handle the complexity of real-world data. We propose a novel generative model, Latent LieGAN (LaLiGAN), which can discover symmetries of nonlinear group actions. It learns a mapping from the data space to a latent space where the symmetries become linear and simultaneously discovers symmetries in the latent space. Theoretically, we show that our model can express nonlinear symmetries under some conditions ab…

  2. Very close Cites this paper
    Learning Infinitesimal Generators of Continuous Symmetries from Data
    Gyeonghoon Ko, Hyunsu Kim, Juho Lee · 2024 · Neural Information Processing Systems · cited 18 times · Not summarized yet
    Abstract

    Exploiting symmetry inherent in data can significantly improve the sample efficiency of a learning procedure and the generalization of learned models. When data clearly reveals underlying symmetry, leveraging this symmetry can naturally inform the design of model architectures or learning strategies. Yet, in numerous real-world scenarios, identifying the specific symmetry within a given data distribution often proves ambiguous. To tackle this, some existing works learn symmetry in a data-driven manner, parameterizing and learning expected symmetry through data. However, these methods often rely on explicit knowledge, such as pre-defined Lie groups, which are typically restricted to linear or…

  3. Very close Cites this paper
    Symmetry Discovery Beyond Affine Transformations
    Ben Shaw, A. Magner, Kevin R. Moon · 2024 · Neural Information Processing Systems · cited 16 times · Not summarized yet
    Abstract

    Symmetry detection can improve various machine learning tasks. In the context of continuous symmetry detection, current state of the art experiments are limited to detecting affine transformations. Under the manifold assumption, we outline a framework for discovering continuous symmetry in data beyond the affine transformation group. We also provide a similar framework for discovering discrete symmetry. We experimentally compare our method to an existing method known as LieGAN and show that our method is competitive at detecting affine symmetries for large sample sizes and superior than LieGAN for small sample sizes. We also show our method is able to detect continuous symmetries beyond the …

  4. Very close Cites this paper
    Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles
    Roy T. Forestano, K. Matchev, K. Matcheva et al. · 2023 · Machine Learning: Science and Technology · cited 29 times · Not summarized yet
    Abstract

    We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO(2), SO(3), and SO(4), and of the Lorentz gro…

  5. Close Cites this paper
    Identifying the Group-Theoretic Structure of Machine-Learned Symmetries
    Roy T. Forestano, K. Matchev, K. Matcheva et al. · 2023 · Physics Letters B · cited 8 times · Not summarized yet
    Abstract

    Deep learning was recently successfully used in deriving symmetry transformations that preserve important physics quantities. Being completely agnostic, these techniques postpone the identification of the discovered symmetries to a later stage. In this letter we propose methods for examining and identifying the group-theoretic structure of such machine-learned symmetries. We design loss functions which probe the subalgebra structure either during the deep learning stage of symmetry discovery or in a subsequent post-processing stage. We illustrate the new methods with examples from the U(n) Lie group family, obtaining the respective subalgebra decompositions. As an application to particle phy…

  6. Close Cites this paper Uses this paper in depth
    SymmetryLens: Unsupervised Symmetry Learning via Locality and Density Preservation
    Onur Efe, Arkadas Ozakin · 2024 · Symmetry · cited 1 time · Not summarized yet
    Abstract

    We develop a new unsupervised symmetry learning method that starts with raw data and provides the minimal generator of an underlying Lie group of symmetries, together with a symmetry-equivariant representation of the data, which turns the hidden symmetry into an explicit one. The method is able to learn the pixel translation operator from a dataset with only an approximate translation symmetry and can learn quite different types of symmetries that are not apparent to the naked eye. The method is based on the formulation of an information-theoretic loss function that measures both the degree of symmetry of a dataset under a candidate symmetry generator and a proposed notion of locality of the…

  7. Close Cited by this paper
    Symmetry meets AI
    G. Barenboim, J. Hirn, V. Sanz · 2021 · SciPost Physics · cited 26 times · Not summarized yet
    Abstract

    We explore whether Neural Networks (NNs) can discover the presence of symmetries as they learn to perform a task. For this, we train hundreds of NNs on a decoy task based on well-controlled Physics templates, where no information on symmetry is provided. We use the output from the last hidden layer of all these NNs, projected to fewer dimensions, as the input for a symmetry classification task, and show that information on symmetry had indeed been identified by the original NN without guidance. As an interdisciplinary application of this procedure, we identify the presence and level of symmetry in artistic paintings from different styles such as those of Picasso, Pollock and Van Gogh.

  8. Close Cited by this paper Cites this paper A method it uses
    A method to challenge symmetries in data with self-supervised learning
    R. Tombs, C. Lester · 2021 · Journal of Instrumentation · cited 31 times · Not summarized yet
    Abstract

    Symmetries are key properties of physical models and of experimental designs, but any proposed symmetry may or may not be realized in nature. In this paper, we introduce a practical and general method to test such suspected symmetries in data, with minimal external input. Self-supervision, which derives learning objectives from data without external labelling, is used to train models to predict 'which is real?' between real data and symmetrically transformed alternatives. If these models make successful predictions in independent tests, then they challenge the targeted symmetries. Crucially, our method handles filtered data, which often arise from inefficiencies or deliberate selections, and…

Prior work it builds on

  1. Close
    Symmetries, safety, and self-supervision
    B. Dillon, G. Kasieczka, Hans Olischläger et al. · 2021 · SciPost Physics · cited 138 times · Not summarized yet
    Abstract

    Collider searches face the challenge of defining a representation of high-dimensional data such that physical symmetries are manifest, the discriminating features are retained, and the choice of representation is new-physics agnostic. We introduce JetCLR to solve the mapping from low-level data to optimized observables through self-supervised contrastive learning. As an example, we construct a data representation for top and QCD jets using a permutation-invariant transformer-encoder network and visualize its symmetry properties. We compare the JetCLR representation with alternative representations using linear classifier tests and find it to work quite well.

  2. Related
    Meta-Learning Symmetries by Reparameterization
    Allan Zhou, Tom Knowles, Chelsea Finn · 2020 · Machine Learning · cited 111 times · AI summary available
    Abstract

    Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only works when practitioners know a-priori symmetries of the task and can manually construct an architecture with the corresponding equivariances. Our goal is a general approach for learning equivariances from data, without needing prior knowledge of a task's symmetries or custom task-specific architectures. We present a method for learning and encoding equivariances into networks by learning corresponding parameter sharing patterns from data. Our method can p…

  3. Related A method it uses
    Anomaly Detection for Resonant New Physics with Machine Learning.
    J. Collins, K. Howe, B. Nachman · 2018 · Physical Review Letters · cited 199 times · Not summarized yet
    Abstract

    Despite extensive theoretical motivation for physics beyond the standard model (BSM) of particle physics, searches at the Large Hadron Collider have found no significant evidence for BSM physics. Therefore, it is essential to broaden the sensitivity of the search program to include unexpected scenarios. We present a new model-agnostic anomaly detection technique that naturally benefits from modern machine learning algorithms. The only requirement on the signal for this new procedure is that it is localized in at least one known direction in phase space. Any other directions of phase space that are uncorrelated with the localized one can be used to search for unexpected features. This new met…

  4. Related A method it uses
    The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics
    Gregor Kasieczka, B. Nachman, David Shih et al. · 2021 · Reports on progress in physics. Physical Society · cited 225 times · Not summarized yet
    Abstract

    A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). Methods made use of modern machine learning tools and were based on unsupervised learning (autoencoders, …

  5. Related A method it uses
    Generative Adversarial Networks
    Gilad Cohen, R. Giryes · 2021 · International Conference on Computing Communication and Networking Technologies · cited 28,188 times · Not summarized yet
    Abstract

    Generative Adversarial Networks (GANs) are a type of deep learning techniques that have shown remarkable success in generating realistic images, videos, and other types of data. This paper provides a comprehensive guide to GANs, covering their architecture, loss functions, training methods, applications, evaluation metrics, challenges, and future directions. We begin with an introduction to GANs and their historical development, followed by a review of the background and related work. We then provide a detailed overview of the GAN architecture, including the generator and discriminator networks, and discuss the key design choices and variations. Next, we review the loss functions utilized in…

Papers that cite it

  1. Close* Uses this paper in depth
    SymmetryLens: A new candidate paradigm for unsupervised symmetry learning via locality and equivariance
    Onur Efe, Arkadas Ozakin · 2024 · arXiv.org · preprint, not peer reviewed · Not summarized yet
  2. Close
    Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning
    Ramzan Basheer, Deepak Mishra · 2024 · arXiv.org · preprint, not peer reviewed · cited 5 times · Not summarized yet
    Abstract

    Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount in obtaining robust and compact feature representations that remain unaffected by nontrivial geometric transformations, which vanilla CNNs cannot effectively handle. Recognizing rotation, translation, permutation, or scale symmetries can lead to equivariance properties in the learned representations. This has led to notable advancements in computer vision and machine learning tasks under the framework of geometric deep learning, as compared to their invari…

  3. Close
    Spectral Discovery of Continuous Symmetries via Generalized Fourier Transforms
    Pavan Karjol, Kumar Shubham, A. Prathosh · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet
    Abstract

    Continuous symmetries are fundamental to many scientific and learning problems, yet they are often unknown a priori. Existing symmetry discovery approaches typically search directly in the space of transformation generators or rely on learned augmentation schemes. We propose a fundamentally different perspective based on spectral structure. We introduce a framework for discovering continuous one-parameter subgroups using the Generalized Fourier Transform (GFT). Our central observation is that invariance to a subgroup induces structured sparsity in the spectral decomposition of a function across irreducible representations. Instead of optimizing over generators, we detect symmetries by identi…

  4. Close
    Oracle-Preserving Latent Flows
    Alexander Roman, Roy T. Forestano, K. Matchev et al. · 2023 · Symmetry · cited 6 times · Not summarized yet
    Abstract

    A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with severa…

  5. Close
    Adaptive Symmetry Discovery for Dynamical System Identification
    B. Tahmasebi, Melanie Weber · 2026 · arXiv.org · preprint, not peer reviewed · cited 4 times · Not summarized yet
    Abstract

    Dynamical systems model trajectory data generated by fixed underlying dynamics, with applications ranging from biology to physics. Especially in scientific settings, dynamical systems are not generic but often exhibit symmetries imposed by physical laws, formalized through equivariance with respect to group actions. The identification problem concerns recovering the parameters of a system from observed trajectories. In this work, we study adaptive symmetry discovery for dynamical system identification and address how a system can be identified from a single trajectory when it is equivariant with respect to an unknown symmetry group. To this end, we first show that for known symmetries, the s…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

Updated on 4 November 2026.

The illustrated guide to the papers around a paper

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.