AI summary · arXiv: 2112.05722v1 · hep-ph
SymmetryGAN: Symmetry Discovery with Deep Learning
The essentials
- Authors explore the concept of symmetries in datasets
- Symmetries of individual data elements can be characterized by their invariance under different transformations
- Symmetries of an ensemble of data elements become ambiguous due to Jacobian factors introduced during coordinate changes
- Authors propose a statistical definition of dataset symmetries involving inertial reference densities, drawing an analogy to inertial frames in classical mechanics
- Introduce SymmetryGAN as a novel approach for discovering symmetries using deep learning techniques based on generative adversarial networks (GANs)
- Performance of SymmetryGAN evaluated on Gaussian examples and demonstrates excellent empirical results consistent with expectations from the analytic loss landscape
- Applied to simulated dijet events from the Large Hadron Collider (LHC) to showcase potential utility in high-energy collider physics applications
- Procedures explored to infer underlying symmetry group from empirical data
- Contributes to advancing understanding of dataset symmetries and provides a powerful tool for discovering and analyzing these symmetries using deep learning methods
- Findings have implications for various fields where understanding and leveraging dataset symmetries are crucial for further research and applications.
Key points written by AI: they may contain errors, check them against the paper.
Ask questions about this paper to our AI assistant
How to chat with this paper? Illustrated guide
You can also chat with multiple papers at once here.
Keep this conversation — a free account saves your questions and answers, your collections of papers and your alerts.
Continue with Google Create a free accountTools for this paper
Advanced tools Premium
For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium
Among the 31 papers around this one, the name that comes back most: Roy T. Forestano (5 papers)
9 more people sign several of them. The full map adds their institutions and approaches, from the papers of the last years.
Papers around this one
See them on a mapRanked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
Latent Space Symmetry DiscoveryJianwei Yang, Nima Dehmamy, R. Walters et al. · 2023 · International Conference on Machine Learning · cited 38 times · Not summarized yet
Abstract
Equivariant neural networks require explicit knowledge of the symmetry group. Automatic symmetry discovery methods aim to relax this constraint and learn invariance and equivariance from data. However, existing symmetry discovery methods are limited to simple linear symmetries and cannot handle the complexity of real-world data. We propose a novel generative model, Latent LieGAN (LaLiGAN), which can discover symmetries of nonlinear group actions. It learns a mapping from the data space to a latent space where the symmetries become linear and simultaneously discovers symmetries in the latent space. Theoretically, we show that our model can express nonlinear symmetries under some conditions ab…
-
Learning Infinitesimal Generators of Continuous Symmetries from DataGyeonghoon Ko, Hyunsu Kim, Juho Lee · 2024 · Neural Information Processing Systems · cited 18 times · Not summarized yet
Abstract
Exploiting symmetry inherent in data can significantly improve the sample efficiency of a learning procedure and the generalization of learned models. When data clearly reveals underlying symmetry, leveraging this symmetry can naturally inform the design of model architectures or learning strategies. Yet, in numerous real-world scenarios, identifying the specific symmetry within a given data distribution often proves ambiguous. To tackle this, some existing works learn symmetry in a data-driven manner, parameterizing and learning expected symmetry through data. However, these methods often rely on explicit knowledge, such as pre-defined Lie groups, which are typically restricted to linear or…
-
Symmetry Discovery Beyond Affine TransformationsBen Shaw, A. Magner, Kevin R. Moon · 2024 · Neural Information Processing Systems · cited 16 times · Not summarized yet
Abstract
Symmetry detection can improve various machine learning tasks. In the context of continuous symmetry detection, current state of the art experiments are limited to detecting affine transformations. Under the manifold assumption, we outline a framework for discovering continuous symmetry in data beyond the affine transformation group. We also provide a similar framework for discovering discrete symmetry. We experimentally compare our method to an existing method known as LieGAN and show that our method is competitive at detecting affine symmetries for large sample sizes and superior than LieGAN for small sample sizes. We also show our method is able to detect continuous symmetries beyond the …
-
Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principlesRoy T. Forestano, K. Matchev, K. Matcheva et al. · 2023 · Machine Learning: Science and Technology · cited 29 times · Not summarized yet
Abstract
We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO(2), SO(3), and SO(4), and of the Lorentz gro…
-
Identifying the Group-Theoretic Structure of Machine-Learned SymmetriesRoy T. Forestano, K. Matchev, K. Matcheva et al. · 2023 · Physics Letters B · cited 8 times · Not summarized yet
Abstract
Deep learning was recently successfully used in deriving symmetry transformations that preserve important physics quantities. Being completely agnostic, these techniques postpone the identification of the discovered symmetries to a later stage. In this letter we propose methods for examining and identifying the group-theoretic structure of such machine-learned symmetries. We design loss functions which probe the subalgebra structure either during the deep learning stage of symmetry discovery or in a subsequent post-processing stage. We illustrate the new methods with examples from the U(n) Lie group family, obtaining the respective subalgebra decompositions. As an application to particle phy…
-
SymmetryLens: Unsupervised Symmetry Learning via Locality and Density PreservationOnur Efe, Arkadas Ozakin · 2024 · Symmetry · cited 1 time · Not summarized yet
Abstract
We develop a new unsupervised symmetry learning method that starts with raw data and provides the minimal generator of an underlying Lie group of symmetries, together with a symmetry-equivariant representation of the data, which turns the hidden symmetry into an explicit one. The method is able to learn the pixel translation operator from a dataset with only an approximate translation symmetry and can learn quite different types of symmetries that are not apparent to the naked eye. The method is based on the formulation of an information-theoretic loss function that measures both the degree of symmetry of a dataset under a candidate symmetry generator and a proposed notion of locality of the…
-
Symmetry meets AIG. Barenboim, J. Hirn, V. Sanz · 2021 · SciPost Physics · cited 26 times · Not summarized yet
Abstract
We explore whether Neural Networks (NNs) can discover the presence of symmetries as they learn to perform a task. For this, we train hundreds of NNs on a decoy task based on well-controlled Physics templates, where no information on symmetry is provided. We use the output from the last hidden layer of all these NNs, projected to fewer dimensions, as the input for a symmetry classification task, and show that information on symmetry had indeed been identified by the original NN without guidance. As an interdisciplinary application of this procedure, we identify the presence and level of symmetry in artistic paintings from different styles such as those of Picasso, Pollock and Van Gogh.
-
A method to challenge symmetries in data with self-supervised learningR. Tombs, C. Lester · 2021 · Journal of Instrumentation · cited 31 times · Not summarized yet
Abstract
Symmetries are key properties of physical models and of experimental designs, but any proposed symmetry may or may not be realized in nature. In this paper, we introduce a practical and general method to test such suspected symmetries in data, with minimal external input. Self-supervision, which derives learning objectives from data without external labelling, is used to train models to predict 'which is real?' between real data and symmetrically transformed alternatives. If these models make successful predictions in independent tests, then they challenge the targeted symmetries. Crucially, our method handles filtered data, which often arise from inefficiencies or deliberate selections, and…
Prior work it builds on
-
Symmetries, safety, and self-supervisionB. Dillon, G. Kasieczka, Hans Olischläger et al. · 2021 · SciPost Physics · cited 138 times · Not summarized yet
Abstract
Collider searches face the challenge of defining a representation of high-dimensional data such that physical symmetries are manifest, the discriminating features are retained, and the choice of representation is new-physics agnostic. We introduce JetCLR to solve the mapping from low-level data to optimized observables through self-supervised contrastive learning. As an example, we construct a data representation for top and QCD jets using a permutation-invariant transformer-encoder network and visualize its symmetry properties. We compare the JetCLR representation with alternative representations using linear classifier tests and find it to work quite well.
-
Meta-Learning Symmetries by ReparameterizationAllan Zhou, Tom Knowles, Chelsea Finn · 2020 · Machine Learning · cited 111 times · AI summary available
Abstract
Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only works when practitioners know a-priori symmetries of the task and can manually construct an architecture with the corresponding equivariances. Our goal is a general approach for learning equivariances from data, without needing prior knowledge of a task's symmetries or custom task-specific architectures. We present a method for learning and encoding equivariances into networks by learning corresponding parameter sharing patterns from data. Our method can p…
-
Anomaly Detection for Resonant New Physics with Machine Learning.J. Collins, K. Howe, B. Nachman · 2018 · Physical Review Letters · cited 199 times · Not summarized yet
Abstract
Despite extensive theoretical motivation for physics beyond the standard model (BSM) of particle physics, searches at the Large Hadron Collider have found no significant evidence for BSM physics. Therefore, it is essential to broaden the sensitivity of the search program to include unexpected scenarios. We present a new model-agnostic anomaly detection technique that naturally benefits from modern machine learning algorithms. The only requirement on the signal for this new procedure is that it is localized in at least one known direction in phase space. Any other directions of phase space that are uncorrelated with the localized one can be used to search for unexpected features. This new met…
-
The LHC Olympics 2020 a community challenge for anomaly detection in high energy physicsGregor Kasieczka, B. Nachman, David Shih et al. · 2021 · Reports on progress in physics. Physical Society · cited 225 times · Not summarized yet
Abstract
A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). Methods made use of modern machine learning tools and were based on unsupervised learning (autoencoders, …
-
Generative Adversarial NetworksGilad Cohen, R. Giryes · 2021 · International Conference on Computing Communication and Networking Technologies · cited 28,188 times · Not summarized yet
Abstract
Generative Adversarial Networks (GANs) are a type of deep learning techniques that have shown remarkable success in generating realistic images, videos, and other types of data. This paper provides a comprehensive guide to GANs, covering their architecture, loss functions, training methods, applications, evaluation metrics, challenges, and future directions. We begin with an introduction to GANs and their historical development, followed by a review of the background and related work. We then provide a detailed overview of the GAN architecture, including the generator and discriminator networks, and discuss the key design choices and variations. Next, we review the loss functions utilized in…
Papers that cite it
-
SymmetryLens: A new candidate paradigm for unsupervised symmetry learning via locality and equivarianceOnur Efe, Arkadas Ozakin · 2024 · arXiv.org · preprint, not peer reviewed · Not summarized yet
-
Current Symmetry Group Equivariant Convolution Frameworks for Representation LearningRamzan Basheer, Deepak Mishra · 2024 · arXiv.org · preprint, not peer reviewed · cited 5 times · Not summarized yet
Abstract
Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount in obtaining robust and compact feature representations that remain unaffected by nontrivial geometric transformations, which vanilla CNNs cannot effectively handle. Recognizing rotation, translation, permutation, or scale symmetries can lead to equivariance properties in the learned representations. This has led to notable advancements in computer vision and machine learning tasks under the framework of geometric deep learning, as compared to their invari…
-
Spectral Discovery of Continuous Symmetries via Generalized Fourier TransformsPavan Karjol, Kumar Shubham, A. Prathosh · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet
Abstract
Continuous symmetries are fundamental to many scientific and learning problems, yet they are often unknown a priori. Existing symmetry discovery approaches typically search directly in the space of transformation generators or rely on learned augmentation schemes. We propose a fundamentally different perspective based on spectral structure. We introduce a framework for discovering continuous one-parameter subgroups using the Generalized Fourier Transform (GFT). Our central observation is that invariance to a subgroup induces structured sparsity in the spectral decomposition of a function across irreducible representations. Instead of optimizing over generators, we detect symmetries by identi…
-
Oracle-Preserving Latent FlowsAlexander Roman, Roy T. Forestano, K. Matchev et al. · 2023 · Symmetry · cited 6 times · Not summarized yet
Abstract
A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with severa…
-
Adaptive Symmetry Discovery for Dynamical System IdentificationB. Tahmasebi, Melanie Weber · 2026 · arXiv.org · preprint, not peer reviewed · cited 4 times · Not summarized yet
Abstract
Dynamical systems model trajectory data generated by fixed underlying dynamics, with applications ranging from biology to physics. Especially in scientific settings, dynamical systems are not generic but often exhibit symmetries imposed by physical laws, formalized through equivariance with respect to group actions. The identification problem concerns recovering the parameters of a system from observed trajectories. In this work, we study adaptive symmetry discovery for dynamical system identification and address how a system can be identified from a single trajectory when it is equivariant with respect to an unknown symmetry group. To this end, we first show that for known symmetries, the s…
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 4 November 2026.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.