AI summary · arXiv: 2306.0145v1 · math.CA
On the Expressive Power of Neural Networks
The essentials
- The paper by Jan Holstermann focuses on the expressive power of neural networks.
- The universal approximation theorem states that wide shallow neural networks can approximate any continuous function on a compact set.
- Research has been done to determine optimal approximation rates for ReLU-networks in $L^p$-norms with $p \in [1,\infty)$ and to prove a universal approximation theorem for deep narrow ReLU-networks.
- Holstermann introduces a framework of two expressive powers to answer open questions regarding the expressive power of neural networks.
- The first expressive power counts the maximal number of linear regions of a function calculated by a ReLU-network, and Holstermann improves upon the best known bounds for this.
- The second expressive power measures how many times an input has to be transformed before it can be classified correctly by a neural network, and is entirely new.
- By improving existing bounds on expressive powers and introducing new ones, this work contributes to our understanding of how neural networks work and what they can do.
Key points written by AI: they may contain errors, check them against the paper.
Ask questions about this paper to our AI assistant
How to chat with this paper? Illustrated guide
You can also chat with multiple papers at once here.
Keep this conversation — a free account saves your questions and answers, your collections of papers and your alerts.
Create a free accountTools for this paper
Advanced tools Premium
For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium
Papers around this one
See them on a mapRanked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
On the Approximation Properties of Neural NetworksJonathan W. Siegel, Jinchao Xu · 2019 · Neural Networks (2020) · AI summary available
Abstract
We prove two new results concerning the approximation properties of neural networks. Our first result gives conditions under which the outputs of the neurons in a two layer neural network are linearly independent functions. Our second result concerns the rate of approximation of a two layer neural network as the number of neurons increases. We improve upon existing results in the literature by significantly relaxing the required assumptions on the activation function and by providing a better rate of approximation. We also provide a simplified proof that the class of functions represented by a two-layer neural network is dense in any compact set if the activation function is not a polynomial…
-
New Integral representations for the Fox-Wright functions and its applicationsKhaled Mehrez · 2017 · Classical Analysis and ODEs · AI summary available
Abstract
Our aim in this paper is to derive several new integral representations of the Fox-Wright functions. In particular, we give new Laplace and Stieltjes transform for this special functions under a special restriction on parameters. From the positivity conditions for the weight in these representations, we found sufficient conditions to be imposed on the parameters of the Fox-Wright functions that it be completely monotonic. As applications, we derive a class of function related to the Fox H-functions is positive definite and an investigation of a class of the Fox H-function is non-negative. Moreover, we extended the Luke's inequalities and we establish a new Tur\'an type inequalities for the F…
-
Identities for the Ln-transform, the L2n-transform and the P2n transform and their applicationsNese Dernek, Fatih Aylikci · 2014 · Classical Analysis and ODEs · AI summary available
Abstract
In the present paper, the authors introduce several new integral transforms including the Ln-transform, the L2n-transform and P2n-transform generalizations of the classical Laplace transform and the classical Stieltjes transform as respectively. It is shown that the second iterate of the L2n-transform is essentially the P2n-transform. Using this relationship, a few new Parseval-Goldstein type identities are obtained. The theorem and the lemmas that are proven in this article are new useful relations for evaluating infinite integrals of special functions. Some related illustrative examples are also given.
-
Perturbations of Cauchy differencesEszter Gselmann, Tomasz Małolepszy, Janusz Matkowski · 2026 · Classical Analysis and ODEs · AI summary available
Abstract
This paper investigates functional equations arising from perturbations of Cauchy differences. We study equations of the form \[ f(x+y)-f(x)-f(y)=B(x,y) \quad \text{or} \quad f(xy)-f(x)f(y) = B(x,y) \] where $B$ is a biadditive mapping, and also more general cases where the inhomogeneity depends on unknown functions \begin{align*} f(x+y)-f(x)-f(y)&= αx y \\[2.5mm] f(x+y)-f(x)-f(y)&= α(x y)\\[2.5mm] f(x+y)-f(x)-f(y)&= α(x)α(y). \end{align*} Our results extend previous work on the bilinearity of the Cauchy exponential difference by Alzer and Matkowski. We characterize solutions under various structural and regularity assumptions, including additive and exponential Cauchy differences, and show …
-
New elementary formulas for any derivative of any rational functionShahar Nevo, Irina Raichik · 2020 · Classical Analysis and ODEs · AI summary available
Abstract
In this paper we introduce elementary and completely explicit formulas for the derivative of any order of any function of the type 1/p, where p is a polynomial with known zeros.
-
Phase retrieval for solutions of the Schr{ö}dinger equationsPhilippe Jaming · 2025 · SampTA 2025, Jul 2025, Vienne, Austria · AI summary available
Abstract
In this note we present several questions about the phase retrieval problem for the Schr{\"o}dinger equation. Some partial answers are given as well as some of the heuristics behind these questions.
-
Multiple basic hypergeometric transformation formulas arising from the balanced duality transformationYasushi Kajihara · 2013 · Classical Analysis and ODEs · Not summarized yet
Abstract
Some multiple hypergeometric transformation formulas arising from the balanced du- ality transformation formula are discussed through the symmetry. Derivations of some transformation formulas with different dimensions are given by taking certain limits of the balanced duality transformation. By combining some of them, some transformation formulas for $A_n$ basic hypergeometric series is given. They include some generalizations of Watson, Sears and ${}_8 W_7$ transformations.
-
Orthogonal Fourier Analysis on DomainsMihail N. Kolountzakis · 2024 · Classical Analysis and ODEs · AI summary available
Abstract
In this paper we go over the history of the Fuglede or Spectral Set Conjecture as it has developed over the last 30 years or so. We do not aim to be exhaustive and we do not cover important areas of development such as the results on the problem in classes of finite groups or the version of the problem that focuses on spectral measures instead of sets. The selection of the material has been strongly influenced by personal taste, history and capabilities. We are trying to be more descriptive than detailed and we point out several open questions.
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.