M. Anthony and P. Bartlett, Neural Network Learning: Theoretical Foundations, 2009.

R. Arora, A. Basu, P. Mianjy, and A. Mukherjee, Understanding deep neural networks with rectified linear units, International Conference on Learning Representations, 2018.

P. Bartlett, N. Harvey, C. Liaw, and A. Mehrabian, Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks, 2017.

J. Conway and N. Sloane, Sphere packings, lattices and groups, 1999.

V. Corlay, J. J. Boutros, P. Ciblat, and L. Brunel, Neural Lattice Decoders, 2018.

H. Coxeter, Regular Polytopes, 1973.

R. Eldan and O. Shamir, The power of depth for feedforward neural networks, 29th Annual Conference on Learning Theory, pp.907-940, 2016.

J. , Almost optimal lower bounds for small depth circuits, Proc. 18th ACM symposium on Theory of computing, pp.6-20, 1986.

G. Montùfar, R. Pascanu, K. Cho, and Y. Bengio, On the Number of Linear Regions of Deep Neural Networks, Advances in neural information processing systems, pp.2924-2932, 2014.

R. Pascanu, G. Montufar, and Y. Bengio, On the number of inference regions of deep feed forward with piece-wise linear activations, 2013.

M. Raghu, B. Poole, J. Kleinberg, S. Ganguli, and J. Sohl-dickstein, On the expressive power of deep neural networks, 2016.

I. Safran and O. Shamir, Depth-width tradeoffs in approximating natural functions with neural networks, International Conference on Machine Learning, pp.2979-2987, 2017.

O. Shamir, S. Sabato, and N. Tishby, Learning and generalization with the information bottleneck, Theor. Comput. Sci, vol.411, issue.29-30, pp.2696-2711, 2010.

M. Telgarsky, Benefits of depth in neural networks, 29th Annual Conference on Learning Theory, pp.1517-1539, 2016.

, The long version of this paper including an appendix is available at: www.josephboutros.org/isit2019lattices.pdf