A. Bellet, A. Habrard, M. Sebban, and . Learning, , 2015.

P. Bianchi and J. Jakubowicz, Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization, IEEE Trans. Autom, vol.58, issue.2, pp.391-405, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00816500

G. Biau and K. Bleakley, Statistical Inference on Graphs. Statistics & Decisions, vol.24, pp.209-232, 2006.

B. Bollobás, Modern Graph Theory, vol.184, 1998.

S. Boyd, . Ghosh, . Arpita, B. Prabhakar, and D. Shah, Randomized gossip algorithms, IEEE Trans. Inf. Theory, vol.52, issue.6, pp.2508-2530, 2006.

F. Chung, Spectral Graph Theory, Amer. Math. Soc, vol.92, 1997.

. Clémençon, . Stéphan, . Lugosi, and N. Vayatis, Ranking and Empirical Minimization of U-statistics, Ann. Stat, vol.36, issue.2, pp.844-874, 2008.

I. Colin, A. Bellet, J. Salmon, C. , and S. , Extending Gossip Algorithms to Distributed Estimation of U-Statistics, NIPS, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01214665

J. Duchi, A. Agarwal, and M. Wainwright, Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling, IEEE Trans. Autom. Control, vol.57, issue.3, pp.592-606, 2012.

F. Iutzeler, . Bianchi, . Pascal, P. Ciblat, and W. Hachem, Asynchronous Distributed Optimization using a Randomized Alternating Direction Method of Multipliers, IEEE CDC, pp.3671-3676, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00868412

R. Jin, S. Wang, and Y. Zhou, Regularized Distance Metric Learning: Theory and Algorithm, NIPS, pp.862-870, 2009.

. Johansson, . Björn, M. Rabi, and M. Johansson, A Randomized Incremental Subgradient Method for Distributed Optimization in Networked Systems, SIAM J. Optimiz, vol.20, issue.3, pp.1157-1170, 2010.

D. Kempe, A. Dobra, J. ;. Gehrke, A. Kumar, A. Niculescu-mizil et al., A Binary Classification Framework for Two-Stage Multiple Kernel Learning, FOCS, pp.482-491, 2003.

. Lee, . Soomin, A. Nedi´cnedi´c, and M. Raginsky, Decentralized online optimization with global objectives and local communication, 2015.

A. Nedi´cnedi´c and A. E. Ozdaglar, Distributed Subgradient Methods for Multi-Agent Optimization, IEEE Trans. Autom. Control, vol.54, issue.1, pp.48-61, 2009.

Y. Nesterov, Primal-dual subgradient methods for convex problems, Math. Program, vol.120, issue.1, pp.261-283, 2009.

K. Pelckmans and J. Suykens, Gossip Algorithms for Computing U-Statistics, NecSys, pp.48-53, 2009.

S. Ram, A. Nedi´cnedi´c, and V. Veeravalli, Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization, J. Optimiz. Theory. App, vol.147, issue.3, pp.516-545, 2010.

D. Shah, Gossip Algorithms. Foundations and Trends in Networking, vol.3, pp.1-125, 2009.

K. Tsianos, S. Lawlor, and M. Rabbat, Push-Sum Distributed Dual Averaging for convex optimization, IEEE CDC, 2015.

J. Tsitsiklis, Problems in decentralized decision making and computation, 1984.

D. J. Watts, . Strogatz, and H. Steven, Collective dynamics of 'small-world'networks, Nature, vol.393, issue.6684, pp.440-442, 1998.

E. Wei and A. Ozdaglar, Distributed Alternating Direction Method of Multipliers, IEEE CDC, pp.5445-5450, 2012.

E. Wei and A. Ozdaglar, On the O(1/k) Convergence of Asynchronous Distributed Alternating Direction Method of Multipliers, IEEE GlobalSIP, 2013.

L. Xiao, Dual averaging methods for regularized stochastic learning and online optimization, JMLR, vol.11, pp.2543-2596, 2010.

D. Yuan, . Xu, . Shengyuan, H. Zhao, and L. Rong, Distributed dual averaging method for multi-agent optimization with quantized communication, Systems & Control Letters, vol.61, issue.11, pp.1053-1061, 2012.

P. Zhao, . Hoi, J. Steven, R. Yang, and T. , Online AUC Maximization, ICML, 2011.