Timezone: »
Oral
Achieving the KS threshold in the general stochastic block model with linearized acyclic belief propagation
Emmanuel Abbe · Colin Sandon
The stochastic block model (SBM) has long been studied in machine learning and network science as a canonical model for clustering and community detection. In the recent years, new developments have demonstrated the presence of threshold phenomena for this model, which have set new challenges for algorithms. For the {\it detection} problem in symmetric SBMs, Decelle et al.\ conjectured that the so-called Kesten-Stigum (KS) threshold can be achieved efficiently. This was proved for two communities, but remained open from three communities. We prove this conjecture here, obtaining a more general result that applies to arbitrary SBMs with linear size communities. The developed algorithm is a linearized acyclic belief propagation (ABP) algorithm, which mitigates the effects of cycles while provably achieving the KS threshold in $O(n \ln n)$ time. This extends prior methods by achieving universally the KS threshold while reducing or preserving the computational complexity. ABP is also connected to a power iteration method on a generalized nonbacktracking operator, formalizing the spectral-message passing interplay described in Krzakala et al., and extending results from Bordenave et al.
Author Information
Emmanuel Abbe (Princeton University)
Colin Sandon (Princeton University)
More from the Same Authors
-
2020 Poster: On the universality of deep learning »
Emmanuel Abbe · Colin Sandon -
2018 Poster: Chaining Mutual Information and Tightening Generalization Bounds »
Amir Asadi · Emmanuel Abbe · Sergio Verdu -
2017 Poster: Nonbacktracking Bounds on the Influence in Independent Cascade Models »
Emmanuel Abbe · Sanjeev Kulkarni · Eun Jee Lee -
2016 Poster: Achieving the KS threshold in the general stochastic block model with linearized acyclic belief propagation »
Emmanuel Abbe · Colin Sandon -
2015 Poster: Recovering Communities in the General Stochastic Block Model Without Knowing the Parameters »
Emmanuel Abbe · Colin Sandon