Timezone: »

 
Using Shannon Information to Probe the Precision of Synaptic Strengths
Mohammad Samavat · Tom Bartol · Kristen Harris · Terrence Sejnowski
Event URL: https://openreview.net/forum?id=UDIXBedvTkk »

Synapses between neurons control the the strengths of neuronal communication in neural circuits and their strengths are in turn dynamically regulated by experience. Because dendritic spine head volumes are highly correlated synaptic strength [1], anatomical reconstructions can probe the distributions of synaptic strengths. Synapses from the same axon onto the same dendrite (SDSA pairs) have a common history of coactivation and have nearly the same spine head volumes, suggesting that synapse function precisely modulates structure. We have applied Shannon information theory to obtain a new analysis of synaptic information storage capacity (SISC) using non-overlapping clusters of dendritic spine head volumes as a measure of synaptic strengths with distinct states based on the synaptic precision level calculated from 10 SDSA pairs. SISC analysis revealed spine head volumes in the stratum radiatum of hippocampal area CA1 occupied 24 distinct states (4.1 bits). This finding indicates an unexpected degree of precision that has implications for learning algorithms in artificial neural network models.

Author Information

Mohammad Samavat (UCSD, The Salk Institute)
Tom Bartol (Salk Institute)
Kristen Harris (University of Texas at Austin)
Terrence Sejnowski (Salk Institute)

More from the Same Authors

  • 2022 : Exploring The Precision of Real Intelligence Systems at Synapse Resolution »
    Mohammad Samavat · Tom Bartol · Kristen Harris · Terrence Sejnowski
  • 2022 : Shannon Information of Synaptic Weights Post Induction of Long-Term Potentiation (Learning) is Nearly Maximized »
    Mohammad Samavat · Tom Bartol · Cailey Bromer · Jared Bowden · Dusten Hubbard · Dakota Hanka · Masaaki Kuwajima · John Mendenhall · Patrick Parker · Wickliffe Abraham · Kristen Harris · Terrence Sejnowski
  • 2021 Workshop: Causal Inference & Machine Learning: Why now? »
    Elias Bareinboim · Bernhard Schölkopf · Terrence Sejnowski · Yoshua Bengio · Judea Pearl
  • 2019 : Poster Session »
    Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar
  • 2018 Poster: Gradient Descent for Spiking Neural Networks »
    Dongsung Huh · Terrence Sejnowski
  • 2016 : From Brains to Bits and Back Again »
    Yoshua Bengio · Terrence Sejnowski · Christos H Papadimitriou · Jakob H Macke · Demis Hassabis · Alyson Fletcher · Andreas Tolias · Jascha Sohl-Dickstein · Konrad P Koerding
  • 2013 Session: Oral Session 3 »
    Terrence Sejnowski
  • 2012 Invited Talk: Suspicious Coincidences in the Brain »
    Terrence Sejnowski
  • 2011 Session: Opening Remarks and Awards »
    Terrence Sejnowski · Peter Bartlett · Fernando Pereira
  • 2010 Placeholder: Opening Remarks »
    Terrence Sejnowski · Neil D Lawrence
  • 2010 Talk: Opening Remarks and Awards »
    Richard Zemel · Terrence Sejnowski · John Shawe-Taylor
  • 2009 Workshop: The Curse of Dimensionality Problem: How Can the Brain Solve It? »
    Simon Haykin · Terrence Sejnowski · Steven W Zucker
  • 2008 Workshop: Cortical Microcircuits and their Computational Functions »
    Tomaso Poggio · Terrence Sejnowski
  • 2006 Workshop: Decoding the neural code »
    Eric Thomson · Bill Kristan · Terrence Sejnowski