Shannon Information Capacity of Discrete Synapses

Simple item page
dc.creatorBarrett, Adam B.
dc.creatorvan Rossum, M. C. W.
dc.date2008-03-13
dc.date.accessioned2026-07-07T09:26:35Z
dc.date.available2026-07-07T09:26:35Z
dc.descriptionThere is evidence that biological synapses have only a fixed number of discrete weight states. Memory storage with such synapses behaves quite differently from synapses with unbounded, continuous weights as old memories are automatically overwritten by new memories. We calculate the storage capacity of discrete, bounded synapses in terms of Shannon information. For optimal learning rules, we investigate how information storage depends on the number of synapses, the number of synaptic states and the coding sparseness.
dc.description5 pages, 2 figures
dc.identifierhttps://arxiv.org/abs/0803.1923
dc.identifierhttp://arxiv.org/abs/0803.1923
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/156801
dc.subjectNeurons and Cognition
dc.titleShannon Information Capacity of Discrete Synapses
dc.typetext

Files

Collections

arXiv