Shannon Information Capacity of Discrete Synapses

Thumbnail Image

Date

Authors

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Description

There is evidence that biological synapses have only a fixed number of discrete weight states. Memory storage with such synapses behaves quite differently from synapses with unbounded, continuous weights as old memories are automatically overwritten by new memories. We calculate the storage capacity of discrete, bounded synapses in terms of Shannon information. For optimal learning rules, we investigate how information storage depends on the number of synapses, the number of synaptic states and the coding sparseness.
5 pages, 2 figures

Keywords

Neurons and Cognition

Citation

URI

http://salesiana.dossiersoluciones.com/handle/123456789/156801

Consulte el texto completo en el siguiente enlace:

https://arxiv.org/abs/0803.1923
 http://arxiv.org/abs/0803.1923

Collections

arXiv