Normalization in a cortical hypercolumn : The modulatory effects of a highly structured recurrent spiking neural network

Abstract: Normalization is important for a large range of phenomena in biological neural systems such as light adaptation in the retina, context dependent decision making and probabilistic inference. In a normalizing circuit the activity of one neuron/-group of neurons is divisively rescaled in relation to the activity of other neurons/­­groups. This creates neural responses invariant to certain stimulus dimensions and dynamically adapts the range over which a neural system can respond discriminatively on stimuli. This thesis examines whether a biologically realistic normalizing circuit can be implemented by a spiking neural network model based on the columnar structure found in cortex. This was done by constructing and evaluating a highly structured spiking neural network model, modelling layer 2/3 of a cortical hypercolumn using a group of neurons as the basic computational unit. The results show that the structure of this hypercolumn module does not per se create a normalizing network. For most model versions the modulatory effect is better described as subtractive inhibition. However three mechanisms that shift the modulatory effect towards normalization were found: An increase in membrane variance for increased modulatory inputs; variability in neuron excitability and connections; and short-term depression on the driving synapses. Moreover it is shown that by combining those mechanisms it is possible to create a spiking neural network that implements approximate normalization over at least ten times increase in input magnitude. These results point towards possible normalizing mechanisms in a cortical hypercolumn; however more studies are needed to assess whether any of those could in fact be a viable explanation for normalization in the biological nervous system.