PubMed Health⌕ Search

Biomedical subjects

Sanya Mitaim

Publications and source records attributed to Sanya Mitaim.

3 recordsLinked to original sources

Robust stochastic resonance for simple threshold neurons.

Simulation and theoretical results show that memoryless threshold neurons benefit from small amounts of almost all types of additive noise and so produce the stochastic-resonance or SR effect. Input-output mutual information measures the performance of such threshold systems that use subthreshold signals. The SR result holds for all possible noise probability density functions with finite variance. The only constraint is that the noise mean must fall outside a "forbidden" threshold-related interval that the user can control--a new theorem shows that this condition is also necessary. A corollary and simulations show that the SR effect occurs for right-sided beta and Weibull noise as well. These SR results further hold for the entire uncountably infinite class of alpha-stable probability density functions. Alpha-stable noise densities have infinite variance and infinite higher-order moments and often model impulsive noise environments. The stable noise densities include the special case of symmetric bell-curve densities with thick tails such as the Cauchy probability density. The SR result for alpha-stable noise densities shows that the SR effect in threshold and thresholdlike systems is robust against occasional or even frequent violent fluctuations in noise. Regression analysis reveals both an exponential relationship for the optimal noise dispersion as a function of the alpha bell-curve tail thickness and an approximate linear relationship for the SR-maximal mutual information as a function of the alpha bell-curve tail thickness.

Action Potentials↗

Adaptive stochastic resonance in noisy neurons based on mutual information.

Noise can improve how memoryless neurons process signals and maximize their throughput information. Such favorable use of noise is the so-called "stochastic resonance" or SR effect at the level of threshold neurons and continuous neurons. This paper presents theoretical and simulation evidence that 1) lone noisy threshold and continuous neurons exhibit the SR effect in terms of the mutual information between random input and output sequences, 2) a new statistically robust learning law can find this entropy-optimal noise level, and 3) the adaptive SR effect is robust against highly impulsive noise with infinite variance. Histograms estimate the relevant probability density functions at each learning iteration. A theorem shows that almost all noise probability density functions produce some SR effect in threshold neurons even if the noise is impulsive and has infinite variance. The optimal noise level in threshold neurons also behaves nonlinearly as the input signal amplitude increases. Simulations further show that the SR effect persists for several sigmoidal neurons and for Gaussian radial-basis-function neurons.

Algorithms↗

Stochastic resonance in noisy threshold neurons.

Stochastic resonance occurs when noise improves how a nonlinear system performs. This paper presents two general stochastic-resonance theorems for threshold neurons that process noisy Bernoulli input sequences. The performance measure is Shannon mutual information. The theorems show that small amounts of independent additive noise can increase the mutual information of threshold neurons if the neurons detect subthreshold signals. The first theorem shows that this stochastic-resonance effect holds for all finite-variance noise probability density functions that obey a simple mean constraint that the user can control. A corollary shows that this stochastic-resonance effect occurs for the important family of (right-sided) gamma noise. The second theorem shows that this effect holds for all infinite-variance noise types in the broad family of stable distributions. Stable bell curves can model extremely impulsive noise environments. So the second theorem shows that this stochastic-resonance effect is robust against violent fluctuations in the additive noise process.

Electricity↗