PubMed Health⌕ Search

PubMed · 15036340

Bifurcating neuron: computation and learning.

Abstract

The ability of bifurcating processing units and their networks to rapidly switch between different dynamic modes has been used in recent research efforts to model new computational properties of neural systems. In this spirit, we devise a bifurcating neuron based on control of chaos collapsing to a period-3 orbit in the dynamics of a quadratic logistic map (QLM). Proposed QLM3 neuron is constructed with the third iterate of QLM and uses an external input, which governs its dynamics. The input shifts the neuron's dynamics from chaos to one of the stable fixed points. This way the inputs from certain ranges (clusters) are mapped to stable fixed points, while the rest of the inputs is mapped to chaotic or periodic output dynamics. It has been shown that QLM3 neuron is able to learn a specific mapping by adaptively adjusting its bifurcation parameter, the idea of which is based on the principles of parametric control of logistic maps [Proceedings of the International Symposium on Nonlinear Theory and its Applications (NOLTA'97), Honolulu, HI, 1997; Proceedings of SPIE, 2000]. Learning algorithm for the bifurcation parameter is proposed, which employs the error gradient descent method.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mykola Lysetskiy, Jacek M Zurada. 2004. Bifurcating neuron: computation and learning.. https://doi.org/10.1016/j.neunet.2003.09.003

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

[Working memory in basic learning processes].

INTRODUCTION AND DEVELOPMENT: Working or operative memory is considered to be a distinctive element of executive functioning. Nowadays, thanks to neuroimaging studies, it is known that the dorsolateral prefrontal cortex plays a crucial role in working memory. It has been observed that during the intervals when information is being retained, intense and persistent activity is going on in the region, as shown by the delayed response times. Working memory is fundamental for the analysis and synthesis of information, the retention of data needed to perform a particular mental process, carrying out priming (impression in memory of something that has been experienced, such as words, objects or events, for example), carrying out pre-functional tutoring activities and post-functional monitoring. CONCLUSIONS: Disorders affecting the fundamental mechanisms of working memory will give rise to a dysfunction that will exert an influence on innumerable formal academic learning processes such as difficulty in focusing attention, difficulty in inhibiting irrelevant stimuli, difficulty in recognising priority patterns, inability to recognise hierarchies and the meaning of stimuli (analysis and synthesis), problems in establishing an intention, and difficulty in recognising and selecting the goals that are best suited to solving a problem. It will also involve the impossibility to establish a plan to achieve goals, inability to analyse the activities required to accomplish an objective and difficulties in carrying out a plan, since it becomes impossible to monitor or modify the task to fit the original plans.

Learning↗

Stability criteria for unsupervised temporal association networks.

A biologically realizable, unsupervised learning rule is described for the online extraction of object features, suitable for solving a range of object recognition tasks. Alterations to the basic learning rule are proposed which allow the rule to better suit the parameters of a given input space. One negative consequence of such modifications is the potential for learning instability. The criteria for such instability are modeled using digital filtering techniques and predicted regions of stability and instability tested. The result is a family of learning rules which can be tailored to the specific environment, improving both convergence times and accuracy over the standard learning rule, while simultaneously insuring learning stability.

Learning↗

Self-organizing learning array.

A new machine learning concept--self-organizing learning array (SOLAR)--is presented. It is a sparsely connected, information theory-based learning machine, with a multilayer structure. It has reconfigurable processing units (neurons) and an evolvable system structure, which makes it an adaptive classification system for a variety of machine learning problems. Its multilayer structure can handle complex problems. Based on the entropy estimation, information theory-based learning is performed locally at each neuron. Neural parameters and connections that correspond to minimum entropy are adaptively set for each neuron. By choosing connections for each neuron, the system sets up its wiring and completes its self-organization. SOLAR classifies input data based on the weighted statistical information from all the neurons. The system classification ability has been simulated and experiments were conducted using test-bench data. Results show a very good performance compared to other classification methods. An important advantage of this structure is its scalability to a large system and ease of hardware implementation on regular arrays of cells.

Learning↗