PubMed · 7711960
Optimization dynamics for partitioned neural networks.
Abstract
Given a relaxation-based neural network and a desired partition of the neurons in the network into modules with relatively slow communication between modules, we investigate relaxation dynamics for the resulting partitioned neural network. In particular, we show how the slow inter-module communication channels can be modeled by means of certain transformations of the original objective function which introduce new state variables for the inter-module communication links. We report on a parallel implementation of the resulting relaxation dynamics, for a two-dimensional image segmentation network, using a network of workstations. Experiments demonstrate a functional and efficient parallelization of this neural network algorithm. We also discuss implications for analog hardware implementations of relaxation networks.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
D I Tsioutsias, E Mjolsness. 1994. Optimization dynamics for partitioned neural networks.. https://doi.org/10.1142/s0129065794000281
Cite the original work for its findings. Save a collection to share your selection of sources.