Abstract
Architecture design is a fundamental step in the successful application of Feed forward Neural Networks. In most cases a large number of neural networks architectures suitable to solve a problem exist and the architecture design is, unfortunately, still a human expert's job. It depends heavily on the expert and on a tedious trial-and-error process. In the last years, many works have been focused on automatic resolution of the design of neural network architectures. Most of the methods are based on evolutionary computation paradigms. Some of the designed methods are based on direct representations of the parameters of the network. These representations do not allow scalability; thus, for representing large architectures very large structures are required. More interesting alternatives are represented by indirect schemes. They codify a compact representation of the neural network. In this work, an indirect constructive encoding scheme is proposed. This scheme is based on cellular automata representations and is inspired by the idea that only a few seeds for the initial configuration of a cellular automaton can produce a wide variety of feed forward neural networks architectures. The cellular approach is experimentally validated in different domains and compared with a direct codification scheme.
Keywords
- Hyper-heuristic approach for neural network architecture design
- evolutionary neural network
- indirect encoding
- cellular automata
Cite this article
@article{cai-1462,
author = {German Gutierrez and Araceli Sanchis and Pedro Isasi and José M. Molina and Inés M. Galván},
title = {Non-Direct Encoding Method Based on Cellular Automata to Design Neural Network Architectures},
journal = {Computing and Informatics},
volume = {24},
number = {3},
pages = {225--247},
year = {2005},
issn = {1335-9150},
url = {https://cai.type.sk/content/2005/3/non-direct-encoding-method-based-on-cellular-automata-to-design-neural-network-architectures/}
}
TY - JOUR AU - German Gutierrez AU - Araceli Sanchis AU - Pedro Isasi AU - José M. Molina AU - Inés M. Galván TI - Non-Direct Encoding Method Based on Cellular Automata to Design Neural Network Architectures JO - Computing and Informatics VL - 24 IS - 3 SP - 225 EP - 247 PY - 2005 SN - 1335-9150 UR - https://cai.type.sk/content/2005/3/non-direct-encoding-method-based-on-cellular-automata-to-design-neural-network-architectures/ KW - Hyper-heuristic approach for neural network architecture design KW - evolutionary neural network KW - indirect encoding KW - cellular automata ER -
Gutierrez, G., Sanchis, A., Isasi, P., Molina, J. M., & Galván, I. M. (2005). Non-Direct Encoding Method Based on Cellular Automata to Design Neural Network Architectures. Computing and Informatics, 24(3), 225–247. https://cai.type.sk/content/2005/3/non-direct-encoding-method-based-on-cellular-automata-to-design-neural-network-architectures/