placeholder image

A structure optimization algorithm of neural networks for large-scale data sets

Conference Paper


Download full-text (Open Access)

Abstract


  • Over the past several decades, neural networks have evolved into powerful computation systems, which are able to learn complex nonlinear input-output relationship from data. However, the structure optimization problem of neural network is a big challenge for processing huge-volumed, diversified and uncertain data. This paper focuses on this problem and introduces a network pruning algorithm based on sparse representation, termed SRP. The proposed approach starts with a large network, then selects important hidden neurons from the original structure using a forward selection criterion that minimizes the residual output error. Furthermore, the presented algorithm has no constraints on the network type. The efficiency of the proposed approach is evaluated based on several benchmark data sets. We also evaluate the performance of the proposed algorithm on a real-world application of individual travel mode choice. The experimental results have shown that SRP performs favorably compared to alternative approaches.

Publication Date


  • 2014

Citation


  • Yang, J., Ma, J., Berryman, M. J. & Perez, P. (2014). A structure optimization algorithm of neural networks for large-scale data sets. 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) (pp. 956-961). United States: IEEE.

Scopus Eid


  • 2-s2.0-84912533215

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=5059&context=eispapers

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/4040

Has Global Citation Frequency


Start Page


  • 956

End Page


  • 961

Place Of Publication


  • United States

Abstract


  • Over the past several decades, neural networks have evolved into powerful computation systems, which are able to learn complex nonlinear input-output relationship from data. However, the structure optimization problem of neural network is a big challenge for processing huge-volumed, diversified and uncertain data. This paper focuses on this problem and introduces a network pruning algorithm based on sparse representation, termed SRP. The proposed approach starts with a large network, then selects important hidden neurons from the original structure using a forward selection criterion that minimizes the residual output error. Furthermore, the presented algorithm has no constraints on the network type. The efficiency of the proposed approach is evaluated based on several benchmark data sets. We also evaluate the performance of the proposed algorithm on a real-world application of individual travel mode choice. The experimental results have shown that SRP performs favorably compared to alternative approaches.

Publication Date


  • 2014

Citation


  • Yang, J., Ma, J., Berryman, M. J. & Perez, P. (2014). A structure optimization algorithm of neural networks for large-scale data sets. 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) (pp. 956-961). United States: IEEE.

Scopus Eid


  • 2-s2.0-84912533215

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=5059&context=eispapers

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/4040

Has Global Citation Frequency


Start Page


  • 956

End Page


  • 961

Place Of Publication


  • United States