Unsupervised Feature Learning Classification with Radial Basis Function Extreme Learning Machine using Graphic Processors
Ever-increasing size and complexity of data sets create challenges and potential tradeoffs of accuracy and speed in learning algorithms. This paper offers progress on both fronts. It presents a mechanism to train the unsupervised learning features learned from only one layer to improve performance in both speed and accuracy. The features are learned by an unsupervised feature learning (UFL) algorithm. Then, those features are trained by a fast radial basis function (RBF) extreme learning machine (ELM). By exploiting the massive parallel computing attribute of modern graphics processing unit, a customized compute unified device architecture (CUDA) kernel is developed to further speed up the computing of the RBF kernel in the ELM. Results tested on Canadian Institute for Advanced Research and Mixed National Institute of Standards and Technology data sets confirm the UFL RBF ELM achieves high accuracy, and the CUDA implementation is up to 20 times faster than CPU and the naive parallel approach.
D. Lam and D. C. Wunsch, "Unsupervised Feature Learning Classification with Radial Basis Function Extreme Learning Machine using Graphic Processors," IEEE Transactions on Cybernetics, vol. 47, no. 1, pp. 224-231, Institute of Electrical and Electronics Engineers (IEEE), Jan 2017.
The definitive version is available at http://dx.doi.org/10.1109/TCYB.2015.2511149
Electrical and Computer Engineering
Center for High Performance Computing Research
International Standard Serial Number (ISSN)
Article - Journal
© 2016 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.