An Information Theoretic ART for Robust Unsupervised Learning


In this paper, an information-theoretic-based adaptive resonance theory (IT-ART) neural network architecture is presented. Each IT-ART category is defined by the first and second order statistics (mean and covariance matrix) of the cluster or class it represents. This information is used to estimate probability density functions (multivariate Gaussians) and compute the activation functions. The match function of the vigilance check is based on Renyi's quadratic cross-entropy: it is the cross information potential. Experiments involving several real world and synthetic data sets were carried out to assess the performance of IT-ART, which was measured in terms of external validity indices. IT-ART expanded the range of successful vigilance parameter values in these tests.

Meeting Name

2016 International Joint Conference on Neural Networks, IJCNN 2016 (2016: Jul. 24-29, Vancouver, Canada)


Electrical and Computer Engineering

Research Center/Lab(s)

Center for High Performance Computing Research

Second Research Center/Lab

Intelligent Systems Center

Keywords and Phrases

Arts Computing; Covariance Matrix; Information Theory; Network Architecture; Activation Functions; Adaptive Resonance Theory; External Validities; Information Potential; Match Functions; Second Order Statistics; Synthetic Datasets; Vigilance Parameter; Probability Density Function

Document Type

Article - Conference proceedings

Document Version


File Type





© 2014 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

01 Jul 2016