Visualizing Dependencies of Spectral Features using Mutual Information
Abstract
The Curse of Dimensionality Leads to Problems in Machine Learning When Dealing with High Dimensionality. This Aspect is Particularly Pronounced If Intrinsically Infinite Dimensionality is Faced Such as Present for Spectral or Functional Data. Feature Selection Constitutes One Possibility to Deal with This Problem. Often, It Relies on Mutual Information as an Evaluation Tool for the Feature Importance, However, It Might Be overlaid by Intrinsic Biases Such as a High Correlation of Neighbored Function Values for Functional Data. in This Paper We Propose to Assess Feature Correlations of Spectral Data by an overlay of Prior Dependencies Due to the Functional Nature and its Similarity as Measured by Mutual Information, Enabling a Quick overall Assessment of the Relationships between Features. by Integrating the Nyström Approximation Technique, the Usually Time Consuming Step to Compute All Pairwise Mutual Informations Can Be Reduced to Only Linear Complexity in the Number of Features.
Recommended Citation
A. Gisbrecht et al., "Visualizing Dependencies of Spectral Features using Mutual Information," ESANN 2013 proceedings, 21st European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pp. 573 - 578, European Symposium on Artificial Neural Networks, Nov 2013.
Department(s)
Engineering Management and Systems Engineering
International Standard Book Number (ISBN)
978-287419081-0
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2024 European Symposium on Artificial Neural Networks, All rights reserved.
Publication Date
11 Nov 2013