Comparison of Combining Methods using Extreme Learning Machines under Small Sample Scenario

Abstract

Making Accurate Predictions is a Difficult Task that is Encountered throughout Many Research Domains. in Certain Cases, the Number of Available Samples is So Scarce that Providing Reliable Estimates is a Challenging Problem. in This Paper, We Are Interested in Giving as Accurate Predictions as Possible based on the Extreme Learning Machine Type of a Neural Network in Small Sample Data Scenarios. Most of the Extreme Learning Machine Literature is Focused on Choosing a Particular Model from a Pool of Candidates, But Such Approach Usually Ignores Model Selection Uncertainty and Has Inferior Performance Compared to Combining Methods. We Empirically Examine Several Model Selection Criteria Coupled with New Model Combining Approaches that Were Recently Proposed. the Results Obtained Indicate that a Careful Choice among the Combinations Must Be Performed in Order to Have the Most Accurate and Stable Predictions.

Department(s)

Engineering Management and Systems Engineering

Keywords and Phrases

Extreme learning machine; Jackknife model averaging; Mallow's model averaging; Model combining; Model selection; Small sample data

International Standard Serial Number (ISSN)

1872-8286; 0925-2312

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2024 Elsevier, All rights reserved.

Publication Date

22 Jan 2016

Link to Full Text

Share

 
COinS