Comparison of combining methods using Extreme Learning Machines under small sample scenario

Dusan Sovilj, Kaj-Mikael Björk, Amaury Lendasse

Research output: Contribution to journalArticleScientificpeer-review

4 Citations (Scopus)

Abstract

Making accurate predictions is a difficult task that is encountered throughout many research domains. In certain cases, the number of available samples is so scarce that providing reliable estimates is a challenging problem. In this paper, we are interested in giving as accurate predictions as possible based on the Extreme Learning Machine type of a neural network in small sample data scenarios. Most of the Extreme Learning Machine literature is focused on choosing a particular model from a pool of candidates, but such approach usually ignores model selection uncertainty and has inferior performance compared to combining methods. We empirically examine several model selection criteria coupled with new model combining approaches that were recently proposed. The results obtained indicate that a careful choice among the combinations must be performed in order to have the most accurate and stable predictions.
Original languageEnglish
Peer-reviewed scientific journalNeurocomputing
Volume174, Part A
Issue numberJanuary
Pages (from-to)4-17
Number of pages14
ISSN0925-2312
DOIs
Publication statusPublished - 22.01.2016
MoE publication typeA1 Journal article - refereed

Keywords

  • 512 Business and Management
  • Extreme LearningMachine
  • Small sampledata
  • Model selection
  • Model combining
  • Mallow's Model Averaging
  • Jackknife Model Averaging

Fingerprint Dive into the research topics of 'Comparison of combining methods using Extreme Learning Machines under small sample scenario'. Together they form a unique fingerprint.

  • Cite this