ELMVIS+: Fast nonlinear visualization technique based on cosine distance and extreme learning machines

Anton Akusok, Stephen Baek, Yoan Miche, Kaj-Mikael Björk, Rui Nian, Paula Lauren, Amaury Lendasse

Research output: Contribution to journalArticleScientificpeer-review

8 Citations (Scopus)

Abstract

This paper presents a fast algorithm and an accelerated toolbox1 for data visualization. The visualization is stated as an assignment problem between data samples and the same number of given visualization points. The mapping function is approximated by an Extreme Learning Machine, which provides an error for a current assignment. This work presents a new mathematical formulation of the error function based on cosine similarity. It provides a closed form equation for a change of error for exchanging assignments between two random samples (called a swap), and an extreme speed-up over the original method even for a very large corpus like the MNIST Handwritten Digits dataset. The method starts from random assignment, and continues in a greedy optimization algorithm by randomly swapping pairs of samples, keeping the swaps that reduce the error. The toolbox speed reaches a million of swaps per second, and thousands of model updates per second for successful swaps in GPU implementation, even for very large dataset like MNIST Handwritten Digits.
Original languageEnglish
Peer-reviewed scientific journalNeurocomputing
Volume205
Issue numberSeptember
Pages (from-to)247-263
Number of pages17
ISSN0925-2312
DOIs
Publication statusPublished - 2016
MoE publication typeA1 Journal article - refereed

Keywords

  • 512 Business and Management
  • Visualization
  • Nonlinear Dimensionality Reduction
  • Cosine Distance
  • Extreme Learning Machines
  • Big Data
  • Projection

Fingerprint Dive into the research topics of 'ELMVIS+: Fast nonlinear visualization technique based on cosine distance and extreme learning machines'. Together they form a unique fingerprint.

  • Cite this