On policymakers’ loss functions and the evaluation of early warning systems

Research output: Contribution to journalArticleScientificpeer-review

35 Citations (Scopus)

Abstract

This paper introduces a new loss function and Usefulness measure for evaluating early warning systems (EWSs) that incorporate policymakers’ preferences between issuing false alarms and missing crises, and individual observations. The novelty derives from three enhancements: (i) accounting for unconditional probabilities of the classes, (ii) computing the proportion of available Usefulness that the model captures, and (iii) weighting observations by their importance for the policymaker. The proposed measures are model free such that they can be used to assess early warning signals issued by any type of EWS, and flexible for any type of crisis. Applications to two renowned EWSs, and comparisons to two common evaluation measures, illustrate the importance of an objective criterion for choosing a final specification and threshold value, and for models to be useful, the need to be more concerned about the rare class and the importance of correctly classifying observations of most relevant entities.
Original languageEnglish
Peer-reviewed scientific journalEconomics letters
Volume119
Issue number1
Pages (from-to)1-7
Number of pages7
ISSN0165-1765
DOIs
Publication statusPublished - 04.2013
MoE publication typeA1 Journal article - refereed

Keywords

  • 511 Economics
  • Early warning systems
  • Policymakers’ loss functions
  • Policymakers’ preferences
  • Misclassification costs

Fingerprint Dive into the research topics of 'On policymakers’ loss functions and the evaluation of early warning systems'. Together they form a unique fingerprint.

  • Cite this