On policymakers’ loss functions and the evaluation of early warning systems

Peter Sarlin

Forskningsoutput: TidskriftsbidragArtikelVetenskapligPeer review

43 Citeringar (Scopus)

Sammanfattning

This paper introduces a new loss function and Usefulness measure for evaluating early warning systems (EWSs) that incorporate policymakers’ preferences between issuing false alarms and missing crises, and individual observations. The novelty derives from three enhancements: (i) accounting for unconditional probabilities of the classes, (ii) computing the proportion of available Usefulness that the model captures, and (iii) weighting observations by their importance for the policymaker. The proposed measures are model free such that they can be used to assess early warning signals issued by any type of EWS, and flexible for any type of crisis. Applications to two renowned EWSs, and comparisons to two common evaluation measures, illustrate the importance of an objective criterion for choosing a final specification and threshold value, and for models to be useful, the need to be more concerned about the rare class and the importance of correctly classifying observations of most relevant entities.
OriginalspråkEngelska
Referentgranskad vetenskaplig tidskriftEconomics Letters
Volym119
Utgåva1
Sidor (från-till)1-7
Antal sidor7
ISSN0165-1765
DOI
StatusPublicerad - 04.2013
MoE-publikationstypA1 Originalartikel i en vetenskaplig tidskrift

Nyckelord

  • 511 Nationalekonomi

Fingeravtryck

Fördjupa i forskningsämnen för ”On policymakers’ loss functions and the evaluation of early warning systems”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här