Forecast Evaluation

Mingmian Cheng, Norman R. Swanson, Chun Yao

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The development of new tests and methods used in the evaluation of time series forecasts and forecasting models remains as important today as it has been for the last 50 years. Paraphrasing what Sir Clive W.J. Granger (arguably the father of modern day time series forecasting) said in the 1990s at a conference in Svinkloev, Denmark, “OK, the model looks like an interesting extension, but can it forecast better than existing models?” Indeed, the forecast evaluation literature continues to expand, with interesting new tests and methods being developed at a rapid pace. In this chapter, we discuss a selected group of predictive accuracy tests and model selection methods that have been developed in recent years, and that are now widely used in the forecasting literature. We begin by reviewing several tests for comparing the relative forecast accuracy of different models, in the case of point forecasts. We then broaden the scope of our discussion by introducing density-based predictive accuracy tests. We conclude by noting that predictive accuracy is typically assessed in terms of a given loss function, such as mean squared forecast error or mean absolute forecast error. Most tests, including those discussed here, are consequently loss function dependent, and the relative forecast superiority of predictive models is therefore also dependent on specification of a loss function. In light of this fact, we conclude this chapter by discussing loss function robust predictive density accuracy tests that have recently been developed using principles of stochastic dominance.

Original languageEnglish (US)
Title of host publicationAdvanced Studies in Theoretical and Applied Econometrics
PublisherSpringer
Pages495-537
Number of pages43
DOIs
Publication statusPublished - Jan 1 2020

Publication series

NameAdvanced Studies in Theoretical and Applied Econometrics
Volume52
ISSN (Print)1570-5811
ISSN (Electronic)2214-7977

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Economics and Econometrics

Cite this

Cheng, M., Swanson, N. R., & Yao, C. (2020). Forecast Evaluation. In Advanced Studies in Theoretical and Applied Econometrics (pp. 495-537). (Advanced Studies in Theoretical and Applied Econometrics; Vol. 52). Springer. https://doi.org/10.1007/978-3-030-31150-6_16