Tag Archives: model selection

ISF2018 Presentation: Beyond summary performance metrics for forecast selection and combination

Nikolaos Kourentzes, Ivan Svetunkov and Stephan Kolassa, ISF2018, 20th June 2018. In doing forecast selection or combination we typically rely on some performance metric. For example, that could be Akaike Information Criterion or some cross-validated accuracy measure. From these we can either pick the top performer, or construct combination weights. There is ample empirical evidence… Read More »

OR59 Keynote: Uncertainty in predictive modelling

I recently presented at the OR59 conference my views and current work (with colleagues) on uncertainty in predictive modelling. I think this is a topic that deserves quite a bit of research attention, as it has substnatial implications for estimation, model selection and eventually decision making. The talk has three parts: Argue (as others before… Read More »

ISF2017 presentation: DIY forecasting – judgement, models & judgmental model selection

This is joint work with Fotios Petropoulos and Kostantinos Nikolopoulos and discusses the performance of experts selecting forecasting models, against automatic statistical model selection, as well as providing guidelines how to maximise the benefits. This is very exciting research, demonstrating the both some limitations of statistical model selection (and avenues for new research), as well… Read More »

Can you spot trend in time series?

Past experiments have demonstrated that humans (with or without formal training) are quite good at visually identifying the structure of time series. Trend is a key component, and arguably the most relevant to practice, as many of the forecasts that affect our lives have to do with potential increases or decreases of economic variables. Forecasters… Read More »

The difference between in-sample fit and forecast performance

One of the fundamental differences in conventional model building, for example they way textbooks introduce regression modelling, and forecasting is how the in-sample fit statistics are used. In forecasting our focus is not a good description of the past, but a (hopefully) good prediction of the yet unseen values. One does not necessarily imply the… Read More »

Talk on `Advances in promotional modelling and demand forecasting’

On 16/11/2016 I gave a talk at the Stockholm School of Economics on the topic of advances in modelling and demand forecasting. Given the diversity of the audience I avoided going into the details of the mathematical formulations, some of which can be found in the appendix of the presentation. The presentation summarises three different… Read More »

ISIR 2016 research presentations

Last August I attended the International Symposium on Inventories, organised by the International Society for Inventory Research (ISIR 2016). This is the second time I had attended this conference and it has been again a very good experience. Interesting talks on a variety of relevant topics to forecasting research. I organised a special track on… Read More »