Skip to content
Stories

News-Based Early Warning System

A visualization of the News-Based Early Warning System project's sentiment index.
A visualization of the News-Based Early Warning System.

Partially supported by a NULab Seedling Grant.

This project explores whether a real-time sentiment index, constructed using the universe of Reuters news, can help in forecasting GDP and predicting extreme events, such as large reversal in capital flows, in emerging markets.

Compared to traditional Early Warning Systems (EWS), a key advantage of a news based sentiment index is its availability in real-time at a daily frequency. This is especially relevant for emerging market countries in which macroeconomic data are available with more considerable lags and often subject to larger revisions than in advanced economies.

Our news sentiment index is built using “bag-of-words” text analysis techniques, which allow us to extract a summary measure of the intensity of positive or negative tonality in any written piece of news. In this approach, texts are split into words (or groups of words) disregarding sentence structures, and the positivity (negativity) of each (group of) words is assessed using dictionaries. The advantage of such an approach, over-optimizing machine learning techniques, is to make the classification transparent, easily replicable, and independent of the corpus of texts used. Our sentiment index is based on an exhaustive panel of about 2 million news articles from Reuters covering 12 emerging market countries over the period 1991—2015.

Assessing its predictive ability, we find that the news sentiment index systemically improves GDP forecast over that of Consensus forecasts, both in panel and country-by-country regression framework. The reduction in Root Mean Square Error (RMSE) over our benchmark, is, on average, 12% but can be considerably more for some countries. The news sentiment index also improves the forecasting ability of the traditional EWS model, both in fixed effect panel regressions and in country-by-country regressions. In particular, using the sentiment index, one could predict more accurately the sudden stops associated with the East Asian Crises of the late 1990s.

In addition to contributing to a recent and fast-growing literature which relates information extracted from text to economic and financial variables, this project contributes to the early warning signal literature and shows that exploiting information in big data—in particular in the mass of news and articles—can help institutions anticipate extreme events.

An interactive visualization is available here.

Principal Investigator
Samuel Fraiberger, Postdoctoral Research Associate, Network Science

Publications and Presentations

Research from this project has been presented at events such as the IMF Big Data and Analytics symposium and the NLP+CSS workshop at EMNLP 2016 (proceedings here).

More Stories

Renewable Messaging of Fossil Fuel Companies: Corporate Communication Strategies in Authoritarian Regimes

01.11.2024
A cover of the July 1922 issue of the Brownies’ Book, the first magazine for African-American children in the US. The cover shows the Bunker Hill Monument in the background, with a banner and flowers showing the spot where Crispus Attucks was killed on State Street in Boston. An African-American child stands guard to the left of the flowers and two African-American soldiers, one older man with a white beard and the other, younger and taller man, salute Crispus Attucks’ memorial.

THE BROWNIES’ BOOK: Mapping Black Boston Education Histories

09.29.2023

Encoding A Narrative of the Life of Mrs. Mary Jemison for the Women Writers Project: NULab + DITI Research Project

04.11.24
Alumni and Completed Research Projects