English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Journal Article

Multivariate anomaly detection for earth observations: A comparison of algorithms and feature extraction techniques

MPS-Authors
/persons/resource/persons195348

Flach,  Milan
Empirical Inference of the Earth System, Dr. Miguel D. Mahecha, Department Biogeochemical Integration, Dr. M. Reichstein, Max Planck Institute for Biogeochemistry, Max Planck Society;
IMPRS International Max Planck Research School for Global Biogeochemical Cycles, Max Planck Institute for Biogeochemistry, Max Planck Society;

/persons/resource/persons62378

Gans,  Fabian
Empirical Inference of the Earth System, Dr. Miguel D. Mahecha, Department Biogeochemical Integration, Dr. M. Reichstein, Max Planck Institute for Biogeochemistry, Max Planck Society;

/persons/resource/persons197682

Bodesheim,  Paul
Empirical Inference of the Earth System, Dr. Miguel D. Mahecha, Department Biogeochemical Integration, Dr. M. Reichstein, Max Planck Institute for Biogeochemistry, Max Planck Society;

/persons/resource/persons127729

Sippel,  Sebastian
Empirical Inference of the Earth System, Dr. Miguel D. Mahecha, Department Biogeochemical Integration, Dr. M. Reichstein, Max Planck Institute for Biogeochemistry, Max Planck Society;
IMPRS International Max Planck Research School for Global Biogeochemical Cycles, Max Planck Institute for Biogeochemistry, Max Planck Society;

/persons/resource/persons62472

Mahecha,  Miguel D.
Empirical Inference of the Earth System, Dr. Miguel D. Mahecha, Department Biogeochemical Integration, Dr. M. Reichstein, Max Planck Institute for Biogeochemistry, Max Planck Society;

External Resource
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

BGC2543D.pdf
(Publisher version), 632KB

Supplementary Material (public)
There is no public supplementary material available
Citation

Flach, M., Gans, F., Brenning, A., Denzler, J., Reichstein, M., Rodner, E., et al. (2016). Multivariate anomaly detection for earth observations: A comparison of algorithms and feature extraction techniques. Earth System Dynamics Discussions. doi:10.5194/esd-2016-51.


Cite as: https://hdl.handle.net/11858/00-001M-0000-002B-B340-3
Abstract
Today, many processes at the Earth's surface are constantly monitored by multiple data streams. These observations have become central to advance our understanding of e.g. vegetation dynamics in response to climate or land use change. Another set of important applications is monitoring effects of climatic extreme events, other disturbances such as fires, or abrupt land transitions. One important methodological question is how to reliably detect anomalies in an automated and generic way within multivariate data streams, which typically vary seasonally and are interconnected across variables. Although many algorithms have been proposed for detecting anomalies in multivariate data, only few have been investigated in the context of Earth system science applications. In this study, we systematically combine and compare feature extraction and anomaly detection algorithms for detecting anomalous events. Our aim is to identify suitable workflows for automatically detecting anomalous patterns in multivariate Earth system data streams. We rely on artificial data that mimic typical properties and anomalies in multivariate spatiotemporal Earth observations. This artificial experiment is needed as there is no 'gold standard' for the identification of anomalies in real Earth observations. Our results show that a well chosen feature extraction step (e.g. subtracting seasonal cycles, or dimensionality reduction) is more important than the choice of a particular anomaly detection algorithm. Nevertheless, we identify 3 detection algorithms (k-nearest neighbours mean distance, kernel density estimation, a recurrence approach) and their combinations (ensembles) that outperform other multivariate approaches as well as univariate extreme event detection methods. Our results therefore provide an effective workflow to automatically detect anomalies in Earth system science data.