September 18, 2020 /

SFB 1313 Publication by Sergey Oladyshkin

Publication: "Bayesian Active Learning for the Gaussian Process Emulator Using Information Theory"
Journal: MDPI – Publisher of Open Access Journals:

New SFB 1313 (University of Stuttgart) publication, published in the scientific journal MDPI – Publisher of Open Access Journals:

"Bayesian Active Learning for the Gaussian Process Emulator Using Information Theory"

Abstract

Gaussian process emulators (GPE) are a machine learning approach that replicates computational demanding models using training runs of that model. Constructing such a surrogate is very challenging and, in the context of Bayesian inference, the training runs should be well invested. The current paper offers a fully Bayesian view on GPEs for Bayesian inference accompanied by Bayesian active learning (BAL). We introduce three BAL strategies that adaptively identify training sets for the GPE using information-theoretic arguments. The first strategy relies on Bayesian model evidence that indicates the GPE’s quality of matching the measurement data, the second strategy is based on relative entropy that indicates the relative information gain for the GPE, and the third is founded on information entropy that indicates the missing information in the GPE. We illustrate the performance of our three strategies using analytical- and carbon-dioxide benchmarks. The paper shows evidence of convergence against a reference solution and demonstrates quantification of post-calibration uncertainty by comparing the introduced three strategies. We conclude that Bayesian model evidence-based and relative entropy-based strategies outperform the entropy-based strategy because the latter can be misleading during the BAL. The relative entropy-based strategy demonstrates superior performance to the Bayesian model evidence-based strategy.

SFB 1313 Publication: "Bayesian Active Learning for the Gaussian Process Emulator Using Information Theory"

Contact

This image shows Sergey Oladyshkin
apl. Prof. Dr.-Ing.

Sergey Oladyshkin

Principal Investigator, Research Project D03

To the top of the page