go-v.orgdoi

An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systems

Feng Bao, USDOE, Guannan Zhang, Guannan Zhang · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · 2023

  • DOI 10.2172/1998985
  • Publisher Office of Scientific and Technical Information
  • Type report
  • Issued 2023

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Office of Scientific and Technical Information · report · 2023

Abstract

We propose an ensemble score filter (EnSF) for solving high-dimensional nonlinear filtering problems with superior accuracy. A major drawback of existing filtering methods, e.g., particle filters or ensemble Kalman filters, is the low accuracy in handling high-dimensional and highly nonlinear problems. EnSF attacks this challenge by exploiting the score-based diffusion model, defined in a pseudo-temporal domain, to characterizing the evolution of the filtering density.

EnSF stores the information of the recursively updated filtering density function in the score function, in stead of storing the information in a set of finite Monte Carlo samples (used in particle filters and ensemble Kalman filters). Unlike existing diffusion models that train neural networks to approximate the score function, we develop a training-free score estimation that uses mini-batch-based Monte Carlo estimator to directly approximate the score function at any pseudo-spatial-temporal location, which provides sufficient accuracy in solving high-dimensional nonlinear problems as well as saves tremendous amount of time spent on training neural networks.

Another essential aspect of EnSF is its analytical update step, gradually incorporating data information into the score function, which is crucial in mitigating the degeneracy issue faced when dealing with very high-dimensional nonlinear filtering problems. High-dimensional Lorenz systems are used to demonstratemore » the performance of our method. EnSF provides surprisingly impressive performance in reliably tracking extremely high-dimensional Lorenz systems (up to 1,000,000 dimension) with highly nonlinear observation processes, which is a well-known challenging problem for existing filtering methods.« less

Open the resolved locator · 10.2172/1998985

Metadata licence: OpenAlex metadata (CC0)

Registry
OpenAlex DOI index + API
Fetched
2026-11-20 15:41 UTC
Cache state
not cached yet (bulk-index+openalex)
Locator
https://www.osti.gov/biblio/1998985
Metadata licence
OpenAlex metadata (CC0)
Scope
Metadata as returned by the resolver; abstracts are never generated here.