Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble Kalman filter”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Near Real-Time Sub/Seasonal Prediction of Aerosol and Air Quality at the NASA Global Modeling and Assimilation Office

Version 2 of the coupled modeling and analysis system used to produce near real time subseasonal to seasonal forecasts was released almost two years ago by the NASA/Goddard Global Modeling and Assimilation Office. The model runs at approximately 1/2 degree globally in the atmosphere and ocean, contains a realistic description of the cryosphere, and includes an interactive aerosol model. The data assimilation used to produce initial conditions is weakly coupled, in which the atmosphere-only assimilated state is coupled to an ocean data assimilation system using a Local Ensemble Transform Kalman Filter. Results of aerosol-derived air quality (Particulate Matter) from an extensive series of retrospective forecasts will be shown, with particular focus on the continental United States and eastern Asia. In addition, under some circumstances, the interactive aerosol is shown to improve seasonal time scale prediction skill. Plans for a future version of the system with predicted biomass burning from fires will also be discussed.

Molod, Andrea↗
NASA NTRS2020

Toward Coupled Data Assimilation in NASA’s GEOS: Developments in the Ocean Context

The Global Modeling & Assimilation Office (GMAO) at NASA GSFC produces analyses and predictions of the Earth system using various configurations of the Goddard Earth Observing System (GEOS) model and assimilation system. The current sub-seasonal-to-seasonal prediction system (GEOS-S2S) is based on a coupled atmosphere-ocean-land-ice configuration of GEOS which includes the Modular Ocean Model version 5 (MOM5) run at approximately 50-km resolution and a de-coupled OI-based ocean analysis that uses an initialization of MOM5 forced by the MERRA-2 reanalysis. GMAO will soon implement an updated GEOS-S2S system that will run at 25-km resolution and adopt aspects of the hybrid four-dimensional ensemble-variational (H4DEnVar) system already running in the production-version atmospheric analysis system, including a Local Ensemble Transform Kalman Filter (LETKF) to provide initial conditions for the oceanic state. This presentation will focus on developments to sustain the GMAO's systems on longer time horizons, where more radical transformations will be required to adapt to advanced computing environments, higher resolution and more diverse model components, and new observations for the Earth system. Results will describe progress toward a version of the GEOS coupled system that will be based around the Joint Effort for Data assimilation Integration (JEDI) framework being developed within Joint Center for Satellite Data Assimilation (JCSDA) and include an updated ocean model, MOM6. Discussion will focus specifically on the use of a Unified Forward Operator (UFO) for simulating observations and the Object Oriented Prediction System (OOPS) for providing the state estimate. These features are being developed as a multi-agency effort under the auspices of the JCSDA and are being adopted in the GMAO for all its applications of coupled data assimilation including S2S, numerical weather prediction, and reanalysis.

Mahajan, Rahul↗
NASA NTRSDate not supplied

Ensemble Forecasting/Assimilation/Emissions Estimation with WRF-Chem/DART: Accomplishments, Lessons Learned, and Future Plans

Over the past ten years, we have been conducting research on regional ensemble atmospheric composition forecasting/data assimilation/emissions estimation with WRF-Chem/DART. WRF- Chem/DART integrates the Weather Research and Forecasting model (WRF) with online chemistry (WRF-Chem) into the Data Assimilation Research Testbed (DART). DART is an ensemble data assimilation system based on the ensemble adjustment Kalman filter (EAKF) with adaptive inflation, localization (physical and state space), and an optional non-Gaussian formulation of the EAKF. DART includes assimilation of meteorological and limited chemical observations. WRF-Chem/DART extends DART to include assimilation of: MOPITT CO; IASI CO and O3; MODIS AOD; OMI O3, NO2, and SO2; TROPOMI CO, O3, NO2, and SO2, TES CO, CO2 (research mode), O3, NH3, and CH4 (research mode); CrIS CO, O3, NH3, CH4 (research mode), and PAN; SCIAMACHY NO2; GOME2a NO2; MLS O3 and HNO3; and proxy TEMPO O3, and NO2 satellite retrievals as raw retrievals or as ‘compact phase space retrievals’ (CPSRs) for profile retrievals. WRF-Chem/DART also assimilates in situ atmospheric composition measurements and uses the ‘state augmentation method’ for emissions estimation. In our presentation, we will provide an overview of WRF-Chem/DART: • applications and results; • lessons learned from: (i) independent versus joint assimilation; (ii) total/partial column versus profile retrieval assimilation; (iii) joint in situ and retrieval assimilation; (iv) assimilation at grid resolutions ranging from 100 km to 4 km; (v) dynamic emissions estimation; and • future work related to wildfire emissions estimation and intercomparison of CMAQ (online)/JEDI and CMAQ (online and offline)/DART.

WRF-Chem/DART↗
NASA NTRS2024

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic‐boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8‐day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. To further reduce the remaining bias in GPP after LAI bias correction, we re‐parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

land data assimilation↗
NASA NTRS1990

Time scale algorithm: Definition of ensemble time and possible uses of the Kalman filter

The comparative study of two time scale algorithms, devised to satisfy different but related requirements, is presented. They are ALGOS(BIPM), producing the international reference TAI at the Bureau International des Poids et Mesures, and AT1(NIST), generating the real-time time scale AT1 at the National Institute of Standards and Technology. In each case, the time scale is a weighted average of clock readings, but the weight determination and the frequency prediction are different because they are adapted to different purposes. The possibility of using a mathematical tool, such as the Kalman filter, together with the definition of the time scale as a weighted average, is also analyzed. Results obtained by simulation are presented.

Tavella, Patrizia↗
NASA NTRS2018

The Impact of Satellite Sea Surface Salinity for Prediction of the Coupled Indo-Pacific System

We assess the impact of satellite sea surface salinity (SSS) observations on seasonal to interannual variability of tropical Indo-Pacific Ocean dynamics as well as on dynamical ENSO forecasts. Our coupled model is composed of a primitive equation ocean model for the tropical Indo-Pacific region that is coupled with the global SPEEDY atmospheric model (Molteni, 2003). The Ensemble Reduced Order Kalman Filter is used to assimilate observations to constrain dynamics and thermodynamics for initialization of the coupled model. The baseline experiment assimilates satellite sea level, SST, and in situ subsurface temperature and salinity observations. This baseline is then compared with experiments that additionally assimilate Aquarius (version 4.0) and SMAP (version 2.0) SSS. Twelve-month forecasts are initialized for each month from Sep. 2011 to Dec. 2016. We find that including satellite SSS significantly improves NINO 3.4 sea surface temperature anomaly validation after 1 out to 12 month forecast lead times. For initialization of the coupled forecast, the positive impact of SSS assimilation is brought about by surface freshening near the eastern edge of the western Pacific warm pool and density changes that lead to shallower mixed layer between 10 degrees South latitude-5 degrees North latitude. SST differences at initialization force wide-spread downwelling favorable curl over most of the tropical Pacific. Over an average forecast, SST remains warmer with SSS assimilation at the eastern edge of the warm pool. This warm SST propagates into the eastern Pacific and drags westerly wind anomalies eastward into the NINO 3.4 region. In addition, salting near the ITCZ (Intertropical Convergence Zone) leads to a deepening of the mixed layer and thermocline near 8 degrees North latitude. These patterns together lead to a funneling effect that provides the background state to amplify equatorial Kelvin waves. We show that the downwelling Kelvin waves are amplified by assimilating satellite SSS and lead to significantly improved forecasts particularly for the 2015 El Nino.

El Nino↗
NASA NTRS2018

The Impact of Satellite Sea Surface Salinity for Prediction of the Coupled Indo-Pacific System

We assess the impact of satellite sea surface salinity (SSS) observations on seasonal to interannual variability of tropical Indo-Pacific Ocean dynamics as well as on dynamical ENSO forecasts. Our coupled model is composed of a primitive equation ocean model for the tropical Indo-Pacific region that is coupled with the global SPEEDY atmospheric model (Molteni, 2003). The Ensemble Reduced Order Kalman Filter is used to assimilate observations to constrain dynamics and thermodynamics for initialization of the coupled model. The baseline experiment assimilates satellite sea level, SST, and in situ subsurface temperature and salinity observations. This baseline is then compared with experiments that additionally assimilate Aquarius (version 4.0) and SMAP (version 2.0) SSS. Twelve-month forecasts are initialized for each month from Sep. 2011 to Dec. 2016. We find that including satellite SSS significantly improves NINO3.4 sea surface temperature anomaly validation after 1 out to 12 month forecast lead times. For initialization of the coupled forecast, the positive impact of SSS assimilation is brought about by surface freshening near the eastern edge of the western Pacific warm pool and density changes that lead to shallower mixed layer between 10S-5N. SST differences at initialization force wide-spread downwelling favorable curl over most of the tropical Pacific. Over an average forecast, SST remains warmer with SSS assimilation at the eastern edge of the warm pool. This warm SST propagates into the eastern Pacific and drags westerly wind anomalies eastward into the NINO3.4 region. In addition, salting near the ITCZ leads to a deepening of the mixed layer and thermocline near 8N. These patterns together lead to a funneling effect that provides the background state to amplify equatorial Kelvin waves. We show that the downwelling Kelvin waves are amplified by assimilating satellite SSS and lead to significantly improved forecasts particularly for the 2015 El Nino.

SST↗
NASA NTRS2003

An optimal modification of a Kalman filter for time scales

The Kalman filter in question, which was implemented in the time scale algorithm TA(NIST), produces time scales with poor short-term stability. A simple modification of the error covariance matrix allows the filter to produce time scales with good stability at all averaging times, as verified by simulations of clock ensembles.

time scale Kalman filter↗
DOE OSTI2023

Non-asymptotic analysis of ensemble Kalman updates: effective dimension and localization

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in applications where generating each particle is costly. This paper develops a non-asymptotic analysis of ensemble Kalman updates, which rigorously explains why a small ensemble size suffices if the prior covariance has moderate effective dimension due to fast spectrum decay or approximate sparsity. Here, we present our theory in a unified framework, comparing everal implementations of ensemble Kalman updates that use perturbed observations, square root filtering and localization. As part of our analysis, we develop new dimension-free covariance estimation bounds for approximately sparse matrices that may be of independent interest.

Mathematics↗
NASA NTRS2012

A Localized Ensemble Kalman Smoother

Numerous geophysical inverse problems prove difficult because the available measurements are indirectly related to the underlying unknown dynamic state and the physics governing the system may involve imperfect models or unobserved parameters. Data assimilation addresses these difficulties by combining the measurements and physical knowledge. The main challenge in such problems usually involves their high dimensionality and the standard statistical methods prove computationally intractable. This paper develops and addresses the theoretical convergence of a new high-dimensional Monte-Carlo approach called the localized ensemble Kalman smoother.

recursive estimation↗
NASA NTRS2001

Kalman plus weights: a time scale algorithm

KPW is a time scale algorithm that combines Kalman filtering with the basic time scale equation (BTSE). A single Kalman filter that estimates all clocks simultaneously is used to generate the BTSE frequency estimates, while the BTSE weights are inversely proportional to the white FM variances of the clocks. Results from simulated clock ensembles are compared to previous simulation results from other algorithms.

time time scales stability Kalman filtering↗
NASA NTRS2008

NASA Tech Briefs, October 2008

Topics covered include: Control Architecture for Robotic Agent Command and Sensing; Algorithm for Wavefront Sensing Using an Extended Scene; CO2 Sensors Based on Nanocrystalline SnO2 Doped with CuO; Improved Airborne System for Sensing Wildfires; VHF Wide-Band, Dual-Polarization Microstrip-Patch Antenna; Onboard Data Processor for Change-Detection Radar Imaging; Using LDPC Code Constraints to Aid Recovery of Symbol Timing; System for Measuring Flexing of a Large Spaceborne Structure; Integrated Formation Optical Communication and Estimation System; Making Superconducting Welds between Superconducting Wires; Method for Thermal Spraying of Coatings Using Resonant-Pulsed Combustion; Coating Reduces Ice Adhesion; Hybrid Multifoil Aerogel Thermal Insulation; SHINE Virtual Machine Model for In-flight Updates of Critical Mission Software; Mars Image Collection Mosaic Builder; Providing Internet Access to High-Resolution Mars Images; Providing Internet Access to High-Resolution Lunar Images; Expressions Module for the Satellite Orbit Analysis Program Virtual Satellite; Small-Body Extensions for the Satellite Orbit Analysis Program (SOAP); Scripting Module for the Satellite Orbit Analysis Program (SOAP); XML-Based SHINE Knowledge Base Interchange Language; Core Technical Capability Laboratory Management System; MRO SOW Daily Script; Tool for Inspecting Alignment of Twinaxial Connectors; An ATP System for Deep-Space Optical Communication; Polar Traverse Rover Instrument; Expert System Control of Plant Growth in an Enclosed Space; Detecting Phycocyanin-Pigmented Microbes in Reflected Light; DMAC and NMP as Electrolyte Additives for Li-Ion Cells; Mass Spectrometer Containing Multiple Fixed Collectors; Waveguide Harmonic Generator for the SIM; Whispering Gallery Mode Resonator with Orthogonally Reconfigurable Filter Function; Stable Calibration of Raman Lidar Water-Vapor Measurements; Bimaterial Thermal Compensators for WGM Resonators; Root Source Analysis/ValuStream[Trade Mark] - A Methodology for Identifying and Managing Risks; Ensemble: an Architecture for Mission-Operations Software; Object Recognition Using Feature-and Color-Based Methods; On-Orbit Multi-Field Wavefront Control with a Kalman Filter; and The Interplanetary Overlay Networking Protocol Accelerator.

Source record↗
NASA NTRS2020

Underlying Fundamentals of Kalman Filtering for River Network Modeling

The grand challenge of producing hydrometeorological estimates every time and everywhere has motivated the fusion of sparse observations with dense numerical models, with a particular interest on discharge in river modeling. Ensemble methods are largely preferred as they enable the estimation of error properties, but at the expense of computational load and generally with underestimations. These imperfect stochastic estimates motivate the use of correction methods, that is, error localization and inflation, although the physical justifications for their optimality are limited. The purpose of this study is to use one of the simplest forms of data assimilation when applied to river modeling and reveal the underlying mechanisms impacting its performance. Our framework based on assimilating daily averaged in situ discharge measurements to correct daily averaged runoff was tested over a 4-yr case study of two rivers in Texas. Results show that under optimal conditions of inflation and localization, discharge simulations are consistently improved such that the mean values of Nash–Sutcliffe efficiency are enhanced from211.32 to 0.55 at observed gauges and from212.24 to21.10 at validation gauges. Yet, parameters controlling the inflation and the localization have a large impact on the performance. Further investigations of these sensitivities showed that optimal inflation occurs when compensating exactly for discrepancies in the magnitude of errors while optimal localization matches the distance traveled during one assimilation window. These results may be applicable to more advanced data assimilation methods as well as for larger applications motivated by upcoming river-observing satellite missions, such as NASA’s Surface Water and Ocean Topography mission.

Streamflow↗
NASA NTRS2002

Addition of random run FM noise to the KPW time scale algorithm

The KPW (Kalman plus weights) time scale algorithm uses a Kalman filter to provide frequency and drift information to a basic time scale equation. This paper extends the algorithm to three-state clocks nd gives results for a simulated eight-clock ensemble.

time scale clock ensemble clock noise↗
NASA NTRS1999

Behavior of Filters and Smoothers for Strongly Nonlinear Dynamics

The Kalman filter is the optimal filter in the presence of known gaussian error statistics and linear dynamics. Filter extension to nonlinear dynamics is non trivial in the sense of appropriately representing high order moments of the statistics. Monte Carlo, ensemble-based, methods have been advocated as the methodology for representing high order moments without any questionable closure assumptions. Investigation along these lines has been conducted for highly idealized dynamics such as the strongly nonlinear Lorenz model as well as more realistic models of the means and atmosphere. A few relevant issues in this context are related to the necessary number of ensemble members to properly represent the error statistics and, the necessary modifications in the usual filter situations to allow for correct update of the ensemble members. The ensemble technique has also been applied to the problem of smoothing for which similar questions apply. Ensemble smoother examples, however, seem to be quite puzzling in that results state estimates are worse than for their filter analogue. In this study, we use concepts in probability theory to revisit the ensemble methodology for filtering and smoothing in data assimilation. We use the Lorenz model to test and compare the behavior of a variety of implementations of ensemble filters. We also implement ensemble smoothers that are able to perform better than their filter counterparts. A discussion of feasibility of these techniques to large data assimilation problems will be given at the time of the conference.

Zhu, Yanqui↗
NASA NTRS1999

The Behavior of Filters and Smoothers for Strongly Nonlinear Dynamics

The Kalman filter is the optimal filter in the presence of known Gaussian error statistics and linear dynamics. Filter extension to nonlinear dynamics is non trivial in the sense of appropriately representing high order moments of the statistics. Monte Carlo, ensemble-based, methods have been advocated as the methodology for representing high order moments without any questionable closure assumptions (e.g., Miller 1994). Investigation along these lines has been conducted for highly idealized dynamics such as the strongly nonlinear Lorenz (1963) model as well as more realistic models of the oceans (Evensen and van Leeuwen 1996) and atmosphere (Houtekamer and Mitchell 1998). A few relevant issues in this context are related to the necessary number of ensemble members to properly represent the error statistics and, the necessary modifications in the usual filter equations to allow for correct update of the ensemble members (Burgers 1998). The ensemble technique has also been applied to the problem of smoothing for which similar questions apply. Ensemble smoother examples, however, seem to quite puzzling in that results of state estimate are worse than for their filter analogue (Evensen 1997). In this study, we use concepts in probability theory to revisit the ensemble methodology for filtering and smoothing in data assimilation. We use Lorenz (1963) model to test and compare the behavior of a variety implementations of ensemble filters. We also implement ensemble smoothers that are able to perform better than their filter counterparts. A discussion of feasibility of these techniques to large data assimilation problems will be given at the time of the conference.

Zhu, Yanqiu↗
NASA NTRS1999

Some Continuum Aspects of Data Assimilation

A long-sought goal in data assimilation is to build more fully the time dimension into the data assimilation process. Truly four-dimensional data assimilation requires evolving second-moment information, namely the estimation error covariance, along with the state estimate itself. The continuum evolution equations for the estimation error covariance constitute a system of partial differential equations in six space dimensions, forced by a model error covariance and by the observations themselves. The high dimensionality of this system poses a difficult computational problem. Numerous methods have been proposed for approximate, discrete solution of this system of equations. Four-dimensional variational schemes solve these equations indirectly, while schemes based on Kalman filtering solve the equations more directly, usually on a small subspace of the full six-dimensional space. In both cases, most proposed solution methods are not derived from the continuum covariance evolution equations themselves. Instead, most methods simply inherit the discretization used for evolving the state estimate, either in the form of a discrete tangent linear model or, in the case of ensemble schemes, in the form of a fully nonlinear discrete model. In this lecture we show that solutions of the continuum covariance evolution equations possess simple properties that are not readily satisfied upon discretization of the equations. we give numerical examples illustrating that "inherited" discretizations sometimes fail to produce meaningfully accurate solutions. Finally, we suggest alternative discretization methods that may yield more faithful approximate solutions of the continuum problem.

Cohn, Stephen E.↗
NASA NTRS2014

Background Error Covariance Estimation Using Information from a Single Model Trajectory with Application to Ocean Data Assimilation

An attractive property of ensemble data assimilation methods is that they provide flow dependent background error covariance estimates which can be used to update fields of observed variables as well as fields of unobserved model variables. Two methods to estimate background error covariances are introduced which share the above property with ensemble data assimilation methods but do not involve the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The Space Adaptive Forecast error Estimation (SAFE) algorithm estimates error covariances from the spatial distribution of model variables within a single state vector. The Flow Adaptive error Statistics from a Time series (FAST) method constructs an ensemble sampled from a moving window along a model trajectory.SAFE and FAST are applied to the assimilation of Argo temperature profiles into version 4.1 of the Modular Ocean Model (MOM4.1) coupled to the GEOS-5 atmospheric model and to the CICE sea ice model. The results are validated against unassimilated Argo salinity data. They show that SAFE and FAST are competitive with the ensemble optimal interpolation (EnOI) used by the Global Modeling and Assimilation Office (GMAO) to produce its ocean analysis. Because of their reduced cost, SAFE and FAST hold promise for high-resolution data assimilation applications.

Error Covariance↗