Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble data assimilation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Synthesis of Ocean Observations Using Data Assimilation for Operational, Real-Time and Reanalysis Systems: A More Complete Picture of the State of the Ocean

Ocean data assimilation is increasingly recognized as crucial for the accuracy of realtime ocean prediction systems and historical re-analyses. The current status of ocean data assimilation in support of the operational demands of analysis, forecasting and reanalysis is reviewed, focusing on methods currently adopted in operational and realtime prediction systems. Significant challenges associated with the most commonly employed approaches are identified and discussed. Overarching issues faced by ocean data assimilation are also addressed, and important future directions in response to scientific advances, evolving and forthcoming ocean observing systems and the needs of stakeholders and downstream applications are discussed.

modeling↗
NASA NTRS2013

An Ensemble Recentering Kalman Filter with an Application to Argo Temperature Data Assimilation into the NASA GEOS-5 Coupled Model

A two-step ensemble recentering Kalman filter (ERKF) analysis scheme is introduced. The algorithm consists of a recentering step followed by an ensemble Kalman filter (EnKF) analysis step. The recentering step is formulated such as to adjust the prior distribution of an ensemble of model states so that the deviations of individual samples from the sample mean are unchanged but the original sample mean is shifted to the prior position of the most likely particle, where the likelihood of each particle is measured in terms of closeness to a chosen subset of the observations. The computational cost of the ERKF is essentially the same as that of a same size EnKF. The ERKF is applied to the assimilation of Argo temperature profiles into the OGCM component of an ensemble of NASA GEOS-5 coupled models. Unassimilated Argo salt data are used for validation. A surprisingly small number (16) of model trajectories is sufficient to significantly improve model estimates of salinity over estimates from an ensemble run without assimilation. The two-step algorithm also performs better than the EnKF although its performance is degraded in poorly observed regions.

Particle Filter↗
DOE OSTI2021

Predicting Thermal Performance of an Enhanced Geothermal System From Tracer Tests in a Data Assimilation Framework

Abstract Predicting the thermal performance of an enhanced geothermal system (EGS) requires a comprehensive characterization of the underlying fracture flow patterns from practically available data such as tracer data. However, due to the inherent complexities of subsurface fractures and the generally insufficient geological/geophysical data, interpreting tracer data for fracture flow characterization and thermal prediction remains a challenging task. The present study aims to tackle the challenge by leveraging a data assimilation method to maximize the utilization of information inherently contained in tracer data, and meanwhile maintain the flexibility to handle various uncertainties. A tracer data interpretation framework was proposed with the following three components integrated: (a) We use principal component analysis (PCA) to reduce the dimensionality of model parameter space. (b) We use ES‐MDA (ensemble smoother with multiple data assimilation) to invert for fracture aperture/flow fields and obtain posterior model ensembles for uncertainty quantification. Various data types are assimilated jointly to improve the predictive ability of the posterior ensemble. (c) The inverted fracture aperture fields are then incorporated into reservoir models to predict thermal performance. We developed a field‐scale EGS model to verify the ability of the framework to characterize highly heterogeneous fracture aperture/flow fields and predicting thermal performance. We also applied the framework to a mesoscale field experiment to demonstrate its potential application in real‐world geothermal reservoirs. The results indicate that the proposed framework can effectively retrieve fracture flow information from tracer data for thermal prediction and uncertainty quantification, and thus provide informative guidance for EGS optimization and risk management.

15 GEOTHERMAL ENERGY↗
NASA NTRS2015

Simultaneous Radar and Satellite Data Storm-Scale Assimilation Using an Ensemble Kalman Filter Approach for 24 May 2011

Assimilating high-resolution radar reflectivity and radial velocity into convection-permitting numerical weather prediction models has proven to be an important tool for improving forecast skill of convection. The use of satellite data for the application is much less well understood, only recently receiving significant attention. Since both radar and satellite data provide independent information, combing these two sources of data in a robust manner potentially represents the future of high-resolution data assimilation. This research combines Geostationary Operational Environmental Satellite 13 (GOES-13) cloud water path (CWP) retrievals with Weather Surveillance Radar-1988 Doppler (WSR-88D) reflectivity and radial velocity to examine the impacts of assimilating each for a severe weather event occurring in Oklahoma on 24 May 2011. Data are assimilated into a 3-km model using an ensemble adjustment Kalman filter approach with 36 members over a 2-h assimilation window between 1800 and 2000 UTC. Forecasts are then generated for 90 min at 5-min intervals starting at 1930 and 2000 UTC. Results show that both satellite and radar data are able to initiate convection, but that assimilating both spins up a storm much faster. Assimilating CWP also performs well at suppressing spurious precipitation and cloud cover in the model as well as capturing the anvil characteristics of developed storms. Radar data are most effective at resolving the 3D characteristics of the core convection. Assimilating both satellite and radar data generally resulted in the best model analysis and most skillful forecast for this event.

Jones, Thomas A.↗
DOE OSTI2021

Penalized ensemble Kalman filters for high dimensional non-linear systems

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the well-known Kalman filter. However, its performance can suffer when the ensemble size is smaller than the state space, as is often necessary for computationally burdensome models. This scenario means that the empirical estimate of the state covariance is not full rank and possibly quite noisy. To solve this problem in this high dimensional regime, we propose a computationally fast and easy to implement algorithm called the penalized ensemble Kalman filter (PEnKF). Under certain conditions, it can be theoretically proven that the PEnKF will be accurate (the estimation error will converge to zero) despite having fewer ensemble members than state dimensions. Further, as contrasted to localization methods, the proposed approach learns the covariance structure associated with the dynamical system. These theoretical results are supported with simulations of several non-linear and high dimensional systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Development of an open-source regional data assimilation system in PEcAn v. 1.7.2: application to carbon cycle reanalysis across the contiguous US using SIPNET

Abstract. The ability to monitor, understand, and predict the dynamics of the terrestrial carbon cycle requires the capacity to robustly and coherently synthesize multiple streams of information that each provide partial information about different pools and fluxes. In this study, we introduce a new terrestrial carbon cycle data assimilation system, built on the PEcAn model–data eco-informatics system, and its application for the development of a proof-of-concept carbon “reanalysis” product that harmonizes carbon pools (leaf, wood, soil) and fluxes (GPP, Ra, Rh, NEE) across the contiguous United States from 1986–2019. We first calibrated this system against plant trait and flux tower net ecosystem exchange (NEE) using a novel emulated hierarchical Bayesian approach. Next, we extended the Tobit–Wishart ensemble filter (TWEnF) state data assimilation (SDA) framework, a generalization of the common ensemble Kalman filter which accounts for censored data and provides a fully Bayesian estimate of model process error, to a regional-scale system with a calibrated localization. Combined with additional workflows for propagating parameter, initial condition, and driver uncertainty, this represents the most complete and robust uncertainty accounting available for terrestrial carbon models. Our initial reanalysis was run on an irregular grid of ∼ 500 points selected using a stratified sampling method to efficiently capture environmental heterogeneity. Remotely sensed observations of aboveground biomass (Landsat LandTrendr) and leaf area index (LAI) (MODIS MOD15) were sequentially assimilated into the SIPNET model. Reanalysis soil carbon, which was indirectly constrained based on modeled covariances, showed general agreement with SoilGrids, an independent soil carbon data product. Reanalysis NEE, which was constrained based on posterior ensemble weights, also showed good agreement with eddy flux tower NEE and reduced root mean square error (RMSE) compared to the calibrated forecast. Ultimately, PEcAn's new open-source regional data assimilation framework provides a scalable workflow for harmonizing multiple data constraints and providing a uniform synthetic platform for carbon monitoring, reporting, and verification (MRV) as well as accelerating terrestrial carbon cycle research.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2002

Regional Data Assimilation Using a Stretched-Grid Approach and Ensemble Calculations

The global variable resolution stretched grid (SG) version of the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS) incorporating the GEOS SG-GCM (Fox-Rabinovitz 2000, Fox-Rabinovitz et al. 2001a,b), has been developed and tested as an efficient tool for producing regional analyses and diagnostics with enhanced mesoscale resolution. The major area of interest with enhanced regional resolution used in different SG-DAS experiments includes a rectangle over the U.S. with 50 or 60 km horizontal resolution. The analyses and diagnostics are produced for all mandatory levels from the surface to 0.2 hPa. The assimilated regional mesoscale products are consistent with global scale circulation characteristics due to using the SG-approach. Both the stretched grid and basic uniform grid DASs use the same amount of global grid-points and are compared in terms of regional product quality.

Fox-Rabinovitz, M. S.↗
NASA NTRS2008

Assimilation of GRACE Terrestrial Water Storage Data into a Land Surface Model

The NASA Gravity Recovery and Climate Experiment (GRACE) system of satellites provides observations of large-scale, monthly terrestrial water storage (TWS) changes. In. this presentation we describe a land data assimilation system that ingests GRACE observations and show that the assimilation improves estimates of water storage and fluxes, as evaluated against independent measurements. The ensemble-based land data assimilation system uses a Kalman smoother approach along with the NASA Catchment Land Surface Model (CLSM). We assimilated GRACE-derived TWS anomalies for each of the four major sub-basins of the Mississippi into the Catchment Land Surface Model (CLSM). Compared with the open-loop (no assimilation) CLSM simulation, assimilation estimates of groundwater variability exhibited enhanced skill with respect to measured groundwater. Assimilation also significantly increased the correlation between simulated TWS and gauged river flow for all four sub-basins and for the Mississippi River basin itself. In addition, model performance was evaluated for watersheds smaller than the scale of GRACE observations, in the majority of cases, GRACE assimilation led to increased correlation between TWS estimates and gauged river flow, indicating that data assimilation has considerable potential to downscale GRACE data for hydrological applications. We will also describe how the output from the GRACE land data assimilation system is now being prepared for use in the North American Drought Monitor.

Reichle, Rolf H.↗
DOE OSTI2022

Deep learning-accelerated 3D carbon storage reservoir pressure forecasting based on data assimilation using surface displacement from InSAR

Fast forecasting of the reservoir pressure distribution during geologic carbon storage (GCS) by assimilating monitoring data is a challenging problem. Due to high drilling cost, GCS projects usually have spatially sparse measurements from few wells, leading to high uncertainties in reservoir pressure prediction. To address this challenge, we use low-cost Interferometric Synthetic-Aperture Radar (InSAR) data as monitoring data to infer reservoir pressure build up. We develop a deep learning-accelerated workflow to assimilate surface displacement maps interpreted from InSAR and to forecast dynamic reservoir pressure. Employing an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates three-dimensional (3D) geologic properties and predicts reservoir pressure with quantified uncertainties. We use a synthetic commercial-scale GCS model with bimodally distributed permeability and porosity to demonstrate the efficacy of the workflow. A two-step CNN-PCA approach is employed to parameterize the bimodal fields. The computational efficiency of the workflow is boosted by two residual U-Net based surrogate models for surface displacement and reservoir pressure predictions, respectively. The workflow can complete data assimilation and reservoir pressure forecasting in half an hour on a personal computer.

25 ENERGY STORAGE↗
NASA NTRSDate not supplied

Impact of GPM-retrieved surface meteorology condition on simulations of two winter storms during ICE-POP 2018

Led by the KMA as a component of the WMO's World Weather Research Program (WWRP) Research and Development and Forecast Demonstration Projects (RDP/FDP). Taken place during the Winter Olympics (February-March) of 2018. Goals of ICE-POP: To improve understanding on severe weathers (snowfalls, visibility, rapid wind changes and gusts,) over complex terrain; To improve the predictability of nowcasting and very-short range forecasting with a few kilometer horizontal resolution - Development of NWP-based nowcasting, multi-scale data assimilation and time-lagged ensemble for VSRF, and radar reflectivity and visibility data assimilation; To improve verification for high resolution model considering complex terrain.

Xuanli Li↗
NASA NTRS2008

Radiance Assimilation Shows Promise for Snowpack Characterization: A 1-D Case Study

We demonstrate an ensemble-based radiometric data assimilation (DA) methodology for estimating snow depth and snow grain size using ground-based passive microwave (PM) observations at 18.7 and 36.5 GHz collected during the NASA CLPX-1, March 2003, Colorado, USA. A land surface model was used to develop a prior estimate of the snowpack states, and a radiative transfer model was used to relate the modeled states to the observations. Snow depth bias was -53.3 cm prior to the assimilation, and -7.3 cm after the assimilation. Snow depth estimated by a non-DA-based retrieval algorithm using the same PM data had a bias of -18.3 cm. The sensitivity of the assimilation scheme to the grain size uncertainty was evaluated; over the range of grain size uncertainty tested, the posterior snow depth estimate bias ranges from -2.99 cm to -9.85 cm, which is uniformly better than both the prior and retrieval estimates. This study demonstrates the potential applicability of radiometric DA at larger scales.

Durand, Michael↗
NASA NTRS2020

SWOT Applications in Alaska

Use of SWOT for model calibration and assimilation are encouraging, but further work is needed: account for uncertainty in meteorological forcing (calibration) and apply ensemble Kalman Smoother (data assimilation). Lessons learned can inform development of operational NOAA National Water Model Alaskan domain and other SWOT applications.

SWOT↗
NASA NTRSDate not supplied

On the Prediction of Surface Melt Over the Greenland Ice Sheet at NWP and S2S Timescales

Greenland surface melt “events” – encompassing large swaths of the ice sheet over approximately 4-10 day periods – have occurred with increasing frequency in the 21st Century. Surface processes are significant to the ice sheet’s overall contribution to sea level. In addition, the sudden onset of widespread surface melt produces hazardous conditions for researchers and for communities adjacent to the ice sheet. The mechanisms producing melt events, their associated large-scale forcing, and timescales of interest are highly variable and poorly understood. Here we examine the predictability of melt events in a numerical weather prediction system (NWP) and a subseasonal-to-seasonal system (S2S). The NASA Global Modeling and Assimilation Office forward processing (GMAO-FP) is an NWP system that incorporates an evolving, global hybrid 4D ensemble–variational (4DEnVar) data assimilation system and a state-of-the-art model that is run twice-daily with forecasts out to five and ten days. The GMAO S2S system is a hindcast-anomaly, coupled-model prediction system initialized with an atmospheric analysis, and in situ and satellite ocean data assimilation. Both systems represent ice sheet surface hydrology and snowpack processes. We examine the performance of the systems over the period 2018-2023, a span that includes approximately nine significant events, against analyses and satellite-derived melt extent. In addition to extent, we examine related conditions and their role in the melt forecast, including the onset of both omega and Rex atmospheric blocking patterns, sea surface temperatures, sea ice extent, water vapor transport, precipitation, and surface preconditioning. We further examine the tendency for false-alarm events in each system and assess reasons for the forecast performance. North Atlantic atmospheric blocking patterns leading to surface melt are well forecast by the NWP system out to around eight days, while the S2S system generally underestimates the magnitude of such events at monthly lead times. These systems suggest that while short term forecasts of ice sheet melt and melt events are relatively robust, S2S predictions of surface conditions are highly dependent on the ability of a coupled system to generate the short-term atmospheric conditions associated with surface melt events.

Richard Cullather↗
DOE OSTI2024

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2012

Experimenting with the GMAO 4D Data Assimilation

The Global Modeling and Assimilation Office (GMAO) has been working to promote its prototype four-dimensional variational (4DVAR) system to a version that can be exercised at operationally desirable configurations. Beyond a general circulation model (GeM) and an analysis system, traditional 4DV AR requires availability of tangent linear (TL) and adjoint (AD) models of the corresponding GeM. The GMAO prototype 4DVAR uses the finite-volume-based GEOS GeM and the Grid-point Statistical Interpolation (GSI) system for the first two, and TL and AD models derived ITom an early version of the finite-volume hydrodynamics that is scientifically equivalent to the present GEOS nonlinear GeM but computationally rather outdated. Specifically, the TL and AD models hydrodynamics uses a simple (I-dimensional) latitudinal MPI domain decomposition, which has consequent low scalability and prevents the prototype 4DV AR ITom being used in realistic applications. In the near future, GMAO will be upgrading its operational GEOS GCM (and assimilation system) to use a cubed-sphere-based hydrodynamics. This versions of the dynamics scales to thousands of processes and has led to a decision to re-derive the TL and AD models for this more modern dynamics, thus taking advantage of a two-dimensional MPI decomposition and improved scalability properties. With the aid of the Transformation of Algorithms in FORTRAN (l'AF) automatic adjoint generation tool and some hand-coding, a version of the cubed-sphere-based TL and AD models, with a simplified vertical diffusion scheme, is now available, enabling multiple configurations of standard implementations of 4DV AR in GEOS. Concurrent to this development, collaboration with the National Centers for Environmental Prediction (NCEP) and the Earth System Research Laboratory (ESRL) has allowed GMAO to implement a hybrid-ensemble capability within the GEOS data assimilation system. Both 3Dand 4D-ensemble capabilities are presently available thus allowing GMAO to now evaluate the performance and benefit of various ensemble and variational assimilation strategies. This presentation will cover the most recent developments taking place at GMAO and show results from various comparisons from traditional techniques to more recent ensemble-based ones.

Todling, R.↗
NASA NTRS2012

An OSSE on Mesoscale Model Assimilation of Simulated HIRAD-Observed Hurricane Surface Winds

The hazards of landfalling hurricanes are well known, but progress on improving the intensity forecasts of these deadly storms at landfall has been slow. Many cite a lack of high-resolution data sets taken inside the core of a hurricane, and the lack of reliable measurements in extreme conditions near the surface of hurricanes, as possible reasons why even the most state-of-the-art forecasting models cannot seem to forecast intensity changes better. The Hurricane Imaging Radiometer (HIRAD) is a new airborne microwave remote sensor for observing hurricanes, and is operated and researched by NASA Marshall Space Flight Center in partnership with the NOAA Atlantic Oceanographic and Meteorological Laboratory/Hurricane Research Division, the University of Central Florida, the University of Michigan, and the University of Alabama in Huntsville. This instrument?s purpose is to study the wind field of a hurricane, specifically observing surface wind speeds and rain rates, in what has traditionally been the most difficult areas for other instruments to study; the high wind and heavy rain regions. Dr. T. N. Krishnamurti has studied various data assimilation techniques for hurricane and monsoon rain rates, and this study builds off of results obtained from utilizing his style of physical initializations of rainfall observations, but obtaining reliable observations in heavy rain regions has always presented trouble to our research of high-resolution rainfall forecasting. Reliable data from these regions at such a high resolution and wide swath as HIRAD provides is potentially very valuable to mesoscale forecasting of hurricane intensity. This study shows how the data assimilation technique of Ensemble Kalman Filtering (EnKF) in the Weather Research and Forecasting (WRF) model can be used to incorporate wind, and later rain rate, data into a mesoscale model forecast of hurricane intensity. The study makes use of an Observing System Simulation Experiment (OSSE) with a simulated HIRAD dataset sampled during a hurricane and uses EnKF to forecast the track and intensity prediction of the hurricane. Comparisons to truth and error metrics are used to assess the model?s forecast performance.

Albers, Cerese↗
NASA NTRSDate not supplied

Evaluating the Global Water and Energy Cycles in Reanalyses Using Ensemble Spread

Reanalyses provide continuous observation based global data over weather and climate time scales through observational assimilation. Ensemble forecasts are a component of modern data assimilation systems, providing information to the analysis process. Storing this spread over the duration of a climate reanalysis will provide insight to the variations of the model that underlies the reanalysis data. Global water and energy cycles (WECs) are a critical aspect of both weather and climate, yet there are some large gaps in the observation of key components as well as their representation in models and reanalyses. NASA’s Water and Energy cycle Studies (NEWS) program is developing a corrected and balanced budget data set that is closed at monthly and regional scales during the 21st century, so far. In this paper, we will evaluate reanalysis WEC components against the initial NEWS collection of observation, but integrate the analysis spread from the reanalysis data assimilation as a new perspective on the evaluation. The initial evaluation will cover a few more recent years using ERA5 10 member spread. As the GMAO’s production of the Modern-Era Retrospective analysis for Research and Applications 21st Century (MERRA-21C) progresses, the effort will include the MERRA-21C 32 member spread. Ultimately, we will explore the potential of the ensemble spread as a measure of uncertainty in the reanalysis.

Michael Bosilovich↗
NASA NTRS2004

ENSO Bred Vectors in Coupled Ocean-Atmosphere General Circulation Models

The breeding method has been implemented in the NASA Seasonal-to-Interannual Prediction Project (NSIPP) Coupled General Circulation Model (CGCM) with the goal of improving operational seasonal to interannual climate predictions through ensemble forecasting and data assimilation. The coupled instability as cap'tured by the breeding method is the first attempt to isolate the evolving ENSO instability and its corresponding global atmospheric response in a fully coupled ocean-atmosphere GCM. Our results show that the growth rate of the coupled bred vectors (BV) peaks at about 3 months before a background ENSO event. The dominant growing BV modes are reminiscent of the background ENSO anomalies and show a strong tropical response with wind/SST/thermocline interrelated in a manner similar to the background ENSO mode. They exhibit larger amplitudes in the eastern tropical Pacific, reflecting the natural dynamical sensitivity associated with the presence of the shallow thermocline. Moreover, the extratropical perturbations associated with these coupled BV modes reveal the variations related to the atmospheric teleconnection patterns associated with background ENSO variability, e.g. over the North Pacific and North America. A similar experiment was carried out with the NCEP/CFS03 CGCM. Comparisons between bred vectors from the NSIPP CGCM and NCEP/CFS03 CGCM demonstrate the robustness of the results. Our results strongly suggest that the breeding method can serve as a natural filter to identify the slowly varying, coupled instabilities in a coupled GCM, which can be used to construct ensemble perturbations for ensemble forecasts and to estimate the coupled background error covariance for coupled data assimilation.

Yang, S. C.↗