Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ASSIMILATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Integration of AI/ML with Data Assimilation for Earth System Prediction

Focal Area(s): Development of dynamically consistent AI/ML methods that can integrate with the data assimilation cycle to improve the efficiency and effectiveness of state estimation and prediction at short to medium range forecast horizons. Science Challenge: This white paper addresses a first step toward complete integration of AI/ML and DA. Here, we address model emulation and its application to simple coupled atmosphere-ocean dynamics for use in data assimilation applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Assimilating Scanning Radar Data into High-Resolution Models

This report documents the findings of a project aiming to improve the initial conditions of km-scale simulations of deep convective storms by assimilating cloud-scale weather radar observations. More accurate numerical analyses will increase the effectiveness of research efforts using LES cloud models as tool to better understand land-atmosphere coupling, boundary layer turbulence, and cloud processes, each used for model parameterization development. Work reported on herein includes: i) assessment of radar data sets for use in data assimilation (‘DA’) experiments, ii) quality control of the radar data set and format conversion to one acceptable to DA schemes utilized by the Weather Research and Forecasting (WRF) model, and iii) examination of the sensitivity of the numerical representation of cloud-scale wind and microphysical features to a variety of tunable DA parameters.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Development of a Framework for Data Integration, Assimilation, and Learning for Geological Carbon Sequestration (DIAL-GCS) (Final Report)

This project aimed to develop and demonstrate a Data Integration, Assimilation, and Learning framework for geologic carbon sequestration projects (DIAL-GCS). DIAL-GCS is an intelligence monitoring system (IMS) for automating GCS closed-loop management by leveraging recent developments in machine learning technologies, complex event processing (CEP), and reduced-order modeling. The safe and efficient operation of GCS repositories requires integrated monitoring to track the injected CO¬2 as it moves within a storage reservoir. GCS projects are data intensive, as a result of proliferation of digital instrumentation and smart-sensing technologies. GCS projects are also resource intensive, often requiring multidisciplinary teams performing different monitoring, verification, accounting (MVA) tasks throughout the lifecycle of a project to ensure secure containment of injected CO2. The success of GCS thus depends in a large part on our ability to access, assimilate, and analyze heterogeneous data and information sources in a timely manner. This project included a number of meaningful and necessary tasks to transform the human domain knowledge into machine-interpretable rules for automating knowledge extraction and discovery in GCS. The specific technical objectives of the proposed DIAL-GCS project were to develop an ontology-driven GCS data management module for storing, querying, and exchanging GCS data (both historic and live sensor data) from multiple sources and in heterogeneous formats. Incorporate a CEP engine for detecting abnormal situations by seamlessly combining expert knowledge, rule-based reasoning, and machine learning. Enable uncertainty quantification and predictive analytics using a combination of coupled-process modeling, AI/ML methods, and reduced-order modeling, and integrate and demonstrate the system’s capabilities with both real and simulated data. As far as we know, this is one of the first projects aimed to develop intelligent monitoring systems (IMS) targeting the GCS. Under this project, the team had developed a large number of web applications and scientific algorithms that contribute the main theme of intelligent monitoring. The team has published more than a dozen peer reviewed papers and disseminated the research results at multiple technical meetings.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

ML-based Data Assimilation and History Matching: Application to the IBDP CCS Project

It is crucial to monitor the CO2 plume effectively throughout the life cycle of a geologic CO2 sequestration project to ensure safety and storage efficiency. However, the computational cost of existing data assimilation methods can be prohibitively expensive due to the complex physics with multi-component non-isothermal simulation and high dimensionality of large-scale reservoir models. We address this challenge by proposing an accelerated deep learning-based workflow for model calibration and prediction of CO2 plume evolution in the reservoir.The power and efficacy of our workflow is demonstrated by application to the Illinois Basin-Decatur Project (IBDP), a large-scale CO2 storage test in saline aquifer. The data assimilation process is implemented rapidly by the proposed workflow with given field measurements including distributed pressure and temperature sensing (DTS) data at an injection and a monitoring well. CO2 plume evolution is predicted by running the simulations of the calibrated reservoir models.

Nagao, Masahiro↗
DOE OSTI2025

WRF-Chem & Data Assimilation: Reconstructing a Historic Dispersion Event

CONCLUSIONS • For this particular case and use, 3D-VAR was the most useful data assimilation method applied for modeling this plume. • Slight downside was the plume was modeled to move too quickly. • Whether this result is generalizable may be debatable based on the circumstances. • The atmospheric state altered how effective the data assimilation algorithms performed. • Nudging and 3D-VAR are not mutually exclusive, but their errors for wind speed may compound

Thomas, Andrew M. [Savannah River National Laborat↗
DOE OSTI2026

Development of Biofuel and Bioenergy Processes for Photosynthetic CO 2 Assimilation (CRADA Final Report)

In order to fully exploit algae carbon assimilation for fuels, a preqrequisite is high photosynthetic efficiency and carbon conversion to fuel precursors. In the context of this collaborative project between NLR and EMRE we aim to address aspects of both the biological constraints around photosynthesis-driven carbon assimilation flux as well as elements that bridge the gap between laboratory cultivation and meaningful outdoor deployment, building on the unique capabilities of NLR and EMRE’s algae bioengineering teams. The goal of this work is to improve our understanding of key cellular biochemistry, mass cultivation, and biomass conversion constraints that presently limit the potential bio-oil yield. The proposed first phase of this work will focus on biomass growth improvements by testing hypotheses for alleviating identified metabolic and photophysiological bottlenecks. The results of this work could inform decisions by stakeholders (e.g., industry, community, investors) on the design and deployment of a sustainable biofuel supply chain from algae.

09 BIOMASS FUELS↗
DOE OSTI2025

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗
DOE OSTI2025

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Adrian, Melissa [Univ. of Chicago, IL (United Stat↗
DOE OSTI2024

The Dynamic Assimilation Technique measures photosynthetic CO2 response curves with similar fidelity as steady-state approaches in half the time

The net CO2 assimilation (A) response to intercellular CO2 concentration (Ci) is a fundamental measurement in photosynthesis and plant physiology research. The conventional A/Ci protocols rely on steady-state measurements and take 15-40 minute per measurement, limiting data resolution or biological replication. Additionally, there are several CO2 protocols employed across the literature, without clear consensus as to the optimal protocol or systematic biases in their estimations. We compared the non-steady state Dynamic Assimilation Technique (DAT) protocol and the three most used CO2 protocols in steady-state measurements, and tested whether different CO2 protocols lead to systematic differences in estimations of the biochemical limitations to photosynthesis.

A/Ci response↗
DOE OSTI2016

Inverse modeling of pan-Arctic methane emissions at high spatial resolution: what can we learn from assimilating satellite retrievals and using different process-based wetland and lake biogeochemical models?

Understanding methane emissions from the Arctic, a fast-warming carbon reservoir, is important for projecting future changes in the global methane cycle. Here we optimized methane emissions from north of 60° N (pan-Arctic) regions using a nested-grid high-resolution inverse model that assimilates both high-precision surface measurements and column-average SCanning Imaging Absorption spectroMeter for Atmospheric CHartogrphY (SCIAMACHY) satellite retrievals of methane mole fraction. For the first time, methane emissions from lakes were integrated into an atmospheric transport and inversion estimate, together with prior wetland emissions estimated with six biogeochemical models. In our estimates, in 2005, global methane emissions were in the range of 496.4–511.5 Tg yr –1 , and pan-Arctic methane emissions were in the range of 11.9–28.5 Tg yr –1 . Methane emissions from pan-Arctic wetlands and lakes were 5.5–14.2 and 2.4–14.2 Tg yr –1 , respectively. Methane emissions from Siberian wetlands and lakes are the largest and also have the largest uncertainty. Our results indicate that the uncertainty introduced by different wetland models could be much larger than the uncertainty of each inversion. We also show that assimilating satellite retrievals can reduce the uncertainty of the nested-grid inversions. The significance of lake emissions cannot be identified across the pan-Arctic by high-resolution inversions, but it is possible to identify high lake emissions from some specific regions. In contrast to global inversions, high-resolution nested-grid inversions perform better in estimating near-surface methane concentrations.

58 GEOSCIENCES↗
DOE OSTI2025

A 1 km soil moisture dataset over eastern CONUS generated by assimilating SMAP data into the Noah-MP land surface model

An improved fine-scale soil moisture (SM) dataset at 1 km grid spacing, covering much of the eastern continental US, was generated by assimilating 9 km Soil Moisture Active Passive (SMAP) SM data into the v4.0.1 Noah-MP land surface model. With 12 ensemble members, the assimilation was carried out using the ensemble Kalman filter algorithm within NASA's Land Information System. The SM analysis for 2016 was fully validated against in situ observations from four different networks and compared with four other existing datasets. Results indicate that this SM analysis surpasses other datasets in top-layer SM distribution, including a machine-learning-based product, despite all SM estimates being less heterogeneous than observed. The analysis of anomalous errors suggests that large similarity in intrinsic errors is likely due to overlapping data sources among the selected SM datasets. More detailed evaluations were performed over two geographic areas. The observations collected by the Atmospheric Radiation Measurement facility in Oklahoma suggest that soil temperature and surface heat fluxes are concurrently simulated with good accuracy. Investigation into the 2016 southeastern US drought response further indicates drier conditions and higher evapotranspiration estimates compared to GLEAMv4.1. Notably, large errors are associated with grids having clay soil textures, underscoring the need for refined model treatments for specific soil types to further improve SM estimates. The dataset is publicly available on Zenodo at https://doi.org/10.5281/zenodo.14370563 (Tai et al., 2024).

Tai, Sheng-Lun [Pacific Northwest National Laborat↗
DOE OSTI2022

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Efficient high-dimensional variational data assimilation with machine-learned reduced-order models

Abstract. Data assimilation (DA) in geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction and is a crucial building block that has allowed dramatic improvements in weather forecasting over the past few decades. DA is commonly framed in a variational setting, where one solves an optimization problem within a Bayesian formulation using raw model forecasts as a prior and observations as likelihood. This leads to a DA objective function that needs to be minimized, where the decision variables are the initial conditions specified to the model. In traditional DA, the forward model is numerically and computationally expensive. Here we replace the forward model with a low-dimensional, data-driven, and differentiable emulator. Consequently, gradients of our DA objective function with respect to the decision variables are obtained rapidly via automatic differentiation. We demonstrate our approach by performing an emulator-assisted DA forecast of geopotential height. Our results indicate that emulator-assisted DA is faster than traditional equation-based DA forecasts by 4 orders of magnitude, allowing computations to be performed on a workstation rather than a dedicated high-performance computer. In addition, we describe accuracy benefits of emulator-assisted DA when compared to simply using the emulator for forecasting (i.e., without DA). Our overall formulation is denoted AIEADA (Artificial Intelligence Emulator-Assisted Data Assimilation).

58 GEOSCIENCES↗
DOE OSTI2025

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

PyDDA: A Pythonic Direct Data Assimilation Framework for Wind Retrievals

This software assimilates data from an arbitrary number of weather radars together with other spatial wind fields (eg numerical weather forecasting model data) in order to retrieve high resolution three dimensional wind fields. PyDDA uses NumPy and SciPy’s optimization techniques combined with the Python Atmospheric Radiation Measurement (ARM) Radar Toolkit (Py-ART) in order to create wind fields using the 3D variational technique (3DVAR). PyDDA is hosted and distributed on GitHub at https://github.com/openradar/PyDDA. PyDDA has the potential to be used by the atmospheric science community to develop high resolution wind retrievals from radar networks. These retrievals can be used for the evaluation of numerical weather forecasting models and plume modelling. This paper shows how wind fields from 2 NEXt generation RADar (NEXRAD) WSR-88D radars and the High Resolution Rapid Refresh can be assimilated together using PyDDA to create a high resolution wind field inside Hurricane Florence.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

Time-continuous assimilation of remote-sounding data and its effect on weather forecasting

Methods were developed for the time-continuous assimilation of satellite-sounding temperature data: direct insertion method, asynoptic successive correction method, and local linear regression method. These methods were applied to DST-6 data from the operational and experimental temperature sounders aboard the NOAA 4 and Nimbus 6 satellites. Attention is given to a comparison of these methods and their effect on the accuracy of the initial states obtained, as well as the resulting forecasts generated from these initial states. The results suggest that (1) satellite-derived temperature data can have a modest though statistically significant positive impact on numerical weather prediction in the 2-3 day range; (2) the impact is highly sensitive to the quantity of data available; and (3) the method of satellite-data assimilation can substantially influence the magnitude of the impact obtained for the same data.

Ghil, M.↗
NASA NTRS1982

Development of mathematical techniques for the assimilation of remote sensing data into atmospheric models

The problem of the assimilation of remote sensing data into mathematical models of atmospheric pollutant species was investigated. The data assimilation problem is posed in terms of the matching of spatially integrated species burden measurements to the predicted three-dimensional concentration fields from atmospheric diffusion models. General conditions were derived for the reconstructability of atmospheric concentration distributions from data typical of remote sensing applications, and a computational algorithm (filter) for the processing of remote sensing data was developed.

Seinfeld, J. H.↗
NASA NTRS1985

Development and testing of a simple assimilation technique to derive average wind fields from simulated scatterometer data

A simple algorithm is developed and tested to derive a regularly spaced wind field in a limited area from simulated multiorbit scatterometer data. The data are generated by sampling a time-varying known wind field, the 1000-mb FGGE data, from a simulated scatterometer. A simple assimilation technique is used to derive a regularly spaced (100-km grid) wind field representation of two-day averages from the simulated data. Several test cases are considered, and it is noted that the assimilation technique might be applicable to large-scale ocean or atmospheric models.

Legler, D. M.↗