Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Stochastic Modeling Workflow to Generate Representative Geologic Variability in Training Dataset for SMART Initiative

The poster discusses the modeling workflow to generate ensemble of geologic realizations of the Illinois Basin Decatur Project (IBDP) site, based on available site characterization data and inherent uncertainty of those data, for use by project collaborators in DOE SMART Initiative (Phase 2) to build their forward modeling, history matching, and optimization workflows. This poster is summarized from the technical report for the SMART project submitted to U.S. DOE earlier this year.

Ganesh, Priya Ravi↗
DOE OSTI2022

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

CMIP5 Climate Models Overestimate Cooling by Volcanic Aerosols

We compare projections of the observed hemispherical mean surface temperature (HadCRUT4.6.0.0) and the ensemble mean of CMIP5 climate models' simulations on a set of standard regression model forcing variables. We find that the volcanic aerosol regression coefficients of the CMIP5 simulations are consistently significantly larger (by 40–49%) than the volcanic aerosol coefficients of the observed temperature. The probability that the observed differences are caused just by chance is much less than 0.01. The overestimate is due to the climate models' response to volcanic aerosol radiative forcing. The largest overestimate occurs in the winter season of each hemisphere. We hypothesize that the models' parameterization of aerosol-cloud interactions within ice and mixed phase clouds is a likely source of this discrepancy. Furthermore, the models significantly underestimate the effect of solar variability on temperature for both hemispheres.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Producing High-fidelity Synthetic Population Ensembles at Scale

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the US via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. Our initial task involves creating ensembles for 17 US metropolitan areas, each consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system comprised of a research cloud, virtual containerization, GPU-enhanced functionality, and a dual API/CLI to interact with UrbanPop’s maturing Likeness Python ecosystem. We observe a reduction in theoretical execution time while maintaining high-fidelity approximations of residential totals by metropolitan area and the demographic characteristics of neighborhoods. We discuss expansion of our approach to produce synthetic population ensembles for the entire US, particularly plans to establish automated workflows for job orchestration to increase computational efficiency, as well as provide outlook for broadening applications of the ensembles.

Gaboardi, James [ORNL] (ORCID:0000000247766826)↗
DOE OSTI2026

Third-Party Supplier Risk Re-Classification Using Multi-Model Semantic Voting and External Web Augmentation

Risk decisions in many third-party risk management (TPRM) workflows rely on static inherent risk questionnaires (IRQ). These static forms provide a snapshot of the vendor from the business users’ perspective, as these requests are processed without cross-referencing for evidence. Consequently, responses can be misinformed or embellished with inaccuracies, thereby masking the vendor’s true risk to the enterprise. This paper presents a multi-stage verification framework to augment IRQs with web evidence and a deterministic ensemble of large language model assessors to reclassify risk. In a case study of 100 submissions previously misclassified as low risk, the proposed framework correctly identified 76% of the cases as high risk, while the existing workflow identified none. McNemar’s continuity corrected statistics of 74 were obtained with a two sided p-value of 2.65 × 10-23, indicating a significantly more effective workflow compared to the legacy model.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Scalable Generation of High-fidelity Synthetic Population Ensembles

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the U.S. via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. The study involves two scenarios: creating ensembles for (1) 17 U.S. metropolitan areas in 2019 and (2) full U.S. Census Divisions in 2023, with each scenario consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system within a research cloud, comprised of virtual containerizations, GPU-enhanced functionality, and orchestrated deployments of UrbanPop’s maturing Likeness Python ecosystem. Results demonstrate we maintained high-fidelity approximations of residential totals by areas of interest and the demographic characteristics of neighborhoods while reducing manual workflow burdens. Finally, we discuss plans to fine-tune and further develop our automated workflows for truly distributed job orchestration to increase computational efficiency, as well as provide an outlook for broadening applications of the ensembles.

Cluster computing↗
DOE OSTI2023

Iterative sampling of expensive simulations for faster deep surrogate training

Deep neural network (DNN) surrogates of expensive physics simulations are enabling a rapid change in the way that common experimental design and analysis tasks are approached. Surrogate models allow simulations to be performed in parallel and separately from downstream tasks, thereby enabling analyses that would be impossible with the simulation in-the-loop; surrogates based on DNNs can effectively emulate diverse non-scalar data of the types collected in fusion and laboratory-astrophysics experiments. The challenge is in training the surrogate model, for which large ensembles of physics simulations must be run, preferably without wasting computational effort on uninteresting simulations. Here, in this paper, we present an iterative sampling scheme that can preferentially propose simulations in interesting regions of parameter space without neglecting unexplored regions, allowing high-quality and wide-ranging surrogate models to be trained using 2–3 times fewer simulations compare to space-filling designs. Our approach uses an explicit importance function defined on the simulation output space, balanced against a measure of simulation density which serves as a proxy for surrogate accuracy. It is easy to implement and can be tuned to find interesting simulations early in the study, allowing surrogates to be trained quickly and refined as new simulations become available; this represents an important step towards the routine generation of deep surrogate models quickly enough to be truly relevant to experimental work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Geology↗
DOE OSTI2021

Assessment of CMIP6 Performance and Projected Temperature and Precipitation Changes Over South America

We evaluate the performance of a large ensemble of Global Climate Models (GCMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6) over South America for a recent past reference period and examine their projections of twenty-first century precipitation and temperature changes. The future changes are computed for two time slices (2040–2059 and 2080–2099) relative to the reference period (1995–2014) under four Shared Socioeconomic Pathways (SSPs, SSP1–2.6, SSP2–4.5, SSP3–7.0 and SSP5–8.5). The CMIP6 GCMs successfully capture the main climate characteristics across South America. However, they exhibit varying skill in the spatiotemporal distribution of precipitation and temperature at the sub-regional scale, particularly over high latitudes and altitudes. Future precipitation exhibits a decrease over the east of the northern Andes in tropical South America and the southern Andes in Chile and Amazonia, and an increase over southeastern South America and the northern Andes—a result generally consistent with earlier CMIP (3 and 5) projections. However, most of these changes remain within the range of variability of the reference period. In contrast, temperature increases are robust in terms of magnitude even under the SSP1–2.6. Future changes mostly progress monotonically from the weakest to the strongest forcing scenario, and from the mid-century to late-century projection period. There is an increase in the seasonality of the intra-annual precipitation distribution, as the wetter part of the year contributes relatively more to the annual total. Furthermore, an increasingly heavy-tailed precipitation distribution and a rightward shifted temperature distribution provide strong indications of a more intense hydrological cycle as greenhouse gas emissions increase. The relative distance of an individual GCM from the ensemble mean does not substantially vary across different scenarios. We found no clear systematic linkage between model spread about the mean in the reference period and the magnitude of simulated sub-regional climate change in the future period. Overall, these results could be useful for regional climate change impact assessments across South America.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Seasonal and CO 2 -Induced Shifts of the ITCZ: Testing Energetic Controls in Idealized Simulations with Comprehensive Models

The Tropical Rain Belts with an Annual Cycle and Continent Model Intercomparison Project (TRACMIP) ensemble—a multimodel ensemble of slab-ocean simulations in idealized configurations—provides a test of the relationship between the zonal mean ITCZ and the cross-equatorial atmospheric energy transports (AHT eq ). In a gross sense, the ITCZ position is linearly related to AHT eq , as expected from the energetic framework. Yet, in many aspects, the TRACMIP model simulations do not conform to the framework. Throughout the annual cycle there are large excursions in the ITCZ position unrelated to changes in the AHT eq and, conversely, substantial variations in the magnitude of the AHT eq while the ITCZ is stationary at its northernmost position. Variations both in the net vertical energy input at the ITCZ location and in the vertical profile of ascent play a role in setting the model behavior apart from the conceptual framework. Nevertheless, a linear fit to the ITCZ–AHT eq relationship captures a substantial fraction of the seasonal variations in these quantities as well as the intermodel or across-climate variations in their annual mean values. The slope of the ITCZ–AHT eq linear fit for annual mean changes across simulations with different forcings and configurations varies in magnitude and even sign from model to model and we identify variations in the vertical profile of ascent as a key factor. A simple sea surface temperature–based index avoids the complication of changes in the vertical structure of the atmospheric circulation and provides a more reliable diagnostic for the ITCZ position.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Dynamic Data-Driven Multiscale Modeling for Predicting Microstructure and Mechanical Properties of 316L Stainless Steel

We have developed a long short-term memory stacked ensemble (LSTM-SE) surrogate modeling approach that can provide rapid predictions of microstructural evolution and the resultant mechanical properties of American Iron and Steel Institute (AISI) 316L series stainless steel (316LSS) fuel cladding under conditions of varying temperature and radiation dose rate. To acquire training data, we developed and implemented a kinetic Monte Carlo (KMC) model to simulate precipitation kinetics of M 23 C 6 , γ', and G phases within SS316L cladding. Experimentally reported precipitation kinetics of SS316L in literature were linked to the kinetic parameters of the simulated precipitation in our KMC model. The model was then used to simulate microstructure evolution under synthetically generated treatments of varying temperature and radiation dose rate, for periods of up to 3000 hours. Changes in volume fraction, number density, and particle size of precipitates were recorded, and particle area fractions were correlated using statistical methods to develop the surrogate model. Simultaneously, the mechanical properties of the simulated microstructures were evaluated using microstructure-based finite element method (FEM) analysis to determine the elastic modulus, yield stress, ultimate tensile strength, and elongation to failure of the aged microstructures. Using this approach, our surrogate model can predict precipitation behavior within 0.25% volume fraction and mechanical properties within 6% relative error from the values predicted by the KMC and FEM models using 50 training simulations as input. The trained recurrent neural network-based model can return estimations of precipitation kinetics and mechanical properties ~1000 times faster than the physics-based codes. This work demonstrates, as a proof of concept, that reactor material service lifetimes under variable service conditions can be predicted for a statistics-based model from a practicably obtainable dataset.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Mid-century climate change impacts on tornado-producing tropical cyclones

Tornadoes are a co-occurring extreme that can be produced by landfalling tropical cyclones (TCs). These tornadoes can exacerbate the loss of life and property damage caused by the TC from which they were spawned. It is uncertain how the severe weather environments of landfalling TCs may change in a future climate and how this could impact tornado activity from TCs. In this study, we investigated four TCs that made landfall in the U.S. and produced large tornado outbreaks. We performed four-member ensembles of convective-allowing (4-km resolution) regional climate model simulations representing each TC in the historical climate and a mid-twenty-first century future climate. To identify potentially tornadic storms, or TC-tornado (TCT) surrogates, we used thresholds for three-hourly maximum updraft helicity and radar reflectivity, as tornadoes are not resolved in the model. We found that the ensemble-mean number of TCT-surrogates increased substantially (56–299%) in the future, supported by increases in most-unstable convective available potential energy, surface-to-700-hPa bulk wind shear, and 0–1-km storm-relative helicity in the tornado-producing region of the TCs. On the other hand, future changes in most-unstable convective inhibition had minimal influence on future TCT-surrogates. This provides robust evidence that tornado activity from TCs may increase in the future. Furthermore, TCT-surrogate frequency between 00Z and 09Z increased for three of the four cases, suggesting enhanced tornado activity at night, when people are asleep and more likely to miss warnings. All of these factors indicate that TC-tornadoes may become more frequent and a greater hazard in the future, compounding impacts from future increases in TC winds and precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Decadal Spiciness Variability in the Subtropical-Tropical Pacific in the CESM2 Large Ensemble

Tropical Pacific decadal variations impact weather and climate around the world and are also connected to variations in the global warming trend. The mechanisms driving these long-term modulations, particularly the role of subsurface ocean dynamics, are still debated. Here, we investigate the dynamics of spiciness (density-compensated temperature and salinity) anomalies in the tropical and subtropical Pacific, which are hypothesized as a possible driving mechanism of decadal climate variability. Based on the analysis of 100 realizations from the Community Earth System Model Version 2 Large Ensemble (CESM2-LE), we demonstrate a coupling between the subtropics and the equatorial Pacific by propagating spiciness anomalies at decadal time scales. The CESM2-LE simulates spiciness variability along a subduction path from the subtropics to the equator with frequency spectra that show the highest power at low frequencies and a power decay proportional to a −4 slope for frequencies greater than 0.01 cycles per months, corresponding to periods smaller than ∼8.5 years. Signals that originate in the Southern Hemisphere (SH) dominate and arrive with a larger magnitude at the equator compared to spiciness anomalies from the Northern Hemisphere (NH). Spiciness anomalies from the SH have shorter propagation times and are strengthened along their pathway as stochastic wind stress curl forcing generates anomalous baroclinic ocean pressure gradients. These pressure gradients generate spiciness anomalies via anomalous advection across climatological spiciness gradients in the SH. We conclude that the observed spiciness variance at decadal time scales is consistent with a forcing by stochastic wind variations that are low-pass filtered by ocean dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Prediction of the development of islet autoantibodies through integration of environmental, genetic, and metabolic markers

The Environmental Determinants of the Diabetes in the Young (TEDDY) study has prospectively followed, from birth, children at increased genetic risk of type 1 diabetes. We evaluated the potential of machine learning to identify new biomarkers that predict imminent (within 6 months) development of persistent islet autoantibodies to insulin, GAD or IA-2 in TEDDY participants through integration of time-invariant risk factors with time-varying metabolomics. The predictive modeling was initiated with over 220 potential biomarkers; through ensemble-based feature evaluation, the optimal model included 42 biomarkers, returning a cross-validated receiver operating characteristic area under the curve of 0.74. The model identified a principal set of 20 time-invariant markers, including 16 single nucleotide polymorphisms and two HLA-DR genotypes, gestational age, and exposure to a prebiotic formula. Integration of the metabolome identified 22 high-priority metabolites and lipids, including adipic acid and ceramide d42:0, that predicted development of islet autoantibodies, dependent upon the time horizon. The majority (86%) of metabolites that predicted development of islet autoantibodies belonged to 3 pathways: lipid oxidation, phospholipase A2 signaling, and pentose phosphate pathway. TEDDY data suggest that these metabolic processes may play a role in triggering islet autoimmunity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning

Stream temperature (Ts) is an important water quality parameter that affects ecosystem health and human water use for beneficial purposes. Accurate Ts predictions at different spatial and temporal scales can inform water management decisions that account for the effects of changing climate and extreme events. In particular, widespread predictions of Ts in unmonitored stream reaches can enable decision makers to be responsive to changes caused by unforeseen disturbances. In this study, we demonstrate the use of classical machine learning (ML) models, support vector regression and gradient boosted trees (XGBoost), for monthly Ts predictions in 78 pristine and human-impacted catchments of the Mid-Atlantic and Pacific Northwest hydrologic regions spanning different geologies, climate, and land use. The ML models were trained using long-term monitoring data from 1980–2020 for three scenarios: (1) temporal predictions at a single site, (2) temporal predictions for multiple sites within a region, and (3) spatiotemporal predictions in unmonitored basins (PUB). In the first two scenarios, the ML models predicted Ts with median root mean squared errors (RMSE) of 0.69–0.84 °C and 0.92–1.02 °C across different model types for the temporal predictions at single and multiple sites respectively. For the PUB scenario, we used a bootstrap aggregation approach using models trained with different subsets of data, for which an ensemble XGBoost implementation outperformed all other modeling configurations (median RMSE 0.62 °C).The ML models improved median monthly Ts estimates compared to baseline statistical multi-linear regression models by 15–48% depending on the site and scenario. Air temperature was found to be the primary driver of monthly Ts for all sites, with secondary influence of month of the year (seasonality) and solar radiation, while discharge was a significant predictor at only 10 sites. The predictive performance of the ML models was robust to configuration changes in model setup and inputs, but was influenced by the distance to the nearest dam with RMSE <1 °C at sites situated greater than 16 and 44 km from a dam for the temporal single site and regional scenarios, and over 1.4 km from a dam for the PUB scenario. Our results show that classical ML models with solely meteorological inputs can be used for spatial and temporal predictions of monthly Ts in pristine and managed basins with reasonable (<1 °C) accuracy for most locations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Large Ensemble Particle Filter for Spatial Climate Reconstructions Using a Linear Inverse Model

Proxy records that document the last 2000 years of climate provide evidence for the wide range of the natural climate variability from inter-annual to secular timescales not captured by the short window of recent direct observations. Assessing climate models ability to reproduce such natural variations is crucial to understand climate sensitivity and impacts of future climate change. Paleoclimate data assimilation (PDA) offers a powerful way to extend the short instrumental period by optimally combining the physics described by General Circulation Climate Models (GCMs) with information from available proxy records while taking into account their uncertainties. Here we present a new PDA approach based on a sequential importance resampling (SIR) Particle filter (PF) that uses Linear Inverse Modeling (LIM) as an emulator of several CMIP-class GCMs. We examine in a perfect-model framework the skill of the various LIMs to forecast the dynamics of the surface temperatures and provide spatial field reconstructions over the last millennium in a SIR PF. Our results show that the LIMs allow for skillful ensemble forecasts at 1-year lead-time based on GCMs dynamical knowledge with best prediction in the tropics and the North Atlantic. The PDA further provides a set of physically consistent spatial fields allowing robust uncertainty quantification related to climate models biases and proxy spatial sampling. Our results indicate that the LIM yields dynamical memory improving climate variability reconstructions and support the use of the LIM as a GCM-emulator in real reconstruction to propagate large ensembles of particles at low cost in SIR PF.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Projected future daily characteristics of African precipitation based on global (CMIP5, CMIP6) and regional (CORDEX, CORDEX-CORE) climate models

In this work, we provide an assessment of future daily characteristics of African precipitation by explicitly comparing the results of large ensembles of global (CMIP5, CMIP6) and regional (CORDEX, CORE) climate models, specifically highlighting the similarities and inconsistencies between them. Results for seasonal mean precipitation are not always consistent amongst ensembles: in particular, global models tend to project a wetter future compared to regional models, especially over the Eastern Sahel, Central and East Africa. However, results for other precipitation characteristics are more consistent. In general, all ensembles project an increase in maximum precipitation intensity during the wet season over all regions and emission scenarios (except the West Sahel for CORE) and a decrease in precipitation frequency (under the Representative Concentration Pathways RCP8.5) especially over the West Sahel, the Atlas region, southern central Africa, East Africa and southern Africa. Depending on the season, the length of dry spells is projected to increase consistently by all ensembles and for most (if not all) models over southern Africa, the Ethiopian highlands and the Atlas region. Discrepancies exist between global and regional models on the projected change in precipitation characteristics over specific regions and seasons. For instance, over the Eastern Sahel in July–August most global models show an increase in precipitation frequency but regional models project a robust decrease. Global and regional models also project an opposite sign in the change of the length of dry spells. CORE results show a marked drying over the regions affected by the West Africa monsoon throughout the year, accompanied by a decrease in mean precipitation intensity between May and July that is not present in the other ensembles. This enhanced drying may be related to specific physical mechanisms that are better resolved by the higher resolution models and highlights the importance of a process-based evaluation of the mechanisms controlling precipitation over the region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Robustness of the Ensemble Score Filter to the Type of Assimilated Observation Networks

Recent advances in data assimilation (DA) have focused on developing more flexible approaches that can better accommodate nonlinearities in models and observations. However, it remains unclear how the performance of these advanced methods depends on the observation network characteristics. In this study, we present initial experiments with the surface quasi‐geostrophic model, in which we compare a recently developed ensemble filter using score‐based diffusion models with the standard Local Ensemble Transform Kalman Filter (LETKF). Our results show that the analysis solutions respond differently to the number, spatial distribution, and nonlinear fraction of assimilated observations. We also find notable changes in the multiscale characteristics of the analysis errors. Given that standard DA techniques will eventually be replaced by more advanced methods, we hope this study sets the ground for future efforts to reassess the value of Earth observing systems in the context of newly emerging algorithms.

97 MATHEMATICS AND COMPUTING↗