Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A sensitivity analysis to predict the neutronics behavior of samples irradiated in the VTR rabbit system

We report a low-order neutronics model is developed to carry out hundreds of simulations efficiently and investigate the neutronics behavior of samples being irradiated in a test reactor setting under different geometrical constraints. The low-order model allowed for simulations that yield the expected neutronics behavior of any irradiated sample in any environment and allows for the calculation of highly accurate spatially averaged statistics and idealized spatial distributions in the neutron flux. Several benchmarks are performed to evaluate the performance and limitations of the low-order model revealing many important findings. The low-order model predicted the LHGR in the EBR-II driver fuel to within 2.34% by only simulating the fuel rod by itself, which served as a validation for the model. Sensitivity studies investigated 3% enriched UO 2 and U-10Zr being irradiated in the Versatile Test Reactor rabbit system. The analyses investigated a range of combinations of 15 radii and 5 heights for each sample in the rabbit system. Similar data sets are also provided for irradiations in the Advanced Test Reactor’s B-10 irradiation position, which is a thermal neutron spectrum environment. Generalized fits and fit coefficients are obtained for sample heating, reaction rate densities, and local multiplication rate characteristics, allowing the predictions of the neutronics behavior of the samples based on their geometrical constraints. The analyses and fits laid the groundwork for developing a user-end Multiphysics analysis framework to assist and accelerate irradiation experiment design and optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Estimating the carbon footprint of computational fluid dynamics

In this study, computational resources have grown exponentially in the past few decades. These machines make possible research and design in fields as diverse as medicine, astronomy, and engineering. Despite ever-increasing computational capabilities, direct simulation of complex systems has remained challenging owing to the degrees of freedom involved. At the cusp of exascale computing, high-resolution simulation of practical problems with minimal model assumptions may soon experience a renaissance. However, growing reliance on modern computers comes at the cost of a growing carbon footprint. To illustrate this, we examine historic computations in fluid dynamics where larger computers have afforded the opportunity to simulate flows at increasingly relevant Reynolds numbers. Under a variety of flow configurations, the carbon footprint of such simulations is found to scale roughly with the fourth power of Reynolds number. This is primarily explained by the computation cost in core-hours, which is also described by similar scaling, though regional differences in renewable energy use also play a role. Using the established correlation, we examine a large database of simulations to develop estimates for the carbon footprint of computational fluid dynamics in a given year. Collectively, the analysis provides an additional benchmark for new computations where, in addition to balancing considerations of model fidelity, carbon footprint should also be considered.

42 ENGINEERING↗
NASA NTRS1989

Review of FD-TD numerical modeling of electromagnetic wave scattering and radar cross section

Applications of the finite-difference time-domain (FD-TD) method for numerical modeling of electromagnetic wave interactions with structures are reviewed, concentrating on scattering and radar cross section (RCS). A number of two- and three-dimensional examples of FD-TD modeling of scattering and penetration are provided. The objects modeled range in nature from simple geometric shapes to extremely complex aerospace and biological systems. Rigorous analytical or experimental validatons are provided for the canonical shapes, and it is shown that FD-TD predictive data for near fields and RCS are in excellent agreement with the benchmark data. It is concluded that with continuing advances in FD-TD modeling theory for target features relevant to the RCS problems and in vector and concurrent supercomputer technology, it is likely that FD-TD numerical modeling will occupy an important place in RCS technology in the 1990s and beyond.

Taflove, Allen↗
DOE OSTI2025

Noble dark matter: Surprising elusiveness of dark baryons

Dark matter could be a baryonic composite of stronglyc upled constituents transforming under SU⁡(2) 𝐿 . We classify the SU⁡(2) 𝐿 representations of baryons in a class of simple confining dark sectors and find that the lightest state can be a pure singlet or a singlet that mixes with other neutral components of SU⁡(2) 𝐿 representations, which strongly suppresses the dark matter candidate’s interactions with the Standard Model. We focus on models with a confining SU⁡(𝑁 𝑐 ) and heavy dark quarks constituting vectorlike 𝑁 𝑓 -plet of SU⁢(2) 𝐿 . For benchmark 𝑁 𝑐 and 𝑁 𝑓 , we calculate baryon mass spectra, incorporating electroweak gauge boson exchange in the nonrelativistic quark model, and demonstrate that above TeV mass scales, dark matter is dominantly a singlet state. The combination of this singlet nature with the recently discovered ℋ-parity results in an inert state analogous to noble gases, hence we coin the term noble dark matter. Our results can be understood in the nonrelativistic effective theory that treats the dark baryons as elementary states, where we find singlets accompanying triplets, 5-plets, or more exotic representations. This generalization of WIMP-like theories is more difficult to find or rule out than dark matter models that include only a single SU⁡(2) 𝐿 multiplet (such as a wino), motivating new searches in colliders and a reanalysis of direct and indirect detection prospects in astrophysical observations.

dark matter direct detection↗
DOE OSTI2024

A multiscale anisotropic polymer network model coupled with phase field fracture

The study of polymers has continued to gain substantial attention due to their expanding range of applications, spanning essential engineering fields to emerging domains like stretchable electronics, soft robotics, and implantable sensors. These materials exhibit remarkable properties, primarily stemming from their intricate polymer chain network, which, in turn, increases the complexity of precisely modeling their behavior. Especially for modeling elastomers and their fracture behavior, accurately accounting for the deformations of the polymer chains is vital for predicting the rupture in highly stretched chains. Despite the importance, many robust multiscale continuum frameworks for modeling elastomer fracture tend to simplify network deformations by assuming uniform behavior among chains in all directions. Recognizing this limitation, our study proposes a multiscale fracture model that accounts for the anisotropic nature of elastomer network responses. At the microscale, damage in the chains is assumed to be driven by both the chain's entropy and the internal energy due to molecular bond distortions. In order to bridge the stretching in the chains to the macroscale deformation, we employ the maximal advance path constraint network model, inherently accommodating anisotropic network responses. As a result, chains oriented differently can be predicted to exhibit varying stretch and, consequently, different damage levels. To drive macroscale fracture based on damages in these chains, we utilize the micromorphic regularization theory, which involves the introduction of dual local-global damage variables at the macroscale. The macroscale local damage variable is obtained through the homogenization of the chain damage values, resulting in the prediction of an isotropic material response. The macroscale global damage variable is subjected to nonlocal effects and boundary conditions in a thermodynamically consistent phase field continuum formulation. Moreover, the total dissipation in the system is considered to be mainly due to the breaking of the molecular bonds at the microscale. To validate our model, we employ the double-edge notched tensile test as a benchmark, comparing simulation predictions with existing experimental data. Additionally, to enhance our understanding of the fracturing process, we conduct uniaxial tensile experiments on a square film made up of polydimethylsiloxane (PDMS) rubber embedded with a hole and notches and then compare our simulation predictions with the experimental observations. Furthermore, we visualize the evolution of stretch and damage values in chains oriented along different directions to assess the predictive capacity of the model. In conclusion, the results are also compared with another existing model to evaluate the utility of our model in accurately simulating the fracture behavior of rubber-like materials.

42 ENGINEERING↗
NASA NTRS2011

Assessment of CFD Hypersonic Turbulent Heating Rates for Space Shuttle Orbiter

Turbulent CFD codes are assessed for the prediction of convective heat transfer rates at turbulent, hypersonic conditions. Algebraic turbulence models are used within the DPLR and LAURA CFD codes. The benchmark heat transfer rates are derived from thermocouple measurements of the Space Shuttle orbiter Discovery windward tiles during the STS-119 and STS-128 entries. The thermocouples were located underneath the reaction-cured glass coating on the thermal protection tiles. Boundary layer transition flight experiments conducted during both of those entries promoted turbulent flow at unusually high Mach numbers, with the present analysis considering Mach 10{15. Similar prior comparisons of CFD predictions directly to the flight temperature measurements were unsatisfactory, showing diverging trends between prediction and measurement for Mach numbers greater than 11. In the prior work, surface temperatures and convective heat transfer rates had been assumed to be in radiative equilibrium. The present work employs a one-dimensional time-accurate conduction analysis to relate measured temperatures to surface heat transfer rates, removing heat soak lag from the flight data, in order to better assess the predictive accuracy of the numerical models. The turbulent CFD shows good agreement for turbulent fuselage flow up to Mach 13. But on the wing in the wake of the boundary layer trip, the inclusion of tile conduction effects does not explain the prior observed discrepancy in trends between simulation and experiment; the flight heat transfer measurements are roughly constant over Mach 11-15, versus an increasing trend with Mach number from the CFD.

Wood, William A.↗
NASA NTRS2013

Development and Applications of Benchmark Examples for Static Delamination Propagation Predictions

The development and application of benchmark examples for the assessment of quasistatic delamination propagation capabilities was demonstrated for ANSYS (TradeMark) and Abaqus/Standard (TradeMark). The examples selected were based on finite element models of Double Cantilever Beam (DCB) and Mixed-Mode Bending (MMB) specimens. First, quasi-static benchmark results were created based on an approach developed previously. Second, the delamination was allowed to propagate under quasi-static loading from its initial location using the automated procedure implemented in ANSYS (TradeMark) and Abaqus/Standard (TradeMark). Input control parameters were varied to study the effect on the computed delamination propagation. Overall, the benchmarking procedure proved valuable by highlighting the issues associated with choosing the appropriate input parameters for the VCCT implementations in ANSYS® and Abaqus/Standard®. However, further assessment for mixed-mode delamination fatigue onset and growth is required. Additionally studies should include the assessment of the propagation capabilities in more complex specimens and on a structural level.

Krueger, Ronald↗
DOE OSTI2025

Lack of clear standards and usable comparisons of downscaled climate projections pose a roadblock for US climate discovery and adaptation

Abstract The release of global climate projections coupled with the demand for local-resolution climate-forced meteorology has prompted many research groups to downscale these projections using various statistical, dynamical, and current machine learning techniques. Such downscaled datasets are being used to plan infrastructure and other community needs over the coming decades. Faced with roughly a dozen available US downscaled datasets, many practitioners ask, ‘What are the relevant differences between datasets?’ This work highlights the difficulty of comparing downscaled datasets and illustrates ways in which datasets differ even when using identical climate model input data. We show that substantial variability in precipitation projections arises from downscaling alone and that the downscaled dataset agreement varies depending on global climate projection. This analysis emphasizes the need for greater coordination and movement toward rigorous benchmarking of downscaling strategies within the downscaling research community, à la the land-modeling community, to better quantify downscaling dataset differences, strengths, and weaknesses for practitioners.

Hartke, Samantha H. (ORCID:0000000202394723)↗
DOE OSTI2022

Correlation Calculations for the Russian Pu Metal Fast Experiments

Nuclear criticality experiments are often conducted in campaigns with multiple variations. These experiments reuse the same basic components, like the fuel, moderator, or positioning machines. The components have uncertainties in their geometry and composition that propagate to models of the experiments. Shared components create shared uncertainty between the $k_{eff}$ of benchmarks. The shared uncertainty is commonly quantified with a covariance, or correlation coefficient. These covariances can impact criticality safety and nuclear data validation applications. While benchmark evaluations tabulate an experiment’s uncertainty, they often lack a detailed calculation of correlations between experiments. Even some very commonly used benchmarks, like the Russian Pu Metal Fast (PMF) experiments, have missing correlations. This paper presents our approach to calculate the correlations for five of the Russian PMF experiments. The experiments share hemispherical Pu shells that induce a correlation between modeled $k_{eff}$ values. We estimated the correlations with simplified and detailed models of the experiments through linear-perturbation theory. The correlations between the experiments vary significantly between the detailed vs. simplified models. We also investigate how the correlations affect validation metrics of the experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Performance Portability Evaluation of OpenCL Benchmarks across Intel and NVIDIA Platforms

We evaluate the capabilities of vendor-provided OpenCL implementations for performance portability across multiple computing platforms. The Rodinia benchmark suite is used for this evaluation. We apply the metric defined by Pennycook et al., and we use roofline efficiency from the Roofline performance model as the "performance efficiency" in the metric's definition. We found that the delivered performance portability is similar for several benchmarks, even if the roofline-based performance efficiencies across platforms are very different among the benchmarks. To help distinguish between these instances, we extend the metric by adding the standard deviation of the performance efficiencies for each benchmark. We argue that the standard deviation gives additional insight into performance portability assessment since it adds the performance variability across platforms. Additionally, we discuss the challenges to measure performance portability associated with algorithms and system software. In terms of algorithms, we need to carefully construct the benchmarks and appropriately use the concurrency available on a platform. In terms of system software, we depend on the vendor performance tools to support the desired programming model and runtime to be able to measure the metrics of interest.

GPU↗
DOE OSTI2025

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗
DOE OSTI2023

Simulating energy performance of buildings: a study using eQUEST and Energy Star ® portfolio manager

Commercial buildings consume significant energy in the United States and exhibit high potential for energy use reduction through retrofits. Benchmarking and energy simulation are well established tools in the industry to identify potential improvements and measure performance. Analysis to identify most sensitive retrofit parameters to energy performance can optimize investment and available energy savings. Presented study demonstrates methodology using a static model to determine sensitivity of building design and retrofit parameters with respect to energy performance. Calibrated simulation energy models (eQUEST) of two distribution centers (A, B) are presented. A fractional factorial analysis is conducted on retrofit parameters of efficiency measures targeting the highest energy consumers, and the results are benchmarked using Energy Star® Portfolio Manager. A custom Microsoft Excel® based simulation model is created to simulate occupancy levels, lighting, plug loads, and other equipment used in various spaces throughout the day. For Building A, efficient lighting was the most influential parameter for energy savings, carbon savings and benchmarking score; whereas, for Building B, HVAC efficiency was most influential for energy and demand controlled ventilation and economizers was most influential for benchmarking score. While retrofit projects can save energy and carbon emissions, variation in source-site ratios and state grid emissions, benchmarking scores may not always reflect equivalent improvement. State grid emissions factors, natural gas composition are difficult to model and hence not considered in this study. In conclusion, the synergistic analysis presented, emphasizes the importance of benchmarking and efficiency retrofits in promoting sustainable building practices to reduce energy consumption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Measuring magnetic fields in laser-driven coils with dual-axis proton deflectometry

Abstract By driving hot electrons between two metal plates connected by a wire loop, high power lasers can generate multi-tesla, quasi-static magnetic fields in miniature coil targets. Many experiments involving laser-coil targets rely on proton deflectometry directed perpendicular to the coil axis to extract a measurement of the magnetic field. In this paper, we show that quantitative measurements using perpendicular probing are complicated by the presence of GV m −1 electric fields in the target that develop on sub-ns timescales. Probing parallel to the coil axis with fiducial grids is shown to reliably separate the electric and magnetic field measurements, giving current estimates of I ≈ 5 kA in 1 mm- and 2 mm-diameter wire loops. An analytic model of proton deflection in electric and magnetic fields is used to benchmark results from the particle-in-cell code and help deconvolve the magnetic and electric field deflections. Results are used to motivate a new experimental scheme that combines a single-plate target with axial proton probing and direct current measurements. This scheme has several important advantages over the traditional target and diagnostic set-up, enabling the robust measurement of coil magnetic fields and plasma properties, as well as making it easier to validate different theoretical models at a range of laser intensities.

Bradford, P. (ORCID:0000000296186342)↗
DOE OSTI2025

Development, validation, and verification of multi-pass thermo-mechanical welding simulations using the open-source MOOSE framework: NeT TG4 benchmark weldment

This study develops and validates a sequentially coupled thermo-mechanical welding simulation for the three-pass 316L stainless steel NeT TG4 benchmark weldment using the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) and the Nuclear Engineering Material model Library (NEML). A diffused ellipsoidal heat source was calibrated against thermocouple data and weld macrographs to accurately model the fusion zone geometry and transient thermal fields. Material hardening is represented using the Lemaitre-Chaboche mixed isotropic-kinematic hardening model, while four annealing models - no annealing, single-stage at 1050 °C and 1300 °C, and two-stage at 800 °C/1300 °C - were implemented to assess the impact of annealing models on the accuracy of the predicted welding-induced plasticity, distortions, and residual stresses. The predictions were validated against experimental measurements and benchmarked against results from commercial software, demonstrating that thermo-mechanical MOOSE welding simulations achieve comparable accuracy with enhanced computational efficiency. This work highlights the potential of using open-source finite element frameworks like MOOSE for advanced manufacturing simulations.

Ji, Wendy [Australian Nuclear Science and Technolo↗
NASA NTRS2013

Using Paleo-climate Comparisons to Constrain Future Projections in CMIP5

We present a description of the theoretical framework and best practice for using the paleo-climate model component of the Coupled Model Intercomparison Project (Phase 5) (CMIP5) to constrain future projections of climate using the same models. The constraints arise from measures of skill in hindcasting paleo-climate changes from the present over 3 periods: the Last Glacial Maximum (LGM) (21 thousand years before present, ka), the mid-Holocene (MH) (6 ka) and the Last Millennium (LM) (8501850 CE). The skill measures may be used to validate robust patterns of climate change across scenarios or to distinguish between models that have differing outcomes in future scenarios. We find that the multi-model ensemble of paleo-simulations is adequate for addressing at least some of these issues. For example, selected benchmarks for the LGM and MH are correlated to the rank of future projections of precipitationtemperature or sea ice extent to indicate that models that produce the best agreement with paleoclimate information give demonstrably different future results than the rest of the models. We also find that some comparisons, for instance associated with model variability, are strongly dependent on uncertain forcing timeseries, or show time dependent behaviour, making direct inferences for the future problematic. Overall, we demonstrate that there is a strong potential for the paleo-climate simulations to help inform the future projections and urge all the modeling groups to complete this subset of the CMIP5 runs.

paleoclimate↗
DOE OSTI2024

Predicting RNA structure and dynamics with deep learning and solution scattering

Advanced deep learning and statistical methods can predict structural models for RNA molecules. However, RNAs are flexible, and it remains difficult to describe their macromolecular conformations in solutions where varying conditions can induce conformational changes. Small-angle x-ray scattering (SAXS) in solution is an efficient technique to validate structural predictions by comparing the experimental SAXS profile with those calculated from predicted structures. There are two main challenges in comparing SAXS profiles to RNA structures: the absence of cations essential for stability and charge neutralization in predicted structures and the inadequacy of a single structure to represent RNA’s conformational plasticity. We introduce a solution conformation predictor for RNA (SCOPER) to address these challenges. This pipeline integrates kinematics-based conformational sampling with the innovative deep learning model, IonNet, designed for predicting Mg 2+ ion binding sites. Validated through benchmarking against 14 experimental data sets, SCOPER significantly improved the quality of SAXS profile fits by including Mg 2+ ions and sampling of conformational plasticity. We observe that an increased content of monovalent and bivalent ions leads to decreased RNA plasticity. Therefore, carefully adjusting the plasticity and ion density is crucial to avoid overfitting experimental SAXS data. SCOPER is an efficient tool for accurately validating the solution state of RNAs given an initial, sufficiently accurate structure and provides the corrected atomistic model, including ions.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2000

GCSS Cirrus Parcel Model Comparison Project

The Cirrus Parcel Model Comparison Project, a project of GCSS Working Group on Cirrus Cloud Systems (WG2), involves the systematic comparison of current models of ice crystal nucleation and growth for specified, typical, cirrus cloud environments. The goal of this project is to document and understand the factors resulting in significant inter-model differences. The intent is to foment research leading to model improvement and validation. In Phase 1 of the project reported here, simulated cirrus cloud microphysical properties are compared for situations of "warm" (-40 C) and "cold" (-60 C) cirrus subject to updrafts of 4, 20 and 100 cm/s, respectively. Five models participated. These models employ explicit microphysical schemes wherein the size distribution of each class of particles (aerosols and ice crystals) is resolved into bins. Simulations are made including both homogeneous and heterogeneous ice nucleation mechanisms. A single initial aerosol population of sulfuric acid particles is prescribed for all simulations. To isolate the treatment of the homogeneous freezing (of haze drops) nucleation process, the heterogeneous nucleation mechanism is disabled for a second parallel set of simulations. Qualitative agreement is found for the homogeneous-nucleation-only simulations, e.g., the number density of nucleated ice crystals increases with the strength of the prescribed updraft. However, non-negligible quantitative differences are found. Detailed analysis reveals that the homogeneous nucleation formulation, aerosol size, ice crystal growth rate (particularly the deposition coefficient), and water vapor uptake rate are critical components that lead to differences in predicted microphysics. Systematic bias exists between results based on a modified classical theory approach and models using an effective freezing temperature approach to the treatment of nucleation. Each approach is constrained by critical freezing data from laboratory studies, but each includes assumptions that can only be justified by further laboratory data. Consequently, it is not yet clear if the two approaches can be made consistent. Large haze particles may deviate considerably from equilibrium size in moderate to strong updrafts (20-100 cm/s) at -60 C when the commonly invoked equilibrium assumption is lifted. The resulting difference in particle-size-dependent solution concentration of haze particles may significantly affect the ice nucleation rate during the initial nucleation interval. The uptake rate for water vapor excess by ice crystals is another key component regulating the total number of nucleated ice crystals. This rate, the product of ice number concentration and ice crystal diffusional growth rate, which is sensitive to the deposition coefficient when ice particles are small, partially controls the peak nucleation rate achieved in an air parcel and the duration of the active nucleation time period. The effects of heterogeneous nucleation are most pronounced in weak updraft situations. Vapor competition by the nucleated (heterogeneous) ice crystals limits the achieved ice supersaturation and thus suppresses the contribution of homogeneous nucleation. Correspondingly, ice crystal number density is markedly reduced. Definitive laboratory and atmospheric benchmark data are needed for the heterogeneous nucleation process. Inter-model differences are correspondingly greater than in the case of the homogeneous nucleation process acting alone.

Lin, Ruei-Fong↗
NASA NTRS2022

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.

Hydrology↗