Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

A Logarithmic Bayesian Approach to Quantum Error Detection

We consider the problem of continuous quantum error correction from a Bayesian perspective, proposing a pair of digital filters using logarithmic probabilities that are able to achieve near-optimal performance on a three-qubit bit-flip code, while still being reasonable to implement on low-latency hardware. These practical filters are approximations of an optimal filter that we derive explicitly for finite time steps, in contrast with previous work that has relied on stochastic differential equations such as the Wonham filter. By utilizing logarithmic probabilities, we are able to eliminate the need for explicit normalization and can reduce the Gaussian noise distribution to a simple quadratic expression. The state transitions induced by the bit-flip errors are modeled using a Markov chain, which for log-probabilities must be evaluated using a LogSumExp function. We develop the two versions of our filter by constraining this LogSumExp to have either one or two inputs, which favors either simplicity or accuracy, respectively. Using simulated data, we demonstrate that the single-term and two-term filters are able to significantly outperform both a double threshold scheme and a linearized version of the Wonham filter in tests of error detection under a wide variety of error rates and time steps.

97 MATHEMATICS AND COMPUTING↗

Applications of the Dulmage–Mendelsohn decomposition for debugging nonlinear optimization problems

Nonlinear modeling and optimization is a valuable tool for aiding decisions by engineering practitioners, but programming an optimization problem based on a complex electrical, mechanical, or chemical process is a time-consuming and error-prone activity. Therefore, there is a need for model analysis and debugging tools that can detect and diagnose modeling errors. One such tool is the Dulmage–Mendelsohn decomposition, which identifies structurally under- and over-determined subsets in systems of equations and variables by partitioning the bipartite graph of the system. This work provides the necessary background to understand the Dulmage–Mendelsohn decomposition and its application to the analysis of nonlinear optimization problems, demonstrates its use in diagnosing a variety of modeling errors, and introduces software implementations for analyzing nonlinear optimization problems in the Pyomo and JuMP algebraic modeling languages.

42 ENGINEERING↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

Airborne Lidar Measurements of XCO 2 in Synoptically Active Environment and Associated Comparisons With Numerical Simulations

Frontal boundaries have been shown to cause large changes in CO 2 mole-fractions, but clouds and the complex vertical structure of fronts make these gradients difficult to observe. It remains unclear how the column average CO 2 dry air mole-fraction (XCO 2 ) changes spatially across fronts, and how well airborne lidar observations, data assimilation systems, and numerical models without assimilation capture XCO 2 frontal contrasts (ΔXCO 2 , i.e., warm minus cold sector average of XCO 2 ). We demonstrated the potential of airborne Multifunctional Fiber Laser Lidar (MFLL) measurements in heterogeneous weather conditions (i.e., frontal environment) to investigate the ΔXCO 2 during four seasonal field campaigns of the Atmospheric Carbon and Transport-America (ACT-America) mission. Most frontal cases in summer (winter) reveal higher (lower) XCO 2 in the warm (cold) sector than in the cold (warm) sector. During the transitional seasons (spring and fall), no clear signal in ΔXCO 2 was observed. Intercomparison among the MFLL, assimilated fields from NASA's Global Modeling and Assimilation Office (GMAO), and simulations from the Weather Research and Forecasting-—Chemistry (WRF-Chem) showed that (a) all products had a similar sign of ΔXCO 2 though with different levels of agreement in ΔXCO 2 magnitudes among seasons; (b) ΔXCO 2 in summer decreases with altitude; and (c) significant challenges remain in observing and simulating XCO 2 frontal contrasts. A linear regression analyses between ΔXCO 2 for MFLL versus GMAO, and MFLL versus WRF-Chem for summer-2016 cases yielded a correlation coefficient of 0.95 and 0.88, respectively. The reported ΔXCO 2 variability among four seasons provide guidance to the spatial structures of XCO 2 transport errors in models and satellite measurements of XCO 2 in synoptically-active weather systems.

54 ENVIRONMENTAL SCIENCES↗

Data-Driven Modeling and Correction of Vehicle Dynamics

We develop a data-driven framework for learning and correcting nonautonomous vehicle dynamics. Physics-based vehicle models are often simplified for tractability and therefore exhibit inherent model-form uncertainty, motivating the need for data-driven correction. Moreover, nonautonomous dynamics are governed by time-dependent control inputs, which pose challenges in learning predictive models directly from temporal snapshot data. To address these, we reformulate the vehicle dynamics via a local parameterization of the time-dependent inputs, yielding a modified system composed ofa sequence of local parametric dynamical systems. Here, we approximate these parametric systems using two complementary approaches. First, we employ the dimension reduction and interpolation in parameter space (DRIPS) methodology to construct efficient linear surrogate models, equipped with lifted observable spaces and manifold-based operator interpolation. This enables data-efficient learning of vehicle models whose dynamics admit accurate linear representations in the lifted spaces. Second, for more strongly nonlinear systems, we employ flow map learning (FML), a deep neural network (DNN) approach that approximates the parametric evolution map without requiring special treatment of nonlinearities. We further extend FML with a transfer-learning-based model correction procedure, enabling the correction of misspecified prior models using only a sparse set of high-fidelity or experimental measurements, without assuming a prescribed form for the correction term. Through a suite of numerical experiments on unicycle, simplified bicycle, and slip-based bicycle models, we demonstrate that DRIPS offers robust and highly data-efficient learning of nonautonomous vehicle dynamics, while FML provides expressive nonlinear modeling and effective correction of model-form errors under severe data scarcity.

data-driven modeling↗

The AWAKEN wind farm benchmark, Part 2: Modeling results

Accurately modeling wind farm performance in complex atmospheric flows remains a challenge. This paper presents the modeling results of the American WAKE experimeNt (AWAKEN) wind farm benchmark, a collaborative effort involving 16 research groups from academia and industry within the International Energy Agency Wind Technology Collaboration Programme Task 57. The study evaluates a diverse suite of simulation tools, ranging from fast-running engineering wake models to high-fidelity large-eddy simulations, against a diurnal case study observed during the AWAKEN campaign. The benchmark utilized a three-phase structure to progressively assess model performance as observational data availability increased. Initial blind predictions showed that higher-fidelity models did not uniformly outperform simpler simulation tools. A distinct spatial bias was observed where models struggled to resolve the interplay between a low-level jet, wakes, and terrain-induced flow acceleration. In subsequent phases, leveraging additional measurements for model improvement led to a reduction in mean absolute error across the model ensemble; however, this effect was most pronounced in engineering wake models, where targeted calibration reduced error by up to 40~\%. Overall, the study demonstrates that inflow characterization remains a primary prerequisite for accuracy, particularly for models relying on coarse forcing datasets. While the limited ability to resolve local terrain-flow interactions under single-day conditions represent a recognized constraint, the overall findings on wake modeling and real-world validation still provide valuable guidance for model application and for mitigating this limitation.

Bodini, Nicola↗

Active learning of a crystal plasticity flow rule from discrete dislocation dynamics simulations

Continuum-scale material deformation models, such as crystal plasticity (CP), can significantly enhance their predictive accuracy by incorporating input from lower-scale (i.e. mesoscale) models. The procedure to generate and extract the relevant information is however typically complex and ad hoc, involving decision and intervention by domain experts, leading to long development times. In this study, we develop a principled approach for calibration of continuum-scale models using lower scale information by representing a CP flow rule as a Gaussian process model. This representation allows for efficient parameter space exploration, guided by the uncertainty embedded in the model through a process known as Bayesian optimization (BO). We demonstrate a semi-autonomous BO loop which instantiates discrete dislocation dynamics simulations whose initial conditions are automatically chosen to optimize the uncertainty of a model CP flow rule. Our self-guided computational pipeline efficiently generated a dataset and corresponding model whose error, uncertainty, and physical feature sensitivities were validated with comparison to an independent dataset four times larger, demonstrating a valuable and efficient active learning implementation readily transferable to similar material systems.

36 MATERIALS SCIENCE↗

Subpolar North Atlantic Mean State Affects the Response of the Atlantic Meridional Overturning Circulation to the North Atlantic Oscillation in CMIP6 Models

Abstract The Atlantic meridional overturning circulation (AMOC) plays an important role in climate, transporting heat and salt to the subpolar North Atlantic. The AMOC’s variability is sensitive to atmospheric forcing, especially the North Atlantic Oscillation (NAO). Because AMOC observations are short, climate models are a valuable tool to study the AMOC’s variability. Yet, there are known issues with climate models, like uncertainties and systematic biases. To investigate this, preindustrial control experiments from models participating in the phase 6 of Coupled Model Intercomparison Project (CMIP6) are evaluated. There is a large, but correlated, spread in the models’ subpolar gyre mean surface temperature and salinity. By splitting models into groups of either a warm–salty or cold–fresh subpolar gyre, it is shown that warm–salty models have a lower sea ice cover in the Labrador Sea and, hence, enable a larger heat loss during a positive NAO. Stratification in the Labrador Sea is also weaker in warm–salty models, such that the larger NAO-related heat loss can also affect greater depths. As a result, subsurface density anomalies are much stronger in the warm–salty models than in those that tend to be cold and fresh. As these anomalies propagate southward along the western boundary, they establish a zonal density gradient anomaly that promotes a stronger delayed AMOC response to the NAO in the warm–salty models. These findings demonstrate how model mean state errors are linked across variables and affect variability, emphasizing the need for improvement of the subpolar North Atlantic mean states in models.

54 ENVIRONMENTAL SCIENCES↗

Dark Energy Survey year 3 results: point spread function modelling

ABSTRACT We introduce a new software package for modelling the point spread function (PSF) of astronomical images, called piff (PSFs In the Full FOV), which we apply to the first three years (known as Y3) of the Dark Energy Survey (DES) data. We describe the relevant details about the algorithms used by piff to model the PSF, including how the PSF model varies across the field of view (FOV). Diagnostic results show that the systematic errors from the PSF modelling are very small over the range of scales that are important for the DES Y3 weak lensing analysis. In particular, the systematic errors from the PSF modelling are significantly smaller than the corresponding results from the DES year one (Y1) analysis. We also briefly describe some planned improvements to piff that we expect to further reduce the modelling errors in future analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

Reduced Order Modeling conditioned on monitored features for response and error bounds estimation in engineered systems

Reduced Order Models (ROMs) form essential tools across engineering domains by virtue of their function as surrogates for computationally intensive digital twinning simulators. Although purely data-driven methods are available for ROM construction, schemes that allow to retain a portion of the physics tend to enhance the interpretability and generalization of ROMs. However, physics-based techniques can adversely scale when dealing with nonlinear systems that feature parametric dependencies. This study introduces a generative physics-based ROM that is suited for nonlinear systems with parametric dependencies and is additionally able to provide numerical error bounds associated with the respective estimates. A main contribution of this work is the conditioning of these parametric ROMs to features that can be derived from monitoring measurements, feasibly in an online fashion. This is contrary to most existing ROM schemes, which remain restricted to the prescription of the physics-based, and usually a priori unknown, system parameters. Our work utilizes conditional Variational Autoencoders to continuously map the required reduction bases to a feature vector extracted from limited output measurements, while additionally allowing for a probabilistic assessment of the ROM-estimated Quantities of Interest. An auxiliary task using a neural network-based parametrization of suitable probability distributions is introduced to re-establish the link with physical model parameters. We verify the proposed scheme on a series of simulated case studies incorporating effects of geometric and material nonlinearity under parametric dependencies related to system properties and input load characteristics.

Conditional VAEs↗

Artificial intelligence driven laser parameter search: Inverse design of photonic surfaces using greedy surrogate-based optimization

Photonic surfaces designed with specific optical characteristics are becoming increasingly crucial for novel energy harvesting and storage systems. The design of these surfaces can be achieved by texturing materials using lasers. The optimal adjustment of laser fabrication parameters to achieve target surface optical properties is an open challenge. Thus, we develop a surrogate-based optimization approach. Our framework employs the Random Forest algorithm to model the forward relationship between the laser fabrication parameters and the resulting optical characteristics. During the optimization process, we use a greedy, prediction-based exploration strategy that iteratively selects batches of laser parameters to be used in experimentation by minimizing the predicted discrepancy between the surrogate model’s outputs and the user-defined target optical characteristics. This strategy allows for efficient identification of optimal fabrication parameters without the need to model the error landscape directly. We demonstrate the efficiency and effectiveness of our approach on two synthetic benchmarks and two specific experimental applications of photonic surface inverse design targets. By calculating the average performance of our algorithm compared to other state of the art optimization methods, we show that our algorithm performs, on average, twice as well across all benchmarks. Additionally, a warm starting inverse design technique for changed target optical characteristics enhances the performance of the introduced approach.

97 MATHEMATICS AND COMPUTING↗

Dominant balance-based adaptive mesh refinement for incompressible fluid flows

This work introduces a novel adaptive mesh refinement (AMR) method that utilizes dominant balance analysis (DBA) for efficient and accurate grid adaptation in computational fluid dynamics (CFD) simulations. The proposed method leverages a Gaussian mixture model (GMM) to classify grid cells into active and passive regions based on the dominant physical interactions within the equation space. By modeling truncation error probabilistically from discretized terms, the method identifies regions of high interaction where numerical accuracy is most sensitive to resolution. Unlike traditional AMR strategies, this approach does not rely on heuristic-based sensors or user-defined thresholds, providing a fully automated and problem-independent framework for AMR. Applied to the incompressible Navier-Stokes equations for steady and unsteady flow past a cylinder, the DBA-based AMR method achieves comparable accuracy to high-resolution grids while reducing computational costs by up to 70 %. The validation highlights the method’s effectiveness in capturing complex flow features while minimizing grid cells, directing computational resources toward regions with the most critical dynamics. This modular and scalable strategy is adaptable to a wide range of applications, presenting a promising tool for efficient high-fidelity simulations in CFD and other multiphysics domains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimizing lossy state preparation for quantum sensing using Hamiltonian engineering

One of the most prominent platforms for demonstrating quantum sensing below the standard quantum limit is the spinor Bose–Einstein condensate. While a quantum advantage using several tens of thousands of atoms has been demonstrated in this platform, it faces an important challenge: atom loss. Atom loss is a Markovian error process modeled by Lindblad jump operators, and a no-go theorem, which we also show here, states that the loss of atoms in all spin components reduces the quantum advantage to a constant factor. Here, we show that this no-go theorem can be circumvented if we constrain atom losses to a single spin component. Moreover, we show that in this case, the maximum quantum Fisher information with N atoms scales as N 3/2 , establishing that a scalable quantum advantage can be achieved despite atom loss. Although Lindblad jump operators are generally non-Hermitian and non-invertible, we use their Moore–Penrose inverse to develop a framework for constructing several states with this scaling of Fisher information in the presence of losses. We use Hamiltonian engineering with realistic Hamiltonians to develop experimental protocols for preparing these states. Finally, we discuss possible experimental techniques to constrain the losses to a single spin mode.

74 ATOMIC AND MOLECULAR PHYSICS↗

Atomic masses with machine learning for the astrophysical r process

The astrophysical r process plays a vital role in the production of heavy elements. Modeling of the r process is sensitive to masses and further requires knowledge of masses beyond current experimental reach. Therefore, simulations of the r process offer a unique test bed for predicting mass extrapolations. We take a Machine-Learning (ML) approach to model the masses across the entire chart of nuclides. For the first time, we simulate r-process nucleosynthesis with a physics-based ML mass model. We compare simulated abundances to solar data in order to evaluate the model's performance far from stability. The resulting r-process abundances up to thorium and uranium qualitatively match those of the observed solar system abundance pattern, with the characteristic peaks well positioned. We propagate the mass uncertainties obtained from the ML model to r-process abundance yields to estimate an uncertainty band associated with our approach. The size of the uncertainty band is approximately one order of magnitude which aligns with the uncertainty reported using alternative techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Kβ X-ray Emission Spectra Analysis Using Bayesian Optimization

The Kβ X-ray emission spectrum of 3 d transition metals is rich with electronic and structural information due to strong exchange interactions with the valence shell of the metal, and has become crucial for understanding their spin and oxidation states. The spectrum is commonly treated using crystal-field multiplet theory, a semi-empirical theory that uses tunable parameters to control the strength of the effects present in X-ray emission spectroscopy (XES). However, determining the experimental values of these parameters remains a challenge. We present a methodology that applies Bayesian optimization to crystal-field multiplet theory to determine parameter values. The algorithm is tested on the X-ray emission spectra of a collection of Mn, Co, and Ni oxides. We are able to find optimal values for the four most impactful parameters: Slater−Condon reduction factors F dd , F pd , and G pd , and crystal field splitting 10 Dq . The algorithm produces significantly improved accuracy compared to current analysis methods, and probes interparameter dependencies by modeling the error landscape. This advancement enhances XES analysis by offering an approach of obtaining quantitative electronic structural information on 3 d transition metal valence shells, facilitating applications across various scientific fields.

Bayesian optimization↗

Relating CMIP5 Model Biases to Seasonal Forecast Skill in the Tropical Pacific

Abstract We examine links between tropical Pacific mean state biases and El Niño/Southern Oscillation forecast skill, using model‐analog hindcasts of sea surface temperature (SST; 1961–2015) and precipitation (1979–2015) at leads of 0–12 months, generated by 28 different models from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Model‐analog forecast skill has been demonstrated to match or even exceed traditional assimilation‐initialized forecast skill in a given model. Models with the most realistic mean states and interannual variability for SST, precipitation, and 10‐m zonal winds in the equatorial Pacific also generate the most skillful precipitation forecasts in the central equatorial Pacific and the best SST forecasts at 6‐month or longer leads. These results show direct links between model climatological biases and seasonal forecast errors, demonstrating that model‐analog hindcast skill—that is, how well a model can capture the observed evolution of tropical Pacific anomalies—is an informative El Niño/Southern Oscillation metric for climate simulations.

Ding, Hui↗

A database of hourly wind speed and modeled generation for US wind plants based on three meteorological models

Abstract In 2022, wind generation accounted for ~10% of total electricity generation in the United States. As wind energy accounts for a greater portion of total energy, understanding geographic and temporal variation in wind generation is key to many planning, operational, and research questions. However, in-situ observations of wind speed are expensive to make and rarely shared publicly. Meteorological models are commonly used to estimate wind speeds, but vary in quality and are often challenging to access and interpret. The Plant-Level US multi-model WIND and generation (PLUSWIND) data repository helps to address these challenges. PLUSWIND provides wind speeds and estimated generation on an hourly basis at almost all wind plants across the contiguous United States from 2018–2021. The repository contains wind speeds and generation based on three different meteorological models: ERA5, MERRA2, and HRRR. Data are publicly accessible in simple csv files. Modeled generation is compared to regional and plant records, which highlights model biases and errors and how they differ by model, across regions, and across time frames.

17 WIND ENERGY↗

Curiosity driven exploration to optimize structure–property learning in microscopy

Rapidly determining structure–property correlations in materials is an important challenge in better understanding fundamental mechanisms and greatly assists in materials design. In microscopy, imaging data provides a direct measurement of the local structure, while spectroscopic measurements provide relevant functional property information. Deep kernel active learning approaches have been utilized to rapidly map local structure to functional properties in microscopy experiments, but are computationally expensive for multi-dimensional and correlated output spaces. Here, we present an alternative lightweight curiosity algorithm which actively samples regions with unexplored structure–property relations, utilizing a deep-learning based surrogate model for error prediction. We show that the algorithm outperforms random sampling for predicting properties from structures, and provides a convenient tool for efficient mapping of structure–property relationships in materials science.

36 MATERIALS SCIENCE↗