Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Comprehensive framework for data-driven model form discovery of the closure laws in thermal-hydraulics codes

The two-phase two-fluid model is a basis of many thermal-hydraulics codes used in design, licensing, and safety considerations of nuclear power plants. Thermal-hydraulics codes rely on the closure laws to close the system of conservation equations and describe the interactions between phases. These laws, derived from years of experimental investigations, are semi-empirical correlations that lack generality and have a limited range of applicability. Increase of computational power, availability of new experiments, and development of high-fidelity simulations has increased the number of validation data. The discrepancies between the code predictions and the validation data are a great source of knowledge. Missing physics that are not included in the model but are important for the considered phenomena can be discovered by propagating the information from the experimental results through the model. Furthermore, physics-discovered data-driven model form (P3DM) methodology integrates available integral effect tests and separate effects tests to determine the necessary corrections to the model form of the closure laws. In contrast to existing calibration techniques, the methodology modifies the functional form of the closure laws. Based on the functional form of the correction, the missing physics that were not included in the original model can be discovered. The methodology provides the alternative to the machine learning approach, in which the model is discovered in the form of the intractable black-box relation. In this work, the methodology was applied to the CTF subchannel code to improve the prediction of the two-phase flow phenomena.

42 ENGINEERING↗
DOE OSTI2023

Battery state-of-health diagnostics during fast cycling using physics-informed deep-learning

Rapid, in-situ Li-ion battery state-of-health (SOH) quantification is challenging. Li-ion battery aging can vary significantly with chemistry, operating conditions, cycling demands, electrode design, and operation history. As a cell ages, optimal and safe operating conditions need to be adapted to account for battery degradation by tracking critical aging modes such as loss-of-lithium-inventory (LLI), loss-of-active-material (LAM) in either electrode, and/or impedance rise. This manuscript describes a framework for identifying battery aging modes in-operando using fast-rate voltage charge/discharge responses. The framework uses a physically based Li-ion battery model to produce synthetic high-rate responses at aged states. The aging model is calibrated against experimental data from cells with different electrode loadings and cycled under a variety of fast-charging conditions (1 h, 15 min, 10 min, and 7 min charging). The synthetically generated high-rate responses at aged states are then used to train a deep-learning model to identify real cell state-of-health from fast charge/discharge battery voltage responses. The synthetically trained deep-learning model performance is validated by comparing to standard incremental capacity analysis and half-cell measurements. Finally, the framework demonstrates the benefits of using high-rate physics-based models to generate synthetic data for training deep-learning models.

25 ENERGY STORAGE↗
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
DOE OSTI2021

Circuit Analysis of Ionizing Surface Potential Measurements of Electrolyte Solutions

Surface potential measurement values of the gas-liquid interface can be ambiguous despite the numerous electrochemical approaches used for quantification of the reported values. Calibration and normalization methods are not standardized, which often undermines the robustness of the reported values. Surface potential instrumentation and data interpretation also varies significantly across literature. Here, we propose a circuit model for an ionizing surface potential method based on the alpha decay of a radioactive americium-241 electrode. We evaluate the robustness of the circuit model for quantifying the surface potential at the air-aqueous interface. We then show successful validation of our circuit model through determination of the surface tension of the air-electrolyte interface with comparison to respective surface tension literature values. This validation reveals the reliability of surface potential measurements using the americium-241 ionizing method. We also report the surface potential difference of the air/water interface to be –0.49 V ± 0.01 V consistent with hydrogens of water pointing toward the air phase.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Real-Twin

Real-Twin is a unified, model-agnostic scenario generation tool designed to streamline and standardize the evaluation of emerging mobility technologies. It provides an end-to-end framework that includes robust workflows, integrated tools, and comprehensive metrics to generate, calibrate, and benchmark microscopic traffic simulation scenarios across multiple platforms. Key Features of Real-Twin include: - Unified Scenario Generation: generate transferable, simulation-ready scenarios from heterogeneous data sources using a consistent workflow. - Automated Calibration Workflow: bridges simulation and real-world data, minimizing manual effort and making traffic simulation more accessible to researchers and engineers. - Model-Agnostic Compatibility: supports SUMO, VISSIM, and AIMSUN for cross-platform scenario generation and benchmarking. Enables reliable comparisons and reproducibility across different simulation tools. - Consistent Scenarios across Different Simulators: generate comparable simulation scenarios across different microscopic traffic simulators, providing users the ability to conduct benchmarking and cross-validation that are crucial for ensuring the reliability and reproducibility of simulation results. - Emerging Technology Support: includes a scenario database and pipeline for studying autonomous vehicles (AVs), with planned extensions to CAVs, EVs, and other advanced technologies.

Wang, Chieh (Ross) [Oak Ridge National Laboratory ↗
DOE OSTI2020

Validation and Sensitivity Analysis of a 1-D Lake Model Across Global Lakes

Lakes have important influence on weather and climate from local to global scales. However, their prediction using numerical models is notoriously difficult because lakes are highly heterogeneous across the globe, but observations are sparse. In this study, we assessed the performance of a 1-D lake model in simulating the thermal structures of 58 lakes with diverse morphometric and geographic characteristics by following the phase 2a local lake protocol of the Inter-sectoral Impact Model Intercomparison Project (ISIMIP2a). After calibration, the root-mean-square errors (RMSE) were below 2 °C for 70% and 75% of the lakes for epilimnion and full-profile temperature simulations, with an average of 1.71 °C and 1.43 °C, respectively. The model performance mainly depended on lake shape rather than location, supporting the possibility of grouping model parameters by lake shape for global applications. Furthermore, through machine-learning based parameter sensitivity tests, we identified turbulent heat fluxes, wind-driven mixing and water transparency as the major processes controlling lake thermal and mixing regimes. Snow density was also important for modeling the ice phenology of high-latitude lakes. The relative influence of the key processes and the corresponding parameters mainly depended on lake latitude and depth. Turbulent heat fluxes showed a decreasing importance in affecting epilimnion temperature with increasing latitude. Wind-driven mixing was less influential to lake stratification for deeper lakes while the impact of light extinction, on the contrary, showed a positive correlation with depth. Our findings may guide improvements in 1-D lake model parameterizations to achieve higher fidelity in simulating global lake thermal dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗
DOE OSTI2024

The SRG/eROSITA All-Sky Survey: Dark Energy Survey year 3 weak gravitational lensing by eRASS1 selected galaxy clusters

Context. Number counts of galaxy clusters across redshift are a powerful cosmological probe if a precise and accurate reconstruction of the underlying mass distribution is performed – a challenge called mass calibration. With the advent of wide and deep photometric surveys, weak gravitational lensing (WL) by clusters has become the method of choice for this measurement. Aims. We measured and validated the WL signature in the shape of galaxies observed in the first three years of the Dark Energy Survey (DES Y3) caused by galaxy clusters and groups selected in the first all-sky survey performed by SRG (Spectrum Roentgen Gamma)/eROSITA (eRASS1). These data were then used to determine the scaling between the X-ray photon count rate of the clusters and their halo mass and redshift. Methods. We empirically determined the degree of cluster member contamination in our background source sample. The individual cluster shear profiles were then analyzed with a Bayesian population model that self-consistently accounts for the lens sample selection and contamination and includes marginalization over a host of instrumental and astrophysical systematics. To quantify the accuracy of the mass extraction of that model, we performed mass measurements on mock cluster catalogs with realistic synthetic shear profiles. This allowed us to establish that hydrodynamical modeling uncertainties at low lens redshifts (z < 0.6) are the dominant systematic limitation. At high lens redshift, the uncertainties of the sources’ photometric redshift calibration dominate. Results. With regard to the X-ray count rate to halo mass relation, we determined its amplitude, its mass trend, the redshift evolution of the mass trend, the deviation from self-similar redshift evolution, and the intrinsic scatter around this relation. Conclusions. The mass calibration analysis performed here sets the stage for a joint analysis with the number counts of eRASS1 clusters to constrain a host of cosmological parameters. We demonstrate that WL mass calibration of galaxy clusters can be performed successfully with source galaxies whose calibration was performed primarily for cosmic shear experiments, opening the way for the cluster cosmological exploitation of future optical and NIR surveys like Euclid and LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Modeling the interfacial failure and resulting mechanical properties of z-pinned additively manufactured composites

The mechanical properties of Fused Filament Fabrication (FFF) parts are limited in the build direction, albeit advantages such as design flexibility and in-house customization. Here, in this paper, a novel z-pinning approach that enhances mechanical properties in the build direction by depositing material across multiple layers within the part was investigated through numerical simulations and validated experimentally. A finite element model for z-pinned composite structures was developed by assigning fiber-orientation dependent material properties obtained using a micromechanics approach to beads and pins. The bead-to-bead and pin-to-pin adhesions within the z-pinned structures were modeled using a cohesive traction separation law. The properties of cohesive elements for carbon fiber-reinforced polylactic acid (CF-PLA) z-pinned composites were calibrated using tensile experiments. The elastic modulus and tensile strength of CF-PLA z-pinned composites in the build direction were predicted with the developed numerical model. The numerical investigation on various geometrical parameters revealed that the largest pin volume increases the stiffness and tensile strength by 40% and thus, has the greatest influence on the mechanical properties of the z-pinned composites. The effect of z-pin geometrical parameters on the mechanical properties was summarized to aid in the design of z-pinned additively manufactured composite structures.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Fragmentation analysis of a bar with the Lip-field approach

The Lip-field approach was introduced in Moës and Chevaugeon (2021) as a new way to regularize softening material models. It was tested in 1D quasistatic in Moës and Chevaugeon (2021) and 2D quasistatic in Chevaugeon and Moës (2021): this paper extends it to 1D dynamics, on the challenging problem of dynamic fragmentation. The Lip-field approach formulates the mechanical problem to be solved as an optimization problem, where the incremental potential to be minimized is the non-regularized one. Spurious localization is prevented by imposing a Lipschitz constraint on the damage field. Here, the displacement and damage field at each time step are obtained by a staggered algorithm, that is the displacement field is computed for a fixed damage field, then the damage field is computed for a fixed displacement field. Indeed, these two problems are convex, which is not the case of the global problem where the displacement and damage fields are sought at the same time. The incremental potential is obtained by equivalence with a cohesive zone model, which makes material parameters calibration simple. A non-regularized local damage equivalent to a cohesive zone model is also proposed. It is used as a reference for the Lip-field approach, without the need to implement displacement jumps. These approaches are applied to the brittle fragmentation of a 1D bar with randomly perturbed material properties to accelerate spatial convergence. Both explicit and implicit dynamic implementations are compared. Favorable comparison to several analytical, numerical and experimental references serves to validate the modeling approach.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Robust Neural Network for Extracting Dynamics from Electrostatic Force Microscopy Data

Advances in scanning probe microscopy (SPM) methods such as time-resolved electrostatic force microscopy (trEFM) now permit the mapping of fast local dynamic processes with high resolution in both space and time, but such methods can be time-consuming to analyze and calibrate. Here, we design and train a regression neural network (NN) that accelerates and simplifies the extraction of local dynamics from SPM data directly in a cantilever-independent manner, allowing the network to process data taken with different cantilevers. We validate the NN’s ability to recover local dynamics with a fidelity equal to or surpassing conventional, more time-consuming, calibrations using both simulated and real microscopy data. We apply this method to extract accurate photoinduced carrier dynamics on n = 1 butylammonium lead iodide, a halide perovskite semiconductor film that is of interest for applications in both solar photovoltaics and quantum light sources. Lastly, we use SHapley Additive exPlanations to evaluate the robustness of the trained model, confirm its cantilever-independence, and explore which parts of the trEFM signal are important to the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Experimental methods for laboratory measurements of helium spectral line broadening in white dwarf photospheres

White Dwarf (WD) stars are the most common stellar remnant in the universe. WDs usually have a hydrogen or helium atmosphere, and helium WD (called DB) spectra can be used to solve outstanding problems in stellar and galactic evolution. DB origins, which are still a mystery, must be known to solve these problems. DB masses are crucial for discriminating between different proposed DB evolutionary hypotheses. Current DB mass determination methods deliver conflicting results. The spectroscopic mass determination method relies on line broadening models that have not been validated at DB atmosphere conditions. We performed helium benchmark experiments using the White Dwarf Photosphere Experiment (WDPE) platform at Sandia National Laboratories' Z-machine that aims to study He line broadening at DB conditions. Using hydrogen/helium mixture plasmas allows investigating the importance of He Stark and van der Waals broadening simultaneously. Accurate experimental data reduction methods are essential to test these line-broadening theories. In this paper, we present data calibration methods for these benchmark He line shape experiments. We give a detailed account of data processing, spectral power calibrations, and instrument broadening measurements. Uncertainties for each data calibration step are also derived. We demonstrate that our experiments meet all benchmark experiment accuracy requirements: WDPE wavelength uncertainties are <1 Å, spectral powers can be determined to within 15%, densities are accurate at the 20% level, and instrumental broadening can be measured with 20% accuracy. Fulfilling these stringent requirements enables WDPE experimental data to provide physically meaningful conclusions about line broadening at DB conditions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Building a machine learning surrogate model for wildfire activities within a global Earth system model

Abstract. Wildfire is an important ecosystem process, influencing land biogeophysical and biogeochemical dynamics and atmospheric composition. Fire-driven loss of vegetation cover, for example, directly modifies the surface energy budget as a consequence of changing albedo, surface roughness, and partitioning of sensible and latent heat fluxes. Carbon dioxide and methane emitted by fires contribute to a positive atmospheric forcing, whereas emissions of carbonaceous aerosols may contribute to surface cooling. Process-based modeling of wildfires in Earth system land models is challenging due to limited understanding of human, climate, and ecosystem controls on fire counts, fire size, and burned area. Integration of mechanistic wildfire models within Earth system models requires careful parameter calibration, which is computationally expensive and subject to equifinality. To explore alternative approaches, we present a deep neural network (DNN) scheme that surrogates the process-based wildfire model with the Energy Exascale Earth System Model (E3SM) interface. The DNN wildfire model accurately simulates observed burned area with over 90 % higher accuracy with a large reduction in parameterization time compared with the current process-based wildfire model. The surrogate wildfire model successfully captured the observed monthly regional burned area during validation period 2011 to 2015 (coefficient of determination, R2=0.93). Since the DNN wildfire model has the same input and output requirements as the E3SM process-based wildfire model, our results demonstrate the applicability of machine learning for high accuracy and efficient large-scale land model development and predictions.

58 GEOSCIENCES↗
DOE OSTI2023

Optimization of the number and locations of the calibration stations needed to monitor soil moisture using distributed temperature sensing systems: A proof-of-concept study

The single-probe heat-pulse (SPHP) technique combined with the Fiber-optic Distributed Temperature Sensing (DTS) technology can offer novel high-resolution measurements of soil moisture (θ) over spatial scales ranging from several centimeters to several kilometers. However, the key limitation of this method is in obtaining the calibration relationship between θ and soil thermal conductivity (λ) across a specific field. In a previous study, a new methodology using a Gaussian processes model was presented to account for the spatial variability in the λ-θ relationship. The model aggregated θ measurements from soil moisture sensors scattered over the SPHP transect with the corresponding DTS λ measurements at their locations. In this study, a novel methodology is tested to optimize the number and locations of soil moisture sensors required to account for the spatial variability of the λ - θ relationship to achieve higher accuracy from the SPHP technique. The proposed methodology utilizes hierarchical clustering to analyze the information contained in the spatial structure of the SPHP measurements as the soil dries from a nearly-saturated condition. The proposed methodology was tested using data from a field in Oklahoma. Monte-Carlo simulation was performed to validate the performance of the proposed methodology. The predictions obtained from the proposed methodology resulted in θ measurements accuracy comparable to those obtained from the 10% best Monte-Carlo iterations of randomly assigned soil moisture locations. Further, this study demonstrates that the proposed methodology is more efficient than the traditional practice of randomly spreading calibration soil moisture sensors along the SPHP transect.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Adaptive Client Selection in Federated Learning: A Network Anomaly Detection Use Case

Federated Learning (FL) has become a ubiquitous approach for training machine learning models on decentralized data, addressing the myriad privacy concerns inherent in traditional centralized methods. However, the efficiency of FL depends on effective client selection and robust privacy preservation mechanisms. Inadequate client selection may lead to suboptimal model performance, while insufficient privacy measures risk exposing sensitive data. This paper proposes a client selection framework for FL that integrates differential privacy and fault tolerance. Our adaptive approach dynamically adjusts the number of selected clients based on model performance and system constraints, ensuring privacy through calibrated noise addition. We evaluate our method on a network anomaly detection use case using the UNSW-NB15 and ROAD datasets. Results show up to a 7% increase in accuracy and a 25% reduction in training time compared to FedL2P. Moreover, we highlight the trade-offs between privacy budgets and model performance, with higher privacy budgets reducing noise and improving accuracy. Our fault tolerance mechanism, while causing a slight performance drop, enhances robustness to client failures. Statistical validation using Mann-Whitney U tests confirms the significance of these improvements (p < 0.05).

Marfo, William [University of Texas at El Paso,Dep↗
DOE OSTI2026

Dark Energy Survey Year 6 Results: Galaxy-galaxy lensing

We present galaxy--galaxy lensing (GGL) measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering $4031\,\mathrm{deg}^2$ and used in the DES Y6 $3\times2$pt cosmological analysis. We use the MagLim++ lens sample, containing $\sim 9$ million galaxies divided into six redshift bins, and the Metadetection source catalog, including $\sim 140$ million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of $173$, corresponding to a $17\%$ improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with $R_{\min}=6\,\mathrm{Mpc}/h$ ($4\,\mathrm{Mpc}/h$) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to $75$ (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high--signal-to-noise geometric shear-ratio measurements from the galaxy--galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the $3\times2$pt analysis.

Giannini, G. [Barcelona, IEEC; Chicago U., KICP; B↗
DOE OSTI2026

Adaptive spectra-to-exposure conversion using ridge regularized polynomial response models

Real-time gamma spectra-to-exposure conversion in aerial and ground monitoring commonly relies on calibration-derived, detector- or system-specific conversion coefficients that are assumed to generalize across operational environments. In practice, deployment specific differences in spectral composition and transport conditions can introduce systematic bias relative to reference instruments, motivating methods that adapt coefficients using minimal field supervision while explicitly limiting overfitting. In this work, we present a conservative coefficient adaptation framework that updates a baseline polynomial energy-weighting function using ridge-regularized regression, with leave-one-out cross-validation (LOOCV) used to select the regularization strength. The findings support ridge-constrained minimal-supervision adaptation as a practical mechanism to suppress site-specific bias without destabilizing a calibration-derived baseline.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2026

Dark Energy Survey Year 6 results: Galaxy-galaxy lensing

Here, we present galaxy-galaxy lensing measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering 4031 deg 2 and used in the DES Y6 3×2 pt cosmological analysis. We use the Maglim++ lens sample, containing ∼9 million galaxies divided into six redshift bins, and the Metadetection source catalog, including ∼140 million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of 173, corresponding to a 17% improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with 𝑅 min =6 Mpc/ℎ (4 Mpc/ℎ) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to 75 (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high signal-to-noise geometric shear-ratio measurements from the galaxy-galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the 3 ×2 pt analysis.

cosmological parameters↗