A characterization of soft-error sensitivity in data-parallel and model-parallel distributed deep learning
Not provided.
Computer Science↗
SEARCH · Engineering Papers
Results for “Model error”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Validation of URANS and STRUCT-ε turbulence models for stratified sodium flow
Simulations of a transient stratified sodium experiment are carried out using a classic unsteady RANS model and the second-generation URANS model, STRUCT-ε. Turbulence modeling challenges and their implications to stratified flow prediction are discussed in the context of other sources of error. Input errors are discussed and addressed; discretization error is calculated to be less than 5% of the inlet velocity, for 80% of the domain; and remaining errors in temperature distributions are attributed to the turbulence model. Qualitative flow features from the simulations are presented and discussed. Compared to the experiment, the STRUCT-ε turbulence model provides a more physically accurate prediction of temperature and momentum mixing in key regions of the domain. Quantitative measures such as the L 2 norm of the temperature discrepancy demonstrate the improved performance of the STRUCT-ε approach. In conclusion, the magnitude of the temperature fluctuations is very well-predicted by the STRUCT-ε, while URANS overpredicts them by approximately 50%.
42 ENGINEERING↗
Using DAPPER to extract the photon strength function of 58 Fe using the inverse Oslo and shape methods
The photon strength function of 58 Fe has been extracted using both the Oslo and Shape methods from particle–γ coincidence data measured using the Detector Array for Photons, Protons, and Exotic Residues, which probes nuclei utilizing (d,p) reactions in inverse kinematics. Four particle–γ coincidence matrices, each constructed with different treatments of the γ–ray energies, are explored in order to observe the impact on the resulting nuclear level density and photon strength. The final photon strength function reported is found to agree well with previous Oslo measurements of other iron isotopes. Systematic uncertainties are included, using different model parameters and their reported errors to perform the Oslo method normalization. The model-independent Shape method is explored and the functional form of the photon strength function obtained is in agreement with the Oslo method results. A low-energy enhancement is not reported for 58 Fe in this work given possible subtraction issues originating from strongly populated states.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Study of the agreement between binary neutron star ejecta models derived from numerical relativity simulations
Neutron star mergers have recently become a tool to study extreme gravity, nucleosynthesis, and the chemical composition of the Universe. To date, there has been one joint gravitational and electromagnetic observation of a binary neutron star merger, GW170817, as well as a solely gravitational observation, GW190425. In order to accurately identify and interpret electromagnetic signals of neutron star mergers, better models of the matter outflows generated by these mergers are required. We compare a series of ejecta models to see where they provide strong constraints on the amount of ejected mass expected from a system, and where systematic uncertainties in current models prevent us from reliably extracting information from observed events. We also examine 2396 neutron star equations of state compatible with GW170817 to see whether a given ejecta mass could be reasonably produced with a neutron star of said equation of state, and whether different ejecta models provide consistent predictions. We find that the difference between models is often comparable to or larger than the error generally assumed for these models, implying better constraints on the models are needed. In conclusion, we also note that the extrapolation of outflow models outside of their calibration window, while commonly needed to analyze gravitational wave events, is extremely unreliable and occasionally leads to completely unphysical results.
79 ASTRONOMY AND ASTROPHYSICS↗
Using DAPPER to extract the photon strength function of 58Fe using the inverse Oslo and shape methods
The photon strength function of 58 Fe has been extracted using both the Oslo and Shape methods from particle-γ coincidence data measured using the Detector Array for Photons, Protons, and Exotic Residues, which probes nuclei utilizing (d,p) reactions in inverse kinematics. Four particle-γ coincidence matrices, each constructed with different treatments of the γ-ray energies, are explored in order to observe the impact on the resulting nuclear level density and photon strength. The final photon strength function reported is found to agree well with previous Oslo measurements of other iron isotopes. Systematic uncertainties are included, using different model parameters and their reported errors to perform the Oslo method normalization. The model-independent Shape method is explored and the functional form of the photon strength function obtained is in agreement with the Oslo method results. A low-energy enhancement is not reported for 58 Fe in this work given possible subtraction issues originating from strongly populated states.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Comparative Performance of Gaussian Plume and Backward Lagrangian Stochastic Models for Near-Field Methane Emission Estimation Using a Single Controlled Release Experiment
Methane (CH 4 ) is a major component of natural gas and a potent greenhouse gas. Increasing atmospheric methane concentrations are attributed to emissive anthropogenic activities by an average of 13 ppb per yr since 2020 and are linked to a changing global climate. Mitigating CH 4 emissions from oil and gas production sites has recently become a target to reduce overall greenhouse gas emissions; however, monitoring the efficacy of mitigation strategies depends on accurate quantification of CH 4 emissions at the facility-level. Near-field quantification of methane (CH 4 ) emissions from oil and gas (O&G) facilities remains challenging due to the effects of atmospheric variability and sensor configuration on atmospheric dispersion models. This study evaluates the performance of two atmospheric dispersion models, the Gaussian plume (GP) and backward Lagrangian stochastic (bLS), by comparing calculated CH 4 emissions to controlled single-point emissions between 0.4 and 5.2 kg CH 4 h −1 . Emissions were calculated by both models using 121 individual sets of measurements comprising five-minute averaged downwind methane mixing ratios and matching meteorological data. The comparison shows that the bLS approach achieved a higher proportion of emission estimates within a factor of two (FAC2) of the known emission rates compared to the GP approach. The emissions calculated by the bLS model also had a lower multiplicative error and reduced bias relative to GP. Other error-based metrics further confirmed the bLS model performed better, as it yielded lower RMSE and MAE than GP. Statistical analysis of the emission data shows that the lateral and vertical alignment of the source and the sensor plays a critical role in emission estimations, as measurements made closer to the plume centerline and at a distance between 40 and 80 m downwind yielded the best FAC2 agreement. High wind meander degraded the ability of both approaches to generate representative emissions, particularly with the GP approach, as it violates the modeling approach’s assumption of steady-state emissions. Data suggest emissions calculated by the bLS model are comprehensively in better agreement, but the computational demands of the modeling approach and integration into fenceline systems limit real-time applicability. While these results provide insight into model performance under controlled near-field conditions, their applicability to more complex or heterogeneous oil and gas production environments (e.g., the regions Marcellus or Unita Basins) remains limited and uncertain.
gaussian plume↗
Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics
In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Predicting wind farm operations with machine learning and the P2D‐RANS model: A case study for an AWAKEN site
Abstract The power performance and the wind velocity field of an onshore wind farm are predicted with machine learning models and the pseudo‐2D RANS model, then assessed against SCADA data. The wind farm under investigation is one of the sites involved with the American WAKE experimeNt (AWAKEN). The performed simulations enable predictions of the power capture at the farm and turbine levels while providing insights into the effects on power capture associated with wake interactions that operating upstream turbines induce, as well as the variability caused by atmospheric stability. The machine learning models show improved accuracy compared to the pseudo‐2D RANS model in the predictions of turbine power capture and farm power capture with roughly half the normalized error. The machine learning models also entail lower computational costs upon training. Further, the machine learning models provide predictions of the wind turbulence intensity at the turbine level for different wind and atmospheric conditions with very good accuracy, which is difficult to achieve through RANS modeling. Additionally, farm‐to‐farm interactions are noted, with adverse impacts on power predictions from both models.
17 WIND ENERGY↗
Economic Analysis of Battery Energy Storage Systems Incorporating Uncertain Battery Model
A high-fidelity battery model is essential for precise economic analysis of battery energy storage systems (BESSs), but these models are computationally intensive. Heuristic models offer computational efficiency but compromise the accuracy of economic analysis results. We assess the impact of errors in heuristic battery models on economic analysis by utilizing open-circuit voltage (OCV) measurements from battery experiments.
Choi, Hyungjin [Sandia National Laboratories (SNL-↗
A Tidal Hydrodynamic Model for Cook Inlet, Alaska, to Support Tidal Energy Resource Characterization
Cook Inlet in Alaska has been identified as a prime site in the U.S. for potential tidal energy development, because of its enormous tidal power potential that accounts for nearly one-third of the national total. As one important step to facilitate tidal energy development, a tidal hydrodynamic model based on the unstructured-grid, finite-volume community ocean model (FVCOM) was developed for Cook Inlet to characterize the tidal stream energy resource. The model has a grid resolution that varies from about 1000 m at the open boundary to 100–300 m inside the Inlet. Extensive model validation was achieved by comparing model predictions with field observations for tidal elevation and velocity at various locations in Cook Inlet. The error statistics confirmed the model performs reasonably well in capturing the tidal dynamics in the system, e.g., R2 > 0.98 for tidal elevation and generally > 0.9 for velocity. Model results suggest that tides in Cook Inlet evolve from progressive waves at the entrance to standing waves at the upper Inlet, and that semi-diurnal tidal constituents are amplified more rapidly than diurnal constituents. The model output was used to identify hotspots that have high energy potential and warrant additional velocity and turbulence measurements such as East Foreland, where averaged power density exceeds 5 kw/m2. Lastly, a tidal energy extraction simulation was conducted for a hypothetical turbine farm configuration at the Forelands cross section to evaluate tidal energy extraction and resulting changes in far-field hydrodynamics.
16 TIDAL AND WAVE POWER↗
Machine Learning-Driven Conservative-to-Primitive Conversion in Hybrid Piecewise Polytropic and Tabulated Equations of State
We present a novel machine learning (ML)-based method to accelerate conservative-to-primitive inversion, focusing on hybrid piecewise polytropic and tabulated equations of state. Traditional root-finding techniques are computationally expensive, particularly for large-scale relativistic hydrodynamics simulations. To address this, we employ feedforward neural networks (NNC2PS and NNC2PL), trained in PyTorch (2.0+) and optimized for GPU inference using NVIDIA TensorRT (8.4.1), achieving significant speedups with minimal accuracy loss. The NNC2PS model achieves 𝐿 1 and 𝐿 ∞ errors of 4.54 × 10 −7 and 3.44 × 10−6, respectively, while the NNC2PL model exhibits even lower error values. TensorRT optimization with mixed-precision deployment substantially accelerates performance compared to traditional root-finding methods. Specifically, the mixed-precision TensorRT engine for NNC2PS achieves inference speeds approximately 400 times faster than a traditional single-threaded CPU implementation for a dataset size of 1,000,000 points. Ideal parallelization across an entire compute node in the Delta supercomputer (dual AMD 64-core 2.45 GHz Milan processors and 8 NVIDIA A100 GPUs with 40 GB HBM2 RAM and NVLink) predicts a 25-fold speedup for TensorRT over an optimally parallelized numerical method when processing 8 million data points. Moreover, the ML method exhibits sub-linear scaling with increasing dataset sizes. We release the scientific software developed, enabling further validation and extension of our findings. By exploiting the underlying symmetries within the equation of state, these findings highlight the potential of ML, combined with GPU optimization and model quantization, to accelerate conservative-to-primitive inversion in relativistic hydrodynamics simulations.
conservative-to-primitive conversion↗
NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018
This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON
54 ENVIRONMENTAL SCIENCES↗
Automatic building energy model development and debugging using large language models agentic workflow
Building energy modeling (BEM) is a complex process that demands significant time and expertise, limiting its broader application in building design and operations. While Large Language Models (LLMs) agentic workflow have facilitated complex engineering processes, their application in BEM has not been specifically explored. This paper investigates the feasibility of automating BEM using LLM agentic workflow. Here, we developed a generic LLM-planning-based workflow that takes a building description as input and generates an error-free EnergyPlus building energy model. Our robust workflow includes four core agents: 1) Building Description Pre-Processing, 2) IDF Object Information Extraction, 3) Single IDF Object Generator Suite, and 4) IDF Debugging Agent. These agents divide the complex tasks into manageable sub-steps, enabling LLMs to generate accurate and reliable results at each stage. The case study demonstrates the successful translation of a building description into an error-free EnergyPlus model for the iUnit modular building at the National Renewable Energy Laboratory. The effectiveness of our workflow surpasses: 1) naive prompt engineering, 2) other LLM-based workflows, and 3) manual modeling, in terms of accuracy, reliability, and time efficiency. The paper concludes with a discussion on the interplay between foundational models and LLM agent planning design, advocating for the use of fine-tuned, specialized models to advance this field.
97 MATHEMATICS AND COMPUTING↗
Simplified calculation of the area specific impedance for solid-state battery design
Simplified algebraic area specific impedance (ASI) correlations have been developed for solid-state composite battery electrodes made of a single ion conducting electrolyte, conductive additive, and intercalation active material. Two ASI expressions were developed, one for short times ( i.e. , pulsed power operation) and another for the pseudo steady state operation (i.e., sustained discharge for energy estimation). A full electrochemical model based on porous electrode theory was developed to examine the accuracy of the simplified ASI expressions. The simplified expressions agree favorably with full model results over a wide range of parameters (i.e. , electrode thicknesses, electrolyte conductivities, solid-state diffusion coefficients, specific surface areas, etc.) and conditions (i.e. , C-rates, states of charge, and pulse times). Under most conditions, the error between the full model and the correlations is well below 7 %. Higher errors were observed for the pseudo steady state expression at high/ low states of charge where the assumption of uniform reaction distributions loses validity. Here, the short time ASI has higher error at low states of charge due to the nonlinearity of the open circuit voltage equation, which is assumed linear in the formulation of the simplified algebraic expression.
25 ENERGY STORAGE↗
Automatically generated model for light alkene combustion
Light alkenes are common combustion intermediates for a variety of fuels. Therefore, understanding their oxidation and pyrolysis chemistry is key to building detailed mechanisms for heavier fuels. This work was focused on the development and evaluation of a detailed kinetic mechanism suitable for the combustion of light alkenes up to C 4 without the use of tuned parameters, instead, the parameter values come from first principles or direct measurements. The generated mechanism accurately estimates the laminar burning velocity (S u ) and ignition delay time (IDT) of light alkenes available in the literature, which represent fundamental combustion properties at a wide range of conditions. Because each parameter is thought to have a physically realistic value, not tuned to these measurements, the new model could be used as a sub-mechanism in models for other applications. The reaction network was generated with the open-source Reaction Mechanism Generator (RMG) software. Sensitivity analyses were performed under wide ranges of temperatures and pressures, allowing for the identification of the most impactful species and reactions. Based on these, a comprehensive thermochemistry database, including calculations on 550 molecules performed in this work at the CBS-QB3 level of theory, and a kinetic library, including theoretically-derived reaction rates retrieved from the literature, were built and used in the mechanism generation. The developed mechanism was compared against several existing detailed kinetic mechanisms for ethene, propene, 1-butene, 2-butene, and isobutene. Here, the newly generated model is the most accurate among the ones analyzed, in terms of fractional bias and normalized mean square error. Hence, this new model was used to analyze the chemistry of alkene combustion. Key rate coefficients were compared, to identify the cause of deviations between the models and possible areas for further improvements.
09 BIOMASS FUELS↗
Evaluating Tropical Precipitation Relations in CMIP6 Models with ARM Data
Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.
54 ENVIRONMENTAL SCIENCES↗
Energy use of piperazine with the advanced stripper from pilot plant testing
Here, piperazine with the Advanced Stripper (PZAS™) was tested at the National Carbon Capture Center (NCCC) at coal and NGCC conditions. Energy performance was measured with accounting for heat loss. The net heat duty was found to be identical at 2.45 GJ/tonne for both 4 and 12% CO 2 at 90% CO 2 removal. The average measured heat loss was 0.38 GJ/tonne and represented 30% of the gross heat rate. For PZAS, the warm rich piping before the control valve is the largest in surface area. Heat loss at this location increased heat duty by 80% of the heat loss value. Therefore, the total heat duty was decreased by 80% of the heat loss. The Independence™ model was validated using 112 steady-state pilot plant runs and predicted average net heat duty with an error of 9% and lean loading with an error of 10%. The model was used to simulate process impacts of heat loss for the PZAS and simple stripper configurations. For both strippers, heat loss was found to impact heat duty at locations other than just the steam heater. While heat loss in the steam heater was the most important for PZAS, heat loss in the column was the most important for the simple stripper due to a large top-side pinch and CO 2 reabsorption at the same location. CO 2 reabsorption in PZAS occurred only at high heat loss values (~0.14 GJ/hr), compared to low heat loss values (~ 0.03 GJ/hr) in the PZ-simple stripper. Excessive packing in the PZ-simple stripper caused a large top-side pinch at 0.23 mol/mol lean loading, making the column very sensitive to heat loss. Heat loss in the PZ-simple stripper increased heat duty by 120–150% at typical heat loss values and lean loading of 0.23 mol/mol. Heat loss in the MEA-simple stripper only increased heat duty by 1–13% in a typical lean loading range of 0.1–0.2 mol/mol. A large bottom side pinch at low lean loading for 7 m MEA made the effect of heat loss less pronounced.
42 ENGINEERING↗
Quantitative assessment of eddy viscosity rans models for turbulent mixed convection in a differentially heated plane channel
Turbulent mixed convection between two vertical, infinite parallel plates at different temperatures is studied using various two-equation turbulence models. The numerical simulations are performed at a turbulent Reynolds number of Re τ = 150 and a Grashof number of Gr = 9.6 × 10 5 . Comparisons are made against the highly trusted DNS results. Consistent with the DNS approach, the current simulations are performed using constant properties and the Boussinesq approximation to predict the influence of buoyancy. Previous studies have provided assessments of two-equation turbulence models for various scenarios, but often rely on a qualitative “eye” test in order to determine the most appropriate model to predict a given flow. This study aims to provide a new form of quantitative assessment that accounts for both the physics captured by the turbulence model as well as the magnitude of the system response quantities (SRQ) using a modified symmetric mean absolute percent error (SMAPE) method. This method is designed to be approachable to researchers at any level and can be applied to system response quantities from multiple research fields. Uncertainty quantification is also performed to determine the discretization error for each turbulence model. Recommendations are made as to which turbulence models best capture the physics – hydrodynamically and thermally – using both local and global validation metrics. Lastly, a sensitivity analysis is performed on the damping functions used in the most accurate models. This underpins the potential of model developments and adjustments most worth pursuing for buoyant flows. Finally, this framework provides a more physics-based comparative analysis of the selected turbulence models.
42 ENGINEERING↗