Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Experimental and analytical studies of a model helicopter rotor in hover

A benchmark test to aid the development of various rotor performance codes was conducted. Simultaneous blade pressure measurements and tip vortex surveys were made for a wide range of tip Mach numbers including the transonic flow regime. The measured tip vortex strength and geometry permit effective blade loading predictions when used as input to a prescribed wake lifting surface code. It is also shown that with proper inflow and boundary layer modeling, the supercritical flow regime can be accurately predicted.

Caradonna, F. X.↗

Dual frequency comb spectroscopy of solid fuel pyrolysis and combustion: Quantifying the influence of moisture content in Douglas fir

As the fire research community develops multi-scale models to predict the spread of wildland fires, there is a need for well-controlled, small-scale experiments which provide benchmark data and fundamental understanding of the effects of key parameters on the combustion of wildland fuels. Here, we implement a unique suite of non-intrusive, quantitative diagnostics that simultaneously measure mass loss, surface temperature, in situ gas temperature and water vapor concentration, including the first implementation of dual frequency comb spectroscopy for the study of solid fuels. As a demonstration, we examine the effect of fuel moisture content on the burning of Douglas fir wood samples that are ignited under constant radiative heat flux from a cone calorimeter to provide benchmark data for multi-scale models. Peak flame temperatures 3 mm above the sample surface measured with the dual frequency comb laser spectrometer are in excess of 1200 K. The flame temperature decreases by over 150 K as fuel moisture content increases from 0.7% to 40%. This work demonstrates a platform for simultaneous, quantitative measurements of well-controlled small-scale experiments which provide benchmark data for the development of advanced modeling and simulations capable of capturing the complex physics present in wildland fire systems.

54 ENVIRONMENTAL SCIENCES↗

Comparison of URANS and LES predictions for the open phase of the OECD NEA CSNI fluid structure interaction CFD benchmark

The OECD NEA CSNI WGAMA CFD Task Group ran a benchmark in 2020 and 2021 to assess the predictive capabilities of coupled fluid structure interaction (FSI) CFD analysis methods. This paper presents the predictions made for the open phase of the benchmark using URANS and LES turbulence modelling approaches, and a comparison of the results to the experimental data. The benchmark comprised a channel containing two inline cylinders in cross-flow. The cylinders were fixed at one end, free at the other, and had measured resonant frequencies and damping properties. The URANS modelling used ANSYS Fluent 2-way coupled to ANSYS Mechanical. The LES modelling used Nek5000, 1-way coupled to Diablo. Comparisons with cross-channel velocity profiles are presented, both for the mean flow and its RMS. Comparisons are also made to the frequency spectra for point measurements of fluid velocity and pressure, and for the accelerations of the free end of each cylinder. URANS predicts the average velocity profiles relatively well, and is able to predict the velocity and acceleration spectra at the shedding frequency. However, the frequency content at the 4th harmonic of the shedding frequency is low in the URANS flow fields, and so does not excite accelerations at the resonant frequency of the cylinders. LES makes better predictions of the average profiles, and the velocity spectra agree well at both the shedding frequency and at higher frequencies. In conclusion, the 1-way coupled LES results show good agreement for acceleration spectra.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Observational needs for estimating Alaskan soil carbon stocks under current and future climate

Abstract Representing land surface spatial heterogeneity when designing observation networks is a critical scientific challenge. Here we present a geospatial approach that utilizes the multivariate spatial heterogeneity of soil‐forming factors—namely, climate, topography, land cover types, and surficial geology—to identify observation sites to improve soil organic carbon (SOC) stock estimates across the State of Alaska, USA. Standard deviations in existing SOC samples indicated that 657, 870, and 906 randomly distributed pedons would be required to quantify the average SOC stocks for 0–1 m, 0–2 m, and whole‐profile depths, respectively, at a confidence interval of 5 kg C m −2 . Using the spatial correlation range of existing SOC samples, we identified that 309, 446, and 484 new observation sites are needed to estimate current SOC stocks to 1 m, 2 m, and whole‐profile depths, respectively. We also investigated whether the identified sites might change under future climate by using eight decadal (2020–2099) projections of precipitation, temperature, and length of growing season for three representative concentration pathway (RCP 4.5, 6.0, and 8.5) scenarios of the Intergovernmental Panel on Climate Change. These analyses determined that 12 to 41 additional sites (906 + 12 to 41; depending upon the emission scenarios) would be needed to capture the impact of future climate on Alaskan whole‐profile SOC stocks by 2100. The identified observation sites represent spatially distributed locations across Alaska that captures the multivariate heterogeneity of soil‐forming factors under current and future climatic conditions. This information is needed for designing monitoring networks and benchmarking of Earth system model results.

54 ENVIRONMENTAL SCIENCES↗

Characterization of gamma-ray background outside of the High Flux Isotope Reactor

Static gamma-ray measurements collected between September 2017 and March 2018 in the vicinity of the High Flux Isotope Reactor (HFIR) and the Radiochemical Engineering Development Center (REDC) at Oak Ridge National Laboratory are presented. Temporal events are identified and tracked, including radioactive material transfers, rain events, and 41 Ar emissions. The remaining data is used to determine the average background and its variation. Finally, these results will be used to benchmark Monte Carlo transport models of the HFIR/REDC vicinity and provide training data for material transfer tracking algorithms and data fusion algorithms to determine HFIR operational status under the Multi-Informatics for Nuclear Operations Scenarios program.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Hybrid fs/ps rotational CARS temperature and oxygen measurements in the product gases of canonical flat flames

A hybrid fs/ps pure-rotational coherent anti-Stokes Raman scattering (CARS) scheme is systematically evaluated over a wide range of flame conditions in the product gases of two canonical flat-flame burners. Near-transform-limited, broadband femtosecond pump and Stokes pulses impulsively prepare a rotational Raman coherence, which is later probed using a high-energy, frequency-narrow picosecond beam generated by the second-harmonic bandwidth compression scheme that has recently been demonstrated for rotational CARS generation in H 2 /air flat flames. The measured spectra are free of collision effects and nonresonant background and can be obtained on a single-shot basis at 1 kHz. The technique is evaluated for temperature/oxygen measurements in near-adiabatic H 2 /air flames stabilized on the Hencken burner for equivalence ratios of φ = 0.20–1.20. Thermometry is demonstrated in hydrocarbon/air products for φ = 0.75–3.14 in premixed C 2 H 4 /air flat flames on the McKenna burner. Reliable spectral fitting is demonstrated for both shot-averaged and single-laser-shot data using a simple phenomenological model. Measurement accuracy is benchmarked by comparison to adiabatic-equilibrium calculations for the H 2 /air flames, and by comparison with nanosecond CARS measurements for the C 2 H 4 /air flames. Quantitative accuracy comparable to nanosecond rotational CARS measurements is observed, while the observed precision in both the temperature and oxygen data is extraordinarily high, exceeding nanosecond CARS, and on par with the best published thermometric precision by femtosecond vibrational CARS in flames, and rotational femtosecond CARS at low temperature. Threshold levels of signal-to-noise ratio to achieve 1–2% precision in temperature and O 2 /N 2 ratio are identified. Our results show that pure-rotational fs/ps CARS is a robust and quantitative tool when applied across a wide range of flame conditions spanning lean H 2 /air combustion to fuel-rich sooting hydrocarbon flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multi-criteria thermal resilience certification scheme for indoor built environments during heat waves

With climate change, the indoor built environment is expected to significantly influence the occupant's safety and well-being. A novel multi-criteria thermal resilience certification scheme for indoor built environments during extreme heat events is proposed in this paper. The certification scheme considers overheating, thermal comfort, heat stress, and hygrothermal discomfort in built environments. These criteria are quantified using key performance indicators like indoor overheating degree, hours of exceedance, wet-bulb globe temperature, and heat index, respectively. This scheme is developed based on existing best practices like standards, rating systems, and literature. The scheme is implemented on a benchmark building energy performance model for detached post-World War II dwellings in Belgium as a case study using weather data measured from the City of Brussels. The indoor overheating in the reference dwelling is assessed with a static threshold of 27 °C for the bedrooms and adaptive thresholds for other areas. The analysis found that the building performance is within the defined threshold levels throughout the heat wave duration for all criteria. Therefore, the reference dwelling got a maximum attainable score of four points and is rated five-star for thermal resilience during heat waves. The proposed certification scheme is intended as a standardized framework and highlights the need for further revisions in building performance policies and guidelines.

Climate change↗

A time-dependent neutron transport method of characteristics formulation with time derivative propagation

A new time-dependent Method of Characteristics (MOC) formulation for nuclear reactor kinetics was developed utilizing angular flux time-derivative propagation. This method avoids the requirement of storing the angular flux at previous points in time to represent a discretized time derivative; instead, an equation for the angular flux time derivative along 1D spatial characteristics is derived and solved concurrently with the 1D transport characteristic equation. This approach allows the angular flux time derivative to be recast principally in terms of the neutron source time derivatives, which are approximated to high-order accuracy using the backward differentiation formula (BDF). This approach, called Source Derivative Propagation (SDP), drastically reduces the memory requirements of time-dependent MOC relative to methods that require storing the angular flux. An SDP method was developed for 2D and 3D applications and implemented in the computer code DeCART in 2D. DeCART was used to model two reactor transient benchmarks: a modified TWIGL problem and a C5G7 transient. The SDP method accurately and efficiently replicated the solution of the conventional time-dependent MOC method using two orders of magnitude less memory.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Computational singular perturbation analysis of stochastic chemical systems with stiffness

Computational singular perturbation (CSP) is a useful method for analysis, reduction, and time integration of stiff ordinary differential equation systems. It has found dominant utility, in particular, in chemical reaction systems with a large range of time scales at continuum and deterministic level. On the other hand, CSP is not directly applicable to chemical reaction systems at micro or meso-scale, where stochasticity plays an non-negligible role and thus has to be taken into account. In this work we develop a novel stochastic computational singular perturbation (SCSP) analysis and time integration framework, and associated algorithm, that can be used to not only construct accurately and efficiently the numerical solutions to stiff stochastic chemical reaction systems, but also analyze the dynamics of the reduced stochastic reaction systems. Furthermore, the algorithm is illustrated by an application to a benchmark stochastic differential equation model, and numerical experiments are carried out to demonstrate the effectiveness of the construction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Experimental demonstration and modeling of a robotic neutron detector with spectral and directional sensitivity for treaty verification

International safeguards and arms control agreements often require labor-intensive, intrusive onsite inspections to perform verification tasks. The ability to localize a neutron source and/or characterize a neutron field may be imperative for identifying anomalies. We are interested in the role of autonomous mobile robots, which, if designed properly, may be more effective and efficient and less intrusive than their human counterparts. Toward developing such a capability, we, for this study, have constructed the N-SpecDir Bot, comprised of three boron-coated straw detectors azimuthally-distributed within a cylinder of high-density polyethylene, which is mounted on an omni-directional robotic platform. Our N-SpecDir Bot is specifically designed to provide spectral and directional sensitivity, in addition to gross counts, by utilizing the signals from the three detectors. The detection system has been extensively characterized by MCNP modeling, which has been benchmarked to experiments conducted at the Princeton Plasma Physics Laboratory. We demonstrate the spectral and directional sensitivity experimentally and in simulation, and provide a simple yet robust method for directional measurements.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Estimation of pipe failure frequencies in the absence of operational experience data: A pilot study

Probabilistic failure metrics such as leak frequency and rupture frequency are commonly used to characterize piping reliability. The methodologies for calculating the failure metrics rely on a complex set of input parameters. Operating experience data and experimental data play an important role in informing the different input parameters. The paper describes results and conclusions of a coordinated research project to benchmark three different reliability models using a four-step procedure: reference case definition of relevance to advanced reactor designs, input parameter calibration, validation of results, and application of different methodologies upon completion of the calibration and validation steps. The reference case is a weld consisting of nickel-base alloy 152/52 and located within a primary pressure boundary of an advanced reactor. This alloy is a class of structural materials known to be highly resistant to stress corrosion cracking. Synergies between the different methods are noted and the importance of a multi-disciplinary approach to input parameter development is underscored. A key conclusion is that the three methods are equally suitable for estimating failure frequencies. In any specific application, a selection of the most practical or effective computational tool can be considered. The comparison of alternative models confirms and helps to gain confidence in the computed failure frequency estimates. The study was part of a coordinated research project organized by the International Atomic Energy Agency.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Deep Learning enabled spectral energy conversion for in situ exposure measurements

A detector-specific deep learning (DL) approach is presented for spectra-to-exposure conversion using large-format sodium iodide (NaI(Tl)) detectors deployed for in situ environmental radiation measurements in emergency response scenarios. Accurate determination of exposure from NaI spectra is challenging due to poor energy resolution, partial energy absorption, and the strong sensitivity of traditionally deployed analytical conversion methods to calibrated source geometry and pre-deployment assumptions. Here, to address these limitations, a multi-layer perceptron model was trained on a hybrid in situ /Monte Carlo dataset constructed to span a broad range of photon energies, spatial extents, and realistic deployment variability, representative of general in situ emergency response conditions. The DL model was evaluated against commonly fielded analytical approaches under matched simulation conditions, including a single-factor method, a G-function method, and a modeled pressurized ion chamber (PIC) baseline. This study was intentionally computational in scope to enable controlled, like-for-like comparisons between conversion techniques while minimizing confounding real-world variability. Comparison to the modeled PIC provides contextual benchmarking and is not intended as a field inter-comparison with deployed instruments. Across the evaluated 20 keV to 3 MeV energy range, the DL approach consistently exhibited higher accuracy and reduced variance relative to the analytical methods against a deterministically calculated exposure. This may indicate improved robustness to spectral complexity without reliance on source-, geometric-, or spectral region-specific optimization. While results do not represent real-world validation, the presented work demonstrates that deep learning may effectively learn the nonlinear detector response-to-exposure relationship for asymmetric NaI(Tl) detectors and offers a promising pathway for improving in situ exposure estimation using spectroscopic systems already integrated into initial real-time emergency response operations.

61 RADIATION PROTECTION AND DOSIMETRY↗

A Universal Augmentation Framework for Long-Range Electrostatics in Machine Learning Interatomic Potentials

Most current machine learning interatomic potentials (MLIPs) rely on short-range approximations, without explicit treatment of long-range electrostatics. To address this, we recently developed the Latent Ewald Summation (LES) method, which infers electrostatic interactions, polarization, and Born effective charges (BECs), just by learning from energy and force training data. Here, in this study, we present LES as a standalone library, compatible with any short-range MLIP, and demonstrate its integration with methods such as MACE, NequIP, Allegro, CACE, CHGNet, and UMA. We benchmark LES-enhanced models on distinct systems, including bulk water, polar dipeptides, and gold dimer adsorption on defective substrates, and show that LES not only captures correct electrostatics but also improves accuracy. Additionally, we scale LES to large and chemically diverse data by training MACELES-OFF on the SPICE set containing molecules and clusters, making a universal MLIP with electrostatics for organic systems, including biomolecules. MACELES-OFF is more accurate than its short-range counterpart (MACE-OFF) trained on the same data set, predicts dipoles and BECs reliably, and has better descriptions of bulk liquids. By enabling efficient long-range electrostatics without directly training on electrical properties, LES paves the way for electrostatic foundation MLIPs.

Kim, Dongjin [University of California, Berkeley, ↗

Combining Theory and Experiment for Multitechnique Characterization of Activated CO 2 on Transition Metal Carbide (001) Surfaces

Early transition metal carbides (TMC; TM = Ti, Zr, Hf, V, Nb, Ta, Mo) with face-centered cubic crystallographic structure have emerged as promising materials for CO 2 capture and activation. Density functional theory (DFT) calculations using the Perdew–Burke–Ernzerhof exchange–correlation functional evidence charge transfer from the TMC surface to CO 2 on the two possible adsorption sites, namely, MMC and TopC, and the electronic structure and binding strength differences are discussed. Further, the suitability of multiple experimental techniques with respect to (1) adsorbed CO2 recognition and (2) MMC/TopC adsorption distinction is assessed from extensive DFT simulations. Results show that ultraviolet photoemission spectroscopies (UPS), work function changes, core level X-ray photoemission spectroscopy (XPS), and changes in linear optical properties could well allow for adsorbed CO2 detection. Only infrared (IR) spectra and scanning tunnelling microscopy (STM) seem to additionally allow for MMC/TopC adsorption site distinction. These findings are confirmed with experimental XPS measurements, demonstrating CO 2 binding on single crystal (001) surfaces of TiC, ZrC, and VC. The experiments also help resolving ambiguities for VC, where CO 2 activation was unexpected due to low adsorption energy, but could be related to kinetic trapping involving a desorption barrier. With a wealth of data reported and direct experimental evidence provided, this study aims to motivate further basic surface science experiments on an interesting case of CO 2 activating materials, allowing also for a benchmark of employed theoretical models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗

Emergent temperature sensitivity of soil organic carbon driven by mineral associations

Abstract Soil organic matter decomposition and its interactions with climate depend on whether the organic matter is associated with soil minerals. However, data limitations have hindered global-scale analyses of mineral-associated and particulate soil organic carbon pools and their benchmarking in Earth system models used to estimate carbon cycle–climate feedbacks. Here we analyse observationally derived global estimates of soil carbon pools to quantify their relative proportions and compute their climatological temperature sensitivities as the decline in carbon with increasing temperature. We find that the climatological temperature sensitivity of particulate carbon is on average 28% higher than that of mineral-associated carbon, and up to 53% higher in cool climates. Moreover, the distribution of carbon between these underlying soil carbon pools drives the emergent climatological temperature sensitivity of bulk soil carbon stocks. However, global models vary widely in their predictions of soil carbon pool distributions. We show that the global proportion of model pools that are conceptually similar to mineral-protected carbon ranges from 16 to 85% across Earth system models from the Coupled Model Intercomparison Project Phase 6 and offline land models, with implications for bulk soil carbon ages and ecosystem responsiveness. To improve projections of carbon cycle–climate feedbacks, it is imperative to assess underlying soil carbon pools to accurately predict the distribution and vulnerability of soil carbon.

54 ENVIRONMENTAL SCIENCES↗