Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

An Evolutionary Algorithm to Personalize Stool-Based Colorectal Cancer Screening

Fecal immunochemical testing (FIT) is an established method for colorectal cancer (CRC) screening. Measured FIT-concentrations are associated with both present and future risk of CRC, and may be used for personalized screening. However, evaluation of personalized screening is computationally challenging. In this study, a broadly applicable algorithm is presented to efficiently optimize personalized screening policies that prescribe screening intervals and FIT-cutoffs, based on age and FIT-history. We present a mathematical framework for personalized screening policies and a bi-objective evolutionary algorithm that identifies policies with minimal costs and maximal health benefits. The algorithm is combined with an established microsimulation model (MISCAN-Colon), to accurately estimate the costs and benefits of generated policies, without restrictive Markov assumptions. The performance of the algorithm is demonstrated in three experiments. In Experiment 1, a relatively small benchmark problem, the optimal policies were known. The algorithm approached the maximum feasible benefits with a relative difference of 0.007%. Experiment 2 optimized both intervals and cutoffs, Experiment 3 optimized cutoffs only. Optimal policies in both experiments are unknown. Compared to policies recently evaluated for the USPSTF, personalized screening increased health benefits up to 14 and 4.3%, for Experiments 2 and 3, respectively, without adding costs. Generated policies have several features concordant with current screening recommendations. The method presented in this paper is flexible and capable of optimizing personalized screening policies evaluated with computationally-intensive but established simulation models. It can be used to inform screening policies for CRC or other diseases. For CRC, more debate is needed on what features a policy needs to exhibit to make it suitable for implementation in practice.

60 APPLIED LIFE SCIENCES↗

Additively manufactured β-Ti5553 with laser powder bed fusion: Microstructures and mechanical properties of bulk and lattice parts

Ti5553 (Ti-5Al-5Mo-5V-3Cr wt%) is a titanium alloy widely used for its high strength-to-weight ratio and good formability at elevated temperatures. Unlike Ti-6Al-4V, Ti5553 does not undergo martensitic transformation, preventing cracking of brittle martensite upon rapid cooling. This makes it a strong candidate for additive manufacturing (AM), particularly laser powder bed fusion (L-PBF). L-PBF offers the unique opportunity to make fine lattice structures to reduce component weight. Despite the growing field of AM, there have been limited studies on L-PBF Ti5553 lattices and how their properties differ from the bulk. Here the present work addresses this knowledge gap by investigating microstructures and properties of L-PBF bulk and lattice parts and the effect of post L-PBF heat treatments. Electron microscopy and mechanical testing show that the high dislocation density formed during L-PBF increases bulk part’s yield strength by approximately 100 MPa compared to the conventional alloy. Digital image correlation during compression testing of octet truss lattices reveals a layer-by-layer failure mode. Compared to the bulk, the lattice contains copious ω nanoprecipitation, weaker <001> texture, smaller average grain sizes, and larger content of high-angle grain boundaries. These features elicit differences in Taylor factor distributions for the lattice depending on load direction, underlining challenges in predicting lattice mechanical response based on bulk properties. By examining the processing-structure-property relationships in the bulk and lattice, the present results delineate their microstructural and mechanical differences and establish a benchmark for the future design applications of L-PBF Ti5553.

36 MATERIALS SCIENCE↗

Ground and excited state gradients with end-to-end differentiable semiempirical quantum chemistry

Accurate and efficient gradients of molecular energy with respect to nuclear degrees of freedom are essential for geometry optimization and molecular dynamics, including simulations that go beyond the Born–Oppenheimer regime. A common approach involves deriving analytical formulas for new electronic structure methods, which is often conceptually difficult and requires tedious coding. Here, we implement analytical, semi-numerical, and automatic differentiation (AD)-based gradient pathways for semiempirical Hamiltonian models in the PYSEQM software package, leveraging both graphics processing unit (GPU) and central processing unit (CPU) architectures. We further extend these capabilities to excited states calculated using the configuration interaction singles and time-dependent Hartree–Fock ansätze. We benchmark wall time, peak memory usage, and accuracy across three molecular families of varying chemical complexity, including systems of up to a thousand atoms. For ground-state simulations, analytical and AD gradients achieve near-identical GPU runtimes, while semi-numerical gradients are slower on GPU but remain competitive on CPU. For excited states, both analytical and custom AD approaches using implicit differentiation show similar performance and low memory requirements, whereas gradients with full AD are memory-limited. AD gradients match analytical ones in accuracy across all tested systems, aided by a quaternion-based diatomic frame rotation for two-center quantities that ensures smooth energy surfaces. Overall, automatic differentiation emerges as a practical alternative to analytical gradients in semiempirical quantum chemistry, offering high accuracy while allowing seamless integration in AI-driven workflows and popular packages, such as PyTorch and JAX. Our results provide actionable guidance for selecting optimal gradient strategies in large-scale ground- and excited-state molecular dynamics simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Critical Experiments Targeting the Epithermal/Intermediate Cross Sections of Tantalum

Sandia National Laboratories (SNL) and Oak Ridge National Laboratory (ORNL) have collaborated to develop a capability to test the epithermal/intermediate cross sections of materials at the SNL critical experiments facility using the Seven Percent Critical Experiment (7uPCX) fuel. The Sandia Critical Experiments Program provides a specialized facility for performing water moderated and reflected critical experiments with UO 2 fuel rod arrays. The facility offers the ability to modify the core configuration and reactor tank to evaluate various reactor cores for pitch, moderator characteristics, and other criteria. A history of safe operations and flexibility in reactor core configuration has resulted in the completion of nine sets of critical benchmark experiments that have been documented in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The experiment described here is expected to be evaluated for inclusion in the 2024 edition of the ICSBEP Handbook.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Studying excited-state-specific perturbation theory on the Thiel set

Here, we explore the performance of a recently introduced N 5 -scaling excited-state-specific second order perturbation theory (ESMP2) on the singlet excitations of the Thiel benchmarking set. We find that, without regularization, ESMP2 is quite sensitive to π system size, performing well in molecules with small π systems but poorly in those with larger π systems. With regularization, ESMP2 is far less sensitive to π system size and shows a higher overall accuracy on the Thiel set than CC2, equation of motion-coupled cluster with singles and doubles, CC3, and a wide variety of time-dependent density functional approaches. Unsurprisingly, even regularized ESMP2 is less accurate than multi-reference perturbation theory on this test set, which can, in part, be explained by the set’s inclusion of some doubly excited states but none of the strong charge transfer states that often pose challenges for state-averaging. Beyond energetics, we find that the ESMP2 doubles norm offers a relatively low-cost way to test for doubly excited character without the need to define an active space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Development of a predictive capability of short-pulse laser-driven broadband x-ray radiography

High intensity, short-pulse laser interaction with a solid metal target produces broadband hard x-rays potentially for various applications of x-ray radiography. In this work, experimental benchmarking of numerical modelling for short-pulse laser-driven broadband x-ray radiography is presented. Angular dependent x-ray spectra are first calculated with a hybrid particle-in-cell code, Large Scale Plasma (LSP), using fast electron parameters inferred from an analysis of measured bremsstrahlung signals. Subsequently, a calculated x-ray spectrum in the direction of radiography is used in photon transport calculations using a Monte Carlo code, Particle and Heavy Ion Transport code System (PHITS), to simulate a radiographic image including a modelled 3D test object, an x-ray attenuation filter and an image plate detector. Simulated radiographic images are compared with measurements obtained in an experiment using a 50-TW Leopard short-pulse laser at the University of Nevada Reno. Results show that simulations reproduce the experimental images well for three different attenuation filters (plastic, aluminium, and brass), while 1D transmission profiles for the plastic and aluminium filters are quantitatively in good agreement. The modelling approach established in this work could be used as a predictive tool to simulate radiographic images of complex 3D solid objects at any arbitrary angular position or to optimize experimental components such as the source spectrum, x-ray attenuation filters and a detector type depending on a radiographic object without carrying out radiographic experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Deploying E3’s RESERVE Tool to Enable Advanced Operation of Clean Grids

Energy and Environmental Economics, Inc. (E3) developed an open-source machine learning model, RESERVE, for deriving ancillary services timeseries in deeply decarbonized electricity grids. E3 used a bespoke PLEXOS production simulation model of the California Independent System Operator’s (CAISO) balancing area to validate RESERVE’s ability to enable production cost, greenhouse gas emissions (GHG), and renewable energy curtailment savings. These savings were modeled by comparing PLEXOS cases with RESERVE’s outputs to PLEXOS cases with CAISO’s incumbent reserve product in the Western Energy Imbalance Market (EIM)’s 15-minute market. E3 also tested cases with solar operating flexibly to provide reserves. E3 found that, in a 2030 modeling year, using RESERVE and flexible solar enabled significant production cost, GHG and curtailment savings versus the incumbent CAISO method in cases with low penetrations of lithium-ion batteries. However, with the full 14 gigawatts (about 30% of peak CAISO demand) of 4-hour lithium-ion batteries that are expected to be installed by 2030, these savings approach zero due to batteries saturating ancillary services markets. E3 also found significant savings under a 2019 benchmarking year.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Implementation and testing of the GPT sensitivities in TRIPOLI-4

Computing the sensitivity of given reactor parameters with respect to nuclear data is mandatory in key applications such as the assessment of reactor safety or core design. In recent years, the development of Monte Carlo methods capable of estimating sensitivity coefficients based on the Standard or Generalized Perturbation Theory (SPT and GPT, respectively) has attracted intensive research efforts, especially in view of having reference golden standard simulations to be compared to faster but approximate deterministic calculations. Following our previous implementation and validation of the SPT functionalities in the Monte Carlo TRIPOLI-4, devoted to the sensitivity of the k eigenvalue, in this work we detail the development of GPT methods for ratios of reaction rates, and validate them against a few relevant benchmark results. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Covariance Testing Progress for ENDF/B-VIII.1β1 at ORNL [Slides]

This presentation touched on how data-induced uncertainty significantly increased for thermal 235 U-fueled systems. And how 239 Pu covariance changes are worrying. Additionally discussed is how 103 Rh is the only significant important fission product change. The Impact of ENDF/B-VIII.1β1 on burnup credit similarity assessments is similar to ENDF/B-VII.1 data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

VECTOR Phase 1 Dataset: CAV Trajectory and Energy Consumption Records

This dataset contains benchmark experimental data from Phase 1 of the VECTOR project, focusing on the energy impact of CAV hardware components. The dataset includes vehicle trajectory data (speed and position) and corresponding energy consumption records collected from a CAV platform equipped with lidar, cameras, onboard computation units, and communication modules. The primary objective is to quantify the baseline energy consumption attributable to sensing and computing systems, independent of any advanced cooperative control strategies. During experiments, the leading vehicle followed a predetermined velocity profile, and the following CAV mirrored this trajectory using a basic car-following control to ensure consistent driving behavior. This setup enables a reliable benchmark for assessing the energy cost introduced by onboard CDA hardware (e.g., lidar and GPU-based processing). The dataset is essential for evaluating energy baselines and supports future comparative studies involving additional cooperative strategies. ![system img](system.png) ![vector img](vector.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An industrial perspective on catalysts for low-temperature CO 2 electrolysis

Electrochemical conversion of CO 2 to useful products at temperatures below 100 °C are nearing the commercial scale. Pilot units for CO 2 conversion to CO are already in testing. Units to convert CO 2 to formic acid are projected to reach pilot scale in the next year. Further, several investigators are starting to observe industrially relevant rates of the electrochemical conversion of CO 2 conversion to ethanol and ethylene with the needed hydrogen coming from water. In each case, Faradaic efficiencies of 80% or more and currents above 200 mA/cm –2 can be reproducibly achieved. In this study we describe the key advances in nano catalysts that lead to the impressive performance, indicate where additional work is needed and provide benchmarks that others can use to compare their results.

10 SYNTHETIC FUELS↗

Field-Array Benchmark of Commercial Bifacial PV Technologies with Publicly Available Data

We present results for a 75-kW field array deployed with rows of 5 different commercially available bifacial technologies. Four PERC (multi and mono) and 1 Silicon Heterojunction manufacturers are represented. Reference strings of equivalent monofacial PV modules are also installed in the 10-row field. High accuracy string-level DC monitoring and module-level measurements have been recorded for six months. Analysis indicates performance within expectation, with a cumulative model mean error within +/- 2% for both bifacial and monofacial models and cumulative bifacial energy gain between 6-9%. A custom-module to measure shading loss from the torque-tube was installed. One month data shows up to 6% irradiance non-uniformity. A fixed-tilt test-site with 3 years of bifacial data is also presented, with a bifacial gain of 3%.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Design of Temperature Dependent Critical Experiments with SPRF/CX

This paper describes the investigation of temperature-dependent critical experiments using the Seven Percent Critical Experiments (7uPCX) and Burnup Credit Critical Experiments (BUCCX) fuel types within the Sandia Pulsed Reactor Facility/Critical Experiments (SPRF/CX) apparatus at Sandia National Laboratories (Sandia). The goal of these experiments is to test the effect of varying system temperature on the $\kappa$ eff bias of water-moderated systems. Temperatures of 5–95°C were considered in this work. Eighteen representative lattice configurations were analyzed that had variations in the number of fuel rods and water holes, as well as in the array configuration, to achieve a variety of moderation regimes. The configurations were based on those detailed in the LEU-COMP-THERM-078 and LEU- COMP-THERM-079 experiments, both of which were published in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Hybrid Solid Oxide Fuel Cell/Gas Turbine Model Development for Electric Aviation

A thermodynamic model was developed and validated to analyze a high-performance solid oxide fuel cell and gas turbine (SOFC-GT) hybrid power system for electric aviation. This study used a process simulation software package (ProMax) to study the role of SOFC design and operation on the feasibility and performance of the hybrid system. Standard modules, including compressor, turbine, heat exchanger, reforming reactor, and combustor were used from the ProMax tool suite while a custom module was created to simulate the SOFC stack. The model used an SOFC test data set as an input. Additional SOFC stack performance effects, such as pressure, temperature, and utilization of air and fuel, were added from open source data. System performance predictors were SOFC specific power, fuel-to-electricity conversion efficiency, and hybrid system efficiency. Using these input data and predictors, a static thermodynamic performance model was created that can be modified for different system configurations and operating conditions. Prior to creating the final aircraft performance model, initial demonstration models were developed to validate output results. We used the NASA SOFC model as a benchmark, which was created with their Numerical Propulsion System Simulator (NPSS) software framework. Our output results matched within 1% of both the NASA model and open source SOFC performance data. With confidence gained in the accuracy of this model, a 1-MW SOFC-GT hybrid power system was constructed for an aircraft propulsion concept. Overall hybrid system efficiencies of > 75% FTE were observed during standard 36,000 feet cruise flight conditions.

30 DIRECT ENERGY CONVERSION↗

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗

Vertical canopy gradients of respiration drive plant carbon budgets and leaf area index

Despite its importance for determining global carbon fluxes, leaf respiration remains poorly constrained in land surface models (LSMs). We tested the sensitivity of the Energy Exascale Earth System Model Land Model – Functionally Assembled Terrestrial Ecosystem Simulator (ELM-FATES) to variation in the canopy gradients of leaf maintenance respiration (R dark ). We ran global and point simulations varying the canopy gradient of R dark to explore the impacts on forest structure, composition, and carbon cycling. In global simulations, steeper canopy gradients of R dark lead to increased understory survival and leaf biomass. Leaf area index (LAI) increased up to 77% in tropical regions compared with the default parameterization, improving alignment with remotely sensed benchmarks. Global vegetation carbon varied from 308 Pg C to 449 Pg C across the ensemble. In tropical forest simulations, steeper gradients of R dark had a large impact on successional dynamics. Results show the importance of canopy gradients in leaf traits and fluxes for determining plant carbon budgets and emergent ecosystem properties such as competitive dynamics, LAI, and vegetation carbon. The high-model sensitivity to canopy gradients in R dark highlights the need for more observations of how leaf traits and fluxes vary along light micro-environments to inform critical dynamics in LSMs.

59 BASIC BIOLOGICAL SCIENCES↗

Discovery of AMPX Thermal Scattering Law Processing Issue for Solid Moderators

The 2020 edition of The International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook includes a newly produced plastic-moderated evaluation, identified as PU-MET-MIXED-002 and referred to as PMM002. The 2021 edition should include another new plastic-moderated experiment, HEU-MET-THERM-004, referred to as HMT-004. These evaluations are of particular interest, as PMM-002 is moderated with polyethylene, and HMT-004 is moderated with polymethyl methacrylate (Lucite), allowing for investigation of the differences in the thermal scattering laws (TSLs) available for these materials. ENDF/B-VIII.0 includes newly produced data for 1 H-based scattering materials, including Lucite and yttrium hydride. Other available 1 H TSLs include polyethylene, light water, zirconium hydride. The unbound 1 H (free-gas) cross sections were also used. ENDF/B-VIII.0 also includes revisions made to the ENDF/B-VII.1 light water and polyethylene evaluations. Zirconium hydride was unchanged from ENDF/B-VII.1. As of this writing, there are no benchmarks included in the Verified, Archived Library of Inputs and Data (VALID) that are primarily moderated with any solid moderator, so validation that includes the PMM-002 and HMT-004 evaluations would expand the coverage to two new moderators. A study was undertaken at Oak Ridge National Laboratory with two purposes: to provide validation data based on systems that are primarily moderated with polyethylene and Lucite, and to demonstrate the reactivity changes that can result from use of different 1 H TSLs in these plastic-moderated systems. The first objective was mainly to test data and code for SCALE and AMPX, whereas the second objective was to provide useful data for practitioners on the potential variability of predicted $k_{eff}$ based on TSL changes. The use of an exactly correct TSL is often not possible given the materials involved (e.g., lubricants), but this study was intended to provide some indication of the magnitude of the changes among similar materials that can manifest through application of different TSLs in hydrogenous systems over a range of different neutron energy spectra. Unfortunately, the nominal $k_{eff}$ results exposed deviations between SCALE and Monte Carlo N-Particle (MCNP). Some of the results using different TSLs were also unexpected and difficult to explain. An investigation revealed a processing issue in AMPX that was caused by an ambiguous description of the data for incoherent elastic scattering in the ENDF manual. This issue is discussed in detail in a SCALE User Notification, and it affects some solid moderators, but it does not apply to 1 H bound in water. This issue highlights the importance of validating all TSLs used in safety analysis calculations. The remainder of this paper provides a more detailed examination of the results that triggered the investigation and a summary of the findings of that investigation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

SCALE 6.2 Lattice Physics Performance Assessment

The US Nuclear Regulatory Commission relies on the lattice physics analysis capabilities of the SCALE code system to perform confirmatory licensing analyses. Either SCALE lattice physics code—TRITON/NEWT or Polaris—can be used to generate cross section data used by the PARCS nodal core simulator for full-core neutronics calculations. This report presents an assessment of the accuracy of SCALE lattice physics codes for preparation of lattice physics data that are used to support simulator codes such as the NRC’s PARCS, for UO 2 -mixed oxide (MOX)/Zr fueled light water reactor (LWR) analyses. Due to the nature of lattice physics calculations, critical reactor experiment benchmarks cannot be modeled in explicit detail in a lattice physics code. However, this limitation does not mean that these measurement data are not usable for lattice physics studies. Therefore, either geometry approximations or axial buckling must be implemented to determine the critical water height. These modeling limitations have led to development of a three-phase assessment strategy. In the first phase, selected critical experiment benchmarks are modeled using the SCALE 3D continuous-energy (CE) Monte Carlo (MC) code KENO, which is the most rigorous neutron transport method available in SCALE, with no approximations in the spatial, angle, or energy treatments. Biases and statistical uncertainties in quantities of interest such as k eff and pin power distributions are determined by comparing CE KENO results to experimental data. This first phase in the accuracy assessment is to demonstrate and establish the use of CE KENO as a reference solution for the second phase. In the second phase, 14 numerical test suites are used to compare SCALE lattice physics calculations with CE KENO as a reference solution. In the third phase, SCALE lattice physics depletion calculations are performed, and the spent fuel isotopic results are compared with available radiochemical assay measurements. Isotopic measurement comparisons provide quantitative assessment of isotopic density distribution predictions with the depletion models in SCALE lattice physics codes. This report documents results for all test suites. The assessment was performed using standard production techniques unless otherwise noted. Both TRITON/NEWT and Polaris exhibited acceptable accuracy for most test cases. For the few test cases in which acceptable accuracy criteria were not met, further code and data development are planned. The computer codes used in this assessment are as follows: SCALE 6.2 rev19189 (pre-release of 6.2.1) was used for CE KENO, TRITON/NEWT and Polaris (PWR only) calculations; SCALE 6.2.2 was used for Polaris calculations to address several updates in support of support boiling water reactor (BWR) lattice geometries. For this work, there is no difference between SCALE 6.2.1 and SCALE 6.2.2 beyond the inclusion of the Polaris BWR analysis capability; The ENDF/B-VII.1 continuous energy and 252 group libraries deployed in SCALE 6.2 were generated with AMPX 6.2 that is distributed with SCALE.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗