Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

A Lens into the Cu Nanograin by In Situ Vibrational Spectroscopy

Cu-based catalysts are uniquely capable of C-C coupling during electrochemical CO 2 reduction (CO 2 R), yet further mechanistic understanding remains hampered by the lack of spectroscopically resolved descriptors that demonstrate how surface adsorbates emerge and evolve within their catalytic environment. Here, in this study, we correlate in situ surface-enhanced Raman spectroscopy (SERS) and surface-enhanced infrared absorption spectroscopy (SEIRAS) to resolve the potential-dependent dynamics during CO 2 R on Cu nanograin catalysts. By building on previous benchmarking of low overpotential performance and nanograin structural evolution, we offer a diagnostic framework linking vibrational signatures to catalytic function, unveiling which species appear, persist, and turnover as the electrified surface and interfacial environment evolve under bias. The onset of linear CO is marked below -0.45 V, coincident with persistent adsorbed *OH/*O domains beyond the CO 2 R onset. In this context, Cu nanograins serve as a platform to dissect contributions of adsorbate coverage. By carefully dissecting the potential dependence of emergent twin-defect/step CO stretch bands (P1-P2), alongside the prototypical terrace-site CO stretch band (P3), we provide important context for interpreting coupled spectroscopic trends driven by coverage effects and resolve this for the evidently complex nanograin morphology. Together, these observations highlight the intertwined roles of surface stabilization and interfacial flux in steering multicarbon product formation. By directly linking vibrational signatures to catalytic behavior, this work aims to bridge the gap between observation and control and help guide toward a predictive framework of fine-tuned selectivity for CO 2 R.

Fonseca Guzman, Maria V. [University of California↗

Data from a multi-year targeted proteomics study of a longitudinal birth cohort of type 1 diabetes

The deployment of liquid chromatography-mass spectrometry-based plasma proteomics experiments in a large cohort is sparse, leading to a lack of data available for benchmarking, method development or validation. Comprised of 6,426 plasma analyses, The Environmental Determinants of Diabetes in the Young (TEDDY) proteomics validation study constitutes one of the largest targeted proteomics experiments in the literature to date. The proteomics data from this study were generated over the course of 2.5 years from over 900 study subjects, each providing up to 29 longitudinal samples. The data also includes 916 quality control samples. The targeted mass spectrometry assay was comprised of 694 peptides mapping to 167 proteins and the panel was measured in each subject and QC sample. The targeted proteomic dataset presented here can be used as a resource for new computational method development, such as for batch correction, as well as for benchmarking and comparing the performance of different methods/tools.

60 APPLIED LIFE SCIENCES↗

Extension of frozen natural orbital approximation to open-shell references: Theory, implementation, and application to single-molecule magnets

Natural orbitals are often used to achieve a more compact representation of correlated wave-functions. Using natural orbitals computed as eigenstates of the virtual–virtual block of the state density matrix instead of the canonical Hartree–Fock orbitals results in smaller errors when the same fraction of virtual space is frozen. This strategy, termed frozen natural orbital (FNO) approach, is effective in reducing the cost of regular coupled-cluster (CC) calculations and some multistate methods, such as EOM-IP-CC (equation-of-motion CC for ionization potentials). This contribution extends the FNO approach to the EOM-SF-CC ansatz (EOM-CC with spin-flip). In contrast to EOM-IP-CCSD, EOM-SF-CCSD relies on high-spin open-shell references. Using FNOs computed for an open-shell reference leads to an erratic behavior of the EOM-SF-CC energies and properties due to an inconsistent truncation of the α and β orbital spaces. A general solution to problems arising in the EOM-CC calculations utilizing open-shell references, termed OSFNO (open-shell FNO), is proposed. Furthermore, by means of singular value decomposition (SVD) of the overlap matrix of the α and β orbitals, the OSFNO algorithm identifies the corresponding orbitals and determines virtual orbitals corresponding to the singly occupied space. This is followed by SVD of the singlet part of the state density matrix in the remaining virtual orbital subspace. The so-computed FNOs preserve the spin purity of the open-shell orbital subspace to the extent allowed by the original reference, thus facilitating a safe truncation of the virtual space. The performance of OSFNO is benchmarked for selected diradicals and triradicals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hybrid-gyrokinetic simulations of low- n toroidal Alfvén eigenmodes using gKPSP

Here, we report a benchmark study of toroidal Alfvén eigenmode (TAE) simulation using the hybrid-gyrokinetic code GyroKinetic Plasma Simulation Program (gKPSP). A simulation capability for energetic particles based on the gyrokinetic δf method has been newly implemented in the gKPSP code. Benchmark simulations have been performed in both circular and realistic tokamak geometries. Good agreement has been found with previously reported results, demonstrating the new capability of the gKPSP code. We have investigated the effects of the distribution function on TAE stability by examining both isotropic and anisotropic slowing-down distributions of energetic particles. The slowing-down distribution produces a higher linear growth rate than a Maxwellian distribution, while a growth rate scan with the anisotropy shows an opposite trend. This can be attributed to competition between Landau damping and the linear drive, which are correlated with the fraction of resonant passing particles and their distribution in phase space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗

The ballad of LLM agents: philosophical reasoning for chemistry

Large language models (LLMs) show remarkable potential for scientific reasoning but often produce unreliable or scientifically unactionable outputs when faced with multi-step logic, domain grounding, and interpretability challenges, especially in complex fields like chemistry and materials science. Here, we introduce a framework of philosophical reasoning agents, inspired by canonical thinkers such as Socrates, Descartes, Kant, and Hume, to guide LLM behavior via structured prompt engineering. These agents embody distinct reasoning paradigms (dialectical inquiry, deductive logic, rule-based judgment, and empirical validation) and are evaluated across multiple chemistry subdomains, physical, analytical, general, inorganic, and organic chemistry, using the ChemBench benchmark. Our agentic prompting approach yields substantial accuracy gains on open-ended numerical chemistry questions, with gains of +11.5 percentage points for GPT-4o with Hume, +4.5 percentage points for GPT-5 with Kant, and +21.8 percentage points for GPT-5.1 with Socrates at the strict 1% error threshold, relative to the corresponding base models. Beyond accuracy, we observe benchmark-level model–agent performance patterns, suggesting that different prompting styles interact differently with each base model. These findings demonstrate that embedding philosophy-of-science principles into multi-agent frameworks can improve and produce interpretable, adaptive, and domain-aligned scientific LLMs.

Harb, Hassan [Argonne National Laboratory (ANL), A↗

Desmearing small-angle scattering data by central moment expansions of instrument resolution

This study introduces an enhanced numerical technique tailored specifically for refining 1D small-angle scattering (SAS) intensity profiles affected by smearing. Our primary objective is to address the resolution blurring commonly encountered in SAS data, particularly in systems with clearly defined correlation peaks whose spread aligns with the width of the resolution function at corresponding Q positions. Unlike previous approaches that expanded the SAS intensity using central moment expansion, the new method focuses on expanding the resolution function itself, thus eliminating artificial oscillations observed in smeared spectra due to limitations inherent in our earlier algorithm. This method is straightforward to implement, computationally efficient and consistently performs well in numerical benchmarking. To illustrate its effectiveness, we present a case study of a lamellar phase characterized by distinct peaks in its small-angle neutron scattering intensities.

central moment expansions↗

Coarse Mesh Finite Difference Acceleration for Pebble Tracking Transport in Griffin

We implemented a coarse mesh finite difference (CMFD) for accelerating transport calculations with PTT (pebble tracking transport) in the Griffin code. More specifically, extensions for transport update with the consideration of scattering operator and CMFD projection were implemented for PTT. The implementation was verified with a simplified PBR (pebble bed reactor) benchmark problem and significant performance improvements in CPU time was observed.

97 MATHEMATICS AND COMPUTING↗

ECP Report: Update on Proxy Applications and Vendor Interactions

The ExaLearn miniGAN team (Ellis and Rajamanickam) have released miniGAN, a generative adversarial network(GAN) proxy application, through the ECP proxy application suite. miniGAN is the first machine learning proxy application in the suite (note: the ECP CANDLE project did previously release some benchmarks) and models the performance for training generator and discriminator networks. The GAN's generator and discriminator generate plausible 2D/3D maps and identify fake maps, respectively. miniGAN aims to be a proxy application for related applications in cosmology (CosmoFlow, ExaGAN) and wind energy (ExaWind). miniGAN has been developed so that optimized mathematical kernels (e.g., kernels provided by Kokkos Kernels) can be plugged into to the proxy application to explore potential performance improvements. miniGAN has been released as open source software and is available through the ECP proxy application website (https://proxyapps.exascaleproject.ordecp-proxy-appssuite/) and on GitHub (https://github.com/SandiaMLMiniApps/miniGAN). As part of this release, a generator is provided to generate a data set (series of images) that are inputs to the proxy application.

97 MATHEMATICS AND COMPUTING↗

Nuclear Data Assessment for Advanced Reactors

Advanced reactor concepts being developed throughout the industry are significantly different from light-water reactor (LWR) designs with respect to geometry, materials, and operating conditions, and consequently, with respect to their reactor physics behavior. Given the limited operating experience with non-LWRs, the accurate simulation of reactor physics and the quantification of associated uncertainties are important for ensuring that the nuclear design for advanced reactor concepts include appropriate margins. Nuclear data are a major source of input uncertainties in reactor physics analysis. As part of a project sponsored by the US Nuclear Regulatory Commission at Oak Ridge National Laboratory (ORNL), key nuclear data relevant to reactor safety analysis in selected advanced reactor technologies were identified, and their impacts on important key figures of merit were assessed based on (1) a review of available advanced reactor specifications, (2) analysis of previous studies performed at ORNL and other research institutions, and (3) sensitivity and uncertainty analyses performed for six selected benchmarks—three experimental and three computational—to quantify the impacts of the identified key nuclear data on several key metrics. This report summarizes the key nuclear data—nominal data and nuclear data uncertainties— considering the most important nuclear reactions in the fuel and in various materials for the moderator, coolant, and structure of the considered advanced reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation of ENDF/B-VIII.1 Nuclear Data Files [Slides]

ENDF-6 formatted files were processed into A Compact ENDF (ACE) files using NJOY2016. Several validation tests were performed: (1) LANL Legacy Benchmark Suite (2) “Modern” Benchmark Suite (3) HEU Benchmark Suite (4) LEU Benchmark Suite (5) Mixed (U+Pu) Benchmark Suite (6) Pu Benchmark Suite (7) 233 U Benchmark Suite.

97 MATHEMATICS AND COMPUTING↗

Machine Learning meets Algebraic Combinatorics: A Suite of Benchmark Datasets to Accelerate AI for Mathematics Research

The use of benchmark datasets has become an important engine of progress in machine learning (ML) over the past 15 years. Recently there has been growing interest in utilizing machine learning to drive advances in research-level mathematics. However, off-the-shelf solutions often fail to deliver the types of insights required by mathematicians. This suggests the need for new ML methods specifically designed with mathematics in mind. The question then is: what benchmarks should the community use to evaluate these? On the one hand, toy problems such as learning the multiplicative structure of small finite groups have become popular in the mechanistic interpretability community whose perspective on explainability aligns well with the needs of mathematicians. While toy datasets are a useful benchmark for initial work, they lack the scale, complexity, and sophistication of many of the principal objects of study in modern mathematics. To address this, we introduce a new collection of benchmark datasets, Algebraic Combinatorics Benchmarks (ACBench), representing either classic or open problems in algebraic combinatorics, a subfield of mathematics that studies discrete structures arising from abstract algebra. After describing the datasets, we discuss the challenges involved in constructing “good” mathematics benchmarks, describe baseline model performance, and discuss some of the insights these datasets can provide that may be of interest even to those who are not interested in mathematics research itself.

97 MATHEMATICS AND COMPUTING↗

MOSCATO Development and Integration in Fiscal Year 2024

MOSCATO (Molten Salt Chemistry and Transport) is a multiphysics code that provides high-fidelity, coupled simulations of fluid flow, heat transfer, mass transfer, chemistry, electrochemical phenomena, and alloy evolution for molten salt equipment. In FY24, significant developments were made to the code package, enhancing its capabilities in many aspects. The improvements and advancements can be summarized as follows: 1. Implementation of tritium transport capabilities and validation with experimental data: To enable modeling of tritium and other fission gases within MSRs, we implemented gas transport within MOSCATO via inclusion of couple mass transport equations within the salt and structural alloys. Comparisons to experimental data from literature showed good agreement with respect to tritium release rates. 2. Preliminary implementation of two-phase flow models in MOSCATO: To model tritium and other gases above their solubility limits, we implemented preliminary two-phase flow models within MOSCATO to account for bubble transport. The first model adopted was the Level-Set approach, which can handle the high void fraction regime, but with a requirement for high mesh resolution thus high computational expense. In this report, we present a verification of the Level-Set method using a simple benchmark case. We also performed a demonstration of the code as applied to an experimental case involving cover gas flow through salt in an experimental vessel. The second model adopted was the Eulerian-Eulerian dispersed flow model, which is computationally cheaper but limited to low void fraction regimes, such as bubbly flow. Validation and verification have not yet been performed for the Eulerian-Eulerian approach, but a preliminary implementation was completed. 3. Validation with static corrosion experiments: Static corrosion experimental data for stainless steel coupons within molten salts was used to further validate the corrosion model in MOSCATO. To do so, we leveraged the existing models in MOSCATO and simulated the sample mass loss and mass gain phenomena. Several ion species, including Cr 2+ , Fe 2+ and H + , were simulated in salt using the PNP solver, while Cr 0 and Fe 0 were simulated with a diffusion solver in stainless steel. The mass loss of the samples was compared with experimental data, and good agreement was achieved. These combined activities served to further expand the capabilities of MOSCATO and make it more generally applicable to the full range of phenomena that can control chemistry and corrosion in molten salt reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Cross Section Generation Capability in Griffin

The Griffin code is a Multiphysics Object-Oriented Simulation Environment (MOOSE) based reactor multiphysics analysis application jointly developed by Idaho National Laboratory and Argonne National Laboratory. The code includes a variety of steady-state solvers for fixed-source, k-eigenvalue, adjoint, and subcritical multiplication, as well as transient solvers for point-kinetics, improved quasi-static, and spatial dynamics. The code reads multigroup cross sections in the ISOXML format generated from external deterministic or Monte Carlo cross section generation codes. The implementation of the cross section generation capability in Griffin was initiated last year by plugging in the cross section application programming interface (CSAPI) and reviewing the methodologies for treating particulate fuels. The focus this year was on improving the CSAPI integration and implementing advanced self-shielding methods for applications to advanced reactor problems with TRISO fuels. First, the process for cross section library generation was updated to accurately and rigorously produce isotopic cross section data. Second, the on-the-fly slowing down method for the resonance treatment was implemented in CSAPI to improve the accuracy of effective multigroup cross sections in the resonance energy range. Among various on-the-fly slowing down methods, the equivalent Dancoff factor cell method was employed. Third, the iterative local spatial self-shielding method was implemented under the calculation framework of the equivalent Dancoff factor cell method to accurately deal with the double heterogeneity effect of particulate fuel. The updated CSAPI with the advanced self-shielding methods, together with the cross section libraries generated based on the improved process, were tested for the very high temperature reactor (VHTR), high temperature test reactor (HTTR), and Empire benchmark problems with various resonance self-shielding conditions, indicating that the updated CSAPI in Griffin is able to produce multigroup cross sections accurately and efficiently. We also show that the methodology works well for pebble bed fuel from HTR-10, but the capability still needs to be fully integrated into CSAPI. In the future, further benchmark tests will be performed for various thermal reactor core problems, including particulate fuel-based pebble bed reactors.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

TEX-Chlorine for TerraPower - Experimental Execution Report

This report describes the critical configurations of the TEX4TerraPower project that were performed in FY26Q4. Within this report, the configurations are presented along with physical measurements performed in support of benchmarking. TEX4TerraPower builds upon the TEX-Chlorine experiments, which in turn were based on the TEX-HEU experiments. Similar to TEX-Chlorine, the TEX4TerraPower configurations iteratively layered HEU fuel with sodium chloride (NaCl) absorbers. However, the main difference in the density achieved during the fabrication process of the sodium chloride absorbers. Unlike TEX-Chlorine, which was able to achieve ~70% theoretical density, the TEX4TerraPower salt plates achieved >90% theoretical density by hydraulically pressing the salt.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗

Data-Driven and Multiscale Modeling of DNA-Templated Dye Aggregates

Dye aggregates are of interest for excitonic applications, including biomedical imaging, organic photovoltaics, and quantum information systems. Dyes with large transition dipole moments (μ) are necessary to optimize coupling within dye aggregates. Extinction coefficients (ε) can be used to determine the μ of dyes, and so dyes with a large ε (>150,000 M –1 cm –1 ) should be engineered or identified. However, dye properties leading to a large ε are not fully understood, and low-throughput methods of dye screening, such as experimental measurements or density functional theory (DFT) calculations, can be time-consuming. In order to screen large datasets of molecules for desirable properties (i.e., large ε and μ), a computational workflow was established using machine learning (ML), DFT, time-dependent (TD-) DFT, and molecular dynamics (MD). ML models were developed through training and validation on a dataset of 8802 dyes using structural features. A Classifier was developed with an accuracy of 97% and a Regressor was constructed with an R2 of above 0.9, comparing between experiment and ML prediction. Using the Regressor, the ε values of over 18,000 dyes were predicted. The top 100 dyes were further screened using DFT and TD-DFT to identify 15 dyes with a μ relative to a reference dye, pentamethine indocyanine dye Cy5. Two benchmark MD simulations were performed on Cy5 and Cy5.5 dimers, and it was found that MD could accurately capture experimental results. The results of this study exhibit that our computational workflow for identifying dyes with a large μ for excitonic applications is effective and can be used as a tool to develop new dyes for excitonic applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter

The Compact Muon Solenoid (CMS) experiment is a general-purpose detector for high-energy collision at the Large Hadron Collider (LHC) at CERN. It employs an online data quality monitoring (DQM) system to promptly spot and diagnose particle data acquisition problems to avoid data quality loss. In this study, we present a semi-supervised spatio-temporal anomaly detection (AD) monitoring system for the physics particle reading channels of the Hadron Calorimeter (HCAL) of the CMS using three-dimensional digi-occupancy map data of the DQM. We propose the GraphSTAD system, which employs convolutional and graph neural networks to learn local spatial characteristics induced by particles traversing the detector and the global behavior owing to shared backend circuit connections and housing boxes of the channels, respectively. Recurrent neural networks capture the temporal evolution of the extracted spatial features. We validate the accuracy of the proposed AD system in capturing diverse channel fault types using the LHC collision data sets. The GraphSTAD system achieves production-level accuracy and is being integrated into the CMS core production system for real-time monitoring of the HCAL. We provide a quantitative performance comparison with alternative benchmark models to demonstrate the promising leverage of the presented system.

43 PARTICLE ACCELERATORS↗