Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Tensor network simulations of quasi-GPDs in the massive Schwinger model

Generalized parton distribution functions (GPDs) are off-diagonal light-cone matrix elements that encode the internal structure of hadrons in terms of quark and gluon degrees of freedom. In this work, we present the first nonperturbative study of quasi-GPDs in the massive Schwinger model, quantum electrodynamics in 1+1 dimensions (QED 2 ), within the Hamiltonian formulation of lattice field theory. Quasidistributions are spatial correlation functions of boosted states, which approach the relevant light-cone distributions in the luminal limit. Using tensor networks, we prepare the first excited state in the strongly coupled regime and boost it to close to the light-cone on lattices of up to 400 lattice sites. We compute both quasiparton distribution functions and, for the first time, quasi-GPDs, and study their convergence for increasingly boosted states. In addition, we perform analytic calculations of GPDs in the two-particle Fock-space approximation and in the Reggeized limit, providing qualitative benchmarks for the tensor network results. Our analysis establishes computational benchmarks for accessing partonic observables in low-dimensional gauge theories, offering a starting point for future extensions to higher dimensions, non-Abelian theories, and quantum simulations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Adaptive Quantum Generative Training using an Unbounded Loss Function

We propose a generative quantum learning algorithm using the Adaptive Derivative-Assembled Problem Tailored ansatz (ADAPT) framework in which the loss function to be minimized is the maximal quantum Rényi divergence of order two, an unbounded function that mitigates barren plateaus which inhibit training variational circuits. We benchmark this method against other state-of-the-art adaptive algorithms by learning random two-local thermal states. We perform numerical experiments of up to 12 qubits comparing our method learning algorithms that use linear objective functions and show that Rényi-ADAPT is capable of constructing shallow quantum circuits competitive with existing methods, while the gradients remain favorable resulting from the maximal Rényi divergence loss function.

quantum algorithms, quantum machine learning, quan↗

A Deep Generative Model for Non-Intrusive Identification of EV Charging Profiles

The proliferation of electric vehicles (EVs) brings environmental benefits and technical challenges to power grids. An identification algorithm which can accurately extract individual EV charging profiles out of widely available smart meter measurements has attracted great interests. This paper proposes a non-intrusive identification framework for EV charging profile extraction, which is driven by deep generative models (DGM). First, the proposed DGM is designed as a representation layer embedded into the Markov process and used to model the joint probability distribution of available time-series data. A novel contribution is to approximate posterior distributions by neural networks whose parameters are obtained by variational inference and supervised learning. Second, the EV charging status is inferred from the DGM via dynamic programming. Lastly, the desired EV charging profile can be reconstructed by the rated power of EV models and inferred status. Compared with the benchmark Hidden Markov Models, the proposed framework can better handle noise in data with less computational complexity and better overall accuracy performances with smaller recall. The proposed framework is validated by numerical experiments on the Pecan Street dataset.

33 ADVANCED PROPULSION SYSTEMS↗

U.S. Solar Photovoltaic System and Energy Storage Cost Benchmarks, With Minimum Sustainable Price Analysis: Q1 2022

NREL's bottom-up cost models can be used to assess the minimum sustainable price (MSP) and modeled market price (MMP) of PV and storage systems having various configurations. MSP can be used to estimate future potential cost-reduction opportunities for PV and PV-plus-storage systems, thus helping guide research and development aimed at advancing cost-effective system configurations. MMP can be used to understand the cost of systems under recent market conditions. The MSP data in this annual benchmarking report will be used to inform the formulation of, and track progress toward, the Solar Energy Technologies Office's Government Performance and Reporting Act cost targets.

14 SOLAR ENERGY↗

GO Competition Challenge 1 Benchmark Approach and Validation Support

At the outset ARPA-e’s grid optimization competition sought to test a hypothesis that modern nonlinear optimization methods had reached a level of performance and reliability necessary to optimize energy grids using nonlinear power flow equations. The results demonstrated by this project and the other participants in the grid optimization competition have demonstrated beyond any shadow of doubt that this hypothesis is true. This result suggest that the mathematical optimization technology now exists to produce a revolution in power grid optimization software, which would improve the efficiency of energy grid operations to the broad benefit of society.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Neutrino Interactions observed with Large Area Picosecond Photodetectors in ANNIE

The Accelerator Neutrino Neutron Interaction Experiment (ANNIE) is a 26-ton water-based neutrino detector located at Fermilab, approximately 110 m downstream of the Booster Neutrino Beam (BNB). ANNIE utilizes both photomultiplier tubes (PMTs) and advanced photodetectors, specifically Large Area Picosecond Photodetectors (LAPPDs), to detect Cherenkov light emitted by leptons produced in neutrino interactions within ANNIE. LAPPDs are a novel technology designed to detect photons with picosecond-level temporal resolution and sub-millimetre spatial precision. Multiple LAPPDs have been deployed in the ANNIE detector. This is the first use of this technology in a running particle physics experiment and has yielded the first detection of light from neutrino interactions in water with LAPPDs. In this poster, I will showcase the operational performance and functionality of LAPPDs in the ANNIE experiment. Neutrino beam data from the BNB is used to evaluate the timing precision, hit reconstruction performance, and beam response of deployed LAPPDs, demonstrating how this novel picosecond-resolution technology performs in a running neutrino water Cherenkov detector. This work highlights the successful integration of LAPPDs in ANNIE and provides quantitative benchmarks that inform their application in future neutrino experiments requiring high-resolution photon detection.

Aman, Mohammad Adil [Florida State U.] (ORCID:0009↗

2019 ASHRAE Handbook: HVAC Applications - Chapter 37 - Energy Use and Management

Handbook is a highly-regarded engineers reference book for heating, ventilating, air conditioning, and energy engineers. Building energy and water use metrics were developed for 53 commercial and residential building types. Supporting narrative was drafted and provided along with multiple tables of building performance metrics for publication in this ASHRAE handbook. ORNL (T. Sharp) developed the building performance metrics in Tables 2, 3, and 4 and authored the narrative about them. T. Sharp also authored the section on "Benchmarking Water Use" and developed building water use metrics published in Table 5.

Sharp, Terry↗

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

Hamilton, Kathleen↗

Revealing the Full Potential of Glycolated Mixed Ionic-Electronic Semiconductors – Symmetric Monomer Polymerization to Boost Electrochemical Transistor Performance

Organic electrochemical transistors (OECTs) enable the transduction of ionic signals into electronic outputs, positioning them as ideal candidates for next-generation sensing and (bio)signal processing applications. Recent years have witnessed the development of various OECT channel materials, affording insights into structural fine-tuning to achieve optimal performance and/or stability. However, homocouplings, commonly present in alternating conjugated polymers, have largely been overlooked. This study investigates the effect of homocoupling on OECT materials by employing two synthesis methods – standard Stille polymerization and an alternative symmetric approach – to create the p-type enhancement-mode benchmark polymer pgBTTT. The impact of homocoupling, and its absence, is studied by comparing the bulk properties of the two polymers and evaluating their respective OECT metrics. The new, homocoupling-free polymer exhibits a notably improved OECT performance ( μC *), mainly due to an average 3-fold increase in electronic mobility (μ).

defects↗

SRBench++: Principled Benchmarking of Symbolic Regression With Domain-Expert Interpretation

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main promise of this approach is that it may return an interpretable model that can be insightful to users, while maintaining high accuracy. The current standard for benchmarking these algorithms is SRBench, which evaluates methods on hundreds of datasets that are a mix of real-world and simulated processes spanning multiple domains. At present, the ability of SRBench to evaluate interpretability is limited to measuring the size of expressions on real-world data, and the exactness of model forms on synthetic data. In practice, model size is only one of many factors used by subject experts to determine how interpretable a model truly is. Furthermore, SRBench does not characterize algorithm performance on specific, challenging sub-tasks of regression such as feature selection and evasion of local minima. In this work, we propose and evaluate an approach to benchmarking SR algorithms that addresses these limitations of SRBench by 1) incorporating expert evaluations of interpretability on a domain-specific task, and 2) evaluating algorithms over distinct properties of data science tasks. We evaluate 12 modern symbolic regression algorithms on these benchmarks and present an in-depth analysis of the results, discuss current challenges of symbolic regression algorithms and highlight possible improvements for the benchmark itself.

97 MATHEMATICS AND COMPUTING↗

Performance-Aligned LLMs for Generating Fast HPC Code

Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor performance can originate from disparate sources and be difficult to diagnose. Recent years have seen a multitude of work that use large language models (LLMs) to assist in software development tasks. However, these tools are trained to model the distribution of code as text, and are not specifically designed to understand performance aspects of code. In this work, we introduce a reinforcement learning based methodology to align the outputs of code LLMs with performance. This allows us to build upon the current code modeling capabilities of LLMs and extend them to generate better performing code. Here, we demonstrate that our fine-tuned model improves the expected speedup of generated code over base models for a set of benchmark tasks from 0.9 to 1.6 for serial code and 1.9 to 4.5 for OpenMP parallel code.

Computer science↗

Foams in Hohlraums

Foam materials are starting to find application in laser-heated hohlraums used to drive inertial confinement fusion (ICF) implosions. The disparate scales of the solid foam elements (nm) compared to the typical problem scale (mm) make it expensive to resolve the individual foam elements in hydrodynamic calculations. In this project we developed two new models for treating foam materials – a 3D hydrodynamic model that treats the foam as bits of pre-expanded solid material separated by voids, and a subgrid model that captures the essential physics of laser-heated foams without requiring resolution of the individual solid elements. We also explored the microphysics of the transition from interpenetrating kinetic behavior to fully-collisional fluid-like behavior during the early time heating and expansion of foam elements through a combination of single-fluid and multi-fluid hydrodynamics calculations and particle-in-cell calculations. The model was benchmarked against these calculations and against experimental data on laser-heated chemical and additive-manufactured (AM) foams. Since there was no existing data on laser-heated AM foams, we performed the first experiments on such foams at the Jupiter Laser Facility. Samples of three different types of printed AM foams were heated using a single 0.5 micron laser. The foam densities ranged from 10 to 100 mg/cc (supercritical for 0.5 micron light). We measured the backscattered light (power and spectrum), the transmitted light, and the time-integrated temperature of the foam samples. This benchmarked subgrid foam model is a new capability that should allow routine calculation of ICF designs using foam elements, potentially opening up a new design space.

36 MATERIALS SCIENCE↗

Critical and Californium Source-Driven Noise Analysis Subcritical Measurements with an Unreflected Cylindrical Tank of Mixed Uranium-Plutonium Nitrate Solution

The reported experiments were performed by Oak Ridge National Laboratory (ORNL) at the Battelle Northwest Laboratory’s (now Pacific Northwest National Laboratory) critical experiments facility at Hanford, Washington in 1981 and used 16 days of critical facility time, not including 10 days for setup and removal of ORNL equipment. These measurements were to assess the capability of the Cf source-driven noise analysis (CSDNA) method to measure the subcriticality (keff) of mixed U-Pu nitrate solutions. In addition to the CSNDA measurements, measurements were also performed near delayed criticality where CSDNA measurements cannot be performed. This report documents the experiments that were not reported at that time by presenting the ORNL experimental results and any online analysis performed during and shortly after the measurements. The mixed nitrate solution had a U concentration at 188 grams per liter (g/L), a Pu concentration of 280 g/L, free acid normality of 2.80, H ion molarity of 5.9 and a specific gravity of 1.754 g/cm 3 , a 240 Pu isotopic content of 7.981 wt. %, and a 235 U isotopic content of 0.724 wt. %. The stainless-steel tank for the solution had an inside diameter of 35.38 cm, an outside diameter of 35.53 cm, a height of 56.72 cm, and bottom thickness of 0.9525 cm. A Zircaloy pipe with a 3.1496 cm outside diameter, a 2.7788 cm inside diameter, and bottom thickness of 0.635 cm was available for insertion of the Cf source in the center of the fissile solution. The Cf source was also located at the outside surface of the tank (solution height varied from 10 to 53 cm) and in the center of the solution (solution height varied from 10 to 60.7 cm). The CSDNA measurements were not analyzed online to determine the subcritical neutron multiplication factors. At all subcritical states, the break frequency noise analysis data was fitted to obtain the prompt neutron decay constant. The neutron multiplication factors were determined for the two configurations of the measurements near delayed criticality. The subcritical neutron multiplication factors from the CNSDA measurements can be obtained with further analysis. However, the near delayed critical configuration, the prompt neutron decay constants, the count rates, and the measured cross and auto power spectral densities can be calculated directly for benchmarking. Much of data presented in this report are from ORNL notes—not in the ORNL logbooks. For the final benchmark analysis, the data from the Battelle Northwest Laboratory (which operated the critical facility in 1981) critical facility logbook should be consulted and be incorporated where appropriate. The purpose of this report is to document the experimental information for the measurements performed so that at a later date researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Program (ICSBEP) or Nuclear Energy Agency benchmark. The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory. Preparation of the present report is part of a larger cooperative effort between Idaho National Laboratory (INL) and Oak Ridge National Laboratory (ORNL) to document more than 15 undocumented critical and subcritical experiments enumerated in ORNL/TM-2019/18 and performed by ORNL at ORCEF and other USDOE critical experiments facilities using more than 500 operational days of critical facility time.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

We describe the outcome of a data challenge conducted as part of the Dark Machines (https://www.darkmachines.org) initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims to detect signals of new physics at the Large Hadron Collider (LHC) using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 billion simulated LHC events corresponding to 10\, fb^{-1} 10 f b − 1 of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SERGHEI (SERGHEI-SWE) v1.0: a performance-portable high-performance parallel-computing shallow-water solver for hydrology and environmental hydraulics

The Simulation EnviRonment for Geomorphology, Hydrodynamics, and Ecohydrology in Integrated form (SERGHEI) is a multi-dimensional, multi-domain, and multi-physics model framework for environmental and landscape simulation, designed with an outlook towards Earth system modelling. At the core of SERGHEI's innovation is its performance-portable high-performance parallel-computing (HPC) implementation, built from scratch on the Kokkos portability layer, allowing SERGHEI to be deployed, in a performance-portable fashion, in graphics processing unit (GPU)-based heterogeneous systems. In this work, we explore combinations of MPI and Kokkos using OpenMP and CUDA backends. In this contribution, we introduce the SERGHEI model framework and present with detail its first operational module for solving shallow-water equations (SERGHEI-SWE) and its HPC implementation. This module is designed to be applicable to hydrological and environmental problems including flooding and runoff generation, with an outlook towards Earth system modelling. Its applicability is demonstrated by testing several well-known benchmarks and large-scale problems, for which SERGHEI-SWE achieves excellent results for the different types of shallow-water problems. Finally, SERGHEI-SWE scalability and performance portability is demonstrated and evaluated on several TOP500 HPC systems, with very good scaling in the range of over 20 000 CPUs and up to 256 state-of-the art GPUs.

58 GEOSCIENCES↗

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗

LibERI—A portable and performant multi-GPU accelerated library for electron repulsion integrals via OpenMP offloading and standard language parallelism

A portable and performant graphics processing unit (GPU)-accelerated library for electron repulsion integral (ERI) evaluation, named LibERI, has been developed and implemented via directive-based (e.g., OpenMP and OpenACC) and standard language parallelism (e.g., Fortran DO CONCURRENT). Offloaded ERIs consist of integrals over low and high contraction s, p, and d functions using the rotated-axis and Rys quadrature methods. GPU codes are factorized based on previous developments with two layers of integral screening and quartet presorting. In this work, the density screening is moved to the GPU to enhance the computational efficacy for large molecular systems. Here, the L-shells in the Pople basis set are also separated into pure S and P shells to increase the ERI homogeneity and reduce atomic operations and the memory footprint. LibERI is compatible with any quantum chemistry drivers supporting the MolSSI Driver Interface. Benchmark calculations of LibERI interfaced with the GAMESS software package were carried out on various GPU architectures and molecular systems. The results show that the LibERI performance is comparable to other state-of-the-art GPU-accelerated codes (e.g., TeraChem and GMSHPC) and, in some cases, outperforms conventionally developed ERI CUDA kernels (e.g., QUICK) while fully maintaining portability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of the response to electrons and pions in the scintillating fiber and lead calorimeter for the future electron-ion collider

The performance of the Baby Barrel Electromagnetic Calorimeter (Baby BCAL) — a small-scale lead-scintillating-fiber (Pb/ScFi) prototype of the GlueX Barrel Electromagnetic Calorimeter (BCAL) — was tested in a dedicated beam campaign at the Fermilab Test Beam Facility (FTBF). This study provides a benchmark for the Pb/ScFi component of the future Barrel Imaging Calorimeter (BIC) in the ePIC detector at the Electron-Ion Collider (EIC). The detector response to electrons and pions was studied at beam energies between 4 and 10 GeV, extending previous GlueX tests to a higher energy regime. The calibrated detector exhibits good linearity within uncertainties, and its electron energy resolution meets EIC requirements. The data further constrain the constant term in the energy resolution to below 1.9%, improving upon previous constraints at lower energies. Simulations reproduce key features of the electron and pion data within the limitations of the collected dataset and the FTBF test environment. Electron-pion separation in the test beam setup was analyzed using multiple methods, incorporating varying degrees of beam-related effects. The inclusion of longitudinal shower profile information enhanced the separation performance, underscoring its relevance for the full-scale BIC in ePIC. These results provide essential benchmarks for the Pb/ScFi section of the future BIC, validating detector simulations and guiding optimization strategies for electron-pion discrimination.

47 OTHER INSTRUMENTATION↗