SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Benchmarking Simulated Precipitation Variability Amplitude across Time Scales

Here, objective performance metrics that measure precipitation variability across time scales from subdaily to interannual are presented and applied to Historical simulations of Coupled Model Intercomparison Project phase 5 and 6 (CMIP5 and CMIP6) models. Three satellite-based precipitation estimates (IMERG, TRMM, and CMORPH) are used as reference data. We apply two independent methods to estimate temporal variability of precipitation and compare the consistency in their results. The first method is derived from power spectra analysis of 3-hourly precipitation, measuring forced variability by solar insolation (diurnal and annual cycles) and internal variability at different time scales (subdaily, synoptic, subseasonal, seasonal, and interannual). The second method is based on time averaging and facilitates estimating the seasonality of subdaily variability. Supporting the robustness of our metric, we find a near equivalence between the results obtained from the two methods when examining simulated-to-observed ratios over large domains (global, tropics, extratropics, land, or ocean). Additionally, we demonstrate that our model evaluation is not very sensitive to the discrepancies between observations. Our results reveal that CMIP5 and CMIP6 models in general overestimate the forced variability while they underestimate the internal variability, especially in the tropical ocean and higher-frequency variability. The underestimation of subdaily variability is consistent across different seasons. The internal variability is overall improved in CMIP6, but remains underestimated, and there is little evidence of improvement in forced variability. Increased horizontal resolution results in some improvement of internal variability at subdaily and synoptic time scales, but not at longer time scales.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Updates and Validation for the n+ 63,65 Cu Cross Sections [Slides]

The RRR and URR parameters for 63,65 Cu have been optimized to transmission and capture data. Several data sets have been newly incorporated in this evaluation. The angular distribution parameters have been adopted from differential measurements, as was done in ENDF/B-V. The performance of this evaluation in the integral benchmark calculations is favorable, and the validation is ongoing.

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2024

Detection of Isotopes in Urban Source Search Gamma Spectra Using Hopfield Neural Network

Source search campaigns involve the measurement of consecutive background gamma-ray spectra obtained with a mobile detector-spectrometer, such as tellurium-doped sodium iodide NaI(Tl) scintillator detector-spectrometer. Counts are measured with NaI(Tl) detector in short acquisition intervals, such as one second. Detection of isotopes in search data is challenging because of the low signal-to-noise ratio (S/N) of the spectral lines and highly varying background due to naturally occurring radioactive material (NORM). In this work, we investigate the performance of the detection of orphan Cs-137, Am-241, and I-131 isotopes in a gamma ray data set obtained in a search survey. Isotopic detection is performed with a Hopfield Neural Network (HNN), which implements an auto-associative memory by matching incoming measurements to the closest one of its memory-stored signature patterns. HNN is trained on examples of spectra of calibrated isotopic sources with well-resolved spectral lines. During testing, HNN processes spectra with partially complete or distorted isotopic lines. The performance of the HNN detection algorithm is benchmarked with Precision, Recall, and F1 scores. Test results demonstrate the potential of HNN to detect the isotope of interest with high accuracy (F1 > 90%) for all isotopes in this study.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Recent High Burnup LOCA Testing at Oak Ridge National Laboratory

To improve fuel cycle economics, increasing the fuel burnup limit in light-water reactors requires a solid technical foundation. Observations from experiments at Halden and Studsvik highlighted severe fuel fragmentation during loss-of-coolant-accident (LOCA) conditions, indicating a need for further technical considerations. These experiments suggest that the fragmentation threshold for high-burnup fuel might be influenced by pre-transient power levels. Consequently, additional LOCA test data are essential to complement existing findings and to deepen our understanding. Oak Ridge National Laboratory’s Severe Accident Test Station has been instrumental in advancing knowledge about high-burnup fuel fragmentation, relocation, and dispersal. This milestone report details two high-burnup LOCA tests designed to evaluate the effects of terminal temperature and grid spacers (or cladding restraints) on fuel fragmentation and relocation susceptibility. In addition, BISON fuel performance modeling and out-of-cell benchmark testing were conducted to better interpret the in-cell test results. These tests were developed in collaboration with fuel vendors to ensure that the results provide valuable data for topical reports and support the Nuclear Regulatory Commission’s review.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

RAG for FLAG: AI Assistance for a Physics Code

Artificial intelligence (AI) has quickly become an important tool in scientific research, where significant efforts are underway to develop tools that will expedite the research process. One area of particular impact is scientific software, which can be particularly complex, and therefore time consuming to learn and use effectively. AI assistants are increasingly helping to streamline the process by performing tasks such as interactively answering user questions or suggesting solutions. Los Alamos National Laboratory (LANL) develops several advanced scientific codes, such as FLAG, which can be used to run multiphysics simulations. With this study, our goal was to develop an AI assistant for FLAG that could help make the process of understanding the software and running physics simulations more efficient. To develop an AI assistant for FLAG, we used a method called retrieval-augmented generation (RAG), which is a technique that uses information from relevant data sources to enhance the accuracy of large language models (LLMs). We used the FLAG user manual and other FLAG documentation as the knowledge base for the RAG system. When a user provides a query, RAG retrieves relevant sections from the knowledge base in response, then uses those excerpts to generate grounded and contextually rich answers. We found that our AI assistant was able to provide context aware answers and source references to user queries. To evaluate performance, we developed a set of 40 benchmark questions and compared the accuracy of the responses to those of two standard LLMs without retrieval. Our AI assistant significantly outperformed the standard LLMs at answering FLAG-related questions, with an 82.5% accuracy rate, compared to 47.5% for both of the standard LLMs. This has the potential to make the process of learning and using FLAG much easier, especially for new users. Ultimately, it supports LANL’s broader mission by empowering scientists and engineers to focus more on discovery and analysis rather than on navigating complex software systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Fast and Thermal Neutron Spectrum Dosimetry Measurements in the Advanced Test Reactor large-B and small-I Positions Following the Sixth Core Internals Change-out [Slides]

The Advanced Test Reactor (ATR) has a wide variety of irradiation positions that have had experiments that were developed by users from around the world. Most experiment irradiations rely on thoroughly benchmarked numerical models. However, some irradiation positions in ATR are not as well- characterized and are complicated by spectral perturbations from control cylinder orientation. The “small I” and “large-B” irradiation positions are located nearby control cylinders and suffer from these flux perturbations from control cylinder orientations that change during an irradiation cycle to maintain the desired core power distribution. Models predicted that these types of position would exhibit both spectral shifts and amplitude changes in neutron flux, but few measurements have been conducted to benchmark these predictions. Recently, requalification testing was performed to confirm the operational readiness of the ATR following the completion of the Core Internals Change-out (CIC). These tests provided a unique opportunity to validate the analytical methods used to simulate the ATR because nearly all components in the reactor were in a clean as-built state, significantly reducing modelling uncertainties. One subset of the testing included characterization of the fast and thermal neutron flux in the “small-I” and “large-B” positions using silver, cobalt, and nickel neutron dosimetry. In contrast to typical irradiation cycles, the control cylinders were held in position during the post-CIC nuclear testing. The specific activity of these dosimeter wires was measured following two low-power tests with different control cylinder positions.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2024

Randomized measurement protocols for lattice gauge theories

Randomized measurement protocols, including classical shadows, entanglement tomography, and randomized benchmarking are powerful techniques to estimate observables, perform state tomography, or extract the entanglement properties of quantum states. While unraveling the intricate structure of quantum states is generally difficult and resource-intensive, quantum systems in nature are often tightly constrained by symmetries. Furthermore, this can be leveraged by the symmetry-conscious randomized measurement schemes we propose, yielding clear advantages over symmetry-blind randomization such as reducing measurement costs, enabling symmetry-based error mitigation in experiments, allowing differentiated measurement of (lattice) gauge theory entanglement structure, and, potentially, the verification of topologically ordered states in existing and near-term experiments. Crucially, unlike symmetry-blind randomized measurement protocols, these latter tasks can be performed without relearning symmetries via full reconstruction of the density matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Leveraging Artificial Intelligence to Expedite Antibody Design and Enhance Antibody–Antigen Interactions

This perspective sheds light on the transformative impact of recent computational advancements in the field of protein therapeutics, with a particular focus on the design and development of antibodies. Cutting-edge computational methods have revolutionized our understanding of protein–protein interactions (PPIs), enhancing the efficacy of protein therapeutics in preclinical and clinical settings. Central to these advancements is the application of machine learning and deep learning, which offers unprecedented insights into the intricate mechanisms of PPIs and facilitates precise control over protein functions. Despite these advancements, the complex structural nuances of antibodies pose ongoing challenges in their design and optimization. Our review provides a comprehensive exploration of the latest deep learning approaches, including language models and diffusion techniques, and their role in surmounting these challenges. We also present a critical analysis of these methods, offering insights to drive further progress in this rapidly evolving field. The paper includes practical recommendations for the application of these computational techniques, supplemented with independent benchmark studies. These studies focus on key performance metrics such as accuracy and the ease of program execution, providing a valuable resource for researchers engaged in antibody design and development. Through this detailed perspective, we aim to contribute to the advancement of antibody design, equipping researchers with the tools and knowledge to navigate the complexities of this field.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Accelerated Charged Particle Tracking with Graph Neural Networks on FPGAs

We develop and study FPGA implementations of algorithms for charged particle tracking based on graph neural networks. The two complementary FPGA designs are based on OpenCL, a framework for writing programs that execute across heterogeneous platforms, and hls4ml, a high-level-synthesis-based compiler for neural network to firmware conversion. We evaluate and compare the resource usage, latency, and tracking performance of our implementations based on a benchmark dataset. We find a considerable speedup over CPU-based execution is possible, potentially enabling such algorithms to be used effectively in future computing workflows and the FPGA-based Level-1 trigger at the CERN Large Hadron Collider.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Research and Development Pathways for Powering the Blue Economy with Marine Renewable Energy

As marine renewable energy technology is adapted or designed for Blue Economy end-uses, challenges unique to operation at sea and in remote coastal areas must be addressed to meet demands distinct from utility grid electricity generation. Foundational research and development with this end goal is conducted to broadly enable the initiative of Powering the Blue Economy. Determination of distinct R\&D topics is informed by pathways including an engineering design customer-driven approach and feedback from the creation and administration of prize competitions in the Blue Economy technology space. Critical research outcomes, such as determining the performance of small wave energy converters and benchmarking the reliability for power systems at sea, are among the goals of ten foundational R\&D projects currently underway.

Cavagnaro, Robert J.↗

DOE OSTI2021

Research and Development Pathways for Powering the Blue Economy with Marine Renewable Energy

As marine renewable energy technology is adapted or designed for Blue Economy end-uses, challenges unique to operation at sea and in remote coastal areas must be addressed to meet demands distinct from utility grid electricity generation. Foundational research and development with this end goal is conducted to broadly enable the initiative of Powering the Blue Economy. Determination of distinct R&D topics is informed by pathways including an engineering design customer-driven approach and feedback from the creation and administration of prize competitions in the Blue Economy technology space. Critical research outcomes, such as determining the performance of small wave energy converters and benchmarking the reliability for power systems at sea, are among the goals of ten foundational R&D projects currently underway.

customer discovery↗

DOE OSTI2022

Implementation of hybrid finite element method based transport solver in GRIFFIN

A new transport solver option based on the hybrid FEM (HFEM) was implemented in GRIFFIN, the MOOSE-based reactor analysis code, as an effort to support routine core design calculations for advanced reactor applications. The HFEM formulation with P{sub N} (spherical harmonics expansion), akin to the variational nodal method, is effective for solving a spatially homogenized problem with strong transport effect. The residual and Jacobian evaluations of the HFEM weak form were derived and successfully implemented in GRIFFIN, having the diffusion and the PN options available in the new HFEM based transport solver. The performance was tested with the simplified ABTR benchmark problems. The results indicate that the HFEM-based transport solver is a feasible option for solving problems with spatially homogenized and strong streaming by providing superior accuracy with a proper p-refinement. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2026

Scintillation light calibrations, systematic uncertainties, and triggering efficiency in the MicroBooNE detector

Scintillation light, produced alongside ionisation charge from particle interactions, plays a critical role in liquid argon time projection chamber (LArTPC) detectors. A detailed understanding of its production and detection mechanisms is essential for robust calibration, systematic uncertainty evaluation, and physics analysis. This article describes the MicroBooNE light simulation, light-based triggering schemes, photomultiplier tube gain calibration, light response stability, and light-based systematic uncertainties over the course of five years of data collection. In addition, we present a measurement of scintillation light triggering efficiency, focusing on the lowest-light regime relevant to rare-event searches and low-energy neutrino interactions. Finally, we discuss two notable observations in MicroBooNE's data, both reported here for the first time: an approximately 50% decline in MicroBooNE's light yield over time, concentrated in the first two years of running; and a higher than expected O(200 kHz) rate of single photoelectron noise. The results presented provide an important benchmark of long-term light detection performance in LArTPC neutrino detectors.

Abratenko, P. [Tufts U.]↗

DOE OSTI2024

A317_Fast and Thermal Neutron Spectrum Dosimetry Measurements in the Advanced Test Reactor large-B and small-I Positions Following the Sixth Core Internals Change-out

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2024

Enhancing Solar Power Forecasting with Regularized Constrained Quantile Regression Averaging and Bootstrapping Techniques

Probabilistic solar power forecasting (SPF) plays an essential role in optimizing power-grid operations by quantifying the forecast uncertainty. To improve the accuracy and robustness of probabilistic SPF, this paper introduces the regularized constrained quantile regression averaging (rCQRA) method to combine outputs from multiple PSPF models. In addition, a bootstrapping method was used to quantify model uncertainty, providing insights into the reliability and significance of each ensemble component. To evaluate its efficacy, the proposed rCQRA method is used to integrate four PSPF methods. The resulting SPF models are trained and validated using a real-world six-year dataset from a rooftop solar plant in the USA. The performance of the proposed rCQRA method is evaluated and compared with two benchmark methods under three categories of weather conditions. It is shown that the rCQRA method has superior performance in its forecast reliability, sharpness, and accuracy.

Ensemble learning, probabilistic solar power forec↗

DOE OSTI2026

Automating Detection and Diagnosis of Faults, Failures, and Underperformance in PV Plants

The project developed hybrid physics-based and machine-learning methods for near-real-time detection of balance-of-system faults (e.g., string, combiner, and tracker outages) in utility-scale Photovoltaic plants, achieving over 50% true positive rates with under 10% false positives and significantly reducing engineering setup time. In the extended phase, the scope expanded to plant-level underperformance analysis and industry benchmarking through the SUPER.epri.com platform. SUPER standardizes data processing and performance metrics across more than 9 GWac and 120+ plants, enabling robust comparisons and insights into loss rates, inverter downtime, and capacity degradation.

14 SOLAR ENERGY↗

DOE OSTI2024

HamPerf: A Hamiltonian-Oriented Approach to Quantum Benchmarking

Quantum computing technologies are undergoing rapid development. The different qubit modalities being considered for quantum computing each have their strengths and weaknesses, making it challenging to compare their performance relative to each other and the state-of-the-art in classical high-performance computing. To better understand the utility of a given quantum processor and to assess when and how it will be able to advance the frontiers of computational science, researchers need a robust approach to quantum benchmarking. A variety of approaches have been proposed, many of which characterize the presence of noise in current quantum devices. These efforts include component-level performance metrics, such as randomized benchmarking and gate set tomography; high-level application-dependent metrics; and devicelevel metrics, such as the Quantum Volume. However, it remains unclear how low-level metrics, such as fidelities and decoherence times, and global device metrics, such as Quantum Volume, relate to the computational utility and practical limitations of quantum processors to solve useful problems. In this paper, we describe our Hamiltonian-oriented approach to quantum benchmarking called HamPerf. Where previous application-dependent approaches specify a suite of benchmarking circuits inspired by applications, we place the problem Hamiltonian at the center. Our strategy allows us to probe the computational performance of a quantum processor on standardized and relevant problem sets, agnostic of the algorithms and hardware used to solve them; it also provides fundamental insights into how device characteristics correlate with computational utility.

Butko, Anastasiia↗

DOE OSTI2023

High Multiplication Neutron Noise Measurements Using the 7uPCX Assembly

The Seven Percent Critical Experiment, or 7uPCX, is a system that mimics the physics of light water nuclear reactor systems by using uranium dioxide fuel pins at an enrichment of approximately 7%. 7uPCX is often used for benchmarking and nuclear data purposes. As part of a collaboration between Lawrence Livermore National Laboratory, Los Alamos National Laboratory, Sandia National Laboratories, and the Institut de Radioprotection et de Sûreté Nucléaire, measurements were performed in support of a high-multiplication, subcritical benchmark candidate for a thermal system. The measurements were completed by making subcritical configurations using the fuel loading pattern of a well-documented configuration of the Seven Percent Critical Experiment at Sandia National Laboratories, which exists as a benchmark in the International Criticality Safety Benchmark Evaluation Project handbook. These measurements, which aimed to capture multiplications ranging from approximately 10 to 1,000, also serve as an intercomparison between both the fielded detector systems and analysis methodologies with the goal of better characterizing the detectors and their ability to capture the state of the criticality these types of systems. Los Alamos National Laboratory’s measurements for this collaboration were made with five linked helium-3 based neutron multiplicity detectors placed on the periphery of the reactor tank beyond the infinite reflector thickness of water, and four organic scintillators placed in dry-wells in-reactor near the edge of the upper fuel grid plate. This work captures the Los Alamos National Laboratory measurements, the Rossi-α and Feynman-Y results, provides an intercomparison between the results of the 3 He neutron detectors and the organic scintillators, compares to simulation where possible, and expands on future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗