SEARCH · Engineering Papers

Results for “Critical Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Entanglement-Enhanced Neyman-Pearson Target Detection

Quantum illumination (QI) provides entanglement-enabled target-detection enhancement, despite operating in an entanglement-breaking environment. Existing experimental studies of QI have utilized a Bayesian approach, assuming that the target is equally likely to be present or absent before detection, to demonstrate an advantage over classical target detection. However, such a premise breaks down in practical operational scenarios in which the prior probability is unknown, thereby hindering QI's applicability to real-world target-detection scenarios. In this work, we adopt the Neyman-Pearson criterion in lieu of the error probability for equally likely target absence or presence as our figure of merit for QI. We demonstrate an unconditional quantum advantage over the optimal classical-illumination protocol as benchmarked by the receiver operating characteristic, which examines detection probability versus false-alarm probability without resorting to known prior probabilities. Our work represents a critical advancement in adapting quantum-enhanced sensing to practical operational settings.

Ward, William↗

DOE OSTI2013

Benchmark Modeling of the Near-Field and Far-Field Wave Effects of Wave Energy Arrays

This project is an industry-led partnership between Columbia Power Technologies and Oregon State University that will perform benchmark laboratory experiments and numerical modeling of the near-field and far-field impacts of wave scattering from an array of wave energy devices. These benchmark experimental observations will help to fill a gaping hole in our present knowledge of the near-field effects of multiple, floating wave energy converters and are a critical requirement for estimating the potential far-field environmental effects of wave energy arrays. The experiments will be performed at the Hinsdale Wave Research Laboratory (Oregon State University) and will utilize an array of newly developed Buoys' that are realistic, lab-scale floating power converters. The array of Buoys will be subjected to realistic, directional wave forcing (1:33 scale) that will approximate the expected conditions (waves and water depths) to be found off the Central Oregon Coast. Experimental observations will include comprehensive in-situ wave and current measurements as well as a suite of novel optical measurements. These new optical capabilities will include imaging of the 3D wave scattering using a binocular stereo camera system, as well as 3D device motion tracking using a newly acquired LED system. These observing systems will capture the 3D motion history of individual Buoys as well as resolve the 3D scattered wave field; thus resolving the constructive and destructive wave interference patterns produced by the array at high resolution. These data combined with the device motion tracking will provide necessary information for array design in order to balance array performance with the mitigation of far-field impacts. As a benchmark data set, these data will be an important resource for testing of models for wave/buoy interactions, buoy performance, and far-field effects on wave and current patterns due to the presence of arrays. Under the proposed project we will initiate high-resolution (fine scale, very near-field) fluid/structure interaction simulations of buoy motions, as well as array-scale, phase-resolving wave scattering simulations. These modeling efforts will utilize state-of-the-art research quality models, which have not yet been brought to bear on this complex problem of large array wave/structure interaction problem.

16 TIDAL AND WAVE POWER↗

DOE OSTI2023

Invited Paper: Benchmarking and Optimizing Data Movement on Emerging Heterogeneous Architectures

As supercomputers evolve, nodes are continually increasing in complexity. As a result, each generation of parallel systems brings new performance challenges. For instance, on recent systems inter-node communication has outperformed inter-socket, resulting in poor performance of many node-aware communication optimizations. Communication optimizations are critical for the performance and scalability of parallel applications, but are dependent on the parallel architecture, which varies significantly among recent generations of supercomputers. Furthermore, this paper investigates the performance of various paths of data movement on recent generations of systems, and analyzes the increased complexity of communication, particularly on recent heterogeneous systems. The paper also introduces MPI Advance, a communication library that enables optimizations to be created based on benchmark analysis of each emerging system.

benchmarking↗

DOE OSTI2014

SU-E-T-413: Experience-Based VMAT Plan Quality Database

Purpose: To quantify VMAT plan quality using a retrospective study of over 200 clinical treated VMAT plans created using the Eclipse Treatment Planning System to create benchmarks of plan quality for a few categories of treatment sites. Methods: Using a controlled phantom geometry, various dosimetric indices were investigated to quantify dosimetric plan quality as a function of isocenter displacement from center of mass, average path length, number of arcs and PTV proximity to critical structures. Beginning with published dosimetry indices from SRS and SBRT evaluations, UDI (Unified Dosimetry Index) and modified UDI were tested before creating a new factor VMAT-DI. VMAT-DI was developed within boundaries of this project and it includes renormalized factors of conformity index, coverage index, modified gradient index and homogeneity index as well as indices based on routine clinical practice such as absolute dose max index. The plans were then evaluated using the VMAT-DI such that benchmarks for planning could be created. Results: The majority of the plans evaluated could be assigned VMAT-DI values within a range for each treatment site. However, the outliers were results of difficult planning parameters such as very irregular targets, inhomogeneities or difficult to achieve critical structure constraints. To effectively use VMAT-DI for guidance, especially for prediction of the plan quality for body sites new to the practice, VMATDI database needs to be subdivided by target complexity and by body site index/average path length factor. Conclusion: An experienced-based VMAT-DI database can be used to help analyze plans before evaluation by the physician to show that it adheres to the clinical standards of previously treated VMAT plans which will make a guideline for concluding the optimization. The introduction of institution-wide clinical planning protocols, standardizing OAR naming and constraints will make it possible to incorporate a cumulative critical structure dosimetry index such as NTCP.

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2013

Gyrokinetic simulation of global and local Alfvén eigenmodes driven by energetic particles in a DIII-D discharge

The unstable spectrum of Alfvén eigenmodes (AEs) driven by neutral beam-sourced energetic particles (EPs) in a benchmark DIII-D discharge (142111) is calculated in a fully gyrokinetic model using the GYRO code's massively parallel linear eigenvalue solver. One cycle of the slow (equilibrium scale) frequency sweep of the reverse shear Alfvén eigenmode (RSAE) at toroidal mode number n=3 is mapped. The RSAE second harmonic and an unstable beta-induced Alfvén eigenmode (BAE) are simultaneously tracked alongside the primary RSAE. An observed twist in the eigenmode pattern, caused mostly by shear in the driving EP profile, is shown through artificially varying the E×B rotational velocity shear to depend generally on shear in the local wave phase velocity. Coupling to the BAE and to the toroidal Alfvén eigenmode limit the RSAE frequency sweeps at the lower and upper end, respectively. While the present fully gyrokinetic model (including thermal ions and electrons) constitutes the best treatment of compressibility physics available, the BAE frequency is overpredicted by about 20% against experiment here and is found to be sensitive to energetic beam ion pressure. The RSAE frequency is more accurately matched except when it is limited by the BAE. Simulations suggest that the experiment is very close to marginal AE stability at points of RSAE-BAE coupling. A recipe for comparing the radial profile of quasilinear transport flux from local modes to that from global modes paves the way for the development of a stiff (critical gradient) local AE transport model based on local mode stability thresholds.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Flow reversal benchmark of a one-sided heated narrow rectangular channel with CATHARE and RELAP5

Flow reversal in narrow coolant channels can be a crucial phenomenon for the safety of research reactors with a downward nominal flow direction. During a loss of forced flow accident, the downward flow stagnates briefly before transitioning into an upward natural circulation flow. The fuel may be damaged if dryout occurs and threshold fuel and/or cladding temperatures are exceeded. A comprehensive study is provided for flow reversal in narrow rectangular channels by examining experimental data and conducting software model analyses. The literature on flow reversal was reviewed, and selected experimental datasets were used to benchmark against CATHARE and RELAP5 models and also compare the code calculations with each other. The experimental data comes from flow reversal tests conducted with a narrow rectangular channel with one-sided heating. The results were compared with experimental data for successful flow reversal tests and predicted dryout power for dryout conditions. Also, the study examined the effects of the pump coastdown period, inlet liquid temperature, system pressure, and localized pressure drops. The experimental results showed that shorter coastdown periods, reduced pressure drops, and lower coolant inlet temperatures increased the dryout power. However, the system pressure did not noticeably affect the results. The simulation results showed that both CATHARE and RELAP5 agreed with experimental data, capturing the trends of the experimental results. Slight differences between each code calculation, as well as the predicted and measured dryout powers, were attributed to experimental uncertainties and the modeling of physical phenomena such as wall nucleation, interfacial heat transfer, drag coefficients, and critical heat flux. Overall, this study provides an understanding of flow reversal and the prediction capabilities of thermal-hydraulics software models. In conclusion, a future study of the flow reversal benchmark of a narrow rectangular channel with two-sided heating may provide additional valuable insights.

CATHARE↗

DOE OSTI2025

Particle collisionality in scaled kinetic plasma simulations

Kinetic plasma processes, such as magnetic reconnection, collisionless shocks, and turbulence, are fundamental to the dynamics of astrophysical and laboratory plasmas. Simulating these processes often requires particle-in-cell (PIC) methods, but the computational cost of fully kinetic simulations can necessitate the use of artificial parameters, such as a reduced speed of light and ion-to-electron mass ratio, to decrease expense. While these approximations can preserve overall dynamics under specific conditions, they introduce nontrivial impacts on particle collisionality that are not yet well understood. In this work, we develop a method to scale particle collisionality in simulations employing an artificial speed of light and/or an artificial ion-to-electron mass ratio. By introducing species-dependent scaling factors, we independently adjust inter- and intra-species collision rates to better replicate the collisional properties of the physical system. Our approach maintains the fidelity of electron and ion transport properties while preserving critical relaxation rates, such as energy exchange timescales, within the limits of weakly collisional plasma theory. Furthermore, we demonstrate the accuracy of this scaling method through benchmarking tests against theoretical relaxation rates and connecting to fluid theory, highlighting its ability to retain key transport properties. Existing collisional PIC implementations can be easily modified to include this scaling, which will enable deeper insights into the behavior of marginally collisional plasmas across various contexts.

Totorica, S. R. [Princeton Univ., NJ (United State↗

DOE OSTI2023

Advancing Energy Equity Considerations in Distribution Systems Planning

Current distribution system planning (DSP) processes do not explicitly account for energy equity considerations, such as who is most affected by power system burdens, where those burdens are concentrated, and what investments can be made to improve baseline conditions. This paper proposes an iterative framework for advancing energy equity as an objective of the DSP process, showing how measurement strategies, or metrics (informed by conceptual foundations of energy justice), can be applied to benchmark equity performance at various stages. This methodology is applied for equity-aware distributed energy resource (DER) hosting capacity analysis and outage analysis to provide critical insights on infrastructure upgrade decisions compared to a business-as-usual (BAU) case. The analysis is performed on a taxonomy feeder representing the West Coast urban/semi-urban system with augmentation of electric vehicles (EVs) and rooftop solar photovoltaic (PV) generators. The study considers disadvantaged community (DAC) and non-disadvantaged community (NDAC) load regions to enable equity-aware simulations. The results demonstrate how equity-aware planning could reveal the limitations of the traditional DSP process as DAC regions are found to have lower DER hosting capacity and higher outage vulnerability. Overall, this work provides insights on the need to incorporate energy equity as an integral part of the DSP process.

Energy Equity, Distribution System Planning, DER a↗

DOE OSTI2013

Thoughts on Uncertainties in the Moments Formalism of the Statistical Theory of Fission Chains

A LANL paper says it provides an uncertainty analysis of subcritical benchmark measurements using the Hage-Cifarelli moment’s formalism. The goal of the LANL work is to provide uncertainties in the leakage and total multiplication values for use in subcritical benchmark measurements. Data of the bare BeRP ball taken September 17-20 2012 as part of exper iment IER-161 for the Department of Energy Nuclear Criticality Safety Program are used as an example to determine the measured uncertainties in leakage and total multiplication. The contribution of each parameter to the total uncertainty is then examined.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2026

TEX-Chlorine for TerraPower - Experimental Execution Report

This report describes the critical configurations of the TEX4TerraPower project that were performed in FY26Q4. Within this report, the configurations are presented along with physical measurements performed in support of benchmarking. TEX4TerraPower builds upon the TEX-Chlorine experiments, which in turn were based on the TEX-HEU experiments. Similar to TEX-Chlorine, the TEX4TerraPower configurations iteratively layered HEU fuel with sodium chloride (NaCl) absorbers. However, the main difference in the density achieved during the fabrication process of the sodium chloride absorbers. Unlike TEX-Chlorine, which was able to achieve ~70% theoretical density, the TEX4TerraPower salt plates achieved >90% theoretical density by hydraulically pressing the salt.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1995

Importance of real gas effects in entry technology

Critical issues concerning real gas effects in hypervelocity flows where the thermochemical nonequilibrium effects are pronounced, are described. Emphasis is on the development and validation of benchmark analysis tools. Approaches to develop and/or enhance phenomenological models, including test techniques to acquire databases, and incorporate them into computational flow field simulation codes are described. The performance characteristics of shock tubes, ballistic ranges and arc heated wind tunnels, state of the art diagnostics are included. The following aerothermodynamic phenomena are discussed: aerodynamic parameters, viscous interactions, turbulent transition, forebody heating/heat transfer, radiative heating, Lee-Base flows and low density real gas.

Deiwert, George S.↗

DOE OSTI2023

Catalytic Upgrading of Pyrolysis Products for the Production of Sustainable Aviation Fuel

The objective of this project is advance the state-of-technology for a catalytic fast pyrolysis (CFP) + hydrotreating (HT) process to produce sustainable aviation fuel and other biogenic products. Our approach focuses on performing integrated experiments using realistic biomass feedstocks and non-noble metal technical catalyst formulations. CFP is performed in an ex-situ configuration using a fluidized bed reactor without co-fed hydrogen. Research advancements over the past two years include establishing benchmark yield structures and compositional data for each step of the biomass-to-SAF process, demonstrating the ability to produce a cycloalkane-rich SAF product that meets key ASTM 4054 guidelines, generating benchmark characterization data for technical catalyst formulations with an emphasis on determining the unique composition and combustion properties of biogenic coke, and establishing bio-oil critical material attributes to mitigate the risk of plugging during down-stream hydroprocessing. Other impacts from this project include generation of broadly enabling scientific knowledge (12 publications/12 presentations since 2021), engagement with industry partners (Johnson Matthey, ExxonMobil, Phillips 66), and identification of a promising pathway to market that addresses emerging demands for biogenic refinery feedstocks.

biomass↗

DOE OSTI2016

SU-F-T-231: Improving the Efficiency of a Radiotherapy Peer-Review System for Quality Assurance

Purpose: To improve the efficiency of a radiotherapy peer-review system using a commercially available software application for plan quality evaluation and documentation. Methods: A commercial application, FullAccess (Radialogica LLC, Version 1.4.4), was implemented in a Citrix platform for peer-review process and patient documentation. This application can display images, isodose lines, and dose-volume histograms and create plan reports for peer-review process. Dose metrics in the report can also be benchmarked for plan quality evaluation. Site-specific templates were generated based on departmental treatment planning policies and procedures for each disease site, which generally follow RTOG protocols as well as published prospective clinical trial data, including both conventional fractionation and hypo-fractionation schema. Once a plan is ready for review, the planner exports the plan to FullAccess, applies the site-specific template, and presents the report for plan review. The plan is still reviewed in the treatment planning system, as that is the legal record. Upon physician’s approval of a plan, the plan is packaged for peer review with the plan report and dose metrics are saved to the database. Results: The reports show dose metrics of PTVs and critical organs for the plans and also indicate whether or not the metrics are within tolerance. Graphical results with green, yellow, and red lights are displayed of whether planning objectives have been met. In addition, benchmarking statistics are collected to see where the current plan falls compared to all historical plans on each metric. All physicians in peer review can easily verify constraints by these reports. Conclusion: We have demonstrated the improvement in a radiotherapy peer-review system, which allows physicians to easily verify planning constraints for different disease sites and fractionation schema, allows for standardization in the clinic to ensure that departmental policies are maintained, and builds a comprehensive database for potential clinical outcome evaluation.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Historic and modern nuclear graphite impurities: Pathways to improved waste strategies

Graphite has been used in large volumes as a structural material and neutron moderator since the earliest days of nuclear fission. However, no international consensus exists on the disposal of irradiated graphite, leaving much of the historic radioactive graphite inventory in interim vault or silo storage. With several new graphite-moderated reactors planned or under construction, the issue of graphite waste management is becoming increasingly urgent. This paper reviews and quantifies impurities in both historic and modern nuclear graphite, with emphasis on nitrogen—responsible for much of the 14 C inventory—and chlorine, which plays a critical role in repository performance and design. Modern graphites, benefitting from stringent quality-control measures developed for non-nuclear industries, meet or exceed the ASTM Ultra-High Purity nuclear standards, even without halide purification. Both chlorine and nitrogen concentrations have declined over time. For chlorine, identified as a key impurity influencing U.S. waste repository design, we propose a target of 0.1 appm in as-fabricated billets as a reasonable benchmark. Nitrogen sources are traced throughout the graphite production process, with surface and bulk concentrations characterized for all materials studied. Modern graphites commonly exhibit nitrogen levels below 5 appm, with values approaching 1 appm achievable. Using such reduced-nitrogen grades is critical to keeping graphite-induced radioactivity below the greater-than-Class-C waste threshold, thereby avoiding disposal cost penalties of nearly an order of magnitude.

Chlorine↗

DOE OSTI2022

An independent analysis of bias sources and variability in wind plant pre-construction energy yield estimation methods

The wind resource assessment community has long had the goal of reducing the bias between wind plant pre-construction energy yield assessment (EYA) and the observed annual energy production (AEP). This comparison is typically made between the 50% probability of exceedance (P50) value of the EYA and the long-term corrected operational AEP (hereafter OA P50), and is known as the P50 bias. The industry has critically lacked an independent analysis of bias reduction investigated across multiple consultants to identify the greatest sources of uncertainty and variance in the EYA process and the best opportunities for uncertainty reduction. The present study addresses this gap by benchmarking consultant methodologies against each other and against operational data at a scale not seen before in industry collaborations. We consider data from 10 wind plants and evaluate discrepancies between eight consultancies in the steps taken from estimates of gross to net energy. Consultants tend to overestimate the gross energy produced at the turbines and then compensate by further overestimating downstream losses, leading to a mean P50 bias near zero, still with significant variability among the individual wind plants. Within our data sample, we find that consultant estimates of all loss categories, except environmental losses, tend to reduce the project-to-project variability of the P50 bias. The disagreement between consultants, however, remains flat throughout the addition of losses. Finally, we find that differences in consultants’ estimates of project performance can lead to differences up to $10/MWh in the levelized cost of energy for a wind plant.

Todd, Austin C.↗

DOE OSTI2026

AutoLabs: cognitive multi-agent systems with self-correction for autonomous chemical experimentation

The automation of chemical research through self-driving laboratories (SDLs) promises to accelerate scientific discovery, yet the reliability and granular performance of the underlying AI agents remain critical, under-examined challenges. In this work, we introduce AutoLabs, a self-correcting, multi-agent architecture designed to autonomously translate natural-language instructions into executable protocols for a high-throughput liquid handler. The system engages users in dialogue, decomposes experimental goals into discrete tasks for specialized agents, performs tool-assisted stoichiometric calculations, and iteratively self-corrects its output before generating a hardware-ready file. We present a comprehensive evaluation framework featuring five benchmark experiments of increasing complexity, from simple sample preparation to multi-plate timed syntheses. Through a systematic ablation study of 20 agent configurations, we assess the impact of reasoning capacity, architectural design (single- vs. multi-agent), tool use, and self-correction mechanisms. Our results demonstrate that agent reasoning capacity is the most critical factor for success, reducing quantitative errors in chemical amounts (nRMSE) by over 85% in complex tasks. When combined with a multi-agent architecture and iterative self-correction, AutoLabs approaches expert-authored reference procedures on the benchmark (F1-score > 0.89) on challenging multi-plate syntheses. These findings establish a clear blueprint for developing robust and trustworthy AI partners for autonomous laboratories, highlighting the synergistic effects of modular design, advanced reasoning, and self-correction to ensure both performance and reliability in high-stakes scientific applications. Code: https://github.com/pnnl/autolabs

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Computational Identification and Experimental Demonstration of High‐Performance Methane Sorbents

Abstract Remarkable methane uptake is demonstrated experimentally in three metal‐organic frameworks (MOFs) identified by computational screening: UTSA‐76, UMCM‐152 and DUT‐23‐Cu. These MOFs outperform the benchmark sorbent, HKUST‐1, both volumetrically and gravimetrically, under a pressure swing of 80 to 5 bar at 298 K. Although high uptake at elevated pressure is critical for achieving this performance, a low density of high‐affinity sites (coordinatively unsaturated metal centers) also contributes to a more complete release of stored gas at low pressure. The identification of these MOFs facilitates the efficient storage of natural gas via adsorption and provides further evidence of the utility of computational screening in identifying overlooked sorbents.

Nath, Karabi↗

DOE OSTI2022

Computational Identification and Experimental Demonstration of High‐Performance Methane Sorbents

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗