Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

WEC fault modelling and condition monitoring: A graph-theoretic approach

The nature of wave resources usually requires wave energy converter (WEC) components to handle peak loads (i.e., torques, forces, and powers) that are many times greater than their average loads, accelerating equipment degradation. Moreover, due to their isolated nature and harsh operating environment, WEC systems are projected to possess high operations and maintenance (O&M) cost, i.e., around 27% of their leveled cost of energy. As such, developing techniques to mitigate these costs through the application of condition monitoring and fault tolerant control will significantly impact the economic feasibility of grid connected WEC power. Toward this goal, models of faulty components are developed in the open source modeling platform, WEC-Sim, to estimate the performance and measurable states of a WEC operating with likely device and sensor failures. Two types of faulty component models are then applied to a point absorber WEC model with basic controller damping and spring forces. Resulting changes in device behavior are recorded as a benchmark, and a graph-theoretic approach is proposed for fault detection and identification utilizing multivariate time series. Simulation results demonstrate that these faults can greatly affect the WEC performance, and that the proposed method can effectively detect and classify different types of faults.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

A Proposed Beam-Beam Test Facility COMBINE

The COmpact Machine for Beam-beam Interactions in Non-Equilibrium systems (COMBINE) is a proposed, dedicated, beam-beam test facility. This is currently a joint effort between Jefferson Lab and Old Dominion University to create a small, low energy pair of collider rings that would be used to study beam-beam interactions, as well as act as a teaching tool for students. The base design would make use of a pair of identical rings (2.5 meters per side) one rotated 180 degrees from the other, meeting at their common interaction point. These would be fed by an electron gun producing up to 125 keV electrons. The low energy will allow for beam-beam tune shifts commensurate with existing colliders, and will also allow for an exploration of the predicted effects of gear-changing, which would be performed using a variable pathlength scheme. Finally, this machine can also test linac-ring type systems.

Nissen, Edith↗
DOE OSTI2022

Lightweight jet reconstruction and identification as an object detection task

We apply object detection techniques based on deep convolutional blocks to end-to-end jet identification and reconstruction tasks encountered at the CERN large hadron collider (LHC). Collision events produced at the LHC and represented as an image composed of calorimeter and tracker cells are given as an input to a Single Shot Detection network. The algorithm, named PFJet-SSD performs simultaneous localization, classification and regression tasks to cluster jets and reconstruct their features. This all-in-one single feed-forward pass gives advantages in terms of execution time and an improved accuracy w.r.t. traditional rule-based methods. A further gain is obtained from network slimming, homogeneous quantization, and optimized runtime for meeting memory and latency constraints of a typical real-time processing environment. We experiment with 8-bit and ternary quantization, benchmarking their accuracy and inference latency against a single-precision floating-point. We show that the ternary network closely matches the performance of its full-precision equivalent and outperforms the state-of-the-art rule-based algorithm. Finally, we report the inference latency on different hardware platforms and discuss future applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Deployment and performance of a Low-Energy-Threshold Skipper-CCD inside a nuclear reactor

Charge Coupled Devices (CCD) are being used for reactor neutrino experiments and have already demonstrated their potential in constraining new physics models. The prospect of a Skipper-CCD experiment looking for standard and beyond standard model (BSM) physics in a nuclear reactor has been evaluated for different benchmark scenarios. Here, we report the first installation of a 2-g Skipper-CCD inside the containment building of a 2 GW th nuclear power plant and analyze its performance throughout its first 18 months of operation. The sensor was successfully deployed at Atucha II, in Argentina, 12 meters away from the center of the reactor core. We discuss the challenges involved in the commissioning of the detector and present data acquired during reactor ON and reactor OFF periods, with the sensor functioning with a sub-electron readout noise of 0.17 e - . Based on an exposure of 56.8 g day reactor ON and two reactor OFF data sets with a total exposure of 118.1 g day we characterize the system and evaluate the sensitivity to CEvNS. We achieved a background rate of 33 kdru and a low threshold of 45 eV ee . The ongoing efforts to improve sensitivities to CEvNS and BSM interaction are also discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Performance Evaluation of Multi-Vendor Grid-Forming Inverters for Grid-Connected Operation Through Hardware Experimentation

This paper presents the functional performance evaluation tests of multiple (three) commercial grid-forming (GFM) inverters when they operate in parallel with the grid through hardware experiments. The goal of these tests is to explore and benchmark the GFM inverters' functionalities and dynamic response when they are operated in parallel with power grids. Both steady-state (changing the inverter's frequency and voltage droop) and transient (adding step changes to grid's frequency/voltage) tests are performed for each GFM inverter with the same testing circuit and testing protocol. The key findings are summarized as follows: 1) The GFM inverters can be dispatched through frequency and voltage droop intercepts to output the target power; and 1) the GFM inverters automatically respond to system frequency and voltage events to output the needed power; 3) all the GFM inviters shows stability issues when absorbing reactive power from the grid.

frequency droop↗
DOE OSTI2026

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity—ranging from encoder-only to encoder-decoder and masked autoencoding paradigms—makes it challenging to assess performance trade-offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self-supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next-generation geospatial foundation models capable of robust multimodal reasoning.

Ambrozio Dias, Philipe [ORNL] (ORCID:0000000194277↗
DOE OSTI2025

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Data from Rossi-α and Pulsed Neutron Prompt Neutron Time Decay Measurements at the Oak Ridge Critical Experiments Facility

This report briefly describes the prompt neutron decay measurements by the Rossi-α and pulsed neutron methods performed at the Oak Ridge Critical Experiments Facility. It briefly describes the measurement equipment, the type of data, and how to access the actual data from the Laboratory Records Department at Oak Ridge National Laboratory and the International Nuclear Criticality Safety Benchmark Evaluation Program at Idaho National Laboratory. Most of the data was acquired between 1960 and 1975 with weapons-grade enriched uranium metal assemblies. It also includes measurement of these types performed at Los Alamos National Laboratory by Oak Ridge National Laboratory with the JEZEBEL and FLATTOP criticality assemblies and other plutonium metal parts. The purpose of this report is to support future mining of the data for publication of additional information that can be used to verify calculational methods and nuclear cross sections. Present calculational methods can be used to directly calculate the measured data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Statistical analysis on random quantum circuit sampling by Sycamore and Zuchongzhi quantum processors

Random quantum circuit sampling, a task to sample bit strings from a random quantum circuit, is considered a suitable benchmark task to demonstrate the outperformance of quantum computers even with noisy qubits. Recently, random quantum circuit sampling was performed on the Sycamore quantum processor with 53 qubits [Nature (London) 574, 505 (2019)] and on the Zuchongzhi quantum processor with 56 qubits [Phys. Rev. Lett. 127, 180501 (2021)]. Here, we analyze and compare the statistical properties of the outputs of the random quantum circuit sampling by the Sycamore and Zuchongzhi processors. Using the Marchenko-Pastur law of random matrices of bit strings and the Wasssertein distances between bit strings, we find that the statistical properties of Sycamore bit strings are quite different from those of Zuchongzhi bit strings, while both processors score similar values of linear cross-entropy fidelity for random circuit sampling. Some bit strings sampled by the Zuchongzhi processor pass the NIST random number tests while both Sycamore and Zuchongzhi processors show similar patterns in the heat maps of bit strings. Zuchongzhi bit strings are much closer to classical uniform random bits than those of Sycamore. It is shown that the statistical properties of bit strings of both random quantum circuits change little as the depth of the random quantum circuits increases. Our findings raise a question about the computational reliability of noisy quantum processors because two quantum processors with similar noise levels and similar qubit structures produced statistically different outputs for the same random quantum circuit sampling.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Stabilizing the Interphase in Cobalt–Free, Ultrahigh–Nickel Cathodes for Lithium–Ion Batteries

High-nickel layered oxide cathodes, such as LiNi 1-x-y Mn x Co y O 2 (NMC) and LiNi 1-x-y Co x Al y O 2 (NCA), are at the forefront for implementation in high-energy-density lithium-ion batteries. The presence of cobalt in both cathode chemistries, however, largely deters their application due to fiscal and humanitarian issues affiliated with cobalt sourcing. Increasing the Ni content drives down the Co content, but introduces additional structural and electrochemical problems attributed to high-Ni cathodes. Herein a dually modified cobalt-free ultrahigh-nickel cathode 0.02B-LiNi 0.99 Mg 0.01 O 2 (NBM) is presented with 1 mol% Mg and 2 mol% B that exhibits a high initial 1C discharge capacity of 210 mA h g –1 with a 20% capacity retention improvement over 500 cycles when benchmarked against LiNiO 2 (LNO) in pouch full cell configurations with graphite anode. Postmortem analyses reveal the enhanced performance stems from reduced active lithium inventory loss and localized surface reactivity in the NBM cathode. Here, the stabilized cathode-electrolyte interphase subsequently reduces transition-metal dissolution and ensuing chemical crossover to the graphite anode, which prevents further catalyzed parasitic reactions that harmfully passivate the anode surface. Altogether, this study aims to highlight the importance of electrode characterization and analysis from an interphasial viewpoint and to push the ongoing research to stabilize cobalt-free ultrahigh-Ni cathodes for industrial feasibility.

25 ENERGY STORAGE↗
DOE OSTI2024

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗
DOE OSTI2026

Toward the performance assessment of advanced nuclear waste forms: temperature dependence of lanthanide borosilicate glass dissolution

Lanthanide borosilicate (LaBS) glasses are among the most promising waste forms for the immobilization of high-level radioactive waste generated from advanced nuclear fuel cycles. However, the temperature dependence of their dissolution kinetics remains poorly understood and constrained, limiting the integration of these materials into established performance assessment models. Here, we investigate the dissolution behavior of the legacy AmCm2-19 LaBS glass and the benchmark alkali aluminoborosilicate ISG-1 in deionized water between 50 °C and 250 °C using ASTM C1285 (Product Consistency Test-B) protocols. For AmCm2-19 LaBS glass, normalized elemental release rates for boron and silicon increase with temperature before plateauing near 150 °C, consistent with solubility-limited behavior. From data obtained at 50 °C and 100 °C, Arrhenius analysis yields activation energies of E a (B) = 24.8 ± 0.3 kJ mol⁻¹ and E a (Si) = 14.4 ± 0.2 kJ mol⁻¹, similar or slightly lower than those previously reported for two other compositions of LaBS glasses. No secondary phases or alteration layers were detected by SEM-EDX or pXRD. These results establish one of the first temperature-dependent kinetic datasets for LaBS glass dissolution, providing quantitative parameters to inform mechanistic corrosion models and predictive simulations of glass degradation in geological disposal environments.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

The multichannel i -propyl + O2 reaction system: A model of secondary alkyl radical oxidation

The i-propyl + O2 reaction mechanism has been investigated by definitive quantum chemical methods to establish this system as a benchmark for the combustion of secondary alkyl radicals. Focal point analyses extrapolating to the ab initio limit were performed based on explicit computations with electron correlation treatments through coupled cluster single, double, triple, and quadruple excitations and basis sets up to cc-pV5Z. The rigorous coupled cluster single, double, and triple excitations/cc-pVTZ level of theory was used to fully optimize all reaction species and transition states, thus, removing some substantial flaws in reference geometries existing in the literature. The vital i-propylperoxy radical (MIN1) and its concerted elimination transition state (TS1) were found 34.8 and 4.4 kcal mol−1 below the reactants, respectively. Two β-hydrogen transfer transition states (TS2, TS2′) lie above the reactants by (1.4, 2.5) kcal mol−1 and display large Born–Oppenheimer diagonal corrections indicative of nearby surface crossings. An α-hydrogen transfer transition state (TS5) is discovered 5.7 kcal mol−1 above the reactants that bifurcates into equivalent α-peroxy radical hanging wells (MIN3) prior to a highly exothermic dissociation into acetone + OH. The reverse TS5 → MIN1 intrinsic reaction path also displays fascinating features, including another bifurcation and a conical intersection of potential energy surfaces. An exhaustive conformational search of two hydroperoxypropyl (QOOH) intermediates (MIN2 and MIN3) of the i-propyl + O2 system located nine rotamers within 0.9 kcal mol−1 of the corresponding lowest-energy minima.

Chemistry↗
DOE OSTI2021

Radon Kinetics in a Basement Space Measured with Different Devices

Although indoor monitoring of radon and benchmarking of radon measurement devices remain important research topics, few intercomparisons of active radon measurement devices have been performed under realistic conditions, let alone dynamic ones enabling comparison of their transient behavior. Five different radon monitors were therefore placed in a poorly ventilated basement space under three different conditions: 24 h under a steady, elevated radon level, 24 h with fans turned on to produce a radon washout transient, and 9 d with fans turned off for a radon buildup transient. Resulting radon concentrations varied between ~200 and ~2,000 Bq m -3 . Accuracy of the devices were evaluated using root-mean-square error, and ventilation data were fit to first order linear compartmental models. To more accurately model behaviors such as cyclic diurnal variations, the source term corresponding to entry of radon from soil into the basement was considered to be non-constant, as it is likely to vary drastically with both the indoor-outdoor pressure differential and soil concentration variations. Here, the improved radon washout model fit very well with the measurements. Despite a wide variety in list prices, all devices performed similarly during transients and at different radon concentrations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Multi-Core Microcontroller Hardware In the Loop System for Electric Machine Control

Hardware in the Loop (HIL) is a simulation technique used to reduce the software development cycle and test control systems in a non-destructive environment. This work describes a cost effective HIL simulator on a dual core microcontroller in which one core acts as a controller and the other emulates the system under control. The emulator runs one step per Pulse Width Modulation (PWM) period in real time. To handle the computational burden and prioritize execution of simulation and control tasks, an interrupt-based software architecture with task prioritization has been developed. As a demonstration, the HIL has been implemented on a Texas Instruments TMS320F28379D dual core microcontroller, which emulates a Permanent Magnet Synchronous Machine (PMSM) with resolver feedback. Hardware peripherals are developed and tested concurrently with the control system, providing higher confidence in the software. By using the peripherals in the HIL development, the controller exercises either the HIL emulation or a pin compatible PMSM testbench. To quantify performance and validate the processor based emulator, the HIL results are compared to the preexisting testbench for accuracy benchmarking at no-load and under load for a range of operating points.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

INSURE: An Information Theory iNspired diSentanglement and pURification modEl for Domain Generalization

Domain Generalization (DG) aims to learn a generalizable model on the unseen target domain by only training on the multiple observed source domains. Although a variety of DG methods have focused on extracting domain-invariant features, the domain-specific class-relevant features have attracted attention and been argued to benefit generalization to the unseen target domain. To take into account the class-relevant domain-specific information, in this paper we propose an Information theory iNspired diSentanglement and pURification modEl (INSURE) to explicitly disentangle the latent features to obtain sufficient and compact (necessary) class-relevant feature for generalization to the unseen domain. Specifically, we first propose an information theory inspired loss function to ensure the disentangled class-relevant features contain sufficient class label information and the other disentangled auxiliary feature has sufficient domain information. Additionally, we further propose a paired purification loss function to let the auxiliary feature discard all the class-relevant information and thus the class-relevant feature will contain sufficient and compact (necessary) class-relevant information. Moreover, instead of using multiple encoders, we propose to use a learnable binary mask as our disentangler to make the disentanglement more efficient and make the disentangled features complementary to each other. We conduct extensive experiments on five widely used DG benchmark datasets including PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet. The proposed INSURE achieves state-of-the-art performance. We also empirically show that domain-specific class-relevant features are beneficial for domain generalization. The code is available at https://github.com/yuxi120407/INSURE .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Transient Stability-Enhancing Method for Grid-Forming Inverters Under Current Limiting

The primary controller of a grid-forming (GFM) inverter governs the internal reference voltage and angle, which enables the inverter to naturally synchronize and share power with the connected grid; however, during disturbances on the grid caused by, e.g., line faults, overloading, or frequency and phase shifts, a GFM inverter can be pushed into a current-limited operation to protect the device against thermal damage. This can lead to a windup of the internal reference frequency generated by the primary controller and cause a total loss of synchronism with the grid. Here, to make the primary controller of GFM inverters more robust against transient instability, this paper proposes a method that manipulates the reference signals governed by the primary controller by introducing the concept of fictitious power. The fictitious power counteracts the integrator windup in the primary controller, which enables the current-limited inverter to conceive a stable operating point. This method is benchmarked against five state-of-the-art GFM inverter stabilization methods to evaluate its stability-enhancing performance. Full-order electromagnetic-transient simulations and experimental results of a hardware inverter test setup validate the benefits of the method to improve the transient stability of GFM inverters in the face of grid disturbances.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Physics-Informed Evolutionary Strategy Based Control for Mitigating Delayed Voltage Recovery

Here, in this work we propose a novel data-driven, real-time power system voltage stability control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to secure system voltage stability. The problem is challenging due to the high-dimensional feature of the power system model and the fast-changing and uncertain nature of power system operation scenarios. To this end, a model-free and derivative-free guided ES method is applied. The method is further combined with a meta-learning strategy to make the learnt control policy automatically adapted to unseen operation conditions and fault scenarios, which is highly desired for real-time emergency control. Last but not least, physical knowledge is embedded in the above method through a trainable action mask technique to rule out unnecessary load shedding actions for better learning and control performance. Case studies on the IEEE 300-bus system and comparisons with other state-of-the-art benchmark methods verify the superiority of the proposed physics-informed guided meta ES method in realizing fast and adaptive power system voltage stability control.

42 ENGINEERING↗