Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “test metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Methods development towards automated, physics-informed, quantitative quality control of TRISO-SiC

Tristructural-isotropic (TRISO) fuel particles have been developed as a high-performance fuel for use in high-temperature gas-cooled reactor (HTGR) systems due to their high efficiency and stability under both normal and off-normal conditions. Broader deployment of this technology in advanced nuclear applications may benefit from quantitative quality assurance and quality control (QA/QC) methods that directly link TRISO properties to downstream performance. A key TRISO property is the SiC layer microstructure, which influences fission product retention during irradiation. However, existing QA/QC for the TRISO-SiC microstructure comprises only a qualitative visual inspection; therefore, there is a clear opportunity for the development of quantitative methods for TRISO QA/QC. Here, to this end, previous work has demonstrated an image processing approach to grain boundary (GB) identification and subsequent extraction of microstructural metrics; however, extensive twinning within the SiC layer complicates such analyses because twin GBs significantly influence microstructural metrics but are not expected to contribute to fission product transport. This study presents the initial development, training, and testing of an ML-based image segmentation algorithm designed to identify and remove twin GBs from standard backscattered electron micrographs, providing an industrially applicable, quantitative, and physically meaningful QA/QC approach for the TRISO-SiC microstructure. Although pixel-wise performance metrics for the twin predictions are low, the change in grain area and the number of GB pixels after twin removal predicted by the ML workflow are within 1% of the true values calculated using crystallographic data. This suggests that the model is well capable of predicting overall twin boundary structures and grain morphology, and continued advancement of this approach could enable automated, scalable, and physics-informed QA/QC for TRISO-SiC microstructures, supporting the reliable qualification of coated particle fuels for next-generation reactor systems.

Computer vision↗
DOE OSTI2025

Field evaluation of zone temperature response to control actions in cooling systems of small and medium-sized office buildings

The response of zone temperature to control actions in heating, ventilation, and air conditioning (HVAC) systems, known as zone temperature response, has been a central focus of building control research owing to its crucial role in determining control performance. However, existing studies often overlook the representativeness of the buildings being studied, resulting in unclear generalizations. In addition, those studies tend to focus on a single aspect of the response. Furthermore, this paper provides the first comprehensive characterization of zone temperature response applicable to a clearly defined building sector—small and medium-sized office (SMO) buildings (<5000 m 2 ) in the US. Specifically, two representative SMO buildings, selected based on the US Department of Energy’s commercial prototype buildings, were studied. Field tests were conducted over a 2-month period during summer, and the collected data were analyzed with two key metrics—delay time and nonlinearity index—to quantify zone temperature response, capturing both short- and long-term patterns. Beyond this quantitative characterization, the analysis reveals that the HVAC system type, rather than factors like floor area or zone location, is the primary determinant of the zone temperature response. Drawing on the field test results, we recommend that building control strategies monitor zone temperatures at intervals shorter than 10 minutes, configure controls independently for VAV- and RTU-served zones, and implement nonlinear methods at the zone level—particularly for VAV zones—rather than across the entire building.

Building control↗
DOE OSTI2026

A cell-centered AMR-ALE framework for 3D multi-material hydrodynamics. Part II: linesweep ALE rezoning for nonconformal block-structured AMR meshes

The simulation of flows presenting contact discontinuities, vorticity, and large variations in spatial scales can be performed in a framework coupling Arbitrary Lagrangian Eulerian (ALE) algorithms and Adaptive Mesh Refinement (AMR). This coupling requires adaptation of ALE rezoning techniques to meshes containing nonconformal nodes arising from both the AMR topology and the junction of mesh blocks. Here, in this paper, we present an ALE rezoning strategy that is compatible with such meshes, and that can also act as a disentangling algorithm. Emphasis is put on an algorithm that respects intrinsic Lagrangian mesh properties in order to preserve accuracy around discontinuities. To that end, we adapt the weighted linesweep algorithm to nonconformal block-structured AMR meshes. Then, we present control parameters introduced in the method for it to be applicable in practical situations. Notably, the method is coupled to a specific metric optimization in order to palliate some shortcomings of the linesweep method. Finally, numerical test cases are presented that feature the capabilities of the ALE-AMR algorithm for flows that present discontinuities, vorticity, and a variety of scales. Notably, we show that our ALE-AMR algorithm gives results at least similar to Euler-AMR, but provides better accuracy in cases where discontinuities are involved, thanks to a method that respects the Lagrangian features of the mesh. Additionally, it enables Euler-AMR-like computations on domains with temporally varying domain boundaries.

Adaptive mesh refinement↗
DOE OSTI2025

DISTRI: Distributed Multi-Facility HPC Simulator (DISTRI) v2.1

DISTRI is an advanced network simulator designed for multi-facility computational infrastructures with agentic behavior. It simulates HPC facilities where computational resources act as autonomous agents, making intelligent decisions about job scheduling, load balancing, and resource allocation. The simulator focuses on developing and testing decentralized algorithms that promote resilience and efficiency in multi-facility environments. Key Features: - Agentic Resource Behavior: Processors and DTNs act as autonomous agents with decision-making capabilities - Pheromone-Based Load Balancing: Decentralized load balancing inspired by ant colony optimization - Dual Topology Support: Mesh (normal operations) and Dumbell (network testing) topologies - Comprehensive TCP Simulation: Realistic TCP implementations with multiple congestion control algorithms - Failure Resilience Testing: Processor failure simulation with automatic job reassignment - Extensive Visualization: Detailed performance analysis and metrics collection - Research-Ready: Designed for algorithm development and benchmarking

Bez, Jean Luca [Lawrence Berkeley National Laborat↗
DOE OSTI2025

SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1

This technote holds reports based on the first analyses of the Data Preview 1 (DP1) data by the Science Unit for photometric redshifts. Although photometric redshifts are not an official DP1 data product, the "Photo-z Science Unit" generated photo-z estimates for every galaxy in DP1 using the available multi-band imaging on a best-effort basis. This work included developing training and test datasets by matching DP1 data to high-quality reference redshifts obtained with spectroscopy, Grism data, and multi-band photometry. The Science Unit used the RAIL software package to make photometric redshift estimates using eight different algorithms, developed simple scientific performance metrics, used those metrics to explore how the performance of the algorithms varied with configuration changes, derived more optimized configurations of the algorithms and tested the performance of those configurations. This work, the resulting data products and expected data distribution mechanism are all described there.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗
DOE OSTI2025

X-Ray Microtomography Measurements of Coevolving Particle Size and Shape

This study measures simultaneous changes in particle size and shape during grain crushing and proposes quantitative metrics to track their coevolving statistical distribution. Idealized granular materials with widely different initial particle shapes (i.e., spheres, quasi-ellipsoids, plates, and rods) are compressed oedometrically at vertical stress levels sufficient to induce particle breakage. X-ray microtomography and digital image analysis are then used to track changes in particle-scale characteristics. The observations indicate that more irregular particles tend to exhibit a higher degree of breakage compared to more spherical grains subjected to an equivalent stress level. Despite these differences, the measurements also indicate that all the tested particle sets approach a common attractor (expressed in terms of aspect ratio, flatness, and elongation), regardless of their initial morphology. A new shape evolution index is proposed to quantify such trends. With this new metric, it is shown that in all the tested materials, the particle shape evolves faster than size, especially for the more regular morphologies, thus implying that the shape tends to reach its attractor point before the grading reaches its ultimate particle size distribution. Furthermore, this finding underpins an ultimate stage of crushing-driven compression that occurs with particle size reduction but minimal shape changes (i.e., self-replicating shapes due to fractures).

Oedometric compression↗
DOE OSTI2024

Advanced Perovskite Solar Cells and Modules

The “Advanced perovskite Cells and Modules” research project was the final agreement focused on enhancing perovskite solar cell (PSC) technologies funded by the US Department of Energy's Solar Energy Technologies Office. The project was designed to address three crucial areas in PSC development: stability, manufacturability, and efficiency. The project was then structured around three main tasks, each targeting one of these strategic goals. The team of experienced researchers in these materials worked collaboratively to address the targets outlined in the technical work plan. building on existing PSC research while also exploring promising new concepts arising in the field. An overview of each primary task is summarized below: Task 1 Stability: This first task, aims to identify material characteristics and metrics that can help predict the primary degradation mechanisms impacting PSC stability. This involved developing specific device tests based on hypotheses regarding mechanisms impacting stability, including fast failure procedures to speed up PSC development and improvement. Various strategies to enhance stability, like incorporating additives, post-treatments, novel contact materials etc. were developed using this fast feedback approach. The relationships between indoor and outdoor stresses were also validated. Task 2 Manufacturability: This second task, focused on creating a scalable production process for PSCs. Initially the objective is to establish a best-known method for a 182 cm2 minimodule. However, given resource limitations, these metrics were modified to focus on the other goal of outlined in the TWP. Specifically, this task worked to demonstrate the transferability of this best-known method to another research institution. Work scope in this area was expanded to material purity and understanding of reagent/process relationships. Examination of other difficulties in PSC production and potential solutions for large-scale production were also evaluated. Given challenges observed in process transfer, work to develop data infrastructure and recording tools for processing of material and devices was then also prioritized in this task. Task 3 Efficiency: This task was focused on improvements to PCE, while still considering Task 1 and Task 2 goal. The efforts targeted a PCE greater than 22% with a T95 exceeding 1000 hours at 25°C in a nitrogen environment for lab-scale devices (approximately 0.1 cm2 devices) across a range of solar-relevant perovskite compositions, including wide-gap (around 1.7 eV) and low-gap (around 1.3 eV) materials, using standard metal contacts. This work then provides a foundation for MHP-based tandem efforts undertaken in other projects and the All-MHP tandem efforts outlined in this projects TWP. Work in this project emphasized disseminating its findings through peer-reviewed publications (PRP), conference presentations, and industrial collaborations. Significant products were produced in all these areas, over 53 peer reviewed publications, 32 conference presentations and industrial investment based on NLR assistance on precompetitive challenges. The team also developed significant intellectual property and awards for their technical excellence, innovations and leadership. The team also leveraged traditional and social media platforms to engage with stakeholders and the public.

14 SOLAR ENERGY↗
DOE OSTI2024

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Heavy-Duty Nonroad Material Handler Electrification Part 2: Energy Efficiency and Performance Evaluation

Decarbonization efforts achieved through electrification in nonroad mobile machinery can realize a reduction in fuel consumption of more than 20%, thanks to concepts familiar to light-duty passenger vehicles. This case study compares the results of a hybrid-electric material handler to its conventional counterpart, utilizing machine-specific drive cycles presented in part one of this paper series. The hybrid prototype features an extended-range electric vehicle (EREV) powertrain that demonstrated substantial energy efficiency improvements. Specifically, there was a reduction in equivalent fuel consumption of 75% when operating in electric-only mode, and 33% when maintaining the battery by charging with an on-board generator. Together, the efficiency improvements can be extrapolated over a low-intensity, 8-h shift characterized by significant idle time and highly dynamic engine load for a 47% reduction in net energy consumption. Key technologies that led to this improvement included engine downsizing and decoupling, regenerative braking, and an electrohydraulic pump unit with advanced controls. Finally, his study explains details of the powertrain architecture and subsystems that were implemented on a demonstration vehicle, control strategies used to meet project goals, and an analysis of energy consumption from testing on a closed course. Also included in this study is a discourse on comparison metrics that can be used for quantifying the energy consumption differences between hybrid-electric and conventional diesel powertrains in nonroad mobile machinery.

25 ENERGY STORAGE↗
DOE OSTI2025

Ultrasonic Characterization of Lithium Ion Thermal Runaway Conditions for Real-time Ultrasonic Enabled BMS Integration

The demand for energy storage is growing, and lithium-ion batteries are a promising technology to meet this need due to their high power/energy density, high round-trip efficiency, rapid response time, and portability. However, recent catastrophic events caused by thermal runaway have slowed their adoption, highlighting the need for an early warning system for battery failure. In this work, ultrasound is used to detect physical changes in 950 mAh batteries by identifying material property changes independent of voltage and current. [Ultrasound signal features (e.g., time of flight, maximum frequency component) were extracted as the batteries were cycled and subjected to both constant current and constant voltage overcharge and were used to develop two metrics identifying failure: a warning to detect the start of overcharge and an emergency stop (E-stop) to immediately take the battery out of service. The identification method involved locating magnitude differences of several ultrasound features compared to baseline operation considering different currents and temperatures, and the warning/stopping metrics were consistent across all experiments. For an average overcharge time of 140 minutes, the average warning was issued 124 minutes before the failure and the average E-stop was triggered 94 minutes before failure. As a test of using ultrasound for early warning detection, a battery was forced into overcharge and returned to normal cycling conditions based on the previously determined warning metric. Both the voltage profile and the ultrasound measurements returned to their baseline behavior, indicating that ultrasonic detection can not only identify battery failure before a catastrophic event, but can also provide early enough warnings such that overcharges can be detected and corrected quickly enough so the battery does not need to be decommissioned.]

25 ENERGY STORAGE↗
DOE OSTI2025

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as p2r, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these miniapps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

Atif, Mohammad [Brookhaven] (ORCID:000000026889770↗
DOE OSTI2024

A Large-Scale Analysis to Optimize the Control and V2V Communication Protocols for CDA Agreement-Seeking Cooperation

Cooperative driving automation (CDA) Class C, agreement-seeking cooperation, is an innovative and practical solution that can promote cooperation among general passenger vehicles on the road. However, more comprehensive studies are needed before establishing the standard protocols of agreement-seeking cooperation, such as communication frequency and the duration of cooperation. Here, this article presents an initiative study on the impacts of communication capabilities on agreement-seeking cooperation. Through a large-scale analysis by regulating vehicle-to-vehicle (V2V) communication metrics, this work suggests desirable system parameters that can maximize the benefits of cooperation and ensure reliable operability while avoiding exhaustive communication loads. As the first step, an example agreement-seeking cooperation system is created for a car-following scenario, including decision-making and control algorithms for autonomous vehicles. Then, software-in-the-loop tests explore the performance of the developed system as it encounters various communication risks, such as latency and message packet drops. The system performance metrics are evaluated from various angles, including the time consumed for the agreement-seeking process, cooperation ratio, and the ratio of faulty cooperation. Energy saving from the cooperation is assessed by using simulation software that can run multiple high-fidelity vehicle models simultaneously. Based on the analyses, this article suggests the V2V communication requirements for the reliable operation of CDA agreement-seeking, which can be referred to when developing the standard protocols of agreement-seeking cooperation.

42 ENGINEERING↗
DOE OSTI2024

Machine learning-guided design of direct methanol fuel cells with a platinum group metal-free cathode

Direct methanol fuel cells (DMFCs) offer a promising solution for clean electricity generation, particularly in small electronics and remote auxiliary power units. However, optimizing their efficiency and performance is challenging due to the complex interactions between various factors. Here, we present a novel approach that integrates experiments with machine learning to model and predict the performance of these fuel cells using atomically dispersed platinum group metal (PGM)-free catalysts at the cathode. Further, our machine learning models, trained on diverse input parameters, allow for the comprehensive optimization of DMFC performance prior to fabrication and testing. Through extensive experimental validation, we demonstrate that this data-driven approach accurately predicts key performance metrics, such as maximum power output and polarization curves. By combining our models with interpretable game-theory methods, we provide deep insights into the factors governing fuel cell performance, ultimately paving the way for the design of scalable and efficient DMFC technologies.

25 ENERGY STORAGE↗
DOE OSTI2024

Open Call LDRD: Physically Informed Autoencoders for Galactic Redshift Regression

Physical constraints have been suggested to make neural network models more generalizable, act scientifically plausible, and be more data-efficient over unconstrained baselines. In this report, we present preliminary work on evaluating the effects of adding soft physical constraints to computer vision neural networks trained to estimate the conditional density of redshift on input galaxy images for the Sloan Digital Sky Survey. We introduce physically motivated soft constraint terms that are not implemented with differential or integral operators. We frame this work as a simple ablation study where the effect of including soft physical constraints is compared to an unconstrained baseline. We compare networks using standard point estimate metrics for photometric redshift estimation, as well as metrics to evaluate how faithful our conditional density estimate represents the probability over the ensemble of our test dataset. We find no evidence that the implemented soft physical constraints are more effective regularizers than augmentation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

TEAMER: Twin Ocean Power Wave Energy Converter Comprehensive Overview

These files collectively provide a comprehensive overview of the testing process, data analysis, and validation for the Twin Ocean Power device tested at the O.H. Hinsdale Wave Research Laboratory, supported by TEAMER funding. This resource includes an overview of power results for a series of 7 trials. The files included in this comprehensive overview include a comprehensive log sheet for each trial, a summary of all trials, and processing scripts for the raw data. It includes all raw data in .tsv and MATLAB compatible formats, an average power chart, angular velocity charts for each trial, trial metrics, and power output files. This resource includes images of the Twin Ocean Power Wave Energy Converter device components and movement during testing and video recordings of each trial.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Adhesion Testing of Direct-Write Printed Ink on Metallic Structural Components

The successful adoption of additive manufacturing for the rapid prototyping of direct-write printed electronics requires the establishment of quantifiable metrics that can interrogate device performance. One measure of performance is the adhesion strength between the substrate and printed film interface, which is critical since the strength of this interface can dictate the accuracy and reliability of the printed device. In this work, a non-contact laser-induced spallation technique was used to quantify the adhesion of silver printed films on aluminum alloy substrates. The laser-based method was compared to a standardized pull-off adhesion test, which provided baseline measurements of adhesion strength. The sintering conditions were shown to play an important role in the film-substrate adhesion strength, as well as the cohesion and ductility of the film itself. The methods and results described in this work support the establishment of process control steps that are necessary for quickly verifying the reliability of printed devices prior to their deployment in critical experiments.

Adhesion test↗