SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Analyzing Terawatt Scale Sustainability with PV ICE Tool

Renewable energy reduces environmental impacts and decarbonizes the production of other goods. But, manufacturing renewable energy sources, such as photovoltaic (PV) modules, require energy inputs that are currently carbon intensive. So, how do we decarbonize and circularize these critical technologies to achieve a sustainable energy transition? As we manufacture and deploy solar PV at a fast pace to support the Energy Transition, this talk will cover some of the most relevant metrics for evaluating the success of our circular economy and sustainability choices.

circular economy↗

DOE OSTI2026

Energy Systems Integration Facility Stewardship Summary: Fiscal Year 2025

A summary of NLR's stewardship of the nationally unique Energy Systems Integration Facility (ESIF) highlighting performance metrics, capability upgrades, and examples of R&D impact. 2025 brought a national focus on energy and ESIF is meeting the moment. All eyes are on data centers and domestic manufacturing and bringing the benefits of artificial intelligence to power system planning and operations. In step with national priorities, ESIF is building out capabilities that advance secure, reliable, and affordable power. ESIF hosted 190 multidisciplinary research projects, 855 high-performance computer users, and collaborated with 81 partners from industry, academia, research, and federal agencies. These research projects resulted in an AI method for detecting high-impedance faults with 90% accuracy, a grid controls demonstration in Connecticut, power quality validation of CorePower's flagship inductor, and a cybersecurity assessment of potential rogue capabilities in digitally connected energy devices. Facility infrastructure improvements enhanced the thermal research network, the SCADA system, the cyber range, power hardware-in-the-loop testing, and more. With support from the U.S Department of Energy (DOE), the ESIF laboratories continue to deliver leading solutions for secure, reliable, and affordable power.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Small Punch Testing of Molybdenum-99 Targets

Northstar Medical Radioisotopes is developing an accelerator-based method to produce 99 Mo, which is a parent isotope of the commonly used 99m Tc medical isotope. The Mo targets being designed for the accelerator will be produced from enriched 100 Mo, also known as aMo . Pressed and sintered powder feedstock is used to fabricate aMo targets, producing 29 mm disk-shaped targets. The targets are subjected to 1–6 days in line of an electron beam with subsequent dissolution of the disk to retain the 99 Mo, which decays to 99m Tc at radio-pharmacies. The press and sinter method is advantageous because the inherent porosity produced by this method enables increased surface area and therefore increased flow of dissolution media, decreasing the dissolution time and reducing the need for a highly acidic media. Although porosity aids in dissolution, it reduces the mechanical strength and ductility. Targets require good mechanical integrity when subjected to the conditions in the accelerator. Therefore, Northstar is seeking methods to rapidly test disk samples after fabrication to assure mechanical performance metrics are achieved. This report details the design and testing of a small punch test (SPT) that accommodates the 29 mm disk. Initial data were used to relate the SPT data to tensile properties, such as the yield strength (YS), ultimate tensile strength (UTS), and total elongation to failure. Although the SPT has been established as a somewhat reliable method for testing metallic materials, few studies have applied the SPT to refractory materials such as Mo. Based on tensile testing performed at Oak Ridge National Laboratory on different Mo samples, correlation between the Mo tensile and SPT properties could be performed, establishing a standard calibration that could be applied to other Mo samples. To test the efficacy of the SPT with Mo, multiple different disk batches were fabricated under different conditions (e.g., pressure, lubricant) with commercially available pure Mo powder. Generally, only a UTS could be well defined because the press and sinter disks failed under brittle fracture, making it difficult to determine the YS and elongation. Compared with disks fabricated with aMo powder, the aMo samples underperformed their pure nat Mo counterparts. This report summarizes the current status of the SPT, but further evaluation is needed before it can be applied as a reliable quality assurance tool.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2024

Review of Technical Photovoltaic Key Performance Indicators and the Importance of Data Quality Routines

Technical key performance indicators (KPIs) are important metrics used to assess and quantitatively summarize various aspects of photovoltaic (PV) systems, including long-term performance, economic viability, and carbon footprint. Herein, a group of experts of the International Energy Agency's Photovoltaic Power Systems Programme Task 13 collect and describ the most important technical KPIs used in the industry. Thereby, a set of best practices for reliably handling PV system data is presented and the impact of data quality and climatic variability on KPI calculation is investigated. Further, the effective use of technical KPIs allows triggering data-driven and informed decisions to optimize PV systems and providing a comprehensive overview of how PV systems operate across different conditions and climates. With the worldwide growth of the PV industry, more companies operate/own PV systems in different regions, where the climatic and seasonal profiles differ. This requires context-aware evaluation of KPIs, or the judicious application of multiple KPIs, to ensure that each asset is evaluated correctly. Beyond that, there is untapped potential in the utilization of KPIs through geospatial mapping and extrapolation of fleet KPIs. This study demonstrates that the uncertainty in KPI estimation is not well understood and depends on data quality, climatic variability, and system configuration.

14 SOLAR ENERGY↗

DOE OSTI2022

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2025

Explainable AI for Multivariate Time Series Pattern Exploration: Latent Space Visual Analytics With Temporal Fusion Transformer and Variational Autoencoders in Power Grid Event Diagnosis

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and interconnected nature of complex patterns, which hinder the understanding of their underlying physical processes. Existing AI methods often face limitations in interpretability, computational efficiency, and scalability, reducing their applicability in real-world scenarios. This paper proposes a novel visual analytics framework that integrates two generative AI models, Temporal Fusion Transformer (TFT) and Variational Autoencoders (VAEs), to reduce complex patterns into lower-dimensional latent spaces and visualize them in 2D using dimensionality reduction techniques such as PCA, t-SNE, and UMAP with DBSCAN. These visualizations, presented through coordinated and interactive views and tailored glyphs, enable intuitive exploration of complex multivariate temporal patterns, identifying patterns’ similarities and uncover their potential correlations for a better interpretability of the AI outputs. The framework is demonstrated through a case study on power grid signal data, where it identifies multi-label grid event signatures, including faults and anomalies with diverse root causes. Additionally, novel metrics and visualizations are introduced to validate the models and assess the performance, efficiency, and consistency of latent maps generated by VAE, which have been utilized in prior studies for latent space cartography and used as a benchmark in this study, and the emerging TFT architecture under various configurations. These analyses provide actionable insights for model parameter tuning and reliability improvements. Comparative results highlight that TFT achieves shorter run times and superior scalability to diverse time-series data shapes compared to VAE. This work advances fault diagnosis in multivariate time series, fostering explainable AI to support critical system operations.

Explainable AI↗

DOE OSTI2025

The search for high-entropy fuel-cell catalysts using disorder descriptors

The transition to a hydrogen economy depends on efficient, affordable catalysts for fuel cells. Platinum—the industry standard for fuel-cell electrodes—is costly and scarce, highlighting the need for practical alternatives. High-entropy alloys offer vast compositional diversity and tunable properties that can mitigate these issues, yet their chemical complexity and configurational disorder have hindered rational discovery. Here, we introduce a data-driven framework that couples machine learning with first-principles disorder descriptors—including the entropy forming ability, disordered enthalpy-entropy descriptor, and electronic-structure similarity metrics to platinum—to predict alloy synthesizability and catalytic performance. These descriptors are applied for the first time in the context of fuel-cell catalyst discovery. The workflow rapidly screens more than 20 000 compositions and identifies several platinum-free candidates that are economically viable, readily scalable, and exhibit promising predicted activity. These results demonstrate that disorder descriptors are reliably predicted by machine learning models and can be effectively integrated into materials-discovery pipelines, accelerating innovation across complex compositional spaces.

fuel-cell catalysts↗

DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗

DOE OSTI2023

On the Language of Reliability: A System Engineer Perspective

In its classical definition, risk is defined by three elements: what can go wrong, what are its consequences, and how likely is it to occur? While this definition makes sense in a regulatory-based framework where for the current fleet of operating light water reactors (LWRs), the risks associated with nuclear power plants typically are characterized in terms of core damage and large early release frequency (LERF), this approach does not provide a useful snapshot of the health of the plant from a broader perspective. This is due to the very narrow context in which the term “risk” typically is defined as nuclear safety aspects that have the potential to impact public health. In this paper, we take the viewpoint of nuclear safety that is reflective of the current fleet of operating LWRs for which core damage frequency and LERF are appropriate metrics. For other advanced reactor designs, other more applicable technology neutral metrics of reactor safety metrics would be specified. A possible alternate path would start by redefining the word risk with a broader meaning that better reflects the needs of a system health and asset management decision-making process. Rather than asking how likely an event could occur (in probabilistic terms), we can ask how far this event is from occurring. Our approach starts by defining and quantifying component and system health in terms of a “distance” between its actual and limiting conditions, i.e., determination of the margin that exists between the current state/condition and the state where the component/system is no longer capable of achieving its intended function. A margin is a measure that is more reflective of the current state or performance of a component, and therefore more closely tied to decisions that are made on an ongoing basis. Further, we will show how, given the data available from plant equipment reliability and monitoring (e.g., pump vibration data) and prognostic (e.g., component remaining useful life estimation) data, a margin can be described and determined for all types of maintenance approaches (e.g., corrective or predictive maintenance). We show how classical reliability models (e.g., fault trees) can be used to quantify the system margin provided component margin values. In the approach described in this paper, the propagation of margin values through classical reliability models are not performed using classical probabilistic calculations applied to sets (as performed in a typical plant probabilistic risk assessment). Instead, we show how it is possible to propagate margin values through Boolean logic gates (i.e., AND and OR operators) through distance-based operations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Test Points for Online Monitoring of Quantum Circuits

Noisy Intermediate-Scale Quantum (NISQ) computers consisting of tens of inherently noisy quantum bits (qubits) suffer from reliability problems. Qubits and their gates are susceptible to various types of errors. Due to limited numbers of qubits and high error rates, quantum error correction cannot be applied. Physical constraints of quantum hardware including the error rates are used to guide the design and the layout of quantum circuits. The error rates determine the selection of qubits and their operations. The resulting circuit is executed on the quantum computer. This study explores the risk of unexpected changes in the error rates of NISQ computers post-calibration. We show that unexpected changes in error rates can alter the output state of a quantum circuit. To detect these changes, we propose the insertion of test points into the quantum circuit to enable online monitoring of the physical qubit behavior. We utilize classical, superposition, and uncompute test points. Furthermore, we use a gate error coverage metric to assess the quality of the tests. We verify the effectiveness of the proposed scheme on different IBM quantum computers (IBM Q), in addition to a noisy simulation that shows the scalability of the proposed approach.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Using ultrasonic attenuation in cortical bone to infer distributions on pore size

Here, in this work we infer the underlying distribution on pore radius in human cortical bone samples using ultrasonic attenuation data. We first discuss how to formulate polydisperse attenuation models using a probabilistic approach and the Waterman Truell model for scattering attenuation. We then compare the Independent Scattering Approximation and the higher-order Waterman Truell models’ forward predictions for total attenuation in polydisperse samples. Following this, we formulate an inverse problem under the Prohorov Metric Framework coupled with variational regularization to stabilize this inverse problem. We then use experimental attenuation data taken from human cadaver samples and solve inverse problems resulting in nonparametric estimates of the probability density function on pore radius. We compare these estimates to the “true” microstructure of the bone samples determined via microCT imaging. We find that our methodology allows us to reliably estimate the underlying microstructure of the bone from attenuation data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

An investigation of non-canonical mixing in red giant stars using APOGEE 12 C/ 13 C ratios observed in open cluster stars

Standard stellar evolution theory poorly predicts the surface abundances of chemical species in low-mass, red giant branch (RGB) stars. Observations show an enhancement of p–p chain and CNO cycle products in red giant envelopes, which suggests the existence of non-canonical mixing that brings interior burning products to the surface of these stars. The 12 C/ 13 C ratio is a highly sensitive abundance metric used to probe this mixing. We investigate extra RGB mixing by examining: (1) how 12 C/ 13 C is altered along the RGB, and (2) how 12 C/ 13 C changes for stars of varying age and mass. Our sample consists of 43 red giants, spread over 15 open clusters from the Sloan Digital Sky Survey’s APOGEE DR17, that have reliable 12 C/ 13 C ratios derived from their APOGEE spectra. We vetted these 12 C/ 13 C ratios and compared them as a function of evolution and age/mass to the standard mixing model of stellar evolution, and to a model that includes prescriptions for RGB thermohaline mixing and stellar rotation. We find that the observations deviate from standard mixing models, implying the need for extra mixing. Additionally, some of the abundance patterns depart from the thermohaline model, and it is unclear whether these differences are due to incomplete observations, issues inherent to the model, our assumption of the cause of extra mixing, or any combination of these factors. Nevertheless, the surface abundances across our age/mass range clearly deviate from the standard model, agreeing with the notion of a universal mechanism for RGB extra mixing in low-mass stars.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Basic Energy Sciences Roundtable: Foundational Science for Carbon-Neutral Hydrogen Technologies

The amount of molecular hydrogen used worldwide is enormous; about 70 million metric tons are produced globally every year, with approximately 10 million metric tons produced within the U.S. alone. 1 Hydrogen is used primarily by the industrial sector for oil refining; chemical production, especially for ammonia; steel manufacturing; and transportation fuels. With the recent announcement of the Hydrogen Shot, the first U.S. Department of Energy (DOE) Energy Earthshot, the DOE declared a near-term focus on “accelerating breakthroughs of more abundant, affordable, and reliable clean energy solutions within the decade.” Consequently, there is a compelling need for novel approaches to enable hydrogen processes and technologies that do not emit carbon dioxide (i.e., are carbon-neutral). Innovative hydrogen research and development is required to impact how hydrogen is produced, stored, transported, converted, and used. Although progress has been made over the previous two decades, fundamental research can play a critical role in overcoming the technical hurdles that continue to limit implementation of economically viable systems and processes for carbon-neutral hydrogen technologies.

08 HYDROGEN↗

DOE OSTI2026

Equipartition and the Temperature of Maximum Density of TIP4P/2005 Water

Here, we simulate TIP4P/2005 water in the temperature range of 257 to 318 K with time-steps δ = 0.25, 0.50, 1.00, 2.00, and 4.00 fs. The density–temperature behavior obtained using 0.25 or 0.50 fs is in excellent agreement with each other but differs from those obtained using time steps that have been shown earlier to lead to a breakdown of equipartition. For δt = 0.25 or 0.50 fs, the temperature of maximum density (TMD) is 277.15 K and the density value is in close agreement with experiments. For δt = 1.00 fs, the TMD is 277.15 K, but the density value is shifted higher. For the other time steps considered here, the TMD is shifted to progressively lower values for longer time steps, a trend that holds for different thermostat/barostat combinations. Enhancing the water–water dispersion interaction, as has been recommended for simulating disordered proteins in TIP4P/2005, degrades the description of the liquid–vapor phase envelope. We present a simple physically transparent explanation that highlights the separation of the time scales between translational and rotational motion. We also develop a metric, χ, that we term the equipartition anomaly, to detect equipartition violations in simulations that include molecules that are treated as rigid objects. Calculating χ is shown to be straightforward and sensitive to equipartition violations. A key takeaway from this study is that using sufficiently short time steps (≤0.5 fs) to preserve equipartition is essential for obtaining meaningful liquid water properties and for producing reliable simulation data, as correct ensemble sampling is fundamental to ensure reproducibility across codes and simulation algorithms.

Asthagiri, Dilipkumar N. [Oak Ridge National Labor↗

DOE OSTI2022

Fabrication, thermal analysis, and heavy ion irradiation resistance of epoxy matrix nanocomposites loaded with silane-functionalized ceria nanoparticles

This paper describes a detailed understanding of how nanofillers function as radiation barriers within the polymer matrix, and how their effectiveness is impacted by factors such as composition, size, loading, surface chemistry, and dispersion. Here, we designed a comprehensive investigation of heavy ion irradiation resistance in epoxy matrix composites loaded with surface-modified ceria nanofillers, utilizing tandem computational and experimental methods to elucidate radiolytic damage processes and relate them to chemical and structural changes observed through thermal analysis, vibrational spectroscopy, and electron microscopy. A detailed mechanistic examination supported by FTIR spectroscopy data identified the bisphenol A moiety as a primary target for degradation reactions. Results of computational modeling by the Stopping Range of Ions in Matter (SRIM) Monte Carlo simulation were in good agreement with damage analysis from surface and cross-sectional SEM imaging. All metrics indicated that ceria nanofillers reduce the damage area in polymer nanocomposites, and that nanofiller loading and homogeneity of dispersion are key to effective damage prevention. The results of this study represent a significant pathway for engineered irradiation tolerance in a diverse array of polymer nanocomposite materials. Numerous areas of materials science can benefit from utilizing this facile and effective method to extend the reliability of polymer materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Best practices for photovoltaic performance loss rate calculations

Abstract The performance loss rate (PLR) is a vital parameter for the time-dependent assessment of photovoltaic (PV) system performance and health state. Although this metric can be calculated in a relatively straightforward manner, it is challenging to achieve accurate and reproducible results with low uncertainty. Furthermore, the temporal evolution of PV system performance is usually nonlinear, but in many cases a linear evaluation is preferred as it simplifies the assessment and it is easier to evaluate. As such, the search for a robust and reproducible calculation methodology providing reliable linear PLR values across different types of systems and conditions has been the focus of many research activities in recent years. In this paper, the determination of PV system PLR using different pipelines and approaches is critically evaluated and recommendations for best practices are given. As nonlinear PLR assessments are fairly new, there is no consent on how to calculate reliable values. Several promising nonlinear approaches have been developed recently and are presented as tools to evaluate the PV system performance in great detail. Furthermore, challenges are discussed with respect to the PLR calculation but also opportunities for differentiating individual performance losses from a generic PLR value having the potential of enabling actionable insights for maintenance.

14 SOLAR ENERGY↗

DOE OSTI2023

AutoSourceID-Classifier: Star-galaxy classification using a convolutional neural network with spatial information

Aims.Traditional star-galaxy classification techniques often rely on feature estimation from catalogs, a process susceptible to introducing inaccuracies, thereby potentially jeopardizing the classification’s reliability. Certain galaxies, especially those not manifesting as extended sources, can be misclassified when their shape parameters and flux solely drive the inference. We aim to create a robust and accurate classification network for identifying stars and galaxies directly from astronomical images. Methods.The AutoSourceID-Classifier (ASID-C) algorithm developed for this work uses 32x32 pixel single filter band source cutouts generated by the previously developed AutoSourceID-Light (ASID-L) code. By leveraging convolutional neural networks (CNN) and additional information about the source position within the full-field image, ASID-C aims to accurately classify all stars and galaxies within a survey. Subsequently, we employed a modified Platt scaling calibration for the output of the CNN, ensuring that the derived probabilities were effectively calibrated, delivering precise and reliable results. Results.We show that ASID-C, trained on MeerLICHT telescope images and using the Dark Energy Camera Legacy Survey (DECaLS) morphological classification, is a robust classifier and outperforms similar codes such as SourceExtractor. To facilitate a rigorous comparison, we also trained an eXtreme Gradient Boosting (XGBoost) model on tabular features extracted by SourceExtractor. While this XGBoost model approaches ASID-C in performance metrics, it does not offer the computational efficiency and reduced error propagation inherent in ASID-C’s direct image-based classification approach. ASID-C excels in low signal-to-noise ratio and crowded scenarios, potentially aiding in transient host identification and advancing deep-sky astronomy.

Astronomy & Astrophysics↗

DOE OSTI2023

A Transductive Graph Neural Network learning for Grid Resilience Analysis

Power grids are critical infrastructures that require robust resilience analysis to ensure reliable and uninterrupted electricity supply. Traditional simulation-based methods for grid resilience analysis suffer from computational complexity and limited ability to capture the full spectrum of potential disruptions. This paper presents a novel approach to enhance grid resilience by leveraging transductive graph neural network (GNN) learning to identify critical nodes and links. By leveraging the graph structure and system features, GNNs effectively learn resilience metrics and accurately identify critical nodes based on actual grid operational behavior. The efficacy of the proposed approach is demonstrated through case studies on node criticality scoring and critical node/line identification in cascading outage scenarios. The results highlight the advantages of learning-based methods over traditional simulation-based approaches and their potential to revolutionize grid resilience analysis. The contributions of this paper include a graph-based scalable approach for fast cascading analysis, an inductive formulation for training GNN models, and a transfer learning-based approach to scale the model to largescale power systems.

grid resilience, graph neural networks, transducti↗