Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

System Health and Status Reporting is Used to Improve Infrastructure Systems at the Hanford Site - 20449

Reliable physical infrastructure systems are vital to completing the clean-up mission and the start-up and commissioning of new nuclear waste processing facilities at the Hanford Site. Key infrastructure systems at Hanford include water, sewer, and electrical utilities, roads, telecommunications/network systems, and fire systems. All of the infrastructure systems are non-nuclear, General Service systems that are being maintained under formal engineering configuration control and none are specifically credited in any documented safety analysis (DSA). Starting in calendar year 2017, the Hanford Site's infrastructure and services contractor started producing system health and status reports for a total of 15 critical infrastructure systems as means to get a better understanding of each system's health and how it could be improved to ensure better and more reliable service delivery. As the reporting, tracking, and use of the metrics has matured, the number of systems for which reports are being developed has been expanded to a total of 23. Each of the critical infrastructure systems are assigned primary and alternate design authorities that complete qualifications on each assigned system. The design authorities actively manage and maintain configuration control on each of their systems and track metrics associated with availability, maintenance (corrective and preventive), and configuration of the technical baseline. The metrics are based on the principles established in Chapter V of DOE O 420.1C, Facility Safety, [1] and have been tailored as appropriate to each of the key infrastructure systems. An overall assessment of system health is performed and documented on a routine basis (e.g., quarterly). Included in this documentation is a quantitative score for each of the metrics (i.e., availability, maintenance, configuration management) along with results of system walk-downs, description of any permanent design modifications, identification of new or emerging issues and vulnerabilities affecting the system, and an assessment by the design authority of actions necessary to improve the system health score. The overall status scores are calculated using a formula and based on a pre-determined grading scale, a color is assigned for simple presentation. The information gained from developing the reports is being used to (1) assist with making timely and better informed decisions through the use of solid technical bases that are increasing the overall reliability and capabilities of the Site's infrastructure systems as new expense and capital projects in the Reliability Projects Investment Portfolio (RPIP) are prioritized and executed; (2) feed the risk management program, and (3) integrate the technical content of Master Plans that describe the Site's needs for the system and the system's capabilities to meet those future needs. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Characterizing the Stability of NISQ Devices

In this study, we focus on the question of stability of NISQ devices. The parameters that define the device stability profile are motivated by the work of DiVincenzo in [9] where the requirements for physical implementation of quantum computing are discussed. We develop the metrics and theoretical framework to quantify the DiVincenzo requirements and study the stability of those key metrics. The basis of our assessment is histogram similarity (in time and space). For identical experiments, devices which produce reproducible histograms in time, and similar histograms in space, are considered more reliable. To investigate such reliability concerns robustly, we propose a moment-based distance (MBD) metric. We illustrate our methodology using data collected from IBM's Yorktown device. Two types of assessments are discussed: spatial stability and temporal stability.

Dasgupta, Samudra↗
DOE OSTI2023

CIEL ∗ Ch color map for visualization and analysis of sea ice motion

The International Commission on Illumination (CIE) designed its color space to be perceptually uniform so that a given numerical change in the color code corresponds to perceived change in color. This color encoding is demon- strated to be advantageous in scientific visualization and analysis of vector fields. The specific application is analysis of ice motion in the Arctic where patterns in smooth monthly-averaged ice motion are seen. Furthermore, fractures occurring in the ice cover result in discontinuities in the ice motion. This vector jump in displacement can also be visualized. We then analyze modeled and observed fractures through the use of a metric on the color space, and image amplitude and phase metrics. Amplitude and phase met- rics arise from image registration that is accomplished by sampling images using space filling curves, thus reducing the image registration problem to the more reliable functional alignment problem. We demonstrate this through an exploration of the metrics to compare model runs to an observed ice crack.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

2023 FORCE Development Status Update

Technical and economic analysis of integrated energy systems (IES) using software models is a complex process requiring multiple commodity market decision analysis, optimal control, process modeling, and stochastic analysis. Many assumptions used in traditional energy analysis tools do not hold in future energy markets with significant storage and variable renewable energy sources (VRE), let alone with multiple commodity markets. Capturing these intricate elements for accurate techno-economic analysis of IES led to the development of the Framework for Optimization of ResourCes and Economics (FORCE) tool suite under the U.S. Department of Energy’s Integrated Energy Systems crosscutting technology program. With the aim of a full framework release in 2025, many improvements to the FORCE tool suite were developed in fiscal year 2023 (FY23). These improvements broadly fit into three focuses for development of FORCE: capability, accessibility, and reliability. Capability refers to the ability of FORCE to accurately model the technical and economic viability of various IES. Accessibility refers to ease-of-use for new and existing IES analysts to efficiently set up, analyze, and produce results using FORCE. Reliability refers to the consistency of the software, allowing consistency to analysis regardless of erstwhile changes to the software. In addition to many smaller changes, there are three major capability improvements in FORCE in FY23. In summary, FORCE developments in FY23 have moved us close to all the capability requirements for FORCE 1.0 to be delivered in FY25. Inclusion of Bayesian optimization, resilience metrics, and levelized cost analysis expand the capability, accessibility, and reliability of FORCE.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Wind Turbine Drivetrain Reliability Research - Gearbox Bearing Axial Cracking Failure Mode Example

The U.S. Department of Energy's National Renewable Energy Laboratory and Argonne National Laboratory have been conducting wind turbine drivetrain (formerly gearbox) reliability research for many years. Although the drivetrain focus has not changed, detailed projects are adjusted every few years based on dynamic needs seen in the field across the wind industry. This webinar will walk through the research methodology by using wind turbine gearbox bearing axial cracking failure mode as an example. The detailed steps include: 1) top failure mode identification based on actual failure data collected from project partners, 2) bench-top testing to identify possible contributing factors and formulate a damage metric, 3) physics domain modeling and validation through testing, 4) reliability assessment and prognosis based on the physics domain model and data domain inputs, and further enhancement through machine learning algorithms, using actual wind plant operational and failure event data. Hopefully, the presented work is of interest to the IISE community, and some members can apply their expertise to wind turbine and plant applications, helping enhance wind power generation technology advancement and its broader deployment.

axial cracking↗
DOE OSTI2026

Molecular Dynamics Investigation of Oil Wetting on Synthetic Polymer Substrates

Understanding the interaction of polymer surfaces with nonpolar, low surface tension liquids, or whether a substrate is oleophobic versus oleophilic, is critical for applications ranging from antifingerprint coatings to oil–water separation membranes and oil spill remediation. Despite its technological importance, the molecular mechanisms underpinning polymer–oil wetting are not well characterized. Here, we employ molecular dynamics simulations to investigate the behavior of n-hexadecane in contact with chemically distinct polymer surfaces, spanning eight constitutional unit chemistries as well as amorphous and crystalline morphologies. This permits a critical examination of both thermodynamic and dynamic descriptors of oleophobicity, including oil contact angle, dewetting free energy, interfacial diffusivity, and a proposed “ghost probe energy,” which does not require explicit simulation of oil–polymer interactions. We find that the oil contact angle does not reliably distinguish oleophobic behavior across polymer chemistries, whereas other metrics provide clearer and more consistent differentiation. Analysis of the results reveals that polymer–oil wetting behavior is primarily governed by interfacial van der Waals interactions and modulated by surface flexibility and morphology. Collectively, this work establishes a computational framework for characterizing oil wetting and provides additional insight into what molecular-level factors dictate trends in oleophobicity.

lipids↗
DOE OSTI2026

An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy

We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.

Artificial neural networks↗
DOE OSTI2021

Modeling Framework for Evaluating Grid Disturbances

Recent research in the literature proposed parameter-based functional forms to quantify the impact of disturbances on electric power grids. This modeling was based on a concept of generalized grid disturbances that harmonized reliability and resilience. Three main stages—avoid, react, and recover—were identified, and to support practicality, were intended to be independently planned. An objective of the grid disturbance model was to fairly analyze the potential impacts of novel mitigations like transactive energy systems (TES) on grid reliability and resilience. Quantitative evaluation of a common performance metric (e.g., area under the curve of percentage customers online before, during, and after an event) over time was shown as an effective tool for such analysis. Such quantification may also enable system planners to assess the impact of appropriate mitigative actions for improving grid performance against potential disturbances. This is the focus of this report, i.e., presenting an evaluation modeling framework that can be utilized to evaluate grid performance against disturbances, under a variety of existing and possible new mitigative actions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Statistical Tests for Diagnosing Fission Source Convergence and Undersampling in Monte Carlo Criticality Calculations [Slides]

There is a very strong need for statistical testing to determine fission source convergence in Monte Carlo criticality calculations. Automation of such tests will greatly streamline and support the work carried out by NCS practitioners. Recent R&D work has shown that no single statistical test for convergence is sufficiently reliable, robust, and “guaranteed.” However, a combination of several standard statistical tests for the similarity of distributions, coupled with a high-fidelity estimate of the fission-matrix source is sufficiently robust, reliable, and repeatable that convergence can be “guaranteed.” During the course of the EG-AMCT studies, a number of statistical metrics and tests were proposed for diagnosing clustering and undersampling. None of these was robust and reliable enough for practical use in production codes. However, the expert group efforts came close. Some recent R&D work stemming from those past efforts has been very successful and promising. This Sub-Group will provide international input and collaboration on the development and implementation of statistical tests for convergence, with the primary goal of having the MC codes automatically detect convergence (or lack thereof). Newly proposed statistical tests to detect undersampling (after convergence) will also be reviewed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) (Final Technical Report)

The Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) project advances resilience science and engineering by addressing challenges in rural Kansas communities where aging infrastructure, extreme weather, and socioeconomic disparities heighten vulnerability to energy disruptions. Traditional approaches often focus on technical performance while overlooking community concerns and priorities. SAFER responds by integrating community perspectives with advanced analytical frameworks to create a holistic model for measuring and improving resilience. Project objectives included developing novel resilience metrics, advancing modeling frameworks that capture interdependencies across infrastructures, and embedding community-centric indicators directly into planning processes for distributed energy resources. The key technical innovations included the creation of self-organizing map (SOM)-based indices for objective resilience quantification, hetero-functional graph theory (HFGT) models linking power, water, transportation, and community assets, and graph neural network (GNN) tools for identifying critical nodes in complex systems. Community-centric energy planning was demonstrated through optimal siting and sizing of (photovoltaic) PV and battery storage, ensuring resilience enhancements also addressed energy burden and energy insecurity. SAFER engaged community partners in Dodge City and Ford County through surveys, focus groups, and workshops, generating more than 600 responses that established baseline measures of energy burden, financial insecurity, and willingness-to-pay to avoid outages. This data, organized in terms of a community capitals framework, informed the development of weighted reliability indices that better reflect community costs than traditional utility metrics. SAFER’s GNN-based critical node identification framework identified expert-labelled critical nodes with over 99% accuracy, while also uncovering additional functionalities essential for proactive resilience planning. The project’s models demonstrated that optimal PV and storage deployment could improve resilience indices by over 11 percent, with dispatch strategies further enhancing outcomes, confirming both the technical effectiveness and economic feasibility of these approaches. Through its combined emphasis on rigorous modeling, community-focused planning, and community engagement, SAFER advances the state of resilience research while delivering direct benefits to rural communities. The project provides tools, guidelines, and resilience heatmaps that help utilities, local governments, and residents better anticipate disruptions, prioritize investments, and strengthen the capacity to withstand and recover from energy-related hazards. Furthermore, the developed HFG and GNN frameworks are designed for transferability, allowing them to be adapted for resilience planning in other communities with minimal retraining. This inductive learning capability provides a scalable pathway to extend the SAFER project’s impact. Thus, creating a foundation for a nationally applicable model of infrastructure resilience. Additionally, the HFG can also be extended to include other FEMA community lifelines.

14 SOLAR ENERGY↗
DOE OSTI2026

SAF: a promising approach to meet growing jet fuel demand

SAF provides a promising approach to aid the rising jet fuel demand from increased travel around the world and reduce the lifecycle emissions from the aviation sector. Although the feasibility of SAF pathways has been demonstrated through economic and environmental metrics quantification, the models used to quantify these variables have a high degree of variability in terms of accuracy and thereby reliability. To understand how to adopt and commercialize SAF, we need to harmonize these process models and assess metrics and technical limitations related to their production technologies. We find the production cost of SAF using hydro processed fatty acids and esters (HEFA), Fischer-Tropsch (FT), and alcohol-to-jet (ATJ) to be $\$$3-$\$$6/gallon gasoline equivalent (gge) and life cycle emissions to be lower than Jet A, except for ATJ using corn grain (≤25%). HEFA utilizing oil feedstocks has the lowest production cost (~$\$$2.9/gge) and highest jet yield (>150 gge/dry ton), while FT has the largest emission reduction (94%) compared to fossil jet. A unique contribution of this study is a comparative analysis of metrics related to SAF processes across technical, economic, and sustainability aspects. A cross-comparison of these metrics shows HEFA using fats, oils, and grease have the most favorable ratings, while HEFA using algae and ATJ using corn stover have more neutral and unfavorable ratings, respectively. These ratings can be improved by implementing the right combination of practical and technological advancements.

09 BIOMASS FUELS↗
DOE OSTI2023

Reliable Devices Yield Stable Quantum Computations

Stable quantum computation requires noisy results to remain bounded even in the presence of noise fluctuations. Yet non-stationary noise processes lead to drift in the varying characteristics of a quantum device that can greatly influence the circuit outcomes. Here we address how temporal and spatial variations in noise relate device reliability to quantum computing stability. First, our approach quantifies the differences in statistical distributions of characterization metrics collected at different times and locations using Hellinger distance. We then validate an analytical bound that relates this distance directly to the stability of a computed expectation value. Our demonstration uses numerical simulations with models informed by the washington superconducting transmon device. We find that the stability metric is consistently bounded from above by the corresponding Hellinger distance, which can be cast as a specified tolerance level. These results underscore the significance of reliable quantum computing devices and the impact for stable quantum computation.

Dasgupta, Samudra↗
DOE OSTI2022

Ellipsoidal Fitting Methodology for Defect Clusters in Gallium Arsenide

In assessing the initial spatial distribution of defects from neutron or heavy ion irradiation, it is useful to have a reliable, automated, and fast-running tool to evaluate characteristic metrics such as the number of sub-clusters or the overall cluster volume. The latter metric, for instance, can be utilized to estimate a reference neutron fluence level at which inter-cluster interaction effects begin to become significant. This paper details a methodology to fit an arbitrarily complex defect map with a set of ellipsoids (one per identified sub-cluster) in which the constituent defects of a sub-cluster are determined using fuzzy degree-of-membership analysis. Specifically, a parameterized model is developed for point defects in gallium arsenide. Cluster volume calculations based on the model are compared against convex hull and single- ellipsoid representations. Results show that the parameterized sub-cluster model begins to deviate from the two reference models at a recoil energy of about 100 keV in GaAs, with the convex hull and single-ellipsoid representations increasingly overestimating the volume thereafter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Avancando na Transicao Energetica: Desafios e Estrategias para a Implantacao Sustentavel de FV

As the world embarks on an ambitious journey towards global decarbonization, the spotlight turns to photovoltaic (PV) technology as a cornerstone for sustainable energy solutions. This talk delves into the current status and projections of PV for the World, US and Brasil, and the necessary considerations to do this increase in manufacturing and deployment sustainably. With the projected scale of deployment, the industry faces significant challenges related to material demand and the management of PV modules at their end of life. The principles of the Circular Economy (CE) and its associated R-Actions - Reduce, Reuse, Recycle, among others - present a promising framework to address these challenges by mitigating end-of-life management and material sourcing concerns. However, traditional CE metrics, often focused solely on mass, fall short by excluding vital energy flow considerations. In this talk, we will highlight how various metrics are needed to understand sustainable PV solutions, how continuing the search for increased efficiency can significantly reduce material demands and enhance energy metrics, while strategies around material circularity and module lifetime and reliability improvements will offer substantial reductions in both material and energy demands.

Brasil↗
DOE OSTI2022

Development of Quality Control Methods for Robust and Reliable Sensor Design

The successful adoption of additive manufacturing for the rapid prototyping of printed sensors requires the establishment of quantifiable metrics that can interrogate device performance. One measure of performance is the adhesion strength between the substrate and sensor interface, which is critical since the strength of this interface can dictate the accuracy and reliability of the printed sensor. In this work, a non-contact laser-induced spallation technique was used to quantify the adhesion of silver prints on an aluminum alloy substrate. The laser-based method was compared to a standardized pull-off adhesion test, which provided baseline measurements of adhesion strength. The sintering conditions were shown to play an important role in the film-substrate adhesion strength, as well as the cohesion and ductility of the film itself. The methods and results described in this work supports the establishment of process control steps that are necessary for verifying the reliability of printed devices prior to its deployment in critical experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Multiscale assessment of North American terrestrial carbon balance

Abstract. Comparisons of carbon uptake estimates from bottom-up terrestrial biosphere models (TBMs) to top-down atmospheric inversions help assess how well we understand carbon dioxide (CO2) exchange between the atmosphere and terrestrial biosphere. Previous comparisons have shown varying levels of agreement between bottom-up and top-down approaches, but they have almost exclusively focused on large, aggregated scales (e.g., global or continental), providing limited insights into reasons for the mismatches. Here we explore how consistency, defined as the spread in net ecosystem exchange (NEE) estimates within an ensemble of TBMs or inversions, varies with at finer spatial scales ranging from 1∘×1∘ to the continent of North America. We also evaluate how well consistency informs accuracy in overall NEE estimates by filtering models based on their agreement with the variability, magnitude, and seasonality in observed atmospheric CO2 drawdowns or enhancements. We find that TBMs produce more consistent estimates of NEE for most regions and at most scales relative to inversions. Filtering models using atmospheric CO2 metrics causes ensemble spread to decrease substantially for TBMs, but not for inversions. This suggests that ensemble spread is likely not a reliable measure of the uncertainty associated with the North American carbon balance at any spatial scale. Promisingly, applying atmospheric CO2 metrics leads to a set of models with converging flux estimates across TBMs and inversions. Overall, we show that multiscale assessment of the agreement between bottom-up and top-down NEE estimates, aided by regional-scale observational constraints is a promising path towards identifying fine-scale sources of uncertainty and improving both ensemble consistency and accuracy. These findings help refine our understanding of biospheric carbon balance, particularly at scales relevant for informing regional carbon-climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Application of Margin-Based Methods to Assess System Health

Health management of complex systems such as nuclear power plants is an essential task to guarantee system reliability. This task can be greatly enhanced by constantly monitoring asset status and performances and process such data (through anomaly detection, diagnostic, and prognostic computational algorithms) to identify asset degradation trends and faulty states. While such information and data are typically available for many of the assets, they are not propagated from the asset to the system level in order to identify the most critical assets and prioritize maintenance and surveillance activities. The main reason is driven by the fact that current reliability modeling techniques are inadequate to process such information/data. This is due to the nature of these techniques which are based on the concept of failure rate/probability that do not serve an operational context where quantitative asset health information is available. Simply stated, current reliability techniques serve a run-to-failure operational setting and not a predictive maintenance one where the goal is to perform maintenance and surveillance activities only when they are needed based on asset health. The risk informed asset management (RIAM) project is focusing on the development of a different kind of reliability modeling techniques designed to adequately serve a predictive operational setting. Such reliability techniques move aways from a failure rate/probability to a margin-based mindset where margin is here used as a metric to quantify asset health based only on current and past operational experience of the asset under consideration. In addition, margin-based reliability techniques are able to propagate asset health information from the component to system level and provide importance measure to each asset. This report summarizes a recent activity performed in collaboration with plant modernization pathway designed to integrate monitoring data into margin-based reliability models. Such activity focuses on a specific system of an existing nuclear power plant where large amount of historic monitoring data is used to monitor asset and system health.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Real-Time Lifetime Prediction of Semiconductor Devices Using Hardware-in-the-Loop

This paper presents a unique approach to enable real-time lifespan prediction of semiconductor power modules using a Hardware-in-the-Loop (HIL) system. By integrating the module's overall loss characteristics-specifically switching and conduction losses-with a thermoelectric model of the thermal management system, this research demonstrates that the model can dynamically estimates the junction temperature profile of the semiconductor devices in response to a changing torque demand profile for the motor drive system. This capability enables continuous monitoring of the module's operational time and cumulative stress induced on the devices to compute accumulated remaining lifetime or time-to-failure (TTF). This study provides an architectural framework for the HIL system with high-fidelity component models of multiple physical domains, allowing simulation of dynamic behaviors of a closely-coupled motor drive system. The advanced real-time computation and measurement functionalities of the HIL system allow for both dynamic lifetime calculations based on simulated data and aggregate lifetime predictions utilizing historical data. Moreover, this paper details an algorithm that not only computes cumulative damage but also synthesizes these data into a comprehensive aggregated lifetime metric. This methodology can enhance the maintenance scheduling strategies and operational reliability of semiconductor devices in critical applications, ultimately extending their service life while optimizing performance.

hardware-in-the-loop (HIL)↗