Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Molecular Dynamics Investigation of Oil Wetting on Synthetic Polymer Substrates

Understanding the interaction of polymer surfaces with nonpolar, low surface tension liquids, or whether a substrate is oleophobic versus oleophilic, is critical for applications ranging from antifingerprint coatings to oil–water separation membranes and oil spill remediation. Despite its technological importance, the molecular mechanisms underpinning polymer–oil wetting are not well characterized. Here, we employ molecular dynamics simulations to investigate the behavior of n-hexadecane in contact with chemically distinct polymer surfaces, spanning eight constitutional unit chemistries as well as amorphous and crystalline morphologies. This permits a critical examination of both thermodynamic and dynamic descriptors of oleophobicity, including oil contact angle, dewetting free energy, interfacial diffusivity, and a proposed “ghost probe energy,” which does not require explicit simulation of oil–polymer interactions. We find that the oil contact angle does not reliably distinguish oleophobic behavior across polymer chemistries, whereas other metrics provide clearer and more consistent differentiation. Analysis of the results reveals that polymer–oil wetting behavior is primarily governed by interfacial van der Waals interactions and modulated by surface flexibility and morphology. Collectively, this work establishes a computational framework for characterizing oil wetting and provides additional insight into what molecular-level factors dictate trends in oleophobicity.

lipids↗
DOE OSTI2026

An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy

We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.

Artificial neural networks↗
DOE OSTI2021

Modeling Framework for Evaluating Grid Disturbances

Recent research in the literature proposed parameter-based functional forms to quantify the impact of disturbances on electric power grids. This modeling was based on a concept of generalized grid disturbances that harmonized reliability and resilience. Three main stages—avoid, react, and recover—were identified, and to support practicality, were intended to be independently planned. An objective of the grid disturbance model was to fairly analyze the potential impacts of novel mitigations like transactive energy systems (TES) on grid reliability and resilience. Quantitative evaluation of a common performance metric (e.g., area under the curve of percentage customers online before, during, and after an event) over time was shown as an effective tool for such analysis. Such quantification may also enable system planners to assess the impact of appropriate mitigative actions for improving grid performance against potential disturbances. This is the focus of this report, i.e., presenting an evaluation modeling framework that can be utilized to evaluate grid performance against disturbances, under a variety of existing and possible new mitigative actions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2010

A Computational Framework to Control Verification and Robustness Analysis

This paper presents a methodology for evaluating the robustness of a controller based on its ability to satisfy the design requirements. The framework proposed is generic since it allows for high-fidelity models, arbitrary control structures and arbitrary functional dependencies between the requirements and the uncertain parameters. The cornerstone of this contribution is the ability to bound the region of the uncertain parameter space where the degradation in closed-loop performance remains acceptable. The size of this bounding set, whose geometry can be prescribed according to deterministic or probabilistic uncertainty models, is a measure of robustness. The robustness metrics proposed herein are the parametric safety margin, the reliability index, the failure probability and upper bounds to this probability. The performance observed at the control verification setting, where the assumptions and approximations used for control design may no longer hold, will fully determine the proposed control assessment.

Crespo, Luis G.↗
NASA NTRS2010

An Analysis of the Environments of Intense Convective Systems in West Africa in 2003

We investigated the local- and regional-scale thermodynamical and dynamical environments associated with intense convective systems in West Africa during 2003. We identified convective system cases from TRMM microwave imagery, classifying each case by the system minimum 85-GHz brightness temperature and by the estimated elapsed time of propagation from high terrain. The speed of the mid-level jet, the magnitude of the low-level shear, and the surface equivalent potential temperature (theta(sub e)) were greater for the intense cases compared to the non-intense cases, although the differences between the means tended to be small, less than 3K for surface theta(sub e). Hypothesis testing of a series of commonly used intensity prediction metrics resulted in significant results only for low-level metrics such as convective available potential energy and not for any of the mid- or upper-level metrics such as 700-hPa theta(sub e). None of the environmental variables or intensity metrics by themselves or in combination appeared to be reliable direct predictors of intensity. In the regional scale analysis, the majority of intense convective systems occurred in the surface baroclinic zone where surface theta(sub e) exceeded 344 K and the 700-hPa zonal wind speeds were less than -6/ms. Fewer intense cases compared to non-intense cases were associated with African easterly wave troughs. Fewer than 25% of our cases occurred in environments with detectable Saharan dust loads, and the results for intense and non-intense cases were similar. Our results for the regional analysis were consistent with the seasonal movement of the WAM and the intertropical front, regional differences in topography, and AEW energetics.

Nicholls, Stephen D.↗
DOE OSTI2020

Statistical Tests for Diagnosing Fission Source Convergence and Undersampling in Monte Carlo Criticality Calculations [Slides]

There is a very strong need for statistical testing to determine fission source convergence in Monte Carlo criticality calculations. Automation of such tests will greatly streamline and support the work carried out by NCS practitioners. Recent R&D work has shown that no single statistical test for convergence is sufficiently reliable, robust, and “guaranteed.” However, a combination of several standard statistical tests for the similarity of distributions, coupled with a high-fidelity estimate of the fission-matrix source is sufficiently robust, reliable, and repeatable that convergence can be “guaranteed.” During the course of the EG-AMCT studies, a number of statistical metrics and tests were proposed for diagnosing clustering and undersampling. None of these was robust and reliable enough for practical use in production codes. However, the expert group efforts came close. Some recent R&D work stemming from those past efforts has been very successful and promising. This Sub-Group will provide international input and collaboration on the development and implementation of statistical tests for convergence, with the primary goal of having the MC codes automatically detect convergence (or lack thereof). Newly proposed statistical tests to detect undersampling (after convergence) will also be reviewed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) (Final Technical Report)

The Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) project advances resilience science and engineering by addressing challenges in rural Kansas communities where aging infrastructure, extreme weather, and socioeconomic disparities heighten vulnerability to energy disruptions. Traditional approaches often focus on technical performance while overlooking community concerns and priorities. SAFER responds by integrating community perspectives with advanced analytical frameworks to create a holistic model for measuring and improving resilience. Project objectives included developing novel resilience metrics, advancing modeling frameworks that capture interdependencies across infrastructures, and embedding community-centric indicators directly into planning processes for distributed energy resources. The key technical innovations included the creation of self-organizing map (SOM)-based indices for objective resilience quantification, hetero-functional graph theory (HFGT) models linking power, water, transportation, and community assets, and graph neural network (GNN) tools for identifying critical nodes in complex systems. Community-centric energy planning was demonstrated through optimal siting and sizing of (photovoltaic) PV and battery storage, ensuring resilience enhancements also addressed energy burden and energy insecurity. SAFER engaged community partners in Dodge City and Ford County through surveys, focus groups, and workshops, generating more than 600 responses that established baseline measures of energy burden, financial insecurity, and willingness-to-pay to avoid outages. This data, organized in terms of a community capitals framework, informed the development of weighted reliability indices that better reflect community costs than traditional utility metrics. SAFER’s GNN-based critical node identification framework identified expert-labelled critical nodes with over 99% accuracy, while also uncovering additional functionalities essential for proactive resilience planning. The project’s models demonstrated that optimal PV and storage deployment could improve resilience indices by over 11 percent, with dispatch strategies further enhancing outcomes, confirming both the technical effectiveness and economic feasibility of these approaches. Through its combined emphasis on rigorous modeling, community-focused planning, and community engagement, SAFER advances the state of resilience research while delivering direct benefits to rural communities. The project provides tools, guidelines, and resilience heatmaps that help utilities, local governments, and residents better anticipate disruptions, prioritize investments, and strengthen the capacity to withstand and recover from energy-related hazards. Furthermore, the developed HFG and GNN frameworks are designed for transferability, allowing them to be adapted for resilience planning in other communities with minimal retraining. This inductive learning capability provides a scalable pathway to extend the SAFER project’s impact. Thus, creating a foundation for a nationally applicable model of infrastructure resilience. Additionally, the HFG can also be extended to include other FEMA community lifelines.

14 SOLAR ENERGY↗
NASA NTRS2010

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

Ligda, Sarah V.↗
DOE OSTI2026

SAF: a promising approach to meet growing jet fuel demand

SAF provides a promising approach to aid the rising jet fuel demand from increased travel around the world and reduce the lifecycle emissions from the aviation sector. Although the feasibility of SAF pathways has been demonstrated through economic and environmental metrics quantification, the models used to quantify these variables have a high degree of variability in terms of accuracy and thereby reliability. To understand how to adopt and commercialize SAF, we need to harmonize these process models and assess metrics and technical limitations related to their production technologies. We find the production cost of SAF using hydro processed fatty acids and esters (HEFA), Fischer-Tropsch (FT), and alcohol-to-jet (ATJ) to be $\$$3-$\$$6/gallon gasoline equivalent (gge) and life cycle emissions to be lower than Jet A, except for ATJ using corn grain (≤25%). HEFA utilizing oil feedstocks has the lowest production cost (~$\$$2.9/gge) and highest jet yield (>150 gge/dry ton), while FT has the largest emission reduction (94%) compared to fossil jet. A unique contribution of this study is a comparative analysis of metrics related to SAF processes across technical, economic, and sustainability aspects. A cross-comparison of these metrics shows HEFA using fats, oils, and grease have the most favorable ratings, while HEFA using algae and ATJ using corn stover have more neutral and unfavorable ratings, respectively. These ratings can be improved by implementing the right combination of practical and technological advancements.

09 BIOMASS FUELS↗
NASA NTRS1988

A menu of self-administered microcomputer-based neurotoxicology tests

This study examined the feasibility of repeated self-administration of a newly developed battery of mental acuity tests. Researchers developed this battery to be used to screen the fitness for duty of persons in at-risk occupations (astronauts, race car drivers), or those who may be exposed to environmental stress, toxic agents, or disease. The menu under study contained cognitive and motor tests implemented on a portable microcomputer including: a five-test core battery, lasting six minutes, which had demonstrable reliabilities and stability from several previous repeated-measures studies, and also 13 new tests, lasting 42 minutes, which had appeared in other batteries but had not yet been evaluated for repeated-measures implementation in this medium. Sixteen subjects self-administered the battery over 10 repeated sessions. The hardware performed well throughout the study and the tests appeared to be easily self-administered. Stabilities and reliabilities of the test from the core battery were comparable to those obtained previously under more controlled experimental conditions. Analyses of metric properties of the remaining 13 tests produced eight additional tests with satisfactory properties. Although the average retest reliability was high, cross-correlations between tests were low, indicating factorial richness. The menu can be used to form batteries of flexible total testing time which are likely to tap different mental processes and functions.

Kennedy, Robert S.↗
DOE OSTI2023

Reliable Devices Yield Stable Quantum Computations

Stable quantum computation requires noisy results to remain bounded even in the presence of noise fluctuations. Yet non-stationary noise processes lead to drift in the varying characteristics of a quantum device that can greatly influence the circuit outcomes. Here we address how temporal and spatial variations in noise relate device reliability to quantum computing stability. First, our approach quantifies the differences in statistical distributions of characterization metrics collected at different times and locations using Hellinger distance. We then validate an analytical bound that relates this distance directly to the stability of a computed expectation value. Our demonstration uses numerical simulations with models informed by the washington superconducting transmon device. We find that the stability metric is consistently bounded from above by the corresponding Hellinger distance, which can be cast as a specified tolerance level. These results underscore the significance of reliable quantum computing devices and the impact for stable quantum computation.

Dasgupta, Samudra↗
DOE OSTI2022

Ellipsoidal Fitting Methodology for Defect Clusters in Gallium Arsenide

In assessing the initial spatial distribution of defects from neutron or heavy ion irradiation, it is useful to have a reliable, automated, and fast-running tool to evaluate characteristic metrics such as the number of sub-clusters or the overall cluster volume. The latter metric, for instance, can be utilized to estimate a reference neutron fluence level at which inter-cluster interaction effects begin to become significant. This paper details a methodology to fit an arbitrarily complex defect map with a set of ellipsoids (one per identified sub-cluster) in which the constituent defects of a sub-cluster are determined using fuzzy degree-of-membership analysis. Specifically, a parameterized model is developed for point defects in gallium arsenide. Cluster volume calculations based on the model are compared against convex hull and single- ellipsoid representations. Results show that the parameterized sub-cluster model begins to deviate from the two reference models at a recoil energy of about 100 keV in GaAs, with the convex hull and single-ellipsoid representations increasingly overestimating the volume thereafter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2022

Robustness of Vegetation Optical Depth Retrievals Based on L-Band Global Radiometry

Microwave vegetation optical depth (VOD) and soil moisture (SM) can be simultaneously retrieved based on L-band radiometry with polarization information. VOD is indicative of the vegetation water content (VWC) because it captures the extinction of land surface emission. If the connectivity of VOD to VWC is robust, the pair of VWC-SM observations can be viable bases for understanding soil–plant–atmosphere water relations, providing new perspectives on ecosystem science. Simultaneous SM–VOD retrievals are feasible by inverting the τ−ω model with two independent datasets in dual-channel algorithms. However, given correlated satellite vertical and horizontal brightness temperatures (TBs; TB v and TB h ), an ill-posed inverse problem arises where TB errors result in high uncertainties of retrievals. In this study, we apply the degrees-of-information (DoI) metric and propose a signal-to-noise ratio (SNR) metric to assess the “retrievability” of VOD given the Soil Moisture Active Passive (SMAP) TB v –TB h linear dependence. The application of these metrics allows determining where the VOD retrievals are robust and reliable. This is a necessary step in supporting the applications of VOD in ecology and hydrology. Results show that regions with mainly nonwoody vegetation have the best potential for VOD retrievals, though regularization is necessary. We then assess VOD time variations from two regularization products that reduce the impact of underdetermined inversions: the L3 dual-channel algorithm (L3-DCA) and the multitemporal dual-channel algorithm (MTDCA), which constrain VOD time dynamics with and without using a priori VOD climatology, respectively. Though they both reduce noise, especially in the VOD retrievals, they result in differences in VOD seasonal amplitude and coupling to SM at high frequencies as we outline here.

Microwave↗
DOE OSTI2024

Avancando na Transicao Energetica: Desafios e Estrategias para a Implantacao Sustentavel de FV

As the world embarks on an ambitious journey towards global decarbonization, the spotlight turns to photovoltaic (PV) technology as a cornerstone for sustainable energy solutions. This talk delves into the current status and projections of PV for the World, US and Brasil, and the necessary considerations to do this increase in manufacturing and deployment sustainably. With the projected scale of deployment, the industry faces significant challenges related to material demand and the management of PV modules at their end of life. The principles of the Circular Economy (CE) and its associated R-Actions - Reduce, Reuse, Recycle, among others - present a promising framework to address these challenges by mitigating end-of-life management and material sourcing concerns. However, traditional CE metrics, often focused solely on mass, fall short by excluding vital energy flow considerations. In this talk, we will highlight how various metrics are needed to understand sustainable PV solutions, how continuing the search for increased efficiency can significantly reduce material demands and enhance energy metrics, while strategies around material circularity and module lifetime and reliability improvements will offer substantial reductions in both material and energy demands.

Brasil↗
DOE OSTI2022

Development of Quality Control Methods for Robust and Reliable Sensor Design

The successful adoption of additive manufacturing for the rapid prototyping of printed sensors requires the establishment of quantifiable metrics that can interrogate device performance. One measure of performance is the adhesion strength between the substrate and sensor interface, which is critical since the strength of this interface can dictate the accuracy and reliability of the printed sensor. In this work, a non-contact laser-induced spallation technique was used to quantify the adhesion of silver prints on an aluminum alloy substrate. The laser-based method was compared to a standardized pull-off adhesion test, which provided baseline measurements of adhesion strength. The sintering conditions were shown to play an important role in the film-substrate adhesion strength, as well as the cohesion and ductility of the film itself. The methods and results described in this work supports the establishment of process control steps that are necessary for verifying the reliability of printed devices prior to its deployment in critical experiments.

36 MATERIALS SCIENCE↗
NASA NTRS2011

Using Reliability to Meet Z540.3's 2 percent Rule

NASA's Kennedy Space Center (KSC) undertook implementation of ANSI/NCSL Z540.3-2006 in October 2008. Early in the implementation, KSC identified that the largest cost driver of Z540.3 implementation is measurement uncertainty analyses for legacy calibration processes. NASA, like other organizations, has a significant inventory of measuring and test equipment (MTE) that have documented calibration procedures without documented measurement uncertainties. This paper provides background information to support the rationale for using high in-tolerance reliability as evidence of compliance to the 2% probability of false acceptance (PFA) quality metric of ANSI/NCSL Z540.3-2006 allowing use of qualifying legacy processes. NASA is adopting this as policy and is recommending NCSL International consider this as a method of compliance to Z540.3. Topics covered include compliance issues, using end-of-period reliability (EOPR) to estimate test point uncertainty, reliability data influences within the PFA model, the validity of EOPR data, and an appendix covering "observed" versus "true" EOPR.

Mimbs, Scott M.↗
DOE OSTI2024

Multiscale assessment of North American terrestrial carbon balance

Abstract. Comparisons of carbon uptake estimates from bottom-up terrestrial biosphere models (TBMs) to top-down atmospheric inversions help assess how well we understand carbon dioxide (CO2) exchange between the atmosphere and terrestrial biosphere. Previous comparisons have shown varying levels of agreement between bottom-up and top-down approaches, but they have almost exclusively focused on large, aggregated scales (e.g., global or continental), providing limited insights into reasons for the mismatches. Here we explore how consistency, defined as the spread in net ecosystem exchange (NEE) estimates within an ensemble of TBMs or inversions, varies with at finer spatial scales ranging from 1∘×1∘ to the continent of North America. We also evaluate how well consistency informs accuracy in overall NEE estimates by filtering models based on their agreement with the variability, magnitude, and seasonality in observed atmospheric CO2 drawdowns or enhancements. We find that TBMs produce more consistent estimates of NEE for most regions and at most scales relative to inversions. Filtering models using atmospheric CO2 metrics causes ensemble spread to decrease substantially for TBMs, but not for inversions. This suggests that ensemble spread is likely not a reliable measure of the uncertainty associated with the North American carbon balance at any spatial scale. Promisingly, applying atmospheric CO2 metrics leads to a set of models with converging flux estimates across TBMs and inversions. Overall, we show that multiscale assessment of the agreement between bottom-up and top-down NEE estimates, aided by regional-scale observational constraints is a promising path towards identifying fine-scale sources of uncertainty and improving both ensemble consistency and accuracy. These findings help refine our understanding of biospheric carbon balance, particularly at scales relevant for informing regional carbon-climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Psychology of computer use: IX. A menu of self-administered microcomputer-based neurotoxicology tests

This study examined the feasibility of repeated self-administration of a newly developed battery of mental acuity tests which may have application in screening for fitness-for-duty or for persons who may be exposed to environmental stress, toxic agents, or disease. 16 subjects self-administered 18 microcomputer-based tests (13 new, 5 "core"), without proctors, over 10 sessions. The hardware performed well throughout the study and the tests appeared to be easily self-administered. Stabilities and reliabilities of the tests from the "core" battery were comparable to those obtained previously under more controlled experimental conditions. Eight of the new tests exceeded minimum criteria for metric and practical requirements and can be recommended as additions to the menu. Although the average retest reliability was high, cross-correlations between tests were low, implying factorial diversity. The menu can be used to form batteries with flexible total testing time which are likely to tap different mental processes and functions.

NASA Discipline Neuroscience↗