Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS1978

Numerical aerodynamic simulation facility. Preliminary study extension. Executive summary

An optimized functional design of key elements of the Numerical Aerodynamic Simulation Facility was investigated. The following tasks were performed and are discussed: (1) develop, optimize, and describe the functional description of the custom hardware; (2) delineate trade-off areas between performance, reliability, availability, serviceability, and programmability; (3) develop metrics and models for validation of the candidate system's performance; (4) conduct a functional simulation of the system design; (5) perform a reliability analysis of the system design; and (6) develop the software specifications to include a user level high level programming language, a correspondence between the programming language and instruction set, and outline the operating system requirements.

Source record↗
NASA NTRS2017

EVA Human Health and Performance Benchmarking Study Overview and Development of a Microgravity Protocol

The primary objective of this study is to develop a protocol to reliably characterize human health and performance metrics for individuals working inside various EVA suits under realistic spaceflight conditions. Expected results and methodologies developed during this study will provide the baseline benchmarking data and protocols with which future EVA suits and suit configurations (e.g., varied pressure, mass, center of gravity [CG]) and different test subject populations (e.g., deconditioned crewmembers) may be reliably assessed and compared. Results may also be used, in conjunction with subsequent testing, to inform fitness-for-duty standards, as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Norcross, Jason↗
DOE OSTI2023

A ductility metric for refractory-based multi-principal-element alloys

We propose a quantum-mechanical dimensionless metric, the local-lattice distortion (LLD), as a reliable predictor of ductility in refractory multi-principal-element alloys (RMPEAs). The LLD metric is based on electronegativity differences in localized chemical environments and combines atomic-scale displacements due to local lattice distortions with a weighted average of valence-electron count. To evaluate the effectiveness of this metric, we examined body-centered cubic (bcc) refractory alloys that exhibit ductile-to-brittle behavior. Our findings demonstrate that local-charge behavior can be tuned via composition to enhance ductility in RMPEAs. With finite-sized cell effects eliminated, the LLD metric accurately predicted the ductility of arbitrary alloys, which compares well with existing tensile-elongation experiments. To validate further, we qualitatively evaluated the ductility of two refractory RMPEAs, i.e., NbTaMoW and Mo 72 W 13 Ta 10 Ti 2.5 Zr 2.5 , through the observation of crack formation under indentation, again showing excellent agreement with LLD predictions. Additionally, a comparative study of three refractory alloys provides further insights into the electronic-structure origin of ductility in refractory RMPEAs. This proposed metric enables rapid and accurate assessment of ductility behavior in the vast RMPEA composition space.

36 MATERIALS SCIENCE↗
NASA NTRS1990

Issues in providing a reliable multicast facility

Issues involved in point-to-multipoint communication are presented and the literature for proposed solutions and approaches surveyed. Particular attention is focused on the ideas and implementations that align with the requirements of the environment of interest. The attributes of multicast receiver groups that might lead to useful classifications, what the functionality of a management scheme should be, and how the group management module can be implemented are examined. The services that multicasting facilities can offer are presented, followed by mechanisms within the communications protocol that implements these services. The metrics of interest when evaluating a reliable multicast facility are identified and applied to four transport layer protocols that incorporate reliable multicast.

Dempsey, Bert J.↗
NASA NTRSDate not supplied

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗
NASA NTRSDate not supplied

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗
DOE OSTI2025

Zero-Emission Transit Bus Needs Assessment

The transition to zero-emissions vehicles (ZEVs) in public transit has gained traction due to significant federal investments from the Bipartisan Infrastructure Law (BIL) and the Inflation Reduction Act (IRA). This needs assessment, commissioned by the Joint Office of Energy and Transportation and conducted by researchers at the Idaho National Laboratory, explores the current state of electrification in transit agencies, identifying barriers to implementation, potential funding sources, and operational considerations necessary for a successful transition. The assessment involved qualitative interviews with representatives from 19 transit service providers across diverse geographic regions. Key findings highlight the challenges related to bus facilities and operations, which require careful planning for charging infrastructure and maintenance capabilities to accommodate battery electric buses (BEBs) and hydrogen fuel cell buses (HFCBs). Agencies reported operational hurdles due to the shorter range of BEBs compared to diesel buses, necessitating revised scheduling and routing strategies. Despite these challenges, many agencies expressed optimism about their capacity to adapt. Funding availability emerged as a critical factor influencing the transition to ZEVs. While agencies welcomed increased financial support, particularly from the Low or No Emission Grant Program (Lo-No), concerns about the sustainability of this funding and the ongoing operational costs were prevalent. The need for a comprehensive funding inventory was underscored to ensure transit agencies are aware of all available resources. Technological constraints were significant barriers to ZEV adoption. The limited range of BEBs was frequently cited as a concern, leading to operational challenges and reliability issues. Agencies reported difficulties in sourcing replacement parts, which exacerbated downtime and maintenance challenges. Workforce development and training were identified as pivotal for a successful transition. Many agencies rely heavily on manufacturers for technician training, highlighting the need for scalable training programs that equip staff with the necessary skills to maintain electric powertrains effectively. This assessment offers actionable recommendations for the Joint Office, including enhancing outreach to transit agencies, developing resources for effective utility partnerships, and facilitating comprehensive training programs. Establishing a zero-emission bus evaluation program to track performance metrics such as cost, range, and reliability could provide valuable insights for transit agencies. The needs assessment provides a detailed examination of the challenges and opportunities facing transit agencies in their transition to zero-emissions bus fleets. By addressing these issues through targeted support, stakeholders can collaboratively work towards a cleaner, more sustainable public transportation system that benefits all communities.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Velocity- and pressure-based metrics for estimating strike injuries during fish passage through hydro turbines

Hydropower is a crucial source of clean and reliable energy worldwide, and its importance will continue to grow. To enhance the environmental sustainability of hydropower development and operations, it is essential to predict the strike injury rates of fish passing through turbines accurately and cost-effectively. However, conventional experiments involving a large number of live fish are still commonly conducted in practice, and previous attempts mainly focused on the dose-response relationships at an individual level or relative comparisons of biological characterization between different conditions. Thus, this study proposes two novel strike metrics based on velocity and pressure (M V and M P ) measured by the cutting-edge Sensor Fish (SF) technology, designed to quantify the biological effects of strikes and collisions between fish and rigid hydraulic structures. SF measurements and 48-hour survival rates of live fish from a study conducted at the Ice Harbor Dam on the Snake River were used to establish thresholds for the two proposed metrics. These metrics and thresholds were then applied to three additional SF studies conducted at hydropower facilities featuring Kaplan turbines within the Columbia River basin. Results from the application of the strike metrics indicate that the estimated survival rates derived from both metrics agree well with previously reported live fish survival rates. Furthermore, the study identified specific passage regions with elevated risks of fish mortality due to strikes and collisions. Overall, the proposed strike metrics present a reliable and cost-effective approach to reducing reliance on live fish and lowering costs in fish passage studies.

Biological characterization↗
NASA NTRS1975

Automatic documentation system extension to multi-manufacturers' computers and to measure, improve, and predict software reliability

The DOMONIC system has been modified to run on the Univac 1108 and the CDC 6600 as well as the IBM 370 computer system. The DOMONIC monitor system has been implemented to gather data which can be used to optimize the DOMONIC system and to predict the reliability of software developed using DOMONIC. The areas of quality metrics, error characterization, program complexity, program testing, validation and verification are analyzed. A software reliability model for estimating program completion levels and one on which to base system acceptance have been developed. The DAVE system which performs flow analysis and error detection has been converted from the University of Colorado CDC 6400/6600 computer to the IBM 360/370 computer system for use with the DOMONIC system.

Simmons, D. B.↗
DOE OSTI2026

Scaling open-weight large language models for hydropower regulatory information extraction: A systematic analysis

Information extraction from regulatory and technical documents using large language models (LLMs) involves practical trade-offs between extraction quality and computational cost. We evaluate eight open-weight LLMs spanning 0.6B–70B parameters on hydropower licensing documents and report deployment-oriented evidence under a unified extraction schema and evaluation protocol. Across the model set, we observe clear scale-dependent trends in both baseline extraction quality and the effectiveness of reflective reasoning (self-checking) under our fixed-prompt, no-augmentation setting. Mid-scale models often provide a favorable balance of accuracy and efficiency, whereas the smallest models show limited or inconsistent gains from the reasoning variants tested. Larger models achieve the highest overall F1 scores but incur substantially greater compute and infrastructure requirements. We further find that reliability failure modes can distort conventional metrics in this domain: in particular, high recall can coincide with systematic extraction errors when models fabricate values for fields that are absent from the source text, underscoring the importance of conservative null handling and evidence-grounded evaluation. Overall, our study provides a reproducible resource–performance comparison for open-weight LLM-based extraction in hydropower regulatory documentation and offers practical guidance for model selection under different deployment constraints.

Evaluation protocol↗
NASA NTRS2020

Assessment of Temperature-Dependent Regression Model Terms of a RUAG Six-Component Block-Type Balance

A metric called the percent contribution was applied to regression models of temperature-dependent calibration data of a RUAG six-component block-type balance in order to assess the influence of temperature-dependent regression model terms on the balance load prediction. Regression models were examined that are needed if either the Iterative or the Non-Iterative Method is used for the load prediction. Computed values of the percent contribution confirmed that the cross-product term defined by a primary load and the temperature difference is the most influential temperature-dependent term of the regression model of a primary output that the Iterative Method needs. Similarly, the analysis showed that the cross-product term defined by a primary output and the temperature difference is the most influential temperature-dependent term of the regression model of a primary load that the Non-Iterative Method needs. Computed results support conclusions that were reported in an earlier theoretical study. This study asserted that the cross-product term defined by a primary load or output and the temperature difference models the temperature-dependent shift of the gage sensitivity. The influence of other temperature-dependent terms used in the regression models of the calibration data of RUAG's balance was negligible. This observation may be explained by the fact that RUAG's block-type balances have highly linear characteristics. Overall, the percent contribution has proven itself to be a reliable and easy-to-implement metric that may also be used for the assessment of the influence of temperature-dependent regression model terms on the load prediction of a six-component strain-gage balance.

Ulbrich, N.↗
NASA NTRS1999

Advanced Life Support System Value Metric

The NASA Advanced Life Support (ALS) Program is required to provide a performance metric to measure its progress in system development. Extensive discussions within the ALS program have reached a consensus. The Equivalent System Mass (ESM) metric has been traditionally used and provides a good summary of the weight, size, and power cost factors of space life support equipment. But ESM assumes that all the systems being traded off exactly meet a fixed performance requirement, so that the value and benefit (readiness, performance, safety, etc.) of all the different systems designs are exactly equal. This is too simplistic. Actual system design concepts are selected using many cost and benefit factors and the system specification is then set accordingly. The ALS program needs a multi-parameter metric including both the ESM and a System Value Metric (SVM). The SVM would include safety, maintainability, reliability, performance, use of cross cutting technology, and commercialization potential. Another major factor in system selection is technology readiness level (TRL), a familiar metric in ALS. The overall ALS system metric that is suggested is a benefit/cost ratio, [SVM + TRL]/ESM, with appropriate weighting and scaling. The total value is the sum of SVM and TRL. Cost is represented by ESM. The paper provides a detailed description and example application of the suggested System Value Metric.

Jones, Harry W.↗
NASA NTRS1999

Advanced Life Support System Value Metric

The NASA Advanced Life Support (ALS) Program is required to provide a performance metric to measure its progress in system development. Extensive discussions within the ALS program have led to the following approach. The Equivalent System Mass (ESM) metric has been traditionally used and provides a good summary of the weight, size, and power cost factors of space life support equipment. But ESM assumes that all the systems being traded off exactly meet a fixed performance requirement, so that the value and benefit (readiness, performance, safety, etc.) of all the different systems designs are considered to be exactly equal. This is too simplistic. Actual system design concepts are selected using many cost and benefit factors and the system specification is defined after many trade-offs. The ALS program needs a multi-parameter metric including both the ESM and a System Value Metric (SVM). The SVM would include safety, maintainability, reliability, performance, use of cross cutting technology, and commercialization potential. Another major factor in system selection is technology readiness level (TRL), a familiar metric in ALS. The overall ALS system metric that is suggested is a benefit/cost ratio, SVM/[ESM + function (TRL)], with appropriate weighting and scaling. The total value is given by SVM. Cost is represented by higher ESM and lower TRL. The paper provides a detailed description and example application of a suggested System Value Metric and an overall ALS system metric.

Jones, Harry W.↗
DOE OSTI2023

Comprehensive Analysis of Streaming and Shutdown Dose Rate Experiments at JET with ORNL Fusion Neutronics Workflows

Current experimental fusion systems and conceptual designs of fusion pilot plants (FPPs) are growing in complexity and size. Several radiation metrics are crucial to the safe operation of fusion machines, including neutron flux streaming through openings and the shutdown dose rate (SDDR). Most current designs of advanced experimental fusion systems—and the most probable candidates for FPPs—are based on the tokamak concept, which is prone to neutron streaming through the myriad openings needed for diagnostic and support systems. SDDR is caused by decay gamma rays from radionuclides that become activated by neutrons during the operation of a fusion system that use deuterium-deuterium (DD), tritium-tritium, or deuterium-tritium plasma. Because computational tools have become essential for determining these radiation metrics, they must be validated against reliable and applicable experimental data. Experiments at the Joint European Torus (JET) provide a unique source of experimental data for validating computational tools and nuclear data used to determine SDDR and neutron fluxes in streaming-dominated geometries. Here, this paper presents the comprehensive analysis of the high-performance DD JET SDDR, and streaming experiments performed using Oak Ridge National Laboratory (ORNL) fusion workflows. The computational results were compared with experimental results that consist of online SDDR measurements with ionization chambers and neutron fluence streaming measurements using thermoluminescent detectors. The ratio of calculated-to-experimental SDDR values ranges from 0.6 to 2.5, and the streaming results range from 0.5 to 8.0. Future work will include analyzing the JET 2021 DTE2 campaign alongside the integration of the Shift Monte Carlo transport code into all ORNL fusion neutronics workflows.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Operations, maintenance, and cost considerations for PV+Storage in the United States

Battery storage systems are increasingly being installed at photovoltaic (PV) sites to address supply-demand balancing needs. Although there is some understanding of costs associated with PV operations and maintenance (O&M), costs associated with emerging technologies such as PV plus storage lack details about the specific systems and/or activities that contribute to the cost values. This study aims to address this gap by exploring the specific factors and drivers contributing to utility-scale PV plus storage systems (UPVS) O&M activities costs, including how technology selection, data collection, and related and ongoing challenges. Specifically, we used semi-structured interviews and questionnaires to collect information and insights from utility-scale owners and operators. Data was collected from 14 semi-structured interviews and questionnaires representing 51.1 MW with 64.1 MWh of installed battery storage capacity within the United States (U.S.). Differences in degradation rate, expected life cycle, and capital costs are observed across different storage technologies. Most O&M activities at UPVS related to correcting under-performance. Fires and venting issues are leading safety concerns, and owner operators have installed additional systems to mitigate these issues. There are ongoing O&M challenges due the lack of storage-specific performance metrics as well as poor vendor reliability and parts availability. Insights from this work will improve our understanding of O&M consideration at PV plus storage sites.

14 SOLAR ENERGY↗
DOE OSTI2023

The Current State of Light-Duty Electric Vehicle Supply Equipment Costs: An Assessment of Contemporary Understanding

This study uses a hybrid meta-analysis and literature-review approach to understand the current state of knowledge regarding the costs of electric vehicle supply equipment (EVSE). We present a novel way to consider, categorize, and label measures of cost and show cost measure estimates from a sample of 13 recent studies. We find that in general, there is too much variation and too few commonly represented EVSE cost measures to reasonably provide aggregate figures for these measures. We propose a convention for presenting EVSE cost measures that includes the application (commercial or residential), the power level (Level 1, Level 2, DCFC [with further distinction based on rated power capacity]), and the type of cost measure (hardware, installation, operation, and total cost). We contend that providing researchers with standard cost measures will help to advance our knowledge of EVSE costs by ensuring that future work will use common metrics. Establishing common metrics will enable conventional meta-analyses that will make assessments of EVSE costs even more accessible. Additionally, common metrics will make tracking costs more reliable as the technology continues to evolve and become more ubiquitous.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1978

Numerical aerodynamic simulation facility. Preliminary study extension

The production of an optimized design of key elements of the candidate facility was the primary objective of this report. This was accomplished by effort in the following tasks: (1) to further develop, optimize and describe the function description of the custom hardware; (2) to delineate trade off areas between performance, reliability, availability, serviceability, and programmability; (3) to develop metrics and models for validation of the candidate systems performance; (4) to conduct a functional simulation of the system design; (5) to perform a reliability analysis of the system design; and (6) to develop the software specifications to include a user level high level programming language, a correspondence between the programming language and instruction set and outline the operation system requirements.

Source record↗