Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Development of an Objective Space Suit Mobility Performance Metric Using Metabolic Cost and Functional Tasks

Existing methods for evaluating EVA suit performance and mobility have historically concentrated on isolated joint range of motion and torque. However, these techniques do little to evaluate how well a suited crewmember can actually perform during an EVA. An alternative method of characterizing suited mobility through measurement of metabolic cost to the wearer has been evaluated at Johnson Space Center over the past several years. The most recent study involved six test subjects completing multiple trials of various functional tasks in each of three different space suits; the results indicated it was often possible to discern between different suit designs on the basis of metabolic cost alone. However, other variables may have an effect on real-world suited performance; namely, completion time of the task, the gravity field in which the task is completed, etc. While previous results have analyzed completion time, metabolic cost, and metabolic cost normalized to system mass individually, it is desirable to develop a single metric comprising these (and potentially other) performance metrics. This paper outlines the background upon which this single-score metric is determined to be feasible, and initial efforts to develop such a metric. Forward work includes variable coefficient determination and verification of the metric through repeated testing.

McFarland, Shane M.↗
NASA NTRS2017

Fault Management Metrics

This paper describes the theory and considerations in the application of metrics to measure the effectiveness of fault management. Fault management refers here to the operational aspect of system health management, and as such is considered as a meta-control loop that operates to preserve or maximize the system's ability to achieve its goals in the face of current or prospective failure. As a suite of control loops, the metrics to estimate and measure the effectiveness of fault management are similar to those of classical control loops in being divided into two major classes: state estimation, and state control. State estimation metrics can be classified into lower-level subdivisions for detection coverage, detection effectiveness, fault isolation and fault identification (diagnostics), and failure prognosis. State control metrics can be classified into response determination effectiveness and response effectiveness. These metrics are applied to each and every fault management control loop in the system, for each failure to which they apply, and probabilistically summed to determine the effectiveness of these fault management control loops to preserve the relevant system goals that they are intended to protect.

Johnson, Stephen B.↗
NASA NTRS2018

Robust Metric-Aligned Quad-Dominant Meshing Using L(sub p) Centroidal Voronoi Tessellation

We introduce a meshing algorithm that can be used to both generate and adapt meshes for bounded domains in an anisotropic manner. This is particularly beneficial when anisotropic flow features like shock waves or contact discontinuities are present in the computational domain. The algorithm presented in this paper is based upon meshing under the imposed Riemannian metric tensor, which controls the orientation and size of the mesh elements. In this way there is no need for user intervention to recognize these features. We demonstrate that the method indeed aligns the elements with the underlying metric and produces right-angled simplices that can be recombined into quadrilateral elements. The aim is to eventually incorporate this meshing strategy in the monolithic high-order spectral element solver that is currently being developed at NASA Ames. This paper has two main contributions: First, we demonstrate that we can generate quad-dominant metric-aligned meshes for bounded domains using a generalized form of L(sub p)-Centroidal Voronoi Tessellation (L(sub p)-CVT). Unlike previous works, we do not rely on a background mesh and discretize the bounded domain in a hierarchical way by first discretizing the boundaries and then the volume using the underlying metric. Second, we present an alternative for clipping the Voronoi cells on the boundary, which is common practice in CVT-based meshing algorithms, by reconstructing the Voronoi cells using the defined metric field. In this way we avoid the geometrical complexity of the clipping procedure and we show that we evaluate the energy and its gradient correctly. We show that the reconstruction of the computational domain is consistent with the Lloyds’ algorithm that is used to compute the L(sub p)-CVT.

Centroidal↗
NASA NTRSDate not supplied

Anisotropic Goal-Based Mesh Adaptation Metric Clarification and Development

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows to control discretization error for reliable simulation results. Multiple independent implementations of flow solvers, anisotropic metric construction methods, and anisotropic mesh adaptation mechanics have matured. Goal-based metrics target estimated error in output functions, such as lift and drag, through the guidance of an adjoint solution. A unification of goal-based anisotropic metrics is presented for steady viscous flows, which is an active area of research. These goal-based metrics drive robust and efficient anisotropic mesh adaptation for the calculation of output functions. The super-convergent functional output error behavior of stabilized finite-element methods is exploited without a formal proof, and evidence of super-convergence is shown in numerical experiments. Mesh adapted drag and lift outputs for two simple bodies in compressible viscous flow show convergence of error to less than a single drag count. Asymptotic behavior established for relatively coarse meshes shows the efficiency of this goal-based metric when compared to solution interpolation error control and expert-guided meshing. Anisotropic mesh adaptation techniques are applied to a transport aircraft in a high-lift configuration where variation between approaches decreases with mesh refinement, but asymptotic behavior is not observed with available resources.

goal-based↗
NASA NTRS2021

A Superposed Metric for Spinning Black Hole Binaries Approaching Merger

We construct an approximate metric that represents the spacetime of spinning binary black holes (BBH) approaching merger. We build the metric as an analytical superposition of two Kerr metrics in harmonic coordinates, where we transform each black hole term with time-dependent boosts describing an inspiral trajectory. The velocities and trajectories of the boost are obtained by solving the post-Newtonian (PN) equations of motion at 3.5 PN order. We analyze the spacetime scalars of the new metric and we show that it is an accurate approximation of Einstein’s field equations in vacuum for a BBH system in the inspiral regime. Furthermore, to prove the effectiveness of our approach, we test the metric in the context of a 3D general relativistic magnetohydrodynamical (GRMHD) simulation of accreting minidisks around the black holes. We compare our results with a previous well-tested spacetime construction based on the asymptotic matching method. We conclude that our new spacetime is well-suited for long-term GRMHD simulations of spinning binary black holes on their way to the merger.

Luciano Combi↗
NASA NTRS2022

Using Trajectory Smoothness Metrics to Identify Drones in Radar Track Data

The identification of unmanned aircraft systems (UAS) using trajectory data is considered. Specifically, a number of smoothness metrics are proposed, which can be used to distinguish UAS from other aerial objects even when they are engaged in accelerative maneuvers (non-constant-velocity flight). The metrics are evaluated on a data set from a UAS sense-and-avoid field test, which contains track data of aerial objects recorded by a vehicle-board radar system during a flight test. The metrics are found to effectively differentiate UAS from other objects such as birds for this data set. In addition, an initial statistical performance analysis of one of the smoothness metrics is undertaken, using 15 data sets deriving from multiple flight tests. The smoothness metric is shown to identify the target UAS with 95% accuracy (95% true positive rate), while achieving a false positive rate of less than 9%.

Sandip Roy↗
NASA NTRS2023

Study of Pairwise Deconfliction Metrics to Analyze Air Traffic Complexity in Upper Class E Airspace

Upper Class E Traffic Management (ETM) is envisioned to cooperatively facilitate operations of a diverse set of aerial vehicles, such as high-altitude long-endurance fixed-wing unmanned aircraft (low-speed and high-speed), high-altitude platforms, airships, stratospheric balloons, supersonic unmanned and commercial aircraft, etc., with a wide variety of mission types, performance characteristics, communication, navigation and surveillance capabilities, maneuverability, and on-board avionics in the National Airspace System (NAS) ’above’ 60,000 feet above mean sea level, without an active and direct control from human air traffic controllers. A diverse mixture of aerial vehicle types creates significant challenges in understanding air traffic complexity, which may not correlate strongly with air traffic density. One key step for determining air traffic complexity in upper class E airspace is to first understand pairwise deconfliction metrics such as reachability, reserve area, and reserve flight time for each pair of unique aerial vehicle types under potential conflict. Therefore, pairwise deconfliction metrics are first defined, and analytical equations are derived for conflict resolution using the heading change maneuver. Next, case studies are performed to analyze deconfliction metrics to avoid secondary conflicts in upper class E airspace. The study shows that pairwise deconfliction metrics are functions of maneuverability, performance characteristics, uncertainty in position and velocity, heading angle change, and conflict angle of aerial vehicles. The next step for this research is to build a mathematical model for air traffic complexity using pairwise deconfliction metrics and validate it in an upper Class E simulation environment.

Airspace Complexity↗
NASA NTRS2022

Metrics for Flight Operations: Application to Europa Clipper Tour Selection

Objective measures are ubiquitous in the formulation, design and implementation of deep space missions. Tour durations, flyby altitudes, propellant budgets, power consumption, and other metrics are essential to developing and managing NASA missions. But beyond the simple metrics of cost and workforce, it has been difficult to identify objective, quantitative measures that assist in evaluating choices made during formulation or implementation phases in terms of their impact on flight operations. As part of the development of the Europa Clipper Mission system, a set of operations metrics have been defined along with the necessary design information and software tooling to calculate them. We have applied these methods and metrics to help assess the impact to the flight team on the six options for the Clipper Tour that are currently being vetted for selection in the fall of 2021. To generate these metrics, the Clipper MOS team first designed the set of essential processes by which flight operations will be conducted, using a standard approach and template to identify (among other aspects) timelines for each process, along with their time constraints (e.g., uplinks for sequence execution). Each of the resulting 50 processes is documented in a common format and concurred by stakeholders. Process timelines were converted into generic schedules and workforce-loaded using COTS scheduling software, based on the inputs of the process authors and domain experts. Custom code was generated to create an operations schedule for a specific portion of Clipper's prime mission, with instances of a given process scheduled based on specific timing rules (e.g., process X starts once per week on Thursdays) or relative to mission events (e.g., sequence generation process begins on a Monday, at least three weeks before each Europa closest approach). Over a 5-month period, and for each of six Clipper candidate tours, the result was a 20,000+ line, workforce-loaded schedule that documents all of the process-driven work effort at the level of individual roles, along with a significant portion of the level-of-effort work. Post-processing code calculated the absolute and relative number of work hours during a nominal 5 day / 40 hour work week, the work effort during 2nd and 3rd shift, as well as 1st shift on weekends. The resultant schedules and shift tables were used to generate objective measures that can be related to both human factors and to operational risk and showed that Clipper tours which utilize 6:1 resonant (21.25 day) orbits instead of 4:1 resonant (14.17 day) orbits during the first dozen or so Europa flybys are advantageous to flight operations. A similar approach can be extended to assist missions in more objective assessments of a number of mission issues and trades, including tour selection and spacecraft design for operability.

Sarrel, Marc↗
NASA NTRSDate not supplied

Study of Pairwise Deconfliction Metrics to Analyze Air Traffic Complexity in Upper Class E Airspace

Upper Class E Traffic Management (ETM) is envisioned to cooperatively facilitate operations of a diverse set of aerial vehicles, such as high-altitude long-endurance fixed-wing unmanned aircraft (low-speed and high-speed), high-altitude platforms, airships, stratospheric balloons, supersonic unmanned and commercial aircraft, etc., with a wide variety of mission types, performance characteristics, communication, navigation and surveillance capabilities, maneuverability, and on-board avionics in the National Airspace System (NAS) ’above’ 60,000 feet above mean sea level, without an active and direct control from human air traffic controllers. A diverse mixture of aerial vehicle types creates significant challenges in understanding air traffic complexity, which may not correlate strongly with air traffic density. One key step for determining air traffic complexity in upper class E airspace is to first understand pairwise deconfliction metrics such as reachability, reserve area, and reserve flight time for each pair of unique aerial vehicle types under potential conflict. Therefore, pairwise deconfliction metrics are first defined, and analytical equations are derived for conflict resolution using the heading change maneuver. Next, case studies are performed to analyze deconfliction metrics to avoid secondary conflicts in upper class E airspace. The study shows that pairwise deconfliction metrics are functions of maneuverability, performance characteristics, uncertainty in position and velocity, heading angle change, and conflict angle of aerial vehicles. The next step for this research is to build a mathematical model for air traffic complexity using pairwise deconfliction metrics and validate it in an upper Class E simulation environment.

Airspace Complexity↗
NASA NTRSDate not supplied

Proof-of-Concept for a Long-Term Health Metric to Quantify End of Mission Health Status in Astronauts

NASA has long used Probabilistic Risk Assessment (PRA) when high-stakes decisions need to be made about complex systems. For spaceflight medical risk, the Human Research Program’s Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) is a significant step towards robustly quantifying the risk to crew health during exploration missions. However, there remains a significant gap in the ability to comprehensively characterize and assess risk across the disparate functionalities and capabilities which comprise the entire Crew Health and Performance (CHP) system. To fill this gap, the Crew Health and Performance – Probabilistic Risk Assessment (CHP-PRA) project aims to perform risk characterization for the CHP system by assessing performance risk in addition to medical risk. This effort also includes quantifying Long-Term Health (LTH) risk in addition to in-mission risk outcomes within the CHP-PRA results. LTH risk encompasses the timeframe from immediately post-flight, through the rest of an astronaut’s career, through retirement, and until death. A proof-of-concept LTH risk metric is based on medical condition end-state, as defined by the Evidence Library, capturing the spaceflight specific medical impacts persisting into post-flight[1]. Condition outcomes in the Evidence Library progress through three Clinical Phases (CP): the diagnostic phase (CP1), the treatment/convalescent phase (CP2), and the end-state phase (CP3) which represents the detrimental effects of the condition after the crew member has recovered to the maximal extent. Each CP has an associated Task Impairment (TI), defined as the degree of crew incapacity due to experiencing the condition, and is quantified with a 0-1 range. Conditions with an associated CP3 (e.g. Sepsis, Traumatic Hypovolemic Shock, Sudden Cardiac Arrest, etc.) typically have serious consequences that can cause an astronaut to be fully or partially debilitated throughout the remainder of the mission. Consequently, the Cumulative CP3 TI End-of-Mission Health Status Metric is developed by CHP-PRA to quantify the cumulative effects of all conditions which progressed to the CP3 state throughout the entirety of the mission. Hence, this End-of-Mission Health Status Metric attempts to serve as an indicator of an astronaut’s health state at the time of landing. The severity of the lingering effects of in-mission medical events are dependent on mission activities and the level of available in-mission medical care. This allows the associated cumulative TI metric to be used in comparison with the crew’s end of mission health status for different levels of in-mission resources. This presentation provides the strategy for using CP3 as an LTH metric component, as well as a proof-of-concept demonstration of LTH risk characterization using this component.

long term health↗
DOE OSTI2026

A call to standardize metrics for monitoring baleen whales near marine construction activities

Effective monitoring is necessary to protect marine mammal species during the construction of offshore infrastructure. The tools for detecting or monitoring marine mammals span traditional (e.g., visual observers, optical cameras), to newer (e.g., passive acoustic monitoring, infrared cameras, tags), and emerging (e.g., satellite imagery, environmental DNA, dimethyl sulfide concentration) technologies. Some are better suited for use during offshore development; however, peer-reviewed literature does not typically evaluate and report on the performance of these various technologies. We define a minimum set of metrics related to efficacy (i.e., confusion matrix, precision and recall, probability of missed mitigation), detection range (i.e., maximum and reliable detection range, spatial resolution), and data delivery (i.e., detection latency, system reliability, temporal resolution) that we recommend are needed to assess the utility of monitoring technologies for this purpose. Following a literature review of relevant studies, we highlight which publications reported these metrics and used multiple technologies to compare relative performance. We also emphasize the benefits of multi-modal approaches and recommend performance assessments through modeling or large-scale collaborative field testing. These metrics will standardize data collection, reporting, and analysis; promote consistent and comparable results; and foster collaboration among developers, regulatory agencies, and scientists. This may lead to the co-development of technology that achieves multiple goals, has greater application, and can answer research questions while collecting data to fulfill permitting requirements. These metrics may also inform decisions on what systems regulatory agencies might consider using and reduce monitoring costs, which is critical to support the marine sector's rapid growth alongside marine mammal conservation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2014

Don't Trust a Management Metric, Especially in Life Support

Goodhart's law states that metrics do not work. Metrics become distorted when used and they deflect effort away from more important goals. These well-known and unavoidable problems occurred when the closure and system mass metrics were used to manage life support research. The intent of life support research should be to develop flyable, operable, reliable systems, not merely to increase life support system closure or to reduce its total mass. It would be better to design life support systems to meet the anticipated mission requirements and user needs. Substituting the metrics of closure and total mass for these goals seems to have led life support research to solve the wrong problems.

life support↗
NASA NTRS2017

An Alternative Time Metric to Modified Tau for Unmanned Aircraft System Detect And Avoid

A new horizontal time metric, Time to Protected Zone, is proposed for use in the Detect and Avoid (DAA) Systems equipped by unmanned aircraft systems (UAS). This time metric has three advantages over the currently adopted time metric, modified tau: it corresponds to a physical event, it is linear with time, and it can be directly used to prioritize intruding aircraft. The protected zone defines an area around the UAS that can be a function of each intruding aircraft's surveillance measurement errors. Even with its advantages, the Time to Protected Zone depends explicitly on encounter geometry and may be more sensitive to surveillance sensor errors than modified tau. To quantify its sensitivity, simulation of 972 encounters using realistic sensor models and a proprietary fusion tracker is performed. Two sensitivity metrics, the probability of time reversal and the average absolute time error, are computed for both the Time to Protected Zone and modified tau. Results show that the sensitivity of the Time to Protected Zone is comparable to that of modified tau if the dimensions of the protected zone are adequately defined.

alert↗
NASA NTRS2017

An Alternative Time Metric to Modified Tau for Unmanned Aircraft System Detect And Avoid

A new horizontal time metric, Time to Protected Zone, is proposed for use in the Detect and Avoid (DAA) Systems equipped by unmanned aircraft systems (UAS). This time metric has three advantages over the currently adopted time metric, modified tau: it corresponds to a physical event, it is linear with time, and it can be directly used to prioritize intruding aircraft. The protected zone defines an area around the UAS that can be a function of each intruding aircraft's surveillance measurement errors. Even with its advantages, the Time to Protected Zone depends explicitly on encounter geometry and may be more sensitive to surveillance sensor errors than modified tau. To quantify its sensitivity, simulation of 972 encounters using realistic sensor models and a proprietary fusion tracker is performed. Two sensitivity metrics, the probability of time reversal and the average absolute time error, are computed for both the Time to Protected Zone and modified tau. Results show that the sensitivity of the Time to Protected Zone is comparable to that of modified tau if the dimensions of the protected zone are adequately defined.

UAS↗
NASA NTRS2017

Real Time Metrics and Analysis of Integrated Arrival, Departure, and Surface Operations

A real time dashboard was developed in order to inform and present users notifications and integrated information regarding airport surface operations. The dashboard is a supplement to capabilities and tools that incorporate arrival, departure, and surface air-traffic operations concepts in a NextGen environment. As trajectory-based departure scheduling and collaborative decision making tools are introduced in order to reduce delays and uncertainties in taxi and climb operations across the National Airspace System, users across a number of roles benefit from a real time system that enables common situational awareness. In addition to shared situational awareness the dashboard offers the ability to compute real time metrics and analysis to inform users about capacity, predictability, and efficiency of the system as a whole. This paper describes the architecture of the real time dashboard as well as an initial set of metrics computed on operational data. The potential impact of the real time dashboard is studied at the site identified for initial deployment and demonstration in 2017; Charlotte-Douglas International Airport. Analysis and metrics computed in real time illustrate the opportunity to provide common situational awareness and inform users of metrics across delay, throughput, taxi time, and airport capacity. In addition, common awareness of delays and the impact of takeoff and departure restrictions stemming from traffic flow management initiatives are explored. The potential of the real time tool to inform the predictability and efficiency of using a trajectory-based departure scheduling system is also discussed.

integrated arrival departure surface operations↗
NASA NTRS2016

A New Paradigm for Quality Metrics

SMA metrics have been traditionally represented as either leading and lagging indicators. Traditional ways of viewing these metrics and trending the data is via graphs which reflect one attribute in each graph. The KSC Independent Assessment Team developed a non-traditional method for expressing variation as a ratio (the deviation between the Expected and Actual). This method allows different measures to be plotted on the same graph for trending and comparison to provide a holistic view across a particular theme or discipline. Since all measurements are a ratio of variation and dimensionless, this variation-based metrics approach can be used a new analytical tool which is complimentary to existing value-added metrics tools.

Dimensionless↗
NASA NTRS2024

Literature Review of Cumulative Noise Metrics Relevant to X-59 Supersonic Overflights

Upcoming studies with the X-59 aircraft will collect dose-response data to understand community response to en-route supersonic noise. This data collection effort will inform regulators in their efforts to potentially update the ban on commercial supersonic flight with acceptable noise standards. Part of the dataset will consist of end-of-day responses to the noise from multiple supersonic overflights. This document provides rationale from relevant literature surrounding which cumulative noise metric to pair with end-of-day survey responses for upcoming community studies with the X-59 aircraft. Despite its deficiencies, day-night average sound level (DNL) summation of candidate single-event metrics remains the most likely choice for a cumulative noise metric for multiple supersonic overflights because 1) it is widely used for other transportation noise sources and 2) its relevance for infrequent events is somewhat plausible, unlike some recent alternative metrics.

sonic boom↗
DOE OSTI2025

Understanding ERE and iVOC Metrics for Graded CdSeTe Absorbers

PL-based external radiative efficiency (ERE) and implied open-circuit voltage (iVOC) metrics were introduced for thin-film solar absorbers to better understand the voltage deficit and diagnose losses in solar cells. Traditionally, elevated ERE and iVOC measurements are associated with diminished recombination within the solar device, a rationale heavily reliant on the assumption of a uniform bandgap and high carrier mobilities in the absorber. Recently, very low mobilities in CdSeTe absorbers (< 1 cm2/(V.s)) were measured using the light-induced transient grading technique. In this study, we use a detailed numerical model of iVOC to investigate the possible reasons of elevated iVOC in realistic CdSeTe absorbers with a graded Se profile. In particular, we examine how the bandgap nonuniformity and the reduced hole mobility in graded CdSeTe absorbers affect iVOC measurements. We show that high iVOC may result from inflated quasi-Fermi level splitting in the high-Se region in the front part of a CdSeTe absorber with slow hole transport. We reproduce the experimentally reported 360 mV increase in iVOC-VOC gap with reduced doping using a model with sub-1 cm2/(V.s) hole mobility in the high-Se region. Based on our results, we conclude that the iVOC metric (or ERE metric) should not be used as a sole metric of CdSeTe absorber quality. We discuss possible ways to extract useful information from the iVOC-VOC gap by supplementing the front-side illumination measurements with back-side illumination measurements.

14 SOLAR ENERGY↗