Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

Coverage Metrics for Model Checking

When using model checking to verify programs in practice, it is not usually possible to achieve complete coverage of the system. In this position paper we describe ongoing research within the Automated Software Engineering group at NASA Ames on the use of test coverage metrics to measure partial coverage and provide heuristic guidance for program model checking. We are specifically interested in applying and developing coverage metrics for concurrent programs that might be used to support certification of next generation avionics software.

Penix, John↗
NASA NTRS1995

A comparison of Image Quality Models and Metrics Predicting Object Detection

Many models and metrics for image quality predict image discriminability, the visibility of the difference between a pair of images. Some image quality applications, such as the quality of imaging radar displays, are concerned with object detection and recognition. Object detection involves looking for one of a large set of object sub-images in a large set of background images and has been approached from this general point of view. We find that discrimination models and metrics can predict the relative detectability of objects in different images, suggesting that these simpler models may be useful in some object detection and recognition applications. Here we compare three alternative measures of image discrimination, a multiple frequency channel model, a single filter model, and RMS error.

Rohaly, Ann Marie↗
NASA NTRS1997

Efficient Calculation of a Jitter/Stability Metric

A tool for computing a jitter/stability metric used in NASA requirements statements is developed. An efficient algorithm is given for computing this metric. Two ways of implementing it on a computer are discussed. One is optimized for computational speed while the other sacrifices some speed to conserve memory. Timing studies are given to show that the improvement of computation times using the present algorithm over previously existing techniques can run to several orders of magnitude, and that previous techniques were so costly that the present algorithm represents enabling technology. Further comparisons show that the memory conservative implementation runs at about half the speed of the fast implementation, but can cut the major data storage requirement of the fast implementation by 95-99%, making the algorithm implementable on much smaller computers, such as PC's, than it would be otherwise. Software for both implementations is included in version 2 of the NASA time and frequency domain analysis program PLATSIM.

Giesy, Daniel P.↗
NASA NTRS2006

Characterization of Days Based On Analysis of National Airspace System Performance Metrics

Days of operations in the National Airspace System can be described in term of traffic demand, runway conditions, equipment outages, and surface and enroute weather conditions. These causes manifest themselves in terms of departure delays, arrival delays, enroute delays and traffic flow management delays, Traffic flow management initiatives such as, ground stops, ground delay programs, miles-in-trail restrictions, rerouting and airborne holding are imposed to balance the air traffic demand with respect to the available capacity, In order to maintain operational efficiency of the National Airspace System, the Federal Aviation Administration (FAA) maintains delay sad other statistics in the Air Traffic Operations Network (OPSNET) and the Aviation System Performance Metrics (ASPM) databases. OPSNET data includes reportable delays of fifteen minutes ox more experienced by Instrument Flight Rule (IFR) flights. Numbers of aircraft affected by departure delays, enroute delays, arrival delays and traffic flow delays are recorded in the OPSNET data. ASPM data consist of number of actual departures, number of canceled departures, percentage of on time departures, percentage of on time gate arrivals, taxi-out delays. taxi-in delays, gate delays, arrival delays and block delays. Surface conditions at the major U.S. airports are classified in terms of Instrument Meteorological Condition (IMC) and Visual Meteorological Condition (VMC) as a function of the time of the day in the ASPM data. The main objective of this paper is to use OPSNET and ASPM data to classify the days in the datasets into few distinct groups, where each group is separated from the other groups in terms of a distance metric. The motivations for classifying the days are two-fold, 1) to enable selection of days of traffic with particular operational characteristics for concept evaluation using system-wide simulation systems such as the National Aeronautics and Space Administration's Airspace Concepts Evaluation Tool (ACES) and 2) to enable evaluation of a given day with respect to the characteristics of the classified groups. The first part of the paper is devoted to the analysis of major trends seen in the OPSNET and ASPM data. The second part of the paper is devoted to describing features or measures derived from the OPSNET and ASPM data that are suitable for characterizing days, and the classification algorithm used for grouping the days. Finally, the method for evaluating the characteristics of a given day with respect to the properties of the groups is described.

Chatterji, Gano B.↗
NASA NTRS2011

Validation of Proposed Metrics for Two-Body Abrasion Scratch Test Analysis Standards

The objective of this work was to evaluate a set of standardized metrics proposed for characterizing a surface that has been scratched from a two-body abrasion test. This is achieved by defining a new abrasion region termed Zone of Interaction (ZOI). The ZOI describes the full surface profile of all peaks and valleys, rather than just measuring a scratch width as currently defined by the ASTM G 171 Standard. The ZOI has been found to be at least twice the size of a standard width measurement, in some cases considerably greater, indicating that at least half of the disturbed surface area would be neglected without this insight. The ZOI is used to calculate a more robust data set of volume measurements that can be used to computationally reconstruct a resultant profile for detailed analysis. Documenting additional changes to various surface roughness parameters also allows key material attributes of importance to ultimate design applications to be quantified, such as depth of penetration and final abraded surface roughness. Data are presented to show that different combinations of scratch tips and abraded materials can actually yield the same scratch width, but result in different volume displacement or removal measurements and therefore, the ZOI method is more discriminating than the ASTM method scratch width. Furthermore, by investigating the use of custom scratch tips for our specific needs, the usefulness of having an abrasion metric that can measure the displaced volume in this standardized manner, and not just by scratch width alone, is reinforced. This benefit is made apparent when a tip creates an intricate contour having multiple peaks and valleys within a single scratch. This work lays the foundation for updating scratch measurement standards to improve modeling and characterization of three-body abrasion test results.

Kobrick, Ryan L.↗
NASA NTRS2010

A Survey of Health Management User Objectives Related to Diagnostic and Prognostic Metrics

One of the most prominent technical challenges to effective deployment of health management systems is the vast difference in user objectives with respect to engineering development. In this paper, a detailed survey on the objectives of different users of health management systems is presented. These user objectives are then mapped to the metrics typically encountered in the development and testing of two main systems health management functions: diagnosis and prognosis. Using this mapping, the gaps between user goals and the metrics associated with diagnostics and prognostics are identified and presented with a collection of lessons learned from previous studies that include both industrial and military aerospace applications.

Wheeler, Kevin R.↗
NASA NTRS2011

An Evaluation of Performance Metrics for High Efficiency Tube-and-Wing Aircraft Entering Service in 2030 to 2035

An analysis of basic vehicle characteristics required to meet the Fundamental Aeronautics Program s 70 percent energy consumption reduction goal for commercial airliners in the 2030 to 2035 timeframe was conducted. A total of 29 combinations of vehicle parasitic drag coefficient, vehicle induced drag coefficient, vehicle empty weight and engine Specific Fuel Consumption were used to create sized tube-and-wing vehicle models. The mission fuel burn for each of these sized vehicles was then compared to a baseline current technology vehicle. A response surface equation was generated of fuel burn reduction as a function of the four basic vehicle performance metrics, so that any values of the performance metrics up to a 50 percent reduction could be used to estimate fuel burn reduction of tube-and-wing aircraft for future studies.

Perkins, H. Douglas↗
NASA NTRS2013

Crew and Thermal Systems Division Strategic Communications Initiatives in Support of NASA's Strategic Goals: Fiscal Year 2012 Summary and Initial Fiscal Year 2013 Metrics

The NASA strategic plan includes overarching strategies to inspire students through interactions with NASA people and projects, and to expand partnerships with industry and academia around the world. The NASA Johnson Space Center Crew and Thermal Systems Division (CTSD) actively supports these NASA initiatives. At the end of fiscal year 2011, CTSD created a strategic communications team to communicate CTSD capabilities, technologies, and personnel to internal NASA and external technical audiences for collaborative and business development initiatives, and to students, educators, and the general public for education and public outreach efforts. The strategic communications initiatives implemented in fiscal year 2012 resulted in 707 in-reach, outreach, and commercialization events with 39,731 participant interactions. This paper summarizes the CTSD Strategic Communications metrics for fiscal year 2012 and provides metrics for the first nine months of fiscal year 2013.

Paul, Heather L.↗
NASA NTRS2013

Visible Contrast Energy Metrics for Detection and Discrimination

Contrast energy was proposed by Watson, Robson, & Barlow as a useful metric for representing luminance contrast target stimuli because it represents the detectability of the stimulus in photon noise for an ideal observer. Like the eye, the ear is a complex transducer system, but relatively simple sound level meters are used to characterize sounds. These meters provide a range of frequency sensitivity functions and integration times depending on the intended use. We propose here the use of a range of contrast energy measures with different spatial frequency contrast sensitivity weightings, eccentricity sensitivity weightings, and temporal integration times. When detection threshold are plotting using such measures, the results show what the eye sees best when these variables are taken into account in a standard way. The suggested weighting functions revise the Standard Spatial Observer for luminance contrast detection and extend it into the near periphery. Under the assumption that the detection is limited only by internal noise, discrimination performance can be predicted by metrics based on the visible energy of the difference images

Ahumada, Albert↗
NASA NTRS2013

GRC GSFC TDRSS Waveform Metrics Report

The report presents software metrics and porting metrics for the GGT Waveform. The porting was from a ground-based COTS SDR, the SDR-3000, to the CoNNeCT JPL SDR. The report does not address any of the Operating Environment (OE) software development, nor the original TDRSS waveform development at GSFC for the COTS SDR. With regard to STRS, the report presents compliance data and lessons learned.

Mortensen, Dale J.↗
NASA NTRS2012

Climate Change: A New Metric to Measure Changes in the Frequency of Extreme Temperatures using Record Data

Consensus on global warming is the result of multiple and varying lines of evidence, and one key ramification is the increase in frequency of extreme climate events including record high temperatures. Here we develop a metric- called "record equivalent draws" (RED)-based on record high (low) temperature observations, and show that changes in RED approximate changes in the likelihood of extreme high (low) temperatures. Since we also show that this metric is independent of the specifics of the underlying temperature distributions, RED estimates can be aggregated across different climates to provide a genuinely global assessment of climate change. Using data on monthly average temperatures across the global landmass we find that the frequency of extreme high temperatures increased 10-fold between the first three decades of the last century (1900-1929) and the most recent decade (1999-2008). A more disaggregated analysis shows that the increase in frequency of extreme high temperatures is greater in the tropics than in higher latitudes, a pattern that is not indicated by changes in mean temperature. Our RED estimates also suggest concurrent increases in the frequency of both extreme high and extreme low temperatures during 2002-2008, a period when we observe a plateauing of global mean temperature. Using daily extreme temperature observations, we find that the frequency of extreme high temperatures is greater in the daily minimum temperature time-series compared to the daily maximum temperature time-series. There is no such observable difference in the frequency of extreme low temperatures between the daily minimum and daily maximum.

Munasinghe, L.↗
NASA NTRS2014

Long Term Performance Metrics of the GD SDR on the SCaN Testbed: The First Year on the ISS

The General Dynamics (GD) S-Band software defined radio (SDR) in the Space Communications and Navigation (SCaN) Testbed on the International Space Station (ISS) provides experimenters an opportunity to develop and demonstrate experimental waveforms in space. The SCaN Testbed was installed on the ISS in August of 2012. After installation, the initial checkout and commissioning phases were completed and experimental operations commenced. One goal of the SCaN Testbed is to collect long term performance metrics for SDRs operating in space in order to demonstrate long term reliability. These metrics include the time the SDR powered on, the time the power amplifier (PA) is powered on, temperature trends, error detection and correction (EDAC) behavior, and waveform operational usage time. This paper describes the performance of the GD SDR over the first year of operations on the ISS.

radio telemetry↗
NASA NTRS2015

A Flexible and Non-instrusive Approach for Computing Complex Structural Coverage Metrics

Software analysis tools and techniques often leverage structural code coverage information to reason about the dynamic behavior of software. Existing techniques instrument the code with the required structural obligations and then monitor the execution of the compiled code to report coverage. Instrumentation based approaches often incur considerable runtime overhead for complex structural coverage metrics such as Modified Condition/Decision (MC/DC). Code instrumentation, in general, has to be approached with great care to ensure it does not modify the behavior of the original code. Furthermore, instrumented code cannot be used in conjunction with other analyses that reason about the structure and semantics of the code under test. In this work, we introduce a non-intrusive preprocessing approach for computing structural coverage information. It uses a static partial evaluation of the decisions in the source code and a source-to-bytecode mapping to generate the information necessary to efficiently track structural coverage metrics during execution. Our technique is flexible; the results of the preprocessing can be used by a variety of coverage-driven software analysis tasks, including automated analyses that are not possible for instrumented code. Experimental results in the context of symbolic execution show the efficiency and flexibility of our nonintrusive approach for computing code coverage information

DO-178C↗
NASA NTRS2016

Clinical Outcome Metrics for Optimization of Robust Training

Introduction: The emphasis of this research is on the Human Research Program (HRP) Exploration Medical Capability's (ExMC) "Risk of Unacceptable Health and Mission Outcomes Due to Limitations of In-Flight Medical Capabilities." Specifically, this project aims to contribute to the closure of gap ExMC 2.02: We do not know how the inclusion of a physician crew medical officer quantitatively impacts clinical outcomes during exploration missions. The experiments are specifically designed to address clinical outcome differences between physician and non-physician cohorts in both near-term and longer-term (mission impacting) outcomes. Methods: Medical simulations will systematically compare success of individual diagnostic and therapeutic procedure simulations performed by physician and non-physician crew medical officer (CMO) analogs using clearly defined short-term (individual procedure) outcome metrics. In the subsequent step of the project, the procedure simulation outcomes will be used as input to a modified version of the NASA Integrated Medical Model (IMM) to analyze the effect of the outcome (degree of success) of individual procedures (including successful, imperfectly performed, and failed procedures) on overall long-term clinical outcomes and the consequent mission impacts. The procedures to be simulated are endotracheal intubation, fundoscopic examination, kidney/urinary ultrasound, ultrasound-guided intravenous catheter insertion, and a differential diagnosis exercise. Multiple assessment techniques will be used, centered on medical procedure simulation studies occurring at 3, 6, and 12 months after initial training (as depicted in the following flow diagram of the experiment design). Discussion: Analysis of procedure outcomes in the physician and non-physician groups and their subsets (tested at different elapsed times post training) will allow the team to 1) define differences between physician and non-physician CMOs in terms of both procedure performance (pre-IMM analysis) and overall mitigation of the mission medical impact (IMM analysis); 2) refine the procedure outcome and clinical outcome metrics themselves; 3) refine or develop innovative medical training products and solutions to maximize CMO performance; and 4) validate the methods and products of this experiment for operational use in the planning, execution, and quality assurance of the CMO training process The team has finalized training protocols and developed a software training/testing tool in collaboration with Butler Graphics (Detroit, MI). In addition to the "hands on" medical procedure modules, the software includes a differential diagnosis exercise (limited clinical decision support tool) to evaluate the diagnostic skills of participants. Human subject testing will occur over the next year.

Ebert, D.↗
NASA NTRS2016

Development and Implementation of a Design Metric for Systems Containing Long-Term Fluid Loops

John Steele, a chemist and technical fellow from United Technologies Corporation, provided a water quality module to assist engineers and scientists with a metric tool to evaluate risks associated with the design of space systems with fluid loops. This design metric is a methodical, quantitative, lessons-learned based means to evaluate the robustness of a long-term fluid loop system design. The tool was developed by a cross-section of engineering disciplines who had decades of experience and problem resolution.

Steele, John W.↗
NASA NTRS2019

Bowles-Tatnall Wake Vortex Encounter Hazard Metric

Wake vortex spacing standards constrict the terminal area throughput and impose severe constraints on the overall capacity and efficiency of the National Airspace System. For more than two decades starting in the early 1990s, the National Aeronautics and Space Administration conducted extensive research on characterizing the formation and evolution of aircraft wakes. This multidisciplinary work included comprehensive field experiments (Pruis et al. 2016), flight tests (Vicroy et al. 1998), and wind tunnel tests (Rossow 1994; Chow et al. 1997). Parametric studies using large eddy simulations (Proctor 1998; Proctor et al. 2006) were conducted in order to develop fast-time models for the prediction of wake transport and decay (Ahmad et al. 2016). Substantial effort was spent on the formulation of acceptable vortex hazard metrics (Tatnall 1995; Hinton and Tatnall 1997). Several wake encounter severity metrics have been suggested in the past, which include the wake circulation strength, vortex-induced rolling moment coefficient (Clv), bank angle, and the roll control ratio (Tatnall 1995; Hinton and Tatnall 1997; Van der Geest 2012). The vortex-induced rolling moment coefficient introduced by Bowles and Tatnall (Tatnall 1995; Gloudemans et al. 2016) has been used extensively for risk and safety analysis of newly proposed air traffic management concepts and procedures. The original method of Bowles and Tatnall assumed a constant wing loading (the wing lift-curve slope, CL is constant), which resulted in an overestimation of the vortexinduced rolling moment coefficient. Bowles (2014) suggested a correction to the original method that provides more accurate values of Clv and which is also consistent with the underlying physics of the problem. The overestimation of Clv in the original method can be corrected by assuming an elliptical lift distribution. Figure 1.1 illustrates the correction in Clv achieved by the modified method.

Joel Malissa↗
NASA NTRS2018

NASA System Wide Safety Project Safety Metrics Research

This is a short set of PPT slides that we will use when we visit several US airlines to provide an introduction to a data collection task supporting the System Wide Safety Project. The goal is to gain an understanding of what airline dispatchers and other airline personnel see as hazards affecting the safety of flight. We want to list the hazards and how they are evaluated as safety metrics. This may eventually lead to an ability to monitor safety metrics in the National Airspace System and identify and predict possible unsafe situations.

Aviation safety↗
NASA NTRSDate not supplied

System-Wide Benefit Metrics

The presentation discusses goals for real-time metrics, new fields available in the ATD-2 System for displaying metrics to users, and analyses on delay prediction accuracy and delay savings.

Jeremy Coupe↗