Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Long Term Performance Metrics of the GD SDR on the SCaN Testbed: The First Year on the ISS

The General Dynamics (GD) S-Band software defined radio (SDR) in the Space Communications and Navigation (SCaN) Testbed on the International Space Station (ISS) provides experimenters an opportunity to develop and demonstrate experimental waveforms in space. The SCaN Testbed was installed on the ISS in August of 2012. After installation, the initial checkout and commissioning phases were completed and experimental operations commenced. One goal of the SCaN Testbed is to collect long term performance metrics for SDRs operating in space in order to demonstrate long term reliability. These metrics include the time the SDR powered on, the time the power amplifier (PA) is powered on, temperature trends, error detection and correction (EDAC) behavior, and waveform operational usage time. This paper describes the performance of the GD SDR over the first year of operations on the ISS.

radio telemetry↗

A Flexible and Non-instrusive Approach for Computing Complex Structural Coverage Metrics

Software analysis tools and techniques often leverage structural code coverage information to reason about the dynamic behavior of software. Existing techniques instrument the code with the required structural obligations and then monitor the execution of the compiled code to report coverage. Instrumentation based approaches often incur considerable runtime overhead for complex structural coverage metrics such as Modified Condition/Decision (MC/DC). Code instrumentation, in general, has to be approached with great care to ensure it does not modify the behavior of the original code. Furthermore, instrumented code cannot be used in conjunction with other analyses that reason about the structure and semantics of the code under test. In this work, we introduce a non-intrusive preprocessing approach for computing structural coverage information. It uses a static partial evaluation of the decisions in the source code and a source-to-bytecode mapping to generate the information necessary to efficiently track structural coverage metrics during execution. Our technique is flexible; the results of the preprocessing can be used by a variety of coverage-driven software analysis tasks, including automated analyses that are not possible for instrumented code. Experimental results in the context of symbolic execution show the efficiency and flexibility of our nonintrusive approach for computing code coverage information

DO-178C↗

Clinical Outcome Metrics for Optimization of Robust Training

Introduction: The emphasis of this research is on the Human Research Program (HRP) Exploration Medical Capability's (ExMC) "Risk of Unacceptable Health and Mission Outcomes Due to Limitations of In-Flight Medical Capabilities." Specifically, this project aims to contribute to the closure of gap ExMC 2.02: We do not know how the inclusion of a physician crew medical officer quantitatively impacts clinical outcomes during exploration missions. The experiments are specifically designed to address clinical outcome differences between physician and non-physician cohorts in both near-term and longer-term (mission impacting) outcomes. Methods: Medical simulations will systematically compare success of individual diagnostic and therapeutic procedure simulations performed by physician and non-physician crew medical officer (CMO) analogs using clearly defined short-term (individual procedure) outcome metrics. In the subsequent step of the project, the procedure simulation outcomes will be used as input to a modified version of the NASA Integrated Medical Model (IMM) to analyze the effect of the outcome (degree of success) of individual procedures (including successful, imperfectly performed, and failed procedures) on overall long-term clinical outcomes and the consequent mission impacts. The procedures to be simulated are endotracheal intubation, fundoscopic examination, kidney/urinary ultrasound, ultrasound-guided intravenous catheter insertion, and a differential diagnosis exercise. Multiple assessment techniques will be used, centered on medical procedure simulation studies occurring at 3, 6, and 12 months after initial training (as depicted in the following flow diagram of the experiment design). Discussion: Analysis of procedure outcomes in the physician and non-physician groups and their subsets (tested at different elapsed times post training) will allow the team to 1) define differences between physician and non-physician CMOs in terms of both procedure performance (pre-IMM analysis) and overall mitigation of the mission medical impact (IMM analysis); 2) refine the procedure outcome and clinical outcome metrics themselves; 3) refine or develop innovative medical training products and solutions to maximize CMO performance; and 4) validate the methods and products of this experiment for operational use in the planning, execution, and quality assurance of the CMO training process The team has finalized training protocols and developed a software training/testing tool in collaboration with Butler Graphics (Detroit, MI). In addition to the "hands on" medical procedure modules, the software includes a differential diagnosis exercise (limited clinical decision support tool) to evaluate the diagnostic skills of participants. Human subject testing will occur over the next year.

Ebert, D.↗

Development and Implementation of a Design Metric for Systems Containing Long-Term Fluid Loops

John Steele, a chemist and technical fellow from United Technologies Corporation, provided a water quality module to assist engineers and scientists with a metric tool to evaluate risks associated with the design of space systems with fluid loops. This design metric is a methodical, quantitative, lessons-learned based means to evaluate the robustness of a long-term fluid loop system design. The tool was developed by a cross-section of engineering disciplines who had decades of experience and problem resolution.

Steele, John W.↗

Bowles-Tatnall Wake Vortex Encounter Hazard Metric

Wake vortex spacing standards constrict the terminal area throughput and impose severe constraints on the overall capacity and efficiency of the National Airspace System. For more than two decades starting in the early 1990s, the National Aeronautics and Space Administration conducted extensive research on characterizing the formation and evolution of aircraft wakes. This multidisciplinary work included comprehensive field experiments (Pruis et al. 2016), flight tests (Vicroy et al. 1998), and wind tunnel tests (Rossow 1994; Chow et al. 1997). Parametric studies using large eddy simulations (Proctor 1998; Proctor et al. 2006) were conducted in order to develop fast-time models for the prediction of wake transport and decay (Ahmad et al. 2016). Substantial effort was spent on the formulation of acceptable vortex hazard metrics (Tatnall 1995; Hinton and Tatnall 1997). Several wake encounter severity metrics have been suggested in the past, which include the wake circulation strength, vortex-induced rolling moment coefficient (Clv), bank angle, and the roll control ratio (Tatnall 1995; Hinton and Tatnall 1997; Van der Geest 2012). The vortex-induced rolling moment coefficient introduced by Bowles and Tatnall (Tatnall 1995; Gloudemans et al. 2016) has been used extensively for risk and safety analysis of newly proposed air traffic management concepts and procedures. The original method of Bowles and Tatnall assumed a constant wing loading (the wing lift-curve slope, CL is constant), which resulted in an overestimation of the vortexinduced rolling moment coefficient. Bowles (2014) suggested a correction to the original method that provides more accurate values of Clv and which is also consistent with the underlying physics of the problem. The overestimation of Clv in the original method can be corrected by assuming an elliptical lift distribution. Figure 1.1 illustrates the correction in Clv achieved by the modified method.

Joel Malissa↗

NASA System Wide Safety Project Safety Metrics Research

This is a short set of PPT slides that we will use when we visit several US airlines to provide an introduction to a data collection task supporting the System Wide Safety Project. The goal is to gain an understanding of what airline dispatchers and other airline personnel see as hazards affecting the safety of flight. We want to list the hazards and how they are evaluated as safety metrics. This may eventually lead to an ability to monitor safety metrics in the National Airspace System and identify and predict possible unsafe situations.

Aviation safety↗

System-Wide Benefit Metrics

The presentation discusses goals for real-time metrics, new fields available in the ATD-2 System for displaying metrics to users, and analyses on delay prediction accuracy and delay savings.

Jeremy Coupe↗

A Study of Particle Size Metrics Using Non-Spherical Feedstock for Metal Additive Manufacturing

The goal of this work was to determine which standard particle size metric derived from optical analysis most closely approximates the sieved weight percent of irregularly shaped powder intended to be used for directed energy deposition. In this investigation, equivalent circle diameter, maximum diameter, minimum diameter, and perimeter are used as metrics to “virtually sieve” the particles in samples of irregularly shaped powder into the following particle size bins: <45 µm, 45 µm - 150 µm, and >150 µm. The percentage in the 45 µm - 150 µm bin is then compared to the weight percent of the powder mechanically sieved into this size range. The absolute difference between the virtually sieved percentage and the mechanically sieved percentage was assessed for 81 samples of mechanically-generated stainless steel 316L powder all produced under different processing conditions in an oscillation ball mill. This difference was found to be on average, the least with the minimum diameter assessed as an area percentage, followed by the equivalent diameter assessed as an area percentage, and then the maximum diameter assessed as a percentage of the total number of particles ranked third. These findings may be used by powder production process engineers and quality assurance personnel to assist in process control as more diverse additive manufacturing feedstocks become utilized.

Marcus Jackson↗

QWIP: A Quantitative Metric for Quality Control of Aquatic Reflectance Spectral Shape using the Apparent Visible Wavelength

The colors of the ocean and inland waters span clear blue to turbid brown, and the corresponding spectral shapes of the waterleaving signal are diverse depending on the various types and concentrations of phytoplankton, sediment, detritus and colored dissolved organic matter. Here we present a simple metric developed from a global dataset spanning blue, green and brown water types to assess the quality of a measured or derived aquatic spectrum. The Quality Water Index Polynomial (QWIP) is founded on the Apparent Visible Wavelength (AVW), a one-dimensional geophysical metric of color that is inherently correlated to spectral shape calculated as a weighted harmonic mean across visible wavelengths. The QWIP represents a polynomial relationship between the hyperspectral AVW and a Normalized Difference Index (NDI) using red and green wavelengths. The QWIP score represents the difference between a spectrum’s AVW and NDI and the QWIP polynomial. The approach is tested extensively with both raw and quality controlled field data to identify spectra that fall outside the general trends observed in aquatic optics. For example, QWIP scores less than or greater than 0.2 would fail an initial screening and be subject to additional quality control. Common outliers tend to have spectral features related to: 1) incorrect removal of surface reflected skylight or 2) optically shallow water. The approach was applied to hyperspectral imagery from the Hyperspectral Imager for the Coastal Ocean (HICO), as well as to multispectral imagery from the Visual Infrared Imaging Radiometer Suite (VIIRS) using sensor-specific extrapolations to approximate AVW. This simple approach can be rapidly implemented in ocean color processing chains to provide a level of uncertainty about a measured or retrieved spectrum and flag questionable or unusual spectra for further analysis.

remote sensing reflectance↗

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (Metric)

Geological solids are characterized by their mineral structure, elemental composition, and morphology. The Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC) is an instrument payload that will quantify all three. METRIC comprises a suite of instruments in a lander to perform X-ray diffraction (XRD) for mineral structure, X-ray fluorescence (XRF) for elemental composition, and X-ray Micro Computed Tomography (XCT) for 3D internal micromorphology. The instruments are accompanied by an Infrared Spectrometer (IRS) provide geologic context. A Honeybee Robotics pneumatic sampling and transfer system [e.g., 1] will be positioned under the lander to deliver sieved regolith to the X-ray instruments for analysis. This payload is envisioned for deployment to the lunar surface on a Commercial Lunar Payload Services (CLPS) lander but could be carried on a lander or rover to any solid surface in the solar system.

E B Rampe↗

Nonnormality of Sonic Boom Loudness Metrics in the Turbulent Atmospheric Boundary Layer at Large Lateral Distances from the Flight Path

Atmospheric boundary layer (ABL) turbulence causes variability of the sonic boom waveform at the ground. Recent numerical investigations of sonic boom propagation through kinematic velocity fluctuations indicate that loudness metric distributions are positively skewed relative to a normal distribution. This skewness depends on the propagation distance and turbulence intensity. Propagation simulations of N-waves and shaped booms through inhomogeneous ABL turbulence are presented. Meteorological conditions are varied to examine different daytime ABL conditions and their effect on sonic boom loudness distributions. Two outcomes are observed: 1) the loudness metric distributions become increasingly positively skewed as the propagation distance through the ABL increases, and 2) the distributions become increasingly positively skewed at the same lateral distance from the flight path as the convection level of the daytime ABL is increased. Thus, results indicate that ground level measurements of sonic boom loudness from flight tests performed at large lateral distances from the flight path may not be normally distributed, due to turbulence present in the ABL. (This research is supported by the Commercial Supersonic Technology Project of the National Aeronautics and Space Administration under Grant No. 80NSSC19K1685.)

sonic boom↗

Intrinsic Dimensionality as a Metric for the Impact of Mission Design Parameters

High-resolution space-based spectral imaging of the Earth's surface delivers critical information for monitoring changes in the Earth system as well as resource management and utilization. Orbiting spectrometers are built according to multiple design parameters, including ground sampling distance (GSD), spectral resolution, temporal resolution, and signal-to-noise ratio. Different applications drive divergent instrument designs, so optimization for wide-reaching missions is complex. The Surface Biology and Geology component of NASA's Earth System Observatory addresses science questions and meets applications needs across diverse fields, including terrestrial and aquatic ecosystems, natural disasters, and the cryosphere. The algorithms required to generate the geophysical variables from the observed spectral imagery each have their own inherent dependencies and sensitivities, and weighting these objectively is challenging. Here, we introduce intrinsic dimensionality (ID), a measure of information content, as an applications-agnostic, data-driven metric to quantify performance sensitivity to various design parameters. ID is computed through the analysis of the eigenvalues of the image covariance matrix, and can be thought of as the number of significant principal components. This metric is extremely powerful for quantifying the information content in high-dimensional data, such as spectrally resolved radiances and their changes over space and time. We find that the ID decreases for coarser GSD, decreased spectral resolution and range, less frequent acquisitions, and lower signal-to-noise levels. This decrease in information content has implications for all derived products. ID is simple to compute, providing a single quantitative standard to evaluate combinations of design parameters, irrespective of higher-level algorithms, products, applications, or disciplines.

Intrinsic dimensionality↗

Correlations Between Porosity, Spatter, and Process Metrics for Powder Bed Fusion Laser Beam Metallic Additive Manufacturing

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M)additive manufacturing process are the result of a multitude of weld passes conducted sequentially. Qualifying components for aerospace applications requires a thorough understanding of the process-structure-properties relationships. Porosity defects are known to have a strong adverse effect on the mechanical properties of a component. In particular, porosity defects created by lack of fusion have high aspect ratio morphologies leading to stress concentrations that become crack initiation sites. In the present work, the occurrence of spatter induced lack of fusion porosity was studied using synchronized in-situ process monitoring, additive manufacturing model-based process metrics, and high-resolution X-ray computed tomography. The results show that lack of fusion porosity is statistically correlated with unremoved welding spatter ejecta of the PBF-LB/M process and process metrics related to the hatching strategy.

Qualification↗

The International Safeguards Technology Base: How is the Patient Doing? An Exploration of Effective Metrics

The term “Technology Base” is commonly used but what does it mean? Is there a common understanding of the components that comprise a technology base? Does a formal process exist to assess the health of a given technology base? These are important questions the relevance of which is even more pressing given the USDOE/NNSA initiatives to strengthen the safeguards technology base through investments in research & development and human capital development. Accordingly, the authors will establish a high-level framework to define and understand what comprises a technology base. Potential goal-driven metrics to assess the health of a technology base will also be explored, such as linear demographics and resource availability, in the hope that they can be used to better understand and improve the health of the U.S. safeguards technology base. Finally, through the identification of such metrics, the authors will offer suggestions and highlight choices for addressing potential shortfalls. Introduction The U.S. safeguards technology base got its start almost half a century ago in the nuclear weapons program of the U.S. Department of Energy/National Nuclear Security Administration (DOE/NNSA) and their predecessors: AEC & ERDA. Due to nuclear materials’ strategic importance and value, and the risk associated with the public’s and worker’s health and the potential for theft, significant investments were made to develop techniques to measure nuclear materials using both destructive assay (DA) and non-destructive assay (NDA). Major investment within the U.S. DOE Domestic Safeguards Program continued over the next three decades, resulting in continuous improvements in the state-of-the-art of these techniques. This was particularly true in the area of NDA with its ability to use gamma rays, neutrons, and heat to identify and quantify nuclear materials without the need to take direct samples of the material. Most of these techniques were commercialized and transferred to industry, opening their applications to the nuclear industry worldwide and to the International Atomic Energy Agency (IAEA).

Schanfein, Mark↗

Metrics for Assessment of Smart Grid Data Integrity Attacks

There is an emerging consensus that the nation’s electricity grid is vulnerable to cyber attacks. This vulnerability arises from the increasing reliance on using remote measurements, transmitting them over legacy data networks to system operators who make critical decisions based on available data. Data integrity attacks are a class of cyber attacks that involve a compromise of information that is processed by the grid operator. This information can include meter readings of injected power at remote generators, power flows on transmission lines, and relay states. These data integrity attacks have consequences only when the system operator responds to compromised data by redispatching generation under normal or contingency protocols. These consequences include (a) financial losses from sub-optimal economic dispatch to service loads, (b) robustness/resiliency losses from placing the grid at operating points that are at greater risk from contingencies, and (c) systemic losses resulting from cascading failures induced by poor operational choices. This paper is focused on understanding the connections between grid operational procedures and cyber attacks. We first offer two examples to illustrate how data integrity attacks can cause economic and physical damage by misleading operators into taking inappropriate decisions. We then focus on unobservable data integrity attacks involving power meter data. These are coordinated attacks where the compromised data are consistent with the physics of power flow, and are therefore passed by any bad data detection algorithm. We develop metrics to assess the economic impact of these attacks under re-dispatch decisions using optimal power flow methods. These metrics can be use to prioritize the adoption of appropriate countermeasures including PMU placement, encryption, hardware upgrades, and advance attack detection algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

R&D100: Lightweight Distributed Metric Service

On today's High Performance Computing platforms, the complexity of applications and configurations makes efficient use of resources difficult. The Lightweight Distributed Metric Service (LDMS) is monitoring software developed by Sandia National Laboratories to provide detailed metrics of system performance. LDMS provides collection, transport, and storage of data from extreme-scale systems at fidelities and timescales to provide understanding of application and system performance with no statistically significant impact on application performance.

97 MATHEMATICS AND COMPUTING↗

The Use of Performance Metrics for the Assessment of Safeguards Effectiveness at the State Level

In the ongoing evolution of International Atomic Energy Agency (IAEA) safeguards at the state level, many safeguards implementation principles have been emphasized: effectiveness, efficiency, non-discrimination, transparency, focus on sensitive materials, centrality of material accountancy for detecting diversion, independence, objectivity, and grounding in technical considerations, among others. These principles are subject to differing interpretations and prioritizations and sometimes conflict. This paper is an attempt to develop metrics and address some of the potential tradeoffs inherent in choices about how various safeguards policy principles are implemented. The paper carefully defines effective safeguards, including in the context of safeguards approaches that take account of the range of state-specific factors described by the IAEA Secretariat and taken note of by the Board in September 2014, and (2) makes use of performance metrics to help document, and to make transparent, how safeguards implementation would meet such effectiveness requirements.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Development of Metric for Measuring the Impact of RD&D Funding on GTO's Geothermal Exploration Goals

The Department of Energy's Geothermal Technology Office (GTO) provides RD&D funding for geothermal exploration technologies with the goal of lowering the risks and costs of geothermal development and exploration. The National Renewable Energy Laboratory (NREL) was tasked with developing a metric in 2012 to measure the impacts of this RD&D funding on the cost and time required for explorationactivities. The development of this cost and time metric included collecting cost and time data for exploration techniques, creating a baseline suite of exploration techniques to which future exploration cost and time improvements can be compared, and developing an online tool for graphically showing potential project impacts (all available at http://en.openei.org/wiki/Gateway: Geothermal).This paper describes the methodology used to define the baseline exploration suite of techniques (baseline), as well as the approach that was used to create the cost and time data set that populates the baseline. The resulting product, an online tool for measuring impact, and the aggregated cost and time data are available on the Open Energy Information website (OpenEI, http://en.openei.org) forpublic access.

15 GEOTHERMAL ENERGY↗