Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Quantitative Metrics from 20 Years of Terra Data Usage

NASA's Terra flagship satellite carries five Earth-observing instruments that have collected data for almost 20 years. NASA's Earth Science Data and Information System (ESDIS) Project makes these data, along with derived products, available to worldwide data users. Since the launch of Terra on December 18, 1999, more than 10,000 data products have been archived and distributed by NASA-funded Distributed Active Archive Centers (DAACs) that are part of NASA's Earth Observing System Data and Information System (EOSDIS). At the end of the 2018 Fiscal Year, about 1,000 Terra data products constituted almost 22% of the entire EOSDIS data archive volume (6 PB out of approximately 27.5 PB), and 6 PB of Terra data were distributed to over half-a-million public users worldwide.By categorizing the Terra data products and their distribution, we can get a quantitative assessment of Terra data usage. NASA's ESDIS Project has collected archive, distribution, and user information from EOSDIS data users since February 2000. These metrics are available through the ESDIS Metrics System (EMS). EMS information is stored in a relational database from which quantitative metrics of Terra data use can be retrieved and analyzed.The purposes of this study are to: 1) perform a comprehensive investigation of the 20-year trend in the archive and distribution of Terra data products; 2) identify and characterize data product usage over the last 20 years; and 3) identify and characterize the global user community for these data. In addition to revealing how Terra data use has evolved over time, the results of this study provide insights on identifying the various user communities for different kinds of Earth science data products. Also, because of the enormous quantity of data handled by EOSDIS DAACs, the study provides guidance of the requirements for future data systems that will be needed to effectively and efficiently handle the ever-increasing amounts of Earth science data produced by future (and ongoing) Earth science missions.

Wanchoo, Lalit↗

Parallel High-Order Anisotropic Meshing Using Discrete Metric Tensors

This paper presents a metric-aligned meshing algorithm that relies on the Lp-Centroidal Voronoi Tesselation approach. A prototype of this algorithm was first presented at the Scitech conference of 2018 and this work is an extension to that paper. At the end of the previously presented work, a set of problems were mentioned which we are trying to address in this paper. First, we show a significant improvement in code performance since we were limited to present relatively benign (analytical) test cases. Second, we demonstrate here that we are able to rely on discrete metric data that is delivered by a Computational Fluid Dynamics (CFD) solver. Third, we demonstrate how to generate high-order curved elements that are aligned with the underlying discrete metric field.

Ekelschot, Dirk↗

Sound Quality Metric Indicators of Rotorcraft Noise Annoyance Using Multilevel Regression Analysis

Although every helicopter in operation has to go through a noise certification process, annoyance due to helicopters still persists within various communities. This implies that certification metrics do not capture the full range of human response and that predicted reactions could be supplemented with other information, which could be acoustic or non-acoustic in nature. The rotorcraft sound quality metric (RoQM) psychoacoustic experiment was designed to determine the relative importance of sound quality metrics (SQMs), such as sharpness, tonality, loudness, fluctuation strength and impulsiveness, on human annoyance to rotorcraft sounds. Starting from a baseline helicopter recording, SQMs were varied synthetically and presented to subjects who responded with an annoyance rating. The RoQM test took place in 2017 at the NASA Langley Research Center in the Exterior Effects Room. A total of 105 sounds were played to 40 subjects. The relationship between helicopter noise sound quality and annoyance is modeled using multilevel regression in this work, which takes into account the variability of responses across subjects. Previous analyses did not consider such a grouping of the data.

Matthew Boucher↗

Enabling Metric-Based Mesh Adaptation for Advanced Compressible Flow Simulations Using US3D

This work presents a metric-based mesh adaptation capability added to the flow solver US3D that is used to improve the accuracy of atmospheric entry simulations. Flow past an entry vehicle in free-flight is usually unsteady and characterized by anisotropic flow features like a strong bow shock and small-scale isotropic flow features like turbulent eddies in the wake. The results presented in this paper demonstrate that we are currently able to iteratively apply metric-based mesh adaptation to improve the solution accuracy by simultaneously targeting isotropic and anisotropic flow features. A simplified workflow of running CFD simulations for entry vehicles is presented where we start off with a coarse initial mesh to compute a first approximation of the flow. This coarse mesh is then iteratively refined using the newly developed metric to improve the resolution of the CFD computation. Furthermore, we demonstrate that we are able to adapt large mesh sizes in a timely fashion which allows us to start thinking about applying this adaptive framework to unsteady atmospheric entry CFD simulations.

Mesh adaptation↗

Stokes resolved differential temperature: an important metric of polarimetric precision in the long-wave infrared

In remote sensing, radiometric measurements taken in the mid-wave infrared and beyond (λ >3μm) are commonly reported in units of Kelvin by utilizing Planck’s radiation law to relate measured radiance and target brightness temperature (Tb). Thus, it is desirable to match this formalism in thermal polarimetry and report the unnormalized Stokes parameters in units of K instead of radiance (Wm−2sr−1). This approach also al-lows common performance metrics in long-wave infrared (LWIR) imaging such as Noise Equivalent DifferentialTemperature (NEDT) to be modified and extended to metrics of polarimetric accuracy and precision. However, since the relationship between measured radiance and Tb are non-linear, the conversion of I, Q, and U in units of radiance to Tb,Tb,Q, and Tb,U in K is ambiguous. As a solution a metric of performance for thermal linear Stokes polarimetry, the Stokes resolved differential temperature (SRDT), is introduced.

polarimetry↗

A Systems Margin Metric for Capability Above Basic Estimates

A systems margin metric is described that indicates the total system performance capability above the basic estimates (CABE) for mass, power, energy, propellant, V, ISP, computer performance, and any other design parameter with a defined margin. This concept normalizes all terms for contingency, margin, growth allowance, and reserves to the amount that the basic mass of the vehicle could grow if each of those “room to grow” terms were released. The CABE metric is intended to provide a uniform indication of the total performance margin of a system at a given point in the project life cycle. The CABE metric can also provide a normalized means to trade the “room to grow” terms between various resources in order to solve system performance issues as they arise. For example, the CABE percentage for ISP margin could be equally traded with the CABE percentage for power margin.

Lepsch, Roger↗

Correlations of Additive Manufacturing Model-Based Process Metrics With Spatter-Induced Porosity in the Powder Bed Fusion-Laser Beam/Metallic Process

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Qualifying materials for components in critical applications requires a thorough understanding of pertinent processing-microstructure-property relationships. Porosity defects have a strong adverse effect on the mechanical properties of a material. The morphology of porosity defects created by lack of fusion in PBF-LB/M often exhibit high aspect ratios that can act as stress concentrators and become crack initiation sites. The occurrence of spatter induced porosity is studied using synchronized AM model-based process metrics and porosity measured by high-resolution X-ray computed tomography. A novel AM process metric is introduced to quantify the relative exposure to spatter ejecta impacts and incorporation throughout the sequence of the PBF-LB/M process. Further characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated statistically with the spatter ejecta impact field of the PBF-LB/M process. Both keyhole and lack of fusion porosity can be predicted by the spatter exposure process metric, which can be exploited to control the fusion sequence.

Additive Manufacturing↗

Influence of Atmospheric Variability on Predicted Sonic Boom Metrics

As part of the Quesst mission, NASA will fly the X-59 aircraft over selected communities to survey community responses to low sonic booms. Previously, we developed a Kalman filter method to estimate the loudness metrics experienced by each survey participant during each flight. The Kalman filter fuses acoustic measurements with predictions from PCBoom, a sonic boom propagation model. PCBoom requires vertical profiles of the temperature, humidity, and wind to propagate sonic booms through the atmosphere and predict the loudness metrics at the ground. Prior to each X-59 flight, NASA will launch weather balloons to measure the vertical atmospheric profile. However, the atmosphere changes continually with geographic location and time. The purpose of this work is to determine where and when to launch these weather balloons to minimize the uncertainty in the predicted loudness metrics caused by atmospheric variability. We analyzed the effect of atmospheric variability on the predicted Perceived Level in three communities in different climate zones in the United States. To achieve acceptable uncertainty in the Perceived Level, weather balloons should be launched from at least two different sites within the survey area within one hour of each X-59 flight.

sonic boom↗

Assessing the Convective Environment over Irrigated and Non-Irrigated Land Use with Land-Atmosphere Coupling Metrics: Results from GRAINEX

Land use land cover change affects weather and climate. This paper quantifies land-atmosphere interactions over irrigated and non-irrigated land uses during the Great Plains Irrigation Experiment (GRAINEX). Three coupling metrics were used to quantify some land-atmosphere interactions as it relates to convection. They include: the Convective Triggering Potential (CTP) and Low-Level Humidity Index (HI low ), and the Lifting Condensation Level (LCL) Deficit. These metrics were calculated from the rawinsonde data obtained from the Integrated Sounding Systems (ISS) for Rogers Farm and York Airport along with soundings launched from the Doppler on Wheels (DOW) sites. Each metric was categorized by Intensive Observation Period (IOP), cloud cover, and time of day.

Daniel Whitesel↗

Use of Spectral Analysis of Singular Values as a Test Metric for IMMAT Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Impedance Matched Multi-Axis Testing↗

Use of Spectral Analysis of Singular Values as a Test Metric for Impedance Matched Multi-Axis Test Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Vibration Testing↗

Control Effectiveness: Metric Development and Application to Resilient Lunar Habitat Design

System safety engineering in its bare essence involves identifying, assessing, and mitigating, or controlling, hazards. Appropriate safety controls are selected using hazard reduction precedence principles, prior experience, or by assessing their impact on residual risk (together with other factors like cost). We propose a control effectiveness metric as one way to systematically and consistently evaluate potential safety controls individually and thereby facilitate selecting a shortlist of potential controls for subsequent integrated evaluation. The control effectiveness metric considers a safety control’s availability when needed, the probability that its design is adequate in addressing the targeted hazard, the probability that the design will be implemented as intended, and the relationship between the time it takes for the safety control to address its target hazard and the time before the hazard propagates. We demonstrated the use of our metric on a lunar habitat design using a physics-based habitat simulator. High control effectiveness and safety controls result in a habitat with high resilience, while low control effectiveness results in lower resilience.

Rashi Jain↗

The Locus Algorithm IV: Performance metrics of a grid computing system used to create catalogues of optimised pointings

This paper discusses the requirements for and performance metrics of the the Grid Computing system used to implement the Locus Algorithm to identify optimum pointings for differential photometry of 61,662,376 stars and 23,779 quasars. Initial operational tests indicated a need for a software system to analyse the data and a High Performance Computing system to run that software in a scalable manner. Practical assessments of the performance of the software in a serial computing environment were used to provide a benchmark against which the performance metrics of the HPC solution could be compared, as well as to indicate any bottlenecks in performance. These performance metrics indicated a distinct split in the performance dictated more by differences in the input data than by differences in the design of the systems used. This indicates a need for experimental analysis of system performance, and suggests that algorithmic complexity analyses may lead to incorrect or naive conclusions, especially in systems with high data I/O overhead such as grid computing. Further, it implies that systems which reduce or eliminate this bottleneck such as in-memory processing could lead to a substantial increase in performance.

Creaner, Oisín↗

Urban Traveler - Changes and Impacts: Mobility Energy Productivity (MEP) Metric

For nearly a century, the automobile has been the primary mode of personal transportation in American life. This remains true today as millions of people rely heavily on cars to connect suburbs with cities or to travel long distances—often out of routine or convenience. However, advances in technology are fueling an era of transportation transformation, with the potential to transform a system that has remained virtually unchanged for decades. Aspiring smart cities are wrestling with questions such as: How does mobility impact a person’s quality of life? Would people make different travel choices if they were presented with better information about their mobility options? The ability to quantify the mobility potential of a given location is the first step toward answering these questions. In response, an interdisciplinary team at the National Renewable Energy Laboratory (NREL) has developed the Mobility-Energy Productivity (MEP) metric. The MEP metric provides an avenue to not only measure the mobility potential at a specific location in its current configuration, but also to test how various technological advances (e.g., connected and automated vehicles, plug-in electric vehicles, shared mobility) and infrastructure investments (e.g., building an additional highway lane, constructing a new shopping mall, implementing a transit-oriented development) impact the mobility of that location over time. This presentation details the FY19 progress on the MEP metric project funded through DOE VTO's SMART Mobility Consortium.

47 OTHER INSTRUMENTATION↗

Beyond Expected Values Evolving Metrics for Resource Adequacy Assessment

Resource adequacy analysis quantifies the likelihood of capacity shortfall on a power system in a probabilistic manner. Using a combination of statistical techniques and power system fundamentals, the analysis typically evaluates hundreds or thousands of stochastic random samples (replications) of varying load, generator outages, variable renewable energy availability, and other aspects of power system uncertainty. In this range of uncertainty, there are - at times - periods where the power system's available resources are insufficient to meet system demand, referred to as a shortfall event. Today's power systems' rapidly evolving generation mix is changing the types of data needed by system planners and regulators, which can often render traditional resource adequacy metrics insufficient for ensuring resource adequacy for tomorrow's grid. In this paper we provide a critical assessment of traditional measures of shortfall risk in power systems, discussing their shortcomings and how they compare to metrics used in other domains. From this analysis we propose four steps forward for improving power system resource adequacy risk metrics in the future.

ENERGY PLANNING, POLICY, AND ECONOMY↗

Standardizing Performance Metrics for Building-Level Electrical Distribution Systems

Building-level electrical distribution systems comprise a myriad of current-carrying equipment, conversion devices, and protection devices that deliver power from the utility or local distributed energy resources to end-use building loads. Electric power has traditionally been generated, transmitted, and distributed in alternating current (AC). However, the last decade has seen a significant increase in the integration of native direct current (DC) equipment that has elevated the importance of DC distribution systems. Numerous studies have comparatively examined the performance of various electrical distribution systems in buildings but have failed to achieve uniform conclusions, primarily because of a lack of consistent and analogous performance evaluation methods. This paper aims to fill this gap by providing a standard set of metrics and measurement boundaries to consistently evaluate the performance of AC, DC, or hybrid AC/DC electrical distribution systems. The efficacy of the proposed approach is evaluated on a representative medium-sized commercial office building model with AC distribution and an equivalent hybrid AC/DC and DC distribution model, wherein the AC distribution model is concluded to be the most efficient. The simulation results show variation in computed metrics with different selected boundaries that verify the effectiveness of the proposed approach in ensuring consistent computation of the performance of building-level electrical distribution systems. This paper provides an initial set of guidelines for building energy system stakeholders to adopt appropriate solutions, thus leading to more efficient energy systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Complexity and Pilot Workload Metrics for the Evaluation of Adaptive Flight Controls on a Full Scale Piloted Aircraft

Flight research has shown the effectiveness of adaptive flight controls for improving aircraft safety and performance in the presence of uncertainties. The National Aeronautics and Space Administration's (NASA)'s Integrated Resilient Aircraft Control (IRAC) project designed and conducted a series of flight experiments to study the impact of variations in adaptive controller design complexity on performance and handling qualities. A novel complexity metric was devised to compare the degrees of simplicity achieved in three variations of a model reference adaptive controller (MRAC) for NASA's F-18 (McDonnell Douglas, now The Boeing Company, Chicago, Illinois) Full-Scale Advanced Systems Testbed (Gen-2A) aircraft. The complexity measures of these controllers are also compared to that of an earlier MRAC design for NASA's Intelligent Flight Control System (IFCS) project and flown on a highly modified F-15 aircraft (McDonnell Douglas, now The Boeing Company, Chicago, Illinois). Pilot comments during the IRAC research flights pointed to the importance of workload on handling qualities ratings for failure and damage scenarios. Modifications to existing pilot aggressiveness and duty cycle metrics are presented and applied to the IRAC controllers. Finally, while adaptive controllers may alleviate the effects of failures or damage on an aircraft's handling qualities, they also have the potential to introduce annoying changes to the flight dynamics or to the operation of aircraft systems. A nuisance rating scale is presented for the categorization of nuisance side-effects of adaptive controllers.

pilot workload metrics↗

Improving magnitude and phase comparison metrics for frequency response functions using cross-correlation and log-frequency shifting

This paper provides a new method for matching dominant features of Frequency Response Functions (FRFs). In particular, this paper proposes a slicing and shifting method where the key features (in this case, resonant amplitudes) of a baseline FRF are compared with a similar FRF using cross-correlation and a Log-Frequency Shift (LFS). Here, the goal is to provide an alternative to classic point-to-point methods for FRF comparison and instead to match the dominant features of two FRFs in a way similar to visual inspection. This enables existing FRF comparison metrics to then be applied with greater fidelity. Additionally, this paper introduces the Phase Similarity Metric (PSM) for comparing phases of two FRFs and illustrates the improvement of using LFS for phase comparisons as well. This paper uses a cantilever beam experiment in multiple configurations to provide a benchmark case for FRF comparison improvements.

42 ENGINEERING↗