Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Sound Quality Metric Indicators of Rotorcraft Noise Annoyance Using Multilevel Regression Analysis

Although every helicopter in operation has to go through a noise certification process, annoyance due to helicopters still persists within various communities. This implies that certification metrics do not capture the full range of human response and that predicted reactions could be supplemented with other information, which could be acoustic or non-acoustic in nature. The rotorcraft sound quality metric (RoQM) psychoacoustic experiment was designed to determine the relative importance of sound quality metrics (SQMs), such as sharpness, tonality, loudness, fluctuation strength and impulsiveness, on human annoyance to rotorcraft sounds. Starting from a baseline helicopter recording, SQMs were varied synthetically and presented to subjects who responded with an annoyance rating. The RoQM test took place in 2017 at the NASA Langley Research Center in the Exterior Effects Room. A total of 105 sounds were played to 40 subjects. The relationship between helicopter noise sound quality and annoyance is modeled using multilevel regression in this work, which takes into account the variability of responses across subjects. Previous analyses did not consider such a grouping of the data.

Matthew Boucher↗

Enabling Metric-Based Mesh Adaptation for Advanced Compressible Flow Simulations Using US3D

This work presents a metric-based mesh adaptation capability added to the flow solver US3D that is used to improve the accuracy of atmospheric entry simulations. Flow past an entry vehicle in free-flight is usually unsteady and characterized by anisotropic flow features like a strong bow shock and small-scale isotropic flow features like turbulent eddies in the wake. The results presented in this paper demonstrate that we are currently able to iteratively apply metric-based mesh adaptation to improve the solution accuracy by simultaneously targeting isotropic and anisotropic flow features. A simplified workflow of running CFD simulations for entry vehicles is presented where we start off with a coarse initial mesh to compute a first approximation of the flow. This coarse mesh is then iteratively refined using the newly developed metric to improve the resolution of the CFD computation. Furthermore, we demonstrate that we are able to adapt large mesh sizes in a timely fashion which allows us to start thinking about applying this adaptive framework to unsteady atmospheric entry CFD simulations.

Mesh adaptation↗

Stokes resolved differential temperature: an important metric of polarimetric precision in the long-wave infrared

In remote sensing, radiometric measurements taken in the mid-wave infrared and beyond (λ >3μm) are commonly reported in units of Kelvin by utilizing Planck’s radiation law to relate measured radiance and target brightness temperature (Tb). Thus, it is desirable to match this formalism in thermal polarimetry and report the unnormalized Stokes parameters in units of K instead of radiance (Wm−2sr−1). This approach also al-lows common performance metrics in long-wave infrared (LWIR) imaging such as Noise Equivalent DifferentialTemperature (NEDT) to be modified and extended to metrics of polarimetric accuracy and precision. However, since the relationship between measured radiance and Tb are non-linear, the conversion of I, Q, and U in units of radiance to Tb,Tb,Q, and Tb,U in K is ambiguous. As a solution a metric of performance for thermal linear Stokes polarimetry, the Stokes resolved differential temperature (SRDT), is introduced.

polarimetry↗

A Systems Margin Metric for Capability Above Basic Estimates

A systems margin metric is described that indicates the total system performance capability above the basic estimates (CABE) for mass, power, energy, propellant, V, ISP, computer performance, and any other design parameter with a defined margin. This concept normalizes all terms for contingency, margin, growth allowance, and reserves to the amount that the basic mass of the vehicle could grow if each of those “room to grow” terms were released. The CABE metric is intended to provide a uniform indication of the total performance margin of a system at a given point in the project life cycle. The CABE metric can also provide a normalized means to trade the “room to grow” terms between various resources in order to solve system performance issues as they arise. For example, the CABE percentage for ISP margin could be equally traded with the CABE percentage for power margin.

Lepsch, Roger↗

Correlations of Additive Manufacturing Model-Based Process Metrics With Spatter-Induced Porosity in the Powder Bed Fusion-Laser Beam/Metallic Process

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Qualifying materials for components in critical applications requires a thorough understanding of pertinent processing-microstructure-property relationships. Porosity defects have a strong adverse effect on the mechanical properties of a material. The morphology of porosity defects created by lack of fusion in PBF-LB/M often exhibit high aspect ratios that can act as stress concentrators and become crack initiation sites. The occurrence of spatter induced porosity is studied using synchronized AM model-based process metrics and porosity measured by high-resolution X-ray computed tomography. A novel AM process metric is introduced to quantify the relative exposure to spatter ejecta impacts and incorporation throughout the sequence of the PBF-LB/M process. Further characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated statistically with the spatter ejecta impact field of the PBF-LB/M process. Both keyhole and lack of fusion porosity can be predicted by the spatter exposure process metric, which can be exploited to control the fusion sequence.

Additive Manufacturing↗

Influence of Atmospheric Variability on Predicted Sonic Boom Metrics

As part of the Quesst mission, NASA will fly the X-59 aircraft over selected communities to survey community responses to low sonic booms. Previously, we developed a Kalman filter method to estimate the loudness metrics experienced by each survey participant during each flight. The Kalman filter fuses acoustic measurements with predictions from PCBoom, a sonic boom propagation model. PCBoom requires vertical profiles of the temperature, humidity, and wind to propagate sonic booms through the atmosphere and predict the loudness metrics at the ground. Prior to each X-59 flight, NASA will launch weather balloons to measure the vertical atmospheric profile. However, the atmosphere changes continually with geographic location and time. The purpose of this work is to determine where and when to launch these weather balloons to minimize the uncertainty in the predicted loudness metrics caused by atmospheric variability. We analyzed the effect of atmospheric variability on the predicted Perceived Level in three communities in different climate zones in the United States. To achieve acceptable uncertainty in the Perceived Level, weather balloons should be launched from at least two different sites within the survey area within one hour of each X-59 flight.

sonic boom↗

Assessing the Convective Environment over Irrigated and Non-Irrigated Land Use with Land-Atmosphere Coupling Metrics: Results from GRAINEX

Land use land cover change affects weather and climate. This paper quantifies land-atmosphere interactions over irrigated and non-irrigated land uses during the Great Plains Irrigation Experiment (GRAINEX). Three coupling metrics were used to quantify some land-atmosphere interactions as it relates to convection. They include: the Convective Triggering Potential (CTP) and Low-Level Humidity Index (HI low ), and the Lifting Condensation Level (LCL) Deficit. These metrics were calculated from the rawinsonde data obtained from the Integrated Sounding Systems (ISS) for Rogers Farm and York Airport along with soundings launched from the Doppler on Wheels (DOW) sites. Each metric was categorized by Intensive Observation Period (IOP), cloud cover, and time of day.

Daniel Whitesel↗

Use of Spectral Analysis of Singular Values as a Test Metric for IMMAT Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Impedance Matched Multi-Axis Testing↗

Use of Spectral Analysis of Singular Values as a Test Metric for Impedance Matched Multi-Axis Test Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Vibration Testing↗

Control Effectiveness: Metric Development and Application to Resilient Lunar Habitat Design

System safety engineering in its bare essence involves identifying, assessing, and mitigating, or controlling, hazards. Appropriate safety controls are selected using hazard reduction precedence principles, prior experience, or by assessing their impact on residual risk (together with other factors like cost). We propose a control effectiveness metric as one way to systematically and consistently evaluate potential safety controls individually and thereby facilitate selecting a shortlist of potential controls for subsequent integrated evaluation. The control effectiveness metric considers a safety control’s availability when needed, the probability that its design is adequate in addressing the targeted hazard, the probability that the design will be implemented as intended, and the relationship between the time it takes for the safety control to address its target hazard and the time before the hazard propagates. We demonstrated the use of our metric on a lunar habitat design using a physics-based habitat simulator. High control effectiveness and safety controls result in a habitat with high resilience, while low control effectiveness results in lower resilience.

Rashi Jain↗

Urban Traveler - Changes and Impacts: Mobility Energy Productivity (MEP) Metric

For nearly a century, the automobile has been the primary mode of personal transportation in American life. This remains true today as millions of people rely heavily on cars to connect suburbs with cities or to travel long distances—often out of routine or convenience. However, advances in technology are fueling an era of transportation transformation, with the potential to transform a system that has remained virtually unchanged for decades. Aspiring smart cities are wrestling with questions such as: How does mobility impact a person’s quality of life? Would people make different travel choices if they were presented with better information about their mobility options? The ability to quantify the mobility potential of a given location is the first step toward answering these questions. In response, an interdisciplinary team at the National Renewable Energy Laboratory (NREL) has developed the Mobility-Energy Productivity (MEP) metric. The MEP metric provides an avenue to not only measure the mobility potential at a specific location in its current configuration, but also to test how various technological advances (e.g., connected and automated vehicles, plug-in electric vehicles, shared mobility) and infrastructure investments (e.g., building an additional highway lane, constructing a new shopping mall, implementing a transit-oriented development) impact the mobility of that location over time. This presentation details the FY19 progress on the MEP metric project funded through DOE VTO's SMART Mobility Consortium.

47 OTHER INSTRUMENTATION↗

Beyond Expected Values Evolving Metrics for Resource Adequacy Assessment

Resource adequacy analysis quantifies the likelihood of capacity shortfall on a power system in a probabilistic manner. Using a combination of statistical techniques and power system fundamentals, the analysis typically evaluates hundreds or thousands of stochastic random samples (replications) of varying load, generator outages, variable renewable energy availability, and other aspects of power system uncertainty. In this range of uncertainty, there are - at times - periods where the power system's available resources are insufficient to meet system demand, referred to as a shortfall event. Today's power systems' rapidly evolving generation mix is changing the types of data needed by system planners and regulators, which can often render traditional resource adequacy metrics insufficient for ensuring resource adequacy for tomorrow's grid. In this paper we provide a critical assessment of traditional measures of shortfall risk in power systems, discussing their shortcomings and how they compare to metrics used in other domains. From this analysis we propose four steps forward for improving power system resource adequacy risk metrics in the future.

ENERGY PLANNING, POLICY, AND ECONOMY↗

Standardizing Performance Metrics for Building-Level Electrical Distribution Systems

Building-level electrical distribution systems comprise a myriad of current-carrying equipment, conversion devices, and protection devices that deliver power from the utility or local distributed energy resources to end-use building loads. Electric power has traditionally been generated, transmitted, and distributed in alternating current (AC). However, the last decade has seen a significant increase in the integration of native direct current (DC) equipment that has elevated the importance of DC distribution systems. Numerous studies have comparatively examined the performance of various electrical distribution systems in buildings but have failed to achieve uniform conclusions, primarily because of a lack of consistent and analogous performance evaluation methods. This paper aims to fill this gap by providing a standard set of metrics and measurement boundaries to consistently evaluate the performance of AC, DC, or hybrid AC/DC electrical distribution systems. The efficacy of the proposed approach is evaluated on a representative medium-sized commercial office building model with AC distribution and an equivalent hybrid AC/DC and DC distribution model, wherein the AC distribution model is concluded to be the most efficient. The simulation results show variation in computed metrics with different selected boundaries that verify the effectiveness of the proposed approach in ensuring consistent computation of the performance of building-level electrical distribution systems. This paper provides an initial set of guidelines for building energy system stakeholders to adopt appropriate solutions, thus leading to more efficient energy systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Complexity and Pilot Workload Metrics for the Evaluation of Adaptive Flight Controls on a Full Scale Piloted Aircraft

Flight research has shown the effectiveness of adaptive flight controls for improving aircraft safety and performance in the presence of uncertainties. The National Aeronautics and Space Administration's (NASA)'s Integrated Resilient Aircraft Control (IRAC) project designed and conducted a series of flight experiments to study the impact of variations in adaptive controller design complexity on performance and handling qualities. A novel complexity metric was devised to compare the degrees of simplicity achieved in three variations of a model reference adaptive controller (MRAC) for NASA's F-18 (McDonnell Douglas, now The Boeing Company, Chicago, Illinois) Full-Scale Advanced Systems Testbed (Gen-2A) aircraft. The complexity measures of these controllers are also compared to that of an earlier MRAC design for NASA's Intelligent Flight Control System (IFCS) project and flown on a highly modified F-15 aircraft (McDonnell Douglas, now The Boeing Company, Chicago, Illinois). Pilot comments during the IRAC research flights pointed to the importance of workload on handling qualities ratings for failure and damage scenarios. Modifications to existing pilot aggressiveness and duty cycle metrics are presented and applied to the IRAC controllers. Finally, while adaptive controllers may alleviate the effects of failures or damage on an aircraft's handling qualities, they also have the potential to introduce annoying changes to the flight dynamics or to the operation of aircraft systems. A nuisance rating scale is presented for the categorization of nuisance side-effects of adaptive controllers.

pilot workload metrics↗

Improving magnitude and phase comparison metrics for frequency response functions using cross-correlation and log-frequency shifting

This paper provides a new method for matching dominant features of Frequency Response Functions (FRFs). In particular, this paper proposes a slicing and shifting method where the key features (in this case, resonant amplitudes) of a baseline FRF are compared with a similar FRF using cross-correlation and a Log-Frequency Shift (LFS). Here, the goal is to provide an alternative to classic point-to-point methods for FRF comparison and instead to match the dominant features of two FRFs in a way similar to visual inspection. This enables existing FRF comparison metrics to then be applied with greater fidelity. Additionally, this paper introduces the Phase Similarity Metric (PSM) for comparing phases of two FRFs and illustrates the improvement of using LFS for phase comparisons as well. This paper uses a cantilever beam experiment in multiple configurations to provide a benchmark case for FRF comparison improvements.

42 ENGINEERING↗

Monitoring Fracture Hydromechanical Evolution in the Lab and Field Using Unsupervised Metric Learning

Fractures evolve in time through thermal‐hydraulic‐mechanical‐chemical (THMC) processes that alter their long‐range hydraulic transport properties and modify subsurface behavior and activities. The location of subsurface fractures makes it necessary to use remote sensing techniques such as passive or active seismic monitoring for fracture characterization. In this paper, we develop a machine learning approach to monitor the evolution of fracture properties using passive seismic sources in a laboratory setting and using active seismic monitoring from the Sanford Underground Research Facility in Lead, South Dakota, at a depth of 1.25 km in amphibolite rock during stimulation of natural fractures as well as during induced fracturing. The unsupervised metric learning technique applies tandem neural networks (twin (Siamese) or triplet) with contrastive loss and adaptive margins to track slowly varying systems for which class or similarity labels are not available. The approach adopts locality‐sensitive hashing to divide time‐ordered contiguous data into an arbitrary number of pseudo‐classes. Contrastive‐loss training with many hash bins generates an evolving latent‐space trajectory. This approach enables unsupervised metric learning for seismic data stacks under the condition of contiguous state sampling and slowly varying fracture properties. The displacement discontinuity theory provides a mechanistic foundation for the fracture‐dependent trajectories that are related to relaxation of fractures with time‐dependent specific stiffness responding to changes in stress or fluid saturation.

02 PETROLEUM↗

Power System Resilience Evaluation Framework and Metric Review

Power system resilience has been an emerging hot topic in recent years to investigate the increasing threats of extreme events, such as natural disasters, severe weather, and cyberattacks. Although much research has been done to define, model, and quantify resilience from different aspects, the lack of universally accepted evaluation methods and resilience metrics makes it difficult to assess and compare resilience across different power systems, such as what is typically done in power system reliability studies. In this paper, first, we review the definitions of resilience, and we summarize two core concepts shared by most of the literature. Then, we develop a new framework to assess power system resilience from two perspectives - i.e., pre-event estimation and post-event evaluation - to capture system resilience performance in both general and specific fashions. We conduct a thorough review of existing resilience metrics and categorize them using the proposed framework, where recommendations are also proposed to capture core concepts of resilience.

power system resilience↗

Logarithmic Resilience Risk Metrics That Address the Huge Variations in Blackout Cost

Resilience risk metrics must address the customer cost of the largest blackouts of greatest impact. However, there are huge variations in blackout cost in observed distribution utility data that make it impractical to properly estimate the mean large blackout cost and the corresponding risk. These problems are caused by the heavy tail observed in the distribution of customer costs. To solve these problems, we propose resilience metrics that describe large blackout risk using the mean of the logarithm of the cost of large-cost blackouts, the slope index of the heavy tail, and the frequency of large-cost blackouts.

24 POWER TRANSMISSION AND DISTRIBUTION↗