Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Real Time Metrics and Analysis of Integrated Arrival, Departure, and Surface Operations

To address the Integrated Arrival, Departure, and Surface (IADS) challenge, NASA is developing and demonstrating trajectory-based departure automation under a collaborative effort with the FAA and industry known Airspace Technology Demonstration 2 (ATD-2). ATD-2 builds upon and integrates previous NASA research capabilities that include the Spot and Runway Departure Advisor (SARDA), the Precision Departure Release Capability (PDRC), and the Terminal Sequencing and Spacing (TSAS) capability. As trajectory-based departure scheduling and collaborative decision making tools are introduced in order to reduce delays and uncertainties in taxi and climb operations across the National Airspace System, users of the tools across a number of roles benefit from a real time system that enables common situational awareness. A real time dashboard was developed to inform and present users notifications and integrated information regarding airport surface operations. The dashboard is a supplement to capabilities and tools that incorporate arrival, departure, and surface air-traffic operations concepts in a NextGen environment. In addition to shared situational awareness, the dashboard offers the ability to compute real time metrics and analysis to inform users about capacity, predictability, and efficiency of the system as a whole. This paper describes the architecture of the real time dashboard as well as an initial proposed set of metrics. The potential impact of the real time dashboard is studied at the site identified for initial deployment and demonstration in 2017: Charlotte-Douglas International Airport (CLT). The architecture of implementing such a tool as well as potential uses are presented for operations at CLT. Metrics computed in real time illustrate the opportunity to provide common situational awareness and inform users of system delay, throughput, taxi time, and airport capacity. In addition, common awareness of delays and the impact of takeoff and departure restrictions stemming from traffic flow management initiatives are explored. The potential of the real time tool to inform users of the predictability and efficiency of using a trajectory-based departure scheduling system is also discussed.

integrated arrival departure surface operations↗

Rotorcraft Sound Quality Metric Test 1: Stimuli Generation and Supplemental Analyses

A psychoacoustic test was conducted at the NASA Langley Research Center Exterior Effects Room (EER) to assess annoyance to simulated helicopter sounds over a range of sound quality (SQ) metric values. Initial findings identified important SQ metrics as sharpness, tonality, and fluctuation strength. This document is a supplement to the initial findings in which the following are discussed: (i) a detailed treatment of the sound generation process, (ii) the impact of analyzing results with stimuli measured in the EER instead of the intended synthesized stimuli, (iii) an evaluation of annoyance responses with certification metrics, and (iv) adjunct analyses related to the test methodology.

Psychoacoustic test, psychoacoustics, sound qualit↗

Estimated Ambient Sonic Boom Metric Levels and X-59 Signal-to-Noise Ratios across the USA

NASA is building the X-59 Quiet Supersonic Technology aircraft to produce low noise sonic booms for a series of community noise surveys across the USA. Survey participants will rate their perception of the low-booms from supersonic X-59 flyovers. Several noise metrics are proposed to quantify the noise dose: A-, B-, D-, and E-weighted Sound Exposure Level, Stevens Perceived Level, and Indoor Sonic Boom Annoyance Predictor. Sparse measurements across the survey area will be used to estimate community noise exposure. The level of these low-booms may be comparable to the ambient noise level in some locations, leading to uncertainty in noise exposure estimations. This uncertainty may necessitate increased reliance on sonic boom propagation predictions for exposure estimation. Low-boom signal to ambient noise ratio is one way to quantify uncertainty in measured sonic boom levels. An empirical relationship between A-weighted ambient level and sonic boom metric levels is used in conjunction with the National Park Service’s L50 SPL map to estimate ambient noise levels expressed in terms of sonic boom noise metrics across the USA. These estimates of ambient levels will aid in X-59 community test planning and execution. The signal-to-noise ratio for the undertrack X-59 sonic boom is also estimated, and an example application of these data is presented for comparing potential noise monitor sites prior to a community noise test.

X-59↗

Risk Assessment Metrics for NASA Fission Reactor Applications

Risk assessment is an important part of many NASA activities. In August 2019, the White House issued NSPM-20, which defines acceptable levels of risk for nuclear launches, but does not prescribe the particular methodologies or metrics that are to be used for comparison to the defined acceptance criteria. There are a variety of metrics that are possible and can be readily generated by a probabilistic risk assessment (PRA). This paper will explore alternative metrics that can be provided, along with some discussion of their characteristics and important factors to consider during a space fission reactor risk analysis.

Probabilistic Risk Assessment↗

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

Effectiveness of various error metrics in SCEPTRE.

The objective of this project is to investigate accuracy of error metrics in SCEPTRE and produce useful benchmarks, identify metrics that do not work well, identify metrics that do work well, and produce easy to reference results.

99 GENERAL AND MISCELLANEOUS↗

Metrics for diagnosing negative mass and stiffness when uncoupling experimental and analytical substructures.

Recently, a new substructure coupling/uncoupling approach has been introduced, called Modal Constraints for Fixture and Subsystem (MCFS) [Allen, Mayes, & Bergman, Journal of Sound and Vibration, vol. 329, 2010]. This method reduces ill-conditioning by imposing constraints on substructure modal coordinates instead of the physical interface coordinates. The experimental substructure is tested in a free-free configuration, and the interface is exercised by attaching a flexible fixture. An analytical representation of the fixture is then used to subtract its effects in order to create an experimental model for the subcomponent of interest. However, it has been observed that indefinite mass and stiffness matrices can be obtained for the experimental substructure in some situations. This paper presents two simple metrics that can be used by the analyst to determine the cause of indefinite mass or stiffness matrices after substructure uncoupling. The metrics rank the experimental and fixture modes based upon their contribution to offending negative eigenvalues. Once the troublesome modes have been identified, they can be inspected and often reveal why the mass has become negative. Two examples are presented to demonstrate the metrics and to illustrate the physical phenomena that they reveal.

99 GENERAL AND MISCELLANEOUS↗

Towards the Net-Zero Data Center: Development and Application of an Energy Reuse Metric

Data Centers are an ever increasing user of energy in our economy. While the performance per watt of our IT equipment continues to increase exponentially, this energy performance improvement is still outstripped by increasing demand. Because of this, the efficiency of data centers must continue to improve. Beyond just efficiency, many data centers now are working towards reuse of their waste energy in other areas in the data center or on the site or campus. How to account for this, through metrics and measurements, is the topic of this paper. The Energy Reuse Effectiveness metric or ERE is discussed; both the development and application of the metric are looked at in detail. The use of ERE in conjunction with PUE (Power Usage Effectiveness) is also considered.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Metrics for Diagnosing Undersampling in Monte Carlo Tally Estimates

This study explored the potential of using Markov chain convergence diagnostics to predict the prevalence and magnitude of biases due to undersampling in Monte Carlo eigenvalue and flux tally estimates. Five metrics were applied to two models of pressurized water reactor fuel assemblies and their potential for identifying undersampling biases was evaluated by comparing the calculated test metrics with known biases in the tallies. Three of the five undersampling metrics showed the potential to accurately predict the behavior of undersampling biases in the responses examined in this study.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Network Metamodeling: The Effect of Correlation Metric Choice on Phylogenomic and Transcriptomic Network Topology

We explore the use of a network meta-modeling approach to compare the effects of similarity metrics used to construct biological networks on the topology of the resulting networks. This work reviews various similarity metrics for the construction of networks and various topology measures for the characterization of resulting network topology, demonstrating the use of these metrics in the construction and comparison of phylogenomic and transcriptomic networks.

Network comparison Network topology Similarity met↗

Towards New Metrics for High-Performance Computing Resilience

Ensuring the reliability of applications is becoming an increasingly important challenge as high-performance computing (HPC) systems experience an ever-growing number of faults, errors and failures. While the HPC community has made substantial progress in developing various resilience solutions, it continues to rely on platform-based metrics to quantify application resiliency improvements. The resilience of an HPC application is concerned with the reliability of the application outcome as well as the fault handling efficiency. To understand the scope of impact, effective coverage and performance efficiency of existing and emerging resilience solutions, there is a need for new metrics. In this paper, we develop new ways to quantify resilience that consider both the reliability and the performance characteristics of the solutions from the perspective of HPC applications. As HPC systems continue to evolve in terms of scale and complexity, it is expected that applications will experience various types of faults, errors and failures, which will require applications to apply multiple resilience solutions across the system stack. The proposed metrics are intended to be useful for understanding the combined impact of these solutions on an application's ability to produce correct results and to evaluate their overall impact on an application's performance in the presence of various modes of faults.

Fault Tolerance↗

Measuring Mobility Potential: NREL Researchers Develop New Metric that Quantifies Mobility Energy Productivity

Mobility is one of the fundamental aspects of human behavior, governed by factors such as time, cost, convenience, and availability of travel options. A new measurement developed by NREL researchers, called the Mobility Energy Productivity metric, provides an avenue to not only measure the quality of mobility at a specific location in its current configuration, but also to test how various technological advancements (e.g. connected and automated vehicles (CAVs), plug-in electric vehicles, shared mobility) and infrastructure investments (e.g. building an additional highway lane; constructing a new shopping mall) may impact the mobility of that location over time. A location with high quality mobility offers multiple transportation options to a diverse number of opportunities while minimizing time, cost, and energy consumption - all factors which define a high quality of life. Development of the MEP metric is a cornerstone of the U.S. Department of Energy's (DOE) SMART Mobility Laboratory Consortium. The metric will aid in developing new knowledge, insights, tools, and technology solutions about the evolving connected mobility system, thereby informing decision makers about how emerging mobility choices could impact people's lives.

30 DIRECT ENERGY CONVERSION↗

Power System Resilience Evaluation Framework and Metric Review: Preprint

Power system resilience is an emerging hot topic in recent years to study the increasing threats of extreme events such as natural disasters, severe weather, and cyberattacks. Although many research works have been done to define, model, and quantify resilience from different aspects, the lack of universally accepted resilience metrics and evaluation methods makes it difficult to assess and compare resilience across different power systems like what is typically done in power system reliability studies. In this paper, we first review the definitions of resilience and summarized two core concepts shared by most literature. On top of that, we conduct a thorough review of resilience metrics and develop a new framework to assess power system resilience from two perspectives, i.e., pre-event estimation and post-event evaluation, to capture system resilience performance in both general and specific fashions. Existing resilience metrics are summarized and categorized using the proposed framework, where recommendations are also proposed to capture core concepts of resilience.

power system resilience↗

Evolving Metrics for Resource Adequacy Assessment

Resource adequacy analysis quantifies the likelihood of capacity shortfall on a power system in a probabilistic manner. Using a combination of statistical techniques and power system fundamentals, the analysis typically evaluates hundreds or thousands of stochastic random samples (replications) of varying load, generator outages, variable renewable energy availability, and other aspects of power system uncertainty. In this range of uncertainty, there are - at times - periods where the power system's available resources are insufficient to meet system demand, referred to as a shortfall event. Today's power systems' rapidly evolving generation mix is changing the types of data needed by system planners and regulators, which can often render traditional resource adequacy metrics insufficient for ensuring resource adequacy for tomorrow's grid. In this paper we provide a critical assessment of traditional measures of shortfall risk in power systems, discussing their shortcomings and how they compare to metrics used in other domains. From this analysis we propose four steps forward for improving power system resource adequacy risk metrics in the future.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗

Defining a Metric to Assess Leachability of Contaminants from Cementitious Waste Forms in Lab Testing Related to Hanford - 20478

This paper reports on the determination of performance metrics for the release of four contaminants (technetium, iodine, nitrate, and chromium) from a theoretical supplemental low-activity waste (LAW) inventory of grout in the Hanford Integrated Disposal Facility (IDF). The performance metric was defined as a retardation factor, R, that can be used to quantify a waste form's ability to retain one contaminant compared with an un-retarded species (e.g., sodium). By setting the target R value at the magnitude required to maintain concentrations of the contaminants below the drinking water standard at the point of compliance for the IDF, a bar for grout leach performance can be established for screening laboratory leach test data. The R can be converted to a corresponding laboratory-observed diffusivity value against which to assess leach test data. The individual performance metrics were determined through an iterative set of simulations using a variable saturation and transport flow model of a grout waste form inventory in the IDF to calculate the resulting concentration-based requirements at the point of compliance. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Selecting Metrics for Sustainable Bioenergy Feedstocks

Key decisions about land-use practices and dynamics in biofuel systems affect the long-term sustainability of biofuels. Choices about what crops are grown and how are they planted, fertilized, and harvested determine the effects of biofuels on native plant diversity, competition with food crops, and water and air quality. Those decisions also affect economic viability since the distance that biofuels must be transported has a large effect on the market cost of biofuels. The components of a landscape approach include environmental and socioeconomic conditions and the bioenergy features [type of fuel, plants species, management practices (e.g., fertilizer and pesticide applications), type and location of production facilities] and ecological and biogeochemical feedbacks. Significantly, while water (availability and quality) emerges as one of the most limiting factors to sustainability of bioenergy feedstocks, the linkage between water and bioenergy choices for land use and management on medium and large scales is poorly quantified. Metrics that quantify environmental and socioeconomic changes in land use and landscape dynamics provide a way to measure and communicate the influence of alternative bioenergy choices on water quality and other components of the environment. Cultivation of switchgrass could have both positive and negative environmental effects, depending on where it is planted and what vegetation it replaces. Among the most important environmental effects are changes in the flow regimes of streams (peak storm flows, base flows during the growing season) and changes in stream water quality (sediment, nutrients, and pesticides). Unfortunately, there have been few controlled studies that provide sufficient data to evaluate the hydrological and water quality impacts of conversion to switchgrass. In particular, there is a need for experimental studies that use the small watershed approach to evaluate the effects of growing a perennial plant as a biomass crop. Small watershed studies have been used for several decades to identify effects of vegetation type, disturbance, and land use and agriculture practices on hydrology and water quality. An ideal experimental design to determine the effects of conversion to switchgrass on surface water hydrology and quality would involve (1) small catchment (5-20 ha) drained by a perennial or ephemeral stream, (2) crop treatments including conversion from row crops to switchgrass; pasture to switchgrass (other likely scenarios); controls (no change in vegetation), (3) treatments to compare different levels of fertilization and pesticide application, (4) riparian treatments to compare riparian buffers with alternative cover types, and a treatment with no buffer, and (5) 3-4 replicates of each treatment or BACI (before-after, control-intervention) design for unreplicated treatments (ideally with several years of measurements prior to the imposition of treatments for BACI design). Hydrologic measurements would include soil moisture patterns with depth and over time; nitrogen and phosphorus chemistry; soil solution chemistry - major anions and cations, inorganic and organic forms of carbon, nitrogen and phosphorus; precipitation amount and chemical deposition; stream discharge; and streamwater chemistry. These water quality metrics would need to be put into context of the other environmental and social conditions that are altered by growth of bioenergy feedstocks. These conditions include farm profits and yield of food and fuel, carbon storage and release, and a variety of ecosystem services such as enhanced biodiversity and pollinator services. Innovations in landscape design for bioenergy feedstocks take into account environmental and socioeconomic dynamics and consequences with consideration of alternative bioenergy regimes and policies. The ideal design would be scale-sensitive so that economic, social, and environmental constraints can be measured via metrics applicable at relevant scales. To develop a landscape design, land managers must consider (1) what are the environmental impacts on water and air quality, carbon sequestration, and native plants and animals and their habitats; (2) what is the appropriate spatial and temporal scales at which to examine environmental effects, and (3) how can potential tradeoffs in environmental costs and benefits be considered. Tradeoffs exist across space and time among the economic, ecological, and social consequences of alternative choices. For example, the implications of increased biofuel production from corn at a local scale may be to increase pesticide use, which could negatively affect human health. At a regional scale, nutrient flux may increase and thus degrade water quality. At the scale of the Mississippi River watershed (48% of the U.S.), production may increase the hypoxia zone in the Gulf of Mexico and cause decline of shrimp harvest in the region.

54 ENVIRONMENTAL SCIENCES↗

On the existence of certain axisymmetric interior metrics

One of the effects of noncommutative coordinate operators is that the delta function connected to the quantum mechanical amplitude between states sharp to the position operator gets smeared by a Gaussian distribution. Although this is not the full account of the effects of noncommutativity, this effect is, in particular, important as it removes the point singularities of Schwarzschild and Reissner-Nordstroem solutions. In this context, it seems to be of some importance to probe also into ringlike singularities which appear in the Kerr case. In particular, starting with an anisotropic energy-momentum tensor and a general axisymmetric ansatz of the metric together with an arbitrary mass distribution (e.g., Gaussian), we derive the full set of Einstein equations that the noncommutative geometry inspired Kerr solution should satisfy. Using these equations we prove two theorems regarding the existence of certain Kerr metrics inspired by noncommutative geometry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Simplified metrics for the identification of the Madden-Julian oscillation in models

We propose simplified metrics to evaluate the fidelity with which the Madden–Julian oscillation (MJO) is simulated in climate models. These metrics are based on lag correlation analysis of principal component time series (PCs). The PCs are obtained by projecting simulated 20–100 day bandpass filtered daily outgoing longwave radiation onto the two leading empirical orthogonal functions of observed MJO variability. The simplified MJO metrics, the maximum positive correlation and time lag at which it occurs, provide consistent information relative to more complex diagnostics developed by the Madden–Julian Oscillation Working Group (CLIVAR MJOWG) and by Kim et al.

58 GEOSCIENCES↗