Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

The Next Stage for Smart Cities: Metrics to Spur an Evolution from Technology for Efficiency to Technology for People's Needs

The Smart Cities movement is about a decade old, energized by the USDOT Smart Cities grant that sparked cities to dream big. Now, 10 years later, and multitudes of conferences and papers later, the biggest question regarding Smart Cities is whether any progress has been made? Smart Cities forums are typically led by the technology sector, either telecommunications, internet access, or most recently artificial intelligence (AI) concerns. Each of these areas have grown and found new applications in the context of Smart Cities, however, these technology applications are just tools toward ends. Do digital communications and assistance enable or foster improved access to real, tactile, non-virtual goods and services such as transportation, food, housing, trash removal, health care, education, social interaction? These and other topics are not 'big tech', but are each critical to quality of life outcomes and are day-to-day necessities, comprising many of the touch points through which citizens interact with municipal agencies. Regarding Smart Cities, relationships have not been fully refined as to how best to merge the emerging generation of technology and related trends with more mundane but essential requirements of tactile services. How should municipal managers and operators bring the range of new technology tools (e.g. on-demand transit, automated vehicles, digital connectivity) to bear to improve functions serving real- physical- non-virtual needs? How do we make cities more efficient in providing access to services and opportunities for improved quality of life? This paper examines the current Smart City movement, emerging trends, and the need to put metrics with respect to the delivery, access, and provision of real-life needs. Using a few case studies of past, present, and projected future scenarios, this paper attempts to bring Smart Cities into the real cities domain, perhaps pushing the moniker away from 'Smart' to 'Efficient' - something that can be measured, counted, and assessed. Through the consideration of the next stage of the evolution of cities from 'Smart' to 'Efficient', the combined efforts and experience of multiple researchers at the NREL and their network of collaborators highlights the need for updates metrics that can be used to start guiding efforts toward productive initiatives to improve quality of life.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Metrics for in-space telescope assembly techniques

Reliable metrics are not yet available for choosing among human and robotic assets for space-based construction and servicing of large space telescopes. Using FAIR-DART as a reference design, we generated example event sequences for telescope assembly scenarios in enough detail to identify infrastructure assumptions and technology requirements. A systems trade among human and robotic techniques (human EVA, on-site telerobotic, ground-in-the- loop robotic, commanded or sequenced robotic, and autonomous/decision-making robotic) helped us to define key metrics in the human-robotic trade space, including quality, time, cost, and risk. Our methodology included examining representative end-member scenarios. Case A treated each step in the assembly sequence as if all other steps have no on-site human involvement, and Case B treated each step as if human EVA is already involved in all other steps. With this trade, we identified key enabling technologies and infrastructure for space-based assembly and servicing of large space telescopes.

space telescopes human and robotic in-space assemb↗

User Metrics in NASA Earth Science Data Systems

This presentation the collection and use of user metrics in NASA's Earth Science data systems. A variety of collection methods is discussed, with particular emphasis given to the American Customer Satisfaction Index (ASCI). User sentiment on potential use of cloud computing is presented, with generally positive responses. The presentation also discusses various forms of automatically collected metrics, including an example of the relative usage of different functions within the Giovanni analysis system.

user metrics↗

Learning from GES DISC's MLS and OMI Data Users: Metrics Matter

It has been over 15 years since Aura research satellite launched in 2004 to observe the Earth's ozone layer, air quality, and climate from four different instruments - the High Resolution Dynamics Limb Sounder (HIRDLS), the Microwave Limb Sounder (MLS), the Ozone Monitoring Instrument (OMI), and the Tropospheric Emission Spectrometer (TES). Observations from the Aura mission have established a concrete understanding of the changing chemistry of our atmosphere.The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the official archive and distribution center for the HIRDLS, MLS, and OMI instruments. This presentation will report metrics of data usage and services on these instruments. Key to GES DISC's mission to provide better data support is gaining a better understanding of our users' needs and behaviors as they discover, access and utilize these data. We will summarize the users' needs from these instruments based on user inquiry information collected over the Aura mission lifetime and present findings from this ensemble metrics.

Metrics↗

Urban Air Mobility Airspace Dynamic Density Safety Metric

NASA’s Advanced Air Mobility (AAM) project focuses on enabling emerging aviation markets by accelerating development of safe, high-volume flight operations.[1] It involves development and validation of vehicles, airspace, and automation changes required to support concepts such as Urban Air Mobility, a vision for electric or hybrid electric, vertical or short take-off and landing vehicles that can transport passengers and cargo over an urban environment.[2] NASA’s System Wide Safety (SWS) project is coordinating with AAM by understanding how safety could be affected by these emerging operations. We approach the assessment of airspace safety by identifying threats to operations and then monitoring and predicting the evolution of those threats encoded in a set of safety metrics.[3] Toward this end, we have been developing a dynamic density metric to predict the likelihood of vehicle conflicts in the airspace.

Dynamic Density↗

Candidate Performance Metrics for Generalized Control for Autonomous Flight

Contingency management is the most challenging aspect of autonomous flight. In order to accommodate the most flexible response to unpredicted events and unexpected circumstances, i.e. contingencies, a new integrated path planning, trajectory following, flight control architecture is required that would maximize the safe operating envelope. For this highly integrated generalized control architecture, a new set of performance metrics that extends beyond traditional stability and performance is required. This paper proposes a candidate set of new performance metrics relevant to urban air mobility mission scenarios.

Control metrics↗

Candidate Performance Metrics for Generalized Control for Autonomous Flight

Contingency management is the most challenging aspect of autonomous flight. In order to accommodate the most flexible response to unpredicted events and unexpected circumstances, i.e. contingencies, a new integrated path planning, trajectory following, flight control architecture is required that would maximize the safe operating envelope. For this highly integrated generalized control architecture, a new set of performance metrics that extends beyond traditional stability and performance is required. This paper proposes a candidate set of new performance metrics relevant to urban air mobility mission scenarios.

Control metrics↗

Equitable Employment Access Assessed Through the Mobility Energy Productivity (MEP) Metric

This paper examines commuting options for an underserved neighborhood in Columbus, Ohio to a major employment center. The analysis is based on an emerging metric called the Mobility Energy Productivity (MEP) metric developed by the National Renewable Energy Laboratory (NREL) on behalf the Department of Energy (DOE). The purpose of the analysis is twofold. The first is to quantify relative attractiveness of commute modes between the two locations, using a perspective that includes travel time, energy and cost, while providing an equity lens to compare commute options between privately owned vehicles and pooled transportation options. The second objective is to apply MEP in a specific origin-destination (O-D) scenario, whereas previously it has been used primarily as an aggregate metropolitan-wide statistical measure. In so doing, parameters in MEP are further customized and the methodology is refined to account for unique aspects of this case study. Four commute options between the neighborhood and the industry employment based are analyzed: drive alone option, public transit express bus (historical), public transit normal route (current), and a proposed shuttle specific to the O-D pair. This analysis identified issues applying MEP that required further customization: (1) deprecation functions customized to modes other than driving, (2) accounting for first-mile last-mile travel times with transit, (3) accounting for transit frequency without resorting to full simulation. The results provide quantitative insights on the employment accessibility between these two locations, both across modes, and as equity of job accessibility for those who can and cannot operate a personal vehicle.

ADVANCED PROPULSION SYSTEMS↗

Developing Metrics to Assess Justice and Equity Implications of Early-Stage Research

Physics is a central component of early-stage research and development of virtually all technologies. But as much as scientific breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in devices for countless applications, early-stage choices research choices, such as those around materials or processing, can also serve to lock in long-term social and equity impacts of deployed technologies. This talk will explore how scientists can start to consider these impacts, with a focus on the energy sector and achieving a just and sustainable energy transition. We discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of justice considerations into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy equity↗

Developing and Evaluating Energy Justice Metrics for Early-Stage Materials Research

Materials science is a central component of early-stage research and development of virtually all clean energy technologies. But as much as material breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in eventual devices, early-stage choices about material types, structures, and processing can also serve to lock in long-term social and equity impacts of deployed energy technologies. Thus, to achieve a just and sustainable energy transition, tools to assess the energy justice impacts of early-stage materials research are critical. Here, we discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess energy justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of energy justice into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy justice↗

Environmental Metrics of Ethanol Production Improve with Increased Biomass Yield and Carbohydrate Content in Populus Trichocarpa

When selecting economically and environmentally advantageous genotypes for domestication in a biofuel supply chain, variability of cell-wall composition within a feedstock population and its impact on biorefinery metrics must be understood. We performed a life cycle assessment (LCA) on a poplar-to-ethanol supply chain to quantify global warming potential and cumulative energy demand as affected by variable carbohydrate content in a large representative natural variant population of Populus trichocarpa. The results showed that both environmental metrics decrease with increasing tree size and with increasing biomass carbohydrate content. These trends parallel prior economic results and provide clear direction to breeders or genetic engineers when improving poplar cultivars.

09 BIOMASS FUELS↗

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗

Regional patterns in hydrologic response, a new three-component metric for hydrograph analysis and implications for ecohydrology, Northwest Volcanic Aquifer Study Area, USA

Spatial patterns of hydrologic response were examined for the Northwest Volcanic Aquifer Study Area (NVASA). The utility of established hydrograph-separation methods for assessing hydrologic response in permeable volcanic terranes was assessed and a new three-component metric for hydrograph analysis was developed. The new metric, which partitions streamflow into subcomponents defined by the timescales of hydrologic response (e.g., fast-runoff, intermediate-interflow and slow-baseflow), was used to gain a fundamental understanding of the regional hydrology, investigate sub-regional differences, influencing factors, and ecohydrological implications. The combined effects of NVASA’s physiography, climate and geology create a strongly coupled surface-groundwater system that produces copious baseflow and limited quantities of runoff and interflow. Patterns of hydrologic response are influenced by the type and rate of precipitation and permeability of the underlying geology. Under variable precipitation conditions the hydrologic response of volcanic terranes with similar permeability and subsurface-storage capacity can be significantly different. From a water management and ecohydrology perspective, understanding regional patterns of hydrologic response and sub-regional differences is fundamental. Results indicate that minimum-flow methods provide the most conservative estimate of baseflow and may be the most robust for filtering out snowmelt bias in baseflow estimates. Baseflow contributes ~75% of the perennial streamflow across the NVASA and represents a critical component of the regional water supply that provides critical cold-water habitat.

54 ENVIRONMENTAL SCIENCES↗

Establishing metrics to quantify spatial similarity in spherical and red blood cell distributions

As computational power increases and systems with millions of red blood cells can be simulated, it is important to note that varying spatial distributions of cells may affect simulation outcomes. Since a single simulation may not represent the ensemble behavior, many different configurations may need to be sampled to adequately assess the entire collection of potential cell arrangements. In order to determine both the number of distributions needed and which ones to run, we must first establish methods to identify well-generated, randomly placed cell distributions and to quantify distinct cell configurations. We utilize metrics to assess (1) the presence of any underlying structure to the initial cell distribution and (2) similarity between cell configurations. We propose the use of the radial distribution function to identify long-range structure in a cell configuration and apply it to a randomly distributed and structured set of red blood cells. To quantify spatial similarity between two configurations, we make use of the Jaccard index, and characterize sets of red blood cell and sphere initializations. As an extension to our work submitted to the International Conference on Computational Science, we significantly increase our data set size from 72 to 1048 cells, include a similar set of studies using spheres, compare the effects of varying sphere size, and utilize the Jaccard index distribution to probe sets of extremely similar configurations. Our results show that the radial distribution function can be used as a metric to determine long-range structure in both distributions of spheres and RBCs. We determine that the ideal case of spheres within a cube versus bi-concave shaped cells within a cylinder affects the shape of the Jaccard index distributions, as well as the range of Jaccard values, showing that both the shape of particle and the domain may play a role. Furthermore, we also find that the distribution is able to capture very similar configurations through Jaccard index values greater than 95% when appending several nearly identical configurations into the data set.

59 BASIC BIOLOGICAL SCIENCES↗

Multiple Metrics Informed Projections of Future Precipitation in China

Predicting how regional precipitation will respond to future warming is among the most challenging undertaking in climate change projection. Despite sustained efforts to improve modeling and understanding of precipitation, the overall uncertainty in projecting regional precipitation has not been reduced substantially. In this work, the potential for more robust precipitation projections is demonstrated through the use of discriminating metrics to subsample the multimodel ensemble. Using a two-dimensional metric of precipitation and its relationship with large-scale circulation indices in East Asia, 31 models in the Coupled Model Intercomparison Project Phase 5 (CMIP5) are classified into three groups. Models in the top performing group projected statistically significant increasing trends in precipitation and the regional precipitation patterns are more similar to each other than to the patterns in the bottom performing group. In contrast, models in the bottom performing group projected diverse responses, with overall small drying or no significant trends in precipitation.

54 ENVIRONMENTAL SCIENCES↗

Electrochemical metrics for corrosion resistant alloys

Abstract Corrosion is an electrochemical phenomenon. It can occur via different modes of attack, each having its own mechanisms, and therefore there are multiple metrics for evaluating corrosion resistance. In corrosion resistant alloys (CRAs), the rate of localized corrosion can exceed that of uniform corrosion by orders of magnitude. Therefore, instead of uniform corrosion rate, more complex electrochemical parameters are required to capture the salient features of corrosion phenomena. Here, we collect a database with an emphasis on metrics related to localized corrosion. The six sections of the database include data on various metal alloys with measurements of (1) pitting potential, E pit , (2) repassivation potential, E rp , (3) crevice corrosion potential, E crev , (4) pitting temperature, T pit , (5) crevice corrosion temperature, T crev , and (6) corrosion potential, E corr , corrosion current density, i corr , passivation current density, i pass , and corrosion rate. The experimental data were collected from 85 publications and include Al- and Fe-based alloys, high entropy alloys (HEAs), and a Ni-Cr-Mo ternary system. This dataset could be used in the design of highly corrosion resistant alloys.

36 MATERIALS SCIENCE↗

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗