Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC): A Payload Designed for Exploration of Terrestrial Planetary Bodies

Geological materials (indeed, all solid objects) are characterized by their crystal structure, elemental composition, and morphology. The Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC) instrument suite quantifies all three. These measurements address fundamental science questions (e.g., the origin and evolution of planetary bodies) and support the human exploration of space (e.g., the characterization of regolith for ISRU and the constraint of its geotechnical properties). METRIC comprises an X-ray Diffraction/X-ray Fluorescence instrument (XRD: mineral structure and XRF: elemental composition), an X-ray micro-Computed Tomography instrument (XCT: 3D internal micromorphology), and a hyperspectral imaging infrared spectrometer (IRS) to provide local/regional mineralogic context for these measurements. METRIC XRD/F draws heritage from the highly successful Mars Science Laboratory CheMin instrument. The METRIC XRD/F employs two separate sample cells, one optimized for XRD and one for XRF, resulting in more rapid XRD analysis (tens of minutes vs. tens of hours for CheMin) and an orders-of-magnitude improvement in XRF detection. XCT has not been deployed in space, so the METRIC XCT represents a new capability for solar system exploration. The XCT uses the same basic high-TRL components as METRIC XRD/F, decreasing its development cost for flight. The METRIC IRS is a derivative of the NASA Earth Science Technology Office funded Hyperspectral Thermal Imager instrument and utilizes the NASA Technology Transfer Program to incorporate a commercial-of-the-shelf infrared camera ruggedized for space by NASA Marshall Space Flight Center. The IRS spectral range (8–14 µm) and resolution (10.8 cm -1 ) are tailored to quantify mineralogy in rocks using their characteristic Reststrahlen bands and to characterize mineralogy of soils using the position of the Christensen Feature. The METRIC payload is currently designed for deployment to the Moon on a Commercial Lunar Payload Services (CLPS) mission, where the XRD/F and XCT would be located on a lander and the IRS would be on deployed on a companion rover to evaluate the mineralogical diversity of the landing site. A pneumatic drill designed by Honeybee Robotics would excavate regolith up to 50 cm below the lander and deliver multiple aliquots of regolith to the XRD/F and XCT. The METRIC payload could also be deployed on a rover. In this case, a sample handling system on a robotic arm could scoop regolith and/or drill rocks and deliver powder to the XRD/F and XCT located in the rover’s interior. Alternatively, METRIC instruments could be used singly or in combination on human space missions. The XRD/F and XCT could be used to characterize samples in a rover or in a science laboratory within a habitat. These data could help astronauts identify resource-enriched rocks and regolith and triage geologic samples to return samples of high interest for analysis in terrestrial laboratories. The IRS could be attached to a human-navigated rover to collect mineralogical data along a traverse and identify high-priority science samples.

E. B. Rampe↗

Toward Human-Centric Transportation and Energy Metrics: Influence of Mode, Vehicle Occupancy, Trip Distance, and Fuel Economy

Traditional metrics measuring transportation and energy outcomes can be augmented to better represent impacts on people's lives and systems-level performance. In this context, this study introduces two novel metrics: road capacity (as number of people traveling and accessing services) and energy intensity (as energy use for people traveling and accessing services). Current national-level distributions of available data in the United States for factors contributing to the two new integrated metrics are used as context to evaluate potential outcomes. These factors include vehicle occupancy, mode share, fuel economy, and trip distance. Variations in input values provide insights on how these factors shape efficiencies in road capacity and energy intensity. Parametric sensitivity analysis indicates that the impact of each input depends upon the metric being evaluated. For the human-centered road capacity mobility metric, increasing vehicle occupancy has the largest effect – twice that of increasing mode share for bike, walk, and transit. For the energy intensity mobility metric, the effect of improving fuel economy is the largest. However, when the focus is on accessibility (instead of mobility), for both metrics the effect of lowering average trip distance is the largest. Additionally, a novel interactive tool to visualize the results for various parameter combinations makes the metrics practitioner ready. The findings suggest that the diffusion of new human-centric metrics that benchmark outcomes associated with road capacity and energy may be significant in motivating new sustainable transportation investments and efficient utilization of infrastructure, mobility assets, and services.

ADVANCED PROPULSION SYSTEMS↗

Review of Noise Metric Sensitivities for Analysis of Quiet Supersonic Overflight

Six different noise metrics (PL, ASEL, BSEL, DSEL, ESEL, and ISBAP) are currently used to quantify sonic boom levels from overflight of supersonic aircraft. A previous meta-analysis using laboratory subjective data identified these metrics, each of which correlated well with human perception of low-boom sounds both indoors and outdoors. Because the analysis did not identify a single metric that was significantly superior, no internationally agreed-upon metric has been chosen for the quiet supersonic aircraft noise certification procedures currently under development. Other analyses of metric sensitivities using existing empirical and simulation datasets, however, have shown significant differences between metrics. Variability of metrics due to macro-atmospheric effects and atmospheric turbulence perturbations have been explored, as well as variability in measurements due to microphone setup configurations, array layouts, and ambient noise effects. This paper reviews these prior studies, summarizes the current understanding of metric sensitivities, and discusses how they may impact future downselection of metrics for certification procedures.

sonic boom↗

Competitiveness Metrics for Electricity System Technologies

The relative economic competitiveness of power generation technologies is a topic of much interest to diverse electric industry participants. However, assessing competitiveness can be challenging as it requires considering both total costs and total system value of each technology, which are complicated by the (1) numerous and diverse grid services needed to operate a reliable power system; (2) variations in the economic value of the grid services with system state and location, and over multiple timescales, due to the challenges of transporting and storing electricity; and (3) the unique characteristics of different electric system assets. Ideally, metrics designed or used to convey technology competitiveness must consider these complexities, but existing metrics often fall short. For example, the levelized cost of energy does not consider the system economic value of the various technologies nor does it consider services beyond electricity production. Various other metrics have been designed with the purpose of more-accurately communicating the economic viability of electric system technologies. In this report, we summarize the primary sources and components of costs and value and review the known competitiveness metrics by presenting their definitions, applications, advantages, and disadvantages. We also introduce a new set of competitiveness metrics, which we refer to as System Profitability metrics, that more-directly applies the economic principles of return-on-investment to electric system technologies. We use conceptual examples to show how the System Profitability metrics better reflect economic viability and relative technology competitiveness compared with existing metrics. We also describe how competitiveness metrics can be quantified using optimization-based models and demonstrate this capability using a U.S. electric sector capacity expansion model.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Metric Type in the Target-matrix Mesh Optimization Paradigm

The Target Matrix Optimization Paradigm (TMOP) is a method for improving the accuracy, efficiency, and robustness of numerical solutions to partial differential equations by improving the geometric quality of the computational mesh, primarily through node movement. TMOP has been successfully applied to a number applications even though the paradigm was not fully understood at the time. With this work, TMOP can be seen to be a tightly woven fabric of interconnecting ideas and concepts that provides a powerful approach to mesh optimization. The central unifying concepts in TMOP are the concept of a Target Matrix and the concept of Metric Type. Target matrices are motivated by the desire to make mesh quality improvement application-specific and, when needed, solution-adaptive. Metric type plays an essential role because it provides, through the use of typed metrics, the bridge between application-specific quality and target construction. It is shown that there are eight theoretical metric types, including the shape and shape+size types used informally in the past. It is shown further that there exist well-posed metrics corresponding to six of the eight metric types. A well-posed metric is a metric that is typed and convex, polyconvex, or invex, and further, it is a metric that simplifies target construction.

97 MATHEMATICS AND COMPUTING↗

Semantic Metrics for Object Oriented Design

The purpose of this proposal is to research a new suite of object-oriented (OO) software metrics, called semantic metrics, that have the potential to help software engineers identify fragile, low quality code sections much earlier in the development cycle than is possible with traditional OO metrics. With earlier and better Fault detection, software maintenance will be less time consuming and expensive, and software reusability will be improved. Because it is less costly to correct faults found earlier than to correct faults found later in the software lifecycle, the overall cost of software development will be reduced. Semantic metrics can be derived from the knowledge base of a program understanding system. A program understanding system is designed to understand a software module. Once understanding is complete, the knowledge-base contains digested information about the software module. Various semantic metrics can be collected on the knowledge base. This new kind of metric measures domain complexity, or the relationship of the software to its application domain, rather than implementation complexity, which is what traditional software metrics measure. A semantic metric will thus map much more closely to qualities humans are interested in, such as cohesion and maintainability, than is possible using traditional metrics, that are calculated using only syntactic aspects of software.

Etzkorn, Lethe↗

NASA EOSDIS Data Usage Metrics- Insight and Assessment

NASA's Earth Science Data and Information System (ESDIS) Project collects Earth science data usage metrics on a daily basis through the ESDIS Metrics System (EMS). This includes metrics on distribution of data products, users, data volumes, and number of files, which are key parameters in evaluating system-level performance of any of the Distributed Active Archive Centers (DAACs) encompassed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS). EOSDIS data usage metrics illustrate the benefits of making NASA data openly available to the public and show a rapid growth in data distribution to a worldwide user community. In fact, each year since 2014 the EOSDIS has distributed over one billion data files of products from EOS satellite, airborne, and in situ observations. An assessment of the long-term trends of data usage metrics and user characterization provides insights into data usability.This study will focus on describing the EMS as a metrics collection tool and will provide a comprehensive analysis of EOSDIS data usage metrics over the last 10 years. This study will also characterize the product distribution metrics by various tools and services, such as Giovanni, the Open-source Project for a Network Data Access Protocol (OPeNDAP), and subsets, to address how these tools/services have extended the usage of data in the EOSDIS collection. Data usage patterns based on discipline and study area will further assist in understanding how EOSDIS data user needs have evolved over time. Results from this study will provide useful information for the DAACs that can help them improve the functionality of their tools and services as well as more efficiently allocate the resources necessary for enhanced access and availability of their data products. Knowledge of these metrics may also benefit user discovery of data in the EOSDIS collection, promote research collaboration, and stimulate new ideas from work and research conducted using specific datasets and data collections.

Kafle, Durga N.↗

Integrated Analysis of Multiple User Metrics - A “Sequel”; and Introducing the Google Analytic

For decades, the Goddard Earth Sciences Data and Information Services Center (GES DISC) has archived and distributed enormous volumes of NASA Earth science data (accompanied with many developed tools and services) to various research/applications communities and the general public. Being “immersed” in the Big Data era, we have inevitably faced the challenges of our continually increasing archived data in both volume and variety, as well as enhanced user needs and demands. In recent years, we have actively analyzed different types of user metrics, such as operational distribution metrics (recording numbers of distinct users and downloaded data files, size of distributed data volume): user publication metrics (mining info from our Giovanni users’ publications): and Bugzilla metrics (collecting info from user questions or feedback from user assistance tickets). Such metrics have helped us achieve a better understanding of user needs, demands, characteristics, and behaviors, which has then helped us improve our user services. Now we will present a “Sequel” of integrated analysis of multiple metrics at the GES DISC by introducing and adding one new kind of metrics acquired via utilizing our recently implemented Google Analytic 360 suite. Several “newer” reports, e.g., “What web site features and links are the most popular (and least)?” and “What are the top 25 dataset Keyword searches?” retrieved from this new metrics set will be presented, along with the aforementioned “traditional” metrics results.

Shie, Chung-Lin↗

A biology-informed similarity metric for simulated patches of human cell membrane

Complex scientific inquiries rely increasingly upon large and autonomous multiscale simulation campaigns, which fundamentally require similarity metrics to quantify ‘sufficient’ changes among data and/or configurations. However, subject matter experts are often unable to articulate similarity precisely or in terms of well-formulated definitions, especially when new hypotheses are to be explored, making it challenging to design a meaningful metric. Furthermore, the key to practical usefulness of such metrics to enable autonomous simulations lies in in situ inference, which requires generalization to possibly substantial distributional shifts in unseen, future data. Here, we address these challenges in a cancer biology application and develop a meaningful similarity metric for ‘patches’—regions of simulated human cell membrane that express interactions between certain proteins of interest and relevant lipids. In the absence of well-defined conditions for similarity, we leverage several biology-informed notions about data and the underlying simulations to impose inductive biases on our metric learning framework, resulting in a suitable similarity metric that also generalizes well to significant distributional shifts encountered during the deployment. We combine these intuitions to organize the learned embedding space in a multiscale manner, which makes the metric robust to incomplete and even contradictory intuitions. Our approach delivers a metric that not only performs well on the conditions used for its development and other relevant criteria, but also learns key spatiotemporal relationships without ever being exposed to any such information during training.

97 MATHEMATICS AND COMPUTING↗

Metrics as tools for bridging climate science and applications

In climate science and applications, the term “metric” is used to describe the distillation of complex, multifaceted evaluations to summarize the overall quality of a model simulation, or other data product, and/or as a means to quantify some response to climate change. Metrics provide insights into the fidelity of processes and outcomes from climate models and can assist with both differentiating models' representation of variables or processes and informing whether models are “fit for purpose.” Metrics can also provide a valuable reference point for co-production of knowledge between climate scientists and climate impact practitioners. Although continued metric developments enable model developers to better understand the impacts of decisions made in the model design process, metrics also have implications for the characterization of uncertainty and facilitating analyses of underlying physical processes. As a result, comprehensive evaluation with multiple metrics enhances usability of climate information by both scientific and stakeholder communities. Here, this paper presents examples of insights gained from the development and appropriate use of metrics, and provides examples of how metrics can be used to engage with stakeholders and inform decision-making.

54 ENVIRONMENTAL SCIENCES↗

Estimating Sonic Boom Metrics Across a Community Using a Kalman Filter

As part of the Quesst mission, NASA will fly the X‑59 aircraft over selected communities to evaluate community responses to low-intensity sonic booms. The purpose of these community tests is to determine the dose-response relationship between the noise exposure metrics and the community response. The independent variables for the dose-response relationship are the noise exposure metrics experienced by survey respondents within the community. Two sources of noise exposure metrics are available in each community: measurements at sparse locations throughout the community, and calculations from propagation models across the community. Both the measurements and calculations are subject to uncertainty. A Kalman filter is proposed to combine the measured and calculated noise exposure metrics to obtain the best estimate of the true noise exposure metrics across the community. The noise exposure metrics estimated by the Kalman filter have lower uncertainty than either the measured or calculated noise exposure metrics alone. Simulations demonstrate that the Kalman filter produces a more accurate estimate of the true noise exposure metrics than other noise estimation methods.

Sonic boom↗

A spectral metric for collider geometry

By quantifying the distance between two collider events, one can triangulate a metric space and reframe collider data analysis as computational geometry. One popular geometric approach is to first represent events as an energy flow on an idealized celestial sphere and then define the metric in terms of optimal transport in two dimensions. In this paper, we advocate for representing events in terms of a spectral function that encodes pairwise particle angles and products of particle energies, which enables a metric distance defined in terms of one-dimensional optimal transport. This approach has the advantage of automatically incorporating obvious isometries of the data, like rotations about the colliding beam axis. It also facilitates first-principles calculations, since there are simple closed-form expressions for optimal transport in one dimension. Up to isometries and event sets of measure zero, the spectral representation is unique, so the metric on the space of spectral functions is a metric on the space of events. At lowest order in perturbation theory in electron-positron collisions, our metric is simply the summed squared invariant masses of the two event hemispheres. Going to higher orders, we present predictions for the distribution of metric distances between jets in fixed-order and resummed perturbation theory as well as in parton-shower generators. Finally, we speculate on whether the spectral approach could furnish a useful metric on the space of quantum field theories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Are light curve classification metrics good proxies for SN Ia cosmological constraining power?

Context. When selecting a light curve classifier for use as part of a photometric supernova Ia (SN Ia) cosmological analysis, it is common to make decisions based on metrics of classification performance, such as the contamination within the photometrically classified SN Ia sample, rather than a measure of cosmological constraining power. If the former is an appropriate proxy for the latter, this practice would eliminate the computational expense of a full cosmology forecast in the analysis pipeline design process. Aims. This study tests the assumption that light curve classification metrics are an appropriate proxy for cosmology metrics. Methods. We emulated photometric SN Ia cosmology light curve samples with controlled contamination rates of individual contaminant classes and evaluated each of them under a set of classification metrics. We then derived cosmological parameter constraints from all samples under two common analysis approaches and quantified the impact of contamination by each contaminant class on the resulting cosmological parameter estimates. Results. We observe that cosmology metrics are sensitive to both the contamination rate and the class of the contaminating population, whereas the classification metrics are shown to be insensitive to the latter. Conclusions. Based on these findings, we discourage any exclusive reliance on light curve classification-based metrics for analysis design decisions, which (counterintuitively) include but are not limited to the classifier choice. Instead, we recommend optimising science analysis pipeline design choices using a metric of the information gained about the physical parameters of interest.

79 ASTRONOMY AND ASTROPHYSICS↗

The Making of a Metric: Co-Producing Decision-Relevant Climate Science

Developing decision-relevant science for adaptation requires the identification of climatic parameters that are both actionable for practitioners as well as tractable for modelers. In many sectors, these decision-relevant climatic metrics and the approaches that enable their identification remain largely unknown. “Co-production” of science with scientists and decision-makers is one potential way to identify these metrics, but there is little research describing specific and successful co-production approaches. This paper examines the negotiations and outcomes from Project Hyperion, wherein scientists and water managers jointly developed decision-relevant climatic metrics for adaptive water management. We identify successful co-production strategies by analyzing the project’s numerous back-and-forth engagements and tracing the evolution of the science during these engagements. We found that effective mediation between scientists and managers needed dedicated “boundary spanners” with significant modeling expertise. Translating practitioners’ information needs into tractable climatic metrics required direct and indirect methods of eliciting knowledge. We identified four indirect methods that were particularly salient for extracting tacitly held knowledge and enabling shared learning: developing a hierarchical framework linking management issues with metrics, starting discussions from the planning challenges, collaboratively exploring the planning relevance of new scientific capabilities, and using analogies of other “good” metrics. The decision-relevant metrics we developed provide insights into advancing adaptation-relevant climate science in the water sector. The co-production strategies we identified can be used to design and implement productive scientist–decision-maker interactions. Overall, the approaches and metrics we developed can help climate science to expand in new and more use-inspired directions.

Planning↗

Advanced Life Support System Value Metric

The NASA Advanced Life Support (ALS) Program is required to provide a performance metric to measure its progress in system development. Extensive discussions within the ALS program have led to the following approach. The Equivalent System Mass (ESM) metric has been traditionally used and provides a good summary of the weight, size, and power cost factors of space life support equipment. But ESM assumes that all the systems being traded off exactly meet a fixed performance requirement, so that the value and benefit (readiness, performance, safety, etc.) of all the different systems designs are considered to be exactly equal. This is too simplistic. Actual system design concepts are selected using many cost and benefit factors and the system specification is defined after many trade-offs. The ALS program needs a multi-parameter metric including both the ESM and a System Value Metric (SVM). The SVM would include safety, maintainability, reliability, performance, use of cross cutting technology, and commercialization potential. Another major factor in system selection is technology readiness level (TRL), a familiar metric in ALS. The overall ALS system metric that is suggested is a benefit/cost ratio, SVM/[ESM + function (TRL)], with appropriate weighting and scaling. The total value is given by SVM. Cost is represented by higher ESM and lower TRL. The paper provides a detailed description and example application of a suggested System Value Metric and an overall ALS system metric.

Jones, Harry W.↗

A Complexity Metric for Automated Separation

A metric is proposed to characterize airspace complexity with respect to an automated separation assurance function. The Maneuver Option metric is a function of the number of conflict-free trajectory change options the automated separation assurance function is able to identify for each aircraft in the airspace at a given time. By aggregating the metric for all aircraft in a region of airspace, a measure of the instantaneous complexity of the airspace is produced. A six-hour simulation of Fort Worth Center air traffic was conducted to assess the metric. Results showed aircraft were twice as likely to be constrained in the vertical dimension than the horizontal one. By application of this metric, situations found to be most complex were those where level overflights and descending arrivals passed through or merged into an arrival stream. The metric identified high complexity regions that correlate well with current air traffic control operations. The Maneuver Option metric did not correlate with traffic count alone, a result consistent with complexity metrics for human-controlled airspace.

Aweiss, Arwa↗

Comparison of Several Global Mixing Performance Metrics for High-Speed Fuel Injectors

To experimentally assess and compare the mixing performance of high-speed fuel injectors for scramjet engines, quantitative global metrics are needed. The one-dimensional metric most commonly used to assess the degree of mixing completeness at a given downstream station is the mixing efficiency parameter. The experimental determination of the mixing efficiency parameter requires measurement of the spatial distributions of both the fuel mass fraction and the mass flux. Standard in-stream gas sampling techniques can be used to measure the fuel mass fraction distribution, however the mass flux distribution is not easily determined experimentally because it requires the measurement of three independent aerothermodynamic variables in addition to the mixture composition. For this reason, several metrics that can be calculated from the fuel distribution alone are commonly used to assess mixing performance. Because these other metrics do not provide a mass flux-weighted measure of the local degree of mixing completeness, they may not correlate well with the mixing efficiency parameter. Therefore, if the substitute metrics are to be used to compare the mixing performance of candidate fuel injector concepts, it is important to understand their relationships to the mixing efficiency parameter in a representative scramjet combustor flowfield. This work investigates the relationships between the mixing efficiency parameter and several substitute metrics that are able to be measured with the current experimental setup of the Enhanced Injection and Mixing Project at the NASA Langley Research Center for baseline strut and ramp injectors. The results of these comparisons have revealed that it is possible to glean different (i.e., incorrect) conclusions about which injector is the better mixer when the substitute mixing performance metrics are used instead of the mixing efficiency parameter, thereby highlighting the importance of mass flux-weighted mixing performance metrics.

Ground, Cody R.↗

Minimal-Area Metrics on the Swiss Cross and Punctured Torus

The closed string theory minimal-area problem asks for the conformal metric of least area on a Riemann surface with the condition that all non-contractible closed curves have length greater than or equal to an arbitrary constant that can be set to one. Through every point in such a metric there is a geodesic that saturates the length condition, and the saturating geodesics in a given homotopy class form a band. The extremal metric is unknown when bands of geodesics cross, as it happens for surfaces of non-zero genus. Here, we use recently proposed convex programs to numerically find the minimal-area metric on the square torus with a square boundary, for various sizes of the boundary. For large enough boundary the problem is equivalent to the “Swiss cross” challenge posed by Strebel. We find that the metric is positively curved in the two-band region and flat in the single-band regions. For small boundary the metric develops a third band of geodesics wrapping around it, and has both regions of positive and of negative curvature. This surface can be completed to provide the minimal-area metric on a once-punctured torus, representing a closed-string tadpole diagram.

97 MATHEMATICS AND COMPUTING↗