Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Evaluating Core Quality for a Mars Sample Return Mission

Sample return missions, including the proposed Mars Sample Return (MSR) mission, propose to collect core samples from scientifically valuable sites on Mars. These core samples would undergo extreme forces during the drilling process, and during the reentry process if the EEV (Earth Entry Vehicle) performed a hard landing on Earth. Because of the foreseen damage to the stratigraphy of the cores, it is important to evaluate each core for rock quality. However, because no core sample return mission has yet been conducted to another planetary body, it remains unclear as to how to assess the cores for rock quality. In this report, we describe the development of a metric designed to quantitatively assess the mechanical quality of any rock cores returned from Mars (or other planetary bodies). We report on the process by which we tested the metric on core samples of Mars analogue materials, and the effectiveness of the core assessment metric (CAM) in assessing rock core quality before and after the cores were subjected to shocking (g forces representative of an EEV landing).

Mars samples↗
NASA NTRS2010

Normalized Point Source Sensitivity for Off-Axis Optical Performance Evaluation of the Thirty Meter Telescope

The Normalized Point Source Sensitivity (PSSN) has previously been defined and analyzed as an On-Axis seeing-limited telescope performance metric. In this paper, we expand the scope of the PSSN definition to include Off-Axis field of view (FoV) points and apply this generalized metric for performance evaluation of the Thirty Meter Telescope (TMT). We first propose various possible choices for the PSSN definition and select one as our baseline. We show that our baseline metric has useful properties including the multiplicative feature even when considering Off-Axis FoV points, which has proven to be useful for optimizing the telescope error budget. Various TMT optical errors are considered for the performance evaluation including segment alignment and phasing, segment surface figures, temperature, and gravity, whose On-Axis PSSN values have previously been published by our group.

optical performance metric↗
NASA NTRS2018

Remote Sensing of Evapotranspiration over the Central Arizona Irrigation and Drainage District, USA

Knowledge of baseline water use for irrigated crops in the U.S. Southwest is important for understanding how much water is consumed under normal farm management and to help manage scarce resources. Remote sensing of evapotranspiration (ET) is an effective way to gain that knowledge: multispectral data can provide synoptic and time-repetitive estimates of crop-specific water use, and could be especially useful for this arid region because of dominantly clear skies and minimal precipitation. Although multiple remote sensing ET approaches have been developed and tested, there is not consensus on which of them should be preferred because there are still few intercomparison studies within this environment. To help build the experience needed to gain consensus, a remote sensing study using three ET models was conducted over the Central Arizona Irrigation and Drainage District (CAIDD). Aggregated ET was assessed for 137 wheat plots (winter/spring crop), 183 cotton plots (summer crop), and 225 alfalfa plots (year-round). The employed models were the Satellite-Based Energy Balance for Mapping Evapotranspiration with Internalized Calibration (METRIC), the Two Source Energy Balance (TSEB), and Vegetation Index ET for the US Southwest (VISW). Remote sensing data were principally Landsat 5, supplemented by Landsat 7, MODIS Terra, MODIS Aqua, and ASTER. Using district-wide model averages, seasonal use (excluding surface evaporation) was 742 mm (millimeters) for wheat, 983 mm for cotton, and 1427 mm for alfalfa. All three models produced similar daily ET for wheat, with 6-8 mm per day mid-season. Model estimates diverged for cotton and alfalfa sites. Considering ET over cotton, TSEB estimates were 9.5 mm per day, METRIC 6 mm per day, and VISW 8 mm per day. For alfalfa, the ET values from TSEB were 8.0 mm per day, METRIC 5 mm per day, and VISW 6 mm per day. Lack of local validation information unfortunately made it impossible to rank model performance. However, by averaging results from all of them, ET model outliers could be identified. They ranged from minus 10 percent to plus 18 percent, values that represent expected ET modeling discrepancies. Relative to the model average, standardized ET-estimators - potential ET (ET (sub 0)), FAO-56 ET, and USDA-SW gravimetric-ET - showed still greater deviations, up to 35 percent of annual crop water use for summer and year-round crops, suggesting that remote sensing of actual ET could lead to significantly improved estimates of crop water use. Results from this study highlight the need for conducting multi-model experiments during summer-months over sites with independent ground validation.

Alfalfa↗
NASA NTRSDate not supplied

A Data Analysis Approach for Simulations of Urban Air Mobility Operations

For the Urban Air Mobility (UAM) industry, NASA has defined a series of UAM Maturity Levels (UML) corresponding to increasingly more complex and operationally dense UAM operations. In support of the gradual progression towards higher UML levels, NASA is currently conducting a set of UAM air traffic simulations—collectively referred to as X4. This paper describes a set of system effectiveness measures, and their associated metrics, for data analysis of X4 simulations. The descriptions, rationales, and calculation procedures for two metrics to be used in data analysis of simulation results, the number of predicted demand-capacity imbalances and the pre-departure delays, are described. Results from data analysis of one set of simulation runs are presented to demonstrate how these metrics support the assessment of performance of the system architecture for X4 simulations and the verification of experiment requirements.

Urban Air Mobility↗
NASA NTRSDate not supplied

A Data Analysis and Simulation Study of Urban Air Mobility

For the Urban Air Mobility (UAM) industry, NASA has defined a series of UAM Maturity Levels (UML) corresponding to increasingly more complex and operationally dense UAM operations. In support of the gradual progression towards higher UML levels, NASA is currently conducting a set of UAM air traffic simulations—collectively referred to as X4. This paper describes a set of system effectiveness measures, and their associated metrics, for data analysis of X4 simulations. The descriptions, rationales, and calculation procedures for two metrics to be used in data analysis of simulation results, the number of predicted demand-capacity imbalances and the pre-departure delays, are described. Results from data analysis of one set of simulation runs are presented to demonstrate how these metrics support the assessment of performance of the system architecture for X4 simulations and the verification of experiment requirements.

Urban Air Mobility↗
DOE OSTI2021

Adapting Existing Energy Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes—including consequences and/or changes in investment or operational decisions due to avoided consequences—based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Environmental and economic analyses of chemical recycling via dissolution of waste polyethylene terephthalate

Globally, more than 1000 organizations and 175 nations are facing the plastic waste problem and have realized the need to transition from “linear-to-circular” economy of plastics. While the current mechanical recycling technologies for plastics are struggling to increase the U.S. plastic recycling rates beyond 9%, chemical recycling technologies become important complementary technologies to the predominant mechanical recycling that are needed to realize the circular economy in plastics supply chains. Dissolution is one such chemical recycling technology that can recycle waste plastic back into high-quality virgin grade plastic. However, the environmental and economic impacts of chemical recycling of waste polyethylene terephthalate (PET) via dissolution technology using a green solvent are unknown. Our study evaluated environmental metrics such as greenhouse gas (GHG) emissions and cumulative energy demand, and economic metrics such as net present value (NPV), minimum selling price, payback period, return on investment, and discounted internal rate of return for three dissolution processes with polymer recovery via anti-solvent, evaporation, and cooling precipitation techniques. The dissolution process with evaporation technique was the most economically favorable, whereas that with cooling technique was the most environmentally favorable. The anti-solvent approach had low economic performance and the highest environmental impacts. The NPV for all of these technologies ranged from $2.67 MM to $10.93 MM for a capacity of 8,400 MT/year and was found to be the highest for dissolution with evaporation approach and the least for anti-solvent approach. The cradle-to-gate GHG emissions and energy demand for PET dissolution processes ranged from 1.33-3.77 kg CO2-eq/kg of chemically recycled (CR) PET and18.9-56.1 MJ/kg of CR-PET, respectively. These economic and environmental metrics will be helpful in evaluating the sustainability of circular PET supply chains in the U.S.

09 BIOMASS FUELS↗
DOE OSTI2023

New Chemical Dopant and Counterion Mechanism for Organic Electrochemical Transistors and Organic Mixed Ionic–Electronic Conductors

Abstract Organic mixed ionic–electronic conductors (OMIECs) have varied performance requirements across a diverse application space. Chemically doping the OMIEC can be a simple, low‐cost approach for adapting performance metrics. However, complex challenges, such as identifying new dopant materials and elucidating design rules, inhibit its realization. Here, these challenges are approached by introducing a new n‐dopant, tetrabutylammonium hydroxide (TBA‐OH), and identifying a new design consideration underpinning its success. TBA‐OH behaves as both a chemical n‐dopant and morphology additive in donor acceptor co‐polymer naphthodithiophene diimide‐based polymer, which serves as an electron transporting material in organic electrochemical transistors (OECTs). The combined effects enhance OECT transconductance, charge carrier mobility, and volumetric capacitance, representative of the key metrics underpinning all OMIEC applications. Additionally, when the TBA + counterion adopts an “edge‐on” location relative to the polymer backbone, Coulombic interaction between the counterion and polaron is reduced, and polaron delocalization increases. This is the first time such mechanisms are identified in doped‐OECTs and doped‐OMIECs. The work herein therefore takes the first steps toward developing the design guidelines needed to realize chemical doping as a generic strategy for tailoring performance metrics in OECTs and OMIECs.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Supply chain system for a centralized biorefinery system based on switchgrass grown on marginal land in Michigan

The feedstock supply chain of a biorefinery is critical in determining the economic and environmental performance of biofuels. This study investigated various feedstock supply chains for a centralized biorefinery based on different objective functions and how the biorefinery responds to supply chain volatility. For the analysis, a hypothetical centralized biorefinery was supplied by switchgrass grown on marginal lands in Michigan. From an economic standpoint, the minimum biofuel selling price is an important metric of the objective function, and the greenhouse gas mitigation potential is a similarly important metric for global warming impact. A trade-off therefore exists between the economic and environmental performance of biofuels under this system configuration. However, when a carbon tax credit is applied to soil organic carbon sequestration in switchgrass production, the metric of the objective function may not be the key factor in establishing a supply chain as long as it is associated with biorefinery capacity as well as economic or environmental values. Year-to-year fluctuations in cellulosic biomass yield (supply chain volatility) might also prevent the biorefinery from operating at full capacity. Cellulosic biomass pellets can serve as an auxiliary feedstock for the centralized cellulosic biorefinery system to minimize the impacts of supply chain volatility.

09 BIOMASS FUELS↗
DOE OSTI2020

An international laboratory comparison of dissolved organic matter composition by high resolution mass spectrometry: Are we getting the same answer?

Since the first detailed compositional analysis of dissolved organic matter (DOM) in 1995, high resolution mass spectrometry (HRMS) has become a vital tool for DOM characterization. While the upward trend in HRMS for molecular level analysis of DOM continues, so do the challenges of data comparison and interpretation between laboratories operating instruments of differing performance and user operating conditions. It is therefore essential that the community establishes whether data and trends can be compared robustly between research groups. To this end, 4 identically prepared DOM samples were each studied by 16 laboratories, representing 17 commercially-purchased instruments located across 8 countries, using positive- and negative-mode electrospray ionization (ESI) HRMS analysis. Despite the widely reported sensitivity of ESI experiments to sample matrix, preparation, ion source operation and instrument tuning parameters, the instruments used in this study showed relatively low variability between results for the same samples, particularly H/C and AI metrics. The variation in O/C and m/z metrics was relatively higher, although z-score graphs and %BCD demonstrated that the relative difference in general chemical composition between samples was the same for each instrument included in the study. As such, these metrics can be used for fingerprinting of DOM samples and as a benchmark for quality control in participating laboratories, with future strides in environmental science building upon these efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Shrubs Strongly Influence Snow Properties in Two Subarctic Watersheds

Understanding changes in snow distribution in permafrost ecosystems is fundamental to predicting their response to future climate change. The expansion of tall shrubs into tundra ecosystems can trap snow and insulate permafrost ecosystems during the winter, but the overall insulation effect is dependent upon many ecosystem properties. To study shrub–snow–ground interactions, small temperature sensors were deployed at two research sites on the Seward Peninsula of Alaska, USA, during the 2019–2020 winter. Snow temperatures were used to extrapolate multiple metrics, including freezing n-factors, the snow insulation effect, snow cover duration, and the length of the snowmelt period. Statistical and spatial analysis showed that shrub patches were a dominant control on all snow metrics. Within shrub patches, average ground temperatures were 2.1°C warmer, snow persisted 50 days longer, snow insulation was double, and a longer, later spring snowmelt period occurred compared to nonshrubby areas. Site-level differences contributed relatively little to variation in snow metrics, indicating that shrub presence is an overarching driver of snow–ground interactions at the locations examined. Shrub expansion, which is anticipated under climate change, will strongly impact future permafrost distribution and Arctic energy, water, and carbon cycles through snow–shrub–ground feedbacks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Persistent Classification: Understanding Adversarial Attacks by Studying Decision Boundary Dynamics

ABSTRACT There are a number of hypotheses underlying the existence of adversarial examples for classification problems. These include the high‐dimensionality of the data, the high codimension in the ambient space of the data manifolds of interest, and that the structure of machine learning models may encourage classifiers to develop decision boundaries close to data points. This article proposes a new framework for studying adversarial examples that does not depend directly on the distance to the decision boundary. Similarly to the smoothed classifier literature, we define a (natural or adversarial) data point to be ( γ , σ)‐stable if the probability of the same classification is at least for points sampled in a Gaussian neighborhood of the point with a given standard deviation . We focus on studying the differences between persistence metrics along interpolants of natural and adversarial points. We show that adversarial examples have significantly lower persistence than natural examples for large neural networks in the context of the MNIST and ImageNet datasets. We connect this lack of persistence with decision boundary geometry by measuring angles of interpolants with respect to decision boundaries. Finally, we connect this approach with robustness by developing a manifold alignment gradient metric and demonstrating the increase in robustness that can be achieved when training with the addition of this metric.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Dimensionality reduction using elastic measures

With the recent surge in big data analytics for hyperdimensional data, there is a renewed interest in dimensionality reduction techniques. In order for these methods to improve performance gains and understanding of the underlying data, a proper metric needs to be identified. This step is often overlooked, and metrics are typically chosen without consideration of the underlying geometry of the data. Here, in this paper, we present a method for incorporating elastic metrics into the t-distributed stochastic neighbour embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP). We apply our method to functional data, which is uniquely characterized by rotations, parameterization and scale. If these properties are ignored, they can lead to incorrect analysis and poor classification performance. Through our method, we demonstrate improved performance on shape identification tasks for three benchmark data sets (MPEG-7, Car data set and Plane data set of Thankoor), where we achieve 0.77, 0.95 and 1.00 F1 score, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Data Center Facility Monitoring with Physics Aware Approach

U.S. Department of Energy's National Renewable Energy Laboratory (NREL) hosts one of the world's most energy-efficient HPC data centers; this system uses component-level warm-water liquid cooling to efficiently remove heat from the data center and capture it for reuse in the building or rejection to the atmosphere. Given the complexity of this system, building data-driven tools for holistically monitoring and operating the entire data center is a priority for ensuring maximal efficiency and resiliency. In this advanced smart facility, over one million metrics are recorded per minute using state-of-the-art streaming data architecture and software to capture and process the state of the system in real time. Here we detail two efforts to effectively analyze, visualize, and interpret this large volume streaming data. We have developed a novel, flexible system for identifying and visualizing individual metric anomalies and component performance across the data center through automatic metadata extraction and physically-motivated visualization for quick interpretation. Additionally, to directly connect system maintenance to data stream processing we explore a physics informed multi-metric drift and anomaly detection application to detect scale-build up in heat exchangers.

anomaly detection↗
DOE OSTI2021

Separability in consistent truncations

The separability of the Hamilton-Jacobi equation has a well-known connection to the existence of Killing vectors and rank-two Killing tensors. This paper combines this connection with the detailed knowledge of the compactification metrics of consistent truncations on spheres. The fact that both the inverse metric of such compactifications, as well as the rank-two Killing tensors can be written in terms of bilinears of Killing vectors on the underlying “round metric,” enables us to perform a detailed analyses of the separability of the Hamilton-Jacobi equation for consistent truncations. We introduce the idea of a separating isometry and show that when a consistent truncation, without reduction gauge vectors, has such an isometry, then the Hamilton-Jacobi equation is always separable. When gauge vectors are present, the gauge group is required to be an abelian subgroup of the separating isometry to not impede separability. We classify the separating isometries for consistent truncations on spheres, S n , for n = 2, …, 7, and exhibit all the corresponding Killing tensors. These results may be of practical use in both identifying when supergravity solutions belong to consistent truncations and generating separable solutions amenable to scalar probe calculations. Finally, while our primary focus is the Hamilton-Jacobi equation, we also make some remarks about separability of the wave equation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Geometries with mismatched branes

We study Randall-Sundrum two brane setups with mismatched brane tensions. For the vacuum solutions, boundary conditions demand that the induced metric on each of the branes is either de Sitter, Anti-de Sitter, or Minkowski. For incompatible boundary conditions, the bulk metric is necessarily time-dependent. This introduces a new class of time-dependent solutions with the potential to address cosmological issues and provide alternatives to conventional inflationary (or contracting) scenarios. We take a first step in this paper toward such solutions. One important finding is that the resulting solutions can be very succinctly described in terms of an effective action involving only the induced metric on either one of the branes and the radion field. But the full geometry cannot necessarily be simply described with a single coordinate patch. We concentrate here on the time- dependent solutions but argue that supplemented with a brane stabilization mechanism one can potentially construct interesting cosmological models this way. This is true both with and without a brane stabilization mechanism.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

The phase space distance between collider events

How can one fully harness the power of physics encoded in relativistic N-body phase space? Topologically, phase space is isomorphic to the product space of a simplex and a hypersphere and can be equipped with explicit coordinates and a Riemannian metric. This natural structure that scaffolds the space on which all collider physics events live opens up new directions for machine learning applications and implementation. Here we present a detailed construction of the phase space manifold and its differential line element, identifying particle ordering prescriptions that ensure that the metric satisfies necessary properties. We apply the phase space metric to several binary classification tasks, including discrimination of high-multiplicity resonance decays or boosted hadronic decays of electroweak bosons from QCD processes, and demonstrate powerful performance on simulated data. Our work demonstrates the many benefits of promoting phase space from merely a background on which calculations take place to being geometrically entwined with a theory’s dynamics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗