Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Quantitative Metrics from 20 Years of Terra Data Usage

NASA's Terra flagship satellite carries five Earth-observing instruments that have collected data for almost 20 years. NASA's Earth Science Data and Information System (ESDIS) Project makes these data, along with derived products, available to worldwide data users. Since the launch of Terra on December 18, 1999, more than 10,000 data products have been archived and distributed by NASA-funded Distributed Active Archive Centers (DAACs) that are part of NASA's Earth Observing System Data and Information System (EOSDIS). At the end of the 2018 Fiscal Year, about 1,000 Terra data products constituted almost 22% of the entire EOSDIS data archive volume (6 PB out of approximately 27.5 PB), and 6 PB of Terra data were distributed to over half-a-million public users worldwide.By categorizing the Terra data products and their distribution, we can get a quantitative assessment of Terra data usage. NASA's ESDIS Project has collected archive, distribution, and user information from EOSDIS data users since February 2000. These metrics are available through the ESDIS Metrics System (EMS). EMS information is stored in a relational database from which quantitative metrics of Terra data use can be retrieved and analyzed.The purposes of this study are to: 1) perform a comprehensive investigation of the 20-year trend in the archive and distribution of Terra data products; 2) identify and characterize data product usage over the last 20 years; and 3) identify and characterize the global user community for these data. In addition to revealing how Terra data use has evolved over time, the results of this study provide insights on identifying the various user communities for different kinds of Earth science data products. Also, because of the enormous quantity of data handled by EOSDIS DAACs, the study provides guidance of the requirements for future data systems that will be needed to effectively and efficiently handle the ever-increasing amounts of Earth science data produced by future (and ongoing) Earth science missions.

Wanchoo, Lalit↗

Parallel High-Order Anisotropic Meshing Using Discrete Metric Tensors

This paper presents a metric-aligned meshing algorithm that relies on the Lp-Centroidal Voronoi Tesselation approach. A prototype of this algorithm was first presented at the Scitech conference of 2018 and this work is an extension to that paper. At the end of the previously presented work, a set of problems were mentioned which we are trying to address in this paper. First, we show a significant improvement in code performance since we were limited to present relatively benign (analytical) test cases. Second, we demonstrate here that we are able to rely on discrete metric data that is delivered by a Computational Fluid Dynamics (CFD) solver. Third, we demonstrate how to generate high-order curved elements that are aligned with the underlying discrete metric field.

Ekelschot, Dirk↗

Sound Quality Metric Indicators of Rotorcraft Noise Annoyance Using Multilevel Regression Analysis

Although every helicopter in operation has to go through a noise certification process, annoyance due to helicopters still persists within various communities. This implies that certification metrics do not capture the full range of human response and that predicted reactions could be supplemented with other information, which could be acoustic or non-acoustic in nature. The rotorcraft sound quality metric (RoQM) psychoacoustic experiment was designed to determine the relative importance of sound quality metrics (SQMs), such as sharpness, tonality, loudness, fluctuation strength and impulsiveness, on human annoyance to rotorcraft sounds. Starting from a baseline helicopter recording, SQMs were varied synthetically and presented to subjects who responded with an annoyance rating. The RoQM test took place in 2017 at the NASA Langley Research Center in the Exterior Effects Room. A total of 105 sounds were played to 40 subjects. The relationship between helicopter noise sound quality and annoyance is modeled using multilevel regression in this work, which takes into account the variability of responses across subjects. Previous analyses did not consider such a grouping of the data.

Matthew Boucher↗

Enabling Metric-Based Mesh Adaptation for Advanced Compressible Flow Simulations Using US3D

This work presents a metric-based mesh adaptation capability added to the flow solver US3D that is used to improve the accuracy of atmospheric entry simulations. Flow past an entry vehicle in free-flight is usually unsteady and characterized by anisotropic flow features like a strong bow shock and small-scale isotropic flow features like turbulent eddies in the wake. The results presented in this paper demonstrate that we are currently able to iteratively apply metric-based mesh adaptation to improve the solution accuracy by simultaneously targeting isotropic and anisotropic flow features. A simplified workflow of running CFD simulations for entry vehicles is presented where we start off with a coarse initial mesh to compute a first approximation of the flow. This coarse mesh is then iteratively refined using the newly developed metric to improve the resolution of the CFD computation. Furthermore, we demonstrate that we are able to adapt large mesh sizes in a timely fashion which allows us to start thinking about applying this adaptive framework to unsteady atmospheric entry CFD simulations.

Mesh adaptation↗

Stokes resolved differential temperature: an important metric of polarimetric precision in the long-wave infrared

In remote sensing, radiometric measurements taken in the mid-wave infrared and beyond (λ >3μm) are commonly reported in units of Kelvin by utilizing Planck’s radiation law to relate measured radiance and target brightness temperature (Tb). Thus, it is desirable to match this formalism in thermal polarimetry and report the unnormalized Stokes parameters in units of K instead of radiance (Wm−2sr−1). This approach also al-lows common performance metrics in long-wave infrared (LWIR) imaging such as Noise Equivalent DifferentialTemperature (NEDT) to be modified and extended to metrics of polarimetric accuracy and precision. However, since the relationship between measured radiance and Tb are non-linear, the conversion of I, Q, and U in units of radiance to Tb,Tb,Q, and Tb,U in K is ambiguous. As a solution a metric of performance for thermal linear Stokes polarimetry, the Stokes resolved differential temperature (SRDT), is introduced.

polarimetry↗

A Systems Margin Metric for Capability Above Basic Estimates

A systems margin metric is described that indicates the total system performance capability above the basic estimates (CABE) for mass, power, energy, propellant, V, ISP, computer performance, and any other design parameter with a defined margin. This concept normalizes all terms for contingency, margin, growth allowance, and reserves to the amount that the basic mass of the vehicle could grow if each of those “room to grow” terms were released. The CABE metric is intended to provide a uniform indication of the total performance margin of a system at a given point in the project life cycle. The CABE metric can also provide a normalized means to trade the “room to grow” terms between various resources in order to solve system performance issues as they arise. For example, the CABE percentage for ISP margin could be equally traded with the CABE percentage for power margin.

Lepsch, Roger↗

Correlations of Additive Manufacturing Model-Based Process Metrics With Spatter-Induced Porosity in the Powder Bed Fusion-Laser Beam/Metallic Process

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Qualifying materials for components in critical applications requires a thorough understanding of pertinent processing-microstructure-property relationships. Porosity defects have a strong adverse effect on the mechanical properties of a material. The morphology of porosity defects created by lack of fusion in PBF-LB/M often exhibit high aspect ratios that can act as stress concentrators and become crack initiation sites. The occurrence of spatter induced porosity is studied using synchronized AM model-based process metrics and porosity measured by high-resolution X-ray computed tomography. A novel AM process metric is introduced to quantify the relative exposure to spatter ejecta impacts and incorporation throughout the sequence of the PBF-LB/M process. Further characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated statistically with the spatter ejecta impact field of the PBF-LB/M process. Both keyhole and lack of fusion porosity can be predicted by the spatter exposure process metric, which can be exploited to control the fusion sequence.

Additive Manufacturing↗

Influence of Atmospheric Variability on Predicted Sonic Boom Metrics

As part of the Quesst mission, NASA will fly the X-59 aircraft over selected communities to survey community responses to low sonic booms. Previously, we developed a Kalman filter method to estimate the loudness metrics experienced by each survey participant during each flight. The Kalman filter fuses acoustic measurements with predictions from PCBoom, a sonic boom propagation model. PCBoom requires vertical profiles of the temperature, humidity, and wind to propagate sonic booms through the atmosphere and predict the loudness metrics at the ground. Prior to each X-59 flight, NASA will launch weather balloons to measure the vertical atmospheric profile. However, the atmosphere changes continually with geographic location and time. The purpose of this work is to determine where and when to launch these weather balloons to minimize the uncertainty in the predicted loudness metrics caused by atmospheric variability. We analyzed the effect of atmospheric variability on the predicted Perceived Level in three communities in different climate zones in the United States. To achieve acceptable uncertainty in the Perceived Level, weather balloons should be launched from at least two different sites within the survey area within one hour of each X-59 flight.

sonic boom↗

Assessing the Convective Environment over Irrigated and Non-Irrigated Land Use with Land-Atmosphere Coupling Metrics: Results from GRAINEX

Land use land cover change affects weather and climate. This paper quantifies land-atmosphere interactions over irrigated and non-irrigated land uses during the Great Plains Irrigation Experiment (GRAINEX). Three coupling metrics were used to quantify some land-atmosphere interactions as it relates to convection. They include: the Convective Triggering Potential (CTP) and Low-Level Humidity Index (HI low ), and the Lifting Condensation Level (LCL) Deficit. These metrics were calculated from the rawinsonde data obtained from the Integrated Sounding Systems (ISS) for Rogers Farm and York Airport along with soundings launched from the Doppler on Wheels (DOW) sites. Each metric was categorized by Intensive Observation Period (IOP), cloud cover, and time of day.

Daniel Whitesel↗

Use of Spectral Analysis of Singular Values as a Test Metric for IMMAT Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Impedance Matched Multi-Axis Testing↗

Use of Spectral Analysis of Singular Values as a Test Metric for Impedance Matched Multi-Axis Test Trials

One of many challenges in the implementation of multiple exciter testing is establishing a reasonable set of test metrics to measure the quality of testing. This is especially true in the application of Impedance Matched Multi-Axis Testing; in that it is possible to have very large spectral density matrices that serve as reference criteria. While there exist plotting schemes to view a spectral density matrix, it is often necessary to break the overlay of reference and test results into subsections of the matrices to get sufficient resolution to interpret the data. In addition, as one attempts to control multiple locations on a structure, implementation of classical single degree-of freedom test tolerances across all channels and associated cross spectra is simply not feasible. Hence it is challenging to evaluate overall test quality. The use of spectral views of the dominant singular values from the singular value decomposition of the spectral density matrices and metrics based upon them is proposed for establishing a set of compact metrics for evaluating test quality. A laboratory experiment will be included to demonstrate this proposed technique.

Vibration Testing↗

Control Effectiveness: Metric Development and Application to Resilient Lunar Habitat Design

System safety engineering in its bare essence involves identifying, assessing, and mitigating, or controlling, hazards. Appropriate safety controls are selected using hazard reduction precedence principles, prior experience, or by assessing their impact on residual risk (together with other factors like cost). We propose a control effectiveness metric as one way to systematically and consistently evaluate potential safety controls individually and thereby facilitate selecting a shortlist of potential controls for subsequent integrated evaluation. The control effectiveness metric considers a safety control’s availability when needed, the probability that its design is adequate in addressing the targeted hazard, the probability that the design will be implemented as intended, and the relationship between the time it takes for the safety control to address its target hazard and the time before the hazard propagates. We demonstrated the use of our metric on a lunar habitat design using a physics-based habitat simulator. High control effectiveness and safety controls result in a habitat with high resilience, while low control effectiveness results in lower resilience.

Rashi Jain↗

Metrics for Evaluating the Accuracy of Solar Power Forecasting: Preprint

Forecasting solar energy generation is a challenging task due to the variety of solar power systems and weather regimes encountered. Forecast inaccuracies can result in substantial economic losses and power system reliability issues. This paper presents a suite of generally applicable and value-based metrics for solar forecasting for a comprehensive set of scenarios (i.e., different time horizons, geographic locations, applications, etc.). In addition, a comprehensive framework is developed to analyze the sensitivity of the proposed metrics to three types of solar forecasting improvements using a design of experiments methodology, in conjunction with response surface and sensitivity analysis methods. The results show that the developed metrics can efficiently evaluate the quality of solar forecasts, and assess the economic and reliability impact of improved solar forecasting.

14 SOLAR ENERGY↗

Enhanced Accident Tolerant LWR Fuels: Metrics Development

The Department of Energy (DOE) Fuel Cycle Research and Development (FCRD) Advanced Fuels Campaign (AFC) is conducting research and development on enhanced Accident Tolerant Fuels (ATF) for light water reactors (LWRs). This mission emphasizes the development of novel fuel and cladding concepts to replace the current zirconium alloy-uranium dioxide (UO2) fuel system. The overall mission of the ATF research is to develop advanced fuels/cladding with improved performance, reliability and safety characteristics during normal operations and accident conditions, while minimizing waste generation. The initial effort will focus on implementation in operating reactors or reactors with design certifications. To initiate the development of quantitative metrics for ATR, a LWR Enhanced Accident Tolerant Fuels Metrics Development Workshop was held in October 2012 in Germantown, MD. This paper summarizes the outcome of that workshop and the current status of metrics development for LWR ATF.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Tale of Three District Energy Systems: Metrics and Future Opportunities

Improving the sustainability of cities is crucial for meeting climate goals in the next several decades. One way this is being tackled is through innovation in district energy systems, which can take advantage of local resources and economies of scale to improve the performance of whole neighborhoods in ways infeasible for individual buildings. These systems vary in physical size, end use services, primary energy resources, and sophistication of control. They also vary enormously in their choice of optimization metrics while all under the umbrella-goal of improved sustainability. This paper explores the implications of choice of metric on district energy systems using three case studies: Stanford University, the University of California at Merced, and the Richmond Bay campus of the University of California at Berkeley. They each have a centralized authority to implement large-scale projects quickly, while maintaining data records, which makes them relatively effective at achieving their respective goals. Comparing the systems using several common energy metrics reveals significant differences in relative system merit. Additionally, a novel bidirectional heating and cooling system is presented. This system is highly energy-efficient, and while more analysis is required, may be the basis of the next generation of district energy systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Locus Algorithm IV: Performance metrics of a grid computing system used to create catalogues of optimised pointings

This paper discusses the requirements for and performance metrics of the the Grid Computing system used to implement the Locus Algorithm to identify optimum pointings for differential photometry of 61,662,376 stars and 23,779 quasars. Initial operational tests indicated a need for a software system to analyse the data and a High Performance Computing system to run that software in a scalable manner. Practical assessments of the performance of the software in a serial computing environment were used to provide a benchmark against which the performance metrics of the HPC solution could be compared, as well as to indicate any bottlenecks in performance. These performance metrics indicated a distinct split in the performance dictated more by differences in the input data than by differences in the design of the systems used. This indicates a need for experimental analysis of system performance, and suggests that algorithmic complexity analyses may lead to incorrect or naive conclusions, especially in systems with high data I/O overhead such as grid computing. Further, it implies that systems which reduce or eliminate this bottleneck such as in-memory processing could lead to a substantial increase in performance.

Creaner, Oisín↗

Pansophy data as used to develop metrics and evaluate trends across SRF projects and facilities to further quality improvement initiatives

Pansophy, a JLAB SRF engineering data management system (EDMS), is composed of a collection of technolo-gies that together provide for the collection, management and analysis of data for the production and testing of cavities and cryomodules. From its inception in 2000, when data collection was a priority for such projects as SNS, CEBAF 12GeV upgrade, LCLS-II, and in the future the SNS-PPU, the focus has turned to data analysis and reporting on quality metrics and key performance indica-tors (KPIs). Reporting enhancements include monthly quality metrics, project specific KPIs, and trending across projects. With the use of Pareto Charts to help analyze vendor quality and non-conformance, timelines of pro-ject and facility metrics, project managers and subject matter experts (SME) are able to look for trends and pre-pare further quality improvement initiatives for their projects.

McDonald, M. G.↗

Urban Traveler - Changes and Impacts: Mobility Energy Productivity (MEP) Metric

For nearly a century, the automobile has been the primary mode of personal transportation in American life. This remains true today as millions of people rely heavily on cars to connect suburbs with cities or to travel long distances—often out of routine or convenience. However, advances in technology are fueling an era of transportation transformation, with the potential to transform a system that has remained virtually unchanged for decades. Aspiring smart cities are wrestling with questions such as: How does mobility impact a person’s quality of life? Would people make different travel choices if they were presented with better information about their mobility options? The ability to quantify the mobility potential of a given location is the first step toward answering these questions. In response, an interdisciplinary team at the National Renewable Energy Laboratory (NREL) has developed the Mobility-Energy Productivity (MEP) metric. The MEP metric provides an avenue to not only measure the mobility potential at a specific location in its current configuration, but also to test how various technological advances (e.g., connected and automated vehicles, plug-in electric vehicles, shared mobility) and infrastructure investments (e.g., building an additional highway lane, constructing a new shopping mall, implementing a transit-oriented development) impact the mobility of that location over time. This presentation details the FY19 progress on the MEP metric project funded through DOE VTO's SMART Mobility Consortium.

47 OTHER INSTRUMENTATION↗