Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Detect-and-Avoid Safety and Operational Suitability Analysis using an Electro-Optical/Infared Sensor Model

This report documents a closed-loop analysis of an DAA system using a Electro/Optical sensor model. Safety and operational suitability metrics are computed. Results show that the safety metrics are most sensitive to the angular rate accuracy of the intruder aircraft. Trade-off between safety and operationl suitability metrics is discussed. Results from this work directly inform the requirements of an electro/optical sensors for detect-and-avoid.

Detect-and-avoid↗

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗

Determining Research Priorities for Astronomy Using Machine Learning

We summarize the first exploratory investigation into whether Machine Learning (ML) techniques can augment science strategic planning. We find that an approach based on Latent Dirichlet Allocation (LDA) using abstracts drawn from high-impact astronomy journals may provide a leading indicator of future interest in a research topic. We show two topic metrics that correlate well with the high-priority research areas identified by the 2010 National Academies’ Astronomy and Astrophysics Decadal Survey. One metric is based on a sum of the fractional contribution to each topic by all scientific papers (“counts”) while the other is the Compound Annual Growth Rate (CAGR) of counts. These same metrics also show the same degree of correlation with the whitepapers submitted to the same Decadal Survey. Our results suggest that the Decadal Survey may under-emphasize fast growing research. A preliminary version of our work was presented by Thronson et al. (2021).

Astronomy↗

Classifying Forest Type in the National Forest Inventory Context with Airborne Hyperspectral and Lidar Data

Forest structure and composition regulate a range of ecosystem services, including biodiversity, water and nutrient cycling, and wood volume for resource extraction. Forest type is an important metric measured in the US Forest Service Forest Inventory and Analysis (FIA) program, the national forest inventory of the USA. Forest type information can be used to quantify carbon and other forest resources within specific domains to support ecological analysis and forest management decisions, such as managing for disease and pests. In this study, we developed a methodology that uses a combination of airborne hyperspectral and lidar data to map FIA-defined forest type between sparsely sampled FIA plot data collected in interior Alaska. To determine the best classification algorithm and remote sensing data for this task, five classification algorithms were tested with six different combinations of raw hyperspectral data, hyperspectral vegetation indices, and lidar-derived canopy and topography metrics. Models were trained using forest type information from 632 FIA subplots collected in interior Alaska. Of the thirty model and input combinations tested, the random forest classification algorithm with hyperspectral vegetation indices and lidar-derived topography and canopy height metrics had the highest accuracy (78% overall accuracy). This study supports random forest as a powerful classifier for natural resource data. It also demonstrates the benefits from combining both structural (lidar) and spectral (imagery) data for forest type classification.

random forest↗

Barefoot Rover: a Sensor-Infused Rover Wheel Demonstrating In-Situ Engineering and Science Extractions using Machine Learning

In this work, we demonstrate an instrumented wheel concept which utilizes a 2D pressure grid, an electrochemical impedance spectroscopy (EIS) sensor and machine learning (ML) to extract meaningful metrics from the interaction between the wheel and surface terrain. These include continuous slip/skid estimation, balance, and sharpness for engineering applications. Estimates of surface hydration, texture, terrain patterns, and regolith physical properties such as cohesion and angle of internal friction are additionally calculated for science applications. Traditional systems rely on post-processing of visual images and vehicle telemetry to estimate these metrics. Through in-situ sensing, these metrics can be calculated in near real time and made available to onboard science and engineering autonomy applications. This work aims to provide a deployable system for future planetary exploration missions to increase science and engineering capabilities through increased knowledge of the terrain.

Marchetti, Yuliya↗

Integrated Handling Qualities Safety Analysis For Conceptual Design of Urban Air Mobility Vehicles

The recent emergence of distributed electric propulsion Vertical Takeoff and Landing (VTOL) aircraft has created a rapid introduction of new design concepts with unique stability and control characteristics. A challenge to realizing the full potential of these vehicles for urban transportation is to gain public acceptance which is largely driven by flight safety. This paper describes ongoing research to address the feasibility of integrating flying qualities safety metrics into conceptual design of VTOL Urban Air Mobility (UAM) vehicles. The discussion is composed of the approach and progress toward a toolbox that integrates with existing NASA rotorcraft design software and processes. Several key challenges are highlighted including modeling requirements for failures, identification of critical failures, and capturing critical failures, with robustness to model uncertainty. A discussion of requirements for safety metrics, specific to UAM vehicles, as well as the effects of the control system design is also included. Results to date have demonstrated the degradation in flying qualities metrics due to propulsion failures.

George Altamirano↗

An Overall Assessment of JPSS-3 VIIRS Radiometric Performance Based on Pre-Launch Testing

Satellite imagery and data are playing an increasingly important role in scientific studies of the Earth and its climate. The scientific community has been demanding ever-increasing capabilities and accuracy from the data provided by these satellites. One key instrument on board a series of satellite platforms is the Visible Infrared Imaging Radiometer Suite (VIIRS), which provides high-quality data of the Earth from low Earth orbit covering the visible to long-wave infrared parts of the spectrum. The fourth build in the series, set to be launched on the Joint Polar-orbiting Satellite System 3 (JPSS-3) platform, has recently completed its main ground calibration program and is set to be integrated into the satellite bus in the near future. This calibration program covered a comprehensive series of performance metrics designed to demonstrate the quality of the science data and ensure the instrument can maintain its calibration successfully once on-orbit. The subject of this work covers the radiometric calibration metrics including dynamic range, signal-to-noise ratio/noise equivalent differential temperature (SNR/NEdT), polarization sensitivity, scattered light response, relative spectral response, response versus scan angle, and uniformity, as well as uncertainties; all key metrics met or exceeded their design requirements with some minor exceptions. Comparisons to previous builds will also be provided.

JPSS-3↗

Quantitative Highlights of 20 years Aqua Data Archive and Data Usage

NASA’s Aqua satellite carries six Earth-observing instruments Atmospheric Infrared Sounder (AIRS), Advanced Microwave Scanning Radiometer for EOS (AMSR-E), Advanced Microwave Sounding Unit (AMSU), Clouds and the Earth’s Radiant Energy System (CERES), Humidity Sounder for Brazil (HSB) and Moderate Resolution Imaging Spectroradiometer (MODIS). Currently only four of six instruments are collecting data, two instruments that stopped transmitting data are AMSR-E that suffered a major anomaly in October 2011 and was powered off in March 2016 while as HSB failed in February 2003. NASA’s Earth Science Data and Information System (ESDIS) Project makes these data, along with derived products, available to worldwide data users. Since the launch of Aqua on May 4, 2002, more than 10,000 data products have been archived and distributed by NASA-funded Distributed Active Archive Centers (DAACs) that are part of NASA’s Earth Observing System Data and Information System (EOSDIS). At the end of the 2021 Fiscal Year with over 100,000 orbits data, about 1,000 Aqua data products constituted almost 16.5 % of the entire EOSDIS data archive volume (8.6 PB out of approximately 55.2 PB), and 7.5 PB of Aqua data were distributed to over half-a-million public users worldwide. By categorizing the Aqua data products and their distribution, we can get a quantitative assessment of Aqua data usage. NASA’s ESDIS Project has collected archive, distribution, and user information from EOSDIS data users since February 2000. These metrics are available through the ESDIS Metrics System (EMS). EMS information is stored in a relational database from which quantitative metrics of Aqua data use can be retrieved and analyzed. The purposes of this study are to: 1) perform a comprehensive investigation of the 20-year trend in the archive and distribution of Aqua data products; 2) identify and characterize data product usage over the last 20 years; and 3) identify and characterize the global user community for these data. In addition to revealing how Aqua data use has evolved over time, the results of this study provide insights on identifying the various user communities for different kinds of Earth science data products. Also, because of the enormous quantity of data handled by EOSDIS DAACs, the study provides guidance of the requirements for future data systems that will be needed to effectively and efficiently handle the ever-increasing amounts of Earth science data produced by future (and ongoing) Earth science missions.

Lalit Wanchoo↗

Continued Exploration of the Electrified Aircraft Propulsion Design Space

A previous electrified aircraft propulsion (EAP) design space exploration study was continued to investigate the impact of mission constraints, further explore the design space of different sized aircraft, and improve the modeling process. Three aircraft were investigated, 18- and 48-passenger turboprops, and a 78-passenger turbofan. Baseline aircraft models were inherited from the earlier study and were hybridized by applying EAP technologies. A parametric study varying motor power and battery specific energy was conducted. For the 78-passenger turbofan, design range was also introduced as a parametric parameter. Key metrics for the study included equivalent lifecycle CO2 emissions and direct operating cost plus interest. Both turboprop aircraft demonstrated significant potential savings in block fuel consumption and CO2 emissions, but at increased operating costs compared to their baseline models. As the 78-passenger turbofan had shown no improvements in any metrics under reasonable technology assumptions, design range was shortened in an attempt to obtain performance benefits. When designed for a shorter range, the 78-passenger EAP vehicle showed potential improvements in block fuel when compared to a baseline with a similarly shortened design range, but not in any other metrics. Operating cost reductions were not achieved for any aircraft, but several designs came close to breaking even with their baselines. Smaller, shorter range aircraft and turboprops demonstrated larger performance benefits and smaller operating cost penalties, but a simple trade of electric energy storage in batteries for fuel is generally insufficient to produce a viable aircraft concept.

Electrified Aircraft Propulsion↗

Monitoring Airspace Complexity and Determining Contributing Factors

The national airspace has evolved over many years to accommodate increased traffic demand while simultaneously maintaining air travel as one of the safest forms of transportation. One of the reasons for this success is the ability of the air traffic control system and the operators to adapt and accommodate to situations that routinely disrupt normal operations. These situations may include: adverse weather, delays, early arrivals, equipment outages, and other factors that are outside the operators’ ability to control. These factors can lead to states where automation is unable to properly handle these issues, and therefore air traffic controllers and pilots have to intervene — ultimately increasing communication between operators resulting in higher workload. As controller workload increases to handle sub-optimal operating conditions, complexity increases. This is because, under these conditions humans are required to make tactical decisions in response to external factors. This results in a departure from the original strategic plan where operations would be more efficiently managed. Human operators manage airspace complexity under rigid regulations but in a constantly changing environment. The airspace is divided into sectors and the number of aircraft assigned to each controller is limited for safe handling. Some prior studies devised airspace complexity metrics in commercial aviation and related these metrics to controller workload. The upper bounds on the system load are pre-determined. Such bounds on complexity make for a safe system, but the system cannot scale and adapt to autonomous, dense, and heterogeneous traffic — including the many types of Unmanned Aerial Vehicles (UAVs) envisioned to be added to the operations. We hypothesize that, as traffic density and heterogeneity grow, and other key metrics change, there will be phase transitions at which the way traffic should be managed changes significantly. We offer a method for in-time detection of contributing factors that lead to phase transitions, characterized by increased complexity. To the best of our knowledge, there is no tool similar to ours that identifies such contributing factors or precursor patterns.

Precursor↗

Classifying Aircraft using Velocity Data with Support Vector Machines and Likelihood Ratio Tests

Timely classification of aircraft is important for small unmanned aerial system (sUAS) technologies, such as onboard collision avoidance systems, and aerial perimeter security for prisons and sports venues. This work uses velocity-based metrics to classify multi-rotor sUAS, fixed wings UAS, and general aviation planes using two classification methods: Support Vector Machines (SVM), and Likelihood Ratio (LR) tests. We found that a 96% classification accuracy is achieved when either classifier is trained using average speed derived from flight controller data or radar data and tested with one second of radar data. Further, we show that LR tests perform similarly to SVM for single metric classification. In addition, we present two novel metrics for classifying aircraft: log variance of absolute change in speed, and log variance of relative change in speed. Finally, we discuss challenges associated with training classifiers with flight controller data but testing on radar data.

Logan T Dihel↗

Exploring the Relationship Between Science Funding and Science Productivity on Extended Missions

Introduction: The goal of this summer internship research project was to explore the relationship between the level of funding for science team research and science productivity for planetary spaceflight missions. The productivity and funding for the prime and extended missions were compared when possible. Determining the actual rather than anecdotal relationship between the level of science team funding and their productivity will help determine the adequacy of science team funding. Additionally, determining whether productivity increases or decreases over time (within missions, or within the years between different missions) provides insights into ongoing trends. This project was conducted using data from 11 extended missions within the Planetary Science Division. The main goals of this project were to 1) quantify the level of productivity of the science team during the extended portion of each mission, 2) compare the level of productivity between different types of missions, and 3) compare the level of productivity between the prime missions and extended missions. Methodology: The central metric enters around the “publication rate” of each mission. This rate is normalized in a variety of ways, including the number of publications per year, per Co-I, and per instruments. For the most part, this data was attainable through mission websites, team rosters, and data collected from previous projects. The publication data for this project utilized the SAO/NASA Astrophysics Data System, and it consisted of a search for any papers from the extended mission that had a co-investigator as an author. The time period for these searches also included an additional two years after the end of the extended mission to account for additional time it typically takes to finish data analysis and publish papers. Data from prime missions was collected from a previous project that measured similar metrics for the same missions. When comparing the different types of missions, three factors were used: mission size, dates of the prime and extended missions, and the type of the mission (rover, flyby, orbiter, or lander). To determine mission size, missions were compared by the number of Co-I’s on the mission, the number of instruments in the payload, and the mission class. Findings: On average, prime mission publication rates were generally higher than those of extended missions. Out of the nine missions used for this comparison, six had a higher prime mission publication rate and three had a higher extended mission publication rate. This distinction was interesting to observe, but it should be noted that the methodology for determing the number of published papers differed for the prime missions and the extended missions Discovery missions were found to be the most scientifically productive. Additionally, more recent extended missions tend to possess greater productivity. When comparing missions of different types, it was found that orbiters were much more productive than other types of missions. Future Work: There are a number of opportunities to extend and improve on this project in the future. Even though the metrics used were the same, the prime mission data could be recollected from the same sources as the extended mission data (Astrophysics Data System) to insure greater consistency. The impact level of the publications could also be accounted for, and financial data could be used to compare teams with different levels of funding. Additionally, more missions could be examined to increase the sample size of these comparisons, especially the comparison of different mission types which had an incredibly small sample size for some categories.

Cameron Maxwell Thompson↗

Robustness of Vegetation Optical Depth Retrievals Based on L-Band Global Radiometry

Microwave vegetation optical depth (VOD) and soil moisture (SM) can be simultaneously retrieved based on L-band radiometry with polarization information. VOD is indicative of the vegetation water content (VWC) because it captures the extinction of land surface emission. If the connectivity of VOD to VWC is robust, the pair of VWC-SM observations can be viable bases for understanding soil–plant–atmosphere water relations, providing new perspectives on ecosystem science. Simultaneous SM–VOD retrievals are feasible by inverting the τ−ω model with two independent datasets in dual-channel algorithms. However, given correlated satellite vertical and horizontal brightness temperatures (TBs; TB v and TB h ), an ill-posed inverse problem arises where TB errors result in high uncertainties of retrievals. In this study, we apply the degrees-of-information (DoI) metric and propose a signal-to-noise ratio (SNR) metric to assess the “retrievability” of VOD given the Soil Moisture Active Passive (SMAP) TB v –TB h linear dependence. The application of these metrics allows determining where the VOD retrievals are robust and reliable. This is a necessary step in supporting the applications of VOD in ecology and hydrology. Results show that regions with mainly nonwoody vegetation have the best potential for VOD retrievals, though regularization is necessary. We then assess VOD time variations from two regularization products that reduce the impact of underdetermined inversions: the L3 dual-channel algorithm (L3-DCA) and the multitemporal dual-channel algorithm (MTDCA), which constrain VOD time dynamics with and without using a priori VOD climatology, respectively. Though they both reduce noise, especially in the VOD retrievals, they result in differences in VOD seasonal amplitude and coupling to SM at high frequencies as we outline here.

Microwave↗

Split-Step Simulations to Assess the Effects of Atmospheric Boundary Layer Turbulence on the Dose Variability of N-Waves and Shaped Booms

The effects of atmospheric boundary layer turbulence on the loudness variability of a sonic boom N-wave and shaped boom are examined with split-step simulations. The shaped boom is representative of a design iteration of the NASA X-59 aircraft. Inhomogeneous atmospheric boundary layer turbulence is generated in the computational domain by a Fourier synthesis method. The N-wave and shaped boom are propagated through turbulent fields representing eight different convection levels measured at the NASA Kennedy Space Center and the NASA Armstrong Flight Research Center. Probability density functions of the formation of caustic regions along the propagation direction are computed from the N-wave results, and a parameter to collapse the caustic PDFs that accounts for both fluctuation intensities and length scales is proposed. Statistical results concerning loudness metric variability are presented, and the standard deviations of several metrics are shown to collapse across different convection levels of turbulence for small nondimensional propagation distances. The loudness metric distributions are observed to be well approximated by a normal distribution for a given range of propagation distances, and become increasingly skewed as distance increases. A model function for the dose variability is proposed, and the function parameters are found to be related to the convection level of the turbulence. The model for the dose variability distribution is compared to simulation data that were not used to find the regression parameters of the model. At several nondimensional propagation distances, agreement is observed between the model and the simulation data. These results indicate that the model may be suitable for providing quick estimates of noise dose variability in the primary carpet region across a wide range of atmospheric boundary layer conditions.

Sonic boom↗

A Psychoacoustic Test for Urban Air Mobility Vehicle Sound Quality

This paper describes a psychoacoustic test in the Exterior Effects Room (EER) at the NASA Langley Research Center. The test investigated the degree to which sound quality metrics (sharpness, tonality, etc.) are predictive of annoyance to notional sounds of Urban Air Mobility (UAM) vehicles (i.e., air taxis). A suite of 136 unique (4.6 second duration) UAM rotor noise stimuli was generated. These stimuli were based on aeroacoustic predictions of a NASA reference UAM quadrotor aircraft under two flight conditions. The synthesizer changed rotor noise parameters such as the blade passage frequency, the relative level of broadband self-noise, and the relative level of tonal motor noise. With loudness constant, the synthesis parameters impacted sound quality in a way that created a spread of predictors both in synthesizer parameters and in sound quality metrics. Forty subjects listened to the suite of UAM noise stimuli in the EER and judged each sound individually on a standard scale of annoyance. Additionally, a subset of the UAM noise stimuli were compared to a reference sound that varied in loudness. From these responses, the relative effect of changes in loudness or changes in other sound quality metrics on annoyance was evaluated. This paper covers background and motivation for the test, details of how the sound stimuli were generated, and details of the test design and execution. Test results investigate how sound quality may affect perceived annoyance to UAM vehicle noise, indicating the importance of sharpness, tonality, impulsiveness, and roughness on annoyance to UAM noise.

UAM↗

IMPACTing Medical System Design with a Risk Analysis Tool [“IMPACT” sur la Conception du Système Médical avec un Outil d'Analyse des Risques]

Background: Following the success of Artemis I, NASA is preparing for human extended duration missions. Ongoing efforts are focused on mitigating mission-related risks, including those affecting crew health and performance. Communication latency, logistics of resupply and time frame of medical evacuation are barriers to provision of healthcare for these missions, especially with respect to constraints in mass, volume, and crew training. An in-depth assessment of medical risks, capabilities and resources for a specific mission design is necessary to determine an optimal balance that maximizes likelihood of mission success. Overview: IMPACT (Informed Mission Planning via Analysis of Complex Tradespaces) is a dynamic tool designed to estimate medical risk and outcomes for a specific mission design. In its current iteration, a list of medical conditions selected based on likelihood of occurrence and/or consequence was linked to a set of clinical capabilities and resources necessary for diagnosis and management. A probabilistic risk analysis tool was then used to identify and estimate the likelihood and consequence of risks through the following outcome metrics: loss of crew life (inflight mortality due to medical conditions), need for medical evacuation (return to definitive care), and crew disability (task time affected based on how medical conditions influence the ability to perform specific exploration mission crew tasks). Finally, the model’s optimization algorithm provides recommendations for medical capabilities that maximize risk mitigation relative to mass and volume constraints. In the Spring of 2023, IMPACT was utilized to estimate outcome metrics for a design reference mission that would be representative of an extended duration Artemis mission. Notional data generated were then used to determine a recommended set of medical capabilities and resources relative to user-defined mass and volume constraints. A multidisciplinary team has also been updating IMPACT to strengthen the model’s fidelity. Figure 1 shows how updates to outcome metric inputs for the conditions resulted in different capability and resource allocation recommendations. Discussion: This presentation will discuss the IMPACT tool and share the latest data generated for a representative extended duration Artemis mission. Efforts to improve the fidelity of data generated by the model’s algorithm will also be discussed.

K A Shair↗

Improving Quantification of Medical Evacuation Risk for Human Spaceflight in the IMPACT Model

Traditionally, mission planners have used a heuristic and qualitative approach to design medical systems based on prior experience however this approach may result in high variability and implicit bias to design and could put missions and crewmembers at risk. The Informing Mission Planning through Analysis of Complex Tradespaces (IMPACT) tool is a probabilistic risk assessment tool designed by NASA to model medical risk in long duration missions outside of low earth orbit (LEO). This tool can quantify risk metrics such as risk of crewmember death, loss of crew task time, and the need for medical evacuation to better inform and augment the more traditional approach to medical system design. The risk metric of Return to Definitive Care (RTDC) represents the likelihood of requiring medical evacuation and has been difficult to quantify in a reliable and standardized manner. Initial development of the RTDC metric was constrained due to the complexity of a medical evacuation decision and the lack of prior spaceflight data and this presentation will discuss the review and improvement process used to increase model accuracy and fidelity.

Prashant Parmar↗