Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ground truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Understanding Machine Learning in Earth Science: A Natural Language Processing Approach

Machine learning (ML) is being increasingly utilized in Earth science research. Benefits of ML include efficiency, reduction of human error, and ability to extract hidden patterns within data. However, the mutual lack of each other’s domain knowledge by ML and Earth science stands as a barrier to timely and effective implementation. Earth science, in particular, faces challenges in generating sample data, compared to those of traditional ML problems such as face recognition or stock predictions, where data is abundant and not lacking in ground truth, which is necessary for labeling. Earth science data are more varying in formats, such as HDF5 and image resolutions, and are not standardized across instruments, even within a given Earth science discipline. Previous studies have been done to outline the specific challenges that Earth science faces with ML, while others have focused on using existing publications to mine information efficiently. Other resources such as Scikit-Learn have developed decision trees for choosing appropriate machine learning algorithms, but application within Earth science subjects becomes much more complex. For the current study, we propose a methodology and tool that aids in implementation of ML in Earth science using natural language processing (NLP). Our work comprises three main parts: (1) analyzing existing publications related to ML and Earth science, using natural language processing: (2) extracting from the publications information on ML models subjects in Earth Science: and (3) visualizing the extracted relationships as a network graph. The resulting network graph should aid the Earth science communities in applying optimal ML algorithms and guiding data preparation through visualization of similar studies. The network graph and analysis of document similarity will be the basis of our next step, which is to develop a decision tree for selecting optimal machine learning methodologies for specified Earth science applications.

Zheng, Laura↗

Neutron Measurements at the Lunar Surface (NMLS)

The Neutron Measurement System (NMS-Lunar) is an instrument payload manifested on Astrobotic’s Peregrine Mission One (M1). Astrobotic Mission One will land at Lacus Mortis (~44oN, 254oE). Astrobotic will fly up to fourteen NASA payloads to the lunar surface in addition to other payload customers on M1. NMS-Lunar is a re-design of the MSFC Fast Neutron Spectrometer (FNS) currently operating on the ISS. The design of NMS-Lunar enables operation on the lunar surface, integration onto the Peregrine lander, and measurement of thermal neutron count rates on the lunar surface. The primary science objectives for NMS-Lunar is to provide ground truth of mapped neutron data from the Lunar Reconnaissance Orbiter and Lunar Prospector missions. Neutrons are created when galactic cosmic rays interact with the lunar regolith, and can provide valuable elemental composition information.

Haviland, H. Fuqua↗

PHALANX: Expendable Projectile Sensor Networks for Planetary Exploration

Technologies enabling long-term, wide-ranging measurement in hard-to-reach areas are a critical need for planetary science inquiry. Phenomena of interest include flows or variations in volatiles, gas composition or concentration, particulate density, or even simply temperature. Improved measurement of these processes enables understanding of exotic geologies and distributions or correlating indicators of trapped water or biological activity. However, such data is often needed in unsafe areas such as caves, lava tubes, or steep ravines not easily reached by current spacecraft and planetary robots. To address this capability gap, we have developed miniaturized, expendable sensors which can be ballistically lobbed from a robotic rover or static lander - or even dropped during a flyover. These projectiles can perform sensing during flight and after anchoring to terrain features. By augmenting exploration systems with these sensors, we can extend situational awareness, perform long-duration monitoring, and reduce utilization of primary mobility resources, all of which are crucial in surface missions. We call the integrated payload that includes a cold gas launcher, smart projectiles, planning software, network discovery, and science sensing: PHALANX. In this paper, we introduce the mission architecture for PHALANX and describe an exploration concept that pairs projectile sensors with a rover “mothership.” Science use cases explored include reconnaissance using ballistic cameras, volatiles detection, and building timelapse maps of temperature and illumination conditions. Strategies to autonomously coordinate constellations of deployed sensors to self-discover and localize with peer ranging (i.e. a “local GPS”) are summarized, thus providing communications infrastructure beyond-line-of-sight (BLOS) of the rover. Capabilities were demonstrated through both simulation and physical testing with a terrestrial prototype. The approach to developing a terrestrial prototype is discussed, including design of the launching mechanism, projectile optimization, micro-electronics fabrication, and sensor selection. Results from early testing and characterization of commercial-off-the-shelf (COTS) components are reported. Nodes were subjected to successful burn-in tests over 48 hours at full logging duty cycle. Integrated field tests were conducted in the Roverscape, a half-acre planetary analog environment at NASA Ames, where we tested up to 10 sensor nodes simultaneously coordinating with an exploration rover. Ranging accuracy has been demonstrated to be within +/-10cm over 20m using commodity radios when compared to high-resolution laser scanner ground truthing. Evolution of the design, including progressive miniaturization of the electronics and iterated modifications of the enclosure housing for streamlining and optimized radio performance are described. Finally, lessons learned to date, gaps toward eventual flight mission implementation, and continuing future development plans are discussed.

Dille, Michael↗

The Future of Oaks in the Santa Monica Mountains: A Case Study in Using Remote Sensing Data for Species Distributions Models

The Woolsey Fire began on November 8, 2018, and lasted for almost two weeks, during which it burned almost 100,000 acres of valuable landscape and habitat, including a vast area of woodland. The persistence of key woodland species provides aesthetic, monetary, and ecological value to the landscape through carbon sequestration, air temperature moderation, and erosion mitigation, among other ecosystem services. This study investigated the impact of the Woolsey Fire on native woodland species distributions and identified areas suitable for restoration within the Santa Monica Mountains National Recreation Area. The team partnered with the Resource Conservation District of the Santa Monica Mountains; National Park Service, Santa Monica Mountains National Recreation Area; California Department of Parks and Recreation, Los Angeles County Division; County of Los Angeles Fire Department, Prevention Services Bureau, Forestry Division; County of Los Angeles Department of Regional Planning; and the University of Montana. The Earth observations used include data from Landsat 8 Operational Land Imager, NASA ER-2 Jet Airborne Visible InfraRed Imaging Spectrometer, Shuttle Radar Topography Mission, and RapidEye. The team produced maps of burn severity from the Woolsey Fire, its impact on plant species distributions, and habitat suitability projections for 2050 and 2099 to assist partners in prioritizing areas for restoration. A plant community classification was successfully created using Multiple Endmember Spectral Mixture Analysis (MESMA). Overall accuracy was assessed at 90.54% by comparing the classification to validation pixels derived from ground truth information provided by our partners.

Roger Ly↗

Vibration-based health characterization of multiple IMUs in UAV applications

Inertial measurement units (IMUs) are vital in UAV navigation for vehicle attitude and position estimation, especially in the frequently-occurring case of temporary loss of GPS capabilities. Degradation in these units could yield inaccurate position estimates, resulting in incorrect input for vehicle control systems. A wide variety of these units exist to meet the needs of UAV operators, general aviation, and military vehicles. In recent decades, lightweight and inexpensive MEMS sensors have grown in popularity with respect to UAVs. Studies into the failure modes of MEMS devices suggest that vibration is one of the leading causes of MEMS degradation. MEMS sensors are generally encased in their own hermetic packaging, as their small size and sensitivity cause them to be particularly vulnerable to air damping and particulate contamination when exposed. Exposure to excessive vibration can cause cracking in this packaging as well as damage to connecting electronics, with recorded results that cause sensors to act outside of their specifications, potentially providing unreliable input to controllers. A prior study from the Politecnico di Torino looked into the degradation of MEMS IMUs, specifically the AXIS-AIS402, for aerospace and vibrating environments. In the study, the authors found that after exposing MEMS IMUs to simulated vibrations from working conditions of aerospace applications, the sensors showed increased noise and increased bias instability. At NASA Ames, several widely-used MEMS IMUs were selected for a new IMU degradation study, comparing accelerometer performance before and after exposure to similar levels of vibration simulating aerospace conditions. The IMUs were selected from the Pixhawk autopilot systems, hobby sUAS, or prior experimental studies at NASA. Additionally, the industrial grade VectorNav-100 IMU was selected as a ground truth reference point to which the performance of the test sensors can be compared. In the study, each sensor is exposed to functional levels of UAV vibration as replicated on a single-frequency vibratory table in the NASA Ames SHARP Laboratory, and each accelerometer is characterized for bias, drift, and noise characteristics both before and after vibratory exposure. The focus of this study is to monitor the health of the IMU sensors and determine if sensor degradation can be detected from output error and frequency spectrum analysis, rather than from microscopic examination of the sensors. In this case, sensor degradation and faulty data can be more easily detectable by non-experts hoping to use these sensors as an important piece of an integrated package. In addition, specific sensor degradation modes potentially leading to in-flight hazards could be identified, such as accelerated levels of drift and altered temperature response. The overall goal of this work is to increase levels of safety for future users of these sensors and to provide a clear analysis of sensor limitations currently lacking in most sensor specification documentation.

IMUs↗

Hail Storm Risk Assessment Using Space-Borne Remote Sensing Observations and Reanalyses

Much of the world is impacted by severe thunderstorms, but whether they become disasters depends upon resilience--our capacity to prepare, mitigate, respond, and recover. Hail is the costliest severe weather hazard for the insurance industry, generating ~70% of severe convective storm losses due to damage to assets such as homes, businesses, agriculture, and infrastructure. Most insurance companies do not reserve enough capital to cover catastrophes, so they acquire reinsurance. The reinsurance industry uses catastrophe models (CatModels) to statistically estimate risk to an insurer’s portfolio. Hail CatModels are developed with climatologies that define hailstorm frequency and severity. Hail-prone areas can be defined using hail reports from trained spotters, the media, and the general public. Extremely severe hail (2+ inch diameter) occurs nearly every day across the world. Weather radars can detect hail because hailstones strongly reflect microwave signals that they emit. However, hail climatologies are difficult to derive because hail covers small areas and there are neither hail reporting mechanisms (e.g. website or mobile app) nor radar networks in most places outside the US and Europe. This lack of ground truth on severe hail puts society and economies at risk. Hail is generated within storms by strong updrafts. These updrafts exhibit unique signatures in NASA and other agency satellite observations, offering new opportunities for hailstorm analysis. Geostationary (GEO) visible and infrared imagery has been collected for ~15-25 years across the world (region dependent) and methods have been developed at NASA Langley Research Center (LaRC) to detect hailstorm updrafts using GEO imagery. Climatological GEO updraft data has been used by Willis Towers Watson (WTW), a leader in catastrophe risk assessment for the insurance industry, and Karlsruhe Institute of Technology to develop CatModels over Europe and Australia. Hail can also be inferred with passive microwave imagery collected by low-Earth-orbiting sensors such as the GPM GMI, TRMM TMI, AMSR-E, AMSR-2, SSM/I, and SSMIS over the last 20+ years using methods developed at the Marshall Space Flight Center (MSFC). Hailstorms generate enhanced lightning flash rates that can be tracked using new GOES-R series GEO Lightning Mapping (GLM) imagery. Atmospheric reanalyses can be used to define favorable hailstorm environments for combination with the satellite-based storm detections. This presentation will describe a framework for developing continental to global hail climatologies and CatModels based on NASA satellite data and capabilities. This is a collaboration between LaRC and MSFC, WTW, and partners in Brazil, Argentina, and South Africa. This project seeks to mitigate hail disasters by aiding development of new satellite-based severe storm nowcasting tools by regional partners and developing climatologies to improve societal understanding of hail frequency. GEOO visible and infrared metrics of storm intensity, environmental conditions based on reanalyses, spotter hail reports and radar MESH observations are intercompared to quantify the detectability of hailstorms, and our ability to discriminate hailstorms from other severe storms. We are also maturing methods using land surface imaging satellite data (e.g. MODIS, Landsat, Sentinel 1 and 2) to identify hail damage to agriculture. Work with WTW will improve socioeconomic resilience through development of new CatModels. Southern Brazil, Uruguay, Paraguay, and Argentina feature some of the most intense thunderstorms on Earth. South America and South Africa are developing insurance markets of interest to WTW clients, and is similar to other regions routinely impacted by hail that do not have comprehensive hail reporting or radars to assess hailstorm frequency. Project datasets will be made available via online GIS-enabled tools developed at the LaRC Atmospheric Science Data Center (ASDC) which will visualize data and provide it in multiple formats for use in a wide range of open source and commercial tools.

Kristopher Michael Bedka↗

Artemis III Neutron Surface Science

This paper highlights lunar neutron science that can be performed in support of the Artemis 2024 mission within 6 degrees of the lunar south pole. There are two primary science goals: the characterization of the radiation environment, and secondly, inference of regolith composition including the presence of water. Characterizing the surface radiation environment is important for risk identification and mitigation during crewed lunar missions. The lunar surface radiation environment includes a unique neutron contribution. The relative contribution from neutrons is higher outside the shielding effects of Earth’s magnetic field, which the Moon experiences ~25% of its orbit. To evaluate the radiation risk to astronauts at the lunar surface, fast neutron measurements are needed. Neutrons are generated when galactic cosmic rays (GCR) collide with the lunar regolith and provide valuable elemental composition information about the near surface (< 1m). For the characterization of regolith composition, a low energy neutron spectrometer or counter can determine surface composition. This provides ground truth for orbital neutron data from the Lunar Reconnaissance Orbiter and Lunar Prospector missions.

Lunar science, Moon, geology, geophysics, neutron ↗

Mercury Lander: Transformative Science from the Surface of the Innermost Planet

As an end-member of terrestrial planet formation, Mercury holds unique clues about the original distribution of elements in the earliest stages of solar system development and how planets and exoplanets form and evolve in close proximity to their host stars. This Mercury Lander mission concept enables in situ surface measurements that address several fundamental science questions raised by MESSENGER’s pioneering exploration of Mercury. Such measurements are needed to understand Mercury’s unique mineralogy and geochemistry; to characterize the proportionally massive core’s structure; to measure the planet’s active and ancient magnetic fields at the surface; to investigate the processes that alter the surface and produce the exosphere; and to provide ground truth for current and future remote datasets. NASA’s Planetary Mission Concept Studies (PMCS) program awarded this study to a multidisciplinary team led by Dr. Carolyn Ernst of the Johns Hopkins Applied Physics Laboratory (APL), to evaluate the feasibility of accomplishing transformative science through a New-Frontiers-class, landed mission to Mercury in the next decade. The resulting mission concept achieves one full Mercury year (~88 Earth days) of surface operations with an ambitious, high-heritage, landed science payload, corresponding well with the New Frontiers mission framework.

Mercury lander↗

Examining Soil Freeze/Thaw Remote Sensing Using NASA’s SLAPex Freeze/Thaw Airborne Campaign

Around half the exposed land of the Northern Hemisphere experiences seasonal freezing and thawing. The changes to the soil thermal, hydraulic, and mechanical properties are large and these, in turn, exert significant controls on the water, energy, and carbon cycles of the affected regions. Wide-area freeze/thaw discrimination via microwave remote sensing is possible using both passive and active techniques. We explore freeze/thaw remote sensing using observations from NASA’s Scanning L-band Active Passive (SLAP) airborne sensor during the SLAPex Freeze/Thaw campaign near Winnipeg, Canada in November, 2015. SLAP is an airborne simulator of the Soil Moisture Active Passive (SMAP) satellite mission. The SLAPex Freeze/Thaw dataset is a unique dataset that allows comparison of airborne-derived freeze/thaw state (plus soil moisture for thawed areas) against in-situ ground truth, satellite-derived freeze/thaw from SMAP, as well as tower-based passive microwave freeze/thaw observations. The sensitivity of passive and active microwave sensing to different depths of freezing and different dielectric models (when soil moisture is retrieved) is examined, and the spatial scaling of heterogeneous frozen/thawed pixels is also explored. Implications for the accuracy of satellite-based freeze/thaw discrimination are discussed.

Edward Kim↗

Monocular Ranging for Small Unmanned Aerial Systems in the Far-Field

Recent proliferation of small Unmanned Aerial Systems (sUAS) applications requires onboard collision avoidance systems to mitigate the risk of collision with non-cooperative aircraft and manned aircraft, which may not see sUAS in time to perform an avoidance maneuver. An attractive avenue for onboard collision avoidance is the utilization of machine vision cameras due to their low size, weight and power (SWaP) requirements. In this paper, we characterize the range performance of a machine vision system developed in-house and mounted onto an sUAS. The technique was designed to estimate the performance of a sense-and-avoid system to ensure that the sensing components meet the well-clear requirements for the chosen platform and avoidance strategy. Experimental flight-test data was acquired from test-flights flown along multiple collision geometries for two intruders: a general Aviation (GA) aircraft and a fixed-wing sUAS. The ownship and both intruders were instrumented with inertial navigation systems (INS) recording position and attitude information. The range at first detection, 𝑹𝟎, was extracted from in-flight imagery of head-on collision course geometry synchronized with INS data from both aircraft and ground-truth values extracted from the raw imagery. This initial detection distance, 𝑹𝟎, scales with atmospheric attenuation. Therefore, under clear sky conditions, the derived 𝑹𝟎 value represents the upper bound on the detection range achievable by the test configuration of the detector. Results indicate that the maximum initial detection distance for a 4k resolution action camera fitted with a 41º Field of View (FOV) lens is 2.763 ± 0.037 km for a GA aircraft and 0.881 ± 0.061 km for a fixed-wing sUAS, respectively. The in results this study suggest that a vision-based detect and track system may be analyzed using the sensor characterization and contextualized within aircraft well-clear volumes.

Chester V. Dolph↗

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions.This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

synthetic data↗

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions. This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

James Ecker↗

In Situ Geochronology for the Next Decade

Geochronology, or determination of absolute ages for geologic events, underpins many inquiries into the formation and evolution of planets and our Solar System. The bombardment chronology inferred from lunar samples has played a significant role in the development of models of early Solar System and extrasolar planet dynamics, as well as the timing of volatile, organic, and siderophile element delivery. Absolute ages of ancient and recent magmatic products provide strong constraints on the dynamics of magma oceans and crustal formation, and the longevity and evolution of interior heat engines and distinct mantle/crustal source regions. Absolute dating also relates habitability markers to the timescale of evolution of life on Earth. The number of geochronologically-significant terrains across the inner Solar System far exceeds our ability to conduct sample return to all of them. Therefore NASA has invested in the development of in situ dating techniques; several such instruments will be TRL 6 by the time of the next Decadal Survey. We formulated a set of medium-class (New Frontiers) mission concepts to three different locations (the Moon, Mars, and Vesta) with a notional payload consisting of the CDEX and KArLE instruments to measure radiometric ages, an imaging spectrometer and optical cameras to provide site geologic context and sample characterization, an ICP-MS to augment sample contextualization, and a sample acquisition and handling system. A Vesta hopper and single-site lunar and Mars landers to advance Solar System chronology fit into the New Frontiers cost cap in our study. Such missions would also enable a broad suite of geologic investigations such as basic geologic characterization, geomorphologic analysis, establishing ground truth for remote sensing analyses, analyses of major, minor, trace, and volatile elements, atmospheric and other long-lived monitoring, organic molecule analyses, and soil and geotechnical properties.

Barbara A Cohen↗

The ANGSA Program: A Low-cost Lunar "Sample Return Mission". An Overview and Progress over the Last 18 Months

The Apollo Program returned 381 kg of samples. Analyses of these samples have provided fundamental insights into the origin and history of the Earth-Moon system and how planets and even solar systems work. These samples have provided ground truth for every post-Apollo mission to the Moon for the interpretation of remotely sensed data. After 50 years of analysis and study, our sophistication for handling and examining samples has greatly increased. Some special samples that were collected or preserved in unique containers or environments remain unexamined by standard or advanced analytical approaches. The Apollo Next Generation Sample Analysis (ANGSA) Program was designed to examine a subset of these special samples. The ANGSA consortium consists of 9 original teams funded by NASA that have combined into a single science team referred to as the ANGSA Science Team. The program was designed to function as the sample analysis portion of a sample return mission with processing, preliminary examination, and analyses utilizing new and improved technologies and recent mission observations. The ANGSA Program links the first generation of lunar explorers (Apollo) with future explorers of the Moon (Artemis). The purpose of this abstract is to highlight the ANGSA samples, science and engineering goals, and progress made so far. Related abstracts and talks will focus on the links between Apollo and Artemis, geologic context, and initial examination, processing, and results.

F M McCubbin↗

GLOBE Observer and the GO on a Trail Data Challenge: A Citizen Science Approach to Generating a Global Land Cover Land Use Reference Dataset

Land cover and land use are highly visible indicators of climate change and human disruption to natural processes. While land cover is frequently monitored over a large area using satellite data, ground-based reference data is valuable as a comparison point. The NASA-funded GLOBE Observer (GO) program provides volunteer-collected land cover photos tagged with location, date and time, and, in some cases, land cover type. When making a full land cover observation, volunteers take six photos of the site, one facing north, south, east, and west (N-S-E-W) respectively, one pointing straight up to capture canopy and sky, and one pointing down to document ground cover. Together, the photos document a 100 meter square of land. Volunteers may then optionally tag each N-S-E-W photo with the land cover types present. Volunteers collect the data through a smartphone app, also called GLOBE Observer, resulting in consistent data. While land cover data collected through GLOBE Observer is ongoing, this paper presents the results of a data challenge held between June 1 and October 15, 2019. Called “GO on a Trail,” the challenge focused on collecting land cover observations at designated points along the Lewis and Clark National Historic Trail (LCNHT), which transects approximately 7,900 kilometers of the United States from east to west. The challenge also included an international component in which participants were recognized for the most data collected during the period. The challenge resulted in more than 2800 land cover data points from around the world with just over 900 land cover data points along the LCNHT. The data collected along the LCNHT is largely within a 1,000 meter corridor along the historic route. Internationally, the challenge had strong participation in Australia, where a Scouts Australia team-based competition was conducted in conjunction with GO on a Trail. GLOBE Observer collections can serve as reference data, ground truthing satellite imagery for the improvement and verification of broad land cover maps. Continued collection using this protocol will build a database documenting climate-related land cover and land use change into the future.

land cover↗

Radar observations of recent Mars landing sites

This paper will present results of terrestrial delay-Doppler radar observations of the landing sites, predictions for the surface properties that will be encountered, and, after successful landings, correlation between the predicted and observed surface properties. The in-situ observations made by both missions serve as ground truth for the validation of the high resolution radar mapping results.

Slade, M. A.↗

A New Parametrization of the Rain Drop Size Distribution

This paper revisits the problem of finding a parametric form for the rain drop size distribution (DSD) which 1) is an appropriate model for tropical rainfall, and 2) involves statistically independent parameters. Using TOGA/COARE data, we derive a parametrization which meets these criteria. This new parametrization is an improvement on the one that was derived in [3] using TRMM ground truth data from Darwin, Australia. The new COARE data allows us to verify that the spatial variability fo the two

rain↗