Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Deep Learning Applications in Manned Spaceflight

This presentation discusses a basic overview of Deep Machine Learning (DML) fundamentals, and two JSC applications of DML to create an Intelligent Personal Coach for exercise applications on deep-space missions, and the training of a neural network using the SingleShotPose algorithm from Microsoft to detect object 6 degree of freedom pose information from 2D image data for use in an Intelligent Procedure Assistant. The presentation concludes with a discussion about conceptual future uses of DML for space missions.

augmented reality↗

Robust Semantic Mapping and Localization on a Free-Flying Robot in Microgravity

We propose a system that uses semantic object detections to localize a microgravity free-flyer. Many applications require absolute localization in a known reference frame, such as the execution of waypoint trajectories defined by human operators. Classical geometric methods build a map of point features, which may not be able to be associated after lighting or environmental changes. By contrast, semantics remain invariant to changes up to the robustness of the detection algorithm and motion of the semantic objects. In this work, we describe our approaches for both offline semantic map generation as well as online localization against a semantic map, intended to run in real-time on the robot. We additionally demonstrate how our semantic localizer outperforms image-feature matching in some cases, and show the robustness of the algorithm to environmental changes. Crucially, we show in our experiments that when semantics are used to supplement point features, localization is always improved. To our knowledge, these experiments demonstrate the first use of learned semantics for localization on a free-flying robot in microgravity.

Localization↗

Easy, Scalable Subsetting of GEDI Point Clouds

The GEDI Subsetter, a Python tool developed for NASA’s Multi-mission Algorithm and Analysis Platform (MAAP), optimizes the accessibility and visualization of GEDI point clouds by enabling users to efficiently subset data in a convenient, scalable manner. Complex science data often requires users to learn new software skills and handle many large files. Handling and cleaning large data sets is tedious and error-prone. These challenges significantly impede analysis. One of the goals of NASA's MAAP is to provide a platform that lowers the barrier to conducting research and analysis at scale. When a group of MAAP users wanted to conduct above-ground biomass estimation using GEDI data, we found that their existing workflow for leveraging GEDI data suffered from the barriers mentioned above. Furthermore, their workflow did not scale easily beyond a small number of granules. We found that existing tools related to GEDI data retrieval and subsetting were too limiting, so the GEDI Subsetter was written to support MAAP users’ needs. Being able to run many subsetting jobs simultaneously in the MAAP, and parallelizing the code itself, has led to significant speed improvements in obtaining relevant data, reducing subsetting time from hours to minutes. MAAP users can now more quickly and easily obtain only the data relevant to their research, by choosing which GEDI collection they want to work with (L1A, L2A, L2B, or L4A), and how they want to subset it, by specifying an area of interest, a temporal range, and relevant attributes. This has significantly reduced the feedback loop for users, allowing them to much more quickly subset GEDI data and begin their analysis. Although the GEDI Subsetter originally targeted users of the MAAP, it is generalized such that it can also be used outside of the MAAP and includes a command-line interface for convenience. Furthermore, with minor modifications, it should be possible to use it with non-GEDI data as the general pattern should be applicable to other sparse/track-based sensors.

Charles Daniels↗

System for Photogrammetric Imaging, Detection, and Ranging (SPIDR)

The System for Photogrammetric Imaging, Detection, and Ranging (SPIDR) project aims to advance the state-of-the-art (SOA) technology in camera tracking. SPIDR will advance this technology in the following ways: 1) perform autonomous tracking of rocket launches, 2) allow modularity for camera payloads to enable various types of imagery capture (standard video, high-speed, infrared, etc.), 3) enable additional imagery assets for increased scope of imagery analysis, and 4) serve as a viable tracking replacement for the existing Kineto Tracking Mount (KTM) system used by the Exploration Ground Systems (EGS) program. The project initially aimed to build an in-house mechanical design and control system, but realigned to a commercial off-the-shelf (COTS) mechanical design. During the FY23 CIF timeline, the SPIDR team made significant advances in building a machine-learning (ML) based object detection model for various rockets and their plumes. The team will continue advancing the model, and begin work on the pan and tilt unit (PTU) control system and tracking algorithm development.

Alden Param↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

reinforcement learning↗

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

Novel Hourly-Resolved Global Cloud Property Composite from Operational Satellites Imagers

Numerous applications in satellite remote sensing of surface properties, atmospheric state, composition, and radiation require accurate knowledge of the location and characteristics of clouds. Operational satellite imager radiances are valuable for cloud detection and for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. This paper describes a new global high-resolution dataset of cloud properties made available for community use that is constructed from analyses of a constellation of meteorological satellite imagers. Data taken from Meteosat-8/9 and -11, Himawari-8/9, GOES-16, and -17/-18, Aqua, Terra, Suomi-NPP and NOAA-20 are processed and composited on a 3-km grid to provide hourly global coverage. A historical multi-year dataset is available to serve various needs including modeling challenges related to cloud evaluations and parameterizations. Near real-time data products are also currently available between 60N and 60S. Efforts are underway to operationalize polar orbiting satellite cloud detection methods for low-latency applications over polar regions. The cloud detection and retrieval algorithms have been developed over many years to support NASA weather and climate programs such as the Clouds and Earth’s Radiant Energy System (CERES). To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. A brief description of the methods highlighting the unique aspects of the SatCORPS data products will be presented along with information on their status and availability.

SatCORPS↗

Applications of fuzzy logic to control and decision making

Long range space missions will require high operational efficiency as well as autonomy to enhance the effectivity of performance. Fuzzy logic technology has been shown to be powerful and robust in interpreting imprecise measurements and generating appropriate control decisions for many space operations. Several applications are underway, studying the fuzzy logic approach to solving control and decision making problems. Fuzzy logic algorithms for relative motion and attitude control have been developed and demonstrated for proximity operations. Based on this experience, motion control algorithms that include obstacle avoidance were developed for a Mars Rover prototype for maneuvering during the sample collection process. A concept of an intelligent sensor system that can identify objects and track them continuously and learn from its environment is under development to support traffic management and proximity operations around the Space Station Freedom. For safe and reliable operation of Lunar/Mars based crew quarters, high speed controllers with ability to combine imprecise measurements from several sensors is required. A fuzzy logic approach that uses high speed fuzzy hardware chips is being studied.

Lea, Robert N.↗

Repetitive control in the presence of multiple periodic disturbances

In this paper, the authors introduce several methods for implementing repetitive control of systems subjected to noninteger multiple periodic disturbances. One method uses a single repetitive controller to learn at the common period of the disturbances. The second employs multiple p-integrator based repetitive controllers operating in parallel. The third method introduces the concept of sequenced repetitive controllers. Cross-talk elimination algorithms are proposed to improve the repetitive control performance in the presence of transients. A novel averaging algorithm is introduced for on-line and off-line control strategies.

Solcz, Edward J.↗

NASA Tech Briefs, August 2009

Topics covered include: Aligning a Receiving Antenna Array to Reduce Interference; Collecting Ground Samples for Balloon-Borne Instruments; Tethered Pyrotechnic Apparatus for Acquiring a Ground Sample; Enhanced Video-Oculography System; Joint Carrier-Phase Synchronization and LDPC Decoding; Dual-Polarization, Sideband-Separating, Balanced Receiver for 1.5 THz Modular Battery Charge Controller; Efficient Multiplexer FPGA Block Structures Based on G4FETs; VLSI Microsystem for Rapid Bioinformatic Pattern Recognition; Low-Noise Amplifier for 100 to 180 GHz; Improved Fabrication of Ceramic Matrix Composite/Foam Core Integrated Structures; Inert Welding/Brazing Gas Filters and Dryers; Fabricating Copper Nanotubes by Electrodeposition; Reducing Aerodynamic Drag on Empty Open Cargo Vehicles; Rotary Percussive Auto-Gopher for Deep Drilling and Sampling; More About Reconfigurable Exploratory Robotic Vehicles; Thermostatic Valves Containing Silicone-Oil Actuators; Improving Heat Flux Performance of Flat Surface in Spray-Cooling Systems; Treating Fibrous Insulation to Reduce Thermal Conductivity; Silica-Aerogel Composites Opacified with La(sub0.7)Sr(sub0.3)MnO3; Cyclic Oxidation Behavior of CuCrAl Cold-Sprayed Coatings for Reusable Launch Vehicles; Ceramic Fiber Structures for Cryogenic Load-Bearing Applications; Elastomer Reinforced with Carbon Nanotubes; Biologically Inspired Purification and Dispersion of SWCNTs; A Technique for Adjusting Eigenfrequencies of WGM Resonators; Low-Pressure, Field-Ionizing Mass Spectrometer; Modifying Operating Cycles to Increase Stability in a LITS; Chamber for Simulating Martian and Terrestrial Environments; Algorithm for Detecting a Bright Spot in an Image; Extreme Programming: Maestro Style; Adaptive Behavior for Mobile Robots; Protocol for Communication Networking for Formation Flying; Planning Complex Sequences Using Compressed Representations; and Self-Supervised Learning of Terrain Traversability from Proprioceptive Sensors.

Source record↗

Doppler Radar Profiler for Launch Winds at the Kennedy Space Center (Phase 1a)

The NASA Engineering and Safety Center (NESC) received a request from the, NASA Technical Fellow for Flight Mechanics at Langley Research Center (LaRC), to develop a database from multiple Doppler radar wind profiler (DRWP) sources and develop data processing algorithms to construct high temporal resolution DRWP wind profiles for day-of-launch (DOL) vehicle assessment. This document contains the outcome of Phase 1a of the assessment including Findings, Observations, NESC Recommendations, and Lessons Learned.

Murri, Daniel G.↗

Robust Algorithm for Estimating Total Suspended Solids (TSS) in Inland and Nearshore Coastal Waters

One of the challenging tasks in modern aquatic remote sensing is the retrieval of near-surface concentrations of Total Suspended Solids (TSS). This study aims to present a Statistical, inherent Optical property (IOP) -based, and muLti-conditional Inversion proceDure (SOLID) for enhanced retrievals of satellite-derived TSS under a wide range of in-water bio-optical conditions in rivers, lakes, estuaries, and coastal waters. In this study, using a large in situ database (N > 3500), the SOLID model is devised using a three-step procedure: (a) water-type classification of the input remote sensing reflectance (R(sub rs)), (b) retrieval of particulate backscattering (b(sub bp)) in the red or near-infrared (NIR) regions using semi-analytical, machine-learning, and empirical models, and (c) estimation of TSS from b(sub bp) via water-type-specific empirical models. Using an independent subset of our in situ data (N = 2729) with TSS ranging from 0.1 to 2626.8 [g/m (exp 3)], the SOLID model is thoroughly examined and compared against several state-of-the-art algorithms (Miller and McKee, 2004; Nechad et al., 2010; Novoa et al., 2017; Ondrusek et al., 2012; Petus et al., 2010). We show that SOLID outperforms all the other models to varying degrees, i.e., from 10 to > 100%, depending on the statistical attributes (e.g., global versus water-type-specific metrics). For demonstration purposes, the model is implemented for images acquired by the MultiSpectral Imager aboard Sentinel-2A/B over the Chesapeake Bay, San-Francisco-Bay-Delta Estuary, Lake Okeechobee, and Lake Taihu. To enable generating consistent, multimission TSS products, its performance is further extended to, and evaluated for, other missions, such as the Ocean and Land Color Instrument (OLCI), Moderate Resolution Imaging Spectroradiometer (MODIS), Visible Infrared Imaging Radiometer Suite (VIIRS), and Operational Land Imager (OLI). Sensitivity analyses on uncertainties induced by the atmospheric correction indicate that 10% uncertainty in Rrs leads to < 20% uncertainty in TSS retrievals from SOLID. While this study suggests that SOLID has a potential for producing TSS products in global coastal and inland waters, our statistical analysis certainly verifies that there is still a need for improving retrievals across a wide spectrum of particle loads.

Total suspended solids↗

Global SO 2 Data Record from OMPS Instruments on the JPSS Constellation

NASA’s Earth Observing System (EOS) SO 2 climate data record (CDR) started in 2004, with the launch of the Aura/Ozone Monitoring Instrument (OMI) and is now being continued with the SNPP/Ozone Mapping and Profiler Suite (OMPS) launched in 2011. Both OMI and SNPP/OMPS SO 2 CDRs are produced with the Goddard principal component analysis (PCA) spectral fitting algorithm. An advantage of the data-driven PCA retrieval technique is that it enables highly consistent retrievals from different instruments, by inherently accounting for various instrumental factors. To further extend the EOS SO 2 CDR, we are implementing the PCA SO 2 retrieval algorithm with the L1B measurements from OMPS instruments flying on the Joint Polar Satellite System (JPSS) constellation. In this presentation, we will provide an update on our progress in NOAA-20 (launched in 2017) and NOAA-21 (launched in 2022) PCA SO2 retrievals. We will focus on our new NOAA-20/OMPS PCA SO 2 EOS continuity product, to be publicly released in fall of 2023. We will present statistical analyses on the quality of NOAA-20 PCA SO 2 product, including retrieval noise, biases over background areas, and long-term stability. We will compare our PCA SO 2 retrievals from NOAA-20 with those from OMI, SNPP/OMPS, and S5P/TROPOMI (TROPOspheric Monitoring Instrument) for anthropogenic sources as well as large volcanic plumes. We will also discuss the application of a new machine learning technique that helps to further reduce the noise of NOAA-20 SO 2 retrievals. In addition, we will present preliminary PCA SO 2 retrievals from NOAA-21/OMPS, including those from direct readout implementation for aviation disaster avoidance. Finally, we will share some first results applying the PCA algorithm to NASA’s geostationary TEMPO (Tropospheric Emissions: Monitoring of Pollution) instrument to obtain hourly, high resolution SO 2 data over North America.

SO2↗

Determination of the mass properties of a manipulator

Space applications for telerobotics requires a manipulator that is robust to the large payload variations that occur in a zero-g environment. One approach to provide the required performance for this large payload variation is to provide inertial decoupling to the controller. The equations to generate the required joint torques can be obtained in several manners but the independent parameters required to perform the calculations are difficult to obtain. This presentation consists of an overview of the inertial decoupling control system and discusses how to reduce the inertial parameter set to a minimum and obtain the required parameter set to a minimum and obtain the required parameter vector using sensed joint positions and torques. In addition, as telerobotic technology becomes more prevalent in the space environments the ability to emulate the effect of zero-g in a one-g environment is critical in learning how to perform tasks in space. To emulate the zero-g environment it is necessary to remove the effect of gravity on the manipulator by determining the feedforward joint torques. A subset of the algorithm developed to obtain the decoupling parameters is used to obtain the gravity offload parameters. These parameters are used to eliminate the effect of gravity. The algorithm is validated on Martin Marietta/NASA Langley's, 7 Degrees-Of-Freedom (DOF) Flight Telerobotic Servicer Hydraulic Manipulator Test Bed. A video portraying actual results of the algorithm is provided.

Goldenberg, Stewart↗

Machine-learning Solution for Automatic Spacesuit Motion Recognition and Measurement from Conventional Video

Extravehicular Activity (EVA) spacesuits exhibit unique movement patterns due to their design characteristics. Mobility assessments using traditional motion capture systems are cost prohibitive and not feasible for some training conditions (e.g., simulated lunar outdoor terrain). This paper aims to present the ongoing development of machine learning solutions to quantify suit motions from conventional videos without special sensors or hardware. Preliminary work into this field was promising but given the fast growth in deep/machine learning technologies, external expertise was sought from open-source communities. Partnerships were formed with the NASA JSC Center of Excellence for Collaborative Innovation (CoCEI) and an execution crowdsourcing platform partner to solicit machine learning framework developments from external contenders. NASA provided contenders with images and video clips of spacesuits with simultaneously measured motion capture data during EVA simulation tasks. The contenders used this data to train and develop generalized algorithms to predict motions. At the end of the crowdsourcing event, the top five solutions were selected from 250 submissions. Each submission was tested and scored using video clips not previously disclosed to the contenders. The weighted scoring metrics measured how well the algorithm detected the suit shape, the 2D suit joint detection accuracy, and 3D joint detection accuracy. The winning solution was able to achieve roughly 85% prediction accuracy. Overall, the algorithms could efficiently detect various types of spacesuits and motions across different EVA environments such as the NASA Active Response Gravity Offload System (ARGOS). After continued improvements and validation, the fully developed system will enable EVA stakeholders to quantify suit kinematic patterns, which can help optimize suit, hardware, and task designs.

Linh Vu↗

Estimating groundwater use and demand in arid Kenya through assimilation of satellite data and in-situ sensors with machine learning toward drought early action

Groundwater is an important source of water for people, livestock, and agriculture during drought in the Horn of Africa. In this work, areas of high groundwater use and demand in drought-prone Kenya were identified and forecasted prior to the dry season. Estimates of groundwater use were extended from a sentinel network of 69 in-situ sensored mechanical boreholes to the region with satellite data and a machine learning model. The sensors contributed 756 site-month observations from June 2017 to September 2021 for model building and validation at a density of approximately one sensor per 3700 sq.km. An ensemble of 19 parameterized algorithms was informed by features including satellite-derived precipitation, surface water availability, vegetation indices, hydrologic land surface modeling, and site characteristics to dichotomize high groundwater pump utilization. Three operational definitions of high demand on groundwater infrastructure were considered: 1) mechanical runtime of pumps greater than a quarter of a day (6+ hr) and daily per capita volume extractions indicative of 2) domestic water needs (35+ L), and 3) intermediate needs including livestock (75+ L). Gridded interpolation of localized groundwater use and demand was provided from 2017 to 2020 and forecasted for the 2021 dry season, June–September 2021. Cross-validated skill for contemporary estimates of daily pump runtime and daily volume extraction to meet domestic and intermediate water needs was 68%, 69%, and 75%, respectively. Forecasts were externally validated with an accuracy of at least 56%, 70%, or 72% for each groundwater use definition. The groundwater maps are accessible to stakeholders including the Kenya National Drought Management Authority (NDMA) and the Famine Early Warning Systems Network (FEWS NET). These maps represent the first operational spatially-explicit sub-seasonal to seasonal (S2S) estimates of groundwater use and demand in the literature. Knowledge of historical and forecasted groundwater use is anticipated to improve decision-making and resource allocation for a range of early warning early action applications.

Katie Fankhauser↗