Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transfer learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Enriching the Twitter Stream Increasing Data Mining Yield and Quality Using Machine Learning

Social media data streams are important sources of real-time and historical global information for science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we are exploring the Twitter data stream for its potential in augmenting the validation program of NASA Earth science missions, specifically the Global Precipitation Measurement (GPM) mission. We have implemented a tweet processing infrastructure that outputs classified precipitation tweets. Inputs are "passive" tweets, along with a smaller number of tweets from "active" participants, i.e., those knowingly contributing to our effort. The "active" tweets, presumably of higher quality, enrich the Twitter stream. "Active" sources include data scraped from other social media (e.g., public Facebook posts) and data from existing crowdsourcing programs (e.g., mPING reports). In addition, there is likely relevant precipitation information in images and documents that are the end points of links often included in tweets. Information derived from these "active" sources could then be tweeted into the Twitter stream, thus enriching its quality. The objective of our current work is to mine these tweet­ linked images and documents, using neural networks, to increase the information content and quality related to precipitation. For images, we classified them as either precipitation-related or not. For training and validation, we used images obtained via the Google custom search API. We created two models: (1) by training a simple Convolutional Neural Network and (2) by using transfer learning principles to adapt a pre-trained object recognition model. For documents, both those linked to tweets and the tweet contents, we trained Hierarchical Attention Networks to determine precipitation occurrence, type, and intensity. For training and validation, we used a keyword-filtered tweet data set labelled with ground truth data from Dark Sky (an API to retrieve weather-related labels) and the National Severe Storms Laboratory's Multi­ Radar/Multi-Sensor (MRMS) system. Our results demonstrated the efficacy of our machine learning approaches for enriching the Twitter stream, to derive information potentially useful for validation of earth science satellite data.

Albayrak, Arif↗
NASA NTRS2011

Feature Acquisition with Imbalanced Training Data

This work considers cost-sensitive feature acquisition that attempts to classify a candidate datapoint from incomplete information. In this task, an agent acquires features of the datapoint using one or more costly diagnostic tests, and eventually ascribes a classification label. A cost function describes both the penalties for feature acquisition, as well as misclassification errors. A common solution is a Cost Sensitive Decision Tree (CSDT), a branching sequence of tests with features acquired at interior decision points and class assignment at the leaves. CSDT's can incorporate a wide range of diagnostic tests and can reflect arbitrary cost structures. They are particularly useful for online applications due to their low computational overhead. In this innovation, CSDT's are applied to cost-sensitive feature acquisition where the goal is to recognize very rare or unique phenomena in real time. Example applications from this domain include four areas. In stream processing, one seeks unique events in a real time data stream that is too large to store. In fault protection, a system must adapt quickly to react to anticipated errors by triggering repair activities or follow- up diagnostics. With real-time sensor networks, one seeks to classify unique, new events as they occur. With observational sciences, a new generation of instrumentation seeks unique events through online analysis of large observational datasets. This work presents a solution based on transfer learning principles that permits principled CSDT learning while exploiting any prior knowledge of the designer to correct both between-class and withinclass imbalance. Training examples are adaptively reweighted based on a decomposition of the data attributes. The result is a new, nonparametric representation that matches the anticipated attribute distribution for the target events.

Thompson, David R.↗
NASA NTRS2020

Shedding Light on Microbial Dark Matter with A Universal Language of Life

The majority of microbial genomes have yet to be cultured, and most proteins predicted from microbial genomes or sequenced from the environment cannot be functionally annotated. As a result, current computational approaches to describe microbial systems rely on incomplete reference databases that cannot adequately capture the full functional diversity of the microbial tree of life, limiting our ability to model high-level features of biological sequences. The scientific community needs a means to capture the functionally and evolutionarily relevant features underlying biology, independent of our incomplete reference databases. Such a model can form the basis for transfer learning tasks, enabling downstream applications in environmental microbiology, medicine, and bioengineering. Here we present LookingGlass, a deep learning model capturing a “universal language of life”. LookingGlass encodes contextually-aware, functionally and evolutionarily relevant representations of short DNA reads, distinguishing reads of disparate function, homology, and environmental origin. We demonstrate the ability of LookingGlass to be fine-tuned to perform a range of diverse tasks: to identify novel oxidoreductases, to predict enzyme optimal temperature, and to recognize the reading frames of DNA sequence fragments. LookingGlass is the first contextually-aware, general purpose pre-trained “biological language” representation model for short-read DNA sequences. LookingGlass enables functionally relevant representations of otherwise unknown and unannotated sequences, shedding light on the microbial dark matter that dominates life on Earth.

A Hoarfrost↗
NASA NTRSDate not supplied

Document Classification Techniques for Aviation Letters of Agreement

Often when working with technical documents, it is helpful to classify them into specific categories. In this paper, we conduct a thorough review of natural language processing techniques to perform this classification task on Letters of Agreement (LOAs), technical aviation documents outlining rules for utilizing US airspace. We evaluate multiple techniques, including Transfer Learning, for representing the text in the documents as embeddings: unigram and bigram Term Frequency Inverse Document Frequency (TFIDF), Word2Vec, Doc2Vec, GloVe and RoBERTa. We investigate a wide range of classification models: K-Nearest Neighbors, Random Forest, Support Vector Machines (SVM), Logistic Regression, Naive Bayes, Feed-Forward Neural Network, Convolutional Neural Networks (CNNs) and Long-Short Term Memory (LSTM). By comparing the different methods, we found the best overall approach for our task was to use unigram TFIDF representations with SVM while also gaining insight into how the other methodologies performed on a small technical datasets.

Aayushi Batra↗
NASA NTRS1992

Formal methods technology transfer: Some lessons learned

IBM has a long history in the application of formal methods to software development and verification. There have been many successes in the development of methods, tools and training to support formal methods. And formal methods have been very successful on several projects. However, the use of formal methods has not been as widespread as hoped. This presentation summarizes several approaches that have been taken to encourage more widespread use of formal methods, and discusses the results so far. The basic problem is one of technology transfer, which is a very difficult problem. It is even more difficult for formal methods. General problems of technology transfer, especially the transfer of formal methods technology, are also discussed. Finally, some prospects for the future are mentioned.

Hamilton, David↗
NASA NTRS1987

Shuttle middeck fluid transfer experiment: Lessons learned

This presentation is based on the experience gained from having integrated and flown a shuttle middeck experiment. The experiment, which demonstrated filling, expulsion, and fluid behavior of a liquid storage system under low-gravity conditions, is briefly described. The advantages and disadvantages of middeck payloads compared to other shuttle payload provisions are discussed. A general approach to the integration process is described. The requirements for the shuttle interfaces--such as structures, pressurized systems, materials, instrumentation, and electrical power--are defined and the approach that was used to satisfy these requirements is presented. Currently the middeck experiment is being used as a test bed for the development of various space fluid system components.

Tegart, James↗
NASA NTRS1991

Rhesus monkey (Macaca mulatta) complex learning skills reassessed

An automated computerized testing facility is employed to study basic learning and transfer in rhesus monkeys including discrimination learning set and mediational learning. The data show higher performance levels than those predicted from other tests that involved compromised learning with analogous conditions. Advanced transfer-index ratios and positive transfer of learning are identified, and indications of mediational learning strategies are noted. It is suggested that these data are evidence of the effectiveness of the present experimental apparatus for enhancing learning in nonhuman primates.

Washburn, David A.↗
NASA NTRS2017

Lessons Learned from Radiative Transfer Simulations of the Venus Atmosphere

The Venus atmosphere is extremely complex, and because of this the spectrum of Earths sister planet is likewise intricate and a challenge to model accurately. However, accurate modeling of Venus spectrum opens up multiple opportunities to better understand the planet next door, and even for understanding Venus-like planets beyond our solar system. Near-infrared (1-2.5 um, NIR) spectral windows observable on the Venus nigthside present the opportunity to probe beneath the Venusian cloud deck and measure thermal emission from the surface and lower atmosphere remotely from Earth or from orbit. These nigthside spectral windows were discovered by Allen and Crawford (1984) and have since been used measure trace gas abundances in the Venus lower atmosphere (less than 45 km), map surface emissivity varisions, and measure properties of the lower cloud deck. These windows sample radiation from below the cloud base at roughly 45 km, and pressures in this region range from roughly Earthlike (approx. 1 bar) up to 90 bars at the surface. Temperatures in this region are high: they range from about 400 K at the base of the cloud deck up to about 740 K at the surface. This high temperature and pressure presents several challenges to modelers attempting radiative transfer simulations of this region of the atmosphere, which we will review. Venus is also important to spectrally model to predict the remote observables of Venus-like exoplanets in anticipation of data from future observatories. Venus-like planets are likely one of the most common types of terrestrial planets and so simulations of them are valuable for planning observatory and detector properties of future telescopes being designed, as well as predicting the types of observations required to characterize them.

Arney, G.↗
NASA NTRS2024

Transitioning Sixty Years of NASA Spacesuit Knowledge Capture Lessons Learned to Searchable Knowledge Transfer Databases

Sixty years of spacesuit knowledge capture and lessons learned by spacesuit subject matter experts are documented on videos and presentations and archived with the NASA Engineering and Safety Center (NESC) Academy. The NESC Academy is a web-based platform that hosts online courses by technical experts. A process is underway to transition these decades of lessons learned from the U.S. Spacesuit Knowledge Capture Program Library into more quicky searchable databases and to proactively provide this information to those working on spacesuit projects. Hundreds of lessons learned from Project Mercury, Gemini, Apollo, Apollo- Soyuz Test Project, Skylab, Space Shuttle, International Space Station, and Artemis have been captured in a format that can be quickly searched, enabling users to find information directly applicable to their needs. Transitioning this information to a NASA wiki page will further enhance search and retrieval of data immediately useful to users. This paper provides information about how the lessons learned were determined and how to access them.

spacesuit↗
NASA NTRSDate not supplied

Transitioning Sixty Years of NASA Spacesuit Knowledge Capture Lessons Learned to Searchable Knowledge Transfer Databases

Sixty years of spacesuit knowledge capture and lessons learned by spacesuit subject matter experts are documented on videos and presentations and archived with the NASA Engineering and Safety Center (NESC) Academy. The NESC Academy is a web-based platform that hosts online courses by technical experts. A process is underway to transition these decades of lessons learned from the U.S. Spacesuit Knowledge Capture Program Library into more quicky searchable databases and to proactively provide this information to those working on spacesuit projects. Hundreds of lessons learned from Project Mercury, Gemini, Apollo, Apollo- Soyuz Test Project, Skylab, Space Shuttle, International Space Station, and Artemis have been captured in a format that can be quickly searched, enabling users to find information directly applicable to their needs. Transitioning this information to a NASA wiki page will further enhance search and retrieval of data immediately useful to users. This paper provides information about how the lessons learned were determined and how to access them.

spacesuit↗
NASA NTRS1990

Comparative psychology and the great apes - Their competence in learning, language, and numbers

An overview of comparative studies conducted for the past three decades is presented. These studies have led to the establishment of the Language Research Center that provides facilities for research into questions of primate behavior and cognition. Several experiments conducted among chimpanzees are discussed and comparative analyses with the lesser apes, monkeys, and humans are offered. Among the primates, brain complexity varies widely and the evidence is strong that encephalization and enhanced brain complexity facilitate the learning of concepts, the transfer of learning to an advantage, and mediational and observational learning.

Rumbaugh, Duane M.↗
NASA NTRSDate not supplied

Dense Feature Tracking of Atmospheric Winds with Deep Optical Flow

Atmospheric winds are a key physical phenomenon impacting natural hazards, energy transport, ocean currents, large-scale circulation, and ecosystem fluxes. Observing winds is a complex process and presents a large gap in NASA’s Earth Observation System. Atmospheric motion vectors (AMVs) aim to fill this gap by making numerical estimates of cloud movement between sequences of multi-spectral satellite images, tracking clouds and water vapor. Recent imaging hardware and software advancements have enabled the use of numerical optical flow techniques to produce accurate and dense vector fields outperforming traditional methods. This work presents WindFlow as the first machine learning based system for feature tracking atmospheric motion using optical flow. Due to the lack of large-scale satellite-based observations, we leverage high-resolution numerical simulations from NASA's GEOS-5 Nature Run to perform supervised learning and transfer to satellite images. We demonstrate that our approach using deep learning based optical flow scales to ultra-high-resolution images of size 2881x5760 with less than 1 m/s bias and 2.5 m/s average error. Four network and learning architectures are compared and it is found that recurrent all-pairs field transforms (RAFT) produces the lowest errors on all metrics for wind speed and direction. Results on held out numerical outputs shows RAFT's good performance in each of the spatial, temporal, and physical dimensions. A comparison between WindFlow and an operational AMV product against rawinsonde observations show that RAFT transfers across simulations and thermal infrared satellite observations. This work shows that machine learning based optical flow is an efficient approach to generating robust feature tracking for AMVs consistently over large regions.

Atmospheric winds↗
NASA NTRSDate not supplied

Exploring the Low-Thrust Transfer Design Space in an Ephemeris Model via Multi-Objective Reinforcement Learning

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to train multiple policies to uncover solutions within a multi-objective solution space. MRPPO is used in this paper to train policies to construct low-thrust transfers for a SmallSat from the vicinity of !2 to an !5 short period orbit in the Sun-Earth-Moon system. First, the policies are trained in this scenario in the circular restricted three-body problem. This information is used to initialize the policies before training in a higher-fidelity ephemeris model; a process known as transfer learning. The recovered segments of the solution space will be compared to fundamental dynamical structures to both examine the results of MRPPO in this complex design scenario and explore the effectiveness of transfer learning.

Christopher J Sullivan↗
NASA NTRSDate not supplied

Exploring the Low-Thrust Transfer Design Space in an Ephemeris Model via Multi-Objective Reinforcement Learning

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to train multiple policies to uncover solutions within a multi-objective solution space. MRPPO is used in this paper to train policies to construct low-thrust transfers for a SmallSat from the vicinity of L2 to an L5 short period orbit in the Sun-Earth-Moon system. First, the policies are trained in this scenario in the circular restricted three-body problem. This information is used to initialize the policies before training in a higher-fidelity ephemeris model; a process known as transfer learning. The recovered segments of the solution space will be compared to fundamental dynamical structures to both examine the results of MRPPO in this complex design scenario and explore the effectiveness of transfer learning.

Christopher J. Sullivan↗
NASA NTRS2022

Exploring the Low-Thrust Transfer Design Space in an Ephemeris Model via Multi-Objective Reinforcement Learning

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to train multiple policies to uncover solutions within a multi-objective solution space. MRPPO is used in this paper to train policies to construct low-thrust transfers for a SmallSat from the vicinity of 𝐿2 to an 𝐿5 short period orbit in the Sun-Earth-Moon system. First, the policies are trained in this scenario in the circular restricted three-body problem. This information is used to initialize the policies before training in a higher-fidelity ephemeris model; a process known as transfer learning. The recovered segments of the solution space will be compared to fundamental dynamical structures to both examine the results of MRPPO in this complex design scenario and explore the effectiveness of transfer learning.

Mashiku, Alinda K.↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a traditional optimization formulation.

algorithm↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Christopher J. Sullivan↗