Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Labeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Active learning in the presence of unlabelable examples

We propose a new active learning framework where the expert labeler is allowed to decline to label any example. This may be necessary because the true label is unknown or because the example belongs to a class that is not part of the real training problem. We show that within this framework, popular active learning algorithms (such as Simple) may perform worse than random selection because they make so many queries to the unlabelable class. We present a method by which any active learning algorithm can be modified to avoid unlabelable examples by training a second classifier to distinguish between the labelable and unlabelable classes. We also demonstrate the effectiveness of the method on two benchmark data sets and a real-world problem.

active learning↗
NASA NTRS2006

Enhancement of the MODIS Snow and Ice Product Suite Utilizing Image Segmentation

A problem has been noticed with the current NODIS Snow and Ice Product in that fringes of certain snow fields are labeled as "cloud" whereas close inspection of the data indicates that the correct labeling is a non-cloud category such as snow or land. This occurs because the current MODIS Snow and Ice Product generation algorithm relies solely on the MODIS Cloud Mask Product for the labeling of image pixels as cloud. It is proposed here that information obtained from image segmentation can be used to determine when it is appropriate to override the cloud indication from the cloud mask product. Initial tests show that this approach can significantly reduce the cloud "fringing" in modified snow cover labeling. More comprehensive testing is required to determine whether or not this approach consistently improves the accuracy of the snow and ice product.

Tilton, James C.↗
NASA NTRS2008

User Guide for the Anvil Threat Cooridor Forecast Tool V2.4 for AWIPS

The Anvil Tool GUI allows users to select a Data Type, toggle the map refresh on/off, place labels, and choose the Profiler Type (source of the KSC 50 MHz profiler data), the Date- Time of the data, the Center of Plot, and the Station (location of the RAOB or 50 MHz profiler). If the Data Type is Models, the user selects a Fcst Hour (forecast hour) instead of Station. There are menus for User Profiles, Circle Label Options, and Frame Label Options. Labels can be placed near the center circle of the plot and/or at a specified distance and direction from the center of the circle (Center of Plot). The default selection for the map refresh is "ON". When the user creates a new Anvil Tool map with Refresh Map "ON, the plot is automatically displayed in the AWIPS frame. If another Anvil Tool map is already displayed and the user does not change the existing map number shown at the bottom of the GUI, the new Anvil Tool map will overwrite the old one. If the user turns the Refresh Map "OFF", the new Anvil Tool map is created but not automatically displayed. The user can still display the Anvil Tool map through the Maps dropdown menu* as shown in Figure 4.

Barett, Joe H., III↗
NASA NTRS2015

Johnson Space Center's Free Range Bicycle Program.- Fall 2015 Intern Report

NASA's Johnson Space Center is a big place, encompassing 1,620 acres and more than a hundred buildings. Furthermore, there are reportedly 15 thousand employees, all of which have somewhere to be. To facilitate the movement of all these people JSC has historically relied on human power. Pedaling their way towards deep space, bicycles have been the go to method. Currently there are about 200 Free Range Bicycles at JSC. Free Range Bicycles belong to nobody, except NASA, and are available for anybody to use. They are not to be locked or hidden (although frequently are) and the intention is that there will always be a bike to hop on to get where you're going (although it may not be the bike you rode in on). Although not without its own shortcomings, the Free Range Bicycle Program has continued to provide low cost, simple transportation for NASA's JSC. In addition to the approximately 200 Free Range Bicycles, various larger divisions (like engineering) will often buy a few dozen bikes for their team members to use or individuals will bring their own personal bike to either commute or use on site. When these bicycles fall into disrepair or are abandoned (from retirees etc) they become a problem at JSC. They are an eye sore, create a safety hazard and make it harder to find a working bike in a time of need. The Free Range Program hopes to address this first problem by "tagging out" abandoned or out of service bicycles. A bright orange "DO NOT OPERATE" tag is placed on the bike and given a serial number for tracking purposes. See picture to the right. If the bike has an active owner with intentions to repair the bike the bottom of the tag has instructions for how to claim the abandoned bicycle. After being tagged the owner of the bicycle has 30 days to claim the bicycle and either haul it off site or get it repaired (and labeled) in accordance with Johnson's Bicycle Policy. If the abandoned bicycle is not claimed within 30 days it becomes the property of the Government. The bicycle is then (in short) repaired, labeled, documented and converted to a free range bicycle. Bikes beyond repair are cannibalized of useable parts and then scrapped. That was nearly the first thing I did when arriving at work. After getting settled in and coordinating the purchase of 50 new bicycles (elaboration below); I started combing the Center. Bikes are hidden and tucked away in the oddest of places and it was my priority to root all of them out. I tagged 70 bikes on the center, setting a record. I tagged so many bikes I ran out tags and had to make more. Long ago it was discovered that the same harsh elements that wreak havoc on the bikes, destroy the tags before the 30 day timeframe. The tags are labeled with instructions on how to claim the bike and numbered, then these paper labels are laminated with packing tape. It sounds like a simple process but nothing fits right, everything has to be trimmed, put on straight and is generally a pain in the neck. So I made an assembly process and knocked out a few hundred to save having to do it again for a while. I walked the center and tagged bikes at every building hiding in nearly every nook and cranny. Thus, in conclusion, I've done many things here at JSC on my first term and had a blast doing it. I've learned a lot from my multi-faceted roles and continual challenges. In short I've done my best to get folks at JSC on bikes and keep folks at JSC on bikes and tended a flock of free range bicycles. Everything from turning the rusty bolts and oiling chains to coordinating a $20,000 deal on 50 new free range bicycles. I am proud of the bicycle shop I have built and am infinitely grateful to the people who lead, help, guide and support me. I have fixed a great number of bicycles and cleaned the center of unsightly and unsafe piles of bicycles. I am immensely thankful for this opportunity to learn and serve and appreciate the privilege of coming back for a second term. A second term, in which I will continue to develop this awesome program.

Lee-Stockton, Willem↗
NASA NTRS2017

Ask-the-expert: Active Learning Based Knowledge Discovery Using the Expert

Often the manual review of large data sets, either for purposes of labeling unlabeled instances or for classifying meaningful results from uninteresting (but statistically significant) ones is extremely resource intensive, especially in terms of subject matter expert (SME) time. Use of active learning has been shown to diminish this review time significantly. However, since active learning is an iterative process of learning a classifier based on a small number of SME-provided labels at each iteration, the lack of an enabling tool can hinder the process of adoption of these technologies in real-life, in spite of their labor-saving potential. In this demo we present ASK-the-Expert, an interactive tool that allows SMEs to review instances from a data set and provide labels within a single framework. ASK-the-Expert is powered by an active learning algorithm for training a classifier in the backend. We demonstrate this system in the context of an aviation safety application, but the tool can be adopted to work as a simple review and labeling tool as well, without the use of active learning.

software↗
NASA NTRS2017

Ask-the-Expert: Active Learning Based Knowledge Discovery Using the Expert

Often the manual review of large data sets, either for purposes of labeling unlabeled instances or for classifying meaningful results from uninteresting (but statistically significant) ones is extremely resource intensive, especially in terms of subject matter expert (SME) time. Use of active learning has been shown to diminish this review time significantly. However, since active learning is an iterative process of learning a classifier based on a small number of SME-provided labels at each iteration, the lack of an enabling tool can hinder the process of adoption of these technologies in real-life, in spite of their labor-saving potential. In this demo we present ASK-the-Expert, an interactive tool that allows SMEs to review instances from a data set and provide labels within a single framework. ASK-the-Expert is powered by an active learning algorithm for training a classifier in the back end. We demonstrate this system in the context of an aviation safety application, but the tool can be adopted to work as a simple review and labeling tool as well, without the use of active learning.

GUI↗
NASA NTRS2020

Efficient Active Learning for New Domains

The promise of active learning is to reduce the number of labeled examples required by supervised machine learning algorithms. The largest potential benefits lie in entirely new domains, for which no labeled examples yet exist. Yet to date, most active learning studies are retroactive and demonstrate the benefits that could have been gained if active learning had been used. What are the barriers to true adoption and utilization of active learning? We focus on two: (1) the cold start or class discovery problem, in which active learning methods may struggle to make progress with zero labeled examples, and (2) the cost of having the classifier in the loop to select the next example to be labeled. We assess different active learning approaches in the context of these two barriers and conclude with recommendations for how to employ active learning in new domains. As an example, we report on the use of active learning on a large, novel data set of Mars surface images.

Lu, Steven↗
NASA NTRS2021

AI4MARS: A Dataset for Terrain-Aware Autonomy on Mars

Deep learning has quickly become a necessity for selfdriving vehicles on Earth. In contrast, the self-driving vehicles on Mars, including NASA’s latest rover, Perseverance, which is planned to land on Mars in February 2021, are still driven by classical machine vision systems. Deep learning capabilities, such as semantic segmentation and object recognition, would substantially benefit the safety and productivity of ongoing and future missions to the red planet. To this end, we created the first large-scale dataset, AI4Mars, for training and validating terrain classification models for Mars, consisting of ~326K semantic segmentation full image labels on 35K images from Curiosity, Opportunity, and Spirit rovers, collected through crowdsourcing. Each image was labeled by ~10 people to ensure greater quality and agreement of the crowdsourced labels. It also includes ~1.5K validation labels annotated by the rover planners and scientists from NASA’s MSL (Mars Science Laboratory) mission, which operates the Curiosity rover, and MER (Mars Exploration Rovers) mission, which operated the Spirit and Opportunity rovers. We trained a DeepLabv3 model on the AI4Mars training dataset and achieved over 96% overall classification accuracy on the test set. The dataset is made publicly available.1

Ono, Hiro↗
NASA NTRSDate not supplied

Anomaly Detection in Flight Operational Data Using Deep Learning

In this session, we demonstrate two recently developed deep learning models for anomaly detection in flight operational data by the Data Sciences Group at NASA Ames Research Center. The first model is Convolutional Variational Auto-Encoder (CVAE) [1], which is an unsupervised deep encoder-decoder model, designed specifically for finding anomalies in heterogeneous multivariate time series data. We will demonstrate its application to finding anomalies in streaming data from NASA’s Digital Information Platform’s Fuser source. CVAE identifies data instances that are not representative of expected nominal behavior as anomalous. Since it is an unsupervised approach, the flagged anomalies will need to be reviewed by the subject matter experts (SMEs) for validation and labeling and is designed to assist with vulnerability discovery within Safety Monitoring System programs. The second model is Robust and Explainable Semi-supervised Anomaly Detection (RESAD) model [2], which builds on CVAE to allow learning from both minimally labeled data (previously reviewed by the SMEs) as well as majority unlabeled data. RESAD takes advantage of graph theoretic techniques to propagate the labels from the labeled data to the unlabeled data based on a pre-defined similarity metric and structures the learned feature space from flight time-series so that data of the same class would cluster tightly together. This model characteristic is enabled by training with an augmented loss function and allows learning of a more informative feature space for down-stream tasks such as search and active learning. We demonstrate RESAD using data from the NASA DASHlink project [3].

anomaly detection↗
NASA NTRSDate not supplied

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗
NASA NTRS1974

Automated microbial metabolism laboratory

The design and rationale of an advanced labeled release experiment based on single addition of soil and multiple sequential additions of media into each of four test chambers are outlined. The feasibility for multiple addition tests was established and various details of the methodology were studied. The four chamber battery of tests include: (1) determination of the effect of various atmospheric gases and selection of that gas which produces an optimum response; (2) determination of the effect of incubation temperature and selection of the optimum temperature for performing Martian biochemical tests; (3) sterile soil is dosed with a battery of C-14 labeled substrates and subjected to experimental temperature range; and (4) determination of the possible inhibitory effects of water on Martian organisms is performed initially by dosing with 0.01 ml and 0.5 ml of medium, respectively. A series of specifically labeled substrates are then added to obtain patterns in metabolic 14CO2 (C-14)O2 evolution.

Source record↗
NASA NTRS1974

Studies on propagation of microbes in the airborne state

An investigation was conducted to demonstrate whether airborne microbes could propagate. The procedure consisted of: (1) looking for dilution of a labelled base in DNA; (2) looking for labelling of DNA by mixing aerosols of the label and the cells; (3) examining changes in cell size; (4) testing the possibility of spore germination; and (5) seeking evidence of an increase in cell number. Results indicate that growth and propagation can occur under special conditions, principally at temperatures of approximately 30 C (87 F) and water activity equivalents of 0.95 to 0.98.

Dimmick, R. L.↗
NASA NTRS1976

Estimation of the probability of error without ground truth and known a priori probabilities

The probability of error or, alternatively, the probability of correct classification (PCC) is an important criterion in analyzing the performance of a classifier. Labeled samples (those with ground truth) are usually employed to evaluate the performance of a classifier. Occasionally, the numbers of labeled samples are inadequate, or no labeled samples are available to evaluate a classifier's performance; for example, when crop signatures from one area from which ground truth is available are used to classify another area from which no ground truth is available. This paper reports the results of an experiment to estimate the probability of error using unlabeled test samples (i.e., without the aid of ground truth).

Havens, K. A.↗
NASA NTRS1978

The biology instrument for the Viking Mars mission

Two Viking spacecraft have successfully soft landed on the surface of Mars. Each carries one biology laboratory with three different experiments designed to search for evidence of living microorganisms in material sampled from the Martian surface. This 15.5-kg biology instrument which occupies a volume of almost 28.3 dm is the first to carry out an in situ search for extraterrestrial life on a planet. The three experiments are called the pyrolytic release, labeled release, and gas exchange. The pyrolytic release experiment has the capability to measure the fixation of carbon dioxide or carbon monoxide into organic matter. The labeled release experiment detects metabolic processes by monitoring the production of volatile carbon compounds from a radioactively labeled nutrient mixture. The gas exchange experiment monitors the gas changes in the head space above a soil sample which is either incubated in a humid environment or supplied with a rich organic nutrient solution.

Brown, F. S.↗
NASA NTRS1979

Clustering algorithm evaluation and the development of a replacement for procedure 1

An efficient procedure which clusters data using a completely unsupervised clustering algorithm and then uses labeled pixels to label the resulting clusters or perform a stratified estimate using the clusters as strata is developed. Three clustering algorithms, CLASSY, AMOEBA, and ISOCLS, are compared for efficiency. Three stratified estimation schemes and three labeling schemes are also considered and compared.

Lennington, R. K.↗
NASA NTRS1980

Extremes of urine osmolality - Lack of effect on red blood cell survival

Rats were allowed a third of normal water intake for 20 days, and food consumption decreased. The reticulocyte count indicated a suppression of erythropoiesis. Urine osmolality increased from 2,000 mosmol/kg to 3,390 mosmol/kg. Random hemolysis and senescence of a cohort of red blood cell (RBC) previously labeled with (2-(C-14)) glycine was monitored via the production of (C-14)O. Neither hemolysis nor senescence was affected. Following water restriction, the polydipsic rats generated a hypotonic urine. Urine osmolality decreased to 1,300 mosmol/kg for at least 6 days; a reticulocytosis occurred, but RBC survival was unaffected. These results contradict those previously reported, which suggest that RBC survival is influenced by the osmotic stress imposed on the RBC by extremes of urine tonicity. This discrepancy, it is concluded, is due to differences in the methods employed for measuring RBC survival. The random-labeling technique employed previously assumes a steady state between RBC production and destruction. The cohort-labeling technique used here measures hemolysis and senescence independent of changes in RBC production, which is known to be depressed by fasting.

Leon, H. A.↗
NASA NTRS1980

As-built design specification for P1A software system modified display subsystem

This document contains the design of the proportional estimate processor which was written to satisfy the software requirement of Part A of the P1A experiment. The purposes of the project are: (1) to select the dots to be labelled; (2) to create tables of green numbers and brightness values for all selected dots per acquisition; (3) to create scatter plots of green numbers vs brightness for each acquisition for all selected dots. If labels have been provided then scatter plots of only categories of interest can be optionally produced; and (4) to produce trajectory plots of green number vs brightness at differing acquisition times for each dot. These plots need to be in the same order as the list of selected dots. When labels are provided only plots of dots of categories of interest are to be produced.

Horton, C. L.↗