Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Managing Maintenance Error: Six Lessons From Aviation Maintenance

There are clear parallels between the ground processing of spacecraft and the maintenance of airline aircraft. In both cases, reliable human performance is critical to safe outcomes. Examples of human factors in airline maintenance and spacecraft ground processing illustrate the similarities between these two domains. The worldwide aviation industry began to pay close attention to human factors in maintenance after several maintenance-related disasters in the 1970s and 80s. Rather than simply applying solutions that had been developed for flight crew and air traffic controllers, the aviation industry developed human factors interventions specifically tailored for maintenance personnel. These interventions have led to safety improvements, greater reliability, and significant cost savings. Six human factors approaches from airline maintenance that can be usefully applied to enhance the quality and safety of ground processing are outlined. These are 1) Design for assembly, test, and maintenance, 2) Non technical skills training, 3) Improved design of documentation, 4) Reduction of iatrogenic quality lapses, 5) Barrier and control analysis, and 6) Continuous improvement based on learning from quality lapses.

maintenance human factors↗

Building an adaptive agent to monitor and repair the electrical power system of an orbital satellite

Over several years we have developed a multistrategy apprenticeship learning methodology for building knowledge-based systems. Recently we have developed and applied our methodology to building intelligent agents. This methodology allows a subject matter expert to build an agent in the same way in which the expert would teach a human apprentice. The expert will give the agent specific examples of problems and solutions, explanations of these solutions, or supervise the agent as it solves new problems. During such interactions, the agent learns general rules and concepts, continuously extending and improving its knowledge base. In this paper we present initial results on applying this methodology to build an intelligent adaptive agent for monitoring and repair of the electrical power system of an orbital satellite, stressing the interaction with the expert during apprenticeship learning.

Tecuci, Gheorghe↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-of-the-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Deep-learning↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-ofthe-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Hesham ElAbd↗

Engineering Lessons Learned and Systems Engineering Applications

Systems Engineering is fundamental to good engineering, which in turn depends on the integration and application of engineering lessons learned and technical standards. Thus, good Systems Engineering also depends on systems engineering lessons learned from within the aerospace industry being documented and applied. About ten percent of the engineering lessons learned documented in the NASA Lessons Learned Information System are directly related to Systems Engineering. A key issue associated with lessons learned datasets is the communication and incorporation of this information into engineering processes. Systems Engineering has been defined (EINIS-632) as "an interdisciplinary approach encompassing the entire technical effort to evolve and verify an integrated and life-cycle balanced set of system people, product, and process solutions that satisfy customer needs". Designing reliable space-based systems has always been a goal for NASA, and many painful lessons have been learned along the way. One of the continuing functions of a system engineer is to compile development and operations "lessons learned" documents and ensure their integration into future systems development activities. They can produce insights and information for risk identification identification and characterization. on a new project. Lessons learned files from previous projects are especially valuable in risk

Gill, Paul S.↗

Lessons Learned (3 Years of H2O2 Propulsion System Testing Efforts at NASA's John C. Stennis Space Center)

John C. Stennis Space Center continues to support the Propulsion community in an effort to validate High-Test Peroxide as an alternative to existing/future oxidizers. This continued volume of peroxide test/handling activity at Stennis Space Center (SSC) provides numerous opportunities for the SSC team to build upon previously documented 'lessons learned'. SSC shall continue to strive to document their experience and findings as H2O2 issues surface. This paper is intended to capture all significant peroxide issues that we have learned over the last three years. This data (lessons learned) has been formulated from practical handling, usage, storage, operations, and initial development/design of our systems/facility viewpoint. The paper is intended to be an information type tool and limited in technical rational; therefore, presenting the peroxide community with some issues to think about as the continued interest in peroxide evolves and more facilities/hardware are built. These lessons learned are intended to assist industry in mitigating problems and identifying potential pitfalls when dealing with the requirements for handling high-test peroxide.

Taylor, Gary O.↗

An architecture for an autonomous learning robot

An autonomous learning device must solve the example bounding problem, i.e., it must divide the continuous universe into discrete examples from which to learn. We describe an architecture which incorporates an example bounder for learning. The architecture is implemented in the GPAL program. An example run with a real mobile robot shows that the program learns and uses new causal, qualitative, and quantitative relationships.

Tillotson, Brian↗

A Parametric Geometry Computational Fluid Dynamics (CFD) Study Utilizing Design of Experiments (DOE)

Design of Experiments (DOE) was applied to the LAS geometric parameter study to efficiently identify and rank primary contributors to integrated drag over the vehicles ascent trajectory in an order of magnitude fewer CFD configurations thereby reducing computational resources and solution time. SME s were able to gain a better understanding on the underlying flowphysics of different geometric parameter configurations through the identification of interaction effects. An interaction effect, which describes how the effect of one factor changes with respect to the levels of other factors, is often the key to product optimization. A DOE approach emphasizes a sequential approach to learning through successive experimentation to continuously build on previous knowledge. These studies represent a starting point for expanded experimental activities that will eventually cover the entire design space of the vehicle and flight trajectory.

Rhew, Ray D.↗

Space Telecommunications Radio System (STRS) Application Repository Design and Analysis

The Space Telecommunications Radio System (STRS) Application Repository Design and Analysis document describes the STRS application repository for software-defined radio (SDR) applications intended to be compliant to the STRS Architecture Standard. The document provides information about the submission of artifacts to the STRS application repository, to provide information to the potential users of that information, and for the systems engineer to understand the requirements, concepts, and approach to the STRS application repository. The STRS application repository is intended to capture knowledge, documents, and other artifacts for each waveform application or other application outside of its project so that when the project ends, the knowledge is retained. The document describes the transmission of technology from mission to mission capturing lessons learned that are used for continuous improvement across projects and supporting NASA Procedural Requirements (NPRs) for performing software engineering projects and NASAs release process.

information retrieval↗

The Challenges of Human-Autonomy Teaming

Machine intelligence is improving rapidly based on advances in big data analytics, deep learning algorithms, networked operations, and continuing exponential growth in computing power (Moores Law). This growth in the power and applicability of increasingly intelligent systems will change the roles humans, shifting them to tasks where adaptive problem solving, reasoning and decision-making is required. This talk will address the challenges involved in engineering autonomous systems that function effectively with humans in aeronautics domains.

artificial intelligence↗

The Challenges of Human-Autonomy Teaming

Machine intelligence is improving rapidly based on advances in big data analytics, deep learning algorithms, networked operations, and continuing exponential growth in computing power (Moores Law). This growth in the power and applicability of increasingly intelligent systems will change the roles humans, shifting them to tasks where adaptive problem solving, reasoning and decision-making is required. This talk will address the challenges involved in engineering autonomous systems that function effectively with humans in aeronautics domains.

Human-Autonomy teaming↗

Medics: Medical Decision Support System for Long-Duration Space Exploration

The Autonomous Medical Operations (AMO) group at NASA Ames is developing a “medical decision support system” to enable astronauts on long-duration exploration missions to operate autonomously. The system will support clinical actions by providing medical interpretation advice and procedural recommendations during emergent care and clinical work performed by crew. The current state of development of the system, called MedICS (Medical Interpretation Classification and Segmentation) includes two separate aspects: a set of machine learning diagnostic models trained to analyze organ images and patient health records, and an interface to ultrasound diagnostic hardware and to medical repositories. Three sets of images of different organs and medical records were utilized for training machine learning models for various analyses, as follows: 1. Pneumothorax condition (collapsed lung). The trained model provides a positive or negative diagnosis of the condition. 2. Carotid artery occlusion. The trained model produces a diagnosis of 5 different occlusion levels (including “normal”). 3. Ocular retinal images. The model extracts optic disc pixels (image segmentation). This is a precursor step for advanced autonomous fundus clinical evaluation algorithms to be implemented in FY20. 4. Medical health records. The model produces a differential diagnosis for any particular individual, based on symptoms and other health and demographic information. A probability is calculated for each of 25 most common conditions. The same model provides the likelihood of survival. All results are provided with a confidence level. Item 1 images were provided by the US Army and were part of a data set for the clinical treatment of injured battlefield soldiers. This condition is relevant to possible space mishaps, due to pressure management issues. Item 2 images were provided by Houston Methodist Hospital, and item 3 health records were acquired from the MIT laboratory of computational physiology. The machine learning technology utilized is deep multilayer networks (Deep Learning), and new models will continue to be produced, as relevant data is made available and specific health needs of astronaut crews are identified. The interfacing aspects of the system include a GUI for running the different models, and retrieving and storing data, as well as support for integration with an augmented reality (AR) system deployed at JSC by Tietronix Software Inc. (HoloLens). The AR system provides guidance for the placement of an ultrasound transducer that captures images to be sent to the MedICS system for diagnosis. The image captured and the associated diagnosis appear in the technician’s AR visual display.

Colombano, Silvano↗

Environmental Testing of the OVEN System for Lunar Water Extraction and Prospecting

Introduction: The presence of water ice in permanently shadowed regions on the lunar surface [1] may enable a sustained human presence on the Moon with minimal need for consumables. However, in order to develop a long term utilization plan that includes the usage of in-situ water we must first understand the abundance, stratigraphy and distribution of this re-source. Multiple space agencies currently have plans for lunar water prospecting missions. The Optimized Volatile Extraction Node (OVEN) was designed for water prospecting missions that require samples to be weighed, sealed, and heated as the means of determining water concentration. This method of water quantification necessitates a fair amount of automation, so a rigorous environmental test program was performed in order to build confidence in the performance of the OVEN design. The work presented here describes the OVEN environmental test program as well as ongoing efforts to improve on the design. Vibration: The OVEN participated in two rounds of random vibration tests. The first test was a stand-alone test performed at the Energy Systems Test Area of the Johnson Space Center. The second test was an integrated test with the mobile platform developed for the Resource Prospector project. The OVEN survived both tests without damage, but the tests did provide valuable lessons learned with regards to specific operations. Thermal Vacuum: The OVEN was successfully demonstrated at a temperature range of -50 to 75 C in a thermal vacuum chamber. The need to heat motor gearboxes at lower temperatures was predetermined so this test program was completed by implementing a method of gearbox heating that used the existing circuitry within the motors. Dust: A custom dynamometer was built in order to determine the torque required to move the various mechanisms within the OVEN at a range of temperatures. The OVEN system was coated with lunar dust simulant in order to determine mechanism torques under a worst-case operating condition. Sublimation: Sublimation losses within the OVEN were quantified through a series of test configurations, including an integrated test in a thermal vacuum chamber at Glenn Research Center [2]. Current Work: The OVEN subsystem is currently not a component of any existing prospecting missions, but work continues that will take the lessons learned from previous environmental tests and improve on the design in order to be considered for future prospecting opportunities. References: [1] Colaprete, A., Schultz, P., Heldmann, J., Wooden, D., Shirley, M., Ennico, K., ... & Sollitt, L. (2010). Detection of water in the LCROSS ejecta plume. science, 330(6003), 463-468. [2] Kleinhenz, J., Smith, J., Roush, T., Colaprete, A., Zacny, K., Paulsen, G., ... & Paz, A. (2018). Volatiles Loss from water bearing regolith simulant at Lunar Environments. In Earth and Space 2018: Engineering for Extreme Environments (pp. 454-466). Reston, VA: American Society of Civil Engineers.

A Paz↗

Neural Network Machine Learning and Dimension Reduction for Data Visualization

Neural network machine learning in computer science is a continuously developing field of study. Although neural network models have been developed which can accurately predict a numeric value or nominal classification, a general purpose method for constructing neural network architecture has yet to be developed. Computer scientists are often forced to rely on a trial-and-error process of developing and improving accurate neural network models. In many cases, models are constructed from a large number of input parameters. Understanding which input parameters have the greatest impact on the prediction of the model is often difficult to surmise, especially when the number of input variables is very high. This challenge is often labeled the "curse of dimensionality" in scientific fields. However, techniques exist for reducing the dimensionality of problems to just two dimensions. Once a problem's dimensions have been mapped to two dimensions, it can be easily plotted and understood by humans. The ability to visualize a multi-dimensional dataset can provide a means of identifying which input variables have the highest effect on determining a nominal or numeric output. Identifying these variables can provide a better means of training neural network models; models can be more easily and quickly trained using only input variables which appear to affect the outcome variable. The purpose of this project is to explore varying means of training neural networks and to utilize dimensional reduction for visualizing and understanding complex datasets.

Liles, Charles A.↗

Distributed System Design Checklist

This report describes a design checklist targeted to fault-tolerant distributed electronic systems. Many of the questions and discussions in this checklist may be generally applicable to the development of any safety-critical system. However, the primary focus of this report covers the issues relating to distributed electronic system design. The questions that comprise this design checklist were created with the intent to stimulate system designers' thought processes in a way that hopefully helps them to establish a broader perspective from which they can assess the system's dependability and fault-tolerance mechanisms. While best effort was expended to make this checklist as comprehensive as possible, it is not (and cannot be) complete. Instead, we expect that this list of questions and the associated rationale for the questions will continue to evolve as lessons are learned and further knowledge is established. In this regard, it is our intent to post the questions of this checklist on a suitable public web-forum, such as the NASA DASHLink AFCS repository. From there, we hope that it can be updated, extended, and maintained after our initial research has been completed.

Hall, Brendan↗

Evolution of Software-Only-Simulation at NASA IV and V

Software-Only-Simulations have been an emerging but quickly developing field of study throughout NASA. The NASA Independent Verification Validation (IVV) Independent Test Capability (ITC) team has been rapidly building a collection of simulators for a wide range of NASA missions. ITC specializes in full end-to-end simulations that enable developers, VV personnel, and operators to test-as-you-fly. In four years, the team has delivered a wide variety of spacecraft simulations that have ranged from low complexity science missions such as the Global Precipitation Management (GPM) satellite and the Deep Space Climate Observatory (DSCOVR), to the extremely complex missions such as the James Webb Space Telescope (JWST) and Space Launch System (SLS).This paper describes the evolution of ITCs technologies and processes that have been utilized to design, implement, and deploy end-to-end simulation environments for various NASA missions. A comparison of mission simulators are discussed with focus on technology and lessons learned in complexity, hardware modeling, and continuous integration. The paper also describes the methods for executing the missions unmodified flight software binaries (not cross-compiled) for verification and validation activities.

Embedded↗

NASA Support for Commercial Crew Launch Capabilities

Since the earliest days of U.S. human spaceflight, NASA’s Marshall Space Flight Center in Huntsville, Alabama, has played a key role in American crew launch capability, from engineering support for the first Mercury-Redstone launches, to the Saturn launches to the Moon, through Shuttle and now Artemis. Today, Marshall brings that expertise gained through decades of crewed space launches to NASA’s Commercial Crew Program (CCP), providing launch vehicle engineering and programmatic support. The team’s responsibilities have included human certification of commercial launch systems for the CCP missions, including Atlas V and Falcon 9, and verifying each launch vehicle complies with flight certification. MSFC provides expertise in nearly all aspects of launch vehicle design and performance including solid motors and liquid engines, stage propulsion, thrust vector control, structural and dynamics, safety and mission assurance. During each commercial crew launch, an engineering support team is on console at Marshall’s Huntsville Operations Support Center, which has provided launch operations support since Apollo, providing real-time oversight to safety standards for the vehicle and verifying data. Launch vehicle support for Commercial Crew has come as a paradigm shift for the MSFC team, inspiring new approaches that leverage expertise and best practices from past NASA-developed launch vehicle missions, while at the same time providing new synergies from work with commercial partners on CCP. This paper will explore the role that the Marshall launch vehicle services team plays in the Commercial Crew Program, as well as lessons learned from the program that will continue to benefit a new era of spaceflight partnerships.

Commercial Crew↗

Automatic learning rate adjustment for self-supervising autonomous robot control

Described is an application in which an Artificial Neural Network (ANN) controls the positioning of a robot arm with five degrees of freedom by using visual feedback provided by two cameras. This application and the specific ANN model, local liner maps, are based on the work of Ritter, Martinetz, and Schulten. We extended their approach by generating a filtered, average positioning error from the continuous camera feedback and by coupling the learning rate to this error. When the network learns to position the arm, the positioning error decreases and so does the learning rate until the system stabilizes at a minimum error and learning rate. This abolishes the need for a predetermined cooling schedule. The automatic cooling procedure results in a closed loop control with no distinction between a learning phase and a production phase. If the positioning error suddenly starts to increase due to an internal failure such as a broken joint, or an environmental change such as a camera moving, the learning rate increases accordingly. Thus, learning is automatically activated and the network adapts to the new condition after which the error decreases again and learning is 'shut off'. The automatic cooling is therefore a prerequisite for the autonomy and the fault tolerance of the system.

Arras, Michael K.↗