Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neural generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Multi-Agent Motion Planning using Deep Learning for Space Applications

State-of-the-art motion planners cannot scale to a large number of systems. Motion planning for multiple agents is an NP (non-deterministic polynomial-time) hard problem, so the computation time increases exponentially with each addition of agents. This computational demand is a major stumbling block to the motion planner's application to future NASA missions involving the swarm of space vehicles. We applied a deep neural network to transform computationally demanding mathematical motion planning problems into deep learning-based numerical problems. We showed optimal motion trajectories can be accurately replicated using deep learning-based numerical models in several 2D and 3D systems with multiple agents. The deep learning-based numerical model demonstrates superior computational efficiency with plans generated 1000 times faster than the mathematical model counterpart.

Madani, Ramtin↗
NASA NTRSDate not supplied

Machine Learning Approaches for Rare-Earth Silicate Environmental Barrier Coating Thermochemical and Thermomechanical Property Predictions

Environmental barrier coatings (EBCs) are a necessary enabling technology for the transition from superalloys to silicon carbide (SiC) ceramic matrix composites (CMCs) in gas turbine engines for increased efficiency and decreased fuel costs. SiC-based CMCs are prone to oxidation-based degradation in the engine hot section, and rare-earth (RE) silicates are promising candidates for EBCs due to their close thermal expansion match to the composite substrate and oxidation resistance. However, the design of EBCs is hindered by the large chemical space of candidate materials and the difficulty in obtaining material properties for engineering optimization. This is especially difficult as research continues into mixed-cation or “high-entropy” RE silicates. First-principles computational methods such as density functional theory (DFT) are highly effective at calculating material properties to guide coating design but are limited by their computational cost. Atomistic simulations have the potential to both accelerate property calculations and expand the properties able to be calculated due to their lower computational compared to DFT. However, they require interatomic potentials (IAPs) specific to the material system of interest, and, to our knowledge, there are no suitable IAPs for RE silicates. Machine learning (ML) is a promising technique to accelerate material property predictions indirectly by generating IAPs for atomistic simulations or via direct prediction. In this work, we present two ML approaches to accelerate the calculation of RE silicate properties relevant to EBC design: 1) a ML-derived interatomic potential (IAP) for atomistic simulations of yttrium disilicate (Y2Si2O7) from DFT training data, and 2) a neural network (NN) model to directly predict thermochemical properties of RE silicates and oxides directly from easily obtainable unit cell parameters. Classical MD simulations using the IAP yield lattice properties and bond lengths in good agreement with both DFT and experimental results from x-ray diffraction. Thermodynamic properties calculated using the finite-displacement phonon method and quasi-harmonic approximation were orders of magnitude faster than DFT with good agreement to the DFT results. The IAP was also used to calculate properties such as coefficient of thermal expansion (CTE) that require large simulation supercells and are therefore difficult with DFT. The IAP correctly predicted the anisotropic nature of the CTE in three different phases of Y2Si2O7. The NN model predicts constant pressure heat capacity, Cp, orders of magnitude faster than DFT calculations, which can enable its use as a surrogate model for multiscale simulations. The two methods presented in this work demonstrate the utility of ML for accelerating the prediction of RE silicate properties, which can in turn accelerate EBC design and optimization.

machine learning↗
NASA NTRS2006

The NASA F-15 Intelligent Flight Control Systems: Generation II

The Second Generation (Gen II) control system for the F-15 Intelligent Flight Control System (IFCS) program implements direct adaptive neural networks to demonstrate robust tolerance to faults and failures. The direct adaptive tracking controller integrates learning neural networks (NNs) with a dynamic inversion control law. The term direct adaptive is used because the error between the reference model and the aircraft response is being compensated or directly adapted to minimize error without regard to knowing the cause of the error. No parameter estimation is needed for this direct adaptive control system. In the Gen II design, the feedback errors are regulated with a proportional-plus-integral (PI) compensator. This basic compensator is augmented with an online NN that changes the system gains via an error-based adaptation law to improve aircraft performance at all times, including normal flight, system failures, mispredicted behavior, or changes in behavior resulting from damage.

Buschbacher, Mark↗
NASA NTRS1994

Computational Approaches to Vestibular Research

The Biocomputation Center at NASA Ames Research Center is dedicated to a union between computational, experimental and theoretical approaches to the study of neuroscience and of life sciences in general. The current emphasis is on computer reconstruction and visualization of vestibular macular architecture in three-dimensions (3-D), and on mathematical modeling and computer simulation of neural activity in the functioning system. Our methods are being used to interpret the influence of spaceflight on mammalian vestibular maculas in a model system, that of the adult Sprague-Dawley rat. More than twenty 3-D reconstructions of type I and type II hair cells and their afferents have been completed by digitization of contours traced from serial sections photographed in a transmission electron microscope. This labor-intensive method has now been replace d by a semiautomated method developed in the Biocomputation Center in which conventional photography is eliminated. All viewing, storage and manipulation of original data is done using Silicon Graphics workstations. Recent improvements to the software include a new mesh generation method for connecting contours. This method will permit the investigator to describe any surface, regardless of complexity, including highly branched structures such as are routinely found in neurons. This same mesh can be used for 3-D, finite volume simulation of synapse activation and voltage spread on neuronal surfaces visualized via the reconstruction process. These simulations help the investigator interpret the relationship between neuroarchitecture and physiology, and are of assistance in determining which experiments will best test theoretical interpretations. Data are also used to develop abstract, 3-D models that dynamically display neuronal activity ongoing in the system. Finally, the same data can be used to visualize the neural tissue in a virtual environment. Our exhibit will depict capabilities of our computational approaches and some of our findings from their application. For example, our research has demonstrated that maculas of adult mammals retain the property of synaptic plasticity. Ribbon synapses increase numerically and undergo changes in type and distribution (p<0.0001) in type II hair cells after exposure to microgravity for as few as nine days. The finding of macular synaptic plasticity is pertinent to the clinic, and may help explain some. balance disorders in humans. The software used in our investigations will be demonstrated for those interested in applying it in their own research.

Ross, Muriel D.↗
NASA NTRS2020

Assistive Relative Pose Estimation for On-orbit Assembly using Convolutional Neural Networks

Accurate real-time pose estimation of spacecraft or object in space is a key capability necessary for on orbit spacecraft servicing and assembly tasks. Pose estimation of objects in space is more challenging than for objects on Earth due to space images containing widely varying illumination conditions, high contrast, and poor resolution in addition to power and mass constraints. In this paper, a convolutional neural network is leveraged to uniquely determine the translation and rotation of an object of interest relative to the camera. The main idea of using CNN model is to assist object tracker used in on space assembly tasks where only feature based method is always not sufficient. The simulation framework designed for assembly task is used to generate dataset for training the modified CNN models and, then results of different models are compared with measure of how accurately models are predicting the pose. Unlike many current approaches for spacecraft or object in space pose estimation, the model does not rely on hand-crafted object-specific features which makes this model more robust and easier to apply to other types of spacecraft. It is shown that the model performs comparable to the current feature-selection methods and can therefore be used in conjunction with them to provide more reliable estimates.

Sonawani, Shubham↗
NASA NTRSDate not supplied

NNREPAIR: Constraint-based Repair of Neural Network Classifiers

We present NNREPAIR, a constraint-based technique for repairing neural network classifiers by i) fixing the logic of the network at an intermediate layer, and ii) fixing the decision conditions of the network at the last layer. NNREPAIR first uses fault localization to find potentially faulty network parameters (specifically weights) and then performs repair using constraint solving to apply small modifications to remedy the defects. We present novel strategies to enable precise yet efficient repair such as inferring correctness specifications to act as oracles for intermediate layer repair, and generation of experts wrt each class. We demonstrate the technique in the context of three different scenarios: (1) Improving the over all accuracy of a model, (2) Fixing security vulnerabilities caused by poisoning of training data and (3) Improving the robustness of the network against adversarial attacks. Our evaluation on MNIST and CIFAR-10 models shows that NNREPAIR can improve the accuracy by 45.56% on poisoned data and 11.11% on adversarial data. NNREPAIR also provides improvement, albeit modest, in the overall accuracy of models, without requiring new data or re-training.

Repair↗
NASA NTRS2015

A High Performance Computing Approach to Tree Cover Delineation in 1-m NAIP Imagery Using a Probabilistic Learning Framework

Tree cover delineation is a useful instrument in deriving Above Ground Biomass (AGB) density estimates from Very High Resolution (VHR) airborne imagery data. Numerous algorithms have been designed to address this problem, but most of them do not scale to these datasets, which are of the order of terabytes. In this paper, we present a semi-automated probabilistic framework for the segmentation and classification of 1-m National Agriculture Imagery Program (NAIP) for tree-cover delineation for the whole of Continental United States, using a High Performance Computing Architecture. Classification is performed using a multi-layer Feedforward Backpropagation Neural Network and segmentation is performed using a Statistical Region Merging algorithm. The results from the classification and segmentation algorithms are then consolidated into a structured prediction framework using a discriminative undirected probabilistic graphical model based on Conditional Random Field, which helps in capturing the higher order contextual dependencies between neighboring pixels. Once the final probability maps are generated, the framework is updated and re-trained by relabeling misclassified image patches. This leads to a significant improvement in the true positive rates and reduction in false positive rates. The tree cover maps were generated for the whole state of California, spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles. The framework produced true positive rates of around 88% for fragmented forests and 74% for urban tree cover areas, with false positive rates lower than 2% for both landscapes. Comparative studies with the National Land Cover Data (NLCD) algorithm and the LiDAR canopy height model (CHM) showed the effectiveness of our framework for generating accurate high-resolution tree-cover maps.

Segments↗
NASA NTRS1989

Studies with spike initiators - Linearization by noise allows continuous signal modulation in neural networks

It is shown that noise can be an important element in the translation of neuronal generator potentials (summed inputs) to neuronal spike trains (outputs), creating or expanding a range of amplitudes over which the spike rate is proportional to the generator potential amplitude. Noise converts the basically nonlinear operation of a spike initiator into a nearly linear modulation process. This linearization effect of noise is examined in a simple intuitive model of a static threshold and in a more realistic computer simulation of spike initiator based on the Hodgkin-Huxley (HH) model. The results are qualitatively similar; in each case larger noise amplitude results in a larger range of nearly linear modulation. The computer simulation of the HH model with noise shows linear and nonlinear features that were earlier observed in spike data obtained from the VIIIth nerve of the bullfrog. This suggests that these features can be explained in terms of spike initiator properties, and it also suggests that the HH model may be useful for representing basic spike initiator properties in vertebrates.

Yu, Xiaolong↗
NASA NTRS2022

Hybrid data-driven and model-informed online tool wear detection in milling machines

Precision machining tool wear is responsible for low product throughput and quality. Monitoring the tool wear online is vital to prevent degradation in machining quality. However, direct real-time tool wear measurement is not practical. This paper presents residual-based anomaly detection models, combining a hybrid model comprised of a physics-based model and a data-driven model (a decision tree or a neural network) to predict signals of interest (e.g., power or forces) under nominal conditions, followed by Page’s cumulative sum test for detecting tool wear on-line using the computer numerical control machine measurements. The most informative features are ranked using dynamic programming and its approximation variants from real-time measurements and machine settings, such as the width of cut, depth of cut, feed rate and spindle speed, that serve as inputs to the predictive models. The baseline nominal model is incrementally updated with experimental data via a gradient boosted adaptation model to generate the residuals that account for discrepancies between the actual machine data under normal conditions and the baseline nominal model predictions. The hybrid model is validated against 20 Mazak milling machine experimental tests and one Haas run-to-failure experiment. The proposed anomaly detector is applied to synthetic data from simulations of the physics-based model at different operating conditions, measurement noise levels, and tool wear levels, and the methods were able to achieve an overall 92% accuracy in data with 1% noise. The anomaly detection methods based on hybrid model reduced the false alarms of either the data-driven or physical-based models alone, and are found to be capable of good online detection of tool wear.

Online anomaly detection↗
NASA NTRS1993

Detection of bearing failure in mechanical devices using neural networks

We present a novel time-domain method for the detection of faulty bearings that has direct applicability to monitoring the health of the turbo pumps on the Space Shuttle Main Engine. A feed-forward neural network was trained to detect modelled roller bearing faults on the basis of the periodicity of impact pulse trains. The network's performance was dependent upon the number of pulses in the network's input window and the signal-to-noise ratio of the input signal. To test the model's validity, we fit the model's parameters to an actual vibration signal generated by a faulty roller element bearing and applied the network trained on this model to detect faults in actual vibration data. When this network was tested on the actual vibration data, it correctly identified the vibration signal as a fault condition 76 percent of the time.

Burne, Richard A.↗
NASA NTRSDate not supplied

SWIPE: Spectral Water Inversion Processor and Emulator

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will be discussing the progress made developing SWIPE: Spectral Water Inversion Processor and Emulator. SWIPE is a platform for advanced modeling of coastal and inland aquatic habitats. The goal is create a comprehensive and cohesive system to leverage recent advancements in computation and machine learning to develop a synthetic training ground for sensitivity studies and algorithm development. The four principal facets of SWIPE include: 1. Advanced two-layer coated sphere bio-optical modeling and GPU radiative transfer modeling, 2. Big Data involving massive synthetic spectral libraries of optical properties of various global aquatic particles, surface reflectance, and top-of-atmosphere reflectance, all at hyperspectral resolution leveraging high-end computing systems at NASA Ames Research Center, 3. Deep Learning for algorithm development for water quality inversion of concentrations of common biogeophysical variables as well as optics, full uncertainty characterization by water type, and forward emulation, and lastly, 4. Image Processing for application of developed retrieval algorithms for both hyperspectral and multispectral sensors with experimental corrections for global adjacency, noise, sunglint, and benthic reflectance. This presentation will demonstrate the Equivalent Algal Populations (EAP) two-layer coated sphere scattering model which has been used develop spectral libraries of hyperspectral inherent optical properties of roughly 80 species of phytoplankton, covering 15 different classes and nine taxonomic functional types. The EAP model was also used to derive spectral properties of 10 different non-algal particle functional types. Examples of how the SMART-G (Speed-up Monte-carlo Advanced Radiative Transfer using GPU) radiative transfer code is used to model optically complex aquatic signals will be presented and discussed in the context of creating a massive synthetic database which can leverage the full power of next generation machine learning techniques and high end computing for water quality inversion. We will discuss our active investigation in things like appropriate model architectures, dimensionality reduction techniques such as PCA and autoencoders, uncertainty quantification and abstaining, and which variables actually benefit most from hyperspectral information versus multispectral resolution. We are also curious about questions relating to cost/benefit analysis in terms of computation resources, neural network complexity, and data volumes. Answers to these questions will hopefully elaborate on cost efficiency for potential future sensor design considerations.

SWIPE↗
NASA NTRS1993

Back Propagation Neural Networks for Predicting Ultimate Strengths of Unidirectional Graphite/Epoxy Tensile Specimens

The research presented herein demonstrates the feasibility of predicting ultimate strengths in simple composite structures through a neural network analysis of their acoustic emission (AE) amplitude distribution data. A series of eleven ASTM D-3039 unidirectional graphite/epoxy tensile samples were loaded to failure to generate the amplitude distributions for this analysis. A back propagation neural network was trained to correlate the AE amplitude distribution signatures generated during the first 25% of loading with the ultimate strengths of the samples. The network was trained using two sets of inputs: (1) the statistical parameters obtained from a Weibull distribution fit of the amplitude distribution data, and (2) the event frequency (amplitude) distribution itself. The neural networks were able to predict ultimate strengths with a worst case error of -8.99% for the Weibull modeled amplitude distribution data and 3.74% when the amplitude distribution itself was used to train the network. The principal reason for the improved prediction capability of the latter technique lies in the ability of the neural network to extract subtle features from within the amplitude distribution.

Walker, James L.↗
NASA NTRS1990

Learning and diagnosing faults using neural networks

Neural networks have been employed for learning fault behavior from rocket engine simulator parameters and for diagnosing faults on the basis of the learned behavior. Two problems in applying neural networks to learning and diagnosing faults are (1) the complexity of the sensor data to fault mapping to be modeled by the neural network, which implies difficult and lengthy training procedures; and (2) the lack of sufficient training data to adequately represent the very large number of different types of faults which might occur. Methods are derived and tested in an architecture which addresses these two problems. First, the sensor data to fault mapping is decomposed into three simpler mappings which perform sensor data compression, hypothesis generation, and sensor fusion. Efficient training is performed for each mapping separately. Secondly, the neural network which performs sensor fusion is structured to detect new unknown faults for which training examples were not presented during training. These methods were tested on a task of fault diagnosis by employing rocket engine simulator data. Results indicate that the decomposed neural network architecture can be trained efficiently, can identify faults for which it has been trained, and can detect the occurrence of faults for which it has not been trained.

Whitehead, Bruce A.↗
NASA NTRS2006

An Optimization of Pulsed ElectroMagnetic Fields Study

To date, in our research we have focused on the use of normal human neuronal progenitor (NHNP) cells because of their importance in human nervous system regeneration, development and maintenance, but we have developed 2-D and 3-D bioreactors that can accommodate any cell line. In this Project, we will include the use of tissues important for physiological regeneration: Human osteoblasts or chondrocytes, and vascular cells. Our initial results with the NHNP cells were quite startling using extremely low-level electromagnetic fields (5 microtesla at 10Hz; 6mA). The low-amplitude, rapidly time-varying electromagnetic fields exert a very potent effect on the proliferation, morphology, and gene expression of the cells in culture, both in standard 2-dimensional culture plates as well as cells organized into 3-dimensional tissue-like assemblies (TLAs) in a 3D bioreactor. We have replicated our preliminary results many, many times, have analyzed the gene expression using gene arrays (followed by Luminex analysis for protein production), and have monitored cell proliferation, orientation, morphology, and glucose metabolism, and we are confident that we have a stable and reliable model to study the control of high-level cellular processes by application of low-amplitude, time varying electromagnetic fields (TVEMF) (1, 2). In additional studies at the University of Michigan, we have been able to generate functional in vitro engineered mammalian skeletal muscle, and have employed nerve-muscle co-culture techniques to promote axonal sprouting. We believe that nearly all tissues, in particular, neural, are susceptible to the influences of low-level TVEMF.

Goodwin, Thomas J.↗
NASA NTRS2023

Predicting Two-Dimensional Airfoil Performance Using Graph Neural Networks

Computer simulations require the use of meshes to simulate geometries. These meshes capture important geometric features of the design and can be used in machine learning modeling. This report explores the use of graph neural networks (GNNs) to learn features from two-dimensional (2D) airfoil designs represented as a set of nodes connected using edges. This type of network is common in aerospace applications: most geometries are represented as a mesh in order to perform analysis. The objective of this work is to use GNNs to predict the performance of 2D airfoils generated using the program XFOIL. The predicted performance parameters include bulk quantities such as coefficients of lift (C L ), drag (C d , C dp ), moment (C m ), and node-specific quantities such as coefficient of pressure (C p ). In this report, a spline convolutional graph-based neural network is compared with deep learning neural networks to predict both bulk and node-specific quantities. The findings indicate the GNNs are able to predict bulk quantities quite well; however, when the number of outputs is increased, the deep neural network (DNN) proves to be better in its prediction capability. Two different normalization strategies were compared in the training of both GNNs and DNNs: minmax and standard deviation. In both types of networks, standard deviation scaling proved to be the best.

machine learning↗
NASA NTRS1989

A neural network for controlling the configuration of frame structure with elastic members

A neural network for controlling the configuration of frame structure with elastic members is proposed. In the present network, the structure is modeled not by using the relative angles of the members but by using the distances between the joint locations alone. The relationship between the environment and the joints is also defined by their mutual distances. The analog neural network attains the reaching motion of the manipulator as a minimization problem of the energy constructed by the distances between the joints, the target, and the obstacles. The network can generate not only the final but also the transient configurations and the trajectory. This framework with flexibility and parallelism is very suitable for controlling the Space Telerobotic systems with many degrees of freedom.

Tsutsumi, Kazuyoshi↗
NASA NTRS2014

Three-Dimensional Normal Human Neutral Progenitor Tissue-Like Assemblies: A Model for Persistent Varicella-Zoster Virus Infection and Platform to Study Oxidate Stress and Damage in Multiple Hit Scenarios

The environment of space results in a multitude of challenges to the human physiology that present barriers to extended habitation and exploration. Over 40 years of investigation to define countermeasures to address space flight adaptation has left gaps in our knowledge regarding mitigation strategies partly due to the lack of investigative tools, monitoring strategies, and real time diagnostics to understand the central causative agent(s) responsible for physiologic adaptation and maintaining homeostasis. Spaceflight-adaptation syndrome is the combination of space environmental conditions and the synergistic reaction of the human physiology. Our work addresses the role of oxidative stress and damage (OSaD) as a negative and contributing Risk Factor (RF) in the following areas of combined spaceflight related dysregulation: i) radiation induced cellular damage [1], [2] ii) immune impacts and the inflammatory response [3], [4] and iii) varicella zoster virus (VZV) reactivation [5]. Varicella-zoster (VZV)/Chicken Pox virus is a neurotropic human alphaherpes virus resulting in varicella upon primary infection, suppressed by the immune system becomes latent in ganglionic neurons, and reactivates under stress events to re-express in zoster and possibly shingles. Our laboratory has developed a complex three-dimensional (3D) normal human neural tissue model that emulates several characteristics of the human trigeminal ganglia (TG) and allows the study of combinatorial experimentation which addresses, simultaneously, OSaD associated with Spaceflight adaptation and habitation [6]. By combining the RFs of microgravity, radiation, and viral infection we will demonstrate that living in the space environment leads to significant physiological consequences for the peripheral and subsequently the central nervous system (PNS, CNS) associated with OSaD generation and consequentially endangers long-duration and exploration-class missions.

Goodwin, Thomas J.↗
NASA NTRS2013

Prediction of Visual Acuity from Wavefront Aberrations

A method for generating a visual acuity metric, based on wavefront aberrations (WFAs), associated with a test subject and representing classes of imperfections, such as defocus, astigmatism, coma and spherical aberrations, of the subject's visual system. The metric allows choices of different image template, can predict acuity for different target probabilities, can incorporate different and possibly subject-specific neural transfer functions, can predict acuity for different subject templates, and incorporates a model of the optotype identification task.

Watson, Andrew B.↗