Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative Neural Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Self-growing neural network architecture using crisp and fuzzy entropy

The paper briefly describes the self-growing neural network algorithm, CID2, which makes decision trees equivalent to hidden layers of a neural network. The algorithm generates a feedforward architecture using crisp and fuzzy entropy measures. The results of a real-life recognition problem of distinguishing defects in a glass ribbon and of a benchmark problem of differentiating two spirals are shown and discussed.

Cios, Krzysztof J.↗

Self-growing neural network architecture using crisp and fuzzy entropy

The paper briefly describes the self-growing neural network algorithm, CID3, which makes decision trees equivalent to hidden layers of a neural network. The algorithm generates a feedforward architecture using crisp and fuzzy entropy measures. The results for a real-life recognition problem of distinguishing defects in a glass ribbon, and for a benchmark problen of telling two spirals apart are shown and discussed.

Cios, Krzysztof J.↗

Usage of ChatGPT for Engineering Design and Analysis Tool Development

ChatGPT, a generative AI large language model, has recently captured significant attention in both the computer science community and the broader public domain. It has demonstrated a wide range of capabilities, from answering simple questions to writing fully functional computer code. This study spotlights both the capabilities and limitations of ChatGPT when addressing engineering problems. The model's capacity to generate practical engineering tools is highlighted through an example of a prompt that leads to an interactive plotting tool, enabling the examination of the fluid boundary layer around a fan blade. Subsequently, the paper also uncovers potential pitfalls in ChatGPT’s application, shown through an unsuccessful attempt to use ChatGPT to automate a process in Ansys Workbench through scripting. The research further investigates ChatGPT's proficiency in addressing inquiries and providing explanations about the functionalities of OpenMDAO, an open-source, multidisciplinary design, analysis, and optimization tool developed at NASA Glenn Research Center. Finally, an optimization methodology, developed with ChatGPT’s help, is applied to the structural optimization of a fan blade. The developed optimization method utilizes T-Blade3 for geometry generation, Ansys Mechanical for meshing and finite element analysis, and sci-kit learn’s MLPRegressor method to generate a trained neural network model of the design space. OpenMDAO is then used to find the optimal point within the design space. The outcome is a significant reduction in stress in the optimized model—less than one-fifth of the stress value in the baseline model.

Design↗

Usage of ChatGPT for Engineering Design and Analysis Tool Development

ChatGPT, a generative AI large language model, has recently captured significant attention in both the computer science community and the broader public domain. It has demonstrated a wide range of capabilities, from answering simple questions to writing fully functional computer code. This study spotlights both the capabilities and limitations of ChatGPT when addressing engineering problems. The model's capacity to generate practical engineering tools is highlighted through an example of a prompt that leads to an interactive plotting tool, enabling the examination of the fluid boundary layer around a fan blade. Subsequently, the paper also uncovers potential pitfalls in ChatGPT’s application, shown through an unsuccessful attempt to use ChatGPT to automate a process in Ansys Workbench through scripting. The research further investigates ChatGPT's proficiency in addressing inquiries and providing explanations about the functionalities of OpenMDAO, an open-source, multidisciplinary design, analysis, and optimization tool developed at NASA Glenn Research Center. Finally, an optimization methodology, developed with ChatGPT’s help, is applied to the structural optimization of a fan blade. The developed optimization method utilizes T-Blade3 for geometry generation, Ansys Mechanical for meshing and finite element analysis, and sci-kit learn’s MLPRegressor method to generate a trained neural network model of the design space. OpenMDAO is then used to find the optimal point within the design space. The outcome is a significant reduction in stress in the optimized model—less than one-fifth of the stress value in the baseline model.

Design↗

Advancing earth system model calibration: a diffusion-based method

Understanding of climate impact on ecosystems globally requires site-specific model calibration. Here we introduce a novel diffusion-based uncertainty quantification (DBUQ) method for efficient model calibration. DBUQ is a score-based diffusion model that leverages Monte Carlo simulation to estimate the score function and evaluates a simple neural network to quickly generate samples for approximating parameter posterior distributions. DBUQ is stable, efficient, and can effectively calibrate the model given diverse observations, thereby enabling rapid and site-specific model calibration on a global scale. This capability significantly advances Earth system modeling and our understanding of climate impacts on Earth systems. We demonstrate DBUQ's capability in E3SM land model calibration at the Missouri Ozark AmeriFlux forest site. Both synthetic and real-data applications indicate that DBUQ produces accurate parameter posterior distributions similar to those generated by Markov Chain Monte Carlo sampling but with 30X less computing time. This efficiency marks a significant stride in model calibration, paving the way for more effective and timely climate impact analyses.

Liu, Yanfang↗

Neural Network Code MATLAB

SAND2022-12606 O Neural Network Code MATLAB reads in an excel file, processes the data, trains a neural network, and tests the neural network. The code generates predictions of diffusion constants based on the data in the excel file. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Allers, Joshua↗

The use of artificial neural networks and multiple linear regression to predict rate of medical waste generation

Prediction of the amount of hospital waste production will be helpful in the storage, transportation and disposal of hospital waste management. Based on this fact, two predictor models including artificial neural networks (ANNs) and multiple linear regression (MLR) were applied to predict the rate of medical waste generation totally and in different types of sharp, infectious and general. In this study, a 5-fold cross-validation procedure on a database containing total of 50 hospitals of Fars province (Iran) were used to verify the performance of the models. Three performance measures including MAR, RMSE and R{sup 2} were used to evaluate performance of models. The MLR as a conventional model obtained poor prediction performance measure values. However, MLR distinguished hospital capacity and bed occupancy as more significant parameters. On the other hand, ANNs as a more powerful model, which has not been introduced in predicting rate of medical waste generation, showed high performance measure values, especially 0.99 value of R{sup 2} confirming the good fit of the data. Such satisfactory results could be attributed to the non-linear nature of ANNs in problem solving which provides the opportunity for relating independent variables to dependent ones non-linearly. In conclusion, the obtained results showed that our ANN-based model approach is very promising and may play a useful role in developing a better cost-effective strategy for waste management in future.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Unsupervised learning about 4D features of microparticle motion

Material clusters of different sizes are known to exist in high-temperature plasmas due to plasma-wall interactions. The facts that these clusters, ranging from sub-microns to above mm in size, can move from one location to another quickly and that there are a lot of them make high-speed imaging and tracking one of the best, effective, and sometimes only diagnostic. An unsupervised machine learning technique based on deconvolutional neural networks is developed to analyze two-camera videos of high-temperature microparticles generated from exploding wires. The neural network utilizes a locally competitive algorithm to infer representations and optimize a dictionary composed of kernels, or basis vectors, for image analysis. Our primary goal is to use this method for feature recognition and prediction of the time-dependent three-dimensional (or “4D”) microparticle motion. Features equivalent to local velocity vectors have been identified as the dictionary kernels or “building blocks” of the scene. The dictionary elements from the left and right camera views are found to be strongly correlated and satisfy the projection geometrical constraints. The results show that unsupervised machine learning techniques are promising approaches to process large sets of images for high-temperature plasmas and other scientific experiments. In conclusion, machine learning techniques can be useful to handle the large amount of data and therefore aid the understanding of plasma-wall interaction.

47 OTHER INSTRUMENTATION↗

Machine-Learning-Based Monitoring of Laser Powder Bed Fusion

A two-step machine learning approach to monitoring Laser Powder Bed Fusion (LPBF) additive manufacturing is demonstrated that enables on-the-fly assessments of laser track welds. First, in situ video melt pool data acquired during LPBF is labeled according to the (1) average and (2) standard deviation of individual track width and also (3) whether or not the track is continuous, measured post-build through an ex situ height map analysis algorithm. This procedure generates three ground truth labeled datasets for supervised machine learning. Using a portion of the labeled 10-millisecond video clips, a single Convolutional Neural Network architecture is trained to generate three distinct networks. With the remaining in situ LPBF data, the trained neural networks are tested and evaluated and found to predict track width, standard deviation, and continuity without the need for ex situ measurements. This two-step approach should benefit any LPBF system – or any additive manufacturing technology – where height-map-derived properties can serve as useful labels for in situ sensor data.

42 ENGINEERING↗

Parameter Estimation for Electrode Degradation: Learning in the Face of Model-Experiment Discrepancies

Use of physics-based models to interpret battery degradation data over the course of cycling can provide deeper physical insight into the internal states of the system and how they evolve. We present a neural network trained on simulations generated by a previously published physics-based model for a lithium trivanadate (LVO) cathode to estimate parameters that evolve over the course of cycling. We focus on the robustness of the neural network through two case studies that probe different kinds of discrepancies between model and experiment: nonideal data and imperfect model. In the former, the experimental protocols do not meet the assumption made in the training data generated by the physics-based model, while in the latter, the physics-based model fails to describe all of the measured cathode behavior even under ideal conditions. When there is total model-experiment agreement, a neural network estimates parameters with improved accuracy compared to a maximum likelihood analysis using the same set of simulations. However, in both types of model-experiment discrepancy, the neural network returned biased parameter estimates. We introduce a data augmentation procedure into the neural network training to mitigate these effects and improve robustness, and employ it to estimate parameters for a cycling LVO cathode.

Mayilvahanan, Karthik S. (ORCID:0000000316282332)↗

Adversarial sampling of unknown and high-dimensional conditional distributions

Many engineering problems require the prediction of realization-to-realization variability or a refined description of modeled quantities. In that case, it is necessary to sample elements from unknown high-dimensional spaces with possibly millions of degrees of freedom. While there exist methods able to sample elements from probability density functions (PDF) with known shapes, several approximations need to be made when the distribution is unknown. In this paper the sampling method, as well as the inference of the underlying distribution, are both handled with a data-driven method known as generative adversarial networks (GAN), which trains two competing neural networks to produce a network that can effectively generate samples from the training set distribution. In practice, it is often necessary to draw samples from conditional distributions. When the conditional variables are continuous, only one (if any) data point corresponding to a particular value of a conditioning variable may be available, which is not sufficient to estimate the conditional distribution. This work handles this problem using an a priori estimation of the conditional moments of a PDF. Herein, two approaches, stochastic estimation, and an external neural network are compared for computing these moments; however, any preferred method can be used. The algorithm is demonstrated in the case of the deconvolution of a filtered turbulent flow field. It is shown that all the versions of the proposed algorithm effectively sample the target conditional distribution with minimal impact on the quality of the samples compared to state-of-the-art methods. Additionally, the procedure can be used as a metric for the diversity of samples generated by a conditional GAN (cGAN) conditioned with continuous variables.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

WE-AB-204-06: Pseudo-CT Generation Using Undersampled, Single-Acquisition UTE-MDixon and Direct-Mapping Artificial Neural Networks for MR-Based Attenuation Correction and Radiation Therapy Planning

Purpose: Emerging technologies such as dedicated PET/MRI and MR-therapy systems require robust and clinically practical methods for determining photon attenuation. Herein, we propose using novel MR acquisition methods and processing for the generation of pseudo-CTs. Methods: A single acquisition, 190-second UTE-mDixon sequence with 25% (angular) sampling density and 3D radial readout was performed on nine volunteers. Three water-filled tubes were placed in the FOV for trajectory-delay correction. The MR data were reconstructed to generate three primitive images acquired at TEs of 0.1, 1.5 and 2.8 ms. In addition, three derived MR images were generated, i.e. two-point Dixon water/fat separation and R2* (1/T2*) map. Furthermore, two spatial features, i.e. local binary pattern (S-1) and relative spatial coordinates (S-2), were incorporated. A direct-mapping operator was generated using Artificial Neural Networks (ANNs) for transforming the MR features to a pseudo-CT. CT images served as the training data and, using a leave-one-out method, for performance evaluation using mean prediction deviation (MPD), mean absolute prediction deviation (MAPD), and correlation coefficient (R). Results: The errors between measured CT and pseudo-CT declined dramatically when the spatial features, i.e. S-1 and S-2, were included. The MPD, MAPD, and R were, respectively, 5±57 HU, 141±41 HU, and 0.815±0.066 for results generated by the ANN trained without the spatial features and were 32±26 HU, 115±18 HU, and 0.869±0.035 with the spatial features. The estimation errors of the pseudo-CT were smaller when both the S-1 and S-2 were used together than when either the S-1 or the S-2 was used. Pseudo-CT generation (256×256×256 voxels) by ANN took < 0.5 s using a computer having an Intel i7 3.4GHz CPU and 16 GB RAM. Conclusion: The proposed direct-mapping ANN approach is a technically accurate, clinically practical method for pseudo-CT generation and can potentially help improve the accuracy of MR-AC and MR-RTP applications. Please note that the project was completed with partial funding from the Ohio Department of Development grant TECH 11-063 and a sponsored research agreement with Philips Healthcare that is managed by Case Western Reserve University. As noted in the affiliations, some of the authors are Philips employees.

60 APPLIED LIFE SCIENCES↗

Hybrid Quantum-Classical Neural Network for Calculating Ground State Energies of Molecules

We present a hybrid quantum-classical neural network that can be trained to perform electronic structure calculation and generate potential energy curves of simple molecules. The method is based on the combination of parameterized quantum circuits and measurements. With unsupervised training, the neural network can generate electronic potential energy curves based on training at certain bond lengths. To demonstrate the power of the proposed new method, we present the results of using the quantum-classical hybrid neural network to calculate ground state potential energy curves of simple molecules such as H 2 , LiH, and BeH 2 . The results are very accurate and the approach could potentially be used to generate complex molecular potential energy surfaces.

74 ATOMIC AND MOLECULAR PHYSICS↗

Prediction of Carbon Dioxide Adsorption via Deep Learning

Abstract Porous carbons with different textural properties exhibit great differences in CO 2 adsorption capacity. It is generally known that narrow micropores contribute to higher CO 2 adsorption capacity. However, it is still unclear what role each variable in the textural properties plays in CO 2 adsorption. Herein, a deep neural network is trained as a generative model to direct the relationship between CO 2 adsorption of porous carbons and corresponding textural properties. The trained neural network is further employed as an implicit model to estimate its ability to predict the CO 2 adsorption capacity of unknown porous carbons. Interestingly, the practical CO 2 adsorption amounts are in good agreement with predicted values using surface area, micropore and mesopore volumes as the input values simultaneously. This unprecedented deep learning neural network (DNN) approach, a type of machine learning algorithm, exhibits great potential to predict gas adsorption and guide the development of next‐generation carbons.

Zhang, Zihao↗

Prediction of Carbon Dioxide Adsorption via Deep Learning

Porous carbons with different textural properties exhibit great differences in CO 2 adsorption capacity. It is generally known that narrow micropores contribute to higher CO 2 adsorption capacity. However, it is still unclear what role each variable in the textural properties plays in CO 2 adsorption. Herein, a deep neural network is trained as a generative model to direct the relationship between CO 2 adsorption of porous carbons and corresponding textural properties. The trained neural network is further employed as an implicit model to estimate its ability to predict the CO 2 adsorption capacity of unknown porous carbons. Interestingly, the practical CO 2 adsorption amounts are in good agreement with predicted values using surface area, micropore and mesopore volumes as the input values simultaneously. This unprecedented deep learning neural network (DNN) approach, a type of machine learning algorithm, exhibits great potential to predict gas adsorption and guide the development of next-generation carbons.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning methods for event verification and image re-purposing detection

Systems and methods herein describe accessing an image, generating a resized image, generating an image feature vector by applying an image classification neural network to the resized image, generating analysis of the image by processing the image feature vector using a machine-learning classifier trained to analyze the image feature vector, and based on the analysis, determining an event that is attributed to the image.

Nataraj, Lakshmanan↗

CTGAN-TVAE

SAND2026-18914O CTGAN-TVAE (Conditional Tabular Generative Adversarial Networks-Tabular Variational Autoencoders) generates extensive sets of variable generation data through a hybrid framework. It enhances latent space representation by combining TVAE's robust feature-embedding with CTGAN's ability to condition categorical variables such as time. CTGAN-TVAE employs a fully connected neural network within a conditional generative adversarial network framework to manage continuous and categorical data effectively, capturing complex feature interactions without needing sequential modeling. This was developed as part of NNSA-MSIPP: Minority Serving Institution Partnership Program, Grant Number DE-NA0004016. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Newlun, Cody [Sandia National Lab. (SNL-CA), Liver↗

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗