Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neural simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Inferring Structural Parameters of Low-Surface-Brightness-Galaxies with Uncertainty Quantification using Bayesian Neural Networks

Measuring the structural parameters (size, total brightness, light concentration, etc.) of galaxies is a significant first step towards a quantitative description of different galaxy populations. In this work, we demonstrate that a Bayesian Neural Network (BNN) can be used for the inference, with uncertainty quantification, of such morphological parameters from simulated low-surface-brightness galaxy images. Compared to traditional profile-fitting methods, we show that the uncertainties obtained using BNNs are comparable in magnitude, well-calibrated, and the point estimates of the parameters are closer to the true values. Our method is also significantly faster, which is very important with the advent of the era of large galaxy surveys and big data in astrophysics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Aeroacoustic Characterization of Optimum Hovering Rotors using Artificial Neural Networks

This work illustrates the use of artificial neural network modeling in the aerodynamic and aeroacoustic characterization of optimum hovering rotors over a broad range of design and operating conditions. Design of Experiments was used to create input feature spaces over eight input factors: the number of rotor blades, rotor radius, rotor rotation rate, design thrust condition, collective pitch, airfoil camber, the location of maximum camber, and the airfoil thickness. A low-fidelity tool chain was then used at the discrete data points defined by the designed input feature spaces to analytically design optimum hovering rotors and simulate aerodynamic and aeroacoustic quantities. This allowed for the generation of data sets over which to train and test the artificial neural network prediction models. Prediction models were trained over the data sets for the actual thrust generated by the rotor, power loading, tonal thickness and loading noise at the fundamental blade passage frequency, and broadband self-noise at seventeen one-third octave bands between 1 kHz and 40 kHz. These prediction models were validated by testing over data previously unseen by the models to quantify their capability for generalization to new data within the design feature space. The models were then used to study the effect each input feature had on the aeroacoustics and aerodynamics of optimum hovering rotors and physical insights were concluded to further explain the effect of each input. This characterization study showed that tonal noise and power loading were most sensitive to the number of rotor blades and the rotor rotation rate and that broadband noise was most sensitive to collective pitch and the design thrust condition.

Christopher S Thurman↗

Efficient mapping between void shapes and stress fields using Deep Convolutional Neural Networks with sparse data

Establishing fast and accurate structure-to-property relationships is an important component in the design and discovery of advanced materials. Physics-based simulation models like the finite element method (FEM) are often used to predict deformation, stress, and strain fields as a function of material microstructure in material and structural systems. Such models may be computationally expensive and time intensive if the underlying physics of the system is complex. This limits their application to solve inverse design problems and identify structures that maximize performance. In such scenarios, surrogate models are employed to make the forward mapping computationally efficient to evaluate. However, the high dimensionality of the input microstructure and the output field of interest often renders such surrogate models inefficient, especially when dealing with sparse data. Deep convolutional neural network (CNN) based surrogate models have shown great promise in handling such high-dimensional problems. In this paper, a single ellipsoidal void structure under a uniaxial tensile load represented by a linear elastic, high-dimensional and expensive-to-query, FEM model. We consider two deep CNN architectures, a modified convolutional autoencoder framework with a fully connected bottleneck and a UNet CNN, and compare their accuracy in predicting the von Mises stress field for any given input void shape in the FEM model. Additionally, a sensitivity analysis study is performed using the two approaches, where the variation in the prediction accuracy on unseen test data is studied through numerical experiments by varying the number of training samples from 20 to 100.

surrogate modeling; convolutional neural networks;↗

Validation of a High-Fidelity Supersonic Parachute Inflation Dynamics Model and Best Practice

The parachute inflation dynamics (PID) of a Disk-Gap-Band (DGB) parachute system travelling at supersonic velocities in the high-altitude Earth atmosphere is simulated using a high-fidelity, multiphysics, massively-parallel computational framework. The sensitivity of the simulation results with respect to critical modelling and simulation parameters, including the fluid mechanical governing equations (Euler vs Navier-Stokes with RANS turbulence closure vs Navier-Stokes with LES turbulence closer), the interaction between the flow and the suspension lines (accounted for vs not accounted for), the dynamics of the payload (restrained vs free), and the material model of the heterogeneous fabric canopy (Saint-Venant Kirchoff vs mechanics-informed multiscale neural network), is extensively investigated. The parameter investigation is enabled by advancements to the state-of-the-art in the modelling and simulation of the supersonic parachute inflation process, which are presented as part of the computational framework. The predictive quality of the computational framework in the context of supersonic PID is validated by comparison of the simulation results with the experimental results from NASA’s Advanced Supersonic Parachute Research (ASPIRE) project. Through the validation, best practices for the modelling and simulation of supersonic PID are developed and proposed.

Rabinovitch, Jason↗

Generative Physics-Informed Neural Network Solving Multi-Scale and Multi-Phase Plasma Chemical Flow Field

Low-temperature plasmas (LTPs) are non-equilibrium systems with near-room-temperature gas and highly energetic electrons. This makes them ideal for delicate applications in biomedicine and semiconductor manufacturing, enabling processes like wound healing, sterilization, etching, and plasma-enhanced chemical vapor deposition without thermal damage. However, LTPs involve complex chemistries, with hundreds of species and thousands of reactions, complicating their diagnosis, prediction, and control. Conventional diagnostics, such as Fourier-transform infrared spectroscopy (FTIR), laser-induced fluorescence (LIF), and optical emission spectroscopy (OES), offer limited species detection, while mass spectrometry (MS) struggles with low-sensitivity species. Additionally, LTP simulations face multi-scale challenges, as macroscopic fluid dynamics and microscopic particle collisions operate on vastly different timescales. To address these issues, we developed an artificial intelligence (AI) based diagnostic system: a generative physics-informed neural network (PINN-Gen) that can predict spatially resolved species concentrations and temperatures in LTPs by integrating experimental data from planar LIF with microscopic plasma chemical kinetics and macroscopic fluid mechanics, including plasma-liquid interactions at the interface between two phases. PINN-Gen solves no equations but checks the errors of physical laws by substituting the output from neural network, and the comparison with the experimental results. Thus, it naturally avoids the multi-scale difficulty of numerical simulations and predicts the results of conventionally unsolvable multi-scale and multi-phase problems. The real-time prediction will be robust due to the physical information used in the training of such a neural network, and only very limited input of condition required due to its generative feature.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Latent Neural ODE for Integrating Multi-Timescale Measurements in Smart Distribution Grids

Under a smart grid paradigm, there has been an increase in sensor installations to enhance situational awareness. The measurements from these sensors can be leveraged for real-time monitoring, control, and protection. However, these measurements are typically irregularly sampled. These measure-ments may also be intermittent due to communication bandwidth limitations. To tackle this problem, this paper proposes a novel latent neural ordinary differential equations (LODE) approach to aggregate the unevenly sampled multivariate time-series measurements. The proposed approach is flexible in performing both imputations and predictions while being computationally efficient. Simulation results on IEEE 37 bus test systems illustrate the efficiency of the proposed approach.

multi time-scale measurements↗

Self-organization via active exploration in robotic applications

We describe a neural network based robotic system. Unlike traditional robotic systems, our approach focussed on non-stationary problems. We indicate that self-organization capability is necessary for any system to operate successfully in a non-stationary environment. We suggest that self-organization should be based on an active exploration process. We investigated neural architectures having novelty sensitivity, selective attention, reinforcement learning, habit formation, flexible criteria categorization properties and analyzed the resulting behavior (consisting of an intelligent initiation of exploration) by computer simulations. While various computer vision researchers acknowledged recently the importance of active processes (Swain and Stricker, 1991), the proposed approaches within the new framework still suffer from a lack of self-organization (Aloimonos and Bandyopadhyay, 1987; Bajcsy, 1988). A self-organizing, neural network based robot (MAVIN) has been recently proposed (Baloch and Waxman, 1991). This robot has the capability of position, size rotation invariant pattern categorization, recognition and pavlovian conditioning. Our robot does not have initially invariant processing properties. The reason for this is the emphasis we put on active exploration. We maintain the point of view that such invariant properties emerge from an internalization of exploratory sensory-motor activity. Rather than coding the equilibria of such mental capabilities, we are seeking to capture its dynamics to understand on the one hand how the emergence of such invariances is possible and on the other hand the dynamics that lead to these invariances. The second point is crucial for an adaptive robot to acquire new invariances in non-stationary environments, as demonstrated by the inverting glass experiments of Helmholtz. We will introduce Pavlovian conditioning circuits in our future work for the precise objective of achieving the generation, coordination, and internalization of sequence of actions.

Ogmen, H.↗

Machine learning prediction on the fractional free volume of polymer membranes

Fractional free volume (FFV) characterizes the microstructural level features of polymers and affects their properties including thermal, mechanical, and separation performance. Experimental measurements and theoretical analyses have been used to quantify the FFV of polymers, but challenges remain because of their limitations. Experimental measurements are laborious and based on semi empirical equations, while Bondi’s group contribution theory involves ambiguities like the determination of van der Waals volume and the choice of factor values in the theoretical equation. To efficiently evaluate the FFV of polymers, this study utilizes high-throughput molecular dynamics (MD) simulations to build a large dataset regarding polymer’s FFV. Based on this large dataset, we further build machine learning (ML) models to establish the composition-structure relation. Inspired by group contribution theory which correlates polymer’s functional groups to FFV, our ML models correlate polymer’s substructures or physico-chemical indexes to FFV. Here, our study first benchmarks the MD simulation protocol to obtain reliable FFV of polymers and then carries out high-throughput MD simulations for more than 6,500 homopolymers and 1,400 polyamides. Such a large and diverse dataset makes the well-trained ML models more generalizable, compared with the group contribution theory. The efficiency of a feed forward neural network model is further demonstrated by applying it to a hypothetical polyimide dataset of more than 8 million chemical structures. The predicted FFVs of hypothetical polyimides are further validated by MD simulations. The obtained FFVs of the 8 million polymers, plus their previously reported gas separation performances, demonstrate the promising capability of ML virtual screening for the discovery of polymer membranes with exceptional permeability/selectivity.

36 MATERIALS SCIENCE↗

Real-Time Sea State Estimation for Wave Energy Converter Control via Machine Learning

Wave energy converters (WECs) harness the untapped power of ocean waves to generate renewable energy, offering a promising solution to sustainable energy. An optimal WEC control strategy is essential to maximize power capture that dynamically adjusts system parameters in response to rapidly changing sea states. This study presents a novel control approach that leverages neural networks to estimate sea states from onboard WEC measurements such as position, velocity, and force. Using a point absorber WEC device as a test platform, our proposed approach estimates sea states in real-time and subsequently adjusts PID controller gains to maximize energy extraction. Simulation results across diverse sea conditions demonstrate that our strategy eliminates the need for external wave monitoring equipment while maintaining power capture efficiency. The results show that our neural network-based control technique can improve power capture by 25.6% while significantly reducing system complexity. This approach offers a practical alternative for WEC deployments where direct wave measurements are either infeasible or cost prohibitive.

PIDcontrol↗

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

Numerical and Experimental Investigations of Polyurethane Foam for Use as Cask Impact Limiter in Accidental Drop Scenarios - 12099

Rigid, closed-cell polyurethane foams are frequently used as cask impact limiters in nuclear materials and hazardous waste transport due to their high energy-absorption potential. When assessing the cask integrity in accidental scenarios based on numerical simulations, a description of the foam damping properties is required for different strain rates and for a wide temperature range with respect to waste heat generation in conjunction with critical operating and environmental conditions. Implementation and adaption of a respective finite element material model strongly relies on an appropriate experimental data base. Even though extensive impact experiments were conducted e.g. in Sandia National Laboratories, Savannah River National Laboratory and by Rolls Royce plc, not all relevant factors were taken into account. Hence, BAM who is in charge of the mechanical evaluation of such packages within the approval procedure in Germany, incorporated systematic test series into a comprehensive research project aimed to develop numerical methods for a couple of damping materials. In a first step, displacement driven compression tests have been performed on confined, cubic specimens at five loading rates ranging from 0.02 mm/s to 3 m/s at temperatures between +90 deg. C and -40 deg. C. Materials include two different polyurethane foam types called FR3718 and FR3730 having densities of 280 kg/m{sup 3} and 488 kg/m{sup 3} from the product line-up of General Plastics Manufacturing Company. Their data was used to adapt an advanced plasticity model allowing for reliably simulating cellular materials under multi-axial compression states. Therefore, an automated parameter identification procedure had been established by combining an artificial neural network with local optimization techniques. Currently, the selected numerical material input values are validated and optimized by means of more complex loading configurations with the prospect of establishing methods applicable to impact limiters under severe accidental conditions. The reference data base is provided by experiments, where weights between 212 kg and 1200 kg have been dropped from heights between 1.25 m and 7 m on confined 10 cm cubic foam specimens. By presenting the deviations between experimental values and the corresponding output of finite element simulations, the potentials and restrictions of the resulting models are highlighted. Systematic compression tests on polyurethane foams had been performed at BAM test site within the framework of a research project on impact limiters for handling casks for radioactive waste. The experimental results had been used to adapt numerical models for simulating the behaviour of different foam types at different temperatures. The loading speed, however, turned out to have a major influence on their flow curves that can not be captured by simple strain-rate dependent multipliers. Especially for guided drop tests that come close to real accidental scenarios there is a significant gap between experimental and numerical results even when applying such advanced material models. Hence, the extensive data base is currently deployed for expanding the standard algorithms to include adequate dynamic hardening factors. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sampling Functions from Gaussian Processes and Structured Covariance Gaussian Networks

When learning aerodynamic models from data, it is critical to incorporate estimates of model uncertainty. This motivates the design of probabilistic aerodynamic databases which can be sampled to generate physically and statistically plausible aerodynamic models. In this talk we discuss how to sample deterministic functions from two different kinds of probabilistic models and demonstrate their use. First, Gaussian Process Regressors (GPRs) are a widely used probabilistic kernel-based model which can be thought of as Gaussian distributions over functions. GPRs are generally trained by maximizing the marginal likelihood of seeing the training data over the kernel parameter space. Sample functions are easily generated by drawing points from the Gaussian distribution at desired input points. However, when the points are not known ahead of time, the classical sampling approach is not possible since successive function samples will generate different function realizations. We present an approach for sampling consistent function evaluations from a GPR over multiple samples. Second, we describe a neural network architecture which learns a conditional Gaussian distribution by maximizing the marginal likelihood at each point in the input space. We then discuss and compare several options for generating sample functions which match this distribution. Finally, we demonstrate the use of these probabilistic aerodynamic models in an atmospheric reentry simulation.

Gaussian process regression↗

Artificial Neural Network Modeling for 2-group Pin-Wise Group Constants

A High-fidelity multi-dimensional analysis is getting more attention because of the accurate prediction of local parameters for core design and safety assessment. For this, there are two possible approaches. One is a direct whole-core transport which is quite promising in terms of accuracy. However, it is very costly in terms of the computing time and memory requirements. Another option is the pin-by-pin core analysis using the diffusion theory. In the pin-by-pin core analysis, the multi-group constants can be produced by using the well-known generalized equivalence theory (GET) and these group constants can be corrected by the super homogenization method (SPH). Moreover, it is clear that both cross sections and discontinuity factors (DFs) must be corrected based on the leakage information in order to obtain an accurate solution for pin-by-pin core analysis. In a recent work by W. Kim and Y. Kim, the albedo-corrected parameterized equivalence constants (APEC) method was proposed, in which fuel assembly two-group XSs are parameterized as a function of an assembly-wise current-to-flux ratio (CFR). In the current work, we have investigated feasibility of APEC-like correction of two-group constants for homogenized pins in PWR cores, which is called APEC for Pin-cell or APECp. Unlike the APEC method, the artificial neural network (ANN) is used for functionalization of pin-wise XSs and DFs in this study. The pin-wise two-group parameters are evaluated using a 2- D method of characteristics (MOC)-based lattice code, DeCART2D.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Construction of generalized quasilinear diffusion coefficient using neural networks with physical restrictions

The quasilinear diffusion coefficient (D QL ) derived from our machine learning framework shows comparable trends with the ground truth D QL obtained from GENRAY-CQL3D simulations. Additionally, for the strong absorption cases, the radial current drive profiles generated using the D QL from our model exhibit consistent behavior with those obtained from the original simulation. These findings indicate the potential of our surrogate modeling approach with physical restrictions to replicate key wave–plasma interaction characteristics while reducing computational costs. Traditionally, calculating D QL for wave–particle interactions relies on computationally intensive wave simulations coupled with Fokker–Planck solvers. To address this challenge, we developed a machine learning-based surrogate model with physical restrictions derived from cold plasma theory and bounce-averaged damping effects. First, we establish the propagation domain of Lower Hybrid Waves in the (N∥, ρ) space by identifying the accessibility limit and determining the upper and lower bounds of N∥ using the Potential Power Deposition (PPD) method. Subsequently, leveraging a database constructed using Latin hypercube sampling alongside the underlying physical restrictions (e.g. PPD), machine learning methods including U-Net and Recurrent Neural Networks are employed to design a physics-restricted machine learning framework capable of reconstructing D QL .

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Efficient Analysis of Complex Structures

Last various accomplishments achieved during this project are : (1) A Survey of Neural Network (NN) applications using MATLAB NN Toolbox on structural engineering especially on equivalent continuum models (Appendix A). (2) Application of NN and GAs to simulate and synthesize substructures: 1-D and 2-D beam problems (Appendix B). (3) Development of an equivalent plate-model analysis method (EPA) for static and vibration analysis of general trapezoidal built-up wing structures composed of skins, spars and ribs. Calculation of all sorts of test cases and comparison with measurements or FEA results. (Appendix C). (4) Basic work on using second order sensitivities on simulating wing modal response, discussion of sensitivity evaluation approaches, and some results (Appendix D). (5) Establishing a general methodology of simulating the modal responses by direct application of NN and by sensitivity techniques, in a design space composed of a number of design points. Comparison is made through examples using these two methods (Appendix E). (6) Establishing a general methodology of efficient analysis of complex wing structures by indirect application of NN: the NN-aided Equivalent Plate Analysis. Training of the Neural Networks for this purpose in several cases of design spaces, which can be applicable for actual design of complex wings (Appendix F).

Kapania, Rakesh K.↗

Machine Learning for Predicting Multipactor Susceptibility in Planar RF Structures

Multipactor discharge is a persistent challenge in high-power microwave (HPM) and accelerator systems, where secondary electron avalanches can cause heating, vacuum degradation, and failure. This work presents the first supervised machine learning (ML) framework for multipactor prediction, trained on high-fidelity 3D Particle-in-Cell (PIC) simulation data in planar geometries. The model maps operational, geometric, and material-dependent secondary electron yield (SEY) parameters to the time-averaged electron growth rate, enabling rapid reconstruction of susceptibility charts. Among the models evaluated, tree-based ensemble methods such as Random Forest and Extra Trees demonstrate superior generalization to unseen materials compared to neural networks such as multilayer perceptron (MLP). Performance metrics, including Intersection over Union (IoU), Structural Similarity Index Measure (SSIM), and Pearson correlation, show close agreement with simulation benchmarks. Principal Component Analysis attributes generalization limits to material feature-space disjointedness.

43 PARTICLE ACCELERATORS↗

Non-parametric Lagrangian biasing from the insights of neural nets

We present a Lagrangian model of galaxy clustering bias in which we train a neural net using the local properties of the smoothed initial density field to predict the late-time mass-weighted halo field.By fitting the mass-weighted halo field in the AbacusSummit simulations at z = 0.5, we find that including three coarsely spaced smoothing scales gives the best recovery of the halo power spectrum. Adding more smoothing scales may lead to 2–5% underestimation of the large-scale power and can cause the neural net to overfit.We find that the fitted halo-to-mass ratio can be well described by two directions in the original high-dimension feature space.Projecting the original features into these two principal components and re-training the neural net either reproduces the original training result, or outperforms it with a better match of the halo power spectrum. The elements of the principal components are unlikely to be assigned physical meanings, partly owing to the features being highly correlated between different smoothing scales.Our work illustrates a potential need to include multiple smoothing scales when studying galaxy bias, and this can be done easily with machine-learning methods that can take in high dimensional input feature space.

79 ASTRONOMY AND ASTROPHYSICS↗