Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Convolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Neural network for 3D inertial confinement fusion shell reconstruction from single radiographs

In inertial confinement fusion (ICF), x-ray radiography is a critical diagnostic for measuring implosion dynamics, which contain rich three-dimensional (3D) information. Traditional methods for reconstructing 3D volumes from 2D radiographs, such as filtered backprojection, require radiographs from at least two different angles or lines of sight (LOS). In ICF experiments, the space for diagnostics is limited, and cameras that can operate on fast timescales are expensive to implement, limiting the number of projections that can be acquired. To improve the imaging quality as a result of this limitation, convolutional neural networks (CNNs) have recently been shown to be capable of producing 3D models from visible light images or medical x-ray images rendered by volumetric computed tomography. Here, we propose a CNN to reconstruct 3D ICF spherical shells from single radiographs. We also examine the sensitivity of the 3D reconstruction to different illumination models using preprocessing techniques such as pseudo-flatfielding. To resolve the issue of the lack of 3D supervision, we show that training the CNN utilizing synthetic radiographs produced by known simulation methods allows for reconstruction of experimental data as long as the experimental data are similar to the synthetic data. We also show that the CNN allows for 3D reconstruction of shells that possess low mode asymmetries. Further comparisons of the 3D reconstructions with direct multiple LOS measurements are justified.

3D Reconstruction↗
DOE OSTI2021

Geometry and dynamics of passive scalar structures in compressible turbulent mixing

We present a structure-based numerical analysis of passive scalar mixing in decaying homogeneous isotropic turbulence (DHIT) and shock-turbulence interaction canonical configurations. The analysis focuses on the temporal evolution of ensembles of passive scalar structures, initialized as spheres of different sizes relative to the Taylor microscale. An algorithm is introduced to track the evolution of each individual structure and the interactions with other structures in the ensemble, relating changes in the surface geometry and the underlying physical processes (turbulent transport, scalar dissipation, and shock compression). The tracking algorithm is applied to datasets from shock-capturing direct numerical simulations of DHIT, with Taylor microscale Reynolds number Re λ =40 and turbulence Mach number M t =0.2 ⁠, and STI cases in which the turbulence is processed by a shock wave at Mach numbers M = 1.5 and 3.0. Temporal surface convolution increases for initially larger structures, resulting in a higher probability of locally hyperbolic geometries where breakup into smaller structures occurs. Shock-induced deformation of the structures amplifies breakup processes, enhancing mixing, particularly for larger structures. Mixing enhancement by the shock is manifested as an amplification of the surface-averaged scalar gradient, which increases for initially larger structures. The alignment between the scalar gradient and the most extensional strain-rate eigendirection on the scalar isosurfaces also increases across the shock. Larger magnitudes of the scalar gradient and its alignment with the most compressive strain-rate eigendirection correlate with flatter surface regions. Shock-induced structure compression increases the area coverage of flat regions, where the amplification of scalar gradient is localized.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Deep learning-based quasi-continuum theory for structure of confined fluids

Predicting the structural properties of water and simple fluids confined in nanometer scale pores and channels is essential in, for example, energy storage and biomolecular systems. Classical continuum theories fail to accurately capture the interfacial structure of fluids. In this work, we develop a deep learning-based quasi-continuum theory (DL-QT) to predict the concentration and potential profiles of a Lennard-Jones (LJ) fluid and water confined in a nanochannel. The deep learning model is built based on a convolutional encoder–decoder network (CED) and is applied for high-dimensional surrogate modeling to relate the fluid properties to the fluid–fluid potential. The CED model is then combined with the interatomic potential-based continuum theory to determine the concentration profiles of a confined LJ fluid and confined water. Further, we show that the DL-QT model exhibits robust predictive performance for a confined LJ fluid under various thermodynamic states and for water confined in a nanochannel of different widths. The DL-QT model seamlessly connects molecular physics at the nanoscale with continuum theory by using a deep learning model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Machine learning for detection of 3D features using sparse x-ray tomographic reconstruction

In many inertial confinement fusion (ICF) experiments, the neutron yield and other parameters cannot be completely accounted for with one and two dimensional models. This discrepancy suggests that there are three dimensional effects that may be significant. Sources of these effects include defects in the shells and defects in shell interfaces, the fill tube of the capsule, and the joint feature in double shell targets. Due to their ability to penetrate materials, x rays are used to capture the internal structure of objects. Methods such as computational tomography use x-ray radiographs from hundreds of projections, in order to reconstruct a three dimensional model of the object. In experimental environments, such as the National Ignition Facility and Omega-60, the availability of these views is scarce, and in many cases only consists of a single line of sight. Mathematical reconstruction of a 3D object from sparse views is an ill-posed inverse problem. These types of problems are typically solved by utilizing prior information. Neural networks have been used for the task of 3D reconstruction as they are capable of encoding and leveraging this prior information. We utilize half a dozen, different convolutional neural networks to produce different 3D representations of ICF implosions from the experimental data. Deep supervision is utilized to train a neural network to produce high-resolution reconstructions. These representations are used to track 3D features of the capsules, such as the ablator, inner shell, and the joint between shell hemispheres. Machine learning, supplemented by different priors, is a promising method for 3D reconstructions in ICF and x-ray radiography, in general.

Wolfe, Bradley T. (ORCID:0000000268301614)↗
DOE OSTI2022

2nd and 3rd order spectral energy corrections with penumbral de-blurring methodology for opacity platform used on the National Ignition Facility

The Opacity Spectrometer (OpSpec) used in the National Ignition Facility’s opacity experiments measures x-ray spectra from 0.9 to 2.1 keV from the different experimental regions: the backlight source, emission source, and the absorption region with the transmission calculated from these regions. The OpSpec designs have gone through several iterations to help improve the signal-to-noise ratio, remove alternate crystal plane reflections, and improve spectral resolution, which helps to increase the validity of the opacity measurements. However, the source spans well outside the current working spectral range, and higher-order reflections are intrinsic to the crystal, which increases the overall signal seen in the data regions. The recorded data are the convolution of 1st order transmission, higher-order reflections, and the penumbra blurring. In conclusion, this work represents the details for deconvolving the 2nd and 3rd order spectral energy corrections with a penumbral de-blurring to correct the relative measurement of x-ray intensity of different spectral energies and further analysis of datasets relevant to the opacity experiments.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Non-Kasha fluorescence of pyrene emerges from a dynamic equilibrium between excited states

Pyrene fluorescence after a high-energy electronic excitation exhibits a prominent band shoulder not present after excitation at low energies. The standard assignment of this shoulder as a non-Kasha emission from the second-excited state (S 2 ) has been recently questioned. To elucidate this issue, we simulated the fluorescence of pyrene using two different theoretical approaches based on vertical convolution and nonadiabatic dynamics with nuclear ensembles. To conduct the necessary nonadiabatic dynamics simulations with high-lying electronic states and deal with fluorescence timescales of about 100 ns of this large molecule, we developed new computational protocols. The results from both approaches confirm that the band shoulder is, in fact, due to S 2 emission. We show that the non-Kasha behavior is a dynamic-equilibrium effect not caused by a metastable S 2 minimum. However, it requires considerable vibrational energy, which can only be achieved in collisionless regimes after transitions into highly excited states. This strict condition explains why the S 2 emission was not observed in some experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Physics-constrained deep learning of nonlinear normal modes of spatiotemporal fluid flow dynamics

In this study, we present a physics-constrained deep learning method to discover and visualize from data the invariant nonlinear normal modes (NNMs) which contain the spatiotemporal dynamics of the fluid flow potentially containing strong nonlinearity. Specifically, we develop a NNM-physics-constrained convolutional autoencoder (NNM-CNN-AE) integrated with a multi-temporal-step dynamics prediction block to learn the nonlinear modal transformation, the NNMs containing the spatiotemporal dynamics of the flow, and reduced-order reconstruction and long-time future-state prediction of the flow fields, simultaneously. In test cases, we apply the developed method to analyze different flow regimes past a cylinder, including laminar flows with low Reynolds number in transient and steady states (RD = 100) and high Reynolds number flow (RD = 1000), respectively. The results indicate that the identified NNMs are able to reveal the nonlinear spatiotemporal dynamics of these flows, and the NNMs-based reduced-order modeling consistently achieves better accuracy with orders of magnitudes smaller errors in construction and prediction of the nonlinear velocity and vorticity fields, compared to the linear proper orthogonal decomposition (POD) method and the Koopman-constrained-CNN-AE using the same number or dimension of modes. We perform an analysis of the modal energy distribution of NNMs and find that compared to POD modes, the few fundamental NNMs capture a very high level of total energy of the flow, which is advantageous for reduced-order modeling and representation of the complex flows. Finally, we discuss the potentials and limitations of the presented method.

Mechanics↗
DOE OSTI2023

Polyimide dynamically compressed to decomposition pressures: Two-wave structures captured by velocimetry and modeling

We performed a series of six plate impact experiments on polyimide and modeled them using new reactant and products equations of state combined with an Arrhenius rate model. The first experiment was diagnosed with embedded electromagnetic velocity gauges through which we directly observed attenuation of the lead shock to an approximately constant state over a propagation distance of roughly 4 mm. Simulated gauge profiles were in excellent qualitative agreement with experiment and suggested a sluggish chemical reaction that did not proceed to completion. The remaining five experiments were conducted in a transmission geometry and diagnosed velocimetrically at the sample/window interface. All five of these yielded profiles with a sharp shock followed by a more gradual approach to maximum interface velocity that was “rounded” to varying degree. These profiles proved difficult to interpret unambiguously due to the convolution of the reactive wave upon first shock with reflection of the lead wave and reshock or release by the window. Comparison with thermochemical calculations strongly suggests that the point of maximum interface velocity corresponds to the equilibrium reshock or release locus. We discuss the implications of this point for the practice of impedance matching based on the reflected Hugoniot of reactive materials such as polymers. The reactant and thermochemical products equations of state are developmental SESAME tables 97710 and 97720, respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Disentangling the confounding spectroscopy of C 1 molecules: Without symmetry as a guide, everything is allowed

The spectra of C 1 molecules are confounding in that each of the fundamental vibrational modes transform as the same irreducible representation (A) and hence each band consists of a seemingly random distribution of a-, b-, and c-type transitions. This is in contrast to higher symmetry molecules for which band types are readily deduced by simple symmetry rules. Herein, we present a method to simulate the convoluted rotational contours in the gas-phase spectra of C 1 molecules by combining existing ab initio calculations with Colin Western’s PGOPHER rotational contour program. Specifically, ab initio calculations in the NWC HEM suite of programs were employed to predict the components of the dipole moment derivatives along the principal axes of the moments of inertia. This information was then input into PGOPHER to model the fundamental band contours as a sum of a-, b-, and c-type transitions. This method was applied to simulate the rotational contour spectra of a series of representative C 1 molecules which were then compared against both ab initio stick spectra and experimentally measured broadband IR spectra from the Pacific Northwest National Laboratory infrared gas-phase database. In addition to providing further insight beyond what is revealed in a typical stick spectrum, the simulated contours showed good agreement with the measured spectra.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Analysis and mitigation of an oscillating background on hybrid complementary metal-oxide semiconductor (hCMOS) imaging sensors at the National Ignition Facility

Nanosecond-gated hybrid complementary metal-oxide semiconductor imaging sensors are a powerful tool for temporally gated and spatially resolved measurements in high energy density science, including inertial confinement fusion, and in laser diagnostics. However, a significant oscillating background excited by photocurrent has been observed in image sequences during testing and in experiments at the National Ignition Facility (NIF). Characterization measurements and simulation results are used to explain the oscillations as the convolution of the pixel-level sensor response with a sensor-wide RLC circuit ringing. Finally, data correction techniques are discussed for NIF diagnostics, and for diagnostics where these techniques cannot be used, a proof-of-principle image correction algorithm is presented.

42 ENGINEERING↗
DOE OSTI2024

Accelerating defect predictions in semiconductors using graph neural networks

First-principles computations reliably predict the energetics of point defects in semiconductors but are constrained by the expense of using large supercells and advanced levels of theory. Machine learning models trained on computational data, especially ones that sufficiently encode defect coordination environments, can be used to accelerate defect predictions. Here, we develop a framework for the prediction and screening of native defects and functional impurities in a chemical space of group IV, III–V, and II–VI zinc blende semiconductors, powered by crystal Graph-based Neural Networks (GNNs) trained on high-throughput density functional theory (DFT) data. Using an innovative approach of sampling partially optimized defect configurations from DFT calculations, we generate one of the largest computational defect datasets to date, containing many types of vacancies, self-interstitials, anti-site substitutions, impurity interstitials and substitutions, as well as some defect complexes. We applied three types of established GNN techniques, namely crystal graph convolutional neural network, materials graph network, and Atomistic Line Graph Neural Network (ALIGNN), to rigorously train models for predicting defect formation energy (DFE) in multiple charge states and chemical potential conditions. We find that ALIGNN yields the best DFE predictions with root mean square errors around 0.3 eV, which represents a prediction accuracy of 98% given the range of values within the dataset, improving significantly on the state-of-the-art. We further show that GNN-based defective structure optimization can take us close to DFT-optimized geometries at a fraction of the cost of full DFT. The current models are based on the semi-local generalized gradient approximation-Perdew–Burke–Ernzerhof (PBE) functional but are highly promising because of the correlation of computed energetics and defect levels with higher levels of theory and experimental data, the accuracy and necessity of discovering novel metastable and low energy defect structures at the PBE level of theory before advanced methods could be applied, and the ability to train multi-fidelity models in the future with new data from non-local functionals. The DFT-GNN models enable prediction and screening across thousands of hypothetical defects based on both unoptimized and partially optimized defective structures, helping identify electronically active defects in technologically important semiconductors.

Rahman, Md Habibur (ORCID:000000027705984X)↗
DOE OSTI2024

Efficient formulation of multitime generalized quantum master equations: Taming the cost of simulating 2D spectra

Modern 4-wave mixing spectroscopies are expensive to obtain experimentally and computationally. In certain cases, the unfavorable scaling of quantum dynamics problems can be improved using a generalized quantum master equation (GQME) approach. However, the inclusion of multiple (light–matter) interactions complicates the equation of motion and leads to seemingly unavoidable cubic scaling in time. In this paper, we present a formulation that greatly simplifies and reduces the computational cost of previous work that extended the GQME framework to treat arbitrary numbers of quantum measurements. Specifically, we remove the time derivatives of quantum correlation functions from the modified Mori–Nakajima–Zwanzig framework by switching to a discrete-convolution implementation inspired by the transfer tensor approach. We then demonstrate the method’s capabilities by simulating 2D electronic spectra for the excitation-energy-transfer dimer model. In our method, the resolution of data can be arbitrarily coarsened, especially along the t2 axis, which mirrors how the data are obtained experimentally. Even in a modest case, this demands O(103) fewer data points. We are further able to decompose the spectra into one-, two-, and three-time correlations, showing how and when the system enters a Markovian regime where further measurements are unnecessary to predict future spectra and the scaling becomes quadratic. This offers the ability to generate long-time spectra using only short-time data, enabling access to timescales previously beyond the reach of standard methodologies.

Chemistry↗
DOE OSTI2024

Deep learning-enabled probing of irradiation-induced defects in time-series micrographs

Modeling time-series data with convolutional neural networks (CNNs) requires building a model to learn in batches as opposed to training sequentially. Coupling CNNs with in situ or operando techniques opens the possibility of accurately segmenting dynamic reactions and mass transport phenomena to understand how materials behave under the conditions in which they are used. In this article, in situ ion irradiation transmission electron microscopy (TEM) images are used as inputs into the CNN to assess the defect generation rate, defect cluster density, and saturation of defects. We then use the output segmentation maps to correlate with conventional TEM micrographs to assess the model’s ability to detail nanoscale interactions. Next, we discuss the implications of preprocessing and hyperparameters on model variability, accuracy when expanded to other datasets, and the role of regularization when controlling model variance. Ultimately, we eliminate human bias when extrapolating physical metrics, speed up analysis time, decouple reactions that happen at 100 ms intervals, and deploy models that are both accurate and transferable to similar experiments.

Burns, Kory (ORCID:0000000158019909)↗
DOE OSTI2024

Low latency optical-based mode tracking with machine learning deployed on FPGAs on a tokamak

Active feedback control in magnetic confinement fusion devices is desirable to mitigate plasma instabilities and enable robust operation. Optical high-speed cameras provide a powerful, non-invasive diagnostic and can be suitable for these applications. Here, in this study, we process high-speed camera data, at rates exceeding 100 kfps, on in situ field-programmable gate array (FPGA) hardware to track magnetohydrodynamic (MHD) mode evolution and generate control signals in real time. Our system utilizes a convolutional neural network (CNN) model, which predicts the n = 1 MHD mode amplitude and phase using camera images with better accuracy than other tested non-deep-learning-based methods. By implementing this model directly within the standard FPGA readout hardware of the high-speed camera diagnostic, our mode tracking system achieves a total trigger-to-output latency of 17.6 μs and a throughput of up to 120 kfps. This study at the High Beta Tokamak-Extended Pulse (HBT-EP) experiment demonstrates an FPGA-based high-speed camera data acquisition and processing system, enabling application in real-time machine-learning-based tokamak diagnostic and control as well as potential applications in other scientific domains.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Simulation-trained machine learning models for Lorentz transmission electron microscopy

Understanding the collective behavior of complex spin textures, such as lattices of magnetic skyrmions, is of fundamental importance for exploring and controlling the emergent ordering of these spin textures and inducing phase transitions. It is also critical to understand the skyrmion–skyrmion interactions for applications such as magnetic skyrmion-enabled reservoir or neuromorphic computing. Magnetic skyrmion lattices can be studied using in situ Lorentz transmission electron microscopy (LTEM), but quantitative and statistically robust analysis of the skyrmion lattices from LTEM images can be difficult. In this work, we show that a convolutional neural network, trained on simulated data, can be applied to perform segmentation of spin textures and to extract quantitative data, such as spin texture size and location, from experimental LTEM images, which cannot be obtained manually. This includes quantitative information about skyrmion size, position, and shape, which can, in turn, be used to calculate skyrmion–skyrmion interactions and lattice ordering. We apply this approach to segmenting images of Néel skyrmion lattices so that we can accurately identify skyrmion size and deformation in both dense and sparse lattices. The model is trained using a large set of micromagnetic simulations as well as simulated LTEM images. This entirely open-source training pipeline can be applied to a wide variety of magnetic features and materials, enabling large-scale statistical studies of spin textures using LTEM.

McCray, Arthur R. C. (ORCID:0000000160774698)↗
DOE OSTI2024

Effective optimization of atomic decoration in giant and superstructurally ordered crystals with machine learning

Crystals with complicated geometry are often observed with mixed chemical occupancy among Wyckoff sites, presenting a unique challenge for accurate atomic modeling. Similar systems possessing exact occupancy on all the sites can exhibit superstructural ordering, dramatically inflating the unit cell size. In this work, a crystal graph convolutional neural network (CGCNN) is used to predict optimal atomic decorations on fixed crystalline geometries. This is achieved with a site permutation search (SPS) optimization algorithm based on Monte Carlo moves combined with simulated annealing and basin-hopping techniques. Our approach relies on the evidence that, for a given chemical composition, a CGCNN estimates the correct energetic ordering of different atomic decorations, as predicted by electronic structure calculations. This provides a suitable energy landscape that can be optimized according to site occupation, allowing the prediction of chemical decoration in crystals exhibiting mixed or disordered occupancy, or superstructural ordering. Verification of the procedure is carried out on several known compounds, including the superstructurally ordered clathrate compound Rb8Ga27Sb16 and vacancy-ordered perovskite Cs2SnI6, neither of which was previously seen during the neural network training. In addition, the critical temperature of an order–disorder phase transition in solid solution CuZn is probed with our SPS routines by sampling site configuration trajectories in the canonical ensemble. This strategy provides an accurate method for determining favorable decoration in complex crystals and analyzing site occupation at unprecedented speed and scale.

Chemistry↗
DOE OSTI2024

Toward ultra-efficient high-fidelity predictions of wind turbine wakes: Augmenting the accuracy of engineering models with machine learning

This study proposes a novel machine learning (ML) methodology for the efficient and cost-effective prediction of high-fidelity three-dimensional velocity fields in the wake of utility-scale turbines. The model consists of an autoencoder convolutional neural network with U-Net skipped connections, fine-tuned using high-fidelity data from large-eddy simulations (LES). The trained model takes the low-fidelity velocity field cost-effectively generated from the analytical engineering wake model as input and produces the high-fidelity velocity fields. The accuracy of the proposed ML model is demonstrated in a utility-scale wind farm for which datasets of wake flow fields were previously generated using LES under various wind speeds, wind directions, and yaw angles. Comparing the ML model results with those of LES, the ML model was shown to reduce the error in the prediction from 20% obtained from the Gauss Curl hybrid (GCH) model to less than 5%. In addition, the ML model captured the non-symmetric wake deflection observed for opposing yaw angles for wake steering cases, demonstrating a greater accuracy than the GCH model. The computational cost of the ML model is on par with that of the analytical wake model while generating numerical outcomes nearly as accurate as those of the high-fidelity LES.

Mechanics↗