SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

All sources NASA NTRS DOE OSTI

DOE OSTI2023

A Landau-Devonshire Approach of Elastic Strain Effects on Ferroelectric Al1-xScxN

Landau-Devonshire thermodynamic modeling enables the phenomenological description of ferroelectrics. 1 The approach has been validated across a wide range of ferroelectric materials from the first ferroelectric discovered, Rochelle Salt, to recent HfO2-based materials. 2-4 Extension to what is now referred to as the Landau-Ginsburg-Devonshire model enables rigorous investigation of polarization boundaries and reorientation, phase transformations, and domain formation/evolution. We present a thermodynamic analysis of the recently discovered nitride ferroelectric materials 5-7 using the classic Landau-Devonshire approach. The electrostrictive and dielectric stiffness coefficients of Al1-xScxN with wurtzite structure (6mm) are determined using a free energy density function assuming a hexagonal parent phase (6/mmm), with the first order phase transition based on the dielectric stiffness relationships (Fig. 1). The results of this analysis show that the strain sensitivity of the energy barrier is one order of magnitude larger than that of the spontaneous polarization in these wurtzite ferroelectrics, yet both are less sensitive to strain compared to classic perovskite ferroelectrics (Fig. 2). These analysis results reported here explain experimentally reported sensitivity of coercive field to elastic strain/stress in Al1-xScxN films, and would enable further thermodynamic analysis via phase field simulation and related methods.

CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS↗

DOE OSTI2023

Ion-beam radiation-induced Eshelby transformations: The mean and variance in hydrostatic and shear residual stresses

Ion beam plays a pivotal role in ion implantations and the fabrication of nanostructures. However, there lacks a quantitative model to describe the residual stresses associated with the ion-beam radiation. Radiation-induced residual stress/transformation strain have been mostly recognized in the hydrostatic sub strain space. Here, in this study, we use molecular dynamics (MD) simulations to show that the response of a material to irradiation is generally anisotropic that depends on the ion-beam direction, and should be described using tensorial quantities. We demonstrate that accelerator-based ion beam irradiation, combined with the intrinsic lattice anisotropy and externally induced anisotropy (such as anisotropic mechanical loadings), causes radiation-actuated shear transformation strains in addition to hydrostatic expansion. We map out these complex correlations for several materials. Radiation-induced defects are shown to be responsible for residual shear stresses in the manner of Eshelby inclusion transformation. We propose such tensorial response model should be considered for accurate nanoscale fabrication using ion-beam irradiation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Floating solar panels on reservoirs impact phytoplankton populations: A modelling experiment

Floating solar photovoltaic (FPV) deployments are increasing globally as the switch to renewable energy intensifies, representing a considerable water surface transformation. FPV installations can potentially impact aquatic ecosystem function, either positively or negatively. However, these impacts are poorly resolved given the challenges of collecting empirical data for field or modelling experiments. In particular, there is limited evidence on the response of phytoplankton to changes in water body thermal dynamics and light climate with FPV. Given the importance of understanding phytoplankton biomass and species composition for managing ecosystem services, we use an uncertainty estimation approach to simulate the effect of FPV coverage and array siting location on a UK reservoir. FPV coverage was modified in 10% increments from a baseline with 0% coverage to 100% coverage for three different FPV array siting locations based on reservoir circulation patterns. Results showed that FPV coverage significantly impacted thermal properties, resulting in highly variable impacts on phytoplankton biomass and species composition. The impacts on phytoplankton were often dependent on array siting location as well as surface coverage. Changes to phytoplankton species composition were offset by the decrease in phytoplankton biomass associated with increasing FPV coverage. We identified that similar phytoplankton biomass reductions could be achieved with less FPV coverage by deploying the FPV array on the water body's faster-flowing area than the central or slower flowing areas. The difference in response dependent on siting location could be used to tailor phytoplankton management in water bodies. Simulation of water body-FPV interactions efficiently using an uncertainty approach is an essential tool to rapidly develop understanding and ultimately inform FPV developers and water body managers looking to minimise negative impacts and maximise co-benefits.

14 SOLAR ENERGY↗

DOE OSTI2024

Denoising Seismic Waveforms Using a Wavelet-Transform-Based Machine-Learning Method

Seismic waveform data recorded at stations can be thought of as a superposition of the signal from a source of interest and noise from other sources. Frequency‐based filtering methods for waveform denoising do not result in desired outcomes when the targeted signal and noise occupy similar frequency bands. Recently, denoising techniques based on deep‐learning convolutional neural networks (CNNs), in which a recorded waveform is decomposed into signal and noise components, have led to improved results. These CNN methods, which use short‐time Fourier transform representations of the time series, provide signal and noise masks for the input waveform. These masks are used to create denoised signal and designaled noise waveforms, respectively. However, advancements in the field of image denoising have shown the benefits of incorporating discrete wavelet transforms (DWTs) into CNN architectures to create multilevel wavelet CNN (MWCNN) models. The MWCNN model preserves the details of the input due to the good time–frequency localization of the DWT. In this report we use a data set of over 382,000 constructed seismograms recorded by the University of Utah Seismograph Stations network to compare the performance of CNN and MWCNN‐based denoising models. Evaluation of both models on constructed test data shows that the MWCNN model outperforms the CNN model in the ability to recover the ground‐truth signal component in terms of both waveform similarity and preservation of amplitude information. Model evaluation of real‐world data shows that both the CNN and MWCNN models outperform standard band‐pass filtering (BPF; average improvement in signal‐to‐noise ratio of 9.6 and 19.7 dB, respectively, with respect to BPF). Evaluation of continuous data suggests the MWCNN denoiser can improve both signal detection capabilities and phase arrival time estimates.

58 GEOSCIENCES↗

DOE OSTI2023

FAIR AI models in high energy physics

Abstract The findable, accessible, interoperable, and reusable (FAIR) data principles provide a framework for examining, evaluating, and improving how data is shared to facilitate scientific discovery. Generalizing these principles to research software and other digital products is an active area of research. Machine learning models—algorithms that have been trained on data without being explicitly programmed—and more generally, artificial intelligence (AI) models, are an important target for this because of the ever-increasing pace with which AI is transforming scientific domains, such as experimental high energy physics (HEP). In this paper, we propose a practical definition of FAIR principles for AI models in HEP and describe a template for the application of these principles. We demonstrate the template’s use with an example AI model applied to HEP, in which a graph neural network is used to identify Higgs bosons decaying to two bottom quarks. We report on the robustness of this FAIR AI model, its portability across hardware architectures and software frameworks, and its interpretability.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

All Optical Neural Networks for Low Power Edge Computing

We developed a simplistic physics-based model of an all-optical neural network that mimics the encoder part of an autoencoder neural network for image compression. Our approach relies on the generation of a MATLAB-based model for both data compression and decompression and utilizes MATLAB's built-in autoencoder networks in combination with simple propagation of optical fields between layers constituting phase elements via Fourier transform. We optimize the phase elements using the particle swarm optimization technique and using our model, we demonstrate a compression ratio of 25% for 2828-pixel input images containing numeric digits from 0 to 9.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗

DOE OSTI2022

Finite Element Modeling of Diffusion in Fractured Porous Media by Using Hierarchical Material Properties

Abstract Fractured porous media challenge modeling approaches due to high computational costs and excessive mesh refinement imposed by the extreme scale variability of fractures and the heterogeneity of the surrounding porous rock. To overcome such difficulties, we utilize the hierarchical finite element method ( Hi ‐FEM) that has been developed previously to simulate the electrical potential distribution in complex geologic environments. The method employs the hierarchical basis functions in classical finite element analysis to enable representation of material properties on each dimensional component of a given 3D unstructured finite element, thereby inherently allowing for interactions at the boundary between fracture and a host rock. In this study, we extend its application to transient fluid flow and heat conduction in the Laplace domain. Time‐domain flow solutions are obtained by numerical inverse Laplace transform. We evaluate the accuracy of the method using different flow models and demonstrate its robustness for large‐scale, rock mass models featuring complex fracture networks. Moreover, for the computation of nodal Darcian velocity fields in fractured porous media where the fractures are represented as 2D features, a new approach that employs the Yeh's Galerkin model for both volume and facet elements is proposed. Results show that Hi ‐FEM can produce accurate flow solutions for fractured porous media without any need of coupling or transfer mechanism while still being computationally economical and numerically robust, even for large‐scale simulations.

Beskardes, G. D.↗

DOE OSTI2021

Organic sulfur fluxes and geomorphic control of sulfur isotope ratios in rivers

Pyrite oxidation plays a critical role in the relationship between weathering and climate, and its impact on the global carbon cycle has previously been constrained through inversion models utilizing observations of river sulfate ($SO^{2–}_{4}$) and its 34 S/ 32 S isotope ratio (δ 34 S SO4 ). However, measurements from some rivers have suggested that SSO4 can be substantially impacted by processes such as microbial sulfate reduction and/or sulfur assimilation and cycling, rather than simply reflecting a weighted mixture of lithologic sulfur sources. To study the prevalence and controls on $SO^{2–}_{4}$ transformations, in this study we measured dissolved major element concentrations and δ 34 S SO4 in river water samples from throughout western Iceland. Our analyses focused on samples from a small catchment hosting the Efri Haukadalsá river, a system with relatively uniform and isotopically constrained basaltic bedrock. We also measured sediment δ 34 S and sulfur speciation using sulfur K-edge X-ray absorption spectroscopy on sediment and vegetation samples from this catchment. Values of dissolved δ 34 S SO4 in the Efri Haukadalsá ranged from 2.5‰ to 23.7‰ and had a linear relationship with Cl – /$SO^{2–}_{4}$ ratios, indicating that $SO^{2–}_{4}$ predominantly derived from basalt weathering and meteoric precipitation. The lower δ 34 S SO4 values were found in fluvial valleys with V-shaped cross sections, while higher values of δ 34 S SO4 occurred in U-shaped, glacially eroded valleys with thick alluvial fills blanketing the valley floor. Spectroscopic observations identified organic sulfur phases in suspended river sediment, floodplain deposits, and vegetation. Mass balance calculations quantified the organic sulfur flux as less than 10% of $SO^{2–}_{4}$ export, and sediment δ 34 S values were comparable to river δ 34 S SO4 . We interpreted these isotopic and chemical patterns as reflecting differences in the availability of unweathered bedrock across the Efri Haukadalsá catchment, with V-shaped valleys having greater access to fresh sulfide-bearing minerals than alluviated U-shaped valleys; this interpretation is in contrast to one in which the elevated δ 34 S SO4 values reflect fractionation during sulfur transformations along alluvial reaches. These results validated the application of river inversion models for constraining weathering fluxes and affirmed that pyrite oxidation globally, even in the presence of river sulfur cycling, modulates the abundance of atmospheric carbon dioxide.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Carbon-efficient conversion of natural gas and natural-gas condensates to chemical products and intermediate feedstocks via catalytic metal–organic framework (MOF) chemistry

The net-zero carbon emission scenario of stopping hydrocarbon use as fuel is unlikely to end the extraction of fossil hydrocarbons. Remaining will be a sizable need for hydrocarbons as feedstocks for commodity chemicals destined for transformation into polymers, manufacturing-relevant intermediates, and value-added chemicals. Historically, the primary feedstock source has been oil. Over the past dozen years, however, fracking-based extraction of shale-trapped natural gas from known enormous reserves, in North America, has resulted in feedstock sourcing instead from wet shale gas. This shift has transformed the catalytic chemistry of commodity chemical manufacturing. In this paper, following a brief discussion of the merits and limitations of crystallographically well-defined metal–organic frameworks (MOFs) as model catalysts and catalyst-supports, we examined their applications for understanding and potentially enabling carbon-economical, catalytic transformation of C 1 , C 2 , C 3 , and C 4 components of natural gas to desirable commodity chemicals, intermediates, or model compounds.

03 NATURAL GAS↗

DOE OSTI2026

Spatially resolved phase transformation mapping in 410 stainless steel during additive manufacturing visualized via real-time infrared data

Here, in this study, we demonstrate that spatially resolved cooling curves derived from real-time infrared (IR) thermography during additive manufacturing (AM) can capture spatial variations in phase transformation temperatures through cooling curve analysis (CCA). Using this approach, we show that during laser hot-wire deposition of 410 stainless steel (410SS), the martensite start temperature (M s ) evolves dynamically throughout the build. The M s temperature is spatially nonuniform, ranging from 185 °C to 348 °C, with the lowest values toward the build center and higher values toward the upper region of the deposit. In the lower portion of the build, no M s inflection is detected via CCA, consistent with transformation occurring earlier during thermal cycling followed by tempering during subsequent thermal cycles. These trends in M s are corroborated by characterizing the microstructure by electron backscatter diffraction (EBSD). Traditionally, M s is assumed to be constant, and a single interpass temperature is applied during both deposition and residual stress modeling. Our results demonstrate that IR-derived cooling curves provide a route to spatially and temporally resolved transformation temperature tracking for dynamic interpass control and improved residual-stress modeling.

Additive manufacturing↗

DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

A structured framework for predicting sustainable aviation fuel properties using liquid-phase FTIR and machine learning

Sustainable aviation fuels have the potential to improve efficiency, reduce emissions, and enhance energy security. To help identify viable sustainable aviation fuels and accelerate research, machine learning models have been developed to predict relevant physicochemical properties. However, many models have limited applicability, leverage data from complex analytical techniques with confined spectral ranges, or use feature decomposition methods that offer limited interpretability. Using liquid-phase Fourier Transform Infrared (FTIR) spectra, this study presents a structured method for creating accurate and interpretable property prediction models for neat molecules, aviation fuels, and blends. Liquid FTIR spectra can be collected quickly and consistently, offering high reliability, sensitivity, and component specificity using less than 2 ml of sample. The method first decomposes FTIR spectra into fundamental building blocks using non-negative matrix factorization (NMF) to enable scientific analysis of FTIR spectra attributes and fuel properties. The NMF features are then used to create five ensemble models for predicting final boiling point, flash point, freezing point, density at 15°C, and kinematic viscosity at -20°C. All models were trained using experimental property data from neat molecules, aviation fuels, and blends. The models accurately predict key properties across a broad range of neat molecules and representative fuels and blends, while enabling interpretation of relationships between compositional elements, such as functional groups or chemical classes, and their resulting properties. This demonstrates strong potential to support sustainable aviation fuel research and development. The models and data are available on an interactive web tool.

Fourier transform infrared spectroscopy↗

DOE OSTI2023

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗

DOE OSTI2021

Model of ramp compression of diamond from ab initio simulations

Ramp compression experiments characterize high-pressure states of matter at temperatures well below those present in shock compression. However, because temperature is typically not directly measured during ramp compression, it is uncertain how much heating occurs under these shock-free conditions. Here, we performed a series of ab initio simulations on carbon in order to match the density-stress measurements of Smith et al. [Smith et al., Nature (London) 511, 330 (2014)]. We considered isotropically as well as uniaxially compressed solid carbon in the diamond and BC8 phases, with and without defects, as well as liquid carbon. Our idealized model ascribes heating during ramp compression to an initially uniaxially compressed cell transforming isochorically into an isotropically (hydrostatic equivalent) compressed state having lower internal energy, hence higher temperature so as to conserve energy. Multiple such heating events can occur during a single ramp experiment, leading to higher temperatures than with isentropic compression. Comparison with experiments shows that heating alone does not explain the equation of state measurements on diamond, instead implying that a significant uniaxial stress component remains present at high compression. The temperature predictions of our ramp compression model remain to be verified with future laboratory measurements.

58 GEOSCIENCES↗

DOE OSTI2024

Resolving crystallographic geometrically necessary dislocations in three dimensions in a hexagonal close packed titanium alloy

Abstract Geometrically necessary dislocation (GND) content is measured from mm 3 -scaled Ti7Al three-dimensional (3D) microstructural data using a theory extended for hexagonal close packed crystals, which accounts for basal, prismatic and pyramidal ⟨ c + a ⟩ type dislocation content. The Ti7Al samples have been mechanically pre-strained to two different strain levels, and will then be strained along the same axis in uniaxial tension during simulation. Both inter- and intragranular GNDs across the microstructures have been characterized, with a large contribution of pyramidal ⟨ c + a ⟩ GNDs, consistent with the relative slip activity involved in pre-straining. The spatially resolved crystallographic GND distributions within the 3D microstructures are used to instantiate a microstructure model for forward modeling deformation simulations by a dislocation density hardening elasto-viscoplastic fast Fourier transform framework. Coarsening the voxel resolution during the initial microstructure construction procedure is shown to strongly impact both the magnitude and spatial distribution of the GNDs and in turn the forward deformation response of the pre-strained material. This study indicates that the voxel resolution desired when transferring from measured to model microstructures need not only be proportionally scaled with the microstructure but also sufficiently fine to capture the subgranular orientation gradients that may already be present in the material.

Materials Science↗

DOE OSTI2023

A Machine Learning Model for Predicting Composition of Catalytic Coprocessing Products from Molecular Beam Mass Spectra

Demand for the development of an automated and integrated refining process for biofuels has increased in recent years due to the lack of generalized process inspection tools. In bio-oil upgrading processes, all process variables are maintained based on the offline specification of intermediates and products. A lack of real-time product specifications in batch-wise monitoring can cause process failure and wasted resources. Therefore, there is a need for a fast and accurate intermediates/product specification tool that can be used for real-time specification to reduce waste and mitigate the risk of process failure. Here, to address this gap, we developed a machine learning (ML) model for predicting speciated bio-oil composition, including paraffin, iso-paraffins, olefins, naphthene, and aromatics. The model is trained using the mass spectra from upgraded products collected in the vapor phase before condensation and predicts the composition of the condensed product. Training ML models using raw mass spectra is challenging due to numerous overlapped peaks originating from different parent compounds. With this in mind, we propose a protocol that (i) transforms raw mass spectra to chemistry-inspired predefined features and (ii) trains decision tree-based models using these features. Our results show that the random forest model was robust against overfitting and had the highest accuracy compared to other models. Moreover, a stochastic ablation method determined the eight most significant features while maximizing the accuracy. Our protocol facilitates real-time compositional analysis of upgraded bio-oils and thus real-time process monitoring. Additionally, this protocol enables the rational design of efficient catalysts and the determination of optimal process conditions.

09 BIOMASS FUELS↗

DOE OSTI2021

A Modular System for Increasing Predictiveness for Extreme Climate Predictions

We know that climate change is poised to reshape our world, but we lack clear enough predictions about precisely how. The preponderance of these changes is associated with human activity, specifically the emission of CO 2 and other greenhouse gases. Problematically, projections of climate change continue to be marred by unacceptably large uncertainties which hamper informed decision-making and cost society a chance to adapt proactively and effectively. These uncertainties stem from deficiencies in predictions of future greenhouse gas emissions, but also from inaccuracies in the representation of the physical models used to predict the climate response to such emissions. The uncertainties in projections associated with the inaccurate representation of climate physics, chemistry and biology are similar to those that plagued the first global climate models developed fifty years ago, despite more than a factor 10 8 increase in computer performance. Our transformational question is then, how can the accuracy of climate projections be dramatically improved by applying recent advances in the computational and data sciences to train the models with the wealth of data being constantly collected about the ongoing changes in the climate system?

54 ENVIRONMENTAL SCIENCES↗