Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Machine-learned interatomic potentials by active learning: amorphous and liquid hafnium dioxide

We propose an active learning scheme for automatically sampling a minimum number of uncorrelated configurations for fitting the Gaussian Approximation Potential (GAP). Our active learning scheme consists of an unsupervised machine learning (ML) scheme coupled with a Bayesian optimization technique that evaluates the GAP model. We apply this scheme to a Hafnium dioxide (HfO 2 ) dataset generated from a "melt-quench" ab initio molecular dynamics (AIMD) protocol. Our results show that the active learning scheme, with no prior knowledge of the dataset, is able to extract a configuration that reaches the required energy fit tolerance. Further, molecular dynamics (MD) simulations performed using this active learned GAP model on 6144 atom systems of amorphous and liquid state elucidate the structural properties of HfO 2 with near ab initio precision and quench rates (i.e., 1.0 K/ps) not accessible via AIMD. The melt and amorphous X-ray structural factors generated from our simulation are in good agreement with experiment. In addition, the calculated diffusion constants are in good agreement with previous ab initio studies.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Bayesian blacksmithing: discovering thermomechanical properties and deformation mechanisms in high-entropy refractory alloys

Finding alloys with specific design properties is challenging due to the large number of possible compositions and the complex interactions between elements. This study introduces a multi-objective Bayesian optimization approach guiding molecular dynamics simulations for discovering high-performance refractory alloys with both targeted intrinsic static thermomechanical properties and also deformation mechanisms occurring during dynamic loading. The objective functions are aiming for excellent thermomechanical stability via a high bulk modulus, a low thermal expansion, a high heat capacity, and for a resilient deformation mechanism maximizing the retention of the BCC phase after shock loading. Contrasting two optimization procedures, we show that the Pareto-optimal solutions are confined to a small performance space when the property objectives display a cooperative relationship. Conversely, the Pareto front is much broader in the performance space when these properties have antagonistic relationships. Density functional theory simulations validate these findings and unveil underlying atomic-bond changes driving property improvements.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗
DOE OSTI2020

Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian process-based exploration–exploitation

Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase separated materials to quantum systems. Traditionally, exploration of the phase diagrams corresponding to multidimensional parameter spaces of Hamiltonians was performed using a combination of basic physical principles, analytical approximations, and extensive numerical modeling. However, exploration of complex multidimensional parameter spaces is subject to the classic dimensionality problem, and the behaviors of interest concentrated on low dimensional manifolds remain undiscovered. Here, we demonstrate that a combination of exploration and exploration–exploitation with Gaussian process modeling and Bayesian optimization allows effective exploration of the parameter space for lattice Hamiltonians and effectively maps the regions at which specific macroscopic functionalities or local structures are maximized. We argue that this approach is general and can be further extended well beyond the lattice Hamiltonians to effectively explore the parameter space of more complex off-lattice and dynamic models.

42 ENGINEERING↗
DOE OSTI2021

Structure prediction of epitaxial inorganic interfaces by lattice and surface matching with Ogre

We present a new version of the Ogre open source Python package with the capability to perform structure prediction of epitaxial inorganic interfaces by lattice and surface matching. In the lattice matching step, a scan over combinations of substrate and film Miller indices is performed to identify the domain-matched interfaces with the lowest mismatch. Subsequently, surface matching is conducted by Bayesian optimization to find the optimal interfacial distance and in-plane registry between the substrate and the film. For the objective function, a geometric score function is proposed based on the overlap and empty space between atomic spheres at the interface. The score function reproduces the results of density functional theory (DFT) at a fraction of the computational cost. The optimized interfaces are pre-ranked using a score function based on the similarity of the atomic environment at the interface to the bulk environment. Final ranking of the top candidate structures is performed with DFT. Ogre streamlines DFT calculations of interface energies and electronic properties by automating the construction of interface models. The application of Ogre is demonstrated for two interfaces of interest for quantum computing and spintronics, Al/InAs and Fe/InSb.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

AL4GAP: Active learning workflow for generating DFT-SCAN accurate machine-learning potentials for combinatorial molten salt mixtures

Machine learning interatomic potentials have emerged as a powerful tool for bypassing the spatiotemporal limitations of ab initio simulations, but major challenges remain in their efficient parameterization. We present AL4GAP, an ensemble active learning software workflow for generating multicomposition Gaussian approximation potentials (GAP) for arbitrary molten salt mixtures. The workflow capabilities include: (1) setting up user-defined combinatorial chemical spaces of charge neutral mixtures of arbitrary molten mixtures spanning 11 cations (Li, Na, K, Rb, Cs, Mg, Ca, Sr, Ba and two heavy species, Nd, and Th) and 4 anions (F, Cl, Br, and I), (2) configurational sampling using low-cost empirical parameterizations, (3) active learning for down-selecting configurational samples for single point density functional theory calculations at the level of Strongly Constrained and Appropriately Normed (SCAN) exchange-correlation functional, and (4) Bayesian optimization for hyperparameter tuning of two-body and many-body GAP models. Here, we apply the AL4GAP workflow to showcase high throughput generation of five independent GAP models for multicomposition binary-mixture melts, each of increasing complexity with respect to charge valency and electronic structure, namely: LiCl–KCl, NaCl–CaCl 2 , KCl–NdCl 3 , CaCl 2 –NdCl 3 , and KCl–ThCl 4 . Our results indicate that GAP models can accurately predict structure for diverse molten salt mixture with density functional theory (DFT)-SCAN accuracy, capturing the intermediate range ordering characteristic of the multivalent cationic melts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Simultaneous reproduction of experimental profiles, fluxes, transport coefficients, and turbulence characteristics via nonlinear gyrokinetic profile predictions in a DIII-D ITER similar shape plasma

Experimental conditions obtained on the DIII-D tokamak in the ITER Similar Shape (ISS) have been compared extensively with nonlinear gyrokinetic simulation using the CGYRO code [Candy et al., J. Comput. Phys. 324, 73–93 (2016)] with comparisons spanning ion and electron heat fluxes, electron and impurity particle transport, and turbulent fluctuation levels and characteristics. Bayesian optimization techniques [Rodriguez-Fernandez et al., Nucl. Fusion 62(7), 076036 (2022)], combined with nonlinear gyrokinetics, have been used to obtain simultaneously Qi, Qe, and Γe flux-matched profiles that are found to be in good agreement with experimental profile measurements. Synthetic diagnostics were used to compare measured beam emission spectroscopy and correlation electron cyclotron emission turbulent fluctuations with nonlinear simulation. Although some disagreements exist, nonlinear simulations are found to be in generally good agreement with measured fluctuation levels, spectral shapes, and measured radial trends in low-k δne/ne and δTe/Te. Low (Li and C) and mid-Z (Ca) impurity transport was also compared with these flux-matched simulations. Fully stripped, low-Z impurities are well reproduced by the gyrokinetic modeling while clear disagreement exists in comparisons with mid-Z impurities. Nonlinear gyrokinetic investigation into the Z dependence of impurity transport in the ISS conditions is also performed, demonstrating clear trends of impurity diffusion with impurity Z (both D∝Z and D∝1/Z) that vary with the radial location studied. These trends are shown to result from the local dominance of ion temperature gradient or ∇n driven trapped electron mode turbulence and may contribute to the disagreement between simulation and experiment in mid-Z impurity transport. The results of this work represent one of the most complete validation studies of the gyrokinetic model performed to date and provide an example of new capabilities for predicting performance in future fusion devices.

Physics↗
DOE OSTI2026

Validation of the GFS model for gyrokinetic stability of NSTX pedestal data

This study presents a large database validation of the gyro fluid system (GFS) model for linear gyrokinetic stability for high-mode (H-mode) edge transport barrier conditions in the national spherical torus experiment (NSTX) tokamak. The database of linear stability calculations with the CGYRO gyrokinetic code was produced using plasma profile measurements from NSTX discharges to identify kinetic ballooning modes (KBM), trapped electron modes (TEM), and micro-tearing modes (MTM) that limit the pressure profile gradient in the H-mode barrier. A novel Bayesian optimization approach determines optimal resolution parameters for GFS specifically for spherical tokamak pedestal conditions. Our results demonstrate that GFS, with optimized resolution, can achieve accurate linear stability analysis in NSTX pedestal conditions for reduced resolution compared to CGYRO. GFS can accurately find the KBM, TEM, and MTM instability branches. Parametric analysis reveals that GFS accuracy in this extreme pedestal parameter range is degraded for low magnetic shear and near the separatrix conditions. These findings establish GFS as a fast linear eigenmode solver for spherical tokamak pedestal gyrokinetic stability and demonstrate a systematic methodology for determining the optimum resolution settings.

Yang, Minglei [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2023

Identifying native point defect configurations in α-alumina

Intimately intertwined atomic and electronic structures of point defects govern diffusion-limited corrosion and underpin the operation of optoelectronic devices. For some materials, complex energy landscapes containing metastable defect configurations challenge first-principles modeling efforts. Here, we thoroughly reevaluate native point defect geometries for the illustrative case of α-Al 2 O 3 by comparing three methods for sampling candidate geometries in density functional theory calculations: displacing atoms near a naively placed defect, initializing interstitials at high-symmetry points of a Voronoi decomposition, and Bayesian optimization. We find symmetry-breaking distortions for oxygen vacancies in some charge states, and we identify several distinct oxygen split-interstitial geometries that help explain literature discrepancies involving this defect. We also report a surprising and, to our knowledge, previously unknown trigonal geometry favored by aluminum interstitials in some charge states. Importantly, these new configurations may have transformative impacts on our understanding of defect migration pathways in aluminum-oxide scales protecting metal alloys from corrosion. Overall, the Voronoi scheme appears most effective for sampling candidate interstitial sites because it always succeeded in finding the lowest-energy geometry identified in this study, although no approach found every metastable configuration. Finally, we show that the position of defect levels within the band gap can depend strongly on the defect geometry, underscoring the need to conduct careful searches for ground-state geometries in defect calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Automated experimental design of safe rampdowns via probabilistic machine learning

Abstract Typically the rampdown phase of a shot consists of a decrease in current and injected power and optionally a change in shape, but there is considerable flexibility in the rate, sequencing, and duration of these changes. On the next generation of tokamaks it is essential that this is done safely as the device could be damaged by the stored thermal and electromagnetic energy present in the plasma. This works presents a procedure for automatically choosing experimental rampdown designs to rapidly converge to an effective rampdown trajectory. This procedure uses probabilistic machine learning methods paired with acquisition functions taken from Bayesian optimization. In a set of 2022 experiments at DIII-D, the rampdown designs produced by our method maintained plasma control down to substantially lower current and energy levels than are typically observed. The actions predicted by the model significantly improved as the model was able to explore over the course of the experimental campaign.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Gyrokinetic profile prediction and validation of a negative triangularity plasma in ASDEX Upgrade

In this work, gyrokinetic simulations are performed with the CGYRO code (Candy et al 2016 J. Comput. Phys. 324 73–93) for a negative triangularity H-mode plasma in ASDEX Upgrade, and compared with experimental measurements. The PORTALS framework (Rodriguez-Fernandez et al 2024 Nucl. Fusion 64 076034) is used to accelerate the prediction of kinetic profiles for this plasma, using surrogate modeling and Bayesian optimization. Ion heat flux, electron heat flux, and electron particle flux are simultaneously matched across the simulated radial regime of the plasma (normalized radius $r/a = 0.35-0.90$), and the resulting ion temperature, electron temperature, and electron density profiles match well with the experimental profile data within this radial range. A synthetic Correlation Electron Cyclotron Emission diagnostic is applied to find well-matched electron temperature fluctuation properties between simulation and experiment. The flux-matched profiles provide a basis for investigation of the turbulence nature across the plasma radius, revealing the dominance of Trapped Electron Mode turbulence at $r/a = 0.35$, the dominance of Ion Temperature Gradient turbulence at $r/a = 0.55$, 0.75, and 0.83, and an instability boundary at $r/a = 0.90$.

gyrokinetic simulation↗
DOE OSTI2025

Simulation driven adaptive sampling for neutron-diffraction based strain mapping of additively manufactured parts

Neutron diffraction based strain mapping is a useful technique for measuring residual strains in additively manufactured (AM) metal parts. The measurement is traditionally done by scanning the sample in a point-wise raster pattern to extract the strain at each position. Since the overall scan can span several hours, adaptive sampling approaches using Bayesian optimization based on Gaussian process (BO-GP) regression have been introduced—demonstrating that even with a fraction of the typically made measurements the dominant strain patterns in the sample can be reconstructed. However, the parameters of the BO-GP algorithm have to be carefully chosen for best performance, and the movement time between arbitrary points can offset the time savings from a reduced number of measurement locations. In this paper, we propose algorithms to refine the BO-GP based methods by using simulations of strain patterns in AM parts based on the materials and the process used to print them. We demonstrate that the simulated strain patterns can be used to help choose better parameters for the BO-GP based framework—leading to low reconstruction error for the final strain pattern. Furthermore, we show that the strain mapping experiment can be initialized with a sampling pattern learnt from the simulation data and ordered to reduce movement time, dramatically enabling reduction in the overall time required to run the baseline BO-GP method.

Gaussian process regression↗
DOE OSTI2022

Chemical control of polarization in thin strained films of a multiaxial ferroelectric: Phase diagrams and polarization rotation

The emergent behaviors in thin films of a multiaxial ferroelectric (FE) due to electrochemical coupling between the rotating polarization and surface ions are explored within the framework of the 2–4 Landau-Ginzburg-Devonshire (LGD) thermodynamic potential combined with the Stephenson-Highland (SH) approach. The combined LGD-SH approach allows us to describe the electrochemical switching and rotation of a polarization vector in a multiaxial ferroelectric film covered by surface ions with a charge density defined by the oxygen pressure. In this work, we calculate phase diagrams, analyze the dependence of polarization components on the applied voltage, and discuss the peculiarities of quasistatic ferroelectric, dielectric, and piezoelectric hysteresis loops in thin strained multiaxial ferroelectric films. The nonlinear surface screening by oxygen ions makes the diagrams very different from the known diagrams of, e.g., strained BaTiO 3 films. Quite unexpectedly, we predict the appearance of ferroelectric reentrant phases. The obtained results point to the possibility to control the appearance and features of ferroelectric, dielectric, and piezoelectric hysteresis in multiaxial FE films covered with surface ions by varying their concentration via the partial oxygen pressure. The LGD-SH description of a multiaxial FE film can be further implemented within the Bayesian optimization framework, paving the way toward predictive materials optimization.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Applications of reduced-basis methods to the nuclear single-particle spectrum

Reduced-basis methods provide a powerful framework for building efficient and accurate emulators. Although widely applied in many fields to simplify complex models, reduced-basis methods have only been recently introduced into nuclear physics. In this Letter we build an emulator to study the single-particle structure of atomic nuclei. By scaling a suitable mean-field Hamiltonian, a “universal” reduced basis is constructed capable of accurately and efficiently reproduce the entire single-particle spectrum of a variety of nuclei. Indeed, the reduced-basis model reproduces both ground- and excited-state energies as well as the associated wave functions with remarkable accuracy. Here our results bode well for more demanding applications that use Bayesian optimization to calibrate nuclear energy density functionals.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Higher-order correlations between different moments of two flow amplitudes in Pb-Pb collisions at $\sqrt{s_{NN}} = 5.02$ TeV

The correlations between different moments of two flow amplitudes, extracted with the recently developed asymmetric cumulants, are measured in Pb-Pb collisions at $\sqrt {s_{NN}}$ = 5.02 TeV recorded by the ALICE detector at the CERN Large Hadron Collider. The magnitudes of the measured observables show a dependence on the different moments as well as on the collision centrality, indicating the presence of nonlinear response in all even moments up to the eighth. Furthermore, the higher-order asymmetric cumulants show different signatures than the symmetric and lower-order asymmetric cumulants. Comparisons with state-of-the-art event generators using two different parametrizations obtained from Bayesian optimization show differences between data and simulations in many of the studied observables, indicating a need for further tuning of the models behind those event generators. These results provide new and independent constraints on the initial conditions and transport properties of the system created in heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Preparation of the SU(3) lattice Yang-Mills vacuum with variational quantum methods

Studying QCD and other gauge theories on quantum hardware requires the preparation of physically interesting states. The variational quantum eigensolver provides a way of performing vacuum state preparation on quantum hardware. Here in this work, variational quantum eigensolver is applied to pure SU(3) lattice Yang-Mills on a single plaquette and one dimensional plaquette chains. Bayesian optimization and gradient descent were investigated for performing the classical optimization. Ansatz states for plaquette chains are constructed in a scalable manner from smaller systems using domain decomposition and a stitching procedure analogous to the density matrix renormalization group. Small examples are performed on IBM’s superconducting Manila processor.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Inference of gravitational lensing and patchy reionization with future CMB data

We develop an optimal Bayesian solution for jointly inferring secondary signals in the Cosmic Microwave Background (CMB) originating from gravitational lensing and from patchy screening during the epoch of reionization. This method is able to extract full information content from the data, improving upon previously considered quadratic estimators for lensing and screening. Here, we forecast constraints using the Marginal Unbiased Score Expansion (MUSE) method, and show that they are largely dominated by CMB polarization, and depend on the exact details of reionization. For models consistent with current data which produce the largest screening signals, a detection (3 σ) of the cross-correlation between lensing and screening is possible with SPT-3G, and a detection of the auto-correlation is possible with CMB-S4. Models with the lowest screening signals evade the sensitivity of SPT-3G, but are still possible to detect with CMB-S4 via their lensing cross-correlation.

79 ASTRONOMY AND ASTROPHYSICS↗