Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

First-Principles Assessment of ZnTe and CdSe as Prospective Tunnel Barriers at the InAs/Al Interface

Majorana zero modes are predicted to emerge in semiconductor/ superconductor interfaces, such as InAs/Al. Majorana modes could be utilized for fault tolerant topological qubits. However, their realization is hindered by materials challenges. The coupling between the superconductor and the semiconductor may be too strong for Majorana modes to emerge, due to effective doping of the semiconductor by the metallic contact. This could be mediated by adding a tunnel barrier of controlled thickness. We use density functional theory (DFT) with Hubbard U corrections, whose values are machine-learned via Bayesian optimization (BO), to assess ZnTe and CdSe as prospective tunnel barriers for the InAs/Al interface. The results of DFT +U(BO) for ZnTe are validated by comparison to angle resolved photoemission spectroscopy (ARPES). We then study bilayer interfaces of the three semiconductors with each other and with Al, as well as trilayer interfaces with a varying number of ZnTe or CdSe layers inserted between InAs and Al. We find that 16 atomic layers of either material completely insulate the InAs from metal induced gap states (MIGS). However, ZnTe and CdSe differ significantly in their band alignment, such that ZnTe forms an effective barrier for electrons, whereas CdSe forms a barrier for holes. Because of Fermi level pinning in the conduction band at the interface, only electron transport is relevant for InAs-based Majorana devices. Therefore, ZnTe is the better choice. Based on the results of our simulations, we suggest conducting experiments with ZnTe barriers in the thickness range of 6–18 atomic layers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dynamic Multiplexed Control and Modeling of Optogenetic Systems Using the High-Throughput Optogenetic Platform, Lustro

The ability to control cellular processes using optogenetics is inducer-limited, with most optogenetic systems responding to blue light. To address this limitation, we leverage an integrated framework combining Lustro, a powerful high-throughput optogenetics platform, and machine learning tools to enable multiplexed control over blue light-sensitive optogenetic systems. Specifically, we identify light induction conditions for sequential activation as well as preferential activation and switching between pairs of light-sensitive split transcription factors in the budding yeast, Saccharomyces cerevisiae. We use the high-throughput data generated from Lustro to build a Bayesian optimization framework that incorporates data-driven learning, uncertainty quantification, and experimental design to enable the prediction of system behavior and the identification of optimal conditions for multiplexed control. This work lays the foundation for designing more advanced synthetic biological circuits incorporating optogenetics, where multiple circuit components can be controlled using designer light induction programs, with broad implications for biotechnology and bioengineering.

59 BASIC BIOLOGICAL SCIENCES↗

ELM–Wet: Inclusion of a Wet–Landunit With Sub–Grid Representation of Eco–Hydrological Patches and Hydrological Forcing Improves Methane Emission Estimations in the E3SM Land Model (ELM)

Wetlands are the largest emitters of biogenic methane (CH 4 ) and represent the highest source of uncertainty in global CH 4 budgets. Here, we aim to improve the realism of wetland representation in the U.S. Department of Energy's Exascale Earth System Model land surface model, ELM, thereby reducing uncertainty of CH 4 flux predictions. We develop an updated version, ELM-Wet, where we activate a separate landunit for wetlands that handles multiple wetland-specific eco-hydrological patch functional types. We introduce more realistic hydrological forcing through prescribing site-level constraints on surface water elevation, which allows resolving different sustained inundation depth for different patches, and if data exists, prescribing inundation depth. We modified the calculation of aerenchyma transport diffusivity based on observed conductance per leaf area for different vegetation types. We use Bayesian Optimization to parameterize CO 2 and CH 4 fluxes in the developed wet-landunit. Site-level simulations of a coastal non-tidal freshwater wetland in Louisiana were performed with the updated model. Eddy covariance observations of CO 2 and CH 4 fluxes from 2012 to 2013 were used to train the model and data from 2021 were used for validation. Patch-specific chamber flux observations and observations of CH 4 concentration profiles in the soil porewater from 2021 were used for evaluation of the model performance. Our results show that ELM-Wet reduces the model's CH 4 emission root mean squared error by up to 33% and is able to represent inter-daily CO 2 and CH 4 flux variability across the wetland's eco-hydrological patches, including during periods of extreme dry or wet conditions.

54 ENVIRONMENTAL SCIENCES↗

Turn-key constrained parameter space exploration for particle accelerators using Bayesian active learning

Abstract Particle accelerators are invaluable discovery engines in the chemical, biological and physical sciences. Characterization of the accelerated beam response to accelerator input parameters is often the first step when conducting accelerator-based experiments. Currently used techniques for characterization, such as grid-like parameter sampling scans, become impractical when extended to higher dimensional input spaces, when complicated measurement constraints are present, or prior information known about the beam response is scarce. Here in this work, we describe an adaptation of the popular Bayesian optimization algorithm, which enables a turn-key exploration of input parameter spaces. Our algorithm replaces the need for parameter scans while minimizing prior information needed about the measurement’s behavior and associated measurement constraints. We experimentally demonstrate that our algorithm autonomously conducts an adaptive, multi-parameter exploration of input parameter space, potentially orders of magnitude faster than conventional grid-like parameter scans, while making highly constrained, single-shot beam phase-space measurements and accounts for costs associated with changing input parameters. In addition to applications in accelerator-based scientific experiments, this algorithm addresses challenges shared by many scientific disciplines, and is thus applicable to autonomously conducting experiments over a broad range of research topics.

43 PARTICLE ACCELERATORS↗

Superlative mechanical energy absorbing efficiency discovered through self-driving lab-human partnership

Energy absorbing efficiency is a key determinant of a structure’s ability to provide mechanical protection and is defined by the amount of energy that can be absorbed prior to stresses increasing to a level that damages the system to be protected. Here, we explore the energy absorbing efficiency of additively manufactured polymer structures by using a self-driving lab (SDL) to perform >25,000 physical experiments on generalized cylindrical shells. We use a human-SDL collaborative approach where experiments are selected from over trillions of candidates in an 11-dimensional parameter space using Bayesian optimization and then automatically performed while the human team monitors progress to periodically modify aspects of the system. The result of this human-SDL campaign is the discovery of a structure with a 75.2% energy absorbing efficiency and a library of experimental data that reveals transferable principles for designing tough structures.

42 ENGINEERING↗

Autonomous platform for solution processing of electronic polymers

The manipulation of electronic polymers’ solid-state properties through processing is crucial in electronics and energy research. Yet, efficiently processing electronic polymer solutions into thin films with specific properties remains a formidable challenge. We introduce Polybot, an artificial intelligence (AI) driven automated material laboratory designed to autonomously explore processing pathways for achieving high-conductivity, low-defect electronic polymers films. Leveraging importance-guided Bayesian optimization, Polybot efficiently navigates a complex 7-dimensional processing space. In particular, the automated workflow and algorithms effectively explore the search space, mitigate biases, employ statistical methods to ensure data repeatability, and concurrently optimize multiple objectives with precision. The experimental campaign yields scale-up fabrication recipes, producing transparent conductive thin films with averaged conductivity exceeding 4500 S/cm. Feature importance analysis and morphological characterizations reveal key design factors. This work signifies a significant step towards transforming the manufacturing of electronic polymers, highlighting the potential of AI-driven automation in material science.

Wang, Chengshi [Argonne National Laboratory (ANL),↗

PhaseT3M: 3D imaging at 1.6 Å resolution via electron cryo-tomography with nonlinear phase retrieval

Electron cryo-tomography (cryo-ET) enables 3D imaging of complex, radiation-sensitive structures with molecular detail. However, image contrast from the interference of scattered electrons is nonlinear with atomic density and multiple scattering further complicates interpretation. These effects degrade resolution, particularly in conventional reconstruction algorithms, which assume linearity. Particle averaging can reduce such issues but is unsuitable for heterogeneous or dynamic samples ubiquitous in biology, chemistry, and materials sciences. Here, we develop a phase retrieval-based cryo-ET method, PhaseT3M. We experimentally demonstrate its application to an approximately 7 nm Co3O4 nanoparticle on an approximately 30 nm carbon substrate, achieving a maximum resolution of 1.6 Å, surpassing conventional limits using standard cryo-TEM equipment. PhaseT3M uses a multislice model for multiple scattering and Bayesian optimization for alignment and computational aberration correction, with a positivity constraint to recover ‘missing wedge’ information. Applied directly to biological particles, it enhances reconstruction quality and reduces artifacts, establishing a standard for routine 3D imaging with phase contrast.

Biophysics↗

Machine-learned interatomic potentials by active learning: amorphous and liquid hafnium dioxide

We propose an active learning scheme for automatically sampling a minimum number of uncorrelated configurations for fitting the Gaussian Approximation Potential (GAP). Our active learning scheme consists of an unsupervised machine learning (ML) scheme coupled with a Bayesian optimization technique that evaluates the GAP model. We apply this scheme to a Hafnium dioxide (HfO 2 ) dataset generated from a "melt-quench" ab initio molecular dynamics (AIMD) protocol. Our results show that the active learning scheme, with no prior knowledge of the dataset, is able to extract a configuration that reaches the required energy fit tolerance. Further, molecular dynamics (MD) simulations performed using this active learned GAP model on 6144 atom systems of amorphous and liquid state elucidate the structural properties of HfO 2 with near ab initio precision and quench rates (i.e., 1.0 K/ps) not accessible via AIMD. The melt and amorphous X-ray structural factors generated from our simulation are in good agreement with experiment. In addition, the calculated diffusion constants are in good agreement with previous ab initio studies.

36 MATERIALS SCIENCE↗

Bayesian blacksmithing: discovering thermomechanical properties and deformation mechanisms in high-entropy refractory alloys

Finding alloys with specific design properties is challenging due to the large number of possible compositions and the complex interactions between elements. This study introduces a multi-objective Bayesian optimization approach guiding molecular dynamics simulations for discovering high-performance refractory alloys with both targeted intrinsic static thermomechanical properties and also deformation mechanisms occurring during dynamic loading. The objective functions are aiming for excellent thermomechanical stability via a high bulk modulus, a low thermal expansion, a high heat capacity, and for a resilient deformation mechanism maximizing the retention of the BCC phase after shock loading. Contrasting two optimization procedures, we show that the Pareto-optimal solutions are confined to a small performance space when the property objectives display a cooperative relationship. Conversely, the Pareto front is much broader in the performance space when these properties have antagonistic relationships. Density functional theory simulations validate these findings and unveil underlying atomic-bond changes driving property improvements.

36 MATERIALS SCIENCE↗

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗

Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian process-based exploration–exploitation

Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase separated materials to quantum systems. Traditionally, exploration of the phase diagrams corresponding to multidimensional parameter spaces of Hamiltonians was performed using a combination of basic physical principles, analytical approximations, and extensive numerical modeling. However, exploration of complex multidimensional parameter spaces is subject to the classic dimensionality problem, and the behaviors of interest concentrated on low dimensional manifolds remain undiscovered. Here, we demonstrate that a combination of exploration and exploration–exploitation with Gaussian process modeling and Bayesian optimization allows effective exploration of the parameter space for lattice Hamiltonians and effectively maps the regions at which specific macroscopic functionalities or local structures are maximized. We argue that this approach is general and can be further extended well beyond the lattice Hamiltonians to effectively explore the parameter space of more complex off-lattice and dynamic models.

42 ENGINEERING↗

Structure prediction of epitaxial inorganic interfaces by lattice and surface matching with Ogre

We present a new version of the Ogre open source Python package with the capability to perform structure prediction of epitaxial inorganic interfaces by lattice and surface matching. In the lattice matching step, a scan over combinations of substrate and film Miller indices is performed to identify the domain-matched interfaces with the lowest mismatch. Subsequently, surface matching is conducted by Bayesian optimization to find the optimal interfacial distance and in-plane registry between the substrate and the film. For the objective function, a geometric score function is proposed based on the overlap and empty space between atomic spheres at the interface. The score function reproduces the results of density functional theory (DFT) at a fraction of the computational cost. The optimized interfaces are pre-ranked using a score function based on the similarity of the atomic environment at the interface to the bulk environment. Final ranking of the top candidate structures is performed with DFT. Ogre streamlines DFT calculations of interface energies and electronic properties by automating the construction of interface models. The application of Ogre is demonstrated for two interfaces of interest for quantum computing and spintronics, Al/InAs and Fe/InSb.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AL4GAP: Active learning workflow for generating DFT-SCAN accurate machine-learning potentials for combinatorial molten salt mixtures

Machine learning interatomic potentials have emerged as a powerful tool for bypassing the spatiotemporal limitations of ab initio simulations, but major challenges remain in their efficient parameterization. We present AL4GAP, an ensemble active learning software workflow for generating multicomposition Gaussian approximation potentials (GAP) for arbitrary molten salt mixtures. The workflow capabilities include: (1) setting up user-defined combinatorial chemical spaces of charge neutral mixtures of arbitrary molten mixtures spanning 11 cations (Li, Na, K, Rb, Cs, Mg, Ca, Sr, Ba and two heavy species, Nd, and Th) and 4 anions (F, Cl, Br, and I), (2) configurational sampling using low-cost empirical parameterizations, (3) active learning for down-selecting configurational samples for single point density functional theory calculations at the level of Strongly Constrained and Appropriately Normed (SCAN) exchange-correlation functional, and (4) Bayesian optimization for hyperparameter tuning of two-body and many-body GAP models. Here, we apply the AL4GAP workflow to showcase high throughput generation of five independent GAP models for multicomposition binary-mixture melts, each of increasing complexity with respect to charge valency and electronic structure, namely: LiCl–KCl, NaCl–CaCl 2 , KCl–NdCl 3 , CaCl 2 –NdCl 3 , and KCl–ThCl 4 . Our results indicate that GAP models can accurately predict structure for diverse molten salt mixture with density functional theory (DFT)-SCAN accuracy, capturing the intermediate range ordering characteristic of the multivalent cationic melts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Simultaneous reproduction of experimental profiles, fluxes, transport coefficients, and turbulence characteristics via nonlinear gyrokinetic profile predictions in a DIII-D ITER similar shape plasma

Experimental conditions obtained on the DIII-D tokamak in the ITER Similar Shape (ISS) have been compared extensively with nonlinear gyrokinetic simulation using the CGYRO code [Candy et al., J. Comput. Phys. 324, 73–93 (2016)] with comparisons spanning ion and electron heat fluxes, electron and impurity particle transport, and turbulent fluctuation levels and characteristics. Bayesian optimization techniques [Rodriguez-Fernandez et al., Nucl. Fusion 62(7), 076036 (2022)], combined with nonlinear gyrokinetics, have been used to obtain simultaneously Qi, Qe, and Γe flux-matched profiles that are found to be in good agreement with experimental profile measurements. Synthetic diagnostics were used to compare measured beam emission spectroscopy and correlation electron cyclotron emission turbulent fluctuations with nonlinear simulation. Although some disagreements exist, nonlinear simulations are found to be in generally good agreement with measured fluctuation levels, spectral shapes, and measured radial trends in low-k δne/ne and δTe/Te. Low (Li and C) and mid-Z (Ca) impurity transport was also compared with these flux-matched simulations. Fully stripped, low-Z impurities are well reproduced by the gyrokinetic modeling while clear disagreement exists in comparisons with mid-Z impurities. Nonlinear gyrokinetic investigation into the Z dependence of impurity transport in the ISS conditions is also performed, demonstrating clear trends of impurity diffusion with impurity Z (both D∝Z and D∝1/Z) that vary with the radial location studied. These trends are shown to result from the local dominance of ion temperature gradient or ∇n driven trapped electron mode turbulence and may contribute to the disagreement between simulation and experiment in mid-Z impurity transport. The results of this work represent one of the most complete validation studies of the gyrokinetic model performed to date and provide an example of new capabilities for predicting performance in future fusion devices.

Physics↗

Validation of the GFS model for gyrokinetic stability of NSTX pedestal data

This study presents a large database validation of the gyro fluid system (GFS) model for linear gyrokinetic stability for high-mode (H-mode) edge transport barrier conditions in the national spherical torus experiment (NSTX) tokamak. The database of linear stability calculations with the CGYRO gyrokinetic code was produced using plasma profile measurements from NSTX discharges to identify kinetic ballooning modes (KBM), trapped electron modes (TEM), and micro-tearing modes (MTM) that limit the pressure profile gradient in the H-mode barrier. A novel Bayesian optimization approach determines optimal resolution parameters for GFS specifically for spherical tokamak pedestal conditions. Our results demonstrate that GFS, with optimized resolution, can achieve accurate linear stability analysis in NSTX pedestal conditions for reduced resolution compared to CGYRO. GFS can accurately find the KBM, TEM, and MTM instability branches. Parametric analysis reveals that GFS accuracy in this extreme pedestal parameter range is degraded for low magnetic shear and near the separatrix conditions. These findings establish GFS as a fast linear eigenmode solver for spherical tokamak pedestal gyrokinetic stability and demonstrate a systematic methodology for determining the optimum resolution settings.

Yang, Minglei [Oak Ridge National Laboratory (ORNL↗

Identifying native point defect configurations in α-alumina

Intimately intertwined atomic and electronic structures of point defects govern diffusion-limited corrosion and underpin the operation of optoelectronic devices. For some materials, complex energy landscapes containing metastable defect configurations challenge first-principles modeling efforts. Here, we thoroughly reevaluate native point defect geometries for the illustrative case of α-Al 2 O 3 by comparing three methods for sampling candidate geometries in density functional theory calculations: displacing atoms near a naively placed defect, initializing interstitials at high-symmetry points of a Voronoi decomposition, and Bayesian optimization. We find symmetry-breaking distortions for oxygen vacancies in some charge states, and we identify several distinct oxygen split-interstitial geometries that help explain literature discrepancies involving this defect. We also report a surprising and, to our knowledge, previously unknown trigonal geometry favored by aluminum interstitials in some charge states. Importantly, these new configurations may have transformative impacts on our understanding of defect migration pathways in aluminum-oxide scales protecting metal alloys from corrosion. Overall, the Voronoi scheme appears most effective for sampling candidate interstitial sites because it always succeeded in finding the lowest-energy geometry identified in this study, although no approach found every metastable configuration. Finally, we show that the position of defect levels within the band gap can depend strongly on the defect geometry, underscoring the need to conduct careful searches for ground-state geometries in defect calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Automated experimental design of safe rampdowns via probabilistic machine learning

Abstract Typically the rampdown phase of a shot consists of a decrease in current and injected power and optionally a change in shape, but there is considerable flexibility in the rate, sequencing, and duration of these changes. On the next generation of tokamaks it is essential that this is done safely as the device could be damaged by the stored thermal and electromagnetic energy present in the plasma. This works presents a procedure for automatically choosing experimental rampdown designs to rapidly converge to an effective rampdown trajectory. This procedure uses probabilistic machine learning methods paired with acquisition functions taken from Bayesian optimization. In a set of 2022 experiments at DIII-D, the rampdown designs produced by our method maintained plasma control down to substantially lower current and energy levels than are typically observed. The actions predicted by the model significantly improved as the model was able to explore over the course of the experimental campaign.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗