Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Advanced techniques in automated high-resolution scanning transmission electron microscopy

Scanning transmission electron microscopy is a common tool used to study the atomic structure of materials. It is an inherently multimodal tool allowing for the simultaneous acquisition of multiple information channels. Despite its versatility, however, experimental workflows currently rely heavily on experienced human operators and can only acquire data from small regions of a sample at a time. Here, we demonstrate a flexible pipeline-based system for high-throughput acquisition of atomic-resolution structural data using an all-piezo sample stage applied to large-scale imaging of nanoparticles and multimodal data acquisition. As a result, the system is available as part of the user program of the Molecular Foundry at Lawrence Berkeley National Laboratory.

4D-STEM↗

Structural mode coupling in perovskite oxides using hypothesis-driven active learning

Abstract Finding the ground-state structure with minimum energy is paramount to designing any material. In ABO 3 -type perovskite oxides with Pnma symmetry, the lowest energy phase is driven by an inherent trilinear coupling between the two primary order parameters such as rotation and tilt with antiferroelectric displacement of the A-site cations as established via hybrid improper ferroelectric mechanism. Conventionally, finding the relevant mode coupling driving phase transition requires performing first-principles calculations which is computationally time-consuming as well as expensive. It involves following an intuitive iterative hit and trial method of (a) adding two or multiple mode vectors, followed by (b) evaluating which combination would lead to the ground-state energy. In this study, we show how a hypothesis-driven active learning framework can identify suitable mode couplings within the Landau free energy expansion with minimal information on amplitudes of modes for a series of double perovskite oxides with A-site layered, columnar and rocksalt ordering. This scheme is expected to be applicable universally for understanding atomistic mechanisms derived from various structural mode couplings behind functionalities, for e.g. polarization, magnetization and metal–insulator transitions.

36 MATERIALS SCIENCE↗

PINNSTRIPES (Physics-Informed Neural Network SurrogaTe for Rapidly Identifying Parameters in Energy Systems) [SWR-22-12]

Energy systems models typically take the form of complex partial differential equations which make multiple forward calculations prohibitively expensive. Fast and data-efficient construction of surrogate models is of utmost importance for applications that require parameter exploration such as design optimization and Bayesian calibration. In presence of a large number of parameters, surrogate models that capture correct dependencies may be difficult to construct with traditional techniques. The issue is addressed here with the formulation of the surrogate model constructed via Physics-Informed Neural Networks (PINN) which capture the dependence with respect to the parameters to estimate, while using a limited amount of data. Since forward evaluations of the surrogate model are cheap, parameter exploration is made inexpensive, even when considering a large number of parameters.

Hassanaly, Malik↗

Multi-fidelity Gaussian Process Bandit Optimisation

In many scientific and engineering applications, we are tasked with the maximisation of an expensive to evaluate black box function f. Traditional settings for this problem assume just the availability of this single function. However, in many cases, cheap approximations to f may be obtainable. For example, the expensive real world behaviour of a robot can be approximated by a cheap computer simulation. We can use these approximations to eliminate low function value regions cheaply and use the expensive evaluations of f in a small but promising region and speedily identify the optimum. We formalise this task as a multi-fidelity bandit problem where the target function and its approximations are sampled from a Gaussian process. We develop MF-GP-UCB, a novel method based on upper confidence bound techniques. In our theoretical analysis we demonstrate that it exhibits precisely the above behaviour and achieves better bounds on the regret than strategies which ignore multi-fidelity information. Empirically, MF-GP-UCB outperforms such naive strategies and other multi-fidelity methods on several synthetic and real experiments.

97 MATHEMATICS AND COMPUTING↗

LANL update to 239 Pu in the fast energy range [Slides]

Researchers are in the process of updating the Pu cross sections in the fast energy range (complementing the work of IAEA / INDEN / ORNL lower energy work in the resonance range). LANL is overhauling its evaluation tools (CoH, CGMF, DeCE, Kalman, NEXUS, PySOK, SOK) and focusing on consistency throughout evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ResDesign: Resilient by Design Platform for CPS Assessment and Validation

ResDesign project has developed integrated capabilities to help cyber physical system modelers and analysts to evaluate vulnerabilities and resilience of such systems using co-simulation-based attack testbed, graph-based visualization and monitoring tool, and Bayesian optimization-based co-design capability. The project demonstrates a collection of attack scenarios and use cases in an integrated software environment.

97 MATHEMATICS AND COMPUTING↗

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗

Adaptive Grid Lens Modeling of the Cosmic Horseshoe Using Hubble Space Telescope Imaging

The Cosmic Horseshoe gravitational lensing system is an extraordinary example of strong gravitational lensing both due to the nearly complete Einstein ring formed in this system and due to the star-forming nature of the lensed $z$ = 2.38 Lyman-break galaxy. In this paper, we describe the development of a new lens modeling package and the lens models produced using the Hubble Space Telescope imaging. Our new lens modeling package uses adaptive grid methods, based especially on the algorithm described by Vegetti & Koopmans. The new lens modeling package introduces the K-means method to deal with multiple background sources. We utilize two parameterized models, the singular isothermal ellipsoid and the Navarro–Frenk–White model in order to optimize the Bayesian penalty function. Color–color diagrams show two distinct colors exist in the Einstein ring, which suggests that the Cosmic Horseshoe is formed from two background galaxies or from a highly irregular galaxy. We find that the best lens model includes two components and the total mass within the Einstein ring is $(5.43\pm 0.08)\times {10}^{12}\,{M}_{\odot }$. Furthermore, the background source reconstruction shows two peaks in the source plane and the most probable lens profile is consistent with the light profile of the foreground galaxy when comparing axis ratios and position angles.

79 ASTRONOMY AND ASTROPHYSICS↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Kriging-Based Inverse Uncertainty Quantification of BISON Fission Gas Release Model

Nuclear reactor fuel performance analysis studies the thermo-mechanical behavior of fuel rods and verify their compliance with safety criteria under both normal operation and accidental conditions. One of the major concerns in fuel performance analysis is the behavior of the fission gases xenon and krypton in uranium dioxide fuel, which significantly affect the thermo-mechanical performance of the nuclear fuel rods employed in current LWRs. Previously, the modeling of fission gas release (FGR) in nuclear fuel performance codes have been relying on empirical models which are not applicable beyond their range of calibration. Recently a more efficient and flexible physics-based FGR and swelling model that can describe a wider range of reactor operation conditions have been implemented in fuel performance code BISON. In this work, we performed Bayesian calibration to inversely quantify the uncertainties associated with the 5 tuning parameters in BISON FGR model, based on the time-dependent FGR measurement data from Riso-AN3 benchmark. It takes around 1 hour and 40 minutes for BISON to simulate the Riso-AN3 benchmark with a moderate mesh size using 32 processors. As hundreds of thousands of BISON simulations are needed during Markov Chain Monte Carlo (MCMC) sampling, running BISON directly is not a viable solution. Therefore we propose to use Kriging-based metamodels to replace BISON during MCMC sampling. Surrogate model is an approximation of the input/output relation of a computer code/model. It is also called metamodel, response surface, emulator. Surrogate models usually take much less computational time than the original model (like BISON) while maintaining the input/output relation of the original model to a desirable accuracy. Constructing the metamodels normally requires small number of executions of the original model. Once validated, metamodels can be used to perform uncertainty and sensitivity analysis, Bayesian calibration, optimization, etc.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Artificial intelligence for materials research at extremes

Abstract Materials development is slow and expensive, taking decades from inception to fielding. For materials research at extremes, the situation is even more demanding, as the desired property combinations such as strength and oxidation resistance can have complex interactions. Here, we explore the role of AI and autonomous experimentation (AE) in the process of understanding and developing materials for extreme and coupled environments. AI is important in understanding materials under extremes due to the highly demanding and unique cases these environments represent. Materials are pushed to their limits in ways that, for example, equilibrium phase diagrams cannot describe. Often, multiple physical phenomena compete to determine the material response. Further, validation is often difficult or impossible. AI can help bridge these gaps, providing heuristic but valuable links between materials properties and performance under extreme conditions. We explore the potential advantages of AE along with decision strategies. In particular, we consider the problem of deciding between low-fidelity, inexpensive experiments and high-fidelity, expensive experiments. The cost of experiments is described in terms of the speed and throughput of automated experiments, contrasted with the human resources needed to execute manual experiments. We also consider the cost and benefits of modeling and simulation to further materials understanding, along with characterization of materials under extreme environments in the AE loop. Graphical abstract AI sequential decision-making methods for materials research: Active learning, which focuses on exploration by sampling uncertain regions, Bayesian and bandit optimization as well as reinforcement learning (RL), which trades off exploration of uncertain regions with exploitation of optimum function value. Bayesian and bandit optimization focus on finding the optimal value of the function at each step or cumulatively over the entire steps, respectively, whereas RL considers cumulative value of the labeling function, where the latter can change depending on the state of the system (blue, orange, or green).

36 MATERIALS SCIENCE↗

Principles of Bayesian Ensemble Creation: Theoretical and Empirical Observations

Bayesian methods are theoretically optimal given their underlying assumptions. Bayesian model averaging (BMA) is generally considered the standard model for creating ensembles of learners using Bayesian methods, but this technique is often out-performed by more ad hoc methods in empirical studies. It has been proposed that Bayesian model averaging struggles in practice because it accounts for uncertainty about which model is the data-generating model but still operates under the assumption that only one of them is. Thus, BMA is unable to enrich the hypothesis space as effectively as other ensemble creation methods, serving as a form of optimal model selection, not optimal model combination. This work provides empirical verification for this hypothesis using both synthetic and real-world data. We propose several different approaches for Bayesian model combination, and demonstrate that they overcome this problem with BMA. We empirically show that even the most simplistic of Bayesian model combination strategies can compete with the traditional ad hoc techniques of bagging, boosting and stacking, as well as significantly outperforming BMA over a wide variety of cases. We also explore the implications of this observation as it relates to the effectiveness of ensemble learning.

97 MATHEMATICS AND COMPUTING↗