Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Gyrokinetic profile prediction and validation of a negative triangularity plasma in ASDEX Upgrade

In this work, gyrokinetic simulations are performed with the CGYRO code (Candy et al 2016 J. Comput. Phys. 324 73–93) for a negative triangularity H-mode plasma in ASDEX Upgrade, and compared with experimental measurements. The PORTALS framework (Rodriguez-Fernandez et al 2024 Nucl. Fusion 64 076034) is used to accelerate the prediction of kinetic profiles for this plasma, using surrogate modeling and Bayesian optimization. Ion heat flux, electron heat flux, and electron particle flux are simultaneously matched across the simulated radial regime of the plasma (normalized radius $r/a = 0.35-0.90$), and the resulting ion temperature, electron temperature, and electron density profiles match well with the experimental profile data within this radial range. A synthetic Correlation Electron Cyclotron Emission diagnostic is applied to find well-matched electron temperature fluctuation properties between simulation and experiment. The flux-matched profiles provide a basis for investigation of the turbulence nature across the plasma radius, revealing the dominance of Trapped Electron Mode turbulence at $r/a = 0.35$, the dominance of Ion Temperature Gradient turbulence at $r/a = 0.55$, 0.75, and 0.83, and an instability boundary at $r/a = 0.90$.

gyrokinetic simulation↗

Simulation driven adaptive sampling for neutron-diffraction based strain mapping of additively manufactured parts

Neutron diffraction based strain mapping is a useful technique for measuring residual strains in additively manufactured (AM) metal parts. The measurement is traditionally done by scanning the sample in a point-wise raster pattern to extract the strain at each position. Since the overall scan can span several hours, adaptive sampling approaches using Bayesian optimization based on Gaussian process (BO-GP) regression have been introduced—demonstrating that even with a fraction of the typically made measurements the dominant strain patterns in the sample can be reconstructed. However, the parameters of the BO-GP algorithm have to be carefully chosen for best performance, and the movement time between arbitrary points can offset the time savings from a reduced number of measurement locations. In this paper, we propose algorithms to refine the BO-GP based methods by using simulations of strain patterns in AM parts based on the materials and the process used to print them. We demonstrate that the simulated strain patterns can be used to help choose better parameters for the BO-GP based framework—leading to low reconstruction error for the final strain pattern. Furthermore, we show that the strain mapping experiment can be initialized with a sampling pattern learnt from the simulation data and ordered to reduce movement time, dramatically enabling reduction in the overall time required to run the baseline BO-GP method.

Gaussian process regression↗

Chemical control of polarization in thin strained films of a multiaxial ferroelectric: Phase diagrams and polarization rotation

The emergent behaviors in thin films of a multiaxial ferroelectric (FE) due to electrochemical coupling between the rotating polarization and surface ions are explored within the framework of the 2–4 Landau-Ginzburg-Devonshire (LGD) thermodynamic potential combined with the Stephenson-Highland (SH) approach. The combined LGD-SH approach allows us to describe the electrochemical switching and rotation of a polarization vector in a multiaxial ferroelectric film covered by surface ions with a charge density defined by the oxygen pressure. In this work, we calculate phase diagrams, analyze the dependence of polarization components on the applied voltage, and discuss the peculiarities of quasistatic ferroelectric, dielectric, and piezoelectric hysteresis loops in thin strained multiaxial ferroelectric films. The nonlinear surface screening by oxygen ions makes the diagrams very different from the known diagrams of, e.g., strained BaTiO 3 films. Quite unexpectedly, we predict the appearance of ferroelectric reentrant phases. The obtained results point to the possibility to control the appearance and features of ferroelectric, dielectric, and piezoelectric hysteresis in multiaxial FE films covered with surface ions by varying their concentration via the partial oxygen pressure. The LGD-SH description of a multiaxial FE film can be further implemented within the Bayesian optimization framework, paving the way toward predictive materials optimization.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Applications of reduced-basis methods to the nuclear single-particle spectrum

Reduced-basis methods provide a powerful framework for building efficient and accurate emulators. Although widely applied in many fields to simplify complex models, reduced-basis methods have only been recently introduced into nuclear physics. In this Letter we build an emulator to study the single-particle structure of atomic nuclei. By scaling a suitable mean-field Hamiltonian, a “universal” reduced basis is constructed capable of accurately and efficiently reproduce the entire single-particle spectrum of a variety of nuclei. Indeed, the reduced-basis model reproduces both ground- and excited-state energies as well as the associated wave functions with remarkable accuracy. Here our results bode well for more demanding applications that use Bayesian optimization to calibrate nuclear energy density functionals.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Higher-order correlations between different moments of two flow amplitudes in Pb-Pb collisions at $\sqrt{s_{NN}} = 5.02$ TeV

The correlations between different moments of two flow amplitudes, extracted with the recently developed asymmetric cumulants, are measured in Pb-Pb collisions at $\sqrt {s_{NN}}$ = 5.02 TeV recorded by the ALICE detector at the CERN Large Hadron Collider. The magnitudes of the measured observables show a dependence on the different moments as well as on the collision centrality, indicating the presence of nonlinear response in all even moments up to the eighth. Furthermore, the higher-order asymmetric cumulants show different signatures than the symmetric and lower-order asymmetric cumulants. Comparisons with state-of-the-art event generators using two different parametrizations obtained from Bayesian optimization show differences between data and simulations in many of the studied observables, indicating a need for further tuning of the models behind those event generators. These results provide new and independent constraints on the initial conditions and transport properties of the system created in heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preparation of the SU(3) lattice Yang-Mills vacuum with variational quantum methods

Studying QCD and other gauge theories on quantum hardware requires the preparation of physically interesting states. The variational quantum eigensolver provides a way of performing vacuum state preparation on quantum hardware. Here in this work, variational quantum eigensolver is applied to pure SU(3) lattice Yang-Mills on a single plaquette and one dimensional plaquette chains. Bayesian optimization and gradient descent were investigated for performing the classical optimization. Ansatz states for plaquette chains are constructed in a scalable manner from smaller systems using domain decomposition and a stitching procedure analogous to the density matrix renormalization group. Small examples are performed on IBM’s superconducting Manila processor.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Inference of gravitational lensing and patchy reionization with future CMB data

We develop an optimal Bayesian solution for jointly inferring secondary signals in the Cosmic Microwave Background (CMB) originating from gravitational lensing and from patchy screening during the epoch of reionization. This method is able to extract full information content from the data, improving upon previously considered quadratic estimators for lensing and screening. Here, we forecast constraints using the Marginal Unbiased Score Expansion (MUSE) method, and show that they are largely dominated by CMB polarization, and depend on the exact details of reionization. For models consistent with current data which produce the largest screening signals, a detection (3 σ) of the cross-correlation between lensing and screening is possible with SPT-3G, and a detection of the auto-correlation is possible with CMB-S4. Models with the lowest screening signals evade the sensitivity of SPT-3G, but are still possible to detect with CMB-S4 via their lensing cross-correlation.

79 ASTRONOMY AND ASTROPHYSICS↗

First principles study of the electronic structure of the Ni 2 MnIn / InAs and Ti 2 MnIn / InSb interfaces

We present a first principles study of the electronic and magnetic properties of epitaxial interfaces between the Heusler compounds, Ti 2 MnIn and Ni 2 MnIn, and the III-V semiconductors, InSb and InAs, respectively. We use density functional theory (DFT) with a machine-learned Hubbard U correction determined by Bayesian optimization. Here, we evaluate these interfaces for prospective applications in Majorana-based quantum computing and spintronics. In both interfaces, states from the Heusler penetrate into the gap of the semiconductor, decaying within a few atomic layers. The magnetic interactions at the interface are weak and local in space and energy. Magnetic moments of less than 0.1 µB are induced in the two atomic layers closest to the interface. The induced spin polarization around the Fermi level of the semiconductor decays within a few atomic layers. The decisive factor for the induced spin polarization around the Fermi level of the semiconductor is the spin polarization around the Fermi level in the Heusler, rather than the overall magnetic moment. As a result, the ferrimagnetic narrow-gap semiconductor Ti 2 MnIn induces a more significant spin polarization in the InSb than the ferromagnetic metal Ni 2 MnIn induces in the InAs. This is explained by the position of the transition metal d states in the Heusler with respect to the Fermi level. Based on our results, these interfaces are unlikely to be useful for Majorana devices but could be of interest for spintronics.

36 MATERIALS SCIENCE↗

Hamiltonian parameter inference from resonant inelastic x-ray scattering with active learning

Identifying model Hamiltonians is a vital step toward creating predictive models of materials. Here, in this study, we combine Bayesian optimization with the EDRIXS numerical package to infer Hamiltonian parameters from resonant inelastic x-ray scattering (RIXS) spectra within the single atom approximation. To evaluate the efficacy of our method, we test it on experimental RIXS spectra of NiPS 3 , NiCl 2 , Ca 3 ⁢LiOsO 6 , and Fe 2⁢ O 3 , and demonstrate that it can reproduce results obtained from hand-fitted parameters to a precision similar to expert human analysis while providing a more systematic mapping of parameter space. Our work provides a key first step toward solving the inverse scattering problem to extract effective multi-orbital models from information-dense RIXS measurements, which can be applied to a host of quantum materials. We also propose atomic model parameter sets for two materials, Ca 3⁢ LiOsO 6 and Fe 2⁢ O 3 , that were previously missing from the literature.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Machine Learning based Approach of Estimating Equivalent Circuit Model Parameters at Different SoCs of Li-ion Batteries from Voltage Relaxation

Abstract: In this study, an approach of estimating the equivalent circuit model (ECM) parameters for Li-ion batteries (LIBs) is proposed based on the voltage value at different intervals while relaxing the LIB after discharge. The typical approach for estimating ECM parameters of a LIB is to conduct electrochemical impedance spectroscopy (EIS) measurements at different frequencies and fit them to a predefined circuit model, which requires additional measuring arrangements and specialized devices. The proposed methodology utilizes four different voltages at 0s, 60s, 360s, and 1800s alongside the specific state of charge (SoC) value for a specific constant discharge current value of ~1C until the relaxation stage to train and evaluate three regression-based machine learning models— Support Vector Regression (SVR), Extreme Gradient Boosting (XGBoost), and Gaussian Process Regression (GPR)—for estimating the ECM parameters of the selected model. Bayesian optimization is employed for hyperparameter tuning to achieve optimal performance for all the regressor models, among which, the GPR provided the best performance with the root-mean-squared error (RMSE) of less than 4x10-4 on average for the resistive components and less than 0.27 for capacitive components with excellent R2 scores. The simplicity of the approach enables it to eliminate the need for sophisticated measuring equipment and computation power.

Sagar, Md. Samiul [The University of Alabama (UA)]↗

PMU-data-driven Event Classification in Power Transmission Grids

This paper presents an event classification in transmission grids. The convolutional neural network (CNN)-based classifier is proposed to capture the temporal similarity of time-synchronized data stream from phasor measurement units (PMUs). The proposed CNN is trained using Bayesian optimization to search for the best hyperparameters. The effectiveness of the proposed event classification is validated through the real-world dataset from the U.S. transmission grids. This dataset includes line outage, transformer outage, frequency, and oscillation events. The validation process also includes different PMU outputs, such as voltage magnitude, phase angle, current magnitude, frequency, and rate of change of frequency (ROCOF). The results show that ROCOF gives the best classification performance compared to other PMU outputs. In addition, it is shown that the classifier trained with a larger dataset has higher accuracy. Moreover, the superiority of the proposed method is validated through comparison with other state-of-the-art classification methods.

Niazazari, Iman↗

Automatic Extraction of Network Configurations for Realistic Simulation and Validation

Popular HPC network interconnection simulators such as SST Macro provide a variety of configurable parameters to explore the design space of hardware components such as network links and switches. While such knobs provide flexibility to explore design trade-offs for novel hardware, manually configuring simulations for existing hardware to focus on topology exploration can be cumbersome and error-prone, leading to widely inaccurate simulations. This challenge is compounded when specifications of various (proprietary) technologies are not readily available or are intentionally omitted. In this work, we provide a methodology to automatically tune the simulation configuration of the multiple network models running within SST Macro using Bayesian optimization. We perform this optimization in the context of multiple messaging regimes (i.e., small to large and latency to bandwidth-bound messages) and provide a detailed analysis of the simulation error for four systems. With our automated framework, we achieve a 5x improvement in accuracy over best-effort configurations based on available hardware specifications.

Suetterlein, Joshua D.↗

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

People commonly utilize visualizations not only to examine a given dataset, but also to draw generalizable conclusions about the underlying models or phenomena. Prior research has compared human visual inference to that of an optimal Bayesian agent, with deviations from rational analysis viewed as problematic. However, human reliance on non-normative heuristics may prove advantageous in certain circumstances. We investigate scenarios where human intuition might surpass idealized statistical rationality. In two experiments, we examine individuals’ accuracy in characterizing the parameters of known data-generating models from bivariate visualizations. Our findings indicate that, although participants generally exhibited lower accuracy compared to statistical models, they frequently outperformed Bayesian agents, particularly when faced with extreme samples. Participants appeared to rely on their internal models to filter out noisy visualizations, thus improving their resilience against spurious data. However, participants displayed overconfidence and struggled with uncertainty estimation. They also exhibited higher variance than statistical machines. Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality. These results carry implications for designing visual analytics tools, offering new perspectives on how to integrate statistical models and analyst intuition for improved inference and decision-making. The data and materials for this paper are available at https://osf.io/qmfv6

human-machine collaboration↗

A Machine Learning–Based Tire Life Prediction Framework for Increasing Life of Commercial Vehicle Tires

In the commercial freight industry, tire retreading decisions are often conservative due to limited knowledge of a tire’s remaining service life. This practice leads to increased costs and material waste. This paper proposes a machine learning–based approach for estimating tire casing life and retreadability, focusing on usage data rather than wear information. This approach could extend the tire’s lifespan and reduce landfill waste. Data integration from diverse tire casing measurement sources presents challenges, including imbalanced removal data. Our methodology addresses these challenges by using historical inspection, telematics, and finite element modeling (FEM) datasets. We introduce “Tire Casing Energy” as a comprehensive usage input and apply a Variance-Reduction Synthetic Minority Oversampling Technique (VR-SMOTE) for data imbalance rectification. A random forest model is used to estimate the state of the tire casing and the casing removal probability, with Bayesian optimization applied for hyperparameter tuning, enhancing model accuracy. Here, the proposed prediction framework is able to differentiate different truck fleets and tire locations based on their usage parameters. With the aid of this machine learning model, the importance and sensitivity of different tire usage parameters can be obtained, which is beneficial to maximize tire life.

Data balancing↗

Multivariate Testing of Sampling Techniques to Address Class Imbalance in Building Use Type Classification

This study addresses the challenges inherent in building use type classification, particularly focusing on the issue of class imbalance in the training datasets for machine learning classifiers. We comprehensively analyze the efficacy of various class-balancing sampling techniques. Employing Monte Carlo simulations and Bayesian optimization, we evaluated the performance of multiple sampling methods, including Random Oversampling, Random Undersampling, SMOTE, Borderline-SMOTE, and ADASYN, across a dataset encompassing nine southeastern coastal states of the United States. Our findings reveal that simple random over- and undersampling techniques outperform more sophisticated methods. Additionally, we show inherent value in creating an imbalance in training data to effectively train a machine learning classifier for distinguishing between residential and nonresidential buildings. This study provides valuable guidance for future research on building use type classification research and lays essential groundwork for developing attribute-rich building stock datasets.

Adams, Daniel↗

XScope

XScope finds inputs that trigger floating-point exceptions, such as NaN (not a number) and infinity, in CUDA functions using Bayesian optimization (BO). XScope assumes that the CUDA functions are a black box, i.e., the source code is not available. It searches the input space using several methods to guide BO into extreme cases. When an input is found to trigger an exception in the target CUDA function, the input is shown to the user.

Laguna Peralta, Ignacio↗

ALchemist (Active Learning Toolkit for Chemical and Materials Research) [SWR-25-102]

ALchemist is a modular Python toolkit that brings active learning and Bayesian optimization to experimental design in chemical and materials research. It is designed for scientists and engineers who want to efficiently explore or optimize high-dimensional variable spaces—without writing code—using an intuitive graphical interface.

Coatney, Caleb [National Renewable Energy Laborato↗