Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Vibroacoustic Tailoring of a Rod-Stiffened Composite Fuselage Panel with Multidisciplinary Considerations

An efficient multi-objective design tailoring procedure seeking to improve the vibroacoustic performance of a fuselage panel while maintaining or reducing weight is presented. The structure considered is the pultruded rod stitched efficient unitized structure, a highly integrated composite structure concept designed for a noncylindrical, next-generation flight vehicle fuselage. Modifications to a baseline design are evaluated within a six-parameter design space including spacing, flange width, and web height for both frame and stringer substructure components. The change in sound power radiation attributed to a design change is predicted using finite-element models sized and meshed for analyses in the 500 Hz, 1 kHz, and 2 kHz octave bands. Three design studies are carried out in parallel while considering a diffuse acoustic field excitation and two types of turbulent boundary-layer excitation. Kriging surrogate models are used to reduce the computational costs of resolving the vibroacoustic and weight objective Pareto fronts. The resulting Pareto optimal designs are then evaluated under a static pressurization ultimate load to assess structural strength and stability. Results suggest that choosing alternative configurations within the considered design space can reduce weight and improve vibroacoustic performance without compromising strength and stability of the structure under the static load condition considered, but the tradeoffs are significantly influenced by the spatial characteristics of the assumed excitation field.

Allen, Albert R.↗

Bayesian optimization algorithms for accelerator physics

Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques toward solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

Deep learning-accelerated 3D carbon storage reservoir pressure forecasting based on data assimilation using surface displacement from InSAR

Fast forecasting of the reservoir pressure distribution during geologic carbon storage (GCS) by assimilating monitoring data is a challenging problem. Due to high drilling cost, GCS projects usually have spatially sparse measurements from few wells, leading to high uncertainties in reservoir pressure prediction. To address this challenge, we use low-cost Interferometric Synthetic-Aperture Radar (InSAR) data as monitoring data to infer reservoir pressure build up. We develop a deep learning-accelerated workflow to assimilate surface displacement maps interpreted from InSAR and to forecast dynamic reservoir pressure. Employing an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates three-dimensional (3D) geologic properties and predicts reservoir pressure with quantified uncertainties. We use a synthetic commercial-scale GCS model with bimodally distributed permeability and porosity to demonstrate the efficacy of the workflow. A two-step CNN-PCA approach is employed to parameterize the bimodal fields. The computational efficiency of the workflow is boosted by two residual U-Net based surrogate models for surface displacement and reservoir pressure predictions, respectively. The workflow can complete data assimilation and reservoir pressure forecasting in half an hour on a personal computer.

25 ENERGY STORAGE↗

Orthorhombic Structures as Inorganic Halide Perovskite Models for High-Throughput DFT Investigations

Although high-symmetry Pm-3m space group cubic models are computationally efficient for high-throughput density functional theory (DFT) calculations of inorganic ternary (ABX 3 ) halide perovskites (HPs), they frequently predict band gaps (E g ) that disagree with experiment. Conversely, while low-symmetry cubic polymorphous networks (PN) comprised of 160 to 320 atoms incur significantly greater computational cost, they predict E g ’s that are more closely aligned with experiment. Here, in this study, we compare the DFT total energies and E g ’s predicted by four high-symmetry structure models (Pnma orthorhombic, R3m trigonal, P4/mbm tetragonal, and Pm-3m cubic) to cubic PNs for 5 experimentally characterized ternary HPs and find that the orthorhombic model computes Eg’s with the smallest MAD of 0.23 eV relative to the PNs. Pair distribution functions and DFT-computed total energies show that octahedral tilting, which is present in the 20-atom orthorhombic and 160-atom cubic PN models but not in the 5-atom cubic models, stabilizes all 5 compositions in our benchmarking set. We also find that imposing PN constraints when generating and optimizing these orthorhombic structures by fixing the unit cell lattice vectors and displacing the atoms prior to ionic relaxation with DFT, which we call the orthorhombic surrogate model (OSM), lowers the MAD of E g predictions to 0.09 eV. Our OSM predicts the PN band gaps of an additional 95 theoretical inorganic ternary HPs with MAD of 0.08 eV, supporting its usage in high-throughput DFT investigations to closely estimate PN band gaps with much less computational expense.

14 SOLAR ENERGY↗

Multitask methods for predicting molecular properties from heterogeneous data

Data generation remains a bottleneck in training surrogate models to predict molecular properties. We demonstrate that multitask Gaussian process regression overcomes this limitation by leveraging both expensive and cheap data sources. In particular, we consider training sets constructed from coupled-cluster (CC) and density functional theory (DFT) data. We report that multitask surrogates can predict at CC-level accuracy with a reduction in data generation cost by over an order of magnitude. Of note, our approach allows the training set to include DFT data generated by a heterogeneous mix of exchange–correlation functionals without imposing any artificial hierarchy on functional accuracy. More generally, the multitask framework can accommodate a wider range of training set structures—including the full disparity between the different levels of fidelity—than existing kernel approaches based on Δ-learning although we show that the accuracy of the two approaches can be similar. Consequently, multitask regression can be a tool for reducing data generation costs even further by opportunistically exploiting existing data sources.

Chemistry↗

Deep Learning Emulation of Subgrid-Scale Processes in Turbulent Shear Flows

Deep neural networks (DNNs) are developed from a data set obtained from the dynamic Smagorinsky model to emulate the subgrid-scale (SGS) viscosity (ν sgs ) and diffusivity (κ sgs ) for turbulent stratified shear flows encountered in the oceans and the atmosphere. These DNNs predict ν sgs and κ sgs from velocities, strain rates, and density gradients such that the evolution of the kinetic energy budget and density variance budget terms is similar to the corresponding values obtained from the original dynamic Smagorinsky model. These DNNs also compute ν sgs and κ sgs ~2–4 times quicker than the dynamic Smagorinsky model resulting in a ~2–2.5 times acceleration of the entire simulation. This study demonstrates the feasibility of deep learning in emulating the subgrid-scale (SGS) phenomenon in geophysical flows accurately in a cost-effective manner. In a broader perspective, deep learning-based surrogate models can present a promising alternative to the traditional parameterizations of the subgrid-scale processes in climate models.

58 GEOSCIENCES↗

Variance Decomposition of MEDLI2 Reconstructed Heating Using Neural Networks

The Mars Entry, Descent, and Landing Instrumentation (MEDLI2) sensor suite collected data during entry of the Mars 2020 Perseverance rover into Mars’ atmosphere. This suite included a network of MEDLI2 Instrumented Sensor Plugs (MISPs). Each MISP was comprised of a cylinder made of Thermal Protection System (TPS) material with 1-3 embedded thermocouples (TCs), and it was flush mounted into the heatshield or backshell. Data from these in-depth TCs were used to reconstruct the aeroheating environment of the vehicle throughout entry. Surface heating was posed as an inverse problem, with the goal of estimating the surface heating by minimizing an objective function of the difference between MISP temperature measurements during flight and the temperature predictions derived from the Fully Implicit Ablation and Thermal response (FIAT) program. Given an aerothermal environment, FIAT calculates the material response and provides in-depth temperatures throughout the TPS material. To achieve the reverse, an internal tool called FIAT_Opt runs through multiple different environments until the output temperature at the TC depth closely matches the flight data. 95% confidence intervals on the reconstructed surface heating were obtained using Monte Carlo analysis, in which uncertainties in the thermocouple depth and the TPS material properties (e.g., density, thermal conductivity, heat capacity, emissivity) based on flight-lot material testing were included. A variance decomposition method using Sobol indices was employed to assess the sensitivity of the reconstructed peak heating to the TC placement and material property uncertainties. Variance decomposition was found to require tens of thousands of FIAT_Opt runs in order for the Sobol indices to converge. With a single FIAT_Opt run taking on the order of 40 minutes, the required number of computations would take months to complete, even if using multiple CPUs. To mitigate this problem, three machine learning models (ridge regression with cross-validation, random forest regression, and a deep neural network) were trained and tested using the 2000 Monte Carlo runs that were already completed. A subset of 1600 runs were used to train the model (i.e., training set), while the remaining 400 runs were used as the test set. The predictions from the deep neural network (DNN) on the test set showed nearly perfect agreement to the actual values computed with FIAT_Opt (R2 > 0.99). Using the DNN as a surrogate model, the variance decomposition using 50,000 runs was completed within minutes. The resulting Sobol indices showed that the reconstructed peak surface heating was most sensitive to the uncertainties in the thermal conductivity (ST = 0.37) and heat capacity (ST = 0.26). This method can be leveraged to provide requirements for material property measurements needed to improve the accuracy of surface heating prediction and ultimately lead to the reduction of design margins in the future. This presentation will include background on the MEDLI2 suite; the method used for inverse heating estimation; the way that material property uncertainties were accounted for using Monte Carlo analysis; a brief background on variance decomposition; the motivation for using machine learning in this context; how a neural network was trained on the data to enable variance decomposition in a fraction of the time; and the variance decomposition results for one of the MISPs.

Hannah Alpert↗

Latent space mapping: Revolutionizing predictive models for divertor plasma detachment control

The inherent complexity of boundary plasma, characterized by multi-scale and multi-physics challenges, has historically restricted high-fidelity simulations to scientific research due to their intensive computational demands. Consequently, routine applications such as discharge control and scenario development have relied on faster but less accurate empirical methods. This work introduces DivControlNN, a novel machine-learning-based surrogate model designed to address these limitations by enabling quasi-real-time predictions (i.e., ~ 0.2 ms) of boundary and divertor plasma behavior. Trained on over 70,000 2D UEDGE simulations from KSTAR tokamak equilibria, DivControlNN employs latent space mapping to efficiently represent complex divertor plasma states, achieving a computational speed-up of over 10 8 compared to traditional simulations while maintaining a relative error below 20% for key plasma property predictions. During the 2024 KSTAR experimental campaign, a prototype detachment control system powered by DivControlNN successfully demonstrated detachment control on its first attempt, even for a new tungsten divertor configuration and without any fine-tuning. These results highlight the transformative potential of DivControlNN in overcoming diagnostic challenges in future fusion reactors by providing fast, robust, and reliable predictions for advanced integrated control systems.

Artificial neural networks↗

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗

High-Performance Simulation of Dynamic Hydrologic Exchange and Implications for Surrogate Flow and Reactive Transport Modeling in a Large River Corridor

Hydrologic exchange flows (HEFs) have environmental significance in riverine ecosystems. Key river channel factors that influence the spatial and temporal variations of HEFs include river stage, riverbed morphology, and riverbed hydraulic conductivity. However, their impacts on HEFs were often evaluated independently or on small scales. In this study, we numerically evaluated the combined interactions of these factors on HEFs using a high-performance simulator, PFLOTRAN, for subsurface flow and transport. The model covers 51 square kilometers of a selected river corridor with large sinuosity along the Hanford Reach of the Columbia River in Washington, US. Three years of spatially distributed hourly river stages were applied to the riverbed. Compared to the simulation when riverbed heterogeneity is not ignored, the simulation using homogeneous riverbed conductivity underestimated HEFs, especially upwelling from lateral features, and overestimated the mean residence times derived from particle tracking. To derive a surrogate model for the river corridor, we amended the widely used transient storage model (TSM) for riverine solute study at reach scale with reactions. By treating the whole river corridor as a batch reactor, the temporal changes in the exchange rate coefficient for the TSM were derived from the dynamic residence time estimated from the hourly PFLOTRAN results. The TSM results were evaluated against the effective concentrations in the hyporheic zone calculated from the PFLOTRAN simulations. Our results show that there is potential to parameterize surrogate models such as TSM amended with biogeochemical reactions while incorporating small-scale process understandings and the signature of time-varying streamflow to advance the mechanistic understanding of river corridor processes at reach to watershed scales. However, the assumption of a well-mixed storage zone for TSM should be revisited when redox-sensitive reactions in the storage zones play important roles in river corridor functioning.

Fang, Yilin↗

A deep learning-based Bayesian framework for high-resolution calibration of building energy models

Calibrating building energy models (BEMs), i.e., closing discrepancy between modeling and field measurements, is of significance to support its applications in building sustainability and resilience analysis. However, as being widely used in practice, current Bayesian calibration is mostly performed in low-resolution (annual or monthly), instead of high-resolution (hourly or sub-hourly), which is crucial to support emerging BEM applications, such as building-renewable energy integration (demand response) and smart control. This is attributable to the gaps in current Bayesian calibration process, including (1) difficulty in supporting reliable high-resolution calibration with over-parameterization and multi-solution issues, (2) inadequacy of meta-model to capture temporal building dynamics in high-resolution, and (3) excessive computational burdens of covariance matrix calculation in Bayesian inference. Therefore, to close these gaps, this research proposes a novel deep learning-based Bayesian calibration framework, involving pre-calibration mechanism, Long Short-Term Memory as surrogate models, and simplified covariance matrix calculation, to calibrate BEMs in high temporal resolution (i.e., hourly) with enhanced accuracy and computational efficiency. Finally, the case study demonstrates its effectiveness to match modeling outcomes with measurements and realize CV-RMSE of < 30 % and NMBE of < 6 % in hourly resolution, as well as a significant reduction of calibration time (by > 99 %, from > 600 h to ~ 1.5 h).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Coupling High-Throughput Experiments and Regression Algorithms to Optimize PGM-Free ORR Electrocatalyst Synthesis

Over the past decades, significant improvement has been achieved in the performance of platinum group metal-free (PGM-free) materials as an alternative to Pt-based electrocatalysts for oxygen reduction reaction (ORR). However, further progress in ORR activity requires evaluation of precursors and synthesis approaches. In response to this challenge, we generated a first of its kind experimental data set of 36 samples using high-throughput synthesis and activity measurements. Several control parameters (e.g., Fe precursor identity, the precursor content, and pyrolysis temperature) were varied. We then developed several state-of-the-art machine learning (ML) based regression models to predict ORR activity, dependent on selected synthesis variables. Through an iterative algorithm, higher prediction accuracy (smaller root-mean-square error) was achieved. We identified that gradient boosting regression (GBR) and support vector regression (SVR), among several methods, work best for this data set. Aided by our ML-based surrogate models, we decided to alter catalyst synthesis conditions, which resulted in a 36% increase in measured ORR activity in comparison to the maximum ORR mass activity value of 21.9 A/g catalyst in the original data set. Overall, this combined experiment and machine learning approach represents a promising path forward toward developing highly efficient next-generation ORR electrocatalysts and, more generally, functional materials.

25 ENERGY STORAGE↗

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗

Physically Realistic Estimates of Electric Water Heater Demand Response Resource

Multiple grid integration studies have examined the value of demand response, including from water heaters, to bulk power systems. Common shortcomings of these studies include physically unrealistic assumptions. For example, studies often assume that all electric water heater load can be shed for up to an hour to provide capacity or contingency service, that all electric water heater load is shiftable, and that round-trip efficiencies for shifting service are 100%. Another issue is that simply summing up estimates of individual water heaters' flexibility bounds, an attractive idea for constructing the MW-scale resources necessary for direct inclusion in grid investment and operational models, can result in significant overestimates of actual resource, because, e.g., a water heater with the ability to reduce load may not be able sustain the reduction for as long as the aggregate model suggests is possible. This presentation demonstrates the impact of estimating the flexibility of electric water heaters with physically realistic models suitable for grid service analysis. Electric water heater flexibility representations are constructed based on ResStock simulations of New England. Specifically, we examine contingency resource (related to capacity, shed, and contingency reserve services) and energy shifting resource from electric resistance and heat pump water heaters. Different estimation methods are compared; and the surrogate models' event responses are validated against events directly simulated in EnergyPlus. We also demonstrate the impact of using electric water heaters for contingency reserves and energy shifting in detailed models of possible future ISO New England power systems.

building energy modeling↗

Techno-Economic Evaluation of Electrified Vehicle Options in Drayage Fleets

The electrification of drayage fleets offers potential economic and operational benefits, but the financial viability of electrified vehicles remains sensitive to battery cost, energy price, and fleet usage patterns. While total cost of ownership (TCO) is a useful benchmark, fleet operators and investors are equally concerned with investment performance metrics such as payback period (PB) and Internal Rate of Return (IRR), which better reflect financial risks and investment return timelines. This study develops a unified techno-economic framework that jointly evaluates TCO, PB, and IRR to determine when electrified trucks become cost-effective alternatives to diesel trucks. Building on a previously developed cost modeling tool and using real-world telematics data from a Class 8 drayage fleet at the Port of Savannah, the analysis incorporates projected battery cost trajectories, electricity and diesel price trends, vehicle efficiency improvements, and multiple battery capacities. Parameter ranges reflect widely cited projections and observed drayage-duty-cycle variability. A surrogate-modeling method approximates economic performance across thousands of battery cost–electricity price combinations, enabling high-resolution identification of conditions that achieve TCO parity, acceptable PB thresholds, and target IRR levels. Additionally, the study estimates the evolving share of the fleet that can feasibly electrify over time under multiple economic metrics. This integrated framework offers a novel, data-driven approach to inform risk-aware decision-making for fleet electrification and supports investment planning under evolving cost and operational conditions.

Sun, Ruixiao [ORNL] (ORCID:0000000341768676)↗

Dispersion-enhanced sequential batch sampling for adaptive contour estimation

In computer simulation and optimal design, sequential batch sampling offers an appealing way to iteratively stipulate optimal sampling points based upon existing selections and efficiently construct surrogate modeling. Nonetheless, the issue of near duplicates poses tremendous quandary for sequential learning. It refers to the situation that selected critical points cluster together in each sampling batch, which are individually but not collectively informative towards the optimal design. Near duplicates severely diminish the computational efficiency as they barely contribute extra information towards update of the surrogate. To address this issue, we impose a dispersion criterion on concurrent selection of sampling points, which essentially forces a sparse distribution of critical points in each batch, and demonstrate the effectiveness of this approach in adaptive contour estimation. Specifically, we adopt Gaussian process surrogate to emulate the simulator, acquire variance reduction of the critical region from new sampling points as a dispersion criterion, and combine it with the modified expected improvement (EI) function for critical batch selection. The critical region here is the proximity of the contour of interest. This proposed approach is vindicated in numerical examples of a two-dimensional four-branch function, a four-dimensional function with a disjoint contour of interest and a time-delay dynamic system.

97 MATHEMATICS AND COMPUTING↗

Neural network-based model of galaxy power spectrum: fast full-shape galaxy power spectrum analysis

ABSTRACT We present a neural network-based emulator for the galaxy redshift-space power spectrum that enables several orders of magnitude acceleration in the galaxy clustering parameter inference, while preserving 3$\sigma$ accuracy better than 0.5 per cent up to $k_{\mathrm{max}}$ = 0.25 $\, h\text{Mpc}^{-1}$ within Lambda-cold dark matter ($\Lambda$CDM) and around 0.5 per cent $w_0$–$w_a$CDM. Our surrogate model only emulates the galaxy bias-invariant terms of one-loop perturbation theory predictions, these terms are then combined analytically with galaxy bias terms, counter-terms, and stochastic terms in order to obtain the non-linear redshift-space galaxy power spectrum. This allows us to avoid any galaxy bias prescription in the training of the emulator, which makes it more flexible. Moreover, we include the redshift $z \in [0,1.4]$ in the training which further avoids the need for re-training the emulator. We showcase the performance of the emulator in recovering the cosmological parameters of $\Lambda$CDM by analysing the suite of 25 AbacusSummit simulations that mimic the Dark Energy Spectroscopic Instrument luminous red galaxies at $z=0.5$ and 0.8, together as the emission line galaxies at $z=0.8$. We obtain similar performance in all cases, demonstrating the reliability of the emulator for any galaxy sample at any redshift in $0 \lt z \lt 1.4$. We will make our emulator public at github repository.

Trusov, Svyatoslav (ORCID:0000000224146720)↗

High-Dimensional Bayesian Optimization via Semi-Supervised Learning with Optimized Unlabeled Data Sampling

We introduce a novel semi-supervised learning approach, named Teacher-Student Bayesian Optimization (TSBO ), integrating the teacher-student paradigm into BO to minimize expensive labeled data queries for the first time. TSBO incorporates a teacher model, an unlabeled data sampler, and a student model. The student is trained on unlabeled data locations generated by the sampler, with pseudo labels predicted by the teacher. The interplay between these three components implements a unique selective regularization to the teacher in the form of student feedback. This scheme enables the teacher to predict high-quality pseudo labels, enhancing the generalization of the GP surrogate model in the search space. To fully exploit TSBO , we propose two optimized unlabeled data samplers to construct effective student feedback that well aligns with the objective of Bayesian optimization. Furthermore, we quantify and leverage the uncertainty of the teacher-student model for the provision of reliable feedback to the teacher in the presence of risky pseudo-label predictions. TSBO demonstrates significantly improved sample-efficiency in several global optimization tasks under tight labeled data budgets. The implementation is available at https://github.com/reminiscenty/TSBO-Official.

Yin, Yuxuan↗