Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Quantum computing for heavy quarkonium spectroscopy

Here, we report a first demonstration for the application of quantum computing to heavy quarkonium spectroscopy study. Based on a Cornell-potential model for the heavy quark and antiquark system, we show how this Hamiltonian problem can be formulated and solved with the variational quantum eigensolver (VQE) approach on the IBM cloud quantum computing platform. Errors due to a global depolarizing noise channel are corrected with a zero-noise extrapolation method, resulting in good agreement with the expected value. We also generalize the VQE method for solving excited states by orthogonalization with respect to the ground state. This new approach is demonstrated to be successful for the quarkonium system on a noiseless quantum simulator and can easily be adapted for solving similar excited state problems in many other physical systems.

79 ASTRONOMY AND ASTROPHYSICS↗

Metabolic and evolutionary responses of Clostridium thermocellum to genetic interventions aimed at improving ethanol production

Engineering efforts targeted at increasing ethanol by modifying the central fermentative metabolism of Clostridium thermocellum have been variably successful. Here, we aim to understand this variation by a multifaceted approach including genomic and transcriptomic analysis combined with chemostat cultivation and high solids cellulose fermentation. Three strain lineages comprising 16 strains total were examined. Two strain lineages in which genes involved in pathways leading to organic acids and/or sporulation had been knocked out resulted in four end-strains after adaptive laboratory evolution (ALE). A third strain lineage recapitulated mutations involving adhE that occurred spontaneously in some of the engineered strains.

Biotechnology & Applied Microbiology↗

Sequential Monte Carlo for Cut-Bayesian Posterior Computation

We propose a sequential Monte Carlo (SMC) method to efficiently and accurately compute cut-Bayesian posterior quantities of interest, variations of standard Bayesian approaches constructed primarily to account for model misspecification. We prove finite sample concentration bounds for estimators derived from the proposed method along with a linear tempering extension and apply these results to a realistic setting where a computer model is misspecified. We then illustrate the SMC method for inference in a modular chemical reactor example that includes submodels for reaction kinetics, turbulence, mass transfer, and diffusion. The samples obtained are commensurate with a direct-sampling approach that consists of running multiple Markov chains, with computational efficiency gains using the SMC method. Overall, the SMC method presented yields a novel, rigorous approach to computing with cut-Bayesian posterior distributions.

97 MATHEMATICS AND COMPUTING↗

The Workforce Readiness Index: A Local and Regional Assessment Tool for Energy Sector Preparedness

Building up a workforce that is properly trained and adequately sized is essential to ensuring that the deployment of energy generation sources in the United States meets future energy demand. Workforce development to support supply chain or large infrastructure investments typically occurs at a local level. However, there is a critical gap in understanding where and to what extent regional workforces are equipped to meet the needs of an energy industry. The Workforce Readiness Index ("the index") was developed to assess and compare energy sector workforce readiness across the United States at the county level to provide granular information to various stakeholders such as industry members, state decision makers, and training program developers. Workforce readiness is defined as the ability to recruit from the general labor market, transition workers with comparable skill sets, and train a workforce using scalable or existing training programs near a specific location. Therefore, the index evaluates readiness levels based on the likelihood that a county possesses the workforce development infrastructure needed to support the occupations required by an energy-related industry or sector. Furthermore, the index offers a standardized yet flexible approach that captures regional variations and highlights local strengths and challenges.

17 WIND ENERGY↗

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗

Phyllosticta paracitricarpa is synonymous with the EU quarantine fungus P. citricarpa based on phylogenomic analyses

Phyllosticta citricarpa is an important citrus-pathogen and a quarantine organism in the European Union. Its recently described relative, P. paracitricarpa, is very closely related and not listed as a quarantine organism. P. paracitricarpa is very difficult to distinguish from P. citricarpa, since its morphological features overlap and the barcoding gene sequences that were originally used to delimit them as distinct species have a low number of species-specific polymorphisms that have subsequently been shown to overlap between the two clades. Therefore, we performed extensive genomic analyses to determine whether the genetic variation between P. citricarpa and P. paracitricarpa strains should be considered to represent infraspecific variation within P. citricarpa, or whether it is indicative of distinct species. Using a phylogenomic analysis with 3,000 single copy ortholog genes and whole-genome comparisons, we determined that the variation between P. citricarpa and P. paracitricarpa can be considered as infraspecies variation within P. citricarpa. We also determined the level of variation in mitochondrial assemblies of several Phyllosticta species and concluded there are only minimal differences between the assemblies of P. citricarpa and P. paracitricarpa. Thus, using several orthogonal approaches, we here demonstrate that variation within the nuclear and mitochondrial genomes of other Phyllosticta species is larger than variation between genomes obtained from P. citricarpa and P. paracitricarpa strains. Thus, P. citricarpa and P. paracitricarpa should be considered as conspecific.

59 BASIC BIOLOGICAL SCIENCES↗

Unsupervised machine learning discovery of structural units and transformation pathways from imaging data

We show that unsupervised machine learning can be used to learn chemical transformation pathways from observational Scanning Transmission Electron Microscopy (STEM) data. To enable this analysis, we assumed the existence of atoms, a discreteness of atomic classes, and the presence of an explicit relationship between the observed STEM contrast and the presence of atomic units. With only these postulates, we developed a machine learning method leveraging a rotationally invariant variational autoencoder (VAE) that can identify the existing molecular fragments observed within a material. The approach encodes the information contained in STEM image sequences using a small number of latent variables, allowing the exploration of chemical transformation pathways by tracing the evolution of atoms in the latent space of the system. The results suggest that atomically resolved STEM data can be used to derive fundamental physical and chemical mechanisms involved, by providing encodings of the observed structures that act as bottom-up equivalents of structural order parameters. The approach also demonstrates the potential of variational (i.e., Bayesian) methods in the physical sciences and will stimulate the development of more sophisticated ways to encode physical constraints in the encoder–decoder architectures and generative physical laws and causal relationships in the latent space of VAEs.

97 MATHEMATICS AND COMPUTING↗

Chemical degradation of fly ash blended concrete with the seasonal variation of rainwater in a radioactive waste repository: A thermodynamic modeling approach

Highlights: • The thermodynamic model for the cementitious system was successfully developed. • The chemical degradation of concrete was greatly affected by rainwater types. • Inorganic carbon species in rainwater reduced the chemical resistance of concrete. • The durability of concrete to rainwater decreased with increasing fly ash content. This study presents a long-term degradation behavior of fly ash blended concrete in a vault type low- and intermediate-level radioactive waste (LILW) repository by thermodynamic equilibrium calculations using PHREEQC combined with CEMDATA18 database. Since rainwater plays a predominant role as leachate for the concrete waste container in the repository, the effect of chemical properties of seasonal rainwater on the chemical degradation of concrete was analyzed. In addition, the impact of the blending with fly ash on the chemical degradation was evaluated through a gradual replacement of ordinary Portland cement (OPC) by fly ash. Regardless of the replacement level, autumn rainwater showed the greatest influence on the concrete degradation owing to the presence of inorganic carbon species, which induce the carbonation. The resistance of concrete to chemical degradation by rainwater was persistently reduced due to the decreasing formation of portlandite and calcium silicate hydrate (C-S-H) with increasing replacement level.

36 MATERIALS SCIENCE↗

A variational multiscale immersed meshfree method for heterogeneous materials

Abstract We introduce an immersed meshfree formulation for modeling heterogeneous materials with flexible non-body-fitted discretizations, approximations, and quadrature rules. The interfacial compatibility condition is imposed by a volumetric constraint, which avoids a tedious contour integral for complex material geometry. The proposed immersed approach is formulated under a variational multiscale based formulation, termed the variational multiscale immersed method (VMIM). Under this framework, the solution approximation on either the foreground or the background can be decoupled into coarse-scale and fine-scale in the variational equations, where the fine-scale approximation represents a correction to the residual of the coarse-scale equations. The resulting fine-scale solution leads to a residual-based stabilization in the VMIM discrete equations. The employment of reproducing kernel (RK) approximation for the coarse- and fine-scale variables allows arbitrary order of continuity in the approximation, which is particularly advantageous for modeling heterogeneous materials. The effectiveness of VMIM is demonstrated with several numerical examples, showing accuracy, stability, and discretization efficiency of the proposed method.

36 MATERIALS SCIENCE↗

A Block-Structured Adaptive Mesh Framework to Solve Radiation Transfer Equation in Irregular Embedded Geometries

Radiation transport arises in various scientific, industrial, and medical fields, and understanding its effect in applications is needed to make accurate predictions, safety assessments and performance optimizations. Solving the Radiation Transport Equation (RTE) is challenging due to its integro-differential nature, which involves both differential and integral terms. The differential term describes the change in radiation intensity due to absorption and emission, while the integral term accounts for scattering. The accurate modeling of radiation is further complicated in many applications due to the complex, irregular geometries. Various methods exist for solving the RTE, including the zonal, Monte Carlo, spherical harmonics, discrete ordinates, and finite volume methods. Traditional mesh-based approaches, which rely on structured or unstructured meshes, struggle with irregular geometries due to: a) the difficulty of conforming structured grids to irregular domains, b) challenges in enforcing boundary conditions correctly, and c) the additional computational cost of unstructured mesh methods. This work presents a second-order accurate method for solving the RTE in irregular geometries. The radiation intensity is discretized using the finite-volume method in both spatial and angular directions on regular Cartesian grid blocks. Leveraging the block-structured adaptive mesh refinement (AMR) framework provided by AMReX, our method refines the grid locally to reduce spatial discretization error, ensuring a converged numerical solution while minimizing computational costs elsewhere. A two-stage deferred correction approach is employed: First, a first-order discretization on grid blocks is solved using an algebraic multigrid method in HYPRE. Second, a correction term is applied explicitly to achieve second-order accuracy. The correction term is calculated by approximating the radiation flux on cell faces using a Total Variation Diminishing (TVD) scheme. This approach ensures quick convergence of the multigrid method while preserving higher-order accuracy of the numerical solution. Irregular geometries are resolved as embedded boundaries (EB), resulting in both cut cells and regular cells. In cut cells, we modify the fluxes using face fractions and incorporate additional contributions from EB boundary conditions. To ensure higher-order convergence near the EB interface, the correction term is modified by interpolating the radiation intensity to fictitious ghost points. The implementation takes advantage of modern supercomputers by leveraging AMReX’sMPI/X parallelization strategy where X can be MPI or a GPU accelerator including CUDA, HIP and DPC++. We validate our solver using classical test cases, both with and without EB, demonstrating accuracy and efficiency. Additionally, we analyze the impact of adaptive mesh refinement on solution accuracy and computational cost, highlighting the advantages of our approach for high-resolution radiation transport simulations.

computational fluid dynamics (CFD)↗

Adaptive autoencoder latent space tuning for more robust machine learning beyond the training set for six-dimensional phase space diagnostics of a time-varying ultrafast electron-diffraction compact accelerator

In this work, we present a general adaptive latent space tuning approach for improving the robustness of machine learning tools with respect to time variation and distribution shift. We demonstrate our approach by developing an encoder-decoder convolutional neural network-based virtual 6D phase space diagnostic of charged particle beams in the HiRES ultrafast electron diffraction (UED) compact particle accelerator with uncertainty quantification. Our method utilizes model-independent adaptive feedback to tune a low dimensional 2D latent space representation of ~1 million dimensional objects which are the 15 unique 2D projections (x, y),...,(z, p z ) of the 6D phase space (x, y, z, p x , p y , p z ) of the charged particle beams. We demonstrate our method with numerical studies of short electron bunches utilizing experimentally measured UED input beam distributions.

43 PARTICLE ACCELERATORS↗

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services

Flexible loads have great potential to improve the electric grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. This paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environmental impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

61 RADIATION PROTECTION AND DOSIMETRY↗

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services: Preprint

Flexible loads have great potential to improve the power grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. The paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environment impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

control↗

Extending Parsimonious Bayesian Inference

Parsimonious Bayesian inference is a theoretical framework for efficient data assimilation that seeks to balance increased consistency between predictions and training data against corresponding increases in model complexity. Within this framework, over-training is understood as optimization that encodes excessive information within model parameters while only achieving small improvements between predictions and training data. This project aims to develop practical methods of limiting excess model information during optimization. One key observation is that practical heuristics for parsimonious learning in high-dimensions must balance expressivity, i.e. the ability of the model to capture diverse predictions with only a few non-zero parameters, against discoverability, i.e. the ability to train the model with gradient-based optimization and drive parameters to low information states. As such, we developed logical activation functions that are able to adaptively approximate arbitrary truth tables that define Boolean logic operations within a probabilistic framework. These functions have demonstrated the ability to learn exclusive disjunction (XOR) and conditioned disjunction (if [condition] then [result_if_true] else [result_if_false]) within a single layer of a neural network. To efficiently exploit these activation functions to drive parsimonious learning required several other advances within the domain of variational inference. The most efficient form of complexity suppression is structured sparsification, driving most model parameters to zero while achieving the structural coherence among nonzeros needed for bandwidth reduction. Such models are not only far more efficient at suppressing information-theoretic complexity, they also reduce the other forms of complexity (computations, communication, storage, and the number of dependencies needed to evaluate predictions). Aiming to support enhanced sparsification, this project examined new approaches to high-dimensional variational inference that allow us to calibrate and control parameter uncertainty during optimization. By identifying which parameters can sustain sparsifying perturbations with little impact on prediction quality, we can develop better pruning strategies by framing them as approximate Bayesian inference. These advances also open paths to mitigate concerns with deploying advanced learning methods in resource-constrained environments, such as running models on power-limited or communication-limited devices.

97 MATHEMATICS AND COMPUTING↗

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗

Gutzwiller hybrid quantum-classical computing approach for correlated materials

Rapid progress in noisy intermediate-scale quantum (NISQ) computing technology has led to the development of novel resource-efficient hybrid quantum-classical algorithms, such as the variational quantum eigensolver (VQE), that can address open challenges in quantum chemistry, physics, and material science. Proof-of-principle quantum chemistry simulations for small molecules have been demonstrated on NISQ devices. While several approaches have been theoretically proposed for correlated materials, NISQ simulations of interacting periodic models on current quantum devices have not yet been demonstrated. Here, we develop a hybrid quantum-classical simulation framework for correlated electron systems based on the Gutzwiller variational embedding approach. We implement this framework on Rigetti quantum processing units (QPUs) and apply it to the periodic Anderson model, which describes a correlated heavy electron band hybridizing with noninteracting conduction electrons. Our simulation results quantitatively reproduce the known ground state quantum phase diagram including metallic, Kondo and Mott insulating phases. This is the first fully self-consistent hybrid quantum-classical simulation of an infinite correlated lattice model executed on QPUs, demonstrating that the Gutzwiller hybrid quantum-classical embedding framework is a powerful approach to simulate correlated materials on NISQ hardware. This benchmark study also puts forth a concrete pathway towards practical quantum advantage on NISQ devices.

36 MATERIALS SCIENCE↗

Invariant discovery of features across multiple length scales: Applications in microscopy and autonomous materials characterization

Physical imaging is a foundational characterization method in areas from condensed matter physics and chemistry to astronomy and spans length scales from atomic to universe. Images encapsulate crucial data regarding atomic bonding, materials microstructures, and dynamic phenomena such as microstructural evolution and turbulence, among other phenomena. The challenge lies in effectively extracting and interpreting this information. Variational Autoencoders (VAEs) have emerged as powerful tools for identifying the underlying factors of variation in image data, providing a systematic approach to distilling meaningful patterns from complex data sets. However, a significant hurdle in their application is the definition and selection of appropriate descriptors reflecting local structures. Here, we introduce the scale-invariant VAE approach (SI-VAE) based on the progressive training of the VAE with the descriptors sampled at different length scales. The SI-VAE allows the discovery of the length scale-dependent factors of variation in the system. Here, we illustrate this approach using the ferroelectric domain images and generalize it to the movies of the electron-beam induced phenomena in graphene and topography evolution across combinatorial libraries. This approach can further be used to initialize the decision making in automated experiments including structure–property discovery and can be applied across a broad range of imaging methods. This approach is universal and can be applied to any spatially resolved data including both experimental imaging studies and simulations, and can be particularly useful for exploration of phenomena such as turbulence and scale-invariant transformation fronts.

36 MATERIALS SCIENCE↗