Engineering PapersSearch

SEARCH · Engineering Papers

Results for “HMC”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Automated tuning for HMC mass ratios

We extended previous work on tuning HMC parameters using gradient information to include Hasenbusch mass ratios. The inclusion of mass ratios adds many more parameters that need to be tuned, and also allows for lots of variations in the choice of integrator pattern. We investigate the effectiveness of automatically tuning a large number of HMC parameters and compare the optimally tuned versions over a range of integrator variants.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference

Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they often suffer from overfitting due to their large number of parameters. Kolmogorov-Arnold networks (KANs) offer an alternative solution with fewer parameters. However, gradient-based inference methods, such as Hamiltonian Monte Carlo (HMC), may result in computational inefficiency when applied to KANs, especially for large-scale datasets, due to the high cost of back-propagation. To address these challenges, we propose a novel approach, combining the dropout Tikhonov ensemble Kalman inversion (DTEKI) with Chebyshev KANs. This gradient-free method effectively mitigates overfitting and enhances numerical stability. In addition, we incorporate the active subspace method to reduce the parameter-space dimensionality, allowing us to improve the accuracy of predictions and obtain more reliable uncertainty estimates. Extensive experiments demonstrate the efficacy of our approach in various test cases, including scenarios with large datasets and high noise levels. Our results show that the new method achieves comparable or better accuracy, much higher efficiency as well as stability compared to HMC, in addition to scalability. Moreover, by leveraging the low-dimensional parameter subspace, our method preserves prediction accuracy while substantially reducing further the computational cost.

97 MATHEMATICS AND COMPUTING

Mechanical, Electrochemical & Thermal Modeling of Electric Vehicle Batteries for Crash Simulation (CRADA CRD-19-00811 Final Report)

Under the proposed effort in partnership with Hyundai Motor Company (HMC), the National Laboratory of the Rockies (NLR) will cooperate with HMC to develop mathematical models for battery cells and modules for simulating abuse response in batteries subject to the type of mechanical crushing that can occur in a full motor vehicle crash.

33 ADVANCED PROPULSION SYSTEMS

Mechanical, Electrochemical & Thermal Models - Training (CRADA CRD-19-00798 Final Report)

Under the proposed effort in partnership with Hyundai Motor Company (HMC), the National Renewable Energy Laboratory (NLR) will host Dr. Jaeyoung Lim from HMC for a period of one year to jointly develop mathematical models for battery cells and modules subject to mechanical crush. NLR will assist with the development of mathematical models that Dr. Lim will incorporate into his research effort on new concepts of mobility with electric vehicles.

33 ADVANCED PROPULSION SYSTEMS

E-PINNs: Epistemic Physics-Informed Neural Networks

Physics-informed neural networks (PINNs) have demonstrated promise as a framework for solving forward and inverse problems involving partial differential equations. Despite recent progress in the field, it remains challenging to quantify uncertainty in these networks. While techniques such as Bayesian PINNs (B-PINNs) provide a principled approach to capturing epistemic uncertainty through Bayesian inference, they can be computationally expensive for large-scale applications. In this work, we propose Epistemic Physics-Informed Neural Networks (E-PINNs), a framework that uses a small network, the epinet, to efficiently quantify epistemic uncertainty in PINNs. The proposed approach works as an add-on to existing, pre-trained PINNs with a small computational overhead. We demonstrate the applicability of the proposed framework in various test cases and compare the results with B-PINNs using Hamiltonian Monte Carlo (HMC) posterior estimation and dropout-equipped PINNs (Dropout-PINNs). In our experiments, E-PINNs achieve calibrated coverage with competitive sharpness at substantially lower cost. We demonstrate that when B-PINNs produce narrower bands, they under-cover in our tests. E-PINNs also show better calibration than Dropout-PINNs in these examples, indicating a favorable accuracy-efficiency trade-off.

AI for Science

A comprehensive study on two types of supercapacitor composite electrodes comprising MnO 2 and activated carbon nanofibers: Self-supporting membrane and ground powder

Manganese dioxide (MnO 2 )@carbon composites have been attractively considered as electrode materials for supercapacitors (SCs) due to synergistic effects. This work systematically investigated the structure of MnO 2 @carbon nanofiber (CNF) composite electrodes with the different forms of CNFs and the corresponding electrochemical performance of SCs. In brief, novel activated carbon nanofibers were first fabricated by electrospinning the hydroxyl-containing poly(amic acid) solution, and then the preferred CNF material was decorated by MnO 2 crystals in the form of self-supporting membrane and ground powders, respectively. Additionally, the synthesis parameters were investigated and optimized based on the electrochemical performance of SCs. The results reveal that the powdered composite electrode exhibits a higher specific surface area of 501 m 2 g –1 compared to the self-supporting membrane composite electrode under the same conditions, resulting in a promising specific capacity of 214.1 mAh g –1 (770.8 Fg –1 ) in 6M KOH solution at 0.5 A g –1 . In addition, the capacitance of the symmetrical SC device assembled by G-HMC-1:3–80 reaches 179.8 Fg –1 , coupled with an energy density of 24.86 Whkg –1 at 230 Wkg –1 power density. This work provides valuable hints for designing SC composite electrode materials with outstanding performance.

25 ENERGY STORAGE

Evaluating the limitations of Bayesian metabolic control analysis

Bayesian Metabolic Control Analysis (BMCA) is a promising framework for inferring metabolic control coefficients in data-limited scenarios, combining Bayesian inference with linear-logarithmic (lin-log) rate laws. These metabolic control coefficients quantify how changes in enzyme activities affect steady-state fluxes and metabolite concentrations across a metabolic network. However, its predictive accuracy and limitations remain underexplored. This study systematically evaluates BMCA’s ability to infer elasticity values, flux control coefficients (FCC), and concentration control coefficients (CCC) under varying data availability conditions using three synthetic metabolic network models. We demonstrate that BMCA predictions are highly dependent on the inclusion of flux and enzyme concentration data, with the omission of these datasets leading to severe inaccuracies. In our synthetic, enzyme-perturbation datasets, external metabolite concentrations had minimal impact and, in some cases, their exclusion improved predictions; when external-nutrient perturbations were introduced and those concentrations were observed, gains were at most modest. Additionally, we find that posterior estimation with both ADVI and HMC can underestimate large-magnitude elasticities in our synthetic settings, with ADVI showing somewhat higher variance under strong up-regulation; thus, recovering |elasticity| ≳ 1.5 remains challenging regardless of the inference engine. ADVI also fails to accurately infer allosteric interactions, even when regulatory effects are strong. While BMCA maintains reasonable accuracy in partially recovering the rankings of the highest FCC values, its estimates of absolute values remain constrained by prior assumptions and data limitations. Our findings reveal the BMCA algorithm’s strengths and weaknesses, providing guidance on its application in metabolic engineering, and highlighting the need for methodological refinements to enhance its predictive capabilities.

59 BASIC BIOLOGICAL SCIENCES

SEM Grid Testing at NLCTA in BeamNetUS Program

We report on the performance of a secondary electron monitor (SEM) grid used to measure the transverse profile of an MeV range electron beam at SLAC National Accelerator Laboratory’s Next Linear Collider Test Accelerator (NLCTA) facility. When inserted into the path of the electron beam, secondary electron emission results in a measurable current on the wires that make up the grid. We present measurements using this technique to reconstruct the beam profile. The SEM grid was designed and manufactured by a team of undergraduate students at Harvey Mudd College (HMC) and was tested at SLAC’s NLCTA facility in collaboration with NCLTA staff as part of the BeamNetUS program. Developed for real-time diagnostics of MeV-range electron beams, this SEM grid has potential applications in both industrial and medical contexts.

43 PARTICLE ACCELERATORS