Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variance reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models

We use a conditional Karhunen-Lo` eve (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, Y (x). We assume that a small number of Y (x) measurements are available and model Y (x) with a KL expansion. We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measurements. We consider two approaches for conditioning the KL expansion: In Approach 1, we condition the KL model first and then truncate it. In Approach 2, we first truncate the KL expansion and then condition it. We employ the conditional KL expansion together with Monte Carlo and sparse grid collocation methods to compute the moments of the solution of the SPDE problem. Uncertainty of the problem is further reduced by adaptively selecting additional observation locations using two active learning methods. Method 1 minimizes the variance of the PDE coefficient, while Method 2 minimizes the variance of the solution of the PDE. We demonstrate that conditioning leads to dimension reduction of the KL representation of Y (x). For a linear diffusion SPDE with uncertain log-normal coefficient, we show that Approach 1 provides a more accurate approximation of the conditional log-normal coefficient and solution of the SPDE than Approach 2 for the same number of random dimensions in a conditional KL expansion. Furthermore, Approach 2 provides a good estimate for the number of terms of the truncated KL expansion of the conditional field of Approach 1. Finally, we demonstrate that active learning based on Method 2 is more efficient for uncertainty reduction in the SPDE’s states (i.e., it leads to a larger reduction of the variance) than active learning using Method 2.

Conditioned Karhunen-Lo` eve expanion, machine lea↗
DOE OSTI2020

Time Series Dimension Reduction for Surrogate Models of Port Scanning Cyber Emulations

Surrogate model development is a key resource in the scientific modeling community for providing computational expedience when simulating complex systems without loss of great fidelity. The initial step to development of a surrogate model is identification of the primary governing components of the system. Principal component analysis (PCA) is a widely used data science technique that provides inspection of such driving factors, when the objective for modeling is to capture the greatest sources of variance inherent to a dataset. Although an efficient linear dimension reduction tool, PCA makes the fundamental assumption that the data is continuous and normally distributed. Thus, it provides ideal performance when these conditions are met. In the case for which cyber emulations provide realizations of a port scanning scenario, the data to be modeled follows a discrete time series function comprised of monotonically increasing piece-wise constant steps. The sources of variance are related to the timing and magnitude of these steps. Therefore, we consider using XPCA, an extension to PCA for continuous and discrete random variates. This report provides the documentation of the trade-offs between the PCA and XPCA linear dimension reduction algorithms, for the intended purpose to identify key components of greatest variance in our time series data. These components will ultimately provide the basis for future surrogate models of port scanning cyber emulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Transmission estimation at the quantum Cramér-Rao bound with macroscopic quantum light

The field of quantum metrology seeks to apply quantum techniques and/or resources to classical sensing approaches with the goal of enhancing the precision in the estimation of a parameter beyond what can be achieved with classical resources. Theoretically, the fundamental minimum uncertainty in the estimation of a parameter for a given probing state is bounded by the quantum Cramér-Rao bound. From a practical perspective, it is necessary to find physical measurements that can saturate this fundamental limit and to show experimentally that it is possible to perform measurements with the required precision to do so. Here we perform experiments that saturate the quantum Cramér-Rao bound for transmission estimation over a wide range of transmissions when probing the system under study with a continuous wave bright two-mode squeezed state. To properly take into account the imperfections in the generation of the quantum state, we extend our previous theoretical results to incorporate the measured properties of the generated quantum state. For our largest transmission level of 84%, we show a 62% reduction over the optimal classical protocol in the variance in transmission estimation when probing with a bright two-mode squeezed state with -8 dB of intensity-difference squeezing. Given that transmission estimation is an integral part of many sensing protocols, such as plasmonic sensing, spectroscopy, calibration of the quantum efficiency of detectors, etc., the results presented promise to have a significant impact on a number of applications in various fields of research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Measuring the β-decay Properties of Neutron-rich Exotic Pm, Sm, Eu, and Gd Isotopes to Constrain the Nucleosynthesis Yields in the Rare-earth Region

Abstract The β -delayed neutron-emission probabilities of 28 exotic neutron-rich isotopes of Pm, Sm, Eu, and Gd were measured for the first time at RIKEN Nishina Center using the Advanced Implantation Detector Array (AIDA) and the BRIKEN neutron detector array. The existing β -decay half-life ( T 1/2 ) database was significantly increased toward more neutron-rich isotopes, and uncertainties for previously measured values were decreased. The new data not only constrain the theoretical predictions of half-lives and β -delayed neutron-emission probabilities, but also allow for probing the mechanisms of formation of the high-mass wing of the rare-earth peak located at A ≈ 160 in the r -process abundance distribution through astrophysical reaction network calculations. An uncertainty quantification of the calculated abundance patterns with the new data shows a reduction of the uncertainty in the rare-earth peak region. The newly introduced variance-based sensitivity analysis method offers valuable insight into the influence of important nuclear physics inputs on the calculated abundance patterns. The analysis has identified the half-lives of 168 Sm and of several gadolinium isotopes as some of the key variables among the current experimental data to understand the remaining abundance uncertainty at A = 167–172.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A comparison of cost and quality of three methods for estimating density for wild pig (Sus scrofa)

A critical element in efective wildlife management is monitoring the status of wildlife populations; however, resources to monitor wildlife populations are typically limited. We compared cost efectiveness of three common population estimation methods (i.e. non-invasive DNA sampling, camera sampling, and sampling from trapping) by applying them to wild pigs (Sus scrofa) across three habitats in South Carolina, U.S.A where they are invasive. We used mark-recapture analyses for fecal DNA sampling data, spatially-explicit capture-recapture analyses for camera sampling data, and a removal analysis for removal sampling from trap data. Density estimates were similar across methods. Camera sampling was the least expensive, but had large variances. Fecal DNA sampling was the most expensive, although this technique generally performed well. We examined how reductions in efort by method related to increases in relative bias or imprecision. For removal sampling, the largest cost savings while maintaining unbiased density estimates was from reducing the number of traps. For fecal DNA sampling, a reduction in efort only minimally reduced costs due to the need for increased lab replicates while maintaining high quality estimates. For camera sampling, efort could only be marginally reduced before inducing bias. We provide a decision tree for researchers to help make monitoring decisions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Neural Active Manifolds: Nonlinear Dimensionality Reduction for Uncertainty Quantification

We present a new approach for nonlinear dimensionality reduction, specifically designed for computationally expensive mathematical models. We leverage autoencoders to discover a one-dimensional neural active manifold (NeurAM) capturing the model output variability, through the aid of a simultaneously learnt surrogate model with inputs on this manifold. Our method only relies on model evaluations and does not require the knowledge of gradients. The proposed dimensionality reduction framework can then be applied to assist outer loop many-query tasks in scientific computing, like sensitivity analysis and multifidelity uncertainty propagation. In particular, we prove, both theoretically under idealized conditions, and numerically in challenging test cases, how NeurAM can be used to obtain multifidelity sampling estimators with reduced variance by sampling the models on the discovered low-dimensional and shared manifold among models. Several numerical examples illustrate the main features of the proposed dimensionality reduction strategy and highlight its advantages with respect to existing approaches in the literature.

Autoencoders↗
DOE OSTI2021

Experimental Studies on Wood Pellets Combustion in a Fixed Bed Combustor Using Taguchi Method

The combustion of wood pellets in a fixed bed combustor of a 20 kW capacity domestic pellet boiler was tested according to several factors including Power, Excess Air (EA), Primary/Secondary air Split Ratio (SR) and Grate Area (GA). The Taguchi method was applied to program the experimental design. Several parameters were measured, including gas emissions (CO), fuel bed temperature (measured at 4 different heights), and efficiency. The experimental results show that the lower CO emission and the higher efficiency were obtained at medium thermal loads and the highest temperature on the fuel bed was obtained at about ¼ of its height (15 mm). The results obtained from the analysis of variance (ANOVA) show that the SR and the Power are the most important factors contributing to the CO reduction and also increase the fuel bed temperature.

Castro, Carlos↗
DOE OSTI2021

Machine Learning Training for HOM reduction and Emittance Preservation in a TESLA-type Cryomodule at FAST

Low emittance electron beams are of high importance at facilities like the LCLS-II at SLAC. Emittance dilution effects due to off-axis beam transport for a TESLA-type cryomodule (CM) have been shown at the Fermilab Accelerator Science and Technology facility. The results showed the correlation between the electron beam-induced cavity high-order modes (HOMs) and submacropulse centroid slewing and oscillation downstream of the CM. Mitigation of emittance dilution can be achieved by reducing the HOM signals and the variances in the submacropulse beam positions downstream of the CM. Here we present a Machine Learning based optimization and model construction for HOM signal level reduction using Neural Networks and Gaussian Processes. To gather training data we performed experiments using single bunch and 50 bunch electron beams with charges up to 125 pC/b. We measured HOM signals of all cavities and beam position with a set of BPMs downstream of the CM. The beam trajectory was changed using V/H125 corrector set located upstream of the CM. The results presented here will inform the LCLS-II injector commissioning and will serve as a prototype for HOM reduction and emittance preservation.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

DP-TwoLevel: two-stage gradient subspace learning for differentially private federated learning

Federated learning (FL) enables collaborative model training across distributed data sources without sharing raw data, but faces fundamental challenges in communication efficiency and privacy. Differentially private (DP) training mitigates information leakage but introduces noise that degrades model performance, especially in high-dimensional settings. We propose DP-TwoLevel, a hierarchical gradient projection method that improves utility under fixed DP constraints by exploiting low-dimensional structure in model updates. Our approach learns a two-level PCA-based representation of gradients and applies DP noise in a reduced-dimensional subspace, thereby lowering the effective noise magnitude while preserving dominant signal components. We evaluate the method across three datasets (MNIST, Fashion-MNIST, CIFAR-10) and three privacy regimes (ϵ∈0.5, 1.0, 2.0). Across nine experimental settings, DP-TwoLevel consistently outperforms DP-FedAvg, achieving an average accuracy improvement of 9.44%, with larger gains observed in lower ϵ(higher-noise) regimes (up to +22.31%). We further analyze scalability across models ranging from 100K to 1.49M parameters and identify a variance-based success criterion: performance remains strong when the projection preserves more than 75% of gradient variance, degrades in a marginal regime (65–75%), and fails below this threshold. Our results demonstrate that structure-aware dimensionality reduction can significantly improve the privacy–utility tradeoff in FL without modifying formal privacy guarantees. We also provide empirical evidence of scaling limitations for global projections and motivate per-layer extensions for larger models.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Fast and accurate reduced-order modeling of a MOOSE-based additive manufacturing model with operator learning

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on existing simulation tools employed in AM. The goal of the present work is to construct a fast and accurate reduced-order model (ROM) for an AM model developed within the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, ultimately reducing the time/cost of AM control and optimization processes. Our adoption of the operator learning (OL) approach enabled us to learn a family of differential equations produced by altering process variables in the laser’s Gaussian point heat source. More specifically, we used the Fourier neural operator (FNO) and deep operator network (DeepONet) to develop ROMs for time-dependent responses. Furthermore, we benchmarked the performance of these OL methods against a conventional deep neural network (DNN)-based ROM. Ultimately, we found that OL methods offer comparable performance and, in terms of accuracy and generalizability, even outperform DNN at predicting scalar model responses. The DNN-based ROM afforded the fastest training time. Furthermore, all the ROMs were faster than the original MOOSE model yet still provided accurate predictions. FNO had a smaller mean prediction error than DeepONet, with a larger variance for time-dependent responses. Unlike DNN, both FNO and DeepONet were able to simulate time series data without the need for dimensionality reduction techniques. Finally, the present work can help facilitate the AM optimization process by enabling faster execution of simulation tools while still preserving evaluation accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Personalized and uncertainty-aware coronary hemodynamics simulations: From Bayesian estimation to improved multi-fidelity uncertainty quantification

Non-invasive simulations of coronary hemodynamics have improved clinical risk stratification and treatment outcomes for coronary artery disease, compared to relying on anatomical imaging alone. However, simulations typically use empirical approaches to distribute total coronary flow amongst the arteries in the coronary tree, which ignores patient variability, the presence of disease, and other clinical factors. Further, uncertainty in the clinical data often remains unaccounted for in the modeling pipeline. We present an end-to-end uncertainty-aware pipeline to (1) personalize coronary flow simulations by incorporating vessel-specific coronary flows as well as cardiac function; and (2) predict clinical and biomechanical quantities of interest with improved precision, while accounting for uncertainty in the clinical data. We assimilate patient-specific measurements of myocardial blood flow from clinical CT myocardial perfusion imaging to estimate branch-specific coronary artery flows. Simulated noise in the clinical data is used to estimate the joint posterior distributions of the model parameters using adaptive Markov Chain Monte Carlo sampling. Additionally, the posterior predictive distribution for the relevant quantities of interest is determined using a new approach combining multi-fidelity Monte Carlo estimation with non-linear, data-driven dimensionality reduction. This leads to improved correlations between high- and low-fidelity model outputs. Our framework accurately recapitulates clinically measured cardiac function as well as branch-specific coronary flows under measurement noise uncertainty. We observe substantial reductions in confidence intervals for estimated quantities of interest compared to single-fidelity Monte Carlo estimation and state-of-the-art multi-fidelity Monte Carlo methods. This holds especially true for quantities of interest that showed limited correlation between the low- and high-fidelity model predictions. In addition, the proposed multi-fidelity Monte Carlo estimators are significantly cheaper to compute than traditional estimators, under a specified confidence level or variance. The proposed pipeline for personalized and uncertainty-aware predictions of coronary hemodynamics is based on routine clinical measurements and recently developed techniques for CT myocardial perfusion imaging. The proposed pipeline offers significant improvements in precision and reduction in computational cost.

Bayesian parameter estimation↗
DOE OSTI2026

ClassNMSW- a real-time classification approach for non-recycled municipal solid waste using hyperspectral imaging

Real-time classification of non-recycled municipal solid waste (NMSW) is essential for efficient valorization. This study introduces ClassNMSW, a comprehensive framework for classifying 22 NMSW subclasses under industrial constraints by using hyperspectral imaging (HSI). A primary innovation of this work is the development of a variance-controlled spectral extraction algorithm. Unlike traditional methods that rely on simple averaging, this approach systematically investigates the extent of pixel extraction to minimize the loss of critical chemical information while maximizing data reduction thus ensuring high spectral fidelity with low computational cost. The approach developed in this work integrates automated, computer-vision-based background removal, eliminating the need for the manual thresholding common in current literature. To resolve ambiguities among chemically similar subclasses, a tiered classification and multi-camera fusion strategy (NIR17 and NIR22) is implemented. Results demonstrate that ClassNMSW achieves an object-wise weighted accuracy of 98.70% for single-sensor configurations and 100% under sensor fusion. A novel rolling-window strategy satisfies desired end-to-end latency of <2 s, satisfying the strict deterministic requirements of high-speed industrial sorting environments. The ClassNMSW framework provides a scalable foundation for advancing circularity and resource recovery in large-scale waste valorization operations.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Wave resource spatial and temporal variability dependence on WEC size

As the wave energy sector grows and looks to the Blue Economy for commercialization opportunities, there is a distinct and pressing need to clearly understand and quantify the coupled impacts of wave energy converter (WEC) size and wave resource characteristics on the annual energy production, spatial variability and temporal variability. Utilizing generic frequency domain representations of the Oscilla Power Triton WEC and spectral wave conditions at PacWave (Oregon), Los Angeles (California) and WETS (Hawaii), a series of interesting results emerge. Firstly, the ‘optimal’ WEC size, from an energy standpoint, is fundamentally dependent on the frequency distribution of the incoming wave variance density spectrum. Secondly, and from a seasonality perspective, the seasonal WEC energy generation doesn’t necessarily follow the seasonal distribution of gross wave power. Finally, from an hourly power variability perspective, a reduction in WEC size generally decreases variability. However, for each of the locations investigated, there appears to be a WEC size threshold; a threshold where further reducing WEC size results in increased power variability.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Wave Resource Spatial and Temporal Variability Dependence on WEC Size

As the wave energy sector grows and looks to the Blue Economy for commercialization opportunities, there is a distinct and pressing need to clearly understand and quantify the coupled impacts of wave energy converter (WEC) size and wave resource characteristics on the annual energy production, spatial variability and temporal variability. Utilizing generic frequency domain representations of the Oscilla Power Triton WEC and spectral wave conditions at PacWave (Oregon), Los Angeles (California) and WETS (Hawaii), a series of interesting results emerge. Firstly, the 'optimal' WEC size, from an energy standpoint, is fundamentally dependent on the frequency distribution of the incoming wave variance density spectrum. Secondly, and from a seasonality perspective, the seasonal WEC energy generation doesn't necessarily follow the seasonal distribution of gross wave power. Finally, from an hourly power variability perspective, a reduction in WEC size generally decreases variability. However, for each of the locations investigated, there appears to be a WEC size threshold; a threshold where further reducing WEC size results in increased power variability.

blue economy↗
DOE OSTI2021

Universal signatures of Dirac fermions in entanglement and charge fluctuations

We study the entanglement entropy (EE) and charge fluctuations in models where the low-energy physics is governed by massless Dirac fermions. We focus on the response to flux insertion which, for the EE, is widely assumed to be universal, i.e., independent of the microscopic details. We provide an analytical derivation of the EE and charge fluctuations for the seminal example of graphene, using the dimensional reduction of its tight-binding model to the one-dimensional Su-Schrieffer-Heeger model. Our asymptotic expression for the EE matches the conformal field theory prediction. We show that the charge variance has the same asymptotic behavior, up to a constant prefactor. To check the validity of universality arguments, we numerically consider several models, with different geometries and numbers of Dirac cones, and either for strictly two-dimensional models or for a gapless surface mode of three-dimensional topological insulators. We also show that the flux response does not depend on the entangling surface geometry as long as it encloses the flux. Finally we consider the universal corner contributions to the EE. We show that in the presence of corners, the Kitaev-Preskill subtraction scheme provides nonuniversal, geometry-dependent results.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Computational study of the adsorption of bimetallic clusters on alumina substrate

We performed computational investigation of the adsorption of bimetallic Pd 3 M 2 (where M changes from Ag, Au, Co, Cu, Mn, Ni, Pt, and Ru) cluster on the hydroxylated alumina surface. Previously, it was shown that small silver cluster can control the rate of discharge at the cathode of lithium-oxygen battery. The gap near the fermi energy was shown to control the oxygen reduction, an important reaction for LiO 2 formation. Controlling the gap would ultimately control the rate of LiO 2 formation. One can vary the size of the cluster to vary the gap, however, this "knob" provides limited variance in the gap. Alloying, in combination with size variation offer a much wider control of the gap, hence the LiO 2 formation. Using Density Functional Theory (DFT), we determined the most stable geometry of the bimetallic clusters Pd 3 M 2 and calculated the binding energies of these clusters on the alumina substrate which ranges from 0.2 eV to 0.25 eV depending upon the composition of the alloy-cluster, its orientation and the adsorption site. We also find that Pd atoms bind strongly with the substrate oxygen atoms with an average short bond-length of about 2.2 angstrom. We explored how the gap at the Fermi level of the system varies as a function of elemental composition and the calculated gap ranges from 0 meV to 90 meV. Charges distribution using Bader analysis was also performed to probe how charges are transferred between the cluster and the substrate. These preliminary results will open the door for more systematic studies of alloy clusters of different size and stoichiometry for Li-O 2 battery cathode design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗