Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “expected error reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Efficient Active Learning for Gaussian Process Classification by Error Reduction

Active learning sequentially selects the best instance for labeling by optimizing an acquisition function to enhance data/label efficiency. The selection can be either from a discrete instance set (pool-based scenario) or a continuous instance space (query synthesis scenario). In this work, we study both active learning scenarios for Gaussian Process Classification (GPC). The existing active learning strategies that maximize the Estimated Error Reduction (EER) aim at reducing the classification error after training with the new acquired instance in a onestep-look-ahead manner. The computation of EER-based acquisition functions is typically prohibitive as it requires retraining the GPC with every new query. Moreover, as the EER is not smooth, it can not be combined with gradient-based optimization techniques to efficiently explore the continuous instance space for query synthesis. To overcome these critical limitations, we develop computationally efficient algorithms for EER-based active learning with GPC. Further, we derive the joint predictive distribution of label pairs as a one-dimensional integral, as a result of which the computation of the acquisition function avoids retraining the GPC for each query, remarkably reducing the computational overhead. We also derive the gradient chain rule to efficiently calculate the gradient of the acquisition function, which leads to the first query synthesis active learning algorithm implementing EER-based strategies. Our experiments clearly demonstrate the computational efficiency of the proposed algorithms. We also benchmark our algorithms on both synthetic and real-world datasets, which show superior performance in terms of sampling efficiency compared to the existing state-of-the-art algorithms.

97 MATHEMATICS AND COMPUTING↗

Active learning strategy for high fidelity short-term data-driven building energy forecasting

The quality of a data-driven model is heavily dependent on the quality of data. Data from building operation often have data bias problems, which means that the data sample is collected in a way that some members of the intended data population are less likely to be included than others. Data-driven energy forecasting models built on such data hence are biased and could lead to large forecasting errors. Active learning—an effective method to defying data bias—is rarely studied or applied in the area of data-driven building energy forecasting modeling. This paper attempts to fill this gap and explores the application of active learning in data-driven building energy forecasting. The developed strategy in this paper efficiently generate informative training data within a time budget and uses block design to passively consider weather disturbances. The developed active learning strategy is applied and evaluated in both virtual and real-building testbeds against traditional data-driven methods. Via these virtual and real-building evaluation cases, we have demonstrated that the data bias problem typically exists in building operation data is resolved by applying the developed active learning strategy. Furthermore, building energy forecasting models trained from data generated from the active learning strategy have shown improved performances in both model accuracy and model extendibility perspectives. The effectiveness of the block design module is also validated to effectively consider the impact of weather conditions on active learning design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Isovector Axial Charge and Form Factors of Nucleons from Lattice QCD

A survey of the calculations of the isovector axial vector form factor of the nucleon using lattice QCD is presented. Attention is paid to statistical and systematic uncertainties, in particular those due to excited state contributions. Based on a comparison of results from various collaborations, a case is made that lattice results are consistent within 10%. A similar level of uncertainty is in the axial charge gAu−d, the mean squared axial charge radius ⟨rA2⟩, the induced pseudoscalar charge gP∗, and the pion–nucleon coupling gπNN. Even with the current methodology, a significant reduction in errors is expected over the next few years with higher statistics data on more ensembles closer to the physical point. Lattice QCD results for the form factor GA(Q2) are compatible with those obtained from the recent MINERνA experiment but lie 2–3σ higher than the phenomenological extraction from the old ν–deuterium bubble chamber scattering data for Q2>0.3 GeV2. Current data show that the dipole ansatz does not have enough parameters to fit the form factor over the range 0≤Q2≤1 GeV2, whereas even a z2 truncation of the z expansion or a low order Padé are sufficient. Looking ahead, lattice QCD calculations will provide increasingly precise results over the range 0≤Q2≤1 GeV2, and MINERνA-like experiments will extend the range to Q2∼2 GeV2 or higher. Nevertheless, improvements in lattice methods to (i) further control excited state contributions and (ii) extend the range of Q2 are needed.

Astronomy & Astrophysics↗

Automated quantum error mitigation based on probabilistic error reduction

Current quantum computers suffer from a level of noise that prohibits extracting useful results directly from longer computations. The figure of merit in many near-term quantum algorithms is an expectation value measured at the end of the computation, which experiences a bias in the presence of hardware noise. A systematic way to remove such bias is probabilistic error cancellation (PEC). PEC requires a full characterization of the noise and introduces a sampling overhead that increases exponentially with circuit depth, prohibiting high-depth circuits at realistic noise levels. Probabilistic error reduction (PER) is a related quantum error mitigation method that systematically reduces the sampling overhead at the cost of reintroducing bias. In combination with zero-noise extrapolation, PER can yield expectation values with an accuracy comparable to PEC.Noise reduction through PER is broadly applicable to near-term algorithms, and the automated implementation of PER is thus desirable for facilitating its widespread use. To this end, we present an automated quantum error mitigation software framework that includes noise tomography and application of PER to user-specified circuits. We provide a multi-platform Python package that implements a recently developed Pauli noise tomography (PNT) technique for learning a sparse Pauli noise model and exploits a Pauli noise scaling method to carry out PER.We also provide software tools that leverage a previously developed toolchain, employing PyGSTi for gate set tomography and providing a functionality to use the software Mitiq for PER and zero-noise extrapolation to obtain error-mitigated expectation values on a user-defined circuit.

McDonough, Benjamin↗

Extending quantum probabilistic error cancellation by noise scaling

Here, we propose a general framework for quantum error mitigation that combines and generalizes two techniques: probabilistic error cancellation (PEC) and zero-noise extrapolation (ZNE). Similar to PEC, the proposed method represents ideal operations as linear combinations of noisy operations that are implementable on hardware. However, instead of assuming a fixed level of hardware noise, we extend the set of implementable operations by noise scaling. By construction, this method encompasses both PEC and ZNE as particular cases and allows us to investigate a larger set of hybrid techniques. For example, gate extrapolation can be used to implement PEC without requiring knowledge of the device’s noise model, e.g., avoiding gate-set tomography. Alternatively, probabilistic error reduction can be used to estimate expectation values at intermediate virtual noise strengths (below the hardware level), leading to partially mitigated results at a lower sampling cost. Moreover, multiple results obtained with different noise-reduction factors can be further postprocessed with ZNE to better approximate the zero-noise limit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas↗

Multifidelity methods for uncertainty quantification of a nonlocal model for phase changes in materials

This study is devoted to the construction of a multifidelity Monte Carlo (MFMC) method for the uncertainty quantification of a nonlocal, non-mass-conserving Cahn-Hilliard model for phase transitions with an obstacle potential. Here, we are interested in estimating the expected value of an output of interest (OoI) that depends on the solution of the nonlocal Cahn-Hilliard model. As opposed to its local counterpart, the nonlocal model captures sharp interfaces without the need for significant mesh refinement. However, the computational cost of the nonlocal Cahn-Hilliard model is higher than that of its local counterpart with similar mesh refinement, inhibiting its use for outer-loop applications such as uncertainty quantification. The MFMC method augments the desired high-fidelity, high-cost OoI with a set of lower-fidelity, lower-cost OoIs to alleviate the computational burden associated with nonlocality. Most of the computational budget is allocated to sampling the cheap surrogate models to achieve speedup, whereas the high-fidelity model is sparsely sampled to maintain accuracy. For the non-mass-conserving nonlocal Cahn-Hilliard model, the use of the MFMC method results in, for a given computational budget, about an order of magnitude reduction in the mean-squared error of the expected value of the OoI relative to that of the Monte Carlo method.

97 MATHEMATICS AND COMPUTING↗

Customer outcomes in Pay-As-You-Save programs

We review the energy and financial outcomes of households participating in several programs based on successive versions of the Pay As You Save¯ (PAYS¯) system. PAYS¯ programs offer non-debt financing for energy efficiency (and sometimes other technologies) in residential buildings through a tariff attached to the home’s utility meter, designed to be offset by project savings. We find that the five programs we study generally serve customers living in zip codes with levels of income and education below the national average and unemployment rates above the national average, demonstrating their potential to improve equity in energy efficiency adoption. Using weather-normalized analysis of energy consumption data, we show that most customers of Midwest Energy’s program reduce annual electricity and gas consumption, averaging 15% and 26% reductions respectively. Changes in energy consumption calculated using this method represent a combination of project effects and changes in occupant behavior. These results are similar to existing analyses of PAYS¯ programs in North Carolina, Arkansas, and Tennessee. About half of participating Midwest households generate sufficient energy cost savings to cover their monthly tariff. Various factors, including changes in occupant behavior, program error, causes independent of the customer or program, or some combination thereof may explain lower-than-expected cost reductions in some projects. Given the inherent variability in annual household electricity consumption, we feel these programs are enabling energy efficiency improvements and their attendant co-benefits, including occupant health and comfort and reduced carbon emissions, while reasonably balancing energy savings and tariff costs. Pairing PAYS¯ with additional financial assistance, as well as promoting cost-effective measures such as air and duct sealing, could further broaden program participation by enabling additional projects to meet PAYS¯ program eligibility rules.

Deason, Jeff↗

Geostatistical interpolation of streambed hydrologic attributes with addition of left censored data and anisotropy

Spatial geostatistical interpolation of point measurements of streambed attributes in the hyporheic zone may be constrained by the streambed anisotropy, and data density and spatial distribution may significantly impact the results. Spatial clustering and low spatial data density can be caused by bedrock outcropping at the streambed limiting installation of in-stream piezometers. This study examines parameter error variability of the geostatistical interpolation using anisotropic interpolation methods and increasing the data density by adding left censored values (i.e., data below measurement limit) to locations where measurements were limited by exposed bedrock lining the streambed. The reduction in relative standard error of the interpolation was determined for the spatial distributions of streambed attributes including hydraulic conductivity, seepage flux, and mercury solute flux measured in two different years along a study reach in East Fork Poplar Creek, Tennessee, USA. Here, two methods to impute the left censored values were compared including the conventional half the detection limit substitution method, and the Stochastic Approximation of Expectation-Maximization (SAEM) algorithm, which both had comparable results. Imputing left censored data increased the data density to recommended ranges, reduced data clustering, increased the spatial dependence for some attributes, and reduced the standard error for each of the three attributes. For the reach considered herein, addition of the left censored values resulted in a larger error reduction than the consideration of anisotropy within the interpolation, which confirms the benefit of data addition to increase data density within data-limited river corridors.

58 GEOSCIENCES↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

cloud properties↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data: Preprint

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data input to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

41 EE - Solar Energy Technologies Office (EE-4S)↗

FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

We present FPDetect, a low-overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.

97 MATHEMATICS AND COMPUTING↗

Improving Computational Efficiency of Mechanical Finite Element Method Simulations for PV Modules: Preprint

In this work we have elucidated the trade off between structural mechanics FEM model accuracy and computation time by employing lower fidelity viscoelastic models. Results indicate that computation time can easily be cut in half while only expecting a potential maximum error of 10 % by considering lower fidelity models. A novel approach to produce the Prony Series fit for viscoelastic characterization has also been presented. Employing this approach, we were able to achieve a further 10 % reduction in computation time without further sacrificing simulation accuracy.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗

Hadronic contributions to (g - 2) µ

The Muon g-2 Experiment at Fermilab, which recently started running, plans to reduce the uncertain- ties on the already very precisely measured anomalous magnetic moment of the muon by a factor of four. The goal of this effort is to probe the observed difference of more than three standard deviations between Standard-Model theory and experiment, one of the few persistent hints for physics beyond the Standard Model. The Fermilab experiment collected data from their first run last year with statistics comparable to BNL E821. They expect to release the measurement result in 2019. On the theoretical side, because the muon g - 2 arises from quantum- mechanical loop contributions in the Standard Model, it is sensitive to virtual effects of new particles, and places important constraints on Standard-Model extensions. To leverage the anticipated reduction in experimental errors, and determine unambiguously whether or not new-physics effects contribute to this quantity, the theoretical errors must be made more reliable and reduced to a commensurate precision. The Muon g-2 Theory Initiative was created to facilitate this development. The dominant sources of uncertainty in the Standard-Model prediction of the muon g -2 are from the hadronic contributions. The hadronic vacuum polarization (HVP) provides the leading correction followed by hadronic light-by-light (HLbL) scattering. There are a number of complementary theoretical efforts underway to better understand and quantify these contributions, including dispersive and data driven methods, lattice QCD, and effective field theories. Given the precision goals and the phenomenological importance, it is important to have more than one independent method for each of the two hadronic corrections, each with fully quantified uncertainties. Fostering the development of such methods is a prime goal of the initiative, as this will enable critical cross checks, and, upon combination, may yield gains in precision, to maximize the impact of E989. An important aspect of the Muon g-2 Theory Initiative’s activities are providing platforms that facilitate interactions between the different groups, as well as between the theoretical and experimental g - 2 communities. To this end, several workshops were organized in 2017 and 2018. The first meeting, held at Fermilab (June 3–6, 2017, St. Charles, IL, USA), served to kick-off the Initiative’s activities. Two meetings in early 2018 were focused respectively on the HVP and HLbL corrections. The HVP meeting was held at KEK (February 12–14, 2018, Tsukuba, Japan) and the HLbL meeting at the University of Connecticut (March 12–14, 2018, Storrs, CT, USA). The most recent workshop, which served as the second plenary meeting of the Initiative, was held at the University of Mainz (June 18–22, 2018, Mainz, Germany). An important outcome of these meetings are concrete plans for a first white paper, which is currently being written. We aim to post the white paper just prior to the release of the first E989 measurement, to present a clean theoretical prediction. The first white paper is focused on assessing and improving the reliability of the SM prediction. The purpose of the INT workshop in September 2019 is to start the next stage of the Initiative, focusing on the development of strategies to improve the theory uncertainties beyond the current level towards the E989 precision goal. We aim to accelerate theoretical developments on the hadronic contributions to the muon g - 2 so that the Standard-Model theory error can be brought to the needed precision, again in advance of the next release from E989. Hence the workshop will provide crucial theory support for a US experiment with broad impact. The Muon g-2 Theory Initiative relies on input from representatives of all the different communities that are engaged in this effort. It is therefore important that all these areas are properly represented. The funds from this grant will be used to enable more people, especially early-career scientists, to participate and make essential contributions to the workshop discussions. Since the workshop’s main goal is to kick-off the next stage of the theory initiative’s activities, support for this workshop from the DOE will help the theory community provide crucial theoretical support to the Fermilab Muon g-2 Experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Tempering stochastic density functional theory

Here, we introduce a tempering approach with stochastic density functional theory (sDFT), labeled t-sDFT, which reduces the statistical errors in the estimates of observable expectation values. This is achieved by rewriting the electronic density as a sum of a "warm" component complemented by "colder" correction(s). Since the warm component is larger in magnitude but faster to evaluate, we use many more stochastic orbitals for its evaluation than for the smaller-sized colder correction(s). This results in a significant reduction in the statistical fluctuations and systematic deviation compared to sDFT for the same computational effort. We demonstrate the method's performance on large hydrogen-passivated silicon nanocrystals, finding a reduction in the systematic deviation in the energy by more than an order of magnitude, while the systematic deviation in the forces is also quenched. Similarly, the statistical fluctuations are reduced by factors of ≈4-5 for the total energy and ≈1.5-2 for the forces on the atoms. Since the embedding in t-sDFT is fully stochastic, it is possible to combine t-sDFT with other variants of sDFT such as energy-window sDFT and embedded-fragmented sDFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A semi-Lagrangian method for detecting and tracking deep convective clouds in geostationary satellite observations

Automated methods for the detection and tracking of deep convective clouds in geostationary satellite imagery have a vital role in both the forecasting of severe storms and research into their behaviour. Studying the interactions and feedbacks between multiple deep convective clouds (DCC), however, poses a challenge for existing algorithms due to the necessary compromise between false detection and missed detection errors. We utilise an optical flow method to determine the motion of deep convective clouds in GOES-16 ABI imagery in order to construct a semi-Lagrangian framework for the motion of the cloud field, independently of the detection and tracking of cloud objects. The semi-Lagrangian framework allows severe storms to be simultaneously detected and tracked in both spatial and temporal dimensions. For the purpose of this framework we have developed a novel Lagrangian convolution method and a number of novel implementations of morphological image operations that account for the motion of observed objects. These novel methods allow the accurate extension of computer vision techniques to the temporal domain for moving objects such as DCCs. By combining this framework with existing methods for detecting DCCs (including detection of growing cores through cloud top cooling and detection of anvil clouds using brightness temperature), we show that the novel framework enables reductions in errors due to both false and missed detections compared to any of the individual methods, reducing the need to compromise when compared with existing frameworks. The novel framework enables the continuous tracking of anvil clouds associated with detected deep convection after convective activity has stopped, enabling the study of the entire life cycle of DCCs and their associated anvils. Furthermore, we expect this framework to be applicable to a wide range of cases including the detection and tracking of low-level clouds and other atmospheric phenomena. In addition, this framework may be used to combine observations from multiple sources, including satellite observations, weather radar and reanalysis model data.

54 ENVIRONMENTAL SCIENCES↗

NISQ+: Boosting quantum computing power by approximating quantum error correction

Quantum computers are growing in size, and design decisions are being made now that attempt to squeeze more computation out of these machines. In this spirit, we design a method to boost the computational power of near-term quantum computers by adapting protocols used in quantum error correction to implement "Approximate Quantum Error Correction (AQEC)." By approximating fully-fledged error correction mechanisms, we can increase the compute volume (qubits × gates, or "Simple Quantum Volume (SQV)") of near-term machines. The crux of our design is a fast hardware decoder that can approximately decode detected error syndromes rapidly. Specifically, we demonstrate a proof-of-concept that approximate error decoding can be accomplished online in near-term quantum systems by designing and implementing a novel algorithm in Single-Flux Quantum (SFQ) superconducting logic technology. This avoids a critical decoding backlog, hidden in all offline decoding schemes, that leads to idle time exponential in the number of T gates in a program. Our design utilizes one SFQ processing module per physical qubit. Employing state-of-the-art SFQ synthesis tools, we show that the circuit area, power, and latency are within the constraints of contemporary quantum system designs. Under pure dephasing error models, the proposed accelerator and AQEC solution is able to expand SQV by factors between 3,402 and 11,163 on expected near-term machines. The decoder achieves a 5% accuracy-threshold and pseudo-thresholds of ~ 5%,4.75%,4.5%, and 3.5% physical error-rates for code distances 3,5,7, and 9. Decoding solutions are achieved in a maximum of ~20 nanoseconds on the largest code distances studied. By avoiding the exponential idle time in offline decoders, we achieve a 10x reduction in required code distances to achieve the same logical performance as alternative designs.

97 MATHEMATICS AND COMPUTING↗