Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

A New Estimator to Correct for Bias from Tag Rate Expansion on Natural-Origin Fish Attributes in Mixed-Stock Analysis Using Parentage-Based Tagging

Abstract In fisheries where hatchery- and natural-origin conspecifics occur as mixed stocks, it is often important to estimate both the natural-origin proportion of the mixture and the composition of attributes within the natural-origin portion (e.g., genetic stock, sex, and age-class). These estimates are facilitated by parentage-based tagging, which allows large numbers of hatchery fish to be efficiently tagged and later identified. When tag rates are less than 100%, the untagged fish in the mixture include both untagged hatchery fish and natural-origin fish. Unbiased estimation of the abundance and attribute composition of the natural-origin portion requires an estimator that accounts for tag rates. Two estimators are described: one “accounting-style” estimator similar to previously described approaches and one maximum likelihood method. These estimators were evaluated and compared using simulations mimicking estimation of the composition of fish migrating past a dam. The two estimators performed similarly at reducing bias when tag rates were high, but the maximum likelihood method had smaller mean square error when tag rates were low. We provide an R package to allow usage of this estimator in a wide variety of fisheries applications.

Delomas, Thomas A. (ORCID:000000015154759X)↗

Empirical validation and comparison of methodologies to simulate micro and macro-encapsulated PCMs in the building envelope

Thermal Energy Storage (TES) has the potential to shift peak electricity demand. Passive TES is usually implemented in building envelope as micro and macro encapsulated phase change materials (PCM) to shift electric energy demand and therefore requires careful heat transfer analysis. Whole building energy modelling with simplified heat transfer analysis has become extremely important for designers, architects, engineers, and researchers to predict energy performance of buildings. It is important to validate PCM modelling algorithms used in building energy programs to quantify their error and prove their capacity to model different PCM encapsulation types. This study uses data from a microencapsulated PCM and two macroencapsulated PCMs (Bio based PCM and hydrate salts) tested in full-scale using the Advanced Multiscale Building Energy Research (AMBER) Lab located at the Colorado School of Mines and is used to validate a numerical algorithm written in MATLAB language. To approximate the heat transfer through a wall assembly with macroencapsulated PCM pouches, several modelling techniques that can reduce 3D heat transfer characteristics to 1D are explored in this research. A parallel path heat transfer modelling approach is found to give the closest agreement with the experimental data for the pouched PCMs in building envelope applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

What, why and when to go virtual: An international analysis of early adopters of virtual building energy codes inspections

To meet greenhouse gas reduction targets, several countries are pursuing more ambitious policies in their buildings and construction sectors, such as introducing zero net energy/carbon building codes. Countries often report not having enough qualified staff for performing building energy code inspections and many are exploring faster, easier, and more reliable methods to check the compliance of buildings with their codes. Building inspections are a critical element for ensuring code compliance and they have traditionally been performed in person. However, in-person inspections can be labor and travel intensive, costly, and prone to human error. In this paper, the authors explore how virtual inspections, particularly in light of the recent COVID-19 pandemic, have impacted processes for building code compliance checks in jurisdictions and communities around the world. Here, the authors collected data on four key parameters (time and financial savings, scope of inspections, changing practices and technological innovation, and benefits to consumers) from six jurisdictions and communities in five countries (Australia, Canada, Singapore, United Arab Emirates, and the United States) to analyze the impacts of virtual inspections on code compliance checks. The analysis found the greatest value from virtual inspections in geographically dispersed regions and for cities experiencing rapid building construction. The study also explored emerging technologies that are being piloted for virtual inspections. Although many of these technologies hold promise, more resources and capacity are needed to make them viable for use in building energy code inspections.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Simulating nonlinear optical processes on a superconducting quantum device

Simulating plasma physics on quantum computers is difficult because most problems of interest are nonlinear, but quantum computers are not naturally suitable for nonlinear operations. In weakly nonlinear regimes, plasma problems can be modelled as wave–wave interactions. In this paper, we develop a quantization approach to convert nonlinear wave–wave interaction problems to Hamiltonian simulation problems. We demonstrate our approach using two qubits on a superconducting device. Unlike a photonic device, a superconducting device does not naturally have the desired interactions in its native Hamiltonian. Nevertheless, Hamiltonian simulations can still be performed by decomposing required unitary operations into native gates. To improve experimental results, we employ a range of error-mitigation techniques. Apart from readout error mitigation, we use randomized compilation to transform undiagnosed coherent errors into well-behaved stochastic Pauli channels. Moreover, to compensate for stochastic noise, we rescale exponentially decaying probability amplitudes using rates measured from cycle benchmarking. We carefully consider how different choices of product-formula algorithms affect the overall error and show how a trade-off can be made to best utilize limited quantum resources. This study provides an example of how plasma problems may be solved on near-term quantum computing platforms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Comparing Classical and Machine Learning Force Fields for Modeling Deformation of Metal–Organic Frameworks Relevant for Direct Air Capture

Deformation of metal–organic frameworks (MOFs) induced by adsorbate molecules can affect adsorption properties such as capacity and selectivity, but most computational studies of MOFs assume framework rigidity to simplify calculations. Although flexible force fields (FFs) for MOFs have been parametrized for specific materials, the generality of FFs for reliably modeling adsorbate-induced deformation to accuracy nearing that of density functional theory (DFT) has not been established. This work confirms using DFT calculations that adsorbate-induced deformation can affect CO 2 and H 2 O adsorption energies in a considerable fraction of MOFs promising for direct air capture (DAC). We then benchmark the efficacy of several general-purpose FFs in describing adsorbate-induced deformation for DAC against DFT. Our results show that current classical FFs are insufficient for describing MOF deformation, especially in cases of interest for DAC where strong interactions exist between adsorbed molecules and MOF frameworks. Some emerging machine learning force fields (MLFFs) we tested, particularly CHGNet, MACE-MP-0, and Equiformer V2, appear to be more promising than the classical FF for emulating the deformation behavior described by DFT. The best performing FF (CHGNet), however, fails to achieve the accuracy required for practical predictions with a mean absolute adsorption energy error of 0.124 eV.

adsorption↗

Generalization in quantum machine learning from few training data

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $\sqrt{T/N}$. When only K$\ll$T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $\sqrt{K/N}$. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

97 MATHEMATICS AND COMPUTING↗

Stochastic evaluation of four-component relativistic second-order many-body perturbation energies: A potentially quadratic-scaling correlation method

A second-order many-body perturbation correction to the relativistic Dirac-Hartree-Fock energy is evaluated stochastically by integrating 13-dimensional products of four-component spinors and Coulomb potentials. The integration in the real space of electron coordinates is carried out by the Monte Carlo (MC) method with the Metropolis sampling, whereas the MC integration in the imaginary-time domain is performed by the inverse-CDF (cumulative distribution function) method. The computational cost to reach a given relative statistical error for spatially compact but heavy molecules is observed to be no worse than cubic and possibly quadratic with the number of electrons or basis functions. This is a vast improvement over the quintic scaling of the conventional, deterministic second-order many-body perturbation method. The algorithm is also easily and efficiently parallelized with demonstrated 92% strong scalability going from 64 to 4096 processors for a fixed job size.

74 ATOMIC AND MOLECULAR PHYSICS↗

Measurements of Six-Junction Concentrator Solar Cells

Accurate measurements of six-junction inverted metamorphic concentrator solar cells under AM1.5 direct spectrum are obtained by adjusting the spectrum of a tunable high-intensity solar simulator with custom mirrors. Isotype reference cells and broadband InGaAs QE calibration cells were developed for accurate measurements. Modeling and varying the illumination show that an unavoidable 15% - 17% overillumination on the sixth junction does not result in significant error of these 6J IMM devices. Spectrally adjusted flash measurements are independently confirmed by NREL's Cell and Module Performance team. Concentration measurements of a 6J IMM solar cell resulted in 47.1 ± 3.2% (absolute) efficiency at 143 suns.

41 EE - Solar Energy Technologies Office (EE-4S)↗

A Reproducible Validation of Algorithms for Estimating Array Tilt and Azimuth from Photovoltaic Power Time Series

In this research, we assess the viability of four different, publicly available algorithms for estimating the azimuth and tilt parameters of solar photovoltaic systems using only the associated AC power time series data and site latitude-longitude coordinates. In this work, we curated a benchmarking data set of 44 fixed-tilt systems, comprising 275 measured AC power inverter data streams, with known azimuth and tilt parameters. Additionally, we isolated test cases in the data set with real- world issues, including shading and clipping, to determine how algorithm performance varies based on the presence of these phenomena. Using this data set for benchmarking, we evaluated the estimated vs. actual system characteristics for each algorithm, as well as the associated algorithm execution time using a standardized benchmarking process. The two highest performing algorithms were the Solar Data Tools and the PVWatts 5- based methods, which both achieved a median absolute error of approximately 5 and 1 degrees for azimuth and tilt, respectively. During run time analysis, the SDT method was approximately 5 times faster than the PVWatts 5-based method, with the median execution time for a stream varying between 6 and 8 seconds vs. a median run time of 31 seconds for the PVWatts 5-based method.

azimuth↗

Benchmarking Optimizers for Qumode State Preparation with Variational Quantum Algorithms

Quantum state preparation involves preparing a target state from an initial system, a process integral to applications such as quantum machine learning and solving systems of linear equations. Recently, there has been a growing interest in qumodes due to advancements in the field and their potential applications. However there is a notable gap in the literature specifically addressing this area. This paper aims to bridge this gap by providing performance benchmarks of various optimizers used in state preparation with Variational Quantum Algorithms. We conducted extensive testing across multiple scenarios, including different target states, both ideal and sampling simulations, and varying numbers of basis gate layers. Our evaluations offer insights into the complexity of learning each type of target state and demonstrate that some optimizers perform better than others in this context. Notably, the Powell optimizer was found to be exceptionally robust against sampling errors, making it a preferred choice in scenarios prone to such inaccuracies. Additionally, the Simultaneous Perturbation Stochastic Approximation optimizer was distinguished for its efficiency and ability to handle increased parameter dimensionality effectively.

Kan, Shuwen [Fordham University]↗

Foliar functional traits from imaging spectroscopy across biomes in eastern North America

Summary Foliar functional traits are widely used to characterize leaf and canopy properties that drive ecosystem processes and to infer physiological processes in Earth system models. Imaging spectroscopy provides great potential to map foliar traits to characterize continuous functional variation and diversity, but few studies have demonstrated consistent methods for mapping multiple traits across biomes. With airborne imaging spectroscopy data and field data from 19 sites, we developed trait models using partial least squares regression, and mapped 26 foliar traits in seven NEON (National Ecological Observatory Network) ecoregions (domains) including temperate and subtropical forests and grasslands of eastern North America. Model validation accuracy varied among traits (normalized root mean squared error, 9.1–19.4%; coefficient of determination, 0.28–0.82), with phenolic concentration, leaf mass per area and equivalent water thickness performing best across domains. Across all trait maps, 90% of vegetated pixels had reasonable values for one trait, and 28–81% provided high confidence for multiple traits concurrently. Maps of 26 traits and their uncertainties for eastern US NEON sites are available for download, and are being expanded to the western United States and tundra/boreal zone. These data enable better understanding of trait variations and relationships over large areas, calibration of ecosystem models, and assessment of continental‐scale functional diversity.

Wang, Zhihui↗

Q-BEEP: Quantum Bayesian Error Mitigation Employing Poisson Modeling over the Hamming Spectrum

Quantum computing technology has grown rapidly in recent years, with new technologies being explored, error rates being reduced, and quantum processor’s qubit capacity growing. However, near-term quantum algorithms are still unable to be induced without compounding consequential levels of noise, leading to non-trivial erroneous results. Quantum Error Correction (in-situ error mitigation) and Quantum Error Mitigation (post-induction error mitigation) are promising fields of research within the quantum algorithm scene, aiming to alleviate quantum errors, increasing the overall fidelity and hence the overall quality of circuit induction. Earlier this year, a pioneering work, namely HAMMER, published in ASPLOS-22 demonstrated the existence of a latent structure regarding post-circuit induction errors when mapping to the Hamming spectrum. However, they intuitively assumed that errors occur in local clusters, and that at higher average Hamming distances this structure falls away. In this work, we show that such a correlation structure is not only local but extends certain non-local clustering patterns which can be precisely described by a Poisson distribution model taking the input circuit, the device run time status (i.e., calibration statistics) and qubit topology into consideration. Using this quantum error characterizing model, we developed an iterative algorithm over the generated Bayesian network state-graph for post-induction error mitigation. Thanks to more precise modeling of the error distribution latent structure and the new iterative method, our Q-Beep approach provides state of the art performance and can boost circuit execution fidelity by up to 234.6% on Bernstein-Vazirani circuits and on average 71.0% on QAOA solution quality, using 16 practical IBMQ quantum processors. For other benchmarks such as those in QASMBench, the fidelity improvement is up to 17.8%. Q-Beep is a light-weight post-processing technique that can be performed offline and remotely, making it a useful tool for quantum vendors to integrate and provide more reliable circuit induction results.

Stein, Samuel A.↗

Evaluation of dynamic testing of full-scale wind turbine drivetrains with hardware-in-the-loop

Dynamometer testing of full-scale wind turbine drivetrains involves subjecting integrated components to extreme static loads, fatigue loads, or dynamic loads to replicate field conditions. This paper provides a detailed evaluation of the uncertainty and errors in applied loads and measured responses, and their magnitude relative to established repeatability bounds for a drivetrain subjected to static and dynamic loads on the 7.5 MW test bench at the Clemson University Wind Turbine Drivetrain Testing Facility. An ideal drivetrain simulation model is utilized to isolate the influence of load tracking errors on test article responses. It is shown that the test article response variations are mainly driven by run out and clearances inherent to the drivetrain. For the dynamic profiles, the load tracking errors are within acceptable limits. Furthermore, a frequency analysis is used to show that the test bench controller tracking performance is acceptable for profiles with frequency content up to 1.5 Hz.

17 WIND ENERGY↗

An Exploratory Approach Using Regression and Machine Learning in the Analysis of Mass Absorption Cross Section of Black Carbon Aerosols: Model Development and Evaluation

Mass absorption cross-section of black carbon (MAC BC ) describes the absorptive cross-section per unit mass of black carbon, and is, thus, an essential parameter to estimate the radiative forcing of black carbon. Many studies have sought to estimate MAC BC from a theoretical perspective, but these studies require the knowledge of a set of aerosol properties, which are difficult and/or labor-intensive to measure. We therefore investigate the ability of seven data analytical approaches (including different multivariate regressions, support vector machine, and neural networks) in predicting MAC BC for both ambient and biomass burning measurements. Our model utilizes multi-wavelength light absorption and scattering as well as the aerosol size distributions as input variables to predict MAC BC across different wavelengths. We assessed the applicability of the proposed approaches in estimating MAC BC using different statistical metrics (such as coefficient of determination (R 2 ), mean square error (MSE), fractional error, and fractional bias). Overall, the approaches used in this study can estimate MAC BC appropriately, but the prediction performance varies across approaches and atmospheric environments. Based on an uncertainty evaluation of our models and the empirical and theoretical approaches to predict MAC BC , we preliminarily put forth support vector machine (SVM) as a recommended data analytical technique for use. We provide an operational tool built with the approaches presented in this paper to facilitate this procedure for future users.

54 ENVIRONMENTAL SCIENCES↗

Enabling Robust Exoplanet Atmospheric Retrievals with Gaussian Processes

Atmospheric retrievals are essential tools for interpreting exoplanet transmission and eclipse spectra, enabling quantitative constraints on the chemical composition, aerosol properties, and thermal structure of planetary atmospheres. The James Webb Space Telescope (JWST) offers unprecedented spectral precision, resolution, and wavelength coverage, unlocking transformative insights into the formation, evolution, climate, and potential habitability of planetary systems. However, this opportunity is accompanied by challenges: modeling assumptions and unaccounted-for noise or signal sources can bias retrieval outcomes and their interpretation. To address these limitations, we introduce a Gaussian process (GP)-aided atmospheric retrieval framework that flexibly accounts for unmodeled features and correlated noise in exoplanet spectra. We validate this method on synthetic JWST observations, and show that GP-aided retrievals reduce bias in inferred abundances and better capture model–data mismatches than traditional approaches. We also introduce the concept of mean squared error to quantify the trade-off between bias and variance, arguing that this metric more accurately reflects retrieval performance than bias alone. We then reanalyze the NIRISS/SOSS JWST transmission spectrum of WASP-96 b, finding that GP-aided retrievals yield broader constraints on CO 2 and H 2 O, possibly alleviating tension between previous retrieval results and equilibrium predictions. Our GP framework provides precise and accurate constraints while highlighting regions where models fail to explain the data. As JWST matures and future facilities come online, a deeper understanding of the limitations of both data and models will be essential, and GP-enabled retrievals like the one presented here offer a principled path forward.

Rotman, Yoav [Arizona State Univ., Tempe, AZ (Unit↗

Triple-frequency radar retrieval of microphysical properties of snow

Abstract. An algorithm based on triple-frequency (X, Ka, W) radar measurements that retrieves the size, water content and degree of riming of ice clouds is presented. This study exploits the potential of multi-frequency radar measurements to provide information on bulk snow density that should underpin better estimates of the snow characteristic size and content within the radar volume. The algorithm is based on Bayes' rule with riming parameterised by the “fill-in” model. The radar reflectivities are simulated with a range of scattering models corresponding to realistic snowflake shapes. The algorithm is tested on multi-frequency radar data collected during the ESA-funded Radar Snow Experiment For Future Precipitation Mission. During this campaign, in situ microphysical probes were mounted on the same aeroplane as the radars. This nearly perfectly co-located dataset of the remote and in situ measurements gives an opportunity to derive a combined multi-instrument estimate of snow microphysical properties that is used for a rigorous validation of the radar retrieval. Results suggest that the triple-frequency retrieval performs well in estimating ice water content (IWC) and mean mass-weighted diameters obtaining root-mean-square errors of 0.13 and 0.15, respectively, for log 10IWC and log 10Dm. The retrieval of the degree of riming is more challenging, and only the algorithm that uses Doppler information obtains results that are highly correlated with the in situ data.

54 ENVIRONMENTAL SCIENCES↗

Simulation of wind and solar energy generation over California with E3SM SCREAM regionally refined models at 3.25 km and 800 m resolutions

This study presents wind and solar power generation estimates derived from the US Department of Energy’s Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) Regionally Refined Models (RRM) over California at 3.25 km and 800 m horizontal resolutions, using the Python wrapper for the System Advisor Model (PySAM). The resulting wind and solar generation estimates are compared to monthly capacity factors reported to the Energy Information Administration (EIA), High-Resolution Rapid Refresh (HRRR, 3 km resolution) forecast model, and E3SM North American regionally refined model (NARRM, 25 km resolution). We systematically assess the impacts of generation modeling assumptions, meteorological models, and horizontal resolution. Results show that resolution plays a dominant role for wind energy: increasing from 25 to 3.25 km brings qualitative and quantitative improvements, most notably by resolving the phase error in the seasonal cycle found in coarser simulations. However, further refinement to 800 m offers minimal gains. SCREAM performs better than HRRR for solar power generation in single- and dual-axis tracking systems, likely due to more accurate surface radiation. The sensitivity of PySAM to system configuration, particularly for axis-tracking modeling in photovoltaics, is also highlighted. Overall, SCREAM-RRM shows strong potential for high-resolution energy assessments, with future progress depending on more in situ observations and clearer quantification of uncertainties in generation modeling.

Geosciences↗

Design and analysis of a wake model for spatially heterogeneous flow

Abstract. Methods of turbine wake modeling are being developed to more accurately account for spatially variant atmospheric conditions within wind farms. Most current wake modeling utilities are designed to apply a uniform flow field to the entire domain of a wind farm. When this method is used, the accuracy of power prediction and wind farm controls can be compromised depending on the flow-field characteristics of a particular area. In an effort to improve strategies of wind farm wake modeling and power prediction, FLOw Redirection and Induction in Steady State (FLORIS) was developed to implement sophisticated methods of atmospheric characterization and power output calculation. In this paper, we describe an adapted FLORIS model that features spatial heterogeneity in flow-field characterization. This model approximates an observed flow field by interpolating from a set of atmospheric measurements that represent local weather conditions. The objective of this method is to capture heterogeneous atmospheric effects caused by site-specific terrain features, without explicitly modeling the geometry of the wind farm terrain. The implemented adaptations were validated by comparing the simulated power predictions generated from FLORIS to the actual recorded wind farm output from the supervisory control and data acquisition (SCADA) recordings and large eddy simulations (LESs). When comparing the performance of the proposed heterogeneous model to homogeneous FLORIS simulations, the results show a 14.6 % decrease for mean absolute error (MAE) in wind farm power output predictions for cases using wind farm SCADA data and a 18.9 % decrease in LES case studies. The results of these studies also indicate that the efficacy of the proposed modeling techniques may vary with differing site-specific operational conditions. This work quantifies the accuracy of wind plant power predictions under heterogeneous flow conditions and establishes best practices for atmospheric surveying for wake modeling.

17 WIND ENERGY↗