Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Error quantification of the Arrhenius blending rule for viscosity of hydrocarbon mixtures

Six hundred and seventy-five measurements of dynamic viscosity and density have been used to assess the prediction error of the Arrhenius blending rule for kinematic viscosity of hydrocarbon mixtures. Major trends within the data show that mixture complexity–binary to hundreds of components—and temperature are more important determinants of prediction error than differences in molecular size or hydrogen saturation between the components of the mixtures. Over the range evaluated, no correlation between prediction error and mole fractions was observed, suggesting the log of viscosity truly is linear in mole fraction, as indicated by the Arrhenius blending rule. Mixture complexity and temperature also impact molar volume and its prediction. However, a linear regression between the two model errors explains less than 20% of the observed variation, indicating that mixture viscosity and/or molar volume are not linear with respect to temperature and/or mixture complexity. Extensive discussion of the intermolecular forces and the geometric arrangement of molecules and vacancies in liquids, which ultimately determines its viscosity, is brought into context with the implicit approximations behind the Arrhenius blending rule. The complexity of this physics is not compatible with a simple algebraic correction to the model. However, sufficient data is now available to determine confidence intervals around the prediction of fuel viscosity based on its component mole fractions and viscosities. At -40°C, when all identified components are pure molecules the modeling error is 13.2% of the predicted (nominal) viscosity times the root mean square of the component mole fractions.

10 SYNTHETIC FUELS↗

Error quantification and comparison of binary neutron star gravitational waveforms from numerical relativity codes

Future gravitational wave detections of merging binary neutron star systems have the possibility to tightly constrain the equation of state of dense nuclear matter. In order to extract such constraints, gravitational waveform models need to be calibrated to accurate numerical relativity simulations of the late inspiral and merger. In this work, we take an essential step toward classifying the error and potential systematics in current generation numerical relativity simulations of merging binary neutron stars. To this end, we perform a direct comparison of two codes (fil, spec), which differ in many aspects, including the numerical methods and discretizations used and equations solved. We find that despite these different approaches, the codes are—within current numerical resolution bounds—fully consistent, and broadly comparable in cost for a given accuracy level. Our results indicate that the error in the waveforms is primarily dominated by the hydrodynamic evolution, consistent with earlier findings in the literature. Finally, we also discuss current limitations and cost estimates for numerical relativity simulations to reach the accuracies required in the era of next-generation gravitational detectors.

gravitational waves↗

Uncertainty Quantification and Error Propagation in the Enthalpy and Entropy of Surface Reactions Arising from a Single DFT Functional

Accounting for parametric uncertainty in models is essential for quantifying the models’ predictive ability. Recently, approaches have been introduced to estimate parametric uncertainty in kinetic models while accounting for correlations among energy parameters. However, correlations have been estimated indirectly and correlations in entropies have not been accounted for. For surface-catalyzed microkinetic models of >C2 (more than two carbon-containing) molecules, which consist of thousands of reaction steps and intermediate surface species, first-principles density functional theory (DFT) is costly, and thus, estimation of thermochemistry and reaction barriers requires surrogate methods of DFT, such as group additivity and Brønsted–Evans–Polanyi relationships, respectively. For such parametrization, model uncertainty is unclear. This work develops a framework to overcome these gaps using group additivity and a single DFT functional. We estimate correlations in parameters of kinetic models and quantify uncertainty for thermochemistry, reaction barriers, reaction paths, and ultimately reaction rates, accounting also for the contribution of entropic uncertainty. Furthermore, the approach is illustrated on propane combustion and ethane oxidative dehydrogenation reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Solution Irregularity Remediation for Spatial Discretization Error Estimation for S N Transport Solutions

The discrete ordinates linear Boltzmann transport equation is typically solved in its spatially discretized form, incurring spatial discretization error. Quantification of this error for purposes such as adaptive mesh refinement or error analysis requires an a posteriori estimator, which utilizes the numerical solution to the spatially discretized equation to compute an estimate. Because the quality of the numerical solution informs the error estimate, irregularities, present in the true solution for any realistic problem configuration, tend to cause the largest deviation in the error estimate vis-a-vis the true error. In this paper, an analytical partial singular characteristic tracking (pSCT) procedure for reducing the estimator’s error is implemented within our novel residual source estimator for a zeroth-order discontinuous Galerkin scheme, at the additional cost of a single inner iteration. Here, a metric-based evaluation of the pSCT scheme versus the standard residual source estimator is performed over the parameter range of a Method of Manufactured Solutions test suite. The pSCT scheme generates near-ideal accuracy in the estimate in problems where the dominant source of the estimator’s error is the solution irregularity, namely, problems where the true solution is discontinuous and problems where the true solution’s first derivative is discontinuous and the scattering ratio is low. In problems where the scattering ratio is high and the true solution is discontinuous in the first derivative, the error in the scattering source, which is not converged by the pSCT scheme, is greater than the error incurred due to the irregularity. Ultimately, a pSCT scheme is judged to be useful for error estimation in problems where the computational cost of the scheme is justified. In the presence of many irregularities, such a scheme may be intractable for general use, but in benchmarks, as an analytical tool, or in problems that have nondissipative discontinuities, the scheme may prove invaluable.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Time-series machine-learning error models for approximate solutions to parameterized dynamical systems

This work proposes a machine-learning framework for modeling the error incurred by approximate solutions to parameterized dynamical systems. In particular, we extend the machine-learning error models (MLEM) framework proposed in Ref. Freno and Carlberg (2019) to dynamical systems. The proposed Time-Series Machine-Learning Error Modeling (T-MLEM) method constructs a regression model that maps features – which comprise error indicators that are derived from standard a posteriori error-quantification techniques – to a random variable for the approximate-solution error at each time instance. The proposed framework considers a wide range of candidate features, regression methods, and additive noise models. We consider primarily recursive regression techniques developed for time-series modeling, including both classical time-series models (e.g., autoregressive models) and recurrent neural networks (RNNs), but also analyze standard non-recursive regression techniques (e.g., feed-forward neural networks) for comparative purposes. Finally, numerical experiments conducted on multiple benchmark problems illustrate that the long short-term memory (LSTM) neural network, which is a type of RNN, outperforms other methods and yields substantial improvements in error predictions over traditional approaches.

42 ENGINEERING↗

A Novel Simulation-Based Framework for Sensor Error Impact Analysis in Smart Building Systems: A Case Study for a Demand-Controlled Ventilation System

Sensors are one of the fundamental components for sensor-rich controls in buildings but are prone to different errors. Existing studies show that sensor errors hold a place among top-priority faults in building systems. Before we take countermeasures to mitigate the sensor errors, it is vital to prioritize key sensors and quantify the collective impacts of concurrent sensor errors. In response to this, a simulation-based methodology is introduced to conduct a comprehensive sensor error impact analysis in building systems, which adds a stochastic sensor prioritization through a sensitivity analysis on top of a commonly used deterministic sensor error quantification. The synergies of these two parts help better interpret the sensor error impacts on building energy consumption, ventilation performance, thermal comfort, etc. A sensor-rich CO2-based Demand-Controlled Ventilation system is used as a case study to demonstrate the viability of the methodology as a proof-of-the-concept. The results show that the energy savings potential and ventilation performance are mostly influenced by the accuracy of the AHU outdoor airflow sensors. The accuracy of zone level airflow sensors has a negligible impact on both energy savings and ventilation performance. The accuracy of zone CO2 sensors has more influence on the ventilation performance compared with the accuracy of zone airflow sensors. Compared with the baseline case with zero errors, the largest deviation percentages could reach 16.90% and 94.32%, respectively, in terms of the Heating, Ventilation, and Air-Conditioning (HVAC) annual energy consumption and the Outdoor Air Ratio (OAR) when multiple key sensors suffer from normal error intensities simultaneously.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of Readily Available & Robust High Heat Flux Gardon Gauges

Concentrated solar power (CSP) technologies deliver concentrated solar energy as a heat source to industrial processes, power generation cycles, and chemical cycles. CSP systems require accurate and reliable high flux measurements, and next generation CSP systems will require flux measurement up to 1000 W/cm2. Existing flux measurement devices do not comprehensively meet the flux rating, cycle life, cost, and lead-time needs of stakeholders, necessitating the development of an improved flux sensor. In this study, Sandia National Laboratories (SNL) partnered with Hukseflux Thermal Sensors to develop a low-cost, short lead-time, and robust flux sensor rated to 250 W/cm2. Three prototype circular foil gauge designs were assessed for performance at the National Solar Thermal Test Facility (NSTTF) at SNL. Each gauge design measured flux up to 250 W/cm2 with <5% measurement error. Following baseline error quantification, gauges were exposed to flux above 500 W/cm2 to assess gauge failure mechanisms. Gauges physically survived >500 W/cm2 flux exposure, but measurement error was found to increase after foil coatings reached 400 °C. The results of this study suggest that coating optical properties change at excessive temperatures and that foil coating temperature, rather than heat flux level, dictates the acceptable gauge measurement range.

McLaughlin, Luke (ORCID:0000000303711310)↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Methane Quantification Performance of the Quantitative Optical Gas Imaging (QOGI) System Using Single-Blind Controlled Release Assessment

Quantitative optical gas imaging (QOGI) system can rapidly quantify leaks detected by optical gas imaging (OGI) cameras across the oil and gas supply chain. A comprehensive evaluation of the QOGI system’s quantification capability is needed for the successful adoption of the technology. This study conducted single-blind experiments to examine the quantification performance of the FLIR QL320 QOGI system under near-field conditions at a pseudo-realistic, outdoor, controlled testing facility that mimics upstream and midstream natural gas operations. The study completed 357 individual measurements across 26 controlled releases and 71 camera positions for release rates between 0.1 kg Ch 4 /h and 2.9 kg Ch 4 /h of compressed natural gas (which accounts for more than 90% of typical component-level leaks in several production facilities). The majority (75%) of measurements were within a quantification factor of 3 (quantification error of –67% to 200%) with individual errors between –90% and 831%, which reduced to –79% to +297% when the mean of estimates of the same controlled release from multiple camera positions was considered. Performance improved with increasing release rate, using clear sky as plume background, and at wind speeds ≤1 mph relative to other measurement conditions.

42 ENGINEERING↗

BUQEYE guide to projection-based emulators in nuclear physics

The BUQEYE collaboration (Bayesian Uncertainty Quantification: Errors in Your effective field theory) presents a pedagogical introduction to projection-based, reduced-order emulators for applications in low-energy nuclear physics. The term emulator refers here to a fast surrogate model capable of reliably approximating high-fidelity models. As the general tools employed by these emulators are not yet well-known in the nuclear physics community, we discuss variational and Galerkin projection methods, emphasize the benefits of offline-online decompositions, and explore how these concepts lead to emulators for bound and scattering systems that enable fast and accurate calculations using many different model parameter sets. We also point to future extensions and applications of these emulators for nuclear physics, guided by the mature field of model (order) reduction. All examples discussed here and more are available as interactive, open-source Python code so that practitioners can readily adapt projection-based emulators for their own work.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Combined Mixed Potential Electrochemical Sensors and Artificial Neural Networks for the Quantificationand Identification of Methane in Natural Gas Emissions Monitoring

Sensors capable of quantifying methane concentration and discriminating between possible sources are needed for natural gas leak detection where multiple spatially overlapping sources including wetlands and agriculture may be present. We report on the fabrication by an additive manufacturing process of a four electrode La 0.87 Sr 0.13 CrO 3 , Indium Tin Oxide (In 2 O 3 90 wt%, SnO 2 10 wt%), Au, Pt mixed potential electrochemical sensor using yttria-stabilized zirconia (YSZ) as a solid electrolyte to natural gas detection. Artificial neural networks (ANNs) are used to automatically decode the possible source and concentration of methane. The ANNs trained on sensor data are capable of correctly discriminating between three sources of methane emissions from simulated mixtures of emissions from cattle, wetlands, or natural gas with >98% accuracy. Quantification error for methane in mixtures of CH 4 in air, CH 4 + NH3 in air, and simulated natural gas is less than 1.5% ppm when a two-temperature dataset is employed.

03 NATURAL GAS↗

Artificial Intelligence for Autonomous Molecular Design: A Perspective

Domain-aware artificial intelligence has been increasingly adopted in recent years to expedite molecular design in various applications, including drug design and discovery. Recent advances in areas such as physics-informed machine learning and reasoning, software engineering, high-end hardware development, and computing infrastructures are providing opportunities to build scalable and explainable AI molecular discovery systems. This could improve a design hypothesis through feedback analysis, data integration that can provide a basis for the introduction of end-to-end automation for compound discovery and optimization, and enable more intelligent searches of chemical space. Several state-of-the-art ML architectures are predominantly and independently used for predicting the properties of small molecules, their high throughput synthesis, and screening, iteratively identifying and optimizing lead therapeutic candidates. However, such deep learning and ML approaches also raise considerable conceptual, technical, scalability, and end-to-end error quantification challenges, as well as skepticism about the current AI hype to build automated tools. To this end, synergistically and intelligently using these individual components along with robust quantum physics-based molecular representation and data generation tools in a closed-loop holds enormous promise for accelerated therapeutic design to critically analyze the opportunities and challenges for their more widespread application. This article aims to identify the most recent technology and breakthrough achieved by each of the components and discusses how such autonomous AI and ML workflows can be integrated to radically accelerate the protein target or disease model-based probe design that can be iteratively validated experimentally. Taken together, this could significantly reduce the timeline for end-to-end therapeutic discovery and optimization upon the arrival of any novel zoonotic transmission event. Our article serves as a guide for medicinal, computational chemistry and biology, analytical chemistry, and the ML community to practice autonomous molecular design in precision medicine and drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗

On the Viability of Video Imaging in Leak Rate Quantification: A Theoretical Error Analysis

Optical gas imaging through multispectral cameras is a promising technique for mitigation of methane emissions through localization and quantification of emissions sources. While more advanced cameras developed in recent years have led to lower uncertainties in measuring gas concentrations, a systematic analysis of the uncertainties associated with leak rate estimation have been overlooked. We present a systematic categorization of the involved uncertainties with a focus on a theoretical analysis of projection uncertainties that are inherent to this technique. The projection uncertainties are then quantified using Large Eddy Simulation experiments of a point source release into the atmosphere. Our results show that while projection uncertainties are typically about 5% of the emission rate, low acquisition times and observation of the gas plume at small distances from the emission source (<10 m) can amount to errors of about 20%. Further, we found that acquisition times on the order of tens of seconds are sufficient to significantly reduce (>50%) the projection uncertainties. These findings suggest robust procedures on how to reduce projection uncertainties, however, a balance between other sources of uncertainty due to operational conditions and the employed instrumentation are required to outline more practical guidelines.

47 OTHER INSTRUMENTATION↗

Simultaneous inference of equation of state parameters and unknown data errors with uncertainty quantification via hierarchical Bayesian posterior maximization

Equations of state (EOSs) are a key component in running hydrodynamic simulations as they relate the thermodynamic states for the material. The Davis reactants EOS is commonly used for modeling high explosives (HEs), and the EOS model parameters are calibrated using material specific data. The calibrations are often performed with uncertainty quantification via Bayesian inference to account for uncertainty in the data and generate ensembles of likely parameters. However, there are relatively few HE data sets to use for calibration and many are historical and lack error information. In this work, we simultaneously calibrate the Davis reactants EOS model parameters and unknown data error terms for the high explosive PBX 9501. To quantify the uncertainty in the models and the data, we use a Bayesian framework for the calibration and compute the hierarchical Bayesian posterior distribution with both a posteriori maximization approach and Markov Chain Monte Carlo. In general, we find that, given our assumptions, the two approaches result in similar calibrated parameters, posterior covariance matrices, and insights about the parameters but that the posterior maximization requires far less computational resources.

97 MATHEMATICS AND COMPUTING↗

Quantification and prediction of error in MIMO tests

Dynamic testing of systems is most realistic of real-world conditions when multiple input and multiple output (MIMO) techniques are used. To replicate measured environmental conditions, a series of desired outputs (responses) on the system must be realized by inverting the frequency response functions (FRF) matrix for input estimation. System identification is dependent on the number of inputs and outputs, which affect the type of solutions. In input estimation, the auto spectra of the determined inputs are affected by both the auto spectra and cross spectra of the desired outputs. This research evaluates errors and investigates two sources in an experimental setting. The first significant error source is test-to-test variability in FRFs from system identification tests, quantified by magnitude variability from long-duration tests. The second significant error source is the realization of time histories from frequency domain inputs. The spectral content of the realized random process deviates from the desired content and is also quantified. The structure is a linear three-story frame fixed at the base; two inputs are provided uniaxially with the use of suspended electrodynamic shakers. The proposed model for error sources was found to be effective in predicting errors in a SISO (single-input single-output) and a square (2-input 2-output) MIMO test.

Yousef, Odey↗