SEARCH · Engineering Papers

Results for “error quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Design of a Molten Salt Flow Cell for Combined Absorbance and Laser-Induced Breakdown Spectroscopy for Online Measurements

A novel flow cell allowing for multiple optical spectroscopy measurements on flowing molten salts was designed, and demonstrative calibrations of impurities in aqueous samples were performed. Online compositional measurements of molten salts are of high interest to monitor the state of relevant solar and nuclear systems. Here, the Spectroscopic Configuration for Optical Real-Time Characterization of High-Temperature (SCORCH) fluids cell was designed to meet this need by providing optical access to a high-temperature molten salt sample stream without physical contact between the sample and window materials. Laser-induced breakdown spectroscopy (LIBS) was utilized to quantify Li, Cr, Fe, Ni, Sr, and Pr at concentrations ranging nominally from 0 to 315 mmol L −1 . Laser power, frequency, and plasma position were optimized to mitigate challenges associated with sample splashing. Univariate calibration models were built with R 2 > 0.98, percent root mean square error of cross-validation (%RMSECV) as low as 2.7%, and limits of quantification (LOQs) down to 4.1 mmol L −1 . Simultaneously, absorbance calibrations were developed for the applicable analytes (Cr, Ni, and Pr) using Beer’s law with a pathlength of 4.41 ± 0.10 mm. These models provide excellent quantification performance with R 2 > 0.999, %RMSECV as low as 0.6%, and LODs down to 0.08 mmol L −1 . Although these calibrations were performed for each spectroscopic technique separately, the two methods may be combined in the future through multivariate modeling and sensor fusion to provide more robust models with the benefits of both techniques (e.g., absorbance: oxidation state concentrations, LIBS: elemental concentration). Additionally, optimized spectrometers may be deployed to enhance sensitivity.

absorbance spectroscopy↗

DOE OSTI2023

Black-box statistical prediction of lossy compression ratios for scientific data

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless compression, no theoretical or data-based quantification of lossy compressibility exists for scientific data. Users rely on trial and error to assess lossy compression performance. As a strong data-driven effort toward quantifying lossy compressibility of scientific datasets, we provide a statistical framework to predict compression ratios of lossy compressors. Our method is a two-step framework where (i) compressor-agnostic predictors are computed and (ii) statistical prediction models relying on these predictors are trained on observed compression ratios. Proposed predictors exploit spatial correlations and notions of entropy and lossyness via the quantized entropy. We study 8+ compressors on 6 scientific datasets and achieve a median percentage prediction error less than 12%, which is substantially smaller than that of other methods while achieving at least a 8.8× speedup for searching for a specific compression ratio and 7.8× speedup for determining the best compressor out of a collection.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2010

Analysis of Wind Tunnel Polar Replicates Using the Modern Design of Experiments

The role of variance in a Modern Design of Experiments analysis of wind tunnel data is reviewed, with distinctions made between explained and unexplained variance. The partitioning of unexplained variance into systematic and random components is illustrated, with examples of the elusive systematic component provided for various types of real-world tests. The importance of detecting and defending against systematic unexplained variance in wind tunnel testing is discussed, and the random and systematic components of unexplained variance are examined for a representative wind tunnel data set acquired in a test in which a missile is used as a test article. The adverse impact of correlated (non-independent) experimental errors is described, and recommendations are offered for replication strategies that facilitate the quantification of random and systematic unexplained variance.

Deloach, Richard↗

NASA NTRS2019

Casper-1, Part 6: Uncertainty Quantification, Factor Effects, and Outlier Analysis for an On-Board Airplane Trajectory Prediction Function

This report presents data analysis results for a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of onboard energy state and automation mode prediction functions for terminal area arrival and approach phases of flight over a wide range of conditions. In particular, the results include quantification of energy state (i.e., altitude and airspeed) prediction performance, models for prediction performance as a function of initial energy state (i.e., initial altitude, airspeed, and weight) and weather factors, and analysis of outlier prediction performance. Wind speed, wind direction, and wind gradient were found to be major factors in energy state prediction performance. Initial energy and gust intensity were also significant factors in airspeed prediction performance. Furthermore, the results suggest that errors in automation mode prediction may be a major contributor to outlier prediction performance.

Torres-Pomales, Wilfredo↗

DOE OSTI2021

Direct determination of cellulosic glucan content in starch-containing samples

A simple and highly selective analytical procedure is presented for the determination of cellulosic glucan content in samples that contain both cellulose and starch. This method eliminates the unacceptably large compounding errors of current two-measurement methods. If both starch and cellulose are present before analytical hydrolysis, both will be hydrolyzed to glucose causing bias and inaccuracy in the method. To prevent this interference, the removal of starch prior to cellulosic quantification is crucial. The method presented here is a concise in-series procedure with minimal measurements, eliminating large compounding errors. Sample preparation consists of a starch extraction employing enzymatic hydrolysis followed by a simple filtration and wash. The samples are then subjected to a two-stage acid hydrolysis. The concentration of glucose is determined by ion exchange high-performance liquid chromatography with a Pb 2+ column and a refractive index detector. The cellulosic glucan content is calculated based on the initial dry weight of the starting material. Data for the native biomass materials studied show excellent reproducibility, with coefficients of variance of 3.0% or less associated with the method. This selectivity for cellulosic glucan by the procedure was validated with several analytical techniques such as liquid chromatography coupled with mass spectrometry (LC–MS), Raman spectroscopy, and nuclear magnetic resonance.

09 BIOMASS FUELS↗

DOE OSTI2023

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

As a type of human actions defined in human reliability analysis (HRA), pre-initiator refers to the human actions that may lead to the unavailability of systems, typically committed during maintenance, test, or calibration. This paper investigates representative HRA methods used for analyzing pre-initiators. The HRA methods are Technique for Human Error Rate Prediction (THERP), Korean Standard HRA (K-HRA) and Standard Plant Risk HRA (SPAR-H). In this paper, characteristics of each HRA method are compared for qualitative and quantification aspects. Two pre-initiators, i.e., a calibration task and a valve restoration task, are analyzed using the HRA methods to compare human error probabilities. Then, insights from the analysis and additional research requirements are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

INVESTIGATION OF HUMAN RELIABILITY ANALYSIS METHODS FOR ANALYZING PRE-INITIATORS

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS2004

Model Update of a Micro Air Vehicle (MAV) Flexible Wing Frame with Uncertainty Quantification

This paper describes a procedure to update parameters in the finite element model of a Micro Air Vehicle (MAV) to improve displacement predictions under aerodynamics loads. Because of fabrication, materials, and geometric uncertainties, a statistical approach combined with Multidisciplinary Design Optimization (MDO) is used to modify key model parameters. Static test data collected using photogrammetry are used to correlate with model predictions. Results show significant improvements in model predictions after parameters are updated; however, computed probabilities values indicate low confidence in updated values and/or model structure errors. Lessons learned in the areas of wing design, test procedures, modeling approaches with geometric nonlinearities, and uncertainties quantification are all documented.

Reaves, Mercedes C.↗

DOE OSTI2024

MultiPEM Toolbox: User Manual [Rev. 2]

This document explains use of the Multi-Phenomenology Explosion Monitoring (Multi PEM) Toolbox, a collection of R scripts for estimating the unknown device parameters of a new event with uncertainty quantification. The methodology and application used for illustration in this user manual are fully documented in a Los Alamos National Laboratory technical report hereafter designated “WPA” for reference. Additional details on the application are found in a recent journal article. Two assessment types are available: rapid and complete. Rapid assessments are conducted in two stages, as described in Section 2. In the first stage, calibration data are used to estimate forward and error model parameters (WPA, §5.1) and (if relevant) errors-in-variables yield values for calibration sources (WPA, §3, Equation (3)). In the second stage, new event data are used to estimate the unknown new event device parameters (WPA, §5.2) with uncertainty quantification. Two options for treating the inferred first stage parameters in second stage Bayesian analysis are available: fixing them at their maximum likelihood estimate (default), or multiple imputation. Multiple imputation involves utilizing several posterior samples (imputations) of the first stage parameters as fixed values in the second stage posterior sampling of the new event device parameters. Second stage sampling is conducted across imputations in parallel to improve computational efficiency. This method produces improved uncertainty quantification of the new event device parameters compared with the default treatment of the first stage parameters, at the expense of additional computation. Complete assessments are conducted in a single stage, as described in Section 3. Calibration and (if relevant) new event data are used simultaneously to estimate all forward model, error model, and (if relevant) new event device parameters with uncertainty quantification on the latter. As the name suggests, rapid assessments generally run substantially faster than complete assessments (even with multiple imputation), because the results of first stage analysis can be stored and incorporated into estimating a relatively low-dimensional space of new event device parameters whenever relevant new event data becomes available. On the other hand, complete assessments must be run on the full set of model and device parameters with calibration and new event data every time the latter becomes available.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗

DOE OSTI2022

Transport error estimation using residual Monte Carlo

The residual Monte Carlo (RMC) method is also known in the literature as sequential Monte Carlo and reduced-source Monte Carlo. Given a Monte Carlo method for solving a linear equation and an approximate solution to that system, the residual method enables use of essentially the same Monte Carlo algorithm to directly compute the additive error or “defect” associated with the approximate solution. As the size of the defect decreases relative to the size of the solution, the residual Monte Carlo method becomes increasingly efficient relative to the standard Monte Carlo (SMC) method. Here we present a new RMC algorithm for evaluating the space-angle error in S n radiation transport solutions, and provide computational examples demonstrating that it can be far more efficient than SMC for this purpose. Herein we also describe a particular pitfall that must be avoided if RMC is to be efficient, and explain why the performance of RMC can significantly differ between different transport problems and different quantities of interest for the same problem.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Data Generation for Machine Learning Interatomic Potentials and Beyond

The field of data-driven chemistry is undergoing an evolution, driven by innovations in machine learning models for predicting molecular properties and behavior. Recent strides in ML-based interatomic potentials have paved the way for accurate modeling of diverse chemical and structural properties at the atomic level. The key determinant defining MLIP reliability remains the quality of the training data. A paramount challenge lies in constructing training sets that capture specific domains in the vast chemical and structural space. This Review navigates the intricate landscape of essential components and integrity of training data that ensure the extensibility and transferability of the resulting models. We delve into the details of active learning, discussing its various facets and implementations. We outline different types of uncertainty quantification applied to atomistic data acquisition and the correlations between estimated uncertainty and true error. The role of atomistic data samplers in generating diverse and informative structures is highlighted. Furthermore, we discuss data acquisition via modified and surrogate potential energy surfaces as an innovative approach to diversify training data. The Review also provides a list of publicly available data sets that cover essential domains of chemical space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1990

Design for validation, based on formal methods

Validation of ultra-reliable systems decomposes into two subproblems: (1) quantification of probability of system failure due to physical failure; (2) establishing that Design Errors are not present. Methods of design, testing, and analysis of ultra-reliable software are discussed. It is concluded that a design-for-validation based on formal methods is needed for the digital flight control systems problem, and also that formal methods will play a major role in the development of future high reliability digital systems.

Butler, Ricky W.↗

DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS2015

Airborne Lidar-Based Estimates of Tropical Forest Structure in Complex Terrain: Opportunities and Trade-Offs for REDD+

Background: Carbon stocks and fluxes in tropical forests remain large sources of uncertainty in the global carbon budget. Airborne lidar remote sensing is a powerful tool for estimating aboveground biomass, provided that lidar measurements penetrate dense forest vegetation to generate accurate estimates of surface topography and canopy heights. Tropical forest areas with complex topography present a challenge for lidar remote sensing. Results: We compared digital terrain models (DTM) derived from airborne lidar data from a mountainous region of the Atlantic Forest in Brazil to 35 ground control points measured with survey grade GNSS receivers. The terrain model generated from full-density (approx. 20 returns/sq m) data was highly accurate (mean signed error of 0.19 +/-0.97 m), while those derived from reduced-density datasets (8/sq m, 4/sq m, 2/sq m and 1/sq m) were increasingly less accurate. Canopy heights calculated from reduced-density lidar data declined as data density decreased due to the inability to accurately model the terrain surface. For lidar return densities below 4/sq m, the bias in height estimates translated into errors of 80-125 Mg/ha in predicted aboveground biomass. Conclusions: Given the growing emphasis on the use of airborne lidar for forest management, carbon monitoring, and conservation efforts, the results of this study highlight the importance of careful survey planning and consistent sampling for accurate quantification of aboveground biomass stocks and dynamics. Approaches that rely primarily on canopy height to estimate aboveground biomass are sensitive to DTM errors from variability in lidar sampling density.

Airborne lidar↗

DOE OSTI2025

Adaptive Uncertainty Quantification for Stochastic Hyperbolic Conservation Laws

Here, we propose a predictor-corrector adaptive method for the study of hyperbolic partial differential equations (PDEs) under uncertainty. Constructed around the framework of stochastic finite volume (SFV) methods, our approach circumvents sampling schemes or simulation ensembles while also preserving fundamental properties, in particular hyperbolicity of the resulting systems and conservation of the discrete solutions. Furthermore, we augment the existing SFV theory with a priori convergence results for statistical quantities, in particular push-forward densities, which we demonstrate through numerical experiments. By linking refinement indicators to regions of the physical and stochastic spaces, we drive anisotropic refinements of the discretizations, introducing new degrees of freedom where deemed profitable. To illustrate our proposed method, we consider a series of numerical examples for nonlinear hyperbolic PDEs based on Burgers’ and Euler’s equations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Demonstration of machine-learning-enhanced Bayesian quantum state estimation

Machine learning (ML) has found broad applicability in quantum information science in topics as diverse as experimental design, state classification, and even studies on quantum foundations. Here, we experimentally realize an approach for defining custom prior distributions that are automatically tuned using ML for Bayesian quantum state estimation methods that generally better conform to the physical properties of the underlying system than standard fixed prior distributions. Previously, researchers have looked to Bayesian quantum state tomography for advantages like uncertainty quantification, the return of reliable estimates under any measurement condition, and minimal mean-squared error. However, practical challenges related to long computation times and conceptual issues concerning how to incorporate prior knowledge most suitably can overshadow these benefits. Using both simulated and experimental measurement results, we demonstrate that ML-defined prior distributions reduce net convergence times and provide a natural way to incorporate both implicit and explicit information directly into the prior distribution. These results constitute a promising path toward practical implementations of Bayesian quantum state tomography.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗