Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Confidence interval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

EPR-based uncertainty validation of the calculated external doses for population exposed in the urals region

Tooth enamel Electron Paramagnetic Resonance (EPR) spectroscopy was used as a method for external dosimetry in the territories contaminated in the 1950s by PA ‘Mayak’ (Urals region) to validate the mean dose estimates predicted by the Techa River Dosimetry System (TRDS). The purpose of this study is to validate the uncertainties of TRDS doses. Ninety percent confidence intervals (90% confidence interval, CI) of dose estimated with both methods were compared for 220 people. All data were grouped according to the width of 90%CI, viz.: (1) 90%CI of EPR-based dose ≤ 90%CI of TRDS prediction (38 cases); (2) 90%CI of EPR-based dose > 90%CI of TRDS prediction (182 cases). About 91% of 90%CIs overlap. In group 1, 100% cases overlap. In group 2, 80% of the cases were non-contradictive (the calculated 90%CI is completely within the measured one). Interval comparison of doses predicted retrospectively and estimated based on individual measurements are non-contradictory and demonstrate a good agreement.

61 RADIATION PROTECTION AND DOSIMETRY↗

Uncertainty and Sensitivity Analyses of a Two-Parameter Impedance Prediction Model

This paper presents comparisons of predicted impedance uncertainty limits derived from Monte-Carlo-type simulations with a Two-Parameter (TP) impedance prediction model and measured impedance uncertainty limits based on multiple tests acquired in NASA Langley test rigs. These predicted and measured impedance uncertainty limits are used to evaluate the effects of simultaneous randomization of each input parameter for the impedance prediction and measurement processes. A sensitivity analysis is then used to further evaluate the TP prediction model by varying its input parameters on an individual basis. The variation imposed on the input parameters is based on measurements conducted with multiple tests in the NASA Langley normal incidence and grazing incidence impedance tubes; thus, the input parameters are assigned uncertainties commensurate with those of the measured data. These same measured data are used with the NASA Langley impedance measurement (eduction) processes to determine the corresponding measured impedance uncertainty limits, such that the predicted and measured impedance uncertainty limits (95% confidence intervals) can be compared. The measured reactance 95% confidence intervals encompass the corresponding predicted reactance confidence intervals over the frequency range of interest. The same is true for the confidence intervals of the measured and predicted resistance at near-resonance frequencies, but the predicted resistance confidence intervals are lower than the measured resistance confidence intervals (no overlap) at frequencies away from resonance. A sensitivity analysis indicates the discharge coefficient uncertainty is the major contributor to uncertainty in the predicted impedances for the perforate-over-honeycomb liner used in this study. This insight regarding the relative importance of each input parameter will be used to guide the design of experiments with test rigs currently being brought on-line at NASA Langley.

Jones, M. G.↗

Systematic study of projection biases in the weak lensing analysis of cosmic shear and the combination of galaxy clustering and galaxy-galaxy lensing

This paper presents the results of a systematic study of projection biases in the weak lensing analysis of cosmic shear and the combination of galaxy clustering and galaxy-galaxy lensing using data collected during the first year of running the Dark Energy Survey experiment. The study uses Lambda cold dark matter ( Λ CDM ) as the cosmological model and two-point correlation functions for the weak lensing (WL) analysis. The results in this paper show that, independent of the WL analysis, projection biases of more than 1 σ exist and are a function of the position of the true values of the parameters h , n s , Ω b , and Ω ν h 2 with respect to their prior probabilities. For cosmic shear, and the combination of galaxy clustering and galaxy-galaxy lensing, this study shows that the coverage probability of the 68.27% credible intervals ranges from as high as 93% to as low as 16% and that these credible intervals are inflated, on average, by 29% for cosmic shear and 20% for the combination of galaxy clustering and galaxy-galaxy lensing. The results of the study also show that, in six out of nine tested cases, the reduction in error bars obtained by transforming credible intervals into confidence intervals is equivalent to an increase in the amount of data by a factor of 3.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison of Entry Descent and Landing Aerodynamic Databases with Uncertainty Quantification Developed Using Machine Learning Techniques

When developing the aerodynamic databases for use in trajectory simulations, it is important to develop a system of metrics to qualify which aerodynamic models are best to use. Since aerodynamics are just one input into trajectory simulations, the results of these simulations do not reflect on the quality of the aerodynamic database used. This means that aerodynamic database comparisons must be done offline. While traditional metrics that focus on mean/nominal predictions are a good first step, more robust estimates of the prediction interval become important as more focused uncertainty models are developed. We explore the limitations of evaluating aerodynamic models based purely on nominal-centered response surfaces. Before elaborating and evaluating metrics based on distributed models, the value of evaluating prediction interval and confidence interval are discussed to conclude that prediction intervals are more relevant to the use of trajectory analysis. Several metrics to evaluate the prediction interval are introduced with a focus on the standard calibration metric. Finally, we compare candidate models using both mean and distributed metrics. A finalized candidate model developed using state of the art machine learning methods is compared to a baseline model developed using traditional aerodynamic database modeling techniques.

Aerodynamic Database↗

UV Spectral Variability and the Lyman-Alpha Forest in the Lensed Quasar Q0957+561

Far-ultraviolet spectra of the gravitational lens components Q0957+561 A and B were obtained with the Hubble Space Telescope Faint Object Spectrograph (FOS) at five equally spaced epochs, one every two weeks. We confirm the flux variability of the quasar's Lyman-alpha and O VI lambda 1037 emission lines reported in IUE (International Ultraviolet Explorer) spectra. The fluxes in these lines vary on a time scale of weeks in the local rest frame (LRF), independently of each other and of the surrounding continuum. The individual spectra of each image were co-added to investigate the properties of the Lyman-alpha forest along the two lines of sight to the quasar. Absorption lines having equivalent width W (sub lambda) greater than or equal to 0.3 Angstroms in the LRF not previously identified as interstellar lines, metal lines, or higher order Lyman lines were taken to be LY-alpha forest lines. The existence of each line in this consistently selected set was then verified by its presence in two archival FOS spectra with approx. 1.5 times higher signal to noise than our co-added spectra. Ly-alpha forest lines with W (sub lambda) greater than or equal to 0.3 Angstroms appear at 42 distinct wavelengths in the spectra of the two images. Two absorption lines in the spectrum of image A have no counterpart at that wavelength in the spectrum of image B, and two lines in image B have no counterpart in image A. Based on the separation of the lines of sight at the redshift of the absorption lines appearing in only one spectrum, the density of the absorbing clouds in the direction of Q0957+561 must change significantly over a distance of 79 (+34, -26) h (sub 50) (sup -1) kpc in the simplified model where the absorbers are treated as spherical clouds and the characteristic dimension is the radius. (We adopt H (sub 0)= 50 h (sub 50) km s (sup -1) kpc (sup -1), q (sub 0) = 1/2, and LAMBDA = 0 throughout the paper.) The two limits define the 68% confidence interval on the characteristic dimension, equivalent to the 1 sigma confidence interval for a Gaussian distribution. The 95% confidence interval extends from (32 - 250) h (sub 50) (sup -1) kpc. We show in the Appendix that the fraction of Ly-alpha forest lines that appear in only one spectrum can be expressed as a rapidly converging power series in 1/r, where r the ratio of the radius of the cloud to the separation of the two LOS at the redshift of the cloud. This power series can be rewritten to give r in terms of the fraction of Ly-alpha forest wavelengths that appear in the spectrum of only one image. A simple linear approximation to the solution which everywhere agrees with the power series solution to better than 0.8% for r greater than or equal to 2 is derived in the Appendix.

Dolan, J. F.↗

Lung Cancer in the Mayak Workers Cohort: Risk Estimation and Uncertainty Analysis

The workers at the Mayak nuclear facility near Ozyorsk, Russia are a primary source of information about exposure to radiation at low-dose rates, since they were subject to protracted exposures to external gamma rays and to internal exposures from plutonium inhalation. Here we re-examine lung cancer mortality rates and assess the effects of external gamma and internal plutonium exposures using recently developed Monte Carlo dosimetry systems. Using individual lagged mean annual lung doses computed from the dose realizations, we fit excess relative risk (ERR) models to the lung cancer mortality data for the Mayak Workers Cohort using risk-modeling software. We then used the corrected information matrix (CIM) approach to widen the confidence intervals of ERR by taking into account the uncertainty in doses represented by multiple realizations from the Monte Carlo dosimetry systems. Findings of this work revealed that there were 930 lung cancer deaths during follow-up. Plutonium lung doses (but not gamma doses) were generally higher in the new dosimetry systems than those used in the previous analysis. This led to a reduction in the risk per unit dose compared to prior estimates. The estimated ERR/Gy for external gamma-ray exposure was 0.19 (95% CI: 0.07 to 0.31) for both sexes combined, while the ERR/Gy for internal exposures based on mean plutonium doses were 3.5 (95% CI: 2.3 to 4.6) and 8.9 (95% CI: 3.4 to 14) for males and females at attained age 60. Accounting for uncertainty in dose had little effect on the confidence intervals for the ERR associated with gamma-ray exposure, but had a marked impact on confidence intervals, particularly the upper bounds, for the effect of plutonium exposure [adjusted 95% CIs: 1.5 to 8.9 for males and 2.7 to 28 for females]. In conclusion, lung cancer rates increased significantly with both external gamma-ray and internal plutonium exposures. Accounting for the effects of dose uncertainty markedly increased the width of the confidence intervals for the plutonium dose response but had little impact on the external gamma dose effect estimate. Adjusting risk estimate confidence intervals using CIM provides a solution to the important problem of dose uncertainty. This work demonstrates, for the first time, that it is possible and practical to use our recently developed CIM method to make such adjustments in a large cohort study.

uncertainty, radiation risk estimation, Mayak Prod↗

Inference in infinite-dimensional inverse problems - Discretization and duality

Many techniques for solving inverse problems involve approximating the unknown model, a function, by a finite-dimensional 'discretization' or parametric representation. The uncertainty in the computed solution is sometimes taken to be the uncertainty within the parametrization; this can result in unwarranted confidence. The theory of conjugate duality can overcome the limitations of discretization within the 'strict bounds' formalism, a technique for constructing confidence intervals for functionals of the unknown model incorporating certain types of prior information. The usual computational approach to strict bounds approximates the 'primal' problem in a way that the resulting confidence intervals are at most long enough to have the nominal coverage probability. There is another approach based on 'dual' optimization problems that gives confidence intervals with at least the nominal coverage probability. The pair of intervals derived by the two approaches bracket a correct confidence interval. The theory is illustrated with gravimetric, seismic, geomagnetic, and helioseismic problems and a numerical example in seismology.

Stark, Philip B.↗

A Supplementary Clear-Sky Snow and Ice Recognition Technique for CERES Level 2 Products

Identification of clear-sky snow and ice is an important step in the production of cryosphere radiation budget products, which are used in the derivation of long-term data series for climate research. In this paper, a new method of clear-sky snow/ice identification for Moderate Resolution Imaging Spectroradiometer (MODIS) is presented. The algorithm's goal is to enhance the identification of snow and ice within the Clouds and the Earth's Radiant Energy System (CERES) data after application of the standard CERES scene identification scheme. The input of the algorithm uses spectral radiances from five MODIS bands and surface skin temperature available in the CERES Single Scanner Footprint (SSF) product. The algorithm produces a cryosphere rating from an aggregated test: a higher rating corresponds to a more certain identification of the clear-sky snow/ice-covered scene. Empirical analysis of regions of interest representing distinctive targets such as snow, ice, ice and water clouds, open waters, and snow-free land selected from a number of MODIS images shows that the cryosphere rating of snow/ice targets falls into 95% confidence intervals lying above the same confidence intervals of all other targets. This enables recognition of clear-sky cryosphere by using a single threshold applied to the rating, which makes this technique different from traditional branching techniques based on multiple thresholds. Limited tests show that the established threshold clearly separates the cryosphere rating values computed for the cryosphere from those computed for noncryosphere scenes, whereas individual tests applied consequently cannot reliably identify the cryosphere for complex scenes.

Radkevich, Alexander↗

Sensitivity and uncertainty of the IFR-1 BISON benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered for adoption by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This paper summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment.For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. Here, the resulting variations in benchmark predictions were normalized to calculate sensitivities. These sensitivities were then used to inform input selections for the UQ.The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of the benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because the confidence intervals associated with benchmark predictions were wide. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Sensitivity and Uncertainty of the IFR-1 BISON Benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This report summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment. For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. The resulting variations in benchmark predictions were normalized to calculate sensitivities. The strongest sensitivities were identified and used to inform input selections for the UQ. The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because of the wide confidence intervals associated with the benchmark predictions. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark development and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantifying Uncertainty in All-to-All Estimates of Space Object Conjunction Probabilities using U-Statistics

Predicting space object conjunctions is inherently probabilistic due to initial state and orbit model uncertainty. A commonly considered Monte Carlo estimator of the conjunction probability is the ’all-to-all’ estimator. Given independent random samples of the trajectories of both objects, the estimator is the percentage of all pairs of trajectories that result in a conjunction. Intuitively, the all-to-all estimator is the best possible estimator of the conjunction probability since it considers all pairs of Monte Carlo samples. However, its distribution is not available in closed-form, which limits its use in practice and makes this intuition difficult to make rigorous. In this paper, the all-to-all estimator is identified as a U-statistic, which implies that it has several favorable properties. Specifically, the estimator is the minimum variance unbiased estimator of the conjunction probability and is asymptotically Gaussian distributed. An approximate confidence interval for the conjunction probability is obtained from an estimate of the asymptotic Gaussian distribution. We show how to efficiently compute the confidence interval and demonstrate that the interval has the nominal coverage level. The confidence intervals are also seen to be narrower than those based on the commonly-used each-to-each estimator. Furthermore, the all-to-all estimator is shown to allow different Monte Carlo sample sizes, whereas the each-to-each estimator requires equal sample sizes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Atrial Septal Aneurysm and Patent Foramen Ovale as Risk Factors for Cryptogenic Stroke in Patients Less Than 55 Years of Age: A Study using Transesophageal Echocardiography

Background and Purpose: An association between atrial septal aneurysm and embolic events has been suggested. Atrial septal aneurysm has been shown to be associated with patent foramen ovale and,.in some reports, with mitral valve prolapse. These two latter cardiac disorder; have been identified as potential risk factors for ischemic stroke. The aim of this prospective study was to assess the role of atrial septal aneurysm as an independent risk factor for stroke, especially for cryptogenic stroke. Methods: We studied the prevalence of atrial septal aneurysm, patent foramen ovale, and mitral valve prolapse in 100 consecutive patients <55 years of age with ischemic stroke who underwent extensive etiological investigations. We compared these results with those in a control group of 50 consecutive patients. The diagnosis of atrial septal aneurysm and patent foramen ovale relied on transesophageal echocardiography with a contrast study and that of mitral valve prolapse, on two-dimensional transthoracic echocardiography. Results: Stepwise logistic regression analysis showed that atrial septal aneurysm (odds ratio, 4.3; 95% confidence interval, 1.3 to 14.6; P=.01) and patent foramen ovale (odds ratio, 3.9; 95% confidence interval, 1.5 to 10; P=.003) but not mitral valve prolapse were significantly associated with the diagnosis of cryptogenic stroke. The stroke odds of a patient with both atrial septal aneurysm and patent foramen ovale were 33.3 times (95% confidence interval, 4.1 to 270) the stroke odds of a patient with neither of these cardiac disorders. For a patient with atrial septal aneurysm of >lo-mm excursion, the stroke odds were approximately 8 times the stroke odds of a patient with atrial septal aneurysm of <10 mm. Conclusions: This study shows that atrial septal aneurysm and patent foramen ovale are both significantly associated with cryptogenic stroke and that their association has a marked synergistic effect. Atrial septal aneurysms of >lo-mm excursion are associated with a higher risk of stroke. (Stroke. 1993;24:1865-1873.) KEY WORDS aneurysm echocardiography foramen ovale, patent mitral valve prolapse o young adults

Cabanes, L.↗

A bootstrapping approach to social media quantification

Abstract This work considers the use of classifiers in a downstream aggregation task estimating class proportions, such as estimating the percentage of reviews for a movie with positive sentiment. We derive the bias and variance of the class proportion estimator when taking classification error into account to determine how to best trade off different error types when tuning a classifier for these tasks. Additionally, we propose a method for constructing confidence intervals that correctly adjusts for classification error when estimating these statistics. We conduct experiments on four document classification tasks comparing our methods to prior approaches across classifier thresholds, sample sizes, and label distributions. Prior approaches have focused on providing the most accurate point estimate while this work focuses on the creation of correct confidence intervals that appropriately account for classifier error. Compared to the prior approaches, our methods provide lower error and more accurate confidence intervals.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Impact Real World System Validation

Introduction NASA has developed a new evidence-based data-driven probabilistic risk assessment and tradespace analysis tool as a successor to the Integrated Medical Model. This updated decision support tool is known as IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces). IMPACT estimates the frequency and consequences of medical conditions that might arise during exploration missions. A validation analysis of IMPACT was performed with respect to a set of International Space Station (ISS) and Shuttle Transportation System (STS) real world system (RWS) referent data due to the limited referent data available from exploration missions. Methods Observed mission and crew characteristics from STS and ISS missions were used as model inputs within MEDPRAT (Medical Extensible Dynamic Probabilistic Risk Assessment Tool). For each mission, two hundred thousand simulations were generated. For each mission, model outputs included occurrence counts for each condition, total medical events (TME), and the probability of loss of crew life (LOCL). These simulated model outputs were compared to the RWS referent data. Results The predicted number of total medical events exceeded the total RWS medical events for ISS missions and combined ISS and STS missions and fell within the 90% confidence interval for STS missions. For the 32 ISS missions simulated by IMPACT, the number of total medical events was overpredicted for 19 missions and fell within the 90% confidence interval for 13 missions. For the 21 STS missions, the total number of medical events was overpredicted for 3 missions, fell within the 90% confidence interval for 16 missions, and was underpredicted for 2 missions. Combined, 29 missions were in range, 22 were overpredicted, and 2 were underpredicted. The predicted LOCL probability for the 32 ISS missions, the 21 STS missions, and the combined ISS and STS missions was consistent with the zero LOCL events observed in the RWS referent data. The validation analysis included a comparison of the number of medical events predicted by IMPACT and the number of medical events observed in the RWS data on a condition-by-condition basis. For ISS missions, 50 conditions were in range, 52 conditions were statistically underpowered (not enough observed sample to draw any conclusions on precision), 8 conditions were overpredicted, and 9 conditions were underpredicted. Overall, only 14% (17/119) of conditions were out of range for STS missions, 40 conditions were in range, 59 conditions were statistically underpowered, 10 conditions were overpredicted, and 10 conditions were underpredicted. Overall, only 17% (20/119) of conditions were out of range. For combined ISS and STS missions, 11 conditions were overpredicted, and 11 conditions were underpredicted. Overall, only 18% (22/119) of conditions were out of range. For combined ISS and STS missions, 49 conditions were in range, 46 conditions were statistically underpowered, 18 conditions were overpredicted, and 8 conditions were underpredicted. Overall, 21% (26/121) of conditions were out of range. Conclusion The results of this validation analysis should not be interpreted as a pass/fail test of the validity of IMPACT. Instead, this validation analysis should be used to assess some of the IMPACT outcomes in terms of consistencies and inconsistencies with the ISS and STS RWS referent data.

L. Boley↗

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗

Reference Correlations for the Density and Viscosity of Molten Alkali and Alkaline Earth Fluoride Salts

While there is a significant body of literature pertaining to thermophysical property measurements of molten salts, there is often a wide degree of variability among independent measurements of the same compounds. As such, the scientific community benefits greatly from an unbiased, independent assessment of duplicate datasets, so that reference correlations which describe these thermophysical properties as functions of temperature can be determined and then commonly used by researchers, scientists, and engineers. With regard to molten fluoride compounds, a significant time has elapsed since density and viscosity reference correlations have been determined; Janz conducted the most recent effort, in 1988, to provide reference correlations for the densities and viscosities of molten fluoride compounds via the National Standard Reference Data System coordinated by the National Bureau of Standards. Since then, new data have been published for molten fluoride compounds, and a new precedent has surfaced for putting forth reference correlations that involve fitting to multiple primary datasets. In this work, reference correlations are put forth for molten alkali and alkaline earth fluoride compounds in an effort to provide updated, improved correlations for general use. For molten alkali fluoride densities, estimated uncertainties with a 95% confidence interval are summarized as follows: LiF (0.63%), NaF (0.48%), KF (0.76%), RbF (0.93%), and CsF (0.75%). For molten alkaline earth fluoride densities, an estimated uncertainty was not able to be quantified for BeF 2 because of limited data; however, estimated uncertainties with a 95% confidence interval are summarized as follows for the remaining alkaline earth fluorides: MgF 2 (1.5%), CaF 2 (0.92%), SrF 2 (1.6%), and BaF 2 (0.23%). For molten alkali fluoride viscosities, uncertainty was not able to be quantified for RbF and CsF because of limited data; however, estimated uncertainties with a 95% confidence interval are summarized as follows for the remaining alkali fluorides: LiF (4.4%), NaF (3.0%), and KF (4.0%). For molten alkaline earth fluoride viscosities, limited consistent data resulted in the recommendation of single datasets (from literature) that are deemed to be the most trustworthy based on the quality of the underlying experimental studies.

Birri, A. [Oak Ridge National Laboratory (ORNL), O↗

Resilience Measurement Framework For Post-deployment Artificial Intelligence (ai) Integrated Systems

Resilience is largely defined as the ability to adapt or recover from adverse conditions, stresses, attacks, or compromises on systems that use or are enabled by digital resources. In Artificial Intelligence Management and Research for Advanced Networked Testbed Hub (AMARANTH), resilience is measured in the amount of time it took from the beginning of a testing period for the model to reach predictions outside of the original 95% confidence interval or using the Kullback-Leibler (KL) divergence theorem, the Population Stability Index (PSI), and traditional methods such as root mean squared error (RMSE) threshold. Artificial Intelligence (AI) model drift is of significant concern when deploying AI-integrated systems into critical and/or secure environments. Drift can impact resilience of the AI-integrated system post-deployment and requires consistent maintenance and upkeep to ensure the model is accurate and precise. To quantify model drift and predict the point when a model's drift becomes unacceptable, we describe using Kullback-Leibler (KL) divergence, Population Stability Index (PSI) and/or confidence interval width estimations to determine the point of failure and time to failure of a model post-deployment. Through simple code functions, the KL-divergence, PSI, confidence interval, and root mean squared (RMSE) point of failures can be used to derive when a model needs to be maintained as well as the impact of adversarial action through statistical means.

Yockey, Patience [Idaho National Laboratory (INL),↗

Characterization and Uncertainty Analysis of a Reference Pressure Measurement System for Wind Tunnels

This paper presents the calibration results and uncertainty analysis of a high-precision reference pressure measurement system currently used in wind tunnels at the NASA Langley Research Center (LaRC). Sensors, calibration standards, and measurement instruments are subject to errors due to aging, drift with time, environment effects, transportation, the mathematical model, the calibration experimental design, and other factors. Errors occur at every link in the chain of measurements and data reduction from the sensor to the final computed results. At each link of the chain, bias and precision uncertainties must be separately estimated for facility use, and are combined to produce overall calibration and prediction confidence intervals for the instrument, typically at a 95% confidence level. The uncertainty analysis and calibration experimental designs used herein, based on techniques developed at LaRC, employ replicated experimental designs for efficiency, separate estimation of bias and precision uncertainties, and detection of significant parameter drift with time. Final results, including calibration confidence intervals and prediction intervals given as functions of the applied inputs, not as a fixed percentage of the full-scale value are presented. System uncertainties are propagated beginning with the initial reference pressure standard, to the calibrated instrument as a working standard in the facility. Among the several parameters that can affect the overall results are operating temperature, atmospheric pressure, humidity, and facility vibration. Effects of factors such as initial zeroing and temperature are investigated. The effects of the identified parameters on system performance and accuracy are discussed.

Amer, Tahani↗