Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Cross-correlation of Dark Energy Survey Year 3 lensing data with ACT and Planck thermal Sunyaev-Zel’dovich effect observations. I. Measurements, systematics tests, and feedback model constraints

Here we present a tomographic measurement of the cross-correlation between thermal Sunyaev-Zel’dovich (TSZ) maps from Planck and the Atacama Cosmology Telescope and weak galaxy lensing shears measured during the first three years of observations of the Dark Energy Survey. This correlation is sensitive to the thermal energy in baryons over a wide redshift range and is therefore a powerful probe of astrophysical feedback. We detect the correlation at a statistical significance of 21σ, the highest significance to date. We examine the TSZ maps for potential contaminants, including cosmic infrared background and radio sources, finding that cosmic infrared background has a substantial impact on our measurements and must be taken into account in our analysis. We use the cross-correlation measurements to test different feedback models. In particular, we model the TSZ using several different pressure profile models calibrated against hydrodynamical simulations. Our analysis marginalizes over redshift uncertainties, shear calibration biases, and intrinsic alignment effects. We also marginalize over Ω m and σ 8 using Planck or DES priors. We find that the data prefer the model with a low amplitude of the pressure profile at small scales, compatible with a scenario with strong active galactic nuclei feedback and ejection of gas from the inner part of the halos. When using a more flexible model for the shear profile, constraints are weaker, and the data cannot discriminate between different baryonic prescriptions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

High Temperature Sodium Submersible Flowmeter Design and Analysis

This work details the design and analysis of a permanent magnet flowmeter designed to be submerged in a pool type sodium fast reactor environment. Recently developed Samarium Cobalt rare earth magnets were utilized that have demonstrated resilience to temperature and neutron flux up to 550 °C and 10 18 n/cm 2 , respectively. This paper will discuss the theory, design, calibration and uncertainty quantification of the flowmeter. The flowmeter was calibrated over a flowrate range of 11.4 - 90.9 LPM at temperatures of 220 and 400 °C, yielding an uncertainty in calibration of 2-3.6%. Here, a finite element model was developed and validated experimentally, yielding <; 3.2% error.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

A precise measurement of the jet energy scale derived from single-particle measurements and in situ techniques in proton–proton collisions at $\sqrt{s}=$ 13 TeV with the ATLAS detector

The jet energy calibration and its uncertainties are derived from measurements of the calorimeter response to single particles in both data and Monte Carlo simulation using proton–proton collisions at $\sqrt{s} = 13$ TeV collected with the ATLAS detector during Run 2 at the Large Hadron Collider. The jet calibration uncertainty for anti-$k_T$ jets with a jet radius parameter of R$_\textrm{jet} = 0.4$ and in the central jet rapidity region is about 2.5% for transverse momenta ($p_{\text {T}}$) of 20 $\text {GeV}$ , about 0.5% for $p_{\text {T}} = 300$ GeV and 0.7% for $p_{\text {T}} = 4$ TeV . Excellent agreement is found with earlier determinations obtained from -balance based in situ methods ($Z/\gamma$ +jets). The combination of these two independent methods results in the most precise jet energy measurement achieved so far with the ATLAS detector with a relative uncertainty of 0.3% at $p_\textrm{T} = 300$ GeV and 0.6% at 4 TeV. The jet energy calibration is also derived with the single-particle calorimeter response measurements separately for quark- and gluon-induced jets and furthermore for jets with R jet varying from 0.2 to 1.0 retaining the correlations between these measurements. Differences between inclusive jets and jets from boosted top-quark decays, with and without grooming the soft jet constituents, are also studied.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Simons Observatory: gain, bandpass and polarization-angle calibration requirements for B-mode searches

We quantify the calibration requirements for systematic uncertainties for next-generation ground-based observatories targeting the large-angle B-mode polarization of the Cosmic Microwave Background, with a focus on the Simons Observatory (SO). We explore uncertainties on gain calibration, bandpass center frequencies, and polarization angles, including the frequency variation of the latter across the bandpass. We find that gain calibration and bandpass center frequencies must be known to percent levels or less to avoid biases on the tensor-to-scalar ratio r on the order of Δ r∼10-3, in line with previous findings. Polarization angles must be calibrated to the level of a few tenths of a degree, while their frequency variation between the edges of the band must be known to O(10) degrees. Given the tightness of these calibration requirements, we explore the level to which residual uncertainties on these systematics would affect the final constraints on r if included in the data model and marginalized over. We find that the additional parameter freedom does not degrade the final constraints on r significantly, broadening the error bar by O(10%) at most. We validate these results by reanalyzing the latest publicly available data from the collaboration within an extended parameter space covering both cosmological, foreground and systematic parameters. Finally, our results are discussed in light of the instrument design and calibration studies carried out within SO.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Electron and photon energy calibration with the ATLAS detector using LHC Run 2 data

This paper presents the electron and photon energy calibration obtained with the ATLAS detector using 140 fb -1 of LHC proton-proton collision data recorded at $\sqrt{s}$ = 13 TeV between 2015 and 2018. Methods for the measurement of electron and photon energies are outlined, along with the current knowledge of the passive material in front of the ATLAS electromagnetic calorimeter. The energy calibration steps are discussed in detail, with emphasis on the improvements introduced in this paper. The absolute energy scale is set using a large sample of Z-boson decays into electron-positron pairs, and its residual dependence on the electron energy is used for the first time to further constrain systematic uncertainties. The achieved calibration uncertainties are typically 0.05% for electrons from resonant Z-boson decays, 0.4% at E T ~ 10 GeV, and 0.3% at E T ~ 1 TeV; for photons at E T ~ 60 GeV, they are 0.2% on average. This is more than twice as precise as the previous calibration. The new energy calibration is validated using J/ψ → ee and radiative Z-boson decays.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Probabilistic Groundwater Modeling of the RDX Plume at Los Alamos National Laboratory to Support Risk Assessment - 20359

A plume of the contaminant hexahydro-1,3,5-trinitro-1,3,5-triazine (RDX) with concentrations greater than the New Mexico tap water drinking standard (9.66 ppb) is present in the regional aquifer near the southwestern boundary of Los Alamos National Laboratory (LANL). A risk assessment is performed for exposure to regional aquifer groundwater, with long-term predictions of RDX concentrations provided by a calibrated, probabilistic, numerical fate and transport model. The structure of the model is hierarchical, with the RDX Regional Aquifer (RA) groundwater model acting as the primary tool for analysis of downgradient RDX concentrations. The RA model is deeply informed by the conceptual site model (CSM) and is calibrated using site RDX concentration data and hydraulic head measurements, along with other analyses. The model is calibrated using data through December 2019. Where data are scarce other lines of evidence are used to inform inputs, including the multiphase RDX Vadose Zone (VZ) model and Pipe and Disk analytical screening tool. Model inputs are described with informative prior distributions using a robust approach to development that incorporates all available lines of evidence for every parameter used as an input to the RA model. Calibration is performed using a classical nonlinear optimization routine, which is then used to initialize a Bayesian calibration. The Bayesian calibration constrains the uncertainty in the classical calibration, ultimately providing posterior distributions for all model parameters. The challenges of the calibration include high-dimensional parameter space, including spatially heterogeneous hydraulic conductivities, comparatively sparse data, and low RDX concentrations. Posterior parameter distributions developed in the calibration process are then used for stochastic predictive model runs into the future. The result of the forward runs is spatially and temporally explicit estimates of head and concentration with uncertainty at all points in space and time. The probabilistic modeling approach presented here includes innovative computational and statistical methods that leverage high-performance computing (HPC) resources. It makes use of prior modeling work performed at the chromium plume site in the central LANL area, with extensive updates. The risk assessment will ultimately be used to support decision-making at the site, using multiple appropriately weighted sources of information, as well as uncertainty, sensitivity, and value-of-information analyses. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

An upgraded frequency-selectable laser source (FLS) calibrator for CMB bandpass characterization

One of the biggest challenges for Cosmic Microwave Background (CMB) experiments comes from the uncertainty in instrument bandpass calibration. Uncertainties in bandpass can limit foreground removal and spectral fitting, which are critical for inflationary and galaxy cluster measurements. CMB experiments currently use Fourier Transform Spectrometers (FTSes) to measure instrument bandpasses. However, FTS systems are currently systematics-limited, so significant improvements in bandpass measurements require novel calibrators. To this end, we developed a Frequency-selectable Laser Source (FLS) calibrator, which uses a laser with adjustable frequency coupled to a system that allows for laser power attenuation. Following initial testing with the first FLS prototype, we developed an upgraded version of the calibrator with improved performance. We present the upgrades to the FLS calibrator, the characterization of the upgraded calibrator and new laser source, and plans for testing with microwave instruments in the field.

Saunders, Lauren J. [Fermilab] (ORCID:000000016367↗
DOE OSTI2023

Simultaneous determination of electrical conductivity and thickness of nonmagnetic metallic foils using two-sided multifrequency eddy current techniques

Here, in this paper, we describe a simple method for performing multifrequency eddy current characterization of free-standing uniform-thickness metallic foils using a forked inductive coil arrangement. The method involves measuring the mutual inductance between two coils when a foil is present between the coils, and when it is not present; the ratio of these mutual inductances is compared with an analytical solution, and foil conductivity, thickness, and sheet resistance are simultaneously estimated using numerical inversion and least-squares fitting. This method was used to characterize 34 non-ferrous metallic samples with thicknesses between 50 and 640 μm and with conductivities between 0.8 × 10 7 and 5.8 × 10 7 S/m. The estimated thicknesses from eddy current characterization agreed well with those measured using confocal optical techniques; the two approaches agreed to within 1 μm for samples that were thinner than 200 μm, and to within 0.5% for samples that had a thickness of 200 μm or greater. The estimated conductivities from eddy current characterization were in close agreement with expected values, given knowledge of the materials used. A particular strength of this approach is that the instrumentation needed is broadly available in research and development laboratories and the associated fixturing is easy to manufacture and assemble. A calibration procedure is described that can be used to reduce errors from geometric uncertainties. This calibration requires a sample that has only a known conductivity or thickness; both do not need to be known. The method described herein is likely extensible to conductivities and thickness well outside the ranges measured as part of this work.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

A new benchmark of soft X-ray transition energies of $$\mathrm {Ne}$$, $$\mathrm {CO}_2$$, and $$\mathrm {SF}_6$$: paving a pathway towards ppm accuracy

Abstract A key requirement for the correct interpretation of high-resolution X-ray spectra is that transition energies are known with high accuracy and precision. We investigate the K-shell features of $$\mathrm {Ne}$$ Ne , $$\mathrm {CO}_2$$ CO 2 , and $$\mathrm {SF}_6$$ SF 6 gases, by measuring their photo ion-yield spectra at the BESSY II synchrotron facility simultaneously with the 1s– n p fluorescence emission of He-like ions produced in the Polar-X EBIT. Accurate ab initio calculations of transitions in these ions provide the basis of the calibration. While the $$\mathrm {CO}_2$$ CO 2 result agrees well with previous measurements, the $$\mathrm {SF}_6$$ SF 6 spectrum appears shifted by $$\sim $$ ∼ 0.5 eV, about twice the uncertainty of the earlier results. Our result for $$\mathrm {Ne}$$ Ne shows a large departure from earlier results, but may suffer from larger systematic effects than our other measurements. The molecular spectra agree well with our results of time-dependent density functional theory. We find that the statistical uncertainty allows calibrations in the desired range of 1–10 meV, however, systematic contributions still limit the uncertainty to $${\sim }$$ ∼ 40–100 meV, mainly due to the temporal stability of the monochromator energy scale. Combining our absolute calibration technique with a relative energy calibration technique such as photoelectron energy spectroscopy will be necessary to realize its full potential of achieving uncertainties as low as 1–10 meV. Graphical abstract

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

Cutting out the middleman: calibrating and validating a dynamic vegetation model (ED2-PROSPECT5) using remotely sensed surface reflectance

Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies

ABSTRACT Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey (DES) is an essential component to mapping the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the DES Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: self-organizing map p(z) (sompz), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SRs), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of σ〈z〉 ∼ 0.01 on the mean redshift in each tomographic bin.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Characterization of Neutron Emission Rates of Commercial 252 Cf Sources

Accurate knowledge of 252 Cf neutron emission rates is critical for modeling and fast-neutron experiments, yet commercial sources are often supplied without traceable calibration or uncertainty estimates. This report describes a method to characterize 252 Cf sources using a pulse-shape-discrimination (PSD) scintillator. The scintillator was efficiency-calibrated against a time-tagged 252 Cf fission chamber manufactured at ORNL over 40 years ago. Isotopic evolution of the calibration source was modeled using Bateman equations to account for changes in the effective average neutrons per fission at the time of measurement. The calibrated scintillator was then used to measure absolute emission rates of several commercial 252 Cf sources, revealing deviations of up to 12% from nominal manufacturer values. This methodology provides a practical approach for establishing uncertainty-quantified 252 Cf neutron emission rates, improving fidelity in simulations and supporting the accurate interpretation of measurements.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2021

Utilizing Environmental Tracers to Reduce Groundwater Flow and Transport Model Parameter Uncertainties

Abstract Non‐uniqueness in groundwater model calibration is a primary source of uncertainty in groundwater flow and transport predictions. In this study, we investigate the ability of environmental tracer information to constrain groundwater model parameters. We utilize a pilot point calibration procedure conditioned to subsets of observed data including: liquid pressures, tritium ( 3 H), chlorofluorocarbon‐12 (CFC‐12), and sulfur hexafluoride (SF 6 ) concentrations; and groundwater apparent ages inferred from these environmental tracers, to quantify uncertainties in the heterogeneous permeability fields and infiltration rates of a steady‐state 2‐D synthetic aquifer and a transient 3‐D model of a field site located near Riverton, Wyoming (USA). To identify the relative data worth of each observation data type, the post‐calibration uncertainties of the optimal parameters for a given observation subset are compared to that from the full observation data set. Our results suggest that the calibration‐constrained permeability field uncertainties are largest when liquid pressures are used as the sole calibration data set. We find significant reduction in permeability uncertainty and increased predictive accuracy when the environmental tracer concentrations, rather than apparent groundwater ages, are used as calibration targets in the synthetic model. Calibration of the Riverton field site model using environmental tracer concentrations directly produces infiltration rate estimates with the lowest uncertainties, however; permeability field uncertainties remain similar between the environmental tracer concentration and apparent groundwater age calibration scenarios. This work provides insight on the data worth of environmental tracer information to calibrate groundwater models and highlights potential benefits of directly assimilating environmental tracer concentrations into model parameter estimation procedures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Accuracy of High Explosive Data used for Reactive Burn Model Calibration

Reactive burn models for a high explosive (HE) have three components: an equation of state (EOS) for the products, an EOS for the reactants and a reaction rate. For the products, we discuss the uncertainty in data for the planar detonation state and its release isentrope. For the reactants, the uncertainty in the principal shock locus data is discussed. For the reaction rate, we discuss uncertainties in shock initiation data (distance-of-run to detonation as a function of shock pressure), and curvature effect data (detonation speed as a function of front curvature). An important source of uncertainty for calibrating the reaction rate for a plastic-bonded explosive (PBX) results from variations in heterogeneities; that is the mesoscale structure of HE grains, binder and porosity. This shows up in the scatter of both shock initiation data and curvature effect data with small changes in initial density and initial temperature, and systematic changes with PBX lot. As illustrative examples, we use data for the conventional HMX based PBX 9501 and the insensitive TATB based PBX 9502 since these explosives have been extensively studied and high quality data are readily available in the literature.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Binning is Sinning: Redemption for Hubble Diagram Using Photometrically Classified Type Ia Supernovae

Bayesian Estimation Applied to Multiple Species (BEAMS) is implemented in the BEAMS with Bias Corrections (BBC) framework to produce a redshift-binned Hubble diagram (HD) for Type Ia supernovae (SNe Ia). BBC corrects for selection effects and non–SN Ia contamination, and systematic uncertainties are described by a covariance matrix with dimension matching the number of BBC redshift bins. For spectroscopically confirmed SN Ia samples, a recent "Binning is Sinning" article showed that an unbinned HD and covariance matrix reduces the systematic uncertainty by a factor of ~1.5 compared to the binned approach. Here we extend their analysis to obtain an unbinned HD for a photometrically identified sample processed with BBC. To test this new method, we simulate and analyze 50 samples corresponding to the Dark Energy Survey (DES) with a low-redshift anchor; the simulation includes SNe Ia, and contaminants from core-collapse SNe and peculiar SNe Ia. The analysis includes systematic uncertainties for calibration and measures the dark energy equation of state parameter (w). Compared to a redshift-binned HD, the unbinned HD with nearly 2000 events results in a smaller systematic uncertainty, in qualitative agreement with BHS21, and averaging results among the 50 samples we find no evidence for a w-bias. To reduce computation time for fitting an unbinned HD with large samples, we propose an HD-rebinning method that defines the HD in bins of redshift, color, and stretch; the rebinned HD results in similar uncertainty as the unbinned case, and shows no evidence for a w-bias.

79 ASTRONOMY AND ASTROPHYSICS↗