Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Effects of surface runoff and infiltration partition methods on hydrological modeling: A comparison of four schemes in two watersheds in the Northeastern US

The ratio according to which the precipitation/snowmelt is divided into surface and subsurface water is of primary importance to watershed scale hydrological modeling. The present study compared four different surface runoff and infiltration partition methods in the Richards-equation-based SWAT model (RSWAT), i.e., daily curve number method (DC-RSWAT), hourly curve number method (HC-RSWAT), Green-Ampt method (GA-RSWAT), and effective infiltration capacity method (EIC-RSWAT). These four versions of RSWAT and a daily-curve-number-based SWAT (DC-SWAT) were used to simulate daily flow rate (from 2001 to 2015) at the outlets of the Tuckahoe Creek Watershed (TCW) and Greensboro Watershed (GW) of the Chesapeake Bay in Maryland. Parameter sensitivity analysis, calibration, and prediction uncertainty analysis were conducted. The results indicate that surface runoff and infiltration partition methods have pronounced impacts on model performance. Comparative analysis showed that DC-RSWAT outperformed other versions of RSWAT for both calibration (from 2001 to2007) and validation (from 2008 to 2015) periods in the two test watersheds. In general, DC-RSWAT achieved more accurate deterministic flow simulation and reliable uncertainty estimation than other versions. As such, daily-curve-number method is recommended for surface runoff and infiltration partition in RSWAT for simulating stream flow.

hydrology, modeling, streamflow↗

Breaking the degeneracy between polarization efficiency and cosmological parameters in CMB experiments

Accurate cosmological parameter estimates using polarization data of the cosmic microwave background (CMB) put stringent requirements on map calibration, as highlighted in the recent results from the Planck satellite. In this paper, we point out that a model-dependent determination of polarization calibration can be achieved by the joint fit of the temperature-E-mode cross-power spectrum (TE) and E-mode auto-power spectrum (EE). This provides a valuable cross-check to band-averaged polarization efficiency measurements determined using other approaches. We demonstrate that, in ΛCDM, the combination of the TE and EE constrain polarization calibration with sub-percent uncertainty with Planck data and 2% uncertainty with sptpol data. We arrive at similar conclusions when extending ΛCDM to include the amplitude of lensing A L , the number of relativistic species N eff , or the sum of the neutrino masses Σm ν . Furthermore, the uncertainties on cosmological parameters are minimally impacted when marginalizing over polarization calibration, except, as can be expected, for the uncertainty on the amplitude of the primordial scalar power spectrum ln(10 10 A s ), which increases by 20–50%. However, this information can be fully recovered by adding temperature auto-power spectrum (TT) information. For current and future ground-based experiments, SPT-3G and CMB-S4, we forecast the cosmological parameter uncertainties to be minimally degraded when marginalizing over polarization calibration parameters. In addition, CMB-S4 could constrain its polarization calibration at the level of ~0.2% by combining TE and EE, and reach ~0.06% by also including TT. We therefore conclude that relying on calibrating against Planck polarization maps, whose statistical uncertainty is limited to ~0.5%, would be insufficient for upcoming experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian discovery of optimal reduced order models from mechanistic and experimental data: A case study of Pd penetration in TRISO fuels using BISON

TRistructural ISOtropic (TRISO) particles rely on a silicon carbide (SiC) layer as the primary structural material and barrier to metallic fission products (FPs) release. Accurate prediction of palladium (Pd) transport and penetration is therefore critical for qualifying TRISO fuels for advanced reactors. The empirical correlation for Pd penetration in BISON is derived from historical particle-fuel data, but cannot explain the large scatter in the experimental data that arises from varying experimental conditions. To aid fuel qualification, we previously developed a mechanistic reduced order model (ROM) using BISON that resolves these dependencies. Here, in this work we build on that mechanistic ROM and perform validation and quantify its uncertainty using Bayesian uncertainty quantification (UQ). calibration against a suite of in-pile and out-of-pile experiments spanning particle compositions, geometries, and operating conditions, and we benchmark it against the empirical correlation. Bayesian UQ identifies influential parameters, calibrates them to data, and yields predictive intervals. Results show that while the empirical correlation can be tuned to fit a single experiment type, it transfers poorly; the mechanistic ROM sustains accuracy with credible uncertainty across disparate conditions. This demonstrates a practical path—via Bayesian UQ applied to mechanistic ROMs—to leverage single-effect experiments for inferring in-reactor behavior and supporting TRISO fuel qualification.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A composite likelihood approach for inference under photometric redshift uncertainty

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

(cosmology:) large-scale structure of Universe↗

Improved quantitation of SIMS depth profile measurements of niobium via sample holder design improvements and characterization of grain orientation effects

The importance of SIMS analyses for “N-doped” impurity alloyed niobium and other surface-alloyed materials continues to increase. A major hurdle is the uncertainty of instrument calibration due to changes in sample height either from sample surface topography or from the sample holder itself. The CAMECA sample holder design allows for many types of samples to be analyzed. However, a drawback is that the holder faceplate can bend, contributing an uncertainty in the relative sensitivity factor (RSF) used to quantify the SIMS results. Here, we describe an improved sample holder having a reinforced faceplate, which prevents deflection and reduces uncertainty. Simulations show that the new design significantly reduces deflection from 10 μm to 5 nm. Sample measurements show a reduction of RSF uncertainty from this source from 4.1% to 0.95%. Grain orientation has long been suspected to affect RSF measurement as well. A bicrystal implant standard, consisting of randomly oriented and [001] grains, was successively rotated 15° between analyses. It was observed that 20% of the analyses performed on the randomly oriented grain exhibited anomalously high RSF values as well as slow sputter rates. These features were associated with the changing grain normal orientation with respect to the primary Cs + beam. The grain orientation associated with the rise in RSF was simulated and determined to be the [101] crystallographic plane, thus indicating that ion channeling was responsible for the significantly increased RSF. Focused ion beam analysis confirmed slower sputter rates for the cardinal crystallographic orientations, indicating that ion channeling occurred for each.

43 PARTICLE ACCELERATORS↗

Emulator-based Bayesian calibration of a subglacial drainage model

Subglacial drainage models, often motivated by the relationship between hydrology and ice flow, sensitively depend on numerous unconstrained parameters. We explore using borehole water-pressure time series to calibrate the uncertain parameters of a popular subglacial drainage model, taking a Bayesian perspective to quantify the uncertainty in parameter estimates and in the calibrated model predictions. To reduce the computation time associated with Markov Chain Monte Carlo sampling, we construct a fast Gaussian process emulator to stand in for the subglacial drainage model. We first carry out a calibration experiment using synthetic observations consisting of model simulations with hidden parameter values as a demonstration of the method. Using real borehole water pressures measured in western Greenland, we find meaningful constraints on four of the eight model parameters and a factor-of-three reduction in uncertainty of the calibrated model predictions. These experiments illustrate Gaussian process-based Bayesian inference as a useful tool for calibration and uncertainty quantification of complex glaciological models using field data. However, significant differences between the calibrated model and the borehole data suggest that structural limitations of the model, rather than poorly constrained parameters or computational cost, remain the most important constraint on subglacial drainage modelling.

58 GEOSCIENCES↗

A Measurement of the Eta Meson Radiative Decay Width via the Primakoff Effect

The ? meson is an interesting tool to study fundamental symmetries in Quantum Chromodynamics (QCD). In particular, its radiative decay width, ? p? Ñ ??q, is an important quantity that can be predicted in the framework of Chiral Perturbation Theory. A precision measurement of this quantity would provide critical inputs to understanding the mixing of the ? and ?1 mesons and extracting constants with wide-ranging applications in low-energy QCD. This decay width has been measured in the past using two different experimental techniques. The more popular technique utilized e`e´ collisions to produce ? mesons through electromagnetic interactions. Today, the Particle Data Group (PDG) averages the results of five such experiments to obtain their currently-accepted value of the decay width as: 0.515?0.018 keV. However the first measurement of this quantity was obtained from a fixed-target experiment that measured the cross section for photoproduction of ? mesons on a nuclear target via the Primakoff effect. Their result of 0.324?0.046 keV shows strong tension with the average of the collider measurements, motivating a new, high precision measurement using the Primakoff method. For this purpose, the PrimEx-eta experiment was conducted in Hall D of the Thomas Jefferson National Accelerator Facility (Jefferson Lab or JLab). The data is currently being analyzed to measure the differential cross section for the photoproduction of ? mesons on a liquid, 4He target. Preliminary results obtained from the analysis of the first phase of the PrimEx-eta experiment show reasonable agreement with the currently-accepted PDG value of the radiative decay width. However, as will be discussed, there are many challenges to this precision measurement which must be studied before any results can be finalized and compared with previous measurements. In parallel to the ? decay width measurement, the PrimEx-eta experiment measured the total cross section for the fundamental, Quantum Electrodynamics (QED) process of Compton scattering from the atomic electrons inside the target. The results obtained from this measurement are in strong agreement with the next-to-leading order QED calculations, and the total combined uncertainties are below 3% for incident photon energies between 7-10 GeV. In addition to providing the first precision measurement of the total Compton scattering cross section within this beam energy range, this measurement verifies the capability of the PrimEx-eta experimental setup to perform absolute cross section measurements at forward angles, and serves as a reference process for the calibration of systematic uncertainties.

Smith, Andrew↗

Radiometric Standards and Best Practices: Recent Progress

International standards and best practices for solar resource assessments provide assurance for traceable measurements associated with a low uncertainty. This benefits the solar energy industry by reducing the investment risks through heightened confidence in the solar resource information. NREL, in collaboration with international organizations, such as subcommittees G03 of ASTM (Radiometry) and TC180/SC1 of ISO (Climate measurement and data), recently revised some standards that are widely used by the solar industry. These include radiometric standards that assist in (i) maintaining calibration traceability; (ii) uncertainty analysis; (iii) measurement quality assurance, and (iv) establishing reference spectral irradiance distributions. The latter are widely used by the solar community to evaluate the actual absorptance, reflectance, and transmittance of solar energy materials, or the performance of solar energy devices and systems, relative to standard conditions. This paper provides a summary of the recent changes brought to these standards as a way to better support the solar energy industry.

industries↗

Examples of Mission-driven Data Science from Jefferson Lab and ACES

This presentation details mission-driven data science initiatives at Jefferson Lab and the Joint Institute for Advanced Computing on Environmental Studies (ACES). JLab, a U.S. Department of Energy Office of Science national laboratory, operates the Continuous Electron Beam Accelerator Facility (CEBAF), and is the lead institute for the new High Performance Data Facility (HPDF) Hub. The Joint Institute for ACES brings together interdisciplinary teams in health informatics, climate modeling, computer science, and physics to address environmental challenges, including flood modeling. The Hampton Roads region, particularly Norfolk and Virginia Beach, faces increasing flood risks, motivating the need for rapid, reliable, and risk-aware decision support. ACES’s flooding work has a focus on uncertainty quantification (UQ) and machine learning (ML) for coastal flood management. The work is motivated by the increasing vulnerability of communities such as Norfolk and Virginia Beach, Virginia, to frequent coastal flooding events, and the need for rapid, reliable decision support. The research develops computationally efficient ML surrogate models to forecast water levels and flooding risk. A central theme is the quantification and calibration of predictive uncertainty, especially for out-of-distribution (OOD) scenarios, using techniques such as Monte Carlo Dropout, Deep Ensembles, Gaussian Processes, and Deep Quantile Regression (DQR). The study demonstrates that distance-aware UQ is critical for reliable scientific AI, particularly in high-dimensional, safety-critical, and real-time applications.

McSpadden, Diana [Thomas Jefferson National Accele↗

Methodology for Digital Image Correlation and Infrared Measurement of Melting Aluminum Bars

Ultimately, our experiment measures two quantities on an aluminum bar: motion (which modeling must predict) and temperature (which sets thermal boundary conditions). For motion, stereo DIC is a technique to use imaging data to provide displacements relative to a reference image down to 1/100th of a pixel. We use a calibrated infrared imaging method for accurate temperature measurements. We will be capturing simultaneous data and then registering temperature data in space to the same coordinate system as the displacement data. While we will later show that our experiments are repeatable, indicating that separate experiments for motion and temperature would provide similar data, the simultaneous and registered data removes test to test variability as a source of uncertainty for model calibration and reduces the number of time-consuming tests that must be performed.

36 MATERIALS SCIENCE↗

Evaluation of Guardbanding Methods for Calibration and Product Acceptance

The Primary Standards Lab employs guardbanding methods to reduce risk of false acceptance in calibration when test uncertainty ratios are low. Similarly, production agencies guardband their requirements to reduce false accept rates in product acceptance. The root-sum-square guardbanding method is recommended by PSL, but many other guardbanding methods have been proposed in literature or implemented in commercial software. This report analyzes the false accept and reject rates resulting from the most common guardbanding methods. It is shown that the root-sum-square method and the Dobbert Managed Guardband strategy are similar and both are suitable for calibration and product acceptance work in the NSE.

42 ENGINEERING↗

Characterization of Low-energy Ionization Signals in Silicon Detectors for the Nab Experiment

The Nab (Neutron a b) experiment is designed to measure the beta-antineutrino angular correlation in free neutron 𝛽 decay with an ultimate precision goal of 0.1%, providing input for tests of Cabibbo-Kobayashi-Maskawa matrix unitarity. This measurement is performed via detection of electrons and protons in delayed coincidence using custom large-area segmented silicon detectors. We present the characterization of one such detector system to establish the proton energy and timing response, using a dedicated proton accelerator. The detected proton peak was studied for 25, 30, and 35 keV incident protons on a set of detector segments and multiple cooling cycles over a one-year period. Ionization losses were consistent with models of the detector dead layer with thicknesses less than 100 nm. The detected proton peak was stable within the uncertainty from energy calibration (0.25 keV). The rise times of detector pulses from 109Cd and 113Sn conversion electron sources were used to extract the impurity density profile and establish a precise model for the detector timing response. The observed impurity density profile varied from (2±2)×109/cm3 at the center to (26±2)×109/cm3 at the edge. This impurity density profile was then used to characterize systematic effects in proton time-of-flight measurements due to detector pulse-shape effects; the resultant proton timing systematic uncertainties were below 0.3 ns, which is sufficient for the Nab experiment.

Taylor, RJ [North Carolina State University]↗

Auger@TA: In-situ Cross-Calibration of the World's Largest Cosmic Ray Observatories

The Pierre Auger Observatory (Auger) and the Telescope Array (TA) are the world's two largest ultra-high-energy cosmic ray (UHECR) observatories. They operate in the Southern and Northern hemispheres, respectively, at similar latitudes but with distinct surface detector (SD) designs. A significant challenge in studying UHECR physics across the full sky is the apparent discrepancy in flux measurements between the two experiments. This discrepancy could arise from astrophysical differences and/or systematic effects related to their detector designs and sensitivities to extensive air shower components. To address this, the Auger@TA working group aims to cross-calibrate the two observatories with a self-triggering micro-Auger array within the TA array. This micro-array consists of eight Auger Surface Detector (SD) stations equipped with Water Cherenkov Detectors (WCDs) and AugerPrime Surface Scintillator Detectors. Seven SD stations, configured with a centered-1-PMT design, are arranged in a hexagonal pattern with one station in the center, with 1.5 km spacing, mirroring the Auger layout. The eighth station, which features a standard 3-PMT Auger station, is located in conjunction with a TA detector at the center of the hexagon, forming a triplet for high-statistics and low-uncertainty cross-calibration. A custom communication system that uses readily available components enables seamless communication between stations and remote access to each station through a central computer. The micro-array is now fully deployed, and initial data-taking is about to start. This presentation will detail the instrumentation, communication systems, central data acquisition system, expected performance of the micro-array, and preliminary results as appropriate.

Mocellin, Adriel G.B. [Colorado School of Mines]↗

Calibrating a finite-strain phase-field model of fracture for bonded granular materials with uncertainty quantification

To study the mechanical behavior of mock high explosives, an experimental and simulation program was developed to calibrate, with quantified uncertainty, a material model of the bonded granular material Idoxuridine and nitroplasticized Estane-5703. This paper reports on the efficacy of such a framework as a generalizable methodology for calibrating material models against experimental data with uncertainty quantification. Additionally, this paper studies the effect of two manufacturing temperatures and three initial granular configurations on the unconfined compressive behavior of the resulting bonded granular materials. In each of these cases, the same calibration framework was used; in that, hundreds of high-fidelity direct numerical simulations using a new, graphics processing unit-enabled, high-performance finite element method software, Ratel, were run to calibrate a finite-strain phase-field fracture model against experimental data. It was found that manufacturing temperature influenced the elastic response of the mock high explosives, with higher temperatures yielding a stiffer response. By contrast, it was found that the initial configuration of the grains had a negligible impact on the overall behavior of the mock high explosives though it remains possible that local damage accumulation within the specimens could be altered by the initial configurations. Overall, the calibration framework was successful at creating well-calibrated models, showing its usefulness as an engineering and scientific tool.

36 MATERIALS SCIENCE↗

Why are we still using 3D masses for cluster cosmology?

ABSTRACT The abundance of clusters of galaxies is highly sensitive to the late-time evolution of the matter distribution, since clusters form at the highest density peaks. However, the 3D cluster mass cannot be inferred without deprojecting the observations, introducing model-dependent biases and uncertainties due to the mismatch between the assumed and the true cluster density profile and the neglected matter along the sightline. Since projected aperture masses can be measured directly in simulations and observationally through weak lensing, we argue that they are better suited for cluster cosmology. Using the Mira–Titan suite of gravity-only simulations, we show that aperture masses correlate strongly with 3D halo masses, albeit with large intrinsic scatter due to the varying matter distribution along the sightline. Nonetheless, aperture masses can be measured ≈2–3 times more precisely from observations, since they do not require assumptions about the density profile and are only affected by the shape noise in the weak lensing measurements. We emulate the cosmology dependence of the aperture mass function directly with a Gaussian process. Comparing the cosmology sensitivity of the aperture mass function and the 3D halo mass function for a fixed survey solid angle and redshift interval, we find the aperture mass sensitivity is higher for Ωm and $w_a$, similar for σ8, ns, and $w_0$, and slightly lower for h. With a carefully calibrated aperture mass function emulator, cluster cosmology analyses can use cluster aperture masses directly, reducing the sensitivity to model-dependent mass calibration biases and uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Combined Meteorological and Hydrologic Uncertainties Shape Projections of Future Soil Moisture in the Eastern United States

Physical hazards pose risks to many critical systems. Designing adaptive measures to mitigate these risks is challenging due to large uncertainties in modeling future hazards and the associated sectoral responses. Here, we help address this challenge in a hydrologic context by examining the combined role of meteorological forcing and hydrologic parameter uncertainties in shaping projections of future soil moisture. By encoding a simple conceptual water balance model in a differentiable programming framework, we facilitate fast runtimes and an efficient calibration, enabling an improved uncertainty analysis. We characterize uncertainty in model parameters by calibrating against different target data sets and by using several loss functions. We then convolve the resulting parameter ensemble with a set of Earth system model projections to produce a large ensemble (2,340 members) of daily soil moisture simulations. Focusing on the eastern United States, we find that most ensemble members project a drying of soils across the region, although some simulate wetter conditions throughout this century. Our ensemble shows an increase in the frequency and intensity of dry extremes while there is less agreement for wet extremes. We conduct sensitivity analyses on several soil moisture signatures to measure the relative influence of meteorological and hydrologic uncertainties across space and time. Both meteorological and hydrologic factors contribute consistently to uncertainty surrounding long-term trends, while changes to both wet and dry soil extremes are typically more sensitive to hydrologic parameter uncertainty. Our results underscore the need to account for varied sources of uncertainty when developing long-term hydrometeorological projections.

Lafferty, David C. [University of Illinois Urbana‐↗

A proposed high-intensity radiometer calibration method using concentrated solar radiation

Accurate calibration of irradiance measurement devices, or radiometers, is essential for ensuring the reliability of measurements in high heat applications such as concentrating solar power (CSP), aerospace, defense, and pulsed power systems. Despite the critical need, existing calibration standards and service providers are limited to irradiance levels below 100 kW/m 2 and specific radiation sources, which is insufficient for many applications. For instance, CSP technologies, particularly those under the Department of Energy’s Solar Energy Technologies Office (SETO) Gen 3 program, require accurate measurements of broadband irradiance at levels exceeding 2000 kW/m 2 . In even more extreme scenarios, such as re-entry vehicles, heat levels can surpass 10000 kW/m 2 . Current ISO standards, specifically ISO 14934–2 and ISO 14934–3, are constrained to lower irradiance levels and dependent on black body heat sources, limiting their applicability for high-intensity broadband irradiance measurements, particularly in concentrated solar applications. Here, to address this shortfall, the National Solar Thermal Test Facility (NSTTF) at Sandia National Laboratories (SNL) proposes a calibration method and facility capable of characterizing radiometers up to 2750 kW/m 2 using concentrated solar irradiance. Calibrating with concentrated sunlight is important for solar applications as it aligns the calibration process with the solar spectrum. This alignment is crucial for minimizing systematic errors and avoiding the need for additional corrections that may arise when radiometers designed for solar applications are calibrated using black-body or electrical sources. This paper presents the present day NSTTF characterization facility and procedure, detailing the proposed calibration method and uncertainty quantification. The presented method builds upon 1980′s NSTTF methodology and involves both theoretical and empirical methods to establish a robust relationship between gauge voltage output and irradiance intensity, quantifying both measurement and fitting errors. By addressing the limitations of existing standards and extending the characterization range, this work provides an advancement in the field of high-intensity irradiance measurement and instrumentation characterization.

Gardon gauge↗