Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Detection of significant antiviral drug effects on COVID-19 with reasonable sample sizes in randomized controlled trials: A modeling study

Development of an effective antiviral drug for Coronavirus Disease 2019 (COVID-19) is a global health priority. Although several candidate drugs have been identified through in vitro and in vivo models, consistent and compelling evidence from clinical studies is limited. The lack of evidence from clinical trials may stem in part from the imperfect design of the trials. We investigated how clinical trials for antivirals need to be designed, especially focusing on the sample size in randomized controlled trials. A modeling study was conducted to help understand the reasons behind inconsistent clinical trial findings and to design better clinical trials. We first analyzed longitudinal viral load data for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) without antiviral treatment by use of a within-host virus dynamics model. The fitted viral load was categorized into 3 different groups by a clustering approach. Comparison of the estimated parameters showed that the 3 distinct groups were characterized by different virus decay rates (p-value < 0.001). The mean decay rates were 1.17 d -1 (95% CI: 1.06 to 1.27 d -1 ), 0.777 d -1 (0.716 to 0.838 d -1 ), and 0.450 d -1 (0.378 to 0.522 d -1 ) for the 3 groups, respectively. Such heterogeneity in virus dynamics could be a confounding variable if it is associated with treatment allocation in compassionate use programs (i.e., observational studies). Subsequently, we mimicked randomized controlled trials of antivirals by simulation. An antiviral effect causing a 95% to 99% reduction in viral replication was added to the model. To be realistic, we assumed that randomization and treatment are initiated with some time lag after symptom onset. Using the duration of virus shedding as an outcome, the sample size to detect a statistically significant mean difference between the treatment and placebo groups (1:1 allocation) was 13,603 and 11,670 (when the antiviral effect was 95% and 99%, respectively) per group if all patients are enrolled regardless of timing of randomization. The sample size was reduced to 584 and 458 (when the antiviral effect was 95% and 99%, respectively) if only patients who are treated within 1 day of symptom onset are enrolled. We confirmed the sample size was similarly reduced when using cumulative viral load in log scale as an outcome. We used a conventional virus dynamics model, which may not fully reflect the detailed mechanisms of viral dynamics of SARS-CoV-2. The model needs to be calibrated in terms of both parameter settings and model structure, which would yield more reliable sample size calculation. In this study, we found that estimated association in observational studies can be biased due to large heterogeneity in viral dynamics among infected individuals, and statistically significant effect in randomized controlled trials may be difficult to be detected due to small sample size. The sample size can be dramatically reduced by recruiting patients immediately after developing symptoms. We believe this is the first study investigated the study design of clinical trials for antiviral treatment using the viral dynamics model.

60 APPLIED LIFE SCIENCES↗

Anomaly Detection for Online Monitoring of Thermocouple Sensors in the Advanced Test Reactor

This study explores data-driven anomaly detection methods to analyze sensor fail- ures in the Advanced Gas Reactor (AGR) nuclear fuel irradiation experiments. Specifically, we examine failures of thermocouples (TCs), which are critical for mon- itoring and controlling in-reactor temperatures during operation. Failures were pri- marily observed during abrupt power transitions and manifested as sensor drop-outs, drifts, or unexplained behavior. We applied three time-series analysis techniques— rolling mean smoothing, matrix profile, and vector auto-regression (VAR)—to de- tect anomalies in TC data prior to failure events. The rolling mean method effec- tively highlighted deviations aligned with reported failures, while the matrix profile provided partial early warning but sometimes flagged normal fluctuations during power-down periods. VAR shows potential in capturing multivariate dependencies but requires further calibration. A rare case of TC drift was also documented, which did not result in failure, underscoring the challenge of building predictive models with sparse positive examples. Our findings demonstrate that traditional statistical tools can aid anomaly detection but have limited predictive power without richer training data. We propose future directions including synthetic data generation, real- time surrogate modeling, and multi-modal feature integration. This work provides a foundation for applying robust anomaly detection frameworks to mission-critical sensor systems in experimental settings.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Muon track reconstruction in a segmented bolometric array using multi-objective optimization

Recent advances in segmented solid-state detector arrays for rare-event searches have allowed the technology to approach the ton-scale in detector mass and the scale of meters in size. Often focused around searches for neutrinoless double-beta decay or direct dark matter detection, such experiments also have the capability to search for exotic particles that leave track-like signatures across their volume. However, the segmented nature of such detector arrays often sets the spatial resolution and makes the problem of reconstructing track-like paths non-trivial. Here, in this paper, we present an algorithm that improves reconstruction of track-like events in segmented detectors using multi-objective optimization — a computational technique that optimizes more than one cost function at a time without specifying a quantitative weighting between them. Such a technique allows the reconstruction of tracks through a detector and the determination of path-lengths through individual elements. When combined with the reconstructed energy depositions in each element this allows for a calculation of the stopping power of track-like particles and opens the door to searches for particles with abnormal stopping power like monopoles or lightly-ionizing particles (LIPs). Results are presented which evaluate the precision of the reconstruction tools as they currently stand against Monte Carlo generated data. The algorithm is presented in the context of the CUORE experiment, but has applications to other segmented calorimeter detectors.

47 OTHER INSTRUMENTATION↗

Water ingress testing of Pressure Cooker 1006027150 REVAB-021

The requirements of this water ingress test are defined in PA-RD-01009, TA-55 Criticality Safety Requirements. “The container design should be capable of preventing the entry of more than 50 ml water when subjected to water spray at a flow of up to 2 inches water per hour for 2 hours or when immersed in water up to a depth of 6 inches above the top of the container for the same period of time.” The six allen screw fasters on the lid of the container were torqued to approximately 45 inch-pounds with a calibrated torque wrench in a crisscross pattern to ensure equal force distribution. The container management team of ORI-2 has developed a standard practice of gathering 5 data points to increase the statistical confidence in the data. This method has been demonstrated in previous LA-URs and approved official memorandums as follows: LANL Memo, SPE-2: 19-016 dated August 22, 2019; LANL Memo, SPE-2:19-020 dated September 24, 2019; and LA-UR-19-28268, Water Ingress Testing of Commercially Available Containers for the TA-55 Criticality Safety Program.

42 ENGINEERING↗

Deterministic Calibration of MFiX-PIC, Part 1: Settling Bed

The Particle-in-cell (PIC) numerical approach for modeling granular solids in fluid flow has gained significant interest in recent years. Valued for its often shorter time-to-solution, the PIC formulation relies on modeling statistical groupings of particles called parcels in cooperation with a solids stress model to affect local solids velocity. This is in contrast to the discrete element model (DEM) where every particle in a system is modelled individually and directly coupled to local solids velocity through Newtonian mechanics. The U.S. Department of Energy (DOE), National Energy Technology Laboratory (NETL) develops and maintains Multiphase Flow with Interphase eXchanges (MFiX), a collection of open-source computational fluid dynamics (CFD) solvers. Included in the MFiX suite are traditional two-fluid model (TFM) and DEM solvers, and a recently added PIC solver (NETL, 2021). In general, PIC methodologies offer an accuracy trade-off in lieu of computational speed; and therefore, it is important to assess the credibility of MFiX-PIC simulations. For this purpose, a systematic verification, validation and uncertainty quantification (VVUQ) effort was initiated at NETL to assess the new PIC solver

42 ENGINEERING↗

An Advanced Microscopic Energy Consumption Model for Automated Vehicle:Development, Calibration, Verification

The automated vehicle (AV) equipped with the Adaptive Cruise Control (ACC) system is expected to reduce the fuel consumption for the intelligent transportation system. This paper presents the Advanced ACC-Micro (AA-Micro) model, a new energy consumption model based on micro trajectory data, calibrated and verified by empirical data. Utilizing a commercial AV equipped with the ACC system as the test platform, experiments were conducted at the Columbus 151 Speedway, capturing data from multiple ACC and Human-Driven (HV) test runs. The calibrated AA-Micro model integrates features from traditional energy consumption models and demonstrates superior goodness of fit, achieving an impressive 90% accuracy in predicting ACC system energy consumption without overfitting. A comprehensive statistical evaluation of the AA-Micro model's applicability and adaptability in predicting energy consumption and vehicle trajectories indicated strong model consistency and reliability for ACC vehicles, evidenced by minimal variance in RMSE values and uniform RSS distributions. Conversely, significant discrepancies were observed when applying the model to HV data, underscoring the necessity for specialized models to accurately predict energy consumption for HV and ACC systems, potentially due to their distinct energy consumption characteristics.

Ma, Ke↗

Implementation of disruptive designs for gas turbine components using direct energy deposition additive manufacturing

This research aims to develop a framework for establishing the correlation between in-situ monitoring data, process parameters, and microstructure evolution in blown-powder laser-directed energy deposition (DED) additive manufacturing (AM). To achieve this, a comprehensive manufacturing framework has been developed, spanning from in-situ data acquisition, melt-pool simulation, microstructure modeling, and statistical microstructure quantification. A machine learning-based surrogate model is constructed to predict melt pool geometry directly from in-situ coaxial camera data. The surrogate model is trained using outputs from a high-fidelity melt pool simulation, which provides accurate melt pool dimension data under varying process conditions. The predicted melt pool geometry is then used as input to a microstructure model to predict microstructural features. To rigorously compare and analyze microstructures, the project introduces statistical metrics that quantify differences based on key features such as morphology and texture. Microstructures are represented using advanced statistical descriptors including angular chord length distribution, two-point spatial statistics, orientation distribution function, and global spherical harmonic. These representations are used to compute four distinct “dissimilarity scores” that quantitatively capture differences in texture and morphology. This framework is demonstrated to enable automated calibration of simulation parameters by minimizing discrepancies between simulated and target microstructures. The technology developed in this project enables direct correlation between in-situ monitoring data and resulting microstructure, paving the way for adaptive microstructure control in metal AM. This capability strengthens the connection between process parameters and final material properties, facilitating more precise and reliable material design.

36 MATERIALS SCIENCE↗

Improving the Quasi‐Biennial Oscillation via a Surrogate‐Accelerated Multi‐Objective Optimization

Accurate simulation of the quasi-biennial oscillation (QBO) is challenging due to uncertainties in representing convectively generated gravity waves. We develop an end-to-end uncertainty quantification workflow that calibrates these gravity wave processes in E3SM for a realistic QBO. Central to our approach is a domain knowledge-informed, compressed representation of high-dimensional spatio-temporal wind fields. By employing a parsimonious statistical model that learns the fundamental frequency from complex observations, we extract interpretable and physically meaningful quantities capturing key attributes. Building on this, we train a probabilistic surrogate model that approximates the fundamental characteristics of the QBO as functions of critical physics parameters governing gravity wave generation. Leveraging the Karhunen–Loève decomposition, our surrogate efficiently represents these characteristics as a set of orthogonal features, capturing cross-correlations among multiple physics quantities evaluated at different pressure levels and enabling rapid surrogate-based inference at a fraction of the computational cost of full-scale simulations. Finally, we analyze the inverse problem using a multi-objective approach. Our study reveals a tension between amplitude and period that constrains the QBO representation, precluding a single optimal solution. To navigate this, we quantify the bi-criteria trade-off and generate a set of Pareto optimal parameter values that balance the conflicting objectives. This integrated workflow improves the fidelity of QBO simulations and offers a versatile template for uncertainty quantification in complex geophysical models.

54 ENVIRONMENTAL SCIENCES↗

Calibrating the scintillation and ionization responses of xenon recoils for high-energy dark matter searches

We report liquid xenon-based direct detection dark matter experiments have recently expanded their searches to include high-energy nuclear recoil events as motivated by effective field theory dark matter and inelastic dark matter interaction models, but few xenon recoil calibrations above 100 keV are currently available. In this work, we measured the scintillation and ionization yields of xenon recoils up to 426 keV. The experiment uses 14.1 MeV neutrons to scatter off xenon in a compact liquid xenon time projection chamber and produce quasimonoenergetic xenon recoils between 39 and 426 keV. We report the xenon recoil responses and their electric field dependence for recoil energies up to 306 keV; due to the low event statistics and the relatively mild field dependence, the yield values at higher energies are reported as the average of xenon responses for electric fields between 0.2 and 2.0 kV/cm. This result will enable xenon-based dark matter experiments to significantly increase their high-energy dark matter sensitivities by including energy regions that were previously inaccessible due to lack of calibrations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Modeling intrinsic galaxy alignment in the MICE simulation

The intrinsic alignment (IA) of galaxies is potentially a major limitation in deriving cosmological constraints from weak lensing surveys. In order to investigate this effect, we assign intrinsic shapes and orientations to galaxies in the light-cone output of the MICE simulation, spanning ~ 5000 deg 2 and reaching redshift Z = 1.4. This assignment is based on a semianalytic IA model that uses photometric properties of galaxies as well as the spin and shape of their host halos. Advancing on previous work, we include more realistic distributions of galaxy shapes and a luminosity-dependent galaxy-halo alignment. The IA model parameters are calibrated against COSMOS and BOSS LOWZ observations. The null detection of IA in observations of blue galaxies is accounted for by setting random orientations for these objects. We compare the two-point alignment statistics measured in the simulation against predictions from the analytical IA models NLA and TATT over a wide range of scales, redshifts, and luminosities for red and blue galaxies separately. We find that both models fit the measurements well at scales above 8h -1 Mpc, while TATT outperforms NLA at smaller scales. The IA parameters derived from our fits are in broad agreement with various observational constraints from red galaxies. Finally, we build a realistic source sample, mimicking DES Year 3 observations and use it to predict the IA contamination to the observed shear statistics. We find this prediction to be within the measurement uncertainty, which might be a consequence of the random alignment of blue galaxies in the simulation.

79 ASTRONOMY AND ASTROPHYSICS↗

On the Determination of the Radiation Doses at Hiroshima [Slides]

Essentially all knowledge regarding the chronic effects of radiation exposure is derived from statistical analyses of the survivors of Hiroshima and Nagasaki. However, we were then, and are now, uncertain about the exposures. That is: We know the effects through observations and statistical analyses, but we can only estimate the doses. Other complications include the fact that Little Boy was truly unique. It was never tested, measurements of yield were ambiguous, calculations of yield were not consistent, and calibration measurements were not made, could not be made.

61 RADIATION PROTECTION AND DOSIMETRY↗

Characterizing and Mitigating Intraday Variability: Reconstructing Source Structure in Accreting Black Holes with mm-VLBI

The extraordinary physical resolution afforded by the Event Horizon Telescope has opened a window onto the astrophysical phenomena unfolding on horizon scales in two known black holes, M87* and Sgr A*. However, with this leap in resolution has come a new set of practical complications. Sgr A* exhibits intraday variability that violates the assumptions underlying Earth aperture synthesis, limiting traditional image reconstruction methods to short timescales and data sets with very sparse (u, v) coverage. We present a new set of tools to detect and mitigate this variability. We develop a data-driven, model-agnostic procedure to detect and characterize the spatial structure of intraday variability. This method is calibrated against a large set of mock data sets, producing an empirical estimator of the spatial power spectrum of the brightness fluctuations. We present a novel Bayesian noise modeling algorithm that simultaneously reconstructs an average image and statistical measure of the fluctuations about it using a parameterized form for the excess variance in the complex visibilities not otherwise explained by the statistical errors. These methods are validated using a variety of simulated data, including general relativistic magnetohydrodynamic simulations appropriate for Sgr A* and M87*. We find that the reconstructed source structure and variability are robust to changes in the underlying image model. We apply these methods to the 2017 EHT observations of M87*, finding evidence for variability across the EHT observing campaign. The variability mitigation strategies presented are widely applicable to very long baseline interferometry observations of variable sources generally, for which they provide a data-informed averaging procedure and natural characterization of inter-epoch image consistency.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic Groundwater Modeling of the RDX Plume at Los Alamos National Laboratory to Support Risk Assessment - 20359

A plume of the contaminant hexahydro-1,3,5-trinitro-1,3,5-triazine (RDX) with concentrations greater than the New Mexico tap water drinking standard (9.66 ppb) is present in the regional aquifer near the southwestern boundary of Los Alamos National Laboratory (LANL). A risk assessment is performed for exposure to regional aquifer groundwater, with long-term predictions of RDX concentrations provided by a calibrated, probabilistic, numerical fate and transport model. The structure of the model is hierarchical, with the RDX Regional Aquifer (RA) groundwater model acting as the primary tool for analysis of downgradient RDX concentrations. The RA model is deeply informed by the conceptual site model (CSM) and is calibrated using site RDX concentration data and hydraulic head measurements, along with other analyses. The model is calibrated using data through December 2019. Where data are scarce other lines of evidence are used to inform inputs, including the multiphase RDX Vadose Zone (VZ) model and Pipe and Disk analytical screening tool. Model inputs are described with informative prior distributions using a robust approach to development that incorporates all available lines of evidence for every parameter used as an input to the RA model. Calibration is performed using a classical nonlinear optimization routine, which is then used to initialize a Bayesian calibration. The Bayesian calibration constrains the uncertainty in the classical calibration, ultimately providing posterior distributions for all model parameters. The challenges of the calibration include high-dimensional parameter space, including spatially heterogeneous hydraulic conductivities, comparatively sparse data, and low RDX concentrations. Posterior parameter distributions developed in the calibration process are then used for stochastic predictive model runs into the future. The result of the forward runs is spatially and temporally explicit estimates of head and concentration with uncertainty at all points in space and time. The probabilistic modeling approach presented here includes innovative computational and statistical methods that leverage high-performance computing (HPC) resources. It makes use of prior modeling work performed at the chromium plume site in the central LANL area, with extensive updates. The risk assessment will ultimately be used to support decision-making at the site, using multiple appropriately weighted sources of information, as well as uncertainty, sensitivity, and value-of-information analyses. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying concordance of correlated cosmological data sets

We develop estimators of agreement and disagreement between correlated cosmological data sets. These account for data correlations when computing the significance of both tensions and excess confirmation while remaining statistically optimal. We discuss and thoroughly characterize different approaches commenting on the ones that have the best behavior in practical applications. We complement the calculation of their statistical distribution within the Gaussian model with one estimator that takes non-Gaussianities fully into account. To illustrate the use of our techniques, we apply these estimators to supernovae measurements of the distance-redshift relation, absolutely calibrated by the local distance ladder. The suite of best estimators that we discuss finds results that are in excellent agreement between estimators and find no indications of significant internal inconsistencies in this data set above the 1% probability threshold. Furthermore, this shows the robustness of local determinations of the Hubble constant to features in the distance-redshift relation.

79 ASTRONOMY AND ASTROPHYSICS↗

Reaction Rate Distribution Measurements in ZPPR-15

Small metal foils were irradiated in ZPPR-15 to measure distributions for 239 Pu(n,f), 235 U(n,f), 238 U(n,f), 238 U(n,γ), 115 In(n,n’) and 115 In(n,γ) reaction rates in ZPPR-15. The measured data were reported as basic reaction rate distributions for individual foils, cell-averaged reaction rate distributions and spectral indices or reaction rate ratios. All of the measured data were analyzed and tabulated in such a manner that the data can be readily compared with computed values. The published uncertainties for ZPPR-15 the reaction rate measurements include the statistical uncertainties in the measurements, reproducibility uncertainty and small uncertainties related to corrections for items such as foil compositions and post-irradiation decay between reactor shutdown and foil measurement. There are additional uncertainty components related to detector calibration that are not included in the published uncertainties. A full uncertainty analysis was performed for each foil measurement and for quantities derived from the basic foil measurements. The significant uncertainties were quantified, and a total uncertainty was derived for each measured value. The ZPPR-15 experimental records were used to create detailed as-built Monte Carlo models for the foil reaction rate measurements in ZPPR-15 loadings 123, 134 and 203 and for the fission chamber measurements of 237 Np and 242 Pu fission rates in ZPPR-15 loading 141. Because there were many foils distributed in the ZPPR-15 assembly and because an individual foil occupies a negligible volume in the ZPPR-15 assembly, direct Monte Carlo calculations of the measured foil reaction rates would require an impractical computational effort. The as-built Monte Carlo models and related files were prepared for conversion to deterministic models that can be calculated with realistic computational effort.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Comparing Designed Training Sets to Optimize Multivariate Regression Models for Pr, Nd, and Nitric Acid Using Spectrophotometry

Chemometric regression models were developed for the quantification of praseodymium (Pr, 0–1000 µg/mL), neodymium (Nd, 0–1000 µg/mL), and nitric acid (HNO 3 , 0.1–5 M) using spectrophotometry. Designed calibration sets were composed of 20 samples each: 10 model points and 10 lack-of-fit (LOF) points. The D-optimal designs effectively minimized the number of samples required to build models, and each design resulted in similar prediction performance, suggesting that statistical design of experiments can provide a reliable framework for selecting training set samples in three-variable systems. Partial least squares regression (PLSR) models were validated against a one-factor-at-a-time validation set composed of 125 samples (three variables, five levels). The top PLS-1 models resulted in average percent root mean square error of prediction error values of 3.5%, 1.7%, and 1.2% for Pr(III), Nd(III), and HNO 3 , respectively. Power set augmentations of the model and LOF samples were investigated to optimize the number of training set samples. PLSR models built using just required model points (10) had similar predictive capabilities as models including the LOF points (20) but with fewer samples. The number of validation samples was also varied systematically to learn how many samples are needed to validate regression models. This work addresses long-standing questions in the field of chemometrics to help make this approach amenable to the near-real-time quantification of hazardous species in remote settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗