Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

An in-silico NMR laboratory for nuclear magnetic shieldings computed via finite fields: Exploring nucleus-specific renormalizations of MP2 and MP3

Here we developed and implemented a method-independent, fully numerical, finite difference approach to calculating nuclear magnetic resonance shieldings, using gauge-including atomic orbitals. The resulting capability can be used to explore non-standard methods, given only the energy as a function of finite-applied magnetic fields and nuclear spins. For example, standard second-order Møller-Plesset theory (MP2) has well-known efficacy for 1H and 13C shieldings and known limitations for other nuclei such as 15N and 17O. It is, therefore, interesting to seek methods that offer good accuracy for 15N and 17O shieldings without greatly increased compute costs, as well as exploring whether such methods can further improve 1H and 13C shieldings. Using a small molecule test set of 28 species, we assessed two alternatives: κ regularized MP2 (κ-MP2), which provides energy-dependent damping of large amplitudes, and MP2.X, which includes a variable fraction, X, of third-order correlation (MP3). The aug-cc-pVTZ basis was used, and coupled cluster with singles and doubles and perturbative triples [CCSD(T)] results were taken as reference values. Our κ-MP2 results reveal significant improvements over MP2 for 13C and 15N, with the optimal κ value being element-specific. κ-MP2 with κ = 2 offers a 30% rms error reduction over MP2. For 15N, κ-MP2 with κ = 1.1 provides a 90% error reduction vs MP2 and a 60% error reduction vs CCSD. On the other hand, MP2.X with a scaling factor of 0.6 outperformed CCSD for all heavy nuclei. These results can be understood as providing renormalization of doubles amplitudes to partially account for neglected triple and higher substitutions and offer promising opportunities for future applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Robust Carbon Dioxide Plume Imaging Using Joint Tomographic Inversion of Seismic Onset Time and Distributed Pressure and Temperature Measurements (Final Report)

We develop and demonstrate rapid and cost-effective methodologies for spatiotemporal tracking of CO2 plumes during geologic sequestration using joint inversion of seismic data and distributed pressure and temperature measurements. Key elements of our methodology are: (a) a computationally efficient approach to pressure and temperature propagation, (b) analysis of time lapse seismic data using a novel ‘seismic onset time’ approach to detect fluid front propagation, and (c) data assimilation and uncertainty assessment via joint inversion of pressure, temperature and time lapse seismic data, and (d) validating the numerical tomographic inversion using a CO2 injection demonstration projects, specifically data collected from the from the Petra Nova Parish Holdings CCUS project in the West Ranch Field, Texas and the Chester-16 reef CO2 injection site in Northern Michigan which is part of the DOE Midwestern Carbon Sequestration Project. The research team is led by Texas A&M University and includes Battelle as a subcontractor with support from Shell, Anadarko, Chevron and JX Nippon. A carbon dioxide (CO2) water-alternating-gas (WAG) pilot was conducted to gain insights into tertiary oil recovery potential via CO2 flood in the West Ranch Field as part of the Petra Nova project, the world’s largest post-combustion CO2 capture and utilization initiative. With a fluvial formation geology and large contrasts in permeability, this is a challenging and novel application of CO2 enhanced oil recovery (EOR). We build a predictive dynamic model of the subsurface that incorporates the multiphase and compositional data acquired during the pilot operation. The calibrated model is used for the carbon dioxide plume imaging. The study began with an initialization of the pilot sector model extracted from a calibrated full-field model. The pilot model calibration follows a two-step hierarchical workflow. First, we performed a large-scale update of the permeability distribution by integrating available bottomhole pressure and multiphase production data. In the second step, local permeability field is fine-tuned using a streamline-based method to match CO2 breakthrough times at the producers. The predictive capability of the calibrated model was verified through two blind validation tests: (1) the model showed good agreement with saturation logs acquired at two observation wells; and (2) the model reproduced the CO2 recovery as a fraction of the injected CO2. The use of seismic onset times has shown great promise for integrating near-continuous seismic surveys for updating geologic models. In this study, we analyze the impact of seismic survey frequency on the onset time approach aiming to extend the application of onset time to infrequent seismic surveys. In addition, we quantitatively examine the nonlinearity of the onset time method and compare it to the commonly used amplitude inversion method. We carry out a sensitivity analysis of seismic survey frequency based on the complete seismic survey data (over 175 surveys) of steam injection in a heavy oil reservoir (Peace River Unit) in Canada. Our results show that an adequate onset time map can be obtained from the infrequent seismic surveys by interpolation between seismic surveys as long as there is no change in the dominant underlying physics between the successive surveys. The study also shows that nonlinearity of the onset time method can be -smaller than that of the amplitude inversion method by several orders of magnitude. Application to the Brugge benchmark case shows that the onset time method obtains comparable permeability update as the traditional seismic amplitude inversion method with faster computation and improved convergence characteristics. We extend the streamline-based data integration approach to incorporate distributed temperature sensor (DTS) data using the concept of thermal tracer travel time. Then, a hierarchical workflow composed of evolutionary and streamline methods is employed to jointly history match the DTS and pressure data. Finally, CO2 saturation and streamline maps are used to visualize the CO2 plume movement during the sequestration process. The hierarchical workflow is applied to a carbon sequestration project in a carbonate reef reservoir within the Northern Niagaran Pinnacle Reef Trend in Michigan, USA. The monitoring data set consists of distributed temperature sensing (DTS) data acquired at the injection well and a monitoring well, flowing bottom-hole pressure data at the injection well, and time-lapse pressure measurements at several locations along the monitoring well. The history matching results indicate that the CO2 movement is mostly restricted to the intended zones of injection which is consistent with an independent warm-back analysis of the temperature data. In addition to employing simulation models and inverse methods for CO2 plume imaging, we also initialized a data-driven technology for detecting inter-well connectivity based on production and pressure data. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO2 EOR projects utilizing the water-alternating-gas (WAG) process. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. Texas A&M University, the lead organization in the project, was primarily responsible for the development of tomographic approaches for CO2 plume mapping in conjunction with distributed pressure, temperature and seismic onset time data. Battelle, as a subcontractor, was primarily responsible for the development of analytical and empirical methods for analyzing transient injection rate and pressure data from point/line sources such as injection and monitoring wells. An additional area of emphasis for Battelle was the use of machine learning for such tasks as inferring reservoir connectivity information from injection-production data, and identifying variable importance for machine learning-based proxy models developed from full-physics simulations. The two organizations also collaborated on the application of the tomographic inversion methodology for a field data set.

02 PETROLEUM↗
DOE OSTI2023

Preliminary Monte Carlo and Thermal Hydraulic Analysis using a Hybrid ETF-Corrected-Diffusion Prediction Block

This paper builds upon previous work to accelerate the Picard iteration (PI) method typically applied for coupled Monte Carlo-Thermal hydraulic (MC-TH) solutions. Previously, the use of the generalized transfer functions (GTFs) to predict variation in macroscopic cross sections following a perturbation in TH properties was demonstrated for a subset of simple 3D problems. In addition, the reduced-order transport prediction block relied on the first order perturbation (FOP) method, which was shown to have computational overheads. Recent work replaced the FOP block with a 1-group nodal diffusion solver to eliminate these overheads. While the use of diffusion is desirable for large-scale problems, the new solver introduces significant homogenization error. This work aims to address this issue by using the Jacobian-Free Newton Krylov (JFNK) method to generate a set of super homogenization (SPH) factors to improve the accuracy of the diffusion solution. The SPH factors will be used in conjunction with an improved cross section prediction method – the expanded transfer function (ETF) method – to produce a highly accurate flux prediction for an axial 1D boiling water reactor (BWR) pincell following a large perturbation in moderator density. The ETF-corrected diffusion (ETF-CD) block is shown to be highly accurate for the 1D test case. Future work will investigate the accuracy of the method for a realistic 3D pressurized water reactor core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗
DOE OSTI2023

Boron coated straw-based neutron multiplicity counter for neutron interrogation of TRISO fueled pebbles

Pebble bed reactors (PBRs) can improve the safety and economics of the nuclear energy production. PBRs rely on TRIstructural-ISOtropic (TRISO) fuel pebbles for enhanced fission product retention. Accurate characterization of individual fuel pebbles would enable the validation of computational models, efficient use of TRISO fuel, and improve fuel accountability. Here, we have developed and tested a new neutron multiplicity counter (NMC) based on 192 boron coated straw (BCS) detectors optimized for 235 U assay in TRISO fuel. The new design yielded a singles and doubles neutron detection efficiency of 4.71% and 0.174%, respectively, and a die-away time of 16.7 μs. The NMC has a low intrinsic gamma-ray detection efficiency of 8.71 x 10 –8 at an exposure rate of 80.3 mR/h. In simulation, a high-efficiency version of the NMC encompassing 396 straws was able to estimate the 235 U in a pebble with a relative uncertainty and error both below 2% in 100 s.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Noisy intermediate-scale quantum algorithms

A universal fault-tolerant quantum computer that can efficiently solve problems such as integer factorization and unstructured database search requires millions of qubits with low error rates and long coherence times. While the experimental advancement toward realizing such devices will potentially take decades of research, noisy intermediate-scale quantum (NISQ) computers already exist. These computers are composed of hundreds of noisy qubits, i.e., qubits that are not error corrected, and therefore perform imperfect operations within a limited coherence time. In the search for achieving quantum advantage with these devices, algorithms have been proposed for applications in various disciplines spanning physics, machine learning, quantum chemistry, and combinatorial optimization. The overarching goal of such algorithms is to leverage the limited available resources to perform classically challenging tasks. In this review, a thorough summary of NISQ computational paradigms and algorithms is provided. The key structure of these algorithms and their limitations and advantages are discussed. Finally, a comprehensive overview of various benchmarking and software tools useful for programming and testing NISQ devices is additionally provided.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description

A novel framework is proposed for the bulk parameterization of rain microphysics: the Bayesian Observationally Constrained Statistical–Physical Scheme (BOSS). It is designed to facilitate direct constraint by observations using Bayesian inference. BOSS combines existing process-level microphysical knowledge with flexible process rate formulations and parameters constrained by observations within a Bayesian framework. Furthermore, using a raindrop size distribution (DSD) normalization method that relates DSD moments to one another via generalized power series, generalized multivariate power expressions are derived for the microphysical process rates as functions of a set of prognostic DSD moments. The scheme is flexible and can utilize any number and combination of prognostic moments and any number of terms in the process rate formulations. This means that both uncertainty in parameter values and structural uncertainty associated with the process rate formulations can be investigated systematically, which is not possible using traditional schemes. In this paper, BOSS is compared to two- and three-moment versions of a traditional bulk rain microphysics scheme (denoted as MORR). It is demonstrated that some process formulations in MORR are analytically equivalent to the generalized power expressions in BOSS using one or two terms, while others are not. BOSS is able to replicate the behavior of MORR in idealized one-dimensional rainshaft tests, but with a much more flexible and systematic design. Part II of this study describes the application of BOSS to derive rain microphysical process rates and posterior parameter distributions in Bayesian experiments using Markov chain Monte Carlo sampling constrained by synthetic observations.

58 GEOSCIENCES↗
DOE OSTI2021

Discrete modeling of a transformer with ALEGRA

We report progress on a task to model transformers in ALEGRA using the “Transient Magnetics” option. We specifically evaluate limits of the approach resolving individual coil wires. There are practical limits to the number of turns in a coil that can be numerically modeled, but calculated inductance can be scaled to the correct number of turns in a simple way. Our testing essentially confirmed this “turns scaling” hypothesis. We developed a conceptual transformer design, representative of practical designs of interest, and that focused our analysis. That design includes three coils wrapped around a rectangular ferromagnetic core. The secondary and tertiary coils have multiple layers. The tertiary has three layers of 13 turns each; the secondary has five layers of 44 turns; the primary has one layer of 20 turns. We validated the turns scaling of inductance for simple (one-layer) coils in air (no core) by comparison to available independent calculations for simple rectangular coils. These comparisons quantified the errors versus reduced number of turns modeled. For more than 3 turns, the errors are <5%. The magnetic field solver failed to converge (within 5000 iterations) for >10 turns. Including the core introduced some complications. It was necessary to capture the core surfaces in thin grid sheaths to minimize errors in computed magnetic energy. We do not yet have quantitative benchmarks with which to compare, but calculated results are qualitatively reasonable.

42 ENGINEERING↗
DOE OSTI2023

Godiva-IV Dosimetry Exercise 2022 Preliminary Results

Integral Experiment Request (IER) 538 is part of a series of dose characterization and nuclear accident dosimetry (NAD) exercises performed under the Department of Energy (DOE) Nuclear Criticality Safety Program (NCSP). This is the second NAD exercise using the Godiva-IV critical assembly and the third NAD exercise overall. The participating laboratories provided their own dosimeters that were mounted on the Lawrence Livermore National Laboratory (LLNL) BOttle Manikin ABsorption (BOMAB) phantoms and aluminum plates. The BOMABs and plates were placed at two, three, and four meters away from the center of Godiva. Alongside the NADs, there was a LLNL Passive Neutron Spectrometer (PNS), Atomic Weapons Establishment (AWE) PNS, and Y-12 Sphere present to measure the neutron dose from Godiva. Two irradiations were conducted to test the NAD performance from each laboratory and assesses their performance to the DOE-STD-1098-2017 part 515 criteria. Neutron and gamma doses were measured prior to this exercise. This work presents a model for the neutron and gamma dose respectively to serve as the reference value. A code written in C/C++/ROOT was used to fit the measured neutron and gamma dose with the new models. It was assumed that the neutron and gamma doses are proportional to the change in temperature of Godiva after a burst irradiation. Uncertainties for the reference values were calculated using error propagation of the model’s parameters. Preliminary results (within twenty-four hours) and final results were compared for each laboratory. On average of all the participating laboratories, 32% of neutron doses and 78% of gamma doses were outside the DOE standards. One laboratory did not report their dose readings and were not included in this average. There is a bias for a lower neutron dose and a higher gamma dose based on the distribution of results. In comparison with the past Godiva-IV NAD exercise, there is an improvement in neutron dose readings by 20%.

BOttle Manikin ABsorption (BOMAB)↗
DOE OSTI2020

Unified architecture for data-driven metadata tagging of building automation systems

This article presents a Unified Architecture (UA) for automated point tagging of Building Automation System (BAS) data, based on a combination of data-driven approaches. Advanced energy analytics applications—including fault detection and diagnostics and supervisory control—have emerged as a significant opportunity for improving the performance of our built environment. Effective application of these analytics depends on harnessing structured data from the various building control and monitoring systems, but typical BAS implementations do not employ any standardized metadata schema. While standards such as Project Haystack and Brick Schema have been developed to address this issue, the process of structuring the data, i.e., tagging the points to apply a standard metadata schema, has, to date, been a manual process. This process is typically costly, labor-intensive, and error-prone. In this work we address this gap by proposing a UA that automates the process of point tagging by leveraging the data accessible through connection to the BAS, including time-series data and the raw point names. The UA intertwines supervised classification and unsupervised clustering techniques from machine learning and leverages both their deterministic and probabilistic outputs to inform the point tagging process. Furthermore, we extend the UA to embed additional input and output data-processing modules that are designed to address the challenges associated with the real-time deployment of this automation solution. We test the UA on two datasets for real-life buildings: (i) commercial retail buildings and (ii) office buildings from the National Renewable Energy Laboratory (NREL) campus. We report the proposed methodology correctly applied 85–90% and 70–75% of the tags in each of these test scenarios, respectively for two significantly different building types used for testing UA's fully-functional prototype. The proposed UA, therefore, offers promising approach for automatically tagging BAS data as it reaches close to 90% accuracy. Further building upon this framework to algorithmically identify the equipment type and their relationships is an apt future research direction to pursue.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Automated fault detection of residential air-conditioning systems using thermostat drive cycles

Residential air conditioning equipment comprises a significant portion of the total energy consumption of a home. Unfortunately, air-conditioning systems can be susceptible to faulty operation either from installation errors or faults that accrue over the equipment’s lifetime. This paper presents a novel automated fault detection algorithm for residential air-conditioning systems that can alert the homeowner of the presence of these faults. The proposed algorithm utilizes only the home’s thermostat and outside air temperature to perform automated fault detection over the course of the equipment’s lifetime, including immediately after installation. The algorithm uses an extended Kalman filter approach to identify a three-resistor, two-capacitor (3R2C) electrical equivalent thermodynamic model. The identified 3R2C model is used to predict cooling times during a testing period comprising of a series of thermostat drive-cycle experiments. We tested the algorithm on an EnergyPlus™ model of a typical residential building in Orlando, Florida. Duct faults, indoor airflow faults, and refrigerant undercharge faults were introduced into the building model one at a time. The algorithm was able to accurately determine duct-leak faults, 40% airflow faults, 40% undercharge faults, and no-fault cases with an accuracy of 70%, 77%, 82%, and 87%, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Multi-scale dynamic modeling and validation of radial flow fixed bed contactors for post-combustion CO 2 capture using bench scale and pilot plant data

Here, in this work, a multi-scale model of a radial flow fixed bed contactor packed with a carbon sorbent is developed and validated with laboratory-scale and pilot plant scale dynamic data. For the lab scale system, the model results were compared with low, medium and high gas and sweep flowrates, yielding root mean square error (RMSE) of 0.80, 0.63, 0.96 CO 2 mol%, respectively, for the outlet CO 2 concentration profile considering the entire A-D cycle. For the bed outer temperature profile, maximum RMSE was found to be 5.5 °C considering all flowrates and entire A-D cycles. An experimental campaign was developed and applied to a pilot plant at Technology Center Mongstad (TCM), Norway. Approaches were developed for pre-processing of data including consideration of the effect of gas mixing, measurement delay, and determination of cyclic steady-state conditions. Considering profiles during A-D cycles for all test runs, it was found that the maximum RMSE for pressure drop, temperature for the outer section of the bed, temperature for the middle section of the bed, and outlet CO 2 concentration profile remained less than 1.5 mbar, 3.5 °C, 2.8 °C, and 1.3 CO 2 mol%, respectively. The validated model was used to perform sensitivity studies on several key design operating variables for the adsorption-desorption cycle. It was found that the flow rate and concentration of flue gas have dominant nonlinear effects on the breakthrough time while the desorption time was strongly affected by the sweep gas flowrate for the specific sorbent being evaluated in this study.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2020

The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: N -body mock challenge for the quasar sample

ABSTRACT The growth rate and expansion history of the Universe can be measured from large galaxy redshift surveys using the Alcock–Paczynski effect. We validate the Redshift Space Distortion models used in the final analysis of the Sloan Digital Sky Survey (SDSS) extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 16 quasar clustering sample, in configuration and Fourier space, using a series of halo occupation distribution mock catalogues generated using the OuterRim N-body simulation. We test three models on a series of non-blind mocks, in the OuterRim cosmology, and blind mocks, which have been rescaled to new cosmologies, and investigate the effects of redshift smearing and catastrophic redshifts. We find that for the non-blind mocks, the models are able to recover fσ8 to within 3 per cent and α∥ and α⊥ to within 1 per cent. The scatter in the measurements is larger for the blind mocks, due to the assumption of an incorrect fiducial cosmology. From this mock challenge, we find that all three models perform well, with similar systematic errors on fσ8, α∥, and α⊥ at the level of $\sigma _{f\sigma _8}=0.013$, $\sigma _{\alpha _\parallel }=0.012$, and $\sigma _{\alpha _\bot }=0.008$. The systematic error on the combined consensus is $\sigma _{f\sigma _8}=0.011$, $\sigma _{\alpha _\parallel }=0.008$, and $\sigma _{\alpha _\bot }=0.005$, which is used in the final DR16 analysis. For baryon acoustic oscillation fits in configuration and Fourier space, we take conservative systematic errors of $\sigma _{\alpha _\parallel }=0.010$ and $\sigma _{\alpha _\bot }=0.007$.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Development of an Improved RELAP5-3D Model for the High Temperature Test Facility

High-temperature gas-cooled reactors (HTGRs) are rapidly approaching deployment. Confidence in transient analysis of these systems for design, optimization, and licensing calculations requires modeling and simulation tools that have been validated against data relevant to HTGR conditions. The High Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility for prismatic HTGRs. In spring and summer of 2019, HTTF was used for a series of experiments that now serve as the basis for the OECD/NEA Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data (HTGR T/H Benchmark). This benchmark contains problems for systems code, computational fluid dynamics (CFD), and coupled systems code/CFD modeling representing lower plenum mixing and both the depressurized and pressurized conduction cooldown (DCC and PCC respectively) transients. Benchmark problems include exercises for code-to-code and code-to-data comparisons as well as an exercise for error scaling between HTTF and the Modular High Temperature Gas-Cooled Reactor, which serves as the basis for the HTTF design. Previous analysis as part of the HTGR T/H benchmark used a RELAP5-3D model developed at Idaho National Laboratory (INL) and demonstrated an ability to reproduce trends in the measured data but difficulties reproducing experimental values within their uncertainty. These difficulties were largely attributed to assumptions made during the development of the initial RELAP5-3D model, which predated the HTTF experiments. A significant cause of difficulty reproducing the measured temperatures may be the radial nodalization of the previous RELAP5-3D model. The new model provides a finer nodalization to assess the impact of radial nodalization and allows for asymmetric heating within the core, which was a feature of multiple HTTF experiments. In this paper, we present the new RELAP5-3D model of HTTF. In addition to describing the new model, this paper compares the new and old models and provides results for a full-power steady state, a DCC, and a PCC in HTTF. These analyses are based on the code-to-code comparison exercises for the DCC and PCC problems of the HTGR T/H benchmark. We present the results of these exercises from the new model and compare them to the results of the old model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Flow-based likelihoods for non-Gaussian inference

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based generative models, a class of models that can capture complex distributions by transforming a simple base distribution through layers of nonlinearities. We call these flow-based likelihoods (FBL). We analyze the accuracy and precision of the reconstructed likelihoods on mock Gaussian data, and show that simply gauging the quality of samples drawn from the trained model is not a sufficient indicator that the true likelihood has been learned. We nevertheless demonstrate that the likelihood can be reconstructed to a precision equal to that of sampling error due to a finite sample size. We then apply FBLs to mock weak lensing convergence power spectra, a cosmological observable that is significantly non-Gaussian (NG). We find that the FBL captures the NG signatures in the data extremely well, while other commonly used data-driven likelihoods, such as Gaussian mixture models and independent component analysis, fail to do so. This suggests that works that have found small posterior shifts in NG data with data-driven likelihoods such as these could be underestimating the impact of non-Gaussianity in parameter constraints. By introducing a suite of tests that can capture different levels of NG in the data, we show that the success or failure of traditional data-driven likelihoods can be tied back to the structure of the NG in the data. Here, unlike other methods, the flexibility of the FBL makes it successful at tackling different types of NG simultaneously. Because of this, and consequently their likely applicability across datasets and domains, we encourage their use for inference when sufficient mock data are available for training.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Novel Instrumentation for Advanced Quantum Chromodynamics Studies with Flavor Sensitivity

The true nature of ordinary matter has always fascinated humankind, whose imagination has been pointed to the right direction since the 5th century BC with the first known atomic theory by Leucippus and Democritus. They described the matter as formed by small, invisible, indivisible, and eternal particles: the atoms. A long investigation followed them, including contributions from several of history?s greatest philosophers and scientists. The progress led to the understanding that atoms have an internal structure consisting of a central nucleus composed of protons and neutrons, surrounded by a cloud of electrons. About 50 years ago, scientists discovered that nucleons also have an internal structure. Through the Deep Inelastic Scattering (DIS) experiments, on which a lepton is scattered off a nucleon, it was possible to access the distribution of partons inside the nucleon along the longitudinal direction defined by the hard-scale probe. It was a crucial step in developing Quantum Chromodynamics (QCD), currently the best theory describing the subatomic matter. Ultimately, DIS was recognized as a limited tool to investigate the nucleon structure because it is mainly sensitive to observables at the probe?s energy scale. In recent decades, theoretical developments have allowed defining soft-scale observables by measuring more complex processes. Reactions such as Semi-Inclusive Deep Inelastic Scattering (SIDIS) with single or di-hadron production, can provide information about the momentum of parton inside the nucleon. In particular, polarized SIDIS allows access to the Transverse-Momentum-Dependent (TMD) parton distributions describing the correlations of the quark and gluon degrees of freedom in transverse momentum and spin. This study can provide three-dimensional imaging of nucleon structure and inner dynamics, as long as the hadronic component in the final state can be measured. Identifying the species of the produced particles provides information on the quark flavor and assumes a crucial role in this context. The thesis describes the work carried out by the author in preparing novel instrumentation for particle identification in the final state of DIS experiments, to support modern analysis of the parton dynamics within the basic confined object (nucleon) with flavor sensitivity. The work has been focused on the CLAS12 spectrometer in operation at Jefferson Laboratory (JLab), Newport News, VA, USA, and the ePIC experiment in preparation for the future Electron-Ion Collider (EIC) at Brookhaven National Laboratory (BNL), Long Island, NY, USA. CLAS12 is a fixed-target experiment using a 12 GeV beam of polarized electrons scattering off polarized nuclear targets. In 2018 and 2022, two Ring Imaging Cherenkov (RICH) detector modules were installed to improve the ?±/K± separation in the high-momentum region (3÷8 GeV/c) of the experiment. The author contributed to the assembly, installation, and com- missioning of the second RICH module, to the efficiency studies of the first module, and to the first SIDIS analysis with high-momentum kaons identified by the RICH. These studies led to the observation of the first spin asymmetry with high-momentum kaons from the CLAS12 experiment, and an initial assessment of the systematic error associated with the hadron identification. ePIC will be the first experiment at the future EIC, the new collider designed to expand the frontiers of QCD. The author was involved in the development of the dual-radiator Ring Imaging Cherenkov (dRICH). This detector will interpolate the measurements of the Cherenkov angles of photons produced by relativistic particles crossing two different radiators to identify charged hadrons. The author contributed to the studies conducted with the dRICH prototype, developing the reconstruction and analysis software and simulations, characterizing the aerogel radiator samples, and being responsible for the tracking system used during the beam tests. The performance obtained by the prototype has been progressively improved and the results are now comparable with the expectation derived from the simulation and satisfy the requirements of the experiment. In Chapter 1, the SIDIS theory is briefly introduced, outlying the connection with the experimental measurement. Chapter 2 includes the description of the CLAS12 RICH, its assembly and installation, and the efficiency study. In Chapter 3, the analysis of the Beam-Spin Asymmetry associated with SIDIS kaons is described. Chapter 4 describes the contribution to the dRICH for EIC, starting from a description of the ePIC experiment and focusing on the studies performed for the dRICH prototype. The conclusions of this work are summarized at the end.

Vallarino, Simone↗