Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “computer model calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

The Response of the BATSE LADs to Radiation From the Crab Nebula and Plans for Radioactivity Studies on Space Station

The Burst And Transient Source Experiment (BATSE) onboard the Compton Gamma-Ray Observatory (CGRO) was designed to measure X-rays and gamma rays with energies from about 50 keV to above 2 MeV. As with many scientific investigations, the success of the original experiment lead to additional areas of research interest. In the case of BATSE the ability to observe the radiation from sources down to about 20 keV became readily apparent. This lead to a continuing program of measuring the spectrum of radiation from stellar objects at these lower energies. One of these, the Crab Nebula, has a very steady radiation flux and, thus, has become a "standard candle" for such measurements. The Large Area Detectors (LADS) on BATSE contain a 1.27-cm thick, 25.4-cm radius NaI(Tl) detector behind a 6.35-mm thick polystyrene Charged Particle Detector (CPD) used to "veto" charged particles signals. The detectors have been calibrated with a series of gamma and X-ray sources and the results carefully simulated with a Monte Carlo code. In the calibration process the computer simulation accounts for scattering from material in the counting room as well as the BATSE structure. For an orbiting detector, scattering from the entire spacecraft must be modeled as well as for all covering material over the detectors. Five years after CGRO was launched on April 5, 1991, a large body of observational data has been taken of the Crab Nebula. The technique used for these observations, and for many other X-ray sources, is Earth occultation. From the perspective of the spacecraft, the Earth occults most stellar objects once in orbit, i.e., the signal is lost as the source sets and is regained as the source rises. A careful analysis of the continuing signals from all sources measured allows for an accurate measurement of the spectrum of a given source. An analysis of this data from the Crab has indicated that the LADs are very responsive at energies as low as 20 keV-at energies below the range of calibration. While the model accounts for many of the interactions of the photons with the detectors, the observation of nonstatistical deviations at low energy and at small angles has suggested a need to recalibrate at energies where the attenuation effects are increasing exponentially.

Laird, C. E.↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

A computational model tracks whole-lung Mycobacterium tuberculosis infection and predicts factors that inhibit dissemination

Mycobacterium tuberculosis (Mtb), the causative infectious agent of tuberculosis (TB), kills more individuals per year than any other infectious agent. Granulomas, the hallmark of Mtb infection, are complex structures that form in lungs, composed of immune cells surrounding bacteria, infected cells, and a caseous necrotic core. While granulomas serve to physically contain and immunologically restrain bacteria growth, some granulomas are unable to control Mtb growth, leading to bacteria and infected cells leaving the granuloma and disseminating, either resulting in additional granuloma formation (local or non-local) or spread to airways or lymph nodes. Dissemination is associated with development of active TB. It is challenging to experimentally address specific mechanisms driving dissemination from TB lung granulomas. Herein, we develop a novel hybrid multi-scale computational model, MultiGran, that tracks Mtb infection within multiple granulomas in an entire lung. MultiGran follows cells, cytokines, and bacterial populations within each lung granuloma throughout the course of infection and is calibrated to multiple non-human primate (NHP) cellular, granuloma, and whole-lung datasets. We show that MultiGran can recapitulate patterns of in vivo local and non-local dissemination, predict likelihood of dissemination, and predict a crucial role for multifunctional CD8+ T cells and macrophage dynamics for preventing dissemination.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1976

GEOS-C C-band transponder prelaunch calibration and test data

The delay characteristics and spacecraft telemetry housekeeping data for the GEOS-C C-Band transponders are presented. The data are presented in graphical form to provide a convenient method for computing radar range measurement corrections as a function of signal strength at the transponder and spacecraft environment. The data are also presented in tabular form along with the mathematical models used to derive the curves. Also included are a list of the operating characteristics of each transponder and a description of the calibration test equipment set-up.

Selser, A. R.↗
NASA NTRS1991

A study of the thermal and optical characteristics of radiometric channels for Earth radiation budget applications

An improved dynamic electrothermal model for the Earth Radiation Budget Experiment (ERBE) total, nonscanning channels is formulated. This model is then used to accurately simulate two types of dynamic solar observation: the solar calibration and the so-called pitchover maneuver. Using a second model, the nonscanner active cavity radiometer (ACR) thermal noise is studied. This study reveals that radiative emission and scattering by the surrounding parts of the nonscanner cavity are acceptably small. The dynamic electrothermal model is also used to compute ACR instrument transfer function. Accurate in-flight measurement of this transfer function is shown to depend on the energy distribution over the frequency spectrum of the radiation input function. A new array-type field of view limiter, whose geometry controls the input function, is proposed for in-flight calibration of an ACR and other types of radiometers. The point spread function (PSF) of the ERBE and the Clouds and Earth's Radiant Energy System (CERES) scanning radiometers is computed. The PSF is useful in characterizing the channel optics. It also has potential for recovering the distribution of the radiative flux from Earth by deconvolution.

Mahan, J. R.↗
DOE OSTI2025

A visco-plastic constitutive model for accurate densification and shape predictions in powder metallurgy hot isostatic pressing

Powder metallurgy hot isostatic pressing (PM-HIP) is an advanced manufacturing process that produces near net shape parts with high material utilization and uniform microstructures. Despite being used frequently to produce small-scale components, the application of PM-HIP to large-scale components is limited due to inadequate understanding of its complex mechanisms that cause unpredictable post-HIP shape distortions. A computational model can provide necessary information about the intermediate and final stages of the HIP process that can help understand it better and make accurate predictions. Generally, two types of computational models are employed for PM-HIP of metal powders, namely, plastic and visco-plastic models. Between these, the plastic model is preferred due to its cheaper calibration approach requiring less experimental data. However, the plastic model sometimes produces incorrect predictions when slight variations of the HIP conditions are encountered in practical situations. Therefore, this work presents a visco-plastic model that addresses these limitations of the plastic model. A novel modified calibration approach is employed for the visco-plastic model that utilizes less experimental data than existing approaches. With the new approach, the data requirement is same for both plastic and visco-plastic models. This also enables a quantitative comparison of plastic and visco-plastic models, which have been only qualitatively compared in the past. When calibrated with the same experimental data, both the models are found to produce similar results. In conclusion, the calibrated visco-plastic model is applied to several complex geometries, and the predictions are found to be in good agreement with experimental observations.

Hot isostatic pressing↗
DOE OSTI2023

IM3 GO WEST Parameter Search Dataset

GO WEST is an open-source power grid modeling framework for U.S. Western Interconnection, which allows users to tailor the model depending on their research study and science questions. It is developed to address weather and water dynamics, and associated vulnerabilities in this bulk power system. It covers 28 balancing authorities (BA) and 12 states in U.S. Western Interconnection. GO WEST allows users to select different number of nodes and come up with a simplified network by utilizing 10,000 nodal topology of U.S. Western Interconnection created by Texas A&M University. Users can try and select different number of nodes, mathematical formulations (linear programming vs. mixed-integer linear programming), transmission line limit scaling factors, and hurdle rate scaling factors. GO WEST offers a unit commitment and economic dispatch (UC/ED) module to simulate grid operations on an hourly scale. In this sense, users can calibrate and validate their model versions by comparing model outputs to historical datasets. Therefore, GO WEST can help researchers to strike a balance between model fidelity (i.e. accuracy) and computational complexity (i.e. runtime). This dataset includes model inputs and outputs from 600 model versions for each 2019, 2020, and 2021. The folder naming convention is as follows: Exp{Number of Nodes}_{Mathematical Formulation}_{Transmission Line Limit Scaling Factor in MW}_{Hurdle Rate Scaling Factor in %}_{Year}. Linear programming is designated with "simple" label whereas mixed-integer linear programming is designated with "coal" label. For example, "Exp100_simple_1000_50_2019" folder contains inputs and outputs from 2019 model version with 100 nodes, linear programming, +1000 MW transmission line limit scaling factor, and +50% hurdle rate scaling factor. GO WEST GitHub repository hosts all raw datasets, processing scripts, and model scripts. Please refer to the README file for a detailed description of the included files.

Economics↗
NASA NTRS2004

Characterization and Uncertainty Analysis of a Reference Pressure Measurement System for Wind Tunnels

This paper presents the calibration results and uncertainty analysis of a high-precision reference pressure measurement system currently used in wind tunnels at the NASA Langley Research Center (LaRC). Sensors, calibration standards, and measurement instruments are subject to errors due to aging, drift with time, environment effects, transportation, the mathematical model, the calibration experimental design, and other factors. Errors occur at every link in the chain of measurements and data reduction from the sensor to the final computed results. At each link of the chain, bias and precision uncertainties must be separately estimated for facility use, and are combined to produce overall calibration and prediction confidence intervals for the instrument, typically at a 95% confidence level. The uncertainty analysis and calibration experimental designs used herein, based on techniques developed at LaRC, employ replicated experimental designs for efficiency, separate estimation of bias and precision uncertainties, and detection of significant parameter drift with time. Final results, including calibration confidence intervals and prediction intervals given as functions of the applied inputs, not as a fixed percentage of the full-scale value are presented. System uncertainties are propagated beginning with the initial reference pressure standard, to the calibrated instrument as a working standard in the facility. Among the several parameters that can affect the overall results are operating temperature, atmospheric pressure, humidity, and facility vibration. Effects of factors such as initial zeroing and temperature are investigated. The effects of the identified parameters on system performance and accuracy are discussed.

Amer, Tahani↗
DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗
DOE OSTI2025

2D reactive transport model of shale chemical weathering and biogeochemical fluxes along a mountainous hillslope, East River Watershed, Colorado: Input files and simulation results

This data package contains input files and simulation results for a two-dimensional (2D) reactive transport model used to quantitatively analyze the coupled hydrological and biogeochemical processes governing shale weathering and associated biogeochemical fluxes under realistic environmental conditions in the high-elevation East River Watershed. These data support the conclusions presented in Stolze et al. (Water Resources Research, under review), "Model-based interpretation of solute exports and carbon partitioning during shale weathering in a mountainous hillslope". The model simulates atmospheric-subsurface gas exchange, subsurface water flow, and shale weathering processes under dynamic, year-scale conditions along a shale-underlain hillslope located in the East River watershed. The simulations were performed using the PFLOTRAN flow and reactive transport code and executed on the Perlmutter supercomputer to leverage its large-scale parallel computing capabilities. The data package contains two zipped folders, "model_input_files" and "simulation_results", and one readme.txt file. "model_input_files" contains the necessary input files to run the calibrated base-base model presented in Stolze et al. (Water Resources Research, under review). "simulation_results" contains a single hdf5 file ("Output_2D_hillslope_model.h5") which includes the results of simulation performed using the base-case model. This file can be opened with HDFView 3.1.4, Python, or MATLAB. "readme.txt" contains relevant information about the base-case model and provides guidelines on how to run the associated input files provided in the folder "model_input_files". Furthermore, readme.txt provides information regarding the model results provided in "Output_2D_hillslope_model.h5" such as matrix dimensionality and output units. Field datasets used to evaluate model performance were collected at three monitoring wells located along a hillslope transect (PLM1, PLM2, and PLM3). Dissolved ion concentration data were collected from November 2016 to October 2021 for Ca, Mg, DIC, Na, K, SO4 (Dong et al., 2025 - dic_npoc_data_2014_2024.zip - DOI:10.15485/1660459; Williams et al., 2025 - anion_data_2014_2024.zip - DOI:10.15485/1668054; Dong et al., 2025 - cation_data_2014_2024.zip - DOI:10.15485/1668055). Note that we used the files named er_PLM1_xx_yy, er_PLM2_xx_yy, and er_PLM3_xx_yy where xx stands for the name of the aqueous species and yy stands for the depth where the measurements were performed. Soil water content ([0 - 1] m) and water table depth were collected from November 2016 to October 2021 (Wan et al., 2024 - Dynamic_water_table__depthsFig2b.csv and Soil_water_content_Fig4e.csv - DOI:10.15485/2322567). Gaseous CO2 concentration were collected from October 2020 to December 2021(Wan et al., 2024 - Soil_CO2_concentrations_Fig4h.csv - DOI:10.15485/2322567) Gaseous CO2 flux from the subsurface to the atmosphere were collected in the vicinity of PLM2 from October 2019 to May 2022 (Wu et al., 2025). Soil microbial biomass concentration was measured from August 2016 to June 2017 (Sorensen et al., 2019 - 2017_East_River_Pumphouse_Microbial_Biomass__1_.csv - DOI:10.15485/1577267) All field data are published as CSV files compatible with Microsoft Excel, MATLAB, and Python, or as text files. The coordinates of the monitoring wells and the CO2(g) flux sensor in the coordinate system WGS84 are: -PLM1: [38.9197710 ; -106.9492750] -PLM2: [38.9201580 ; -106.9487170] -PLM3: [38.9207843 ; -106.9483668] -PLM4: 38.9210060 ; -106.9479528] -CO2(g) flux sensor: [38.9199180 ; -106.9489906] ------------------------------------------------------------------------------------------- This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. This research used resources of the National Energy Research Scientific Computing Center (NERSC), a Department of Energy User Facility using NERSC award BER-ERCAP 23980, BER-ERCAP 28550, and BER-ERCAP 33789.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A multiscale packed-bed reactor model for sustainable ethylene production via chemical looping oxidative coupling of methane

The rising global warming concerns and shale gas discovery have prompted research in the direction of greenhouse gas (GHG), such as methane, reduction and conversion. Oxidative coupling of methane (OCM) offers a pathway to low carbon-intense valorization of methane while producing ethylene, a chemical regarded as central to the petrochemical industry. Even after decades of OCM discovery, researchers keep understanding the process and underlying chemical reactions in a pursuit to achieve industrial viability for OCM. Here, in general, OCM suffers from low C 2 selectivity, yield and reactor temperature runaways due to highly exothermic nature of its reactions. Computational Fluid Dynamics (CFD) tools help analyze spatial gradients within the reactor to deeply understand the diffusion of species, mass and heat transfer phenomena. Furthermore, challenges associated with scaling up such as hot spot formation and parametric sensitivity can be addressed without having to expend on costly experiments. The current paper presents a multiscale packed-bed reactor CFD model coupled with a chemical kinetic model for the chemical looping OCM. The CFD model includes two scales i.e., macroscale for catalyst bed and microscale for individual pellets. Moreover, a chemical kinetic model based on 10 gas-phase reactions is integrated with the CFD model. An additional surface reaction for the formation of gas-phase oxygen from catalyst surface is added to account for the absence of feed oxygen. The model is calibrated against experimental results. The calibrated model captures trends in CH 4 conversion, C 2 selectivity and C 2 yield within a ± 4.35 % range across a temperature range of 700-900 °C. Moreover, model fidelity is evaluated by varying key computational parameters such as mesh resolution and time step size. The model is also verified by varying the inlet methane concentration and the gas hourly space velocity (GHSV) and comparing the results with literature. A sensitivity analysis and scale-up of the current model is undergoing.

Chemical looping↗
NASA NTRS2020

Assessment of Temperature-Dependent Regression Model Terms of a RUAG Six-Component Block-Type Balance

A metric called the percent contribution was applied to regression models of temperature-dependent calibration data of a RUAG six-component block-type balance in order to assess the influence of temperature-dependent regression model terms on the balance load prediction. Regression models were examined that are needed if either the Iterative or the Non-Iterative Method is used for the load prediction. Computed values of the percent contribution confirmed that the cross-product term defined by a primary load and the temperature difference is the most influential temperature-dependent term of the regression model of a primary output that the Iterative Method needs. Similarly, the analysis showed that the cross-product term defined by a primary output and the temperature difference is the most influential temperature-dependent term of the regression model of a primary load that the Non-Iterative Method needs. Computed results support conclusions that were reported in an earlier theoretical study. This study asserted that the cross-product term defined by a primary load or output and the temperature difference models the temperature-dependent shift of the gage sensitivity. The influence of other temperature-dependent terms used in the regression models of the calibration data of RUAG's balance was negligible. This observation may be explained by the fact that RUAG's block-type balances have highly linear characteristics. Overall, the percent contribution has proven itself to be a reliable and easy-to-implement metric that may also be used for the assessment of the influence of temperature-dependent regression model terms on the load prediction of a six-component strain-gage balance.

Ulbrich, N.↗
NASA NTRS2018

CFD Model Of The Transonic Dynamics Tunnel With Applications

This paper presents the Computational Fluid Dynamics (CFD) model of the flow in the NASA Langley Research Center Transonic Dynamics Tunnel (TDT) with some recent applications. The TDT is a continuous-flow, closed circuit, slotted-test-section wind tunnel with a 16- by 16-foot test section with cropped corners. The tunnel was originally built as the 19-ft Pressure Tunnel in 1938, but it was converted to the current transonic tunnel in the 1950s, with capabilities to use either air or heavy gas at pressures from atmosphere down to near vacuum. In this study, experimental data acquired in the empty tunnel using R-134a as the test medium was used to calibrate the computational data. Experimental data from a recent TDT test of a full-span fighter configuration in air was then selected for comparison with the numerical data. During this test, the configuration experienced a flutter event in the transonic flow regime. Numerically, the flutter event is simulated both inside the CFD model of the TDT and in a classical free-air model. The preliminary results show that the wind-tunnel walls do not affect flutter prediction.

Chwalowski, Pawel↗
DOE OSTI2021

Fractional Modeling in Action: A Survey of Nonlocal Models for Subsurface Transport, Turbulent Flows, and Anomalous Materials

Modeling of phenomena such as anomalous transport via fractional-order differential equations has been established as an effective alternative to partial differential equations, due to the inherent ability to describe large-scale behavior with greater efficiency than fully-resolved classical models. In this review article, we first provide a broad overview of fractional-order derivatives with a clear emphasis on the stochastic processes that underlie their use. We then survey three exemplary application areas – subsurface transport, turbulence, and anomalous materials – in which fractional-order differential equations provide accurate and predictive models. For each area, we report on the evidence of anomalous behavior that justifies the use of fractional-order models, and survey both foundational models as well as more expressive state-of-the-art models. We also propose avenues for future research, including more advanced and physically sound models, as well as tools for calibration and discovery of fractional-order models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Modeling Heat Pipes with Non-Condensable Gases

The report showcases advancements in modeling heat pipes, considering both scenarios with and without non-condensable gases. To achieve this, two distinct modeling approaches are juxtaposed. Firstly, the effective conduction model, implemented in the MOOSE-based code Sockeye, is employed. Secondly, a first-of-a-kind two-phase Euler-Euler Computational Fluid Dynamics (CFD) model is developed using the STAR-CCM+ code. Both models undergo validation against experimental data, acknowledging the inherent uncertainties associated with each modeling assumption. Interestingly, the non-tuned CFD model surpasses the performance of the calibrated conduction model for heat pipes operating under both conditions: with and without non-condensable gases. It's worth noting, however, that the CFD models entail significantly longer runtimes compared to the conduction models. Nevertheless, the insights garnered from the CFD model shed invaluable light on the intricate operational dynamics of heat pipes. Future work involves broadening the validation scope of these models and continuing their development to enhance their utility as robust tools for heat pipe design and operational support.

42 ENGINEERING↗