Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Improved Statistical Analysis for the Neutrinoless Double-Beta Decay Matrix Element of 136Xe

Neutrinoless double beta decay nuclear matrix element (M0ν) for 136Xe was recently analyzed using a statistical approach (Phys. Rev. C 107, 045501 (2023)). In the analysis, three initial shell model effective Hamiltonians were randomly altered, and their results for 23 measured observables were used to infer credibility for the M0ν nuclear matrix element (NME) based on a Bayesian Model Averaging approach. In that analysis, a reasonable Gamow-Teller quenching factor of 0.7 was assumed for each starting effective Hamiltonian. Given that the result of the statistical analysis was sensible to this choice, we are here improving that analysis by assuming that the Gamow-Teller quenching factor is also randomly chosen within reasonabe limits for all three starting Hamiltonians. The outcomes are slightly higher expectation values and uncertainties for the M0ν NME.

Astronomy & Astrophysics↗

ENSO-driven energy budget perturbations in observations and CMIP models

Various observation-based datasets are employed to robustly quantify changes in ocean heat content (OHC), anomalous ocean–atmosphere energy exchanges and atmospheric energy transports during El Niño-Southern Oscillation (ENSO). These results are used as a benchmark to evaluate the energy pathways during ENSO as simulated by coupled climate model runs from the CMIP3 and CMIP5 archives. The models are able to qualitatively reproduce observed patterns of ENSO-related energy budget variability to some degree, but key aspects are seriously biased. Area-averaged tropical Pacific OHC variability associated with ENSO is greatly underestimated by all models because of strongly biased responses of net radiation at top-of-the-atmosphere to ENSO. The latter are related to biases of mean convective activity in the models and project on surface energy fluxes in the eastern Pacific Intertropical Convergence Zone region. Moreover, models underestimate horizontal and vertical OHC redistribution in association with the generally too weak Bjerknes feedback, leading to a modeled ENSO affecting a too shallow layer of the Pacific. Vertical links between SST and OHC variability are too weak even in models driven with observed winds, indicating shortcomings of the ocean models. Furthermore, modeled teleconnections as measured by tropical Atlantic OHC variability are too weak and the tropical zonal mean ENSO signal is strongly underestimated or even completely missing in most of the considered models. In conclusion, results suggest that attempts to infer insight about climate sensitivity from ENSO-related variability are likely to be hampered by biases in ENSO in CMIP simulations that do not bear a clear link to future changes.

54 ENVIRONMENTAL SCIENCES↗

Estimation of inflow uncertainties in laminar hypersonic double-cone experiments

We propose herein a probabilistic framework for assessing the consistency of an experimental dataset, i.e., whether the stated experimental conditions are consistent with the measurements provided. In case the dataset is inconsistent, our framework allows one to hypothesize and test sources of inconsistencies. This is crucial in model validation efforts. The framework relies on Bayesian inference to estimate experimental settings deemed uncertain, from measurements deemed accurate. The quality of the inferred variables is gauged by its ability to reproduce held-out experimental measurements. We test the correctness of the framework on three double-cone experiments conducted in the CUBRC Inc.'s LENS-I shock tunnel, which have also been numerically simulated successfully. Thereafter, we use the framework to investigate two double-cone experiments (executed in the LENS-XX shock tunnel) which have encountered difficulties when used in model validation exercises. We detect an inconsistency with one of the LENS-XX experiments. In addition, we hypothesize two causes for our inability to simulate LEXS-XX experiments accurately and test them using our framework. We find that there is no single cause that explains all the discrepancies between model predictions and experimental data, but different causes explain different discrepancies, to larger or smaller extent. We end by proposing that uncertainty quantification methods be used more widely to understand experiments and characterize facilities, and we cite three different methods to do so, the third of which we present in this paper.

Thermophysics↗

THE NON-UNIVERSALITY OF THE LOW-MASS END OF THE IMF IS ROBUST AGAINST THE CHOICE OF SSP MODEL

We perform a direct comparison of two state-of-the art single stellar population (SSP) models that have been used to demonstrate the non-universality of the low-mass end of the initial mass function (IMF) slope. The two public versions of the SSP models are restricted to either solar abundance patterns or solar metallicity, too restrictive if one aims to disentangle elemental enhancements, metallicity changes, and IMF variations in massive early-type galaxies (ETGs) with star formation histories different from those in the solar neighborhood. We define response functions (to metallicity and α-abundance) to extend the parameter space for each set of models. We compare these extended models with a sample of Sloan Digital Sky Survey (SDSS) ETG spectra with varying velocity dispersions. We measure equivalent widths of optical IMF-sensitive stellar features to examine the effect of the underlying model assumptions and ingredients, such as stellar libraries or isochrones, on the inference of the IMF slope down to ∼0.1 M{sub ⊙}. We demonstrate that the steepening of the low-mass end of the IMF based on a non-degenerate set of spectroscopic optical indicators is robust against the choice of the stellar population model. Although the models agree in a relative sense (i.e., both imply more bottom-heavy IMFs for more massive systems), we find non-negligible differences in the absolute values of the IMF slope inferred at each velocity dispersion by using the two different models. In particular, we find large inconsistencies in the quantitative predictions of the IMF slope variations and abundance patterns when sodium lines are used. We investigate the possible reasons for these inconsistencies.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine Learning Models for Network Traffic Classification in Programmable Logic

Network traffic classification via machine learning on network packet payloads has emerged as an active area of research for network security due to the high accuracy machine learning models have achieved in classifying payloads. For effective deployment as part of network security, these machine learning models must not only classify malicious packet payloads accurately, they must also identify anomalous payloads and perform inference at speeds generally faster than 10,000 packets per second to be effective. This work explores the in- ference speeds and accuracy of several neural network models implemented in programmable logic on various field programmable gate arrays (FPGA) including the Xilinx VC1902 and Xilinx Zynq Ultrascale+. This work also presents the design and performance of both an autoencoder and variational autoencoder programmed on the FPGA for identifying anomalous packet payloads. The performance benefits of the FPGA implementation for this type of packet payload inspection driven by machine learning are compared against graphics processing unit (GPU) inference implementations run on two state-of-the-art datacenter GPU devices, the NVIDIA V100 and A100. The model accuracy difference between the FPGA and GPU implementations was found to be 4% or less while the Xilinx VC1902 outperformed both the NVIDIA V100 and A100 for inference speeds on all the models explored except the variational autoencoder.

97 MATHEMATICS AND COMPUTING↗

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗

Graph link prediction in computer networks using Poisson matrix factorisation

Graph link prediction is an important task in cybersecurity: relationships between entities within a computer network, such as users interacting with computers or system libraries and the corresponding processes that use them, can provide key insights into adversary behaviour. Poisson matrix factorisation (PMF) is a popular model for link prediction in large networks, particularly useful for its scalability. In this article PMF is extended to include scenarios that are commonly encountered in cybersecurity applications. Specifically, an extension is proposed to explicitly handle binary adjacency matrices and include known categorical covariates associated with the graph nodes. A seasonal PMF model is also presented to handle seasonal networks. To allow the methods to scale to large graphs, variational methods are discussed for performing fast inference. The results show an improved performance over the standard PMF model and other statistical network models.

97 MATHEMATICS AND COMPUTING↗

Bayesian projection pursuit regression

In projection pursuit regression (PPR), a univariate response variable is approximated by the sum of $M$ “ridge functions,” which are flexible functions of one-dimensional projections of a multivariate input variable. Traditionally, optimization routines are used to choose the projection directions and ridge functions via a sequential algorithm, and $M$ is typically chosen via cross-validation. Here, we introduce a novel Bayesian version of PPR, which has the benefit of accurate uncertainty quantification. To infer appropriate projection directions and ridge functions, we apply novel adaptations of methods used for the single ridge function case ($M$=1), called the Bayesian Single Index Model; and use a Reversible Jump Markov chain Monte Carlo algorithm to infer the number of ridge functions $M$. We evaluate the predictive ability of our model in 20 simulated scenarios and for 23 real datasets, in a bake-off against an array of state-of-the-art regression methods. Finally, we generalize this methodology and demonstrate the ability to accurately model multivariate response variables. Its effective performance indicates that Bayesian Projection Pursuit Regression is a valuable addition to the existing regression toolbox.

97 MATHEMATICS AND COMPUTING↗

Azimuthal asymmetry in the risetime of the surface detector signals of the Pierre Auger Observatory

The azimuthal asymmetry in the risetime of signals in Auger surface detector stations is a source of information on shower development. The azimuthal asymmetry is due to a combination of the longitudinal evolution of the shower and geometrical effects related to the angles of incidence of the particles into the detectors. The magnitude of the effect depends upon the zenith angle and state of development of the shower and thus provides a novel observable, (secθ) max , sensitive to the mass composition of cosmic rays above 3 x 10 18 eV. By comparing measurements with predictions from shower simulations, we find for both of our adopted models of hadronic physics (QGSJETII-04 and EPOS-LHC) an indication that the mean cosmic-ray mass increases slowly with energy, as has been inferred from other studies. However, the mass estimates are dependent on the shower model and on the range of distance from the shower core selected. Furthermore, the method has uncovered further deficiencies in our understanding of shower modelling that must be resolved before the mass composition can be inferred from (secθ) max .

79 ASTRONOMY AND ASTROPHYSICS↗

Yield strength dependence on strain rate of molybdenum-alloy nanofibers

The yield strength dependence on strain rate was studied for molybdenum-alloy nanofibers with varying initial dislocation density at three different pre-strain levels. In-situ tensile experiments at three displacement rates were carried out in a scanning electron microscope. Yield strength and its scatter decreased as a function of the pre-strain level for different displacement rates. A statistical model was used to analyze the results, and a negative strain rate dependence was inferred from the yield experiments. This finding suggests the need for theoretical investigations since classical models such as dynamic strain aging may have limitations at such nanoscales.

36 MATERIALS SCIENCE↗

Exploring Resonance Structures in the Partial-Wave Analysis of ¿p0 Photoproduction at GlueX

This thesis studies what happens when a photon (¿) collides with a proton (p) and produces a neutral omega (¿) and pion (p0) pair, with a recoiling proton (p'), expressed as ¿p ¿ ¿p0p'. We study this and other reactions to better understand the strong nuclear force; one of the four fundamental forces that govern all the physics of the universe. This force is specifically responsible for the binding and decay of subatomic particles, such as the ones here. While we understand the ¿ and p0, what we are actually interested in is a short-lived unknown particle X that decays via X ¿ ¿p0. There are a multitude of possible particles X can be, and so our focus in this work is to find out what X is by determining its properties from the particles we measure. We do this via an intricate analysis procedure known as “partial-wave analysis”. By analogy, one can think of our particle detector as a buoy, and the particles we want to analyze (X) as pebbles hitting a pond. The waves created by the pebble will move our buoy, giving us information about the pebble that produced the wave. However, when multiple pebbles hit our pond, the waves overlap and interfere with each other. Our buoy only can measure the complicated interfering result of all the waves. To disentangle this, our partial-wave analysis works by modeling this interference pattern so that we may infer the properties of the pebbles (particles) we produced. In this thesis, we review the relevant experimental history in photoproduction and related production mechanisms, as well as the theoretical foundations that motivate our measurement. We describe the methods used to collect our data at the GlueX experiment stationed at the Jefferson Lab accelerator facility in Newport News, Virginia. We then detail the selections we apply to ensure our events are almost exclusively ¿p ¿ ¿p0p'. We cover the intensity model, how we verify its capabilities, and finally present our results together with systematic studies. Our primary result is the detection of a b1(1235) meson interfering with a wide JPC = 1-- vector state, measured via a mass-independent partial-wave analysis. It provides precise experimental results that can be used as input for theoretical models of the reaction, yielding conclusions about the procedures responsible for how our universe behaves at its most basic level.

Scheuer, Kevin [College of William and Mary, Willi↗

Pulse profile modelling of thermonuclear burst oscillations − I. The effect of neglecting variability

ABSTRACT We study the effects of the time-variable properties of thermonuclear X-ray bursts on modelling their millisecond-period burst oscillations. We apply the pulse profile modelling technique that is being used in the analysis of rotation-powered millisecond pulsars by the Neutron Star Interior Composition Explorer to infer masses, radii, and geometric parameters of neutron stars. By simulating and analysing a large set of models, we show that overlooking burst time-scale variability in temperatures and sizes of the hot emitting regions can result in substantial bias in the inferred mass and radius. To adequately infer neutron star properties, it is essential to develop a model for the time-variable properties or invest a substantial amount of computational time in segmenting the data into non-varying pieces. We discuss prospects for constraints from proposed future X-ray telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗

Predicting Building Envelope Construction from In-Situ Thermal Testing

When embarking on a retrofit of a building envelope, it is critical to understand the composition of its assembly. This practice is currently done by destructive and invasive material testing or demolition, which is sometimes not possible when in historic or protected buildings. To address this problem, in-situ thermal testing can be utilized along with machine learning classification algorithms to infer the composition of an assembly. In this paper, a proof-of-concept K-nearest neighbors classification model is developed to classify assembly composition from effective thermal resistance, effective thermal mass, and assembly cladding. This model was trained and tested utilizing a synthetic dataset producing an F1-score of 94.6%. This model was also validated with experimental data from a 100-year old wall assembly, confirming the model’s real-world validity. The paper presents a framework for inferring as-built envelope assemblies, all without having to damage or disturb the building and its occupants.

Pilet, Tyler J.↗

An Adaptive-Importance-Sampling-Enhanced Bayesian Approach for Topology Estimation in an Unbalanced Power Distribution System

The reliable operation of a power distribution system relies on a good prior knowledge of its topology and its system state. Although crucial, due to the lack of direct monitoring devices on the switch statuses, the topology information is often unavailable or outdated for the distribution system operators for real-time applications. Apart from the limited observability of the power distribution system, other challenges are the nonlinearity of the model, the complicated, unbalanced structure of the distribution system, and the scale of the system. To overcome the above challenges, we, in this paper, propose a Bayesian-inference framework that allows us to simultaneously estimate the topology and the state of a three-phase, unbalanced power distribution system. Specifically, by using the very limited number of measurements available that are associated with the forecast load data, we efficiently recover the full Bayesian posterior distributions of the system topology under both normal and outage operation conditions. This is performed through an adaptive importance sampling procedure that greatly alleviates the computational burden of the traditional Monte-Carlo (MC)-sampling-based approach while maintaining a good estimation accuracy. The simulations conducted on the IEEE 123-bus test system and an unbalanced 1282-bus system reveal the excellent performances of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

GPU-Accelerated Machine Learning Inference as a Service for Computing in Neutrino Experiments

Machine learning algorithms are becoming increasingly prevalent and performant in the reconstruction of events in accelerator-based neutrino experiments. These sophisticated algorithms can be computationally expensive. At the same time, the data volumes of such experiments are rapidly increasing. The demand to process billions of neutrino events with many machine learning algorithm inferences creates a computing challenge. We explore a computing model in which heterogeneous computing with GPU coprocessors is made available as a web service. The coprocessors can be efficiently and elastically deployed to provide the right amount of computing for a given processing task. With our approach, Services for Optimized Network Inference on Coprocessors (SONIC), we integrate GPU acceleration specifically for the ProtoDUNE-SP reconstruction chain without disrupting the native computing workflow. With our integrated framework, we accelerate the most time-consuming task, track and particle shower hit identification, by a factor of 17. This results in a factor of 2.7 reduction in the total processing time when compared with CPU-only production. For this particular task, only 1 GPU is required for every 68 CPU threads, providing a cost-effective solution.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Comparing the DES-SN5YR and Pantheon+ SN cosmology analyses: investigation based on ‘evolving dark energy or supernovae systematics’?

Recent cosmological analyses measuring distances of type Ia supernovae (SNe Ia) and baryon acoustic oscillations (BAO) have all given similar hints at time-evolving dark energy. To examine whether underestimated SN Ia systematics might be driving these results, Efstathiou (2025) compared overlapping SN events between Pantheon+ and DES-SN5YR (20 per cent SNe are in common), and reported evidence for an $\sim$0.04 mag offset between the low- and high-redshift distance measurements of this subsample of events. If this offset is arbitrarily subtracted from the entire DES-SN5YR sample, the preference for evolving dark energy is reduced. In this paper, we show that this offset is mostly due to different corrections for Malmquist bias between the two samples; therefore, an object-to-object comparison can be misleading. Malmquist bias corrections differ between the two analyses for several reasons. First, DES-SN5YR used an improved model of SN Ia luminosity scatter compared to Pantheon+ but the associated scatter-model uncertainties are included in the error budget. Secondly, improvements in host mass estimates in DES-SN5YR also affected SN standardized magnitudes and their bias corrections. Thirdly, and most importantly, the selection functions of the two compilations are significantly different, hence the inferred Malmquist bias corrections. Even if the original scatter model and host properties from Pantheon+ are used instead, the evidence for evolving dark energy from CMB, DESI BAO Year 1 and DES-SN5YR is only reduced from 3.9$\sigma$ to 3.3$\sigma$, consistent with the error budget. Finally, in this investigation, we identify an underestimated systematic uncertainty related to host galaxy property uncertainties, which could increase the final DES-SN5YR error budget by 3 per cent. In conclusion, we confirm the validity of the published DES-SN5YR results.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation-based inference for parameter estimation of complex watershed simulators

High-resolution, spatially distributed process-based (PB) simulators are widely employed in the study of complex catchment processes and their responses to a changing climate. However, calibrating these PB simulators using observed data remains a significant challenge due to several persistent issues, including the following: (1) intractability stemming from the computational demands and complex responses of simulators, which renders infeasible calculation of the conditional probability of parameters and data, and (2) uncertainty stemming from the choice of simplified representations of complex natural hydrologic processes. Here, we demonstrate how simulation-based inference (SBI) can help address both of these challenges with respect to parameter estimation. SBI uses a learned mapping between the parameter space and observed data to estimate parameters for the generation of calibrated simulations. To demonstrate the potential of SBI in hydrologic modeling, we conduct a set of synthetic experiments to infer two common physical parameters – Manning's coefficient and hydraulic conductivity – using a representation of a snowmelt-dominated catchment in Colorado, USA. We introduce novel deep-learning (DL) components to the SBI approach, including an “emulator” as a surrogate for the PB simulator to rapidly explore parameter responses. We also employ a density-based neural network to represent the joint probability of parameters and data without strong assumptions about its functional form. While addressing intractability, we also show that, if the simulator does not represent the system under study well enough, SBI can yield unreliable parameter estimates. Approaches to adopting the SBI framework for cases in which multiple simulator(s) may be adequate are introduced using a performance-weighting approach. The synthetic experiments presented here test the performance of SBI, using the relationship between the surrogate and PB simulators as a proxy for the real case.

54 ENVIRONMENTAL SCIENCES↗

MOOSE ProbML: Parallelizable Probabilistic Machine Learning and Uncertainty Quantification Capabilities

The Multiphysics Object Oriented Simulation Environment (MOOSE) is a widely used open- source finite element software for performing multiphysics multiscale simulations in a massively parallel fashion. Recently, the computational team at Idaho National Laboratory (INL) has implemented Probabilistic Machine Learning (ProbML) capabilities in MOOSE—in a parallelized fashion—and enable active learning with large-scale computational models for tasks such as surrogate model development, scale bridging, forward/inverse uncertainty quantification (UQ), Bayesian optimization, etc. This presentation summarizes these developments in MOOSE along with demonstrations on several real applications relevant to nuclear energy. At the fundamental level, samplers like Monte Carlo/Latin Hypercube, variance reduction, parallelized Markov Chain Monte Carlo (MCMC) support uncertainty propagation in both forward and inverse settings. These samplers can be integrated with the Gaussian processes (GP) suite in MOOSE, which offer several variants like scalar GPs, multi-output GPs, and deep GPs, to enable active learning. These GPs can be tuned using gradient-based optimization methods like Adam and its variants or gradient-free methods like the elliptical slice sampler (a variant of MCMC adept under Gaussian settings) for more complex covariance kernels or likelihoods whose gradient computations can be cumbersome. A variety of batch acquisition functions permit parallelized evaluation of the computational model and support different learning objectives with high efficiency like Bayesian inference, global surrogate development, optimization, etc. Furthermore, libtorch integration supports training, evaluation, and re-training of neural networks and other complex machine learning models in active learning settings. The impacts of these developments are shown on several real applications: (1) nuclear fuel inverse UQ and model inadequacy assessment using the Kennedy O’Hagan framework; (2) uncertainty aware surrogate modeling for additive manufacturing to predict field quantities; (3) nuclear reactor rare events analysis; and (4) complex fluid flow prediction using a global surrogate with quantified prediction uncertainty. Finally, the outlook of MOOSE ProbML is discussed for both outer-loop and inner-loop computations in the broad view to accelerate fuels and materials qualification, address gaps in knowledge and data, and assess new reactor/fuel systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗