Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Graph link prediction in computer networks using Poisson matrix factorisation

Graph link prediction is an important task in cybersecurity: relationships between entities within a computer network, such as users interacting with computers or system libraries and the corresponding processes that use them, can provide key insights into adversary behaviour. Poisson matrix factorisation (PMF) is a popular model for link prediction in large networks, particularly useful for its scalability. In this article PMF is extended to include scenarios that are commonly encountered in cybersecurity applications. Specifically, an extension is proposed to explicitly handle binary adjacency matrices and include known categorical covariates associated with the graph nodes. A seasonal PMF model is also presented to handle seasonal networks. To allow the methods to scale to large graphs, variational methods are discussed for performing fast inference. The results show an improved performance over the standard PMF model and other statistical network models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Data-driven prediction of scaling and ignition of inertial confinement fusion experiments

Recent advances in inertial confinement fusion (ICF) at the National Ignition Facility (NIF), including ignition and energy gain, are enabled by a close coupling between experiments and high-fidelity simulations. Neither simulations nor experiments can fully constrain the behavior of ICF implosions on their own, meaning pre- and postshot simulation studies must incorporate experimental data to be reliable. Linking past data with simulations to make predictions for upcoming designs and quantifying the uncertainty in those predictions has been an ongoing challenge in ICF research. We have developed a data-driven approach to prediction and uncertainty quantification that combines large ensembles of simulations with Bayesian inference and deep learning. The approach builds a predictive model for the statistical distribution of key performance parameters, which is jointly informed by past experiments and physics simulations. The prediction distribution captures the impact of experimental uncertainty, expert priors, design changes, and shot-to-shot variations. We have used this new capability to predict a 10× increase in ignition probability between Hybrid-E shots driven with 2.05 MJ compared to 1.9 MJ, and validated our predictions against subsequent experiments. We describe our new Bayesian postshot and prediction capabilities, discuss their application to NIF ignition and validate the results, and finally investigate the impact of data sparsity on our prediction results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

An Open-Source Framework for Characterizing Urban Energy Models: Integrating Top-Down and Bottom-Up Methods to Predict Residential Buildings Characteristics: Preprint

Bottom-up urban energy models are crucial for understanding current energy use patterns and informing design strategies. However, accurately characterizing these models to represent different communities remains a challenge due to the extensive data needed for simulating existing energy use behavior. This data includes information related to human activities and building characteristics, all of which correlate with socioeconomic factors. To overcome this challenge, we developed an automated framework that utilizes both top-down and bottom-up data, to predict unknown building and occupant characteristics that are needed for more accurate and equitable modeling and analytics. Our framework, integrated into the URBANopt district energy modeling platform, uses statistical data models from ResStock. URBANopt models co-located buildings and neighborhoods. At this scale there are data gaps in building characteristic data, such as materials, insulation, occupancy, income, and energy usage of the buildings. To address this data gap, we use ResStock data, representative at the census tract scale, and develop machine-learning and deeplearning techniques to disaggregate it to individual buildings. By mapping unique occupant, building and economic properties to URBANopt energy models, we gain detailed insights into the variability of building energy use across different neighborhoods. This insight helps deploy technologies for co-located buildings and supports targeted upgrades for communities with unique economic and demographic characteristics, ensuring energy equity. Accurate characterization of energy models allows us to develop equitable strategies tailored to diverse neighborhoods, whether underserved or affluent. Our automated framework streamlines energy modeling and provides a reliable tool for building energy characterization.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2021

Statistically bias-corrected and downscaled climate models underestimate the adverse effects of extreme heat on U.S. maize yields

Abstract Efforts to understand and quantify how a changing climate can impact agriculture often rely on bias-corrected and downscaled climate information, making it important to quantify potential biases of this approach. Here, we use a multi-model ensemble of statistically bias-corrected and downscaled climate models, as well as the corresponding parent models from the Coupled Model Intercomparison Project Phase 5 (CMIP5), to drive a statistical panel model of U.S. maize yields that incorporates season-wide measures of temperature and precipitation. We analyze uncertainty in annual yield hindcasts, finding that the CMIP5 models considerably overestimate historical yield variability while the bias-corrected and downscaled versions underestimate the largest weather-induced yield declines. We also find large differences in projected yields and other decision-relevant metrics throughout this century, leaving stakeholders with modeling choices that require navigating trade-offs in resolution, historical accuracy, and projection confidence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Examining the Robustness of Weakened Orographic Influence on Precipitation in Downscaled Climate Projections Over the Western US

Assessing local climate change impacts often requires downscaling coarse global climate model (GCM) output to finer resolution. Two main approaches exist: dynamical downscaling using high-resolution regional climate models, and statistical downscaling based on historical relationships between large-scale and local variables. In a recent analysis of five dynamically downscaled simulations over the western United States, Koszuta et al. (2024, https://doi.org/10.1029/2023gl107298) found that warming weakens orographic influence on winter precipitation, damping increases on windward slopes and amplifying them in rain-shadowed regions. Here we show that this effect is robust across seasons and multiple dynamically downscaled ensembles, and is more pronounced at higher model resolutions. However, it is absent in projections from a widely used statistical model (LOCA2), even when trained on high-resolution future simulations (LOCA2-Hybrid). This highlights a key limitation of many statistical downscaling methods: their preservation of parent GCM trends, which usually fail to capture emergent changes in orographic precipitation patterns.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Full forward model of galaxy clustering statistics with AbacusSummit light cones

ABSTRACT Novel summary statistics beyond the standard 2-point correlation function (2PCF) are necessary to capture the full astrophysical and cosmological information from the small-scale (r < 30h−1Mpc) galaxy clustering. However, the analysis of beyond-2PCF statistics on small scales is challenging because we lack the appropriate treatment of observational systematics for arbitrary summary statistics of the galaxy field. In this paper, we develop a full forward modelling pipeline for a wide range of summary statistics using the large high-fidelity AbacusSummit light cones that account for many systematic effects as well as remain flexible and computationally efficient to enable posterior sampling. We apply our forward model approach to a fully realistic mock galaxy catalog and demonstrate that we can recover unbiased constraints on the underlying galaxy–halo connection model using two separate summary statistics: the standard 2PCF and the novel k-th nearest neighbour (kNN) statistics, which are sensitive to correlation functions of all orders. We will demonstrate its strong constraining power on extended galaxy–halo connection models and cosmology in follow up papers. We expect this to become a powerful approach when applying to upcoming surveys such as DESI where we can leverage a multitude of summary statistics across a wide redshift range to maximally extract information from the non-linear scales.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Statistical (n,$$\gamma $$) cross section model comparison for short-lived nuclei

Abstract Neutron-capture cross sections of neutron-rich nuclei are calculated using a Hauser–Feshbach model when direct experimental cross sections cannot be obtained. A number of codes to perform these calculations exist, and each makes different assumptions about the underlying nuclear physics. We investigated the systematic uncertainty associated with the choice of Hauser-Feshbach code used to calculate the neutron-capture cross section of a short-lived nucleus. The neutron-capture cross section for $$^{73}\hbox {Zn}$$ 73 Zn (n, $$\gamma $$ γ ) $$^{74}\hbox {Zn}$$ 74 Zn was calculated using three Hauser-Feshbach statistical model codes: TALYS, CoH, and EMPIRE. The calculation was first performed without any changes to the default settings in each code. Then an experimentally obtained nuclear level density (NLD) and $$\gamma $$ γ -ray strength function ( $$\gamma \hbox {SF}$$ γ SF ) were included. Finally, the nuclear structure information was made consistent across the codes. The neutron-capture cross sections obtained from the three codes are in good agreement after including the experimentally obtained NLD and $$\gamma \hbox {SF}$$ γ SF , accounting for differences in the underlying nuclear reaction models, and enforcing consistent approximations for unknown nuclear data. It is possible to use consistent inputs and nuclear physics to reduce the differences in the calculated neutron-capture cross section from different Hauser-Feshbach codes. However, ensuring the treatment of the input of experimental data and other nuclear physics are similar across multiple codes requires a careful investigation. For this reason, more complete documentation of the inputs and physics chosen is important.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

National Climate Database (NCDB)

The National Climate Database (NCDB) is a high resolution, bias-corrected climate dataset consisting of the three most widely used variables of solar radiation- global horizontal (GHI), direct normal (DNI), and diffuse horizontal irradiance (DHI)- as well as other meteorological data. The goal of the NCDB is to provide unbiased high temporal and spatial resolution climate data needed for renewable energy modeling. The NCDB is modeled using a statistical downscaling approach with Regional Climate Model (RCM)-based climate projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX; linked below). Daily climate projections simulated by the Canadian Regional Climate Model 4 (CanRCM4) forced by the second-generation Canadian Earth System Model (CanESM2) for two Representative Concentration Pathways (RCP4.5 or moderate emissions scenario and RCP8.5 or highest baseline emission scenario) are selected as inputs to the statistical downscaling models. The National Solar Radiation Database (NSRDB) is used to build and calibrate statistical models.

Array↗
DOE OSTI2023

Probabilistic-learning-based stochastic surrogate model from small incomplete datasets for nonlinear dynamical systems

We consider a high-dimensional nonlinear computational model of a dynamical system, parameterized by a vector-valued control parameter, in the presence of uncertainties represented by an uncontrolled parameter modeled by a vector-valued random variable, and possibly with stochastic excitation. The objective is to construct a statistical surrogate model where the input is any deterministic value of the control parameter, and the output is a vector-valued observation of the computational model, which is a random vector whose probability measure is updated using a target dataset. To construct this statistical surrogate model, the stochastic response of the computational model must be built, which is a vector-valued time-discretized stochastic process in high dimension, depending on the control parameter. It is assumed that the computational cost of a single evaluation of the deterministic model is high. For the probabilistic updating, we consider a subset of the components of the observation of the computational model, defined as the “identification observation” of the computational model, for which a small target dataset is available. Therefore, the target dataset is associated with partial observability, corresponding to an incomplete data case. Given a prior probability model of the random control and uncontrolled parameters, a training dataset is constructed, consisting of realizations of the random triplet composed of the stochastic response, the random identification observation, and the random control parameter. Since the computational cost of a single evaluation of the deterministic model is assumed to be large, the training dataset is also of small size. The main challenges in this problem are the high dimensionality, partial observability leading to incomplete data in the target dataset for the identification observation of the computational model (which is not sufficient to identify the computational stochastic responses), and the availability of a small training dataset. To address these challenges, we propose a methodology based on statistical methods for constructing necessary reduced representations, direct probabilistic learning under constraints using probabilistic learning on manifolds (PLoM) constrained by the target dataset, and the use of a weak formulation of the Fourier transform of probability measures. Statistical conditioning is also employed to explore the learned dataset. The constructed predictive statistical surrogate model can be implemented in the context of online computation. Here, we apply this approach to a problem of nonlinear stochastic dynamics in high dimensions within the framework of deformable solids mechanics.

Engineering↗
DOE OSTI2020

A Remote Sensing Technique to Upscale Methane Emission Flux in a Subtropical Peatland

Abstract Quantification of methane (CH 4 ) gas emission from peat is critical to understand CH 4 budget from natural wetlands under a climate warming scenario. Previous studies have focused on prediction and mapping of CH 4 emission flux using process‐based models, while application of statistical‐empirical models for upscaling spatially sparse in situ measurements is scarce. In this study, we developed an empirical remote sensing upscaling approach to estimate CH 4 emission flux in the Everglades using limited in situ point‐based CH 4 emission flux measurements and Landsat data during 2013–2018. We spatially and temporally linked in situ data with Landsat surface reflectance based on temporally composite data sets and developed an object‐based machine learning framework to model and map CH 4 emission flux. An ensemble analysis of two machine learning models, k ‐Nearest Neighbor ( k ‐NN) and Support Vector Machine (SVM), shows that the upscaling approach is promising for predicting CH 4 emission flux with a R 2 of 0.65 and 0.87 based on a fivefold cross‐validation for a dry season and wet season estimation, respectively. We generated emission flux map products that successfully revealed the spatial and temporal heterogeneity of CH 4 emission within the dominant freshwater marsh ecosystem in the Everglades. We conclude that Landsat is promising for upscaling and monitoring CH 4 emission flux and reducing the uncertainty in emission estimates from wetlands.

Zhang, Caiyun↗
DOE OSTI2025

Towards absolutely stable ergodicity breaking in two and three dimensions

We propose physically reasonable systems capable of avoiding ergodicity at infinite time in the thermodynamic limit, even with generic perturbations and when coupled to a heat bath. In two dimensions, the rainbow loop soup has (stretched) exponentially numerous absolutely stable nonergodic states with diverging energy but vanishing energy density. In three dimensions the rainbow membrane soup has (stretched) exponentially numerous nonergodic states with diverging energy barriers, leading to infinite-time robust ergodicity breaking that even survives coupling to a nonzero temperature heat bath. We describe our results in the language of exact emergent symmetries and demonstrate how the systems avoid common instabilities. Furthermore, our construction naturally connects to quantum dimer models, topologically ordered systems, the group word construction, and Hamiltonians whose low-energy eigenstates exhibit anomalous entanglement entropy.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Framework for phase transitions between the Maxwell and Gibbs constructions

By taking the nucleon-to-quark phase transition within a neutron star as an example, we present a thermodynamically consistent method to calculate the equation of state of ambient matter so that transitions that are intermediate to those of the familiar Maxwell and Gibbs constructions can be described. This method does not address the poorly known surface tension between the two phases microscopically (as, for example, in the calculation of the core pasta phases via the Wigner-Seitz approximation) but instead combines the local and global charge neutrality conditions characteristic of the Maxwell and Gibbs constructions, respectively. Overall charge neutrality is achieved by dividing the leptons to those that obey local charge neutrality (Maxwell) and those that maintain global charge neutrality (Gibbs). The equation of state is obtained by using equilibrium constraints derived from minimizing the total energy density. The results of this minimization are then used to calculate neutron star mass-radius curves, tidal deformabilities, equilibrium and adiabatic sound speeds, and nonradial g-mode oscillation frequencies for several intermediate constructions. Various quantities of interest transform smoothly from their Gibbs structures to those of Maxwell as the local-to-total electron ratio η, introduced to mimic the hadron-to-quark interface tension from 0 (Gibbs) to ∞ (Maxwell), is raised from 0 to 1. As a result, a notable exception is the g-mode frequency for the specific case of η = 1 for which a gap appears between the quark and hadronic branches.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Measurement-induced criticality in random quantum circuits

We investigate the critical behavior of the entanglement transition induced by projective measurements in (Haar) random unitary quantum circuits. Using a replica approach, we map the calculation of the entanglement entropies in such circuits onto a two-dimensional statistical-mechanics model. In this language, the area- to volume-law entanglement transition can be interpreted as an ordering transition in the statistical-mechanics model. We derive the general scaling properties of the entanglement entropies and mutual information near the transition using conformal invariance. We analyze in detail the limit of infinite on-site Hilbert space dimension in which the statistical-mechanics model maps onto percolation. In particular, we compute the exact value of the universal coefficient of the logarithm of subsystem size in the n th Rényi entropies for n ≥ 1 in this limit using relatively recent results for the conformal field theory describing the critical theory of two-dimensional (2D) percolation, and we discuss how to access the generic transition at finite on-site Hilbert space dimension from this limit, which is in a universality class different from 2D percolation. Here, we also comment on the relation to the entanglement transition in random tensor networks, studied previously in Vasseur et al. [Phys. Rev. B 100, 134203 (2019)].

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Flood Susceptibility Mapping Using Machine Learning and Geospatial-Sentinel-1 SAR Integration for Enhanced Early Warning Systems

This study presents a comprehensive framework for flood susceptibility mapping by integrating geospatial factors with both statistical and machine learning models. Thirteen Flood-related factors, including DEM, slope, TWI, NDVI, etc., are extracted as features of models, and historical flood data derived from Sentinel-1 SAR from 2018 to 2023 are used as the target variables of the models. These datasets are analyzed using a frequency-based statistical model and three machine learning models, including Random Forest, XGBoost, and CNN, to generate flood susceptibility maps. The performance of each model is evaluated through AUC; and SHAP scores are separately generated for Machine learning (ML) models to explain each feature contribution in the ML model. The generated susceptibility maps are validated by high-flood-risk locations monitored by flood sensors, BLE inundation models, and flood-prone areas suggested by the Local Community Task Force. The results indicate that the XGBoost model outperforms all other models, with an AUC of 0.92 and demonstrates the highest alignment with recommended high-flood-risk locations, while the frequency-based statistical model showed the weakest performance with an AUC of 0.65. SHAP value graphs highlight the elevation, slope, and TWI as the most influential features across all models. The susceptibility maps generated by the machine learning model show strong agreement with the BLE map and high-flood-risk areas identified by the local Community Task Force.

Google Engine↗
DOE OSTI2021

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗
DOE OSTI2025

Direct statistical simulation of the Lorenz96 system in model reduction approaches

Direct statistical simulation (DSS) of nonlinear dynamical systems bypasses the traditional route of accumulating statistics by lengthy direct numerical simulations by solving the equations that govern the statistics themselves. DSS suffers, however, from the curse of dimensionality as the statistics (such as correlations) generally have higher dimensions than the underlying dynamical variables. Here we investigate two approaches to reduce the dimensionality of DSS, illustrating each method with numerical experiments with the Lorenz96 dynamical system. The forms of DSS chosen here involve approximate closures at second and third order in the equal-time cumulants. We demonstrate significant reduction in computational effort that can be achieved without sacrificing the accuracy of DSS. The methods developed here can be applied to turbulent fluid and magnetohydrodynamical systems. Published by the American Physical Society 2025

Li, Kuan↗