Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distribution shift”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Assessing Membership Inference Attacks under Distribution Shifts

Membership inference attacks (MIAs) exploit machine learning models to infer whether a data point was in the training set, posing significant privacy risks even with limited black-box access. These attacks rely on the attacker approximating the target model’s training distribution, yet the impact of distribution shifts between target and shadow models on MIA success remains underexplored. We systematically evaluate five types of distribution shifts —-cutout, jitter, Gaussian noise, label shift, and attribute shift —- at varying intensities. Our results reveal that these shifts affect MIA effectiveness in nuanced ways, with some reducing attack success while others exacerbate vulnerabilities, and the same shift can have opposite effects depending on the type of MIA. This highlights the complex interplay between distributional differences and attack performance, offering critical insights for improving model defenses against MIAs.

Shi, Yichuan [Massachusetts Institute of Technolog↗
DOE OSTI2025

Data-Conforming Data-Driven Control: Avoiding Premature Generalizations Beyond Data

Data-driven and adaptive control approaches face the problem of introducing sudden distributional shifts beyond the distribution of data encountered during learning. Therefore, they are prone to invalidating the very assumptions used in their own construction. This is due to the linearity of the underlying system, inherently assumed and formulated in most data-driven control approaches, which may falsely generalize the behavior of the system beyond the behavior experienced in the data. This article seeks to mitigate these problems by enforcing consistency of the newly designed closed-loop systems with data and slowing down any distributional shifts in the joint state-input space. This is achieved through incorporating affine regularization terms and linear matrix inequality constraints to data-driven approaches, resulting in convex semi-definite programs that can be efficiently solved by standard software packages. We discuss the optimality conditions of these programs and then conclude this article with a numerical example that further highlights the problem of premature generalization beyond data and shows the effectiveness of our proposed approaches in enhancing the safety of data-driven control methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluating Entrainment–Mixing Characteristics through Direct Comparisons of Drop Size Distributions Using In Situ Observations from ACE-ENA

Abstract Constraining the impacts of entrainment and associated mixing (i.e., entrainment–mixing) on cloud properties continues to be difficult, partly due to observational uncertainties as well as a lacking consensus of which methodologies for diagnosing entrainment–mixing are most appropriate. This study introduces a novel method to evaluate the presence and degree of inhomogeneous and homogeneous mixing using ∼100 h of in situ observations from a research aircraft over the northeastern Atlantic. Specifically, drop size distributions are compared between regions containing negligible and significant entrainment for select flight legs, making a direct characterization of the degree of homogeneous and inhomogeneous mixing possible. A measure of drop concentration variance is used as a proxy variable to diagnose entrainment–mixing. Results correspond well with entrainment–mixing metrics, showing lower Damköhler numbers where drop size distributions shift toward smaller drop sizes (i.e., inhomogeneous mixing) and greater transition length scales where drop size distributions do not (i.e., homogeneous mixing). Inhomogeneous mixing occurs in most samples from Aerosol and Cloud Experiment in the Eastern North Atlantic (ACE-ENA) (regardless of homogeneous mixing frequencies increasing with increasing spatial resolution from ∼100 to ∼10 m) and is associated with decreased drop size relative dispersion and both greater aerosol and drop concentrations compared with homogeneous mixing. Precipitating clouds have a greater frequency of homogeneous mixing compared with nonprecipitating clouds. The proposed methodology is similarly applied to in situ observations of southeast Pacific stratocumulus, shallow convective clouds over central Oklahoma and low-level clouds over the Southern Ocean. All four locations are primarily dominated by inhomogeneous mixing with minimal variability among each region.

Clouds↗
DOE OSTI2026

SimLBR: Learning to Detect Fake Images by Learning to Detect Real Images

The rapid advancement of generative models has made the detection of AI-generated images a critical challenge for both research and society. Recent works have shown that most state-of-the-art fake image detection methods overfit to their training data and catastrophically fail when evaluated on curated hard test sets with strong distribution shifts. In this work, we argue that it is more principled to learn a tight decision boundary around the real image distribution and treat the fake category as a sink class. To this end, we propose SimLBR, a simple and efficient framework for fake image detection with Latent Blending Regularization (LBR). Our method significantly improves cross-generator generalization, achieving up to +24.85% accuracy and +69.62% recall on the challenging Chameleon benchmark. SimLBR is also highly efficient, training orders of magnitude faster than existing approaches. Furthermore, we emphasize the need for reliability-oriented evaluation in fake image detection, introducing risk-adjusted metrics and worst-case estimates to better assess model robustness. All the code and models are availabe at: https://github.com/mvrl/SimLBR

Dhakal, Aayush [Washington University, St. Louis]↗
DOE OSTI2024

Elucidating the Impact of Cis – Trans Organic Structure Directing Agent Isomer Ratios on the Aluminum Distribution Within SSZ-39

Despite their widespread use, the mechanisms governing the synthesis of zeolite catalysts are still poorly understood. A notable example of this problem is the uncertainty surrounding the influence of synthesis conditions on the placement of Al atoms in the zeolite framework which determines the active sites available for catalytic species. In this work, the role of the cis to trans isomer ratio of the OSDA N,N-dimethyl-3-5-dimethylpiperidinium on the energetics of 26 distinct Al pair distributions in SSZ-39 is examined both in the presence and absence of Na using density functional theory calculations. The initial orientation of the OSDA was found to have a significant impact on the final energies present, necessitating the screening of a large number of initial orientations with force field calculations and single point DFT calculations. Ground state energies were found to vary significantly with the ratio of cis to trans OSDAs with a Boltzmann distribution revealing the most likely Al pair distributions shift from sharing the same 8 membered rings to sharing the same double six membered rings to having no shared subunits as one increases the amount of cis OSDA present within the framework. The presence of Na was found to favor Al pair distributions where both Als occupied the same 6-membered ring. When an implicit solvent model was used to evaluate ground state energies the ideal Na sites shifted from 6-membered rings to empty SSZ-39 cages while OSDA positions and orientations remained largely the same. To provide insight on how kinetic factors may influence Al distributions, formation energies we calculated for connected double six membered rings. Further, these formation energies revealed a preference for Al pairs to occupy the same 4-membered ring which indicates kinetic and thermodynamic control may lead to different Al distributions in SSZ-39.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Lens Modeling of STRIDES Strongly Lensed Quasars Using Neural Posterior Estimation

Strongly lensed quasars can be used to constrain cosmological parameters through time-delay cosmography. Models of the lens masses are a necessary component of this analysis. To enable time-delay cosmography from a sample of $\mathcal{O}(10^3)$ lenses, which will soon become available from surveys like the Rubin Observatory’s Legacy Survey of Space and Time and the Euclid Wide Survey, we require fast and standardizable modeling techniques. To address this need, we apply neural posterior estimation (NPE) for modeling galaxy-scale strongly lensed quasars from the Strong Lensing Insights into the Dark Energy Survey (STRIDES) sample. NPE brings two advantages: speed and the ability to implicitly marginalize over nuisance parameters. We extend this method by employing sequential NPE to increase precision of mass model posteriors. We then fold individual lens models into a hierarchical Bayesian inference to recover the population distribution of lens mass parameters, accounting for out-of-distribution shift. After verifying our method using simulated analogs of the STRIDES lens sample, we apply our method to 14 Hubble Space Telescope single-filter observations. We find the population mean of the power-law elliptical mass distribution slope, γ lens , to be $\mathcal{M}_γ$ lens = 2.13 ± 0.06. Our result represents the first population-level constraint for these systems. This population-level inference from fully automated modeling is an important stepping stone toward cosmological inference with large samples of strongly lensed quasars.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Object detection with deep learning for rare event search in the GADGET II TPC

In the pursuit of identifying rare two-particle events within the GADGET II Time Projection Chamber (TPC), this paper presents a comprehensive approach for leveraging Convolutional Neural Networks (CNNs) and various data processing methods. To address the inherent complexities of 3D TPC track reconstructions, the data is expressed in 2D projections and 1D quantities. This approach capitalizes on the diverse data modalities of the TPC, allowing for the efficient representation of the distinct features of the 3D events, with no loss in topology uniqueness. Additionally, it leverages the computational efficiency of 2D CNNs and benefits from the extensive availability of pre-trained models. Given the scarcity of real training data for the rare events of interest, simulated events are used to train the models to detect real events. To account for potential distribution shifts when predominantly depending on simulations, significant perturbations are embedded within the simulations. This produces a broad parameter space that works to account for potential physics parameter and detector response variations and uncertainties. These parameter-varied simulations are used to train sensitive 2D CNN object detectors. When combined with 1D histogram peak detection algorithms, this multi-modal detection framework is highly adept at identifying rare, two-particle events in data taken during experiment 21072 at the Facility for Rare Isotope Beams (FRIB), demonstrating a 100% recall for events of interest. Here, we present the methods and outcomes of our investigation and discuss the potential future applications of these techniques.

Convolutional neural network↗
DOE OSTI2024

Enabling dynamic 3D coherent diffraction imaging via adaptive latent space tuning of generative autoencoders

Abstract Coherent diffraction imaging (CDI) is an advanced non-destructive 3D X-ray imaging technique for measuring a sample’s electron density. The main challenge of CDI is loss of phase information in diffraction intensity measurements, resulting in lengthy iterative reconstruction processes that can return non-unique solutions, which pose challenges for experiments attempting to track dynamic sample evolution through multiple states. As the increased brightness of fourth-generation light sources enables faster sample measurements and drives operando experiments with Bragg CDI, there is a growing need for faster reconstruction techniques that can keep pace. We have developed an adaptive generative autoencoder approach for uniquely tracking a sample’s electron density as it dynamically evolves. Our approach adaptively tunes the low-dimensional latent embedding of a generative autoencoder, enabling a computationally efficient manner to account for time-varying shifting distributions in real-time. Analytic proof of convergence is provided as well as numerical demonstration of sample tracking with noisy measurements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Nonstationarity in the global terrestrial water cycle and its interlinkages in the Anthropocene

Climate change and human activities alter the global freshwater cycle, causing nonstationary processes as its distribution shifting over time, yet a comprehensive understanding of these changes remains elusive. Here, we develop a remote sensing–informed terrestrial reanalysis and assess the nonstationarity of and interconnections among global water cycle components from 2003 to 2020. We highlight 20 hotspot regions where terrestrial water storage exhibits strong nonstationarity, impacting 35% of the global population and 45% of the area covered by irrigated agriculture. Emerging long-term trends dominate the most often (48.2%), followed by seasonal shifts (32.8%) and changes in extremes (19%). Notably, in mid-latitudes, this encompasses 34% of Asia and 27% of North America. The patterns of nonstationarity and their dominant types differ across other water cycle components, including precipitation, evapotranspiration, runoff, and gross primary production. These differences also manifest uniquely across hotspot regions, illustrating the intricate ways in which each component responds to climate change and human water management. Our findings emphasize the importance of considering nonstationarity when assessing water cycle information toward the development of strategies for sustainable water resource usage, enhancing resilience to extreme events, and effectively addressing other challenges associated with climate change.

Science & Technology - Other Topics↗
DOE OSTI2025

Physics-constrained superresolution diffusion for six-dimensional phase space diagnostics

Adaptive physics-constrained superresolution diffusion is developed for noninvasive virtual diagnostics of the six-dimensional (6D) phase space density of charged particle beams. An adaptive variational autoencoder embeds initial beam condition images and scalar measurements to a low-dimensional latent space from which a 32 6 pixel 6D tensor representation of the beam's 6D phase space density is generated. Projecting from a 6D tensor generates physically consistent two-dimensional projections. Physics-guided superresolution diffusion transforms low-resolution images of the 6D density to high resolution 256 × 256 pixel images. Unsupervised adaptive latent space tuning enables tracking of time-varying beams without knowledge of time-varying initial conditions. The method is demonstrated with experimental data and multiparticle simulations at the HiRES UED. The general approach is applicable to a wide range of complex dynamic systems evolving in high-dimensional phase space. The method is shown to be robust to distribution shift without retraining. Published by the American Physical Society 2025

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Enhancing synchrotron radiation micro-CT images using deep learning: an application of Noise2Inverse on bone imaging

In bone-imaging research, in situ synchrotron radiation micro-computed tomography (SRµCT) mechanical tests are used to investigate the mechanical properties of bone in relation to its microstructure. Low-dose computed tomography (CT) is used to preserve bone's mechanical properties from radiation damage, though it increases noise. To reduce this noise, the self-supervised deep learning method Noise2Inverse was used on low-dose SRµCT images where segmentation using traditional thresholding techniques was not possible. Simulated-dose datasets were created by sampling projection data at full, one-half, one-third, one-fourth and one-sixth frequencies of an in situ SRµCT mechanical test. After convolutional neural networks were trained, Noise2Inverse performance on all dose simulations was assessed visually and by analyzing bone microstructural features. Visually, high image quality was recovered for each simulated dose. Lacunae volume, lacunae aspect ratio and mineralization distributions shifted slightly in full, one-half and one-third dose network results, but were distorted in one-fourth and one-sixth dose network results. Following this, new models were trained using a larger dataset to determine differences between full dose and one-third dose simulations. Significant changes were found for all parameters of bone microstructure, indicating that a separate validation scan may be necessary to apply this technique for microstructure quantification. Noise present during data acquisition from the testing setup was determined to be the primary source of concern for Noise2Inverse viability. While these limitations exist, incorporating dose calculations and optimal imaging parameters enables self-supervised deep learning methods such as Noise2Inverse to be integrated into existing experiments to decrease radiation dose.

Obata, Yoshihiro (ORCID:0000000303659129)↗
DOE OSTI2024

Counter Data Paucity through Adversarial Invariance Encoding: A Case Study on Modeling Battery Thermal Runaway

Lithium-ion batteries, widely used for their durability and high energy storage, face the risk of internal short circuits leading to catastrophic thermal runaway events. These events, triggered by external stimuli like mechanical loads, pose safety concerns in applications such as electric vehicles. Detecting and understanding thermal runaway events is crucial, but physics-driven models struggle to explain the non-linear evolution of battery temperature during these events, considering factors like material composition and state-of-charge. Due to the rarity of these events and the cost of data collection, we propose a deep learning (DL) model to predict battery temperature responses during thermal runaway. The challenge lies in the scarcity of data, making traditional DL models prone to overfitting and learning low-quality representations of the complex process.Our approach introduces a novel few-shot architecture that incorporates an adversarially governed invariant encoding process. This architecture aims to distill "invariant" relationships by addressing distributional shifts in data across various battery properties, facilitating the detection of thermal runaway events. Specifically, our results demonstrate that deep learning models conditioned on these "invariant" representations outperform state-of-the-art baselines, achieving a remarkable 96.8% performance improvement in terms of the popular metric MAPE. This framework presents a promising direction for enhancing battery safety modeling, particularly in the context of rare and complex events like thermal runaway. Our code and code and dataset used for the paper are public1.

Tabassum, Anika [ORNL] (ORCID:0000000254600955)↗
DOE OSTI2024

Combined speckle- and propagation-based single shot two-dimensional phase retrieval method

Single-shot two-dimensional (2D) phase retrieval (PR) can recover the phase shift distribution within an object from a single 2D x-ray phase contrast image (XPCI). Two competing XPCI imaging modalities often used for single-shot 2D PR to recover material properties critical for predictive performance capabilities are: speckle-based (SP-XPCI) and propagation-based (PB-XPCI) XPCI imaging. However, PR from SP-XPCI and PB-XPCI images are, respectively, limited to reconstructing accurately slowly and rapidly varying features due to noise and differences in their contrast mechanisms. Herein, we consider a combined speckle- and propagation-based XPCI (SPB-XPCI) image by introducing a mask to generate a reference pattern and imaging in the near-to-holographic regime to induce intensity modulations in the image. We develop a single-shot 2D PR method for SPB-XPCI images of pure phase objects without imposing restrictions such as object support constraints. It is compared against PR methods inspired by those developed for SP-XPCI and PB-XPCI on simulated and experimental images of a thin glass shell before and during shockwave compression. Reconstructed phase maps show improvements in quantitative scores of root-mean-square error and structural similarity index measure using our proposed method.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Helium Bubble Physics Experiments

New results from MST-16 indicate that as plutonium ages at close to ambient temperature and helium ingrows, the number density of bubbles increases only slowly, if at all, and their size distribution shifts towards larger diameters. Helium-containing aged plutonium foams when annealed at high temperatures. We attribute these phenomena to a diffusivity large enough that, after a few years of aging, new decay helium diffuses to extant bubbles rather than nucleating new bubbles, and that during annealing larger bubbles grow at the expense of smaller ones (Ostwald ripening). Bulk swelling results from the fact that the Laplace pressure and therefore the helium density are less in larger bubbles. We develop a simple theory and propose to study these phenomena in aluminum alloyed with 10 B in which successive exposure to reactor thermal neutrons produces a stepwise increase in helium content.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Distributionally Robust Variational Quantum Algorithms With Shifted Noise

Given their potential to demonstrate near-term quantum advantage, variational quantum algorithms (VQAs) have been extensively studied. Although numerous techniques have been developed for VQA parameter optimization, it remains a significant challenge. A practical issue is the high sensitivity of quantum noise to environmental changes, and its propensity to shift in real time. This presents a critical problem as an optimized VQA ansatz may not perform effectively under a different noise environment. For the first time, we explore how to optimize VQA parameters to be robust against unknown shifted noise. We model the noise level as a random variable with an unknown probability density function (PDF), and we assume that the PDF may shift within an uncertainty set. This assumption guides us to formulate a distributionally robust optimization problem, with the goal of finding parameters that maintain effectiveness under shifted noise. We utilize a distributionally robust Bayesian optimization solver for our proposed formulation. This provides numerical evidence in both the Quantum Approximate Optimization Algorithm (QAOA) and the Variational Quantum Eigensolver (VQE) with hardware-efficient ansatz, indicating that we can identify parameters that perform more robustly under shifted noise. We regard this work as the first step towards improving the reliability of VQAs influenced by real-time noise.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Utah FORGE: Fiber Optic Cumulative Strain Change and Strain Change Rate Data From Well 16A Stimulation at Well 16B

This dataset includes Rayleigh Frequency Shift (RFS) Distributed Strain Sensing (DSS) cumulative strain change and change rate data. The data was acquired during the stimulation of Utah FORGE Well 16A(78)-32 in April 2024 via fiber installed in Well 16B(78)-32. The fiber optic data was acquired using Neubrex SR7000 RFS DSS Distributed Strain sensing instruments and is saved here in the format of HDF5 files (.h5 extension). The spatial sampling on the full wellbore profiles is 0.20 centimeters. The data is the far field strain change response from a baseline profile made down the 16B well on April 3, 2024, so each strain value represents the strain change or strain change rate at each depth relative to the baseline reference profile. The data arrays for each type share the same dimensions (number of channels and time stamps).

15 GEOTHERMAL ENERGY↗