Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generalizability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

639 records · Page 36

Neural Image Compression: Generalization, Robustness, and Spectral Biases

Recent advances in neural image compression (NIC) have resulted in models which are starting to outperform traditional codecs. While this has led to growing excitement about using these methods in real-world applications, the successful adoption of any machine learning system (including NIC) in the wild requires it to generalize (and be robust) to unseen distribution shifts at deployment time. Unfortunately, current research lacks comprehensive datasets and informative tools to evaluate and understand compression performance in real-world settings. To bridge this crucial gap, first, this paper presents a comprehensive benchmark suite to evaluate the out-of-distribution (OOD) performance of image compression methods. Specifically, we design CLIC-C and Kodak-C by introducing 15 common corruptions to popular CLIC and Kodak benchmarks. Next, we propose spectrally inspired introspection tools to gain a deeper understanding of errors introduced by image compression methods as well as their OOD performance. To this end, we carry out a detailed performance comparison of the classical codec with various variants of NIC (e.g., original, variable rate, pruned), revealing intriguing findings that challenge our current understanding of the strengths and limitations of NIC. Finally, we corroborate our empirical findings with theoretical analysis, providing an in-depth view of the OOD performance of NIC. Our benchmarks, spectral introspection tools, and findings provide a crucial bridge to the real-world adoption of NIC. We hope that our work will propel future efforts in designing more robust and generalizable NIC methods.

neural networks, Variational Autoencoder, robustne↗

A Framework for Assessing Economic and Environmental Trade-offs of Internalized Emission Costs in ERCOT Grid Planning

The power grid is on the cusp of a massive transition driven by three major areas: 1) the growth in demand for electricity, 2) efforts to decarbonize the United States economy, and 3) a desire to mitigate social disparities from the impact of electricity generation on local populations. However, most studies of the electricity sector do not include equity impacts in their models. This study seeks to do so by developing a comprehensive and generalizable model tailored to the Electric Reliability Council of Texas (ERCOT) grid, designed to incorporate the equity impacts of electricity generation in a decarbonized and resilient framework. To integrate equity into our research, we incorporate environmental externalities into our capacity expansion model of ERCOT. Specifically, we factor in intermediate-level local marginal damages of precursor pollutants (NH3, NOx, primary PM2.5, SO2, and VOC) and global pollutant CO2 into the cost of generating electricity. We do this by taking into account county population, county ambient pollution concentration, and generator emission rates. Leveraging open-source modeling tools, such as PowerGenome, pyGRETA, and GenX we construct a county-level model to account for these costs. We integrate these marginal damages into the variable operations and maintenance costs of generators, for both existing and potential future builds. This study’s findings suggest that the value of a dynamic social cost of carbon (SSC) will cover criteria pollutant marginal damages within the ERCOT grid and solar and wind is expected to increase out to 2035. Key metrics evaluated within this research include fuel mix distribution across technologies, transmission and grid infrastructure costs, CO2 emissions, local pollutants marginal damages, and the variation in generation capacity built by the model. These results and framework can be used to support grid decisions that explicitly include distributional and procedural equity within a decarbonized and sustainable grid framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Automating Anomaly Detection for Target systems at Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory, produces the world’s most intense pulse neutrons beams. An accelerated proton beam is directed into a mercury target to generate neutrons via spallation. The target system accounted for over 40% of the overall downtime of the facility in 2022. Thus, early detection in anomalies in the target systems can enable taking corrective actions to avoid failures and reduce downtime. Fault prognostics and anomaly detection in accelerators, both at SNS and outside, has largely focused on the beam side. This paper presents one the first studies exploring leveraging machine learning to automate the detection of anomalies in the target system. The target system consists of over 30 different interconnected subsystems, and the present work focuses on the mercury process system as a use case. Analyzing data from 28 process variables from 2022 and 2023, tree-based and reconstruction-based algorithms are employed to detect anomalies in archived data. The algorithms detected previously unreported anomalies, several of which were deemed alert worthy by human experts, particularly those found by reconstruction-based algorithms. Using data from each production run in the accelerator increased the generalizability of the models in time. Efforts are now underway to implement a workflow for incorporating human feedback to update the models and evaluating performance on unseen data. The models will eventually be integrated into the existing System Tracking and Reliability system with a web interface for automated anomaly detection and reporting along with a pathway for incorporating human feedback for model updates.

Raj, Anant [ORNL] (ORCID:0000000306711244)↗

Electron-Proton Scattering Event Generation using Structured Tokenization

Recent work such as Omnijet-$\alpha$ has demonstrated that effective tokenization combined with transformer-based architectures can produce effective foundation models for jet physics. While tokenization may help models capture generalizable event characteristics, it also introduces discretization errors that may compromise the precision required for downstream physics analyses. As the number and complexity of the particle features grow, these errors are likely to grow proportionally. In this study, we investigate new tokenization strategies to improve the application of generative transformer models to \textsc{Pythia8} simulations of electron-proton scattering at the Electron-Ion Collider. Specifically, we propose a feature-based structured tokenization approach that utilizes multiple tokens per particle, improving expressivity, while reducing the total number of unique tokens needed. We evaluate this method against grid-based binning, K-means clustering, and vector-quantized variational auto-encoders on the event simulations. Our results show that feature-based structured tokenization reduces discretization error, leading to more accurate generative modeling of particle-level events.

Goldenberg, Steven [Thomas Jefferson National Acce↗

RE-INTEGRATE EMT Simulation Tool: Input Data Processing Layer for Bulk Power System

This paper introduces an advanced input data processing layer for EMT simulations of large-scale bulk power systems. The paper proposes two versions of the RE-INTEGRATE EMT simulation tool, RE-INTEGRATE Gen-0 and RE-INTEGRATE Gen-1, which are developed to enhance simulation generalizability, scalability, and accuracy. The framework leverages a generic class design for components to incorporate linear equations, which are generated by discretizing the Differential-Algebraic Equations (DAEs) that represent the dynamics of the components. In addition, the framework employs a parsing algorithm that parses a power system’s raw and dyr files to generate a connectivity graph which is then traversed to form the overall system’s dynamics. The proposed input data processing layer is used to simulate the IEEE 39-bus test system. The obtained results demonstrate the framework’s capability to achieve simulation scalability and accuracy. Further, the results indicate that EMT simulations performed using the proposed automations can effectively handle complex grid configurations.

Mishra, Rahul [ORNL] (ORCID:0000000328205932)↗

Using Best Basis Inventory Data to Direct Strategies for Real Time Monitoring of Hanford High Level Waste – 26226

The potential to accelerate the processing of low- and high-level tank waste by applying real-time monitoring (RTM) of chemical and physical properties has prompted research into the suitability of multiple analytical methods for that purpose. The broad variety of waste stream properties and the large number of analytes of interest (as evidenced by Waste Acceptance Criteria (WAC) and Process Control Limit (PCL) lists) lead to an overwhelming set of possible analytical scenarios. This report describes the use of Best Basis Inventory (BBI) data to find the most relevant analytical targets for the specific case of monitoring the blending of High Level Waste from multiple tanks prior to introduction into a vitrification facility. Campaigns for blending this waste to minimize the risk of exceeding WACs and PCLs have been proposed. However, the predicted compositions of the blended materials do not incorporate any uncertainties that may be associated with the representativeness of the waste layer samples or the laboratory analyses that generated the BBI data. Also, they do not include any uncertainty associated with the precision of collecting highly specific fractions of the layers during a blending campaign or any inhomogeneities that may exist in those layers. Monte Carlo methods are used to apply uncertainties to the compositions of the individual layers specified in the campaign recipes. The resulting variations in the compositions of the blended materials allow estimation of the risks of exceeding WACs and PCLs for each campaign. A critical subset of WACs/PCLs – NOx, NaK, AlFeZr, and S – are especially at risk of being exceeded in multiple campaigns. These analytes should be the focus of instrument development. We also have extracted the expected solid/supernate distribution for these analytes, which establishes important performance criteria for individual analytical methods. The BBI data also permits an understanding of the different chemical forms in which the analytes appear. Thus, the need to establish instrumental sensitivity to these forms can be gainfully addressed. Although concentrating on one specific application – the blending of tank waste - this approach should be generalizable for the analysis of other possible RTM applications for waste processing.

Lascola, Robert [Savannah River National Laborator↗

Surrogates for Valve-Controlled Pipe Flow: Accelerating Nuclear Reactor Design

Neural surrogate models are developed to replace expensive steady-state RANS CFD simulations for valve-controlled pipe flow in nuclear reactor design. Using parametric CFD data generated with MOOSE Pronghorn across a range of valve geometry and flow conditions, three approaches are compared: a POD-based reduced-order model, a structured UNet on a cylindrical grid, and unstructured models (DeepONet and BiStride MeshGraphNet) on nondimensionalized point clouds. POD achieves the highest accuracy (99%) with fast inference but requires storing all solution snapshots, while the DeepONet and BSMS-GNN both achieve ~89% accuracy at sub-second inference, with the BSMS-GNN offering superior geometric generalizability. These surrogates enable rapid ranking of candidate valve designs and can warm-start CFD solvers to accelerate convergence, supporting agentic design iteration on the Prometheus platform.

42 - ENGINEERING↗

Generalizing synthetic data-trained acoustic predictive models to real-world measurements

Acoustic Resonance Spectroscopy (ARS) is highly sensitive to structural properties such as material, geometry, and environmental conditions; as a consequence, it can noninvasively measure internal properties that are unobservable by most other methods. Because of its sensing capabilities and low implementation cost and complexity, ARS has potential as a paradigm shift in noninvasive sensing, characterization, and monitoring applications. However, extracting specific properties from ARS measurements, comprising the vibration spectrum of a test object, is challenging due to the sensitivity of the spectra to other structural changes not being measured, e.g. manufacturing tolerances, component coupling, environmental variation, etc. Neural Networks are promising tools for identifying trends in ARS measurements, but their training typically requires large datasets, which are often impractical to obtain for real-world systems. Synthetic data can be simulated efficiently, but discrepancies between synthetic and real-world data frequently lead to poor generalization when testing on the real-world data. We propose a novel ARS model training framework that enables networks trained exclusively on synthetic ARS data to generalize effectively to real-world measurements. Our approach leverages the Correlation Alignment (CORAL) technique to enforce the extraction of features common to both synthetic and real-world domains. As a case study, we demonstrate noninvasive ARS-based pressure measurements in sealed systems. Finite element method (FEM) simulations were used to generate synthetic training data across diverse vessel configurations and pressure conditions, and model performance was then tested on real-world measurements. We demonstrate that robust machine learning models for ARS can be developed without large real-world datasets, significantly broadening the applicability of ARS for noninvasive sensing. Moreover, the approach is extensible to other sensing modalities where synthetic data are abundant but real-world data are limited.

36 MATERIALS SCIENCE↗