SEARCH · Engineering Papers

Results for “generalizability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

All sources NASA NTRS DOE OSTI

DOE OSTI2026

MSD CoP Webinar: Modeling the Operations of Reservoir Systems with LLMs and Inverse Reinforcement Learning

Context: This panel featured three presentations centered on the common theme of applying LLMs and inverse reinforcement learning (IRL) to capture the complex human-environment interactions that are central to the operation of reservoir systems. Dr. Wyatt Arnold will kick off the webinar with a talk on how analyzing LLM chain-of-thought reasoning reveals sophisticated quantitative justification and risk awareness, showing promise as a bridge between quantitative models and value-driven water management decisions. Next, Dr. Matteo Giuliani will build on this with a discussion demonstrating that AI- and IRL-driven approaches can infer the trade-offs between flood control and water supply using historical observations. Finally, Dr. Rohan Singh Wilkho will close the webinar with a talk establishing IRL as a generalizable diagnostic tool for decoding decision-making in managed hydrologic and human-infrastructure systems. Across the three presentations, the application of LLMs and IRL opens new possibilities for the development of adaptive, transparent, and human-aware models supporting water management in an increasingly uncertain future. Presenters: Wyatt Arnold (Politecnico di Milano); Matteo Giuliani (Politecnico di Milano); Rohan Singh Wilkho (Cornell University) Moderator: Patrick M. Reed (MSD CoP Facilitation Team); Stefano Galelli (MSD CoP AI Working Group Co-Chair); David Gold (MSD CoP AI Working Group Co-Chair) This webinar was held on: June 23rd, 2026 from 12-1 PM EST.

Arnold, Wyatt [Politecnico di Milano]↗

DOE OSTI2020

Uncovering the basis of protein-protein interaction specificity with a combinatorially complete library

Protein-protein interaction specificity is often encoded at the primary sequence level. However, the contributions of individual residues to specificity are usually poorly understood and often obscured by mutational robustness, sequence degeneracy, and epistasis. Using bacterial toxin-antitoxin systems as a model, we screened a combinatorially complete library of antitoxin variants at three key positions against two toxins. This library enabled us to measure the effect of individual substitutions on specificity in hundreds of genetic backgrounds. These distributions allow inferences about the general nature of interface residues in promoting specificity. We find that positive and negative contributions to specificity are neither inherently coupled nor mutually exclusive. Further, a wild-type antitoxin appears optimized for specificity as no substitutions improve discrimination between cognate and non-cognate partners. By comparing crystal structures of paralogous complexes, we provide a rationale for our observations. Collectively, this work provides a generalizable approach to understanding the logic of molecular recognition.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Kinetics Modeling for Design of Continuous Enzymatic Hydrolysis

Enzymatic hydrolysis of cellulose to monomeric sugars continues to be a limiting step in cost-effectively producing sugar and fermentation-based biofuels from biomass. In particular, the high cost of enzymes coupled with the long time-scale of reaction pose challenges to economic viability. Performing enzymatic hydrolysis in a continuous mode with enzyme recycle may provide a path towards substantially reduced costs for sugar production, but design and analysis are complicated by a lack of suitable kinetics models. Computationally attainable models, such as fractal-based models, require knowledge of the reaction-history of the biomass, and are thus only suitable for describing the batch reactions from which they are derived. Fundamental models, while potentially more generalizable, are often too computationally intensive to use in process or reactor modeling. In this work, a phenomenological rate model is proposed based on a two-phase substrate representation. Good agreement is seen between batch and continuous enzymatic hydrolysis (CEH) experiment data, which validates the model and enables us to solve for reactor design parameters, such as CEH reactor size and stream flow rates, based on process variables like yield. This model is integrated with techno-economic analysis software to explore economic sensitivities. Important design optimizations and tradeoffs are identified and quantified, including the relative cost imposed by rate slowdown from sugar inhibition versus the cost to remove and concentrate sugars at a lower concentration. It also identifies, high-leverage avenues for further exploration, such as increasing the maximum feasible solids concentration, and sustaining high membrane flux and reliability.

09 BIOMASS FUELS↗

DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗

DOE OSTI2021

Quantifying Turbine-Level Risk to Golden Eagles Using a High-Fidelity Updraft Model and a Stochastic Behavioral Model

To minimize the effects of wind farms on Golden Eagle (Aquila chrysaetos) populations while enabling sustainable development of renewable energy resources, it is important to understand how eagles interact with atmospheric flows, terrain features, and anthropogenic structures. Models that predict migratory flight paths provide one tool that helps us grasp how the location of wind farms may influence interactions and impacts on migrating Golden Eagles. The current state-of-the-art in predicting migratory flight paths uses a deterministic fluid-flow analogy to predict eagle trajectory using only an orographic updraft potential computed from topographical features. This model does not take into account variables, such as thermal updrafts and time varying atmospheric conditions that are known to influence migratory behavior. In this work, we improve on the model with the objective of developing tools that advance our understanding of how atmospheric flows and terrain features affect migratory eagle behavior and their interactions with wind farms. Specifically, we 1) incorporate both orographic and thermal updraft information in simulating eagle flight paths; 2) incorporate stochasticity into eagle travel patterns to better capture the influence of exogenous factors on, and the inherent stochasticity of eagle behavior; 3) consider spatio-temporal atmospheric data at wind-farm-scale when computing updraft potential; and 4) account for how atmospheric conditions and the direction of migration change seasonally and how these changes affect eagle migratory flight behavior. We tested the model using a 50km by 50km region with 50 m resolution in the western United States. We simulated 900 independent, probabilistic eagle tracks during southerly and northerly migration, assuming eagles solely rely on orographic updrafts. The preliminary results indicate that the inclusion of finer resolution atmospheric data allows for the inclusion of realistic conditions that an eagle experiences. The stochasticity in eagle tracks provides a platform to include uncertainty in eagle decision making and help produce robust eagle presence maps. We will deploy updraft and downdraft velocities computed using a high-fidelity, wind farm scale, computational fluid dynamics solver under development at National Renewable Energy Laboratory. This work is a first step in the development of a predictive and generalizable eagle behavior model at the wind farm scale that does not rely on empirical data collection. Although the current model is intended for migratory eagles, we will extend and refine this model to inform the development of additional behavioral modes, including resident eagle behavior. This modeling approach improves our ability to understand eagle use of the landscape at a fine scale, and it is our hope that this work will ultimately help advance strategies that minimize the impact of wind development on Golden Eagle populations.

49 EE - Wind and Water Power Program - Wind (EE-4W↗

DOE OSTI2022

Anderson Acceleration for Distributed Training of Deep Learning Models

Anderson acceleration (AA) is an extrapolation technique that has recently gained interest in the deep learning (DL) community to speed-up the sequential training of DL models. However, when performed at large scale, the DL training is exposed to a higher risk of getting trapped into steep local minima of the training loss function, and standard AA does not provide sufficient acceleration to escape from these steep local minima. This results in poor generalizability and makes AA ineffective. To restore AA’s advantage to speed-up the training of DL models on large scale computing platforms, we combine AA with an adaptive moving average procedure that boosts the training to escape from steep local minima. By monitoring the relative standard deviation between consecutive iterations, we also introduce a criterion to automatically assess whether the moving average is needed. We applied the method to the following DL instantiations for image classification: (i) ResNet50 trained on the open-source CIFAR100 dataset and (ii) ResNet50 trained on the open-source ImageNet1k dataset. Numerical results obtained using up to 1,536 NVIDIA V100 GPUs on the OLCF supercomputer Summit showed the stabilizing effect of the moving average on AA for all the problems above.

Lupo Pasini, Massimiliano↗

DOE OSTI2022

DERMS Online: A New Voltage Sensitivity-Enabled Feedback Optimization Framework: Preprint

This paper proposes a distributed energy resource management system (DERMS) solution by developing a new voltage sensitivity enabled feedback optimization framework. The key idea is to adopt a measurement feedback scheme to reformulate the original nonlinear optimization into a linear programming (LP) problem via perturb and observe-based voltage sensitivity analysis. The proposed solution eliminates the dependence on load knowledge and can be implemented online thanks to an efficient open-source solver for LP problems. The proposed DERMS online platform is generalizable to deal with various types of distributed energy resources (DERs), including distributed photovoltaics (PVs), energy storage, electric vehicles, demand response, etc. Comparison results with other control methods on a realistic distribution feeder in Southern California highlight the feasibility as well as benefits for the proposed framework.

distributed energy resources management↗

DOE OSTI2022

Grid-Interactive Electric Vehicle and Building Coordination Using Coupled Distributed Control: Preprint

As an increasing number of controllable devices are introduced onto the grid, they can individually provide ancillary services in support of grid stability. However, the goals of each device differ due to their type and individual objectives, causing instances where they may conflict. To reduce the chances of these devices contributing to grid instability, these devices must effectively communicate in a cooperative manner to both meet their own needs while providing services to the grid. Previous work demonstrates that the NALD (Network Lasso-ADMM - Limited Communication - DMPC) algorithm allows coordination between two subsystems that use different control algorithms (building and charging stations) to provide services to the grid and individually optimize their performance in a specific scenario. The ideal NALD algorithm should be generalized to allow plug-and-play capabilities across devices of differing characteristics. This paper takes a step toward generalizability by updating the electric vehicle charging objective and re-defining the communication scheme compared to prior work to generalize the coordination and, as a result, improve the performance of the NALD algorithm.

ADVANCED PROPULSION SYSTEMS,ENERGY CONSERVATION, C↗

DOE OSTI2022

Redox-flow batteries employing oligomeric organic active materials and size-selective microporous polymer membranes

Intermittent energy sources, including solar and wind, require scalable, low-cost, multi-hour energy storage solutions to be effectively incorporated into the grid. Redox-flow batteries offer a solution, but suffer from rapid capacity fade and low Coulombic efficiency due to the high permeability of redox-active species across the battery's membrane. Here we show that active-species crossover can be arrested by scaling the membrane's pore size to molecular dimensions and in turn increasing the size of the active material to be above the membrane's pore-size exclusion limit. When oligomeric redox-active organic molecules were paired with microporous polymer membranes, the rate of active-material crossover was either completely blocked or slowed more than 9,000-fold compared to traditional separators at minimal cost to ionic conductivity. In the case of the latter, this corresponds to an absolute rate of ROM crossover of less than 3 μmol cm−2 day−1 (for a 1.0 M concentration gradient), which exceeds performance targets recently set forth by the battery industry. This strategy was generalizable to both high and low-potential ROMs in a variety of electrolytes, highlighting the importance of macromolecular design in implementing next-generation redox-flow batteries.

Helms, Brett A.↗

DOE OSTI2021

November Mega-AI Newsletter

Mega AI, an internal investment at Pacific Northwest National Laboratory, aims to develop next-generation artificial intelligence (AI) capabilities unique to the Department of Energy national lab complex to address research gaps in large-scale multimodal representation learning, multitask inferences, and the need for increased generalizability, rapid adaptivity, and usability of AI technologies. In this newsletter, we highlight recent developments in the research community on next-gen AI technologies focusing on massive-scale model development, deployment and evaluation, data and code availability, model interactions, and new features and capabilities that are relevant to Mega AI’s goals and science and security applications.

Volkova, Svitlana↗

DOE OSTI2022

Systems and methods for powder bed additive manufacturing anomaly detection

Detection and classification of anomalies for powder bed metal additive manufacturing. Anomalies, such as recoater blade impacts, binder deposition issues, spatter generation, and some porosities, are surface-visible at each layer of the building process. A multi-scaled parallel dynamic segmentation convolutional neural network architecture provides additive manufacturing machine and imaging system agnostic pixel-wise semantic segmentation of layer-wise powder bed image data. Learned knowledge is easily transferrable between different additive manufacturing machines. The anomaly detection can be conducted in real-time and provides accurate and generalizable results.

Scime, Luke R.↗

DOE OSTI2023

Electrochemical Reaction Engineering: A Lost (and Found) Art

The heart (or, perhaps more appropriately, the stomach) of any chemical manufacturing process is the reactor, where chemical and physical transformations occur under precisely controlled conditions. For non-electrochemical industrial processes, the design, optimization and operation of chemical reactors are extremely well developed, drawing upon the principles of chemistry, physics, calculus and economics. However, electrolytic processes face a dearth of well documented reaction engineering principles and design practices. This tutorial-style poster presentation introduces electrochemistry students and industrial practitioners to the "lost art" of reaction engineering and its organic extensions to electrochemical devices. Electrochemical reactor fundamentals and illustrative design equations are presented alongside a proposed five-step generalizable methodology for electrochemical reactor scale-up. Overall, this contribution seeks to educate electrochemistry researchers on practical means of reducing laboratory technologies to commercial practice.

electrochemistry↗

DOE OSTI2024

Navigating Urban Mobility: Evaluating Infrastructure Strategies for Enhanced Energy-Efficient Access for Micromobility

Cities and communities continue to expand pedestrian and bicycle infrastructure as part of their sustainable mobility and post-pandemic recovery plans. However, the emergence of micro-mobility (e.g., electric bicycles) has created new challenges for urban transport planning. As the popularity of micro-mobility modes has grown, so have safety concerns due to rising injuries, thus challenging many cities to come up with regulatory measures that enable efficient access while minimizing negative impacts from micro-mobility. Leveraging the Open-Source Tool (Mobility Energy Productivity metric), powered by an open-source dataset (OpenStreetMap), and enhanced through the incorporation of perceived discomfort (level-of-traffic stress), this research study focuses on evaluating the accessibility implications of infrastructure planning and regulatory measures for micro-mobility. Five scenarios pertaining to level of traffic stress, sidewalk access, traffic calming, and bike lane coverage were tested in the Denver-Aurora region in Colorado. Maximum improvements in energy-efficient access are realized when allowing sidewalks for micro-mobility use. Cities and planning agencies could leverage this information to assess sidewalk use policies for micro-mobility, while ensuring pedestrian safety and ADA access. Results indicate that expansion of bicycle lane coverage yields 11% accessibility benefits for micro-mobility compared to implementing traffic calming measures yielding 3% accessibility improvements. Further, it was observed most of the population in the Denver-Aurora region is experiencing lower accessibility in-part due to presence of a high-stress connections in the network. Although not generalizable, the use of open-source data and access calculation methodology, make this analysis reproducible and transferable to other locations.

ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2023

Enabling Interconnected Science Workflows through an Adapter Approach

The INTERSECT Software framework project aims to create an open federated library that connects, coordinates, and controls systems in the scientific domain. It features the Adapter, a flexible and extensible interface inspired by the Adapter design pattern in object-oriented programming. By utilizing Adapters, the INTERSECT SDK enables effective communication and coordination within a diverse ecosystem of systems. This adaptability facilitates the execution of complex operations within the framework, promoting collaboration and efficient workflow management in scientific research. Additionally, the generalizability of Adapters and their patterns enhances their utility in other scientific software projects and challenges.

McGaha, Jesse↗

DOE OSTI2023

Neural Image Compression: Generalization, Robustness, and Spectral Biases

Recent advances in neural image compression (NIC) have resulted in models which are starting to outperform traditional codecs. While this has led to growing excitement about using these methods in real-world applications, the successful adoption of any machine learning system (including NIC) in the wild requires it to generalize (and be robust) to unseen distribution shifts at deployment time. Unfortunately, current research lacks comprehensive datasets and informative tools to evaluate and understand compression performance in real-world settings. To bridge this crucial gap, first, this paper presents a comprehensive benchmark suite to evaluate the out-of-distribution (OOD) performance of image compression methods. Specifically, we design CLIC-C and Kodak-C by introducing 15 common corruptions to popular CLIC and Kodak benchmarks. Next, we propose spectrally inspired introspection tools to gain a deeper understanding of errors introduced by image compression methods as well as their OOD performance. To this end, we carry out a detailed performance comparison of the classical codec with various variants of NIC (e.g., original, variable rate, pruned), revealing intriguing findings that challenge our current understanding of the strengths and limitations of NIC. Finally, we corroborate our empirical findings with theoretical analysis, providing an in-depth view of the OOD performance of NIC. Our benchmarks, spectral introspection tools, and findings provide a crucial bridge to the real-world adoption of NIC. We hope that our work will propel future efforts in designing more robust and generalizable NIC methods.

neural networks, Variational Autoencoder, robustne↗

DOE OSTI2025

A Framework for Assessing Economic and Environmental Trade-offs of Internalized Emission Costs in ERCOT Grid Planning

The power grid is on the cusp of a massive transition driven by three major areas: 1) the growth in demand for electricity, 2) efforts to decarbonize the United States economy, and 3) a desire to mitigate social disparities from the impact of electricity generation on local populations. However, most studies of the electricity sector do not include equity impacts in their models. This study seeks to do so by developing a comprehensive and generalizable model tailored to the Electric Reliability Council of Texas (ERCOT) grid, designed to incorporate the equity impacts of electricity generation in a decarbonized and resilient framework. To integrate equity into our research, we incorporate environmental externalities into our capacity expansion model of ERCOT. Specifically, we factor in intermediate-level local marginal damages of precursor pollutants (NH3, NOx, primary PM2.5, SO2, and VOC) and global pollutant CO2 into the cost of generating electricity. We do this by taking into account county population, county ambient pollution concentration, and generator emission rates. Leveraging open-source modeling tools, such as PowerGenome, pyGRETA, and GenX we construct a county-level model to account for these costs. We integrate these marginal damages into the variable operations and maintenance costs of generators, for both existing and potential future builds. This study’s findings suggest that the value of a dynamic social cost of carbon (SSC) will cover criteria pollutant marginal damages within the ERCOT grid and solar and wind is expected to increase out to 2035. Key metrics evaluated within this research include fuel mix distribution across technologies, transmission and grid infrastructure costs, CO2 emissions, local pollutants marginal damages, and the variation in generation capacity built by the model. These results and framework can be used to support grid decisions that explicitly include distributional and procedural equity within a decarbonized and sustainable grid framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Automating Anomaly Detection for Target systems at Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory, produces the world’s most intense pulse neutrons beams. An accelerated proton beam is directed into a mercury target to generate neutrons via spallation. The target system accounted for over 40% of the overall downtime of the facility in 2022. Thus, early detection in anomalies in the target systems can enable taking corrective actions to avoid failures and reduce downtime. Fault prognostics and anomaly detection in accelerators, both at SNS and outside, has largely focused on the beam side. This paper presents one the first studies exploring leveraging machine learning to automate the detection of anomalies in the target system. The target system consists of over 30 different interconnected subsystems, and the present work focuses on the mercury process system as a use case. Analyzing data from 28 process variables from 2022 and 2023, tree-based and reconstruction-based algorithms are employed to detect anomalies in archived data. The algorithms detected previously unreported anomalies, several of which were deemed alert worthy by human experts, particularly those found by reconstruction-based algorithms. Using data from each production run in the accelerator increased the generalizability of the models in time. Efforts are now underway to implement a workflow for incorporating human feedback to update the models and evaluating performance on unseen data. The models will eventually be integrated into the existing System Tracking and Reliability system with a web interface for automated anomaly detection and reporting along with a pathway for incorporating human feedback for model updates.

Raj, Anant [ORNL] (ORCID:0000000306711244)↗

DOE OSTI2025

Electron-Proton Scattering Event Generation using Structured Tokenization

Recent work such as Omnijet-$\alpha$ has demonstrated that effective tokenization combined with transformer-based architectures can produce effective foundation models for jet physics. While tokenization may help models capture generalizable event characteristics, it also introduces discretization errors that may compromise the precision required for downstream physics analyses. As the number and complexity of the particle features grow, these errors are likely to grow proportionally. In this study, we investigate new tokenization strategies to improve the application of generative transformer models to \textsc{Pythia8} simulations of electron-proton scattering at the Electron-Ion Collider. Specifically, we propose a feature-based structured tokenization approach that utilizes multiple tokens per particle, improving expressivity, while reducing the total number of unique tokens needed. We evaluate this method against grid-based binning, K-means clustering, and vector-quantized variational auto-encoders on the event simulations. Our results show that feature-based structured tokenization reduces discretization error, leading to more accurate generative modeling of particle-level events.

Goldenberg, Steven [Thomas Jefferson National Acce↗