Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gradient information”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

GAAF: Searching Activation Functions for Binary Neural Networks Through Genetic Algorithm

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computation and storage demand, but at the cost of degraded performance. To close the accuracy gap, in this paper we propose to add a complementary activation function (AF) ahead of the sign based binarization, and rely on the genetic algorithm (GA) to automatically search for the ideal AFs. These AFs can help extract extra information from the input data in the forward pass, while allowing improved gradient approximation in the backward pass. Fifteen novel AFs are identified through our GA-based search, while most of them show improved performance (up to 2.54% on ImageNet) when testing on different datasets and network models. Interestingly, periodic functions are identified as a key component for most of the discovered AFs, which rarely exist in human designed AFs. Our method offers a novel approach for designing general and application-specific BNN architecture.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Federated Machine Learning-Based Anomaly Detection System for Synchrophasor Network Using Heterogeneous Data Sets: Preprint

Synchrophasor technology is widely deployed in the energy management system to monitor the grid health at micro level and perform necessary corrective actions in real time; however, integrated phasor devices and data aggregators are exposed to several cybersecurity threats. This paper proposes a federated ML(FML)-based ADS to detect several data integrity attacks in the synchrophasor network. The proposed approach integrates the horizontal FML technique and consists of substation-based local models and a control center-based global model. The proposed methodology includes training local models using heterogeneous data sets that include network and grid information and updating the global model through multiple iterations by sharing model gradients. Finally, the trained global model is applied to identify cyberattacks, normal operation, and physical events. To validate the proof of concept, we used synthetic data sets generated by Mississippi State University and Oak Ridge National Laboratory for training and testing the classification models using the National Renewable Energy Laboratory's high performance computing resources. Our experimental results, computed through several performance measures, reveal that the proposed approach shows consistent performance during the binary, three-class, and multiclass classifications while ensuring privacy of synchrophasor data.

anomaly detection system↗
DOE OSTI2023

Physics-Informed Deep Learning-Based Proof-of-Concept Study of a Novel Elastohydrodynamic Seal for Supercritical CO 2 Turbomachinery

Supercritical carbon dioxide (sCO 2 ) power cycles show promising potential of higher plant efficiencies and power densities for a wide range of power generation applications such as fossil fuel power plants, nuclear power production, solar power, and geothermal power generation. sCO 2 leakage through the turbomachinery has been one of the main concerns in such applications. To offer a potential solution, we propose an elastohydrodynamic (EHD) seal that can work at elevated pressures and temperatures with low leakage and minimal wear. The EHD seal has a very simple, sleeve-like structure, wrapping on the rotor with minimal initial clearance at micron levels. Here, in this work, a proof-of-concept study for the proposed EHD seal was presented by using the simplified Reynolds equation and Lame’s formula for the fluid flow in the clearance and for seal deformation, respectively. The set of nonlinear equations was solved by using both the conventional Prediction–Correction (PC) method and modern Physics-Informed Neural Network (PINN). It was shown that the physics-informed deep learning method provided good computational efficiency in resolving the steep pressure gradient in the clearance with good accuracy. The results showed that the leakage rates increased quadratically with working pressures and reached a steady-state at high-pressure values of 15~20 MPa, where Q = 300 g/s at 20 MPa for an initial seal clearance of 255 μm. This indicates that the EHD seal could be tailored to become a potential solution to minimize the sCO 2 discharge in power plants.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Homotypic aggregates contribute to heterogeneity in B cell fates due to an intrinsic gradient of stimulant exposure

Highlights: • CD40-signaled B cells in cultures form three-dimensional homotypic aggregates. • These tight aggregates hinder the free diffusion of large molecule stimulants. • The resulting concentration gradient of stimulants leads to heterogeneous cell fates. • We describe a flow cytometric approach to quantify this positional information. Monocultures of several cell types result in the formation of robust clusters called homotypic aggregates (HAs). How this physical aggregation affects cell fates in immune cell cultures, is poorly understood. We studied anti-CD40-stimulated primary B cell cultures, where cells assembled into large three-dimensional LFA1-driven HAs by 72 h. The dense packing in these aggregates restricts the infiltration of stimulants, such as antibodies, to cells inside the clusters. This creates a concentration gradient of stimulant availability across the cross-section of HAs. We describe a method to retain this positional information even after the disruption of HAs, for analysis by flow cytometry. Comparison of stage-specific cell-surface markers showed that the extent of stimulant-binding affected multiple fates non-uniformly. While germinal center and lineage markers were moderately upregulated, immunoglobulins and markers associated with memory were more than doubled in the peripheral cells binding more anti-CD40. These cells also experienced a strong repression of the plasma cell regulator Prdm1 and an upregulation of the oncogene Myc. Thus, cells at different locations in HAs are subjected to unequal doses of stimulants, leading to a hitherto unreported source of heterogeneity in cell fates. These findings can be extrapolated to understand the dose-dependent effects of stimulants in other three-dimensional cell clusters.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Two-Dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials

A major obstacle for machine learning (ML) in chemical science is the lack of physically informed feature representations that provide both accurate prediction and easy interpretability of the ML model. In this work, we describe adsorption systems using novel two-dimensional energy histogram (2D-EH) features, which are obtained from the probe-adsorbent energies and energy gradients at grid points located throughout the adsorbent. The 2D-EH features encode both energetic and structural information of the material and lead to highly accurate ML models (coefficient of determination R2 ~ 0.94–0.99) for predicting single-component adsorption capacity in metal–organic frameworks (MOFs). Here, we consider the adsorption of spherical molecules (Kr and Xe), linear alkanes with a wide range of aspect ratios (ethane, propane, n-butane, and n-hexane), and a branched alkane (2,2-dimethylbutane) over a wide range of temperatures and pressures. The interpretable 2D-EH features enable the ML model to learn the basic physics of adsorption in pores from the training data. We show that these MOF-data-trained ML models are transferrable to different families of amorphous nanoporous materials. We also identify several adsorption systems where capillary condensation occurs, and ML predictions are more challenging. Nevertheless, our 2D-EH features still outperform structural features including those derived from persistent homology. The novel 2D-EH features may help accelerate the discovery and design of advanced nanoporous materials using ML for gas storage and separation in the future.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

This paper presents NSGA-PINN, a multi-objective optimization framework for the effective training of physics-informed neural networks (PINNs). The proposed framework uses the non-dominated sorting genetic algorithm (NSGA-II) to enable traditional stochastic gradient optimization algorithms (e.g., ADAM) to escape local minima effectively. Additionally, the NSGA-II algorithm enables satisfying the initial and boundary conditions encoded into the loss function during physics-informed training precisely. We demonstrate the effectiveness of our framework by applying NSGA-PINN to several ordinary and partial differential equation problems. In particular, we show that the proposed framework can handle challenging inverse problems with noisy data.

Lu, Binghang (ORCID:0009000160016632)↗
DOE OSTI2021

On Anomaly Detection for Transactive Energy Systems with Competitive Market

Two anomaly-detection criteria are proposed for transactive energy systems with competitive markets. Participants of transactive energy systems seek an optimal power allocation through hybrid economic-control methods to facilitate the integration of various types of distributed energy resources to power distribution systems. In transactive energy systems, every participant is assumed to be a rational entity, and consumers have diminishing marginal utility and suppliers have increasing marginal cost. With the first proposed anomaly-detection criterion, the monotonicity of marginal cost and marginal utility are examined. The impact of line flow constraints is also taken into consideration. Then, the second anomaly-detection criterion is proposed for TESs with marginal cost and marginal utility which change faster than a certain rate. The second criterion is more accurate than the first one for TES with marginal cost and marginal utility which change faster than a certain rate, but it requires the knowledge of that rate. Neither criteria requires more data than those necessary to find the optimal power allocation and the market-clear price in a transactive energy system. Therefore, the proposed criteria do not disclose any more data than necessary. As the monotonicity of marginal cost and marginal utility in a TES with competitive markets results in convex objective functions in an optimization problem and strongly convex ones when marginal cost and marginal utility changes faster than a certain rate, the two detection criteria are also applicable to anomaly detection of general convex optimization problems. Simulations are carried out to show the efficacy of the proposed criteria to detect anomalies caused by cyberattacks.

Wang, Peng↗
DOE OSTI2022

Single-stage gradient-based stellarator coil design: Optimization for near-axis quasi-symmetry

Here we present a new coil design paradigm for magnetic confinement in stellarators. Our approach directly optimizes coil shapes and coil currents to produce a vacuum quasi-symmetric magnetic field with a target rotational transform on the magnetic axis. This approach differs from the traditional two-stage approach in which first a magnetic configuration with desirable physics properties is found, and then coils to approximately realize this magnetic configuration are designed. The proposed single-stage approach allows us to find a compromise between confinement and engineering requirements, i.e., find easy-to-build coils with good confinement properties. Using forward and adjoint sensitivities, we derive derivatives of the physical quantities in the objective, which is constrained by a nonlinear periodic differential equation. In two numerical examples, we compare different gradient-based descent algorithms and find that incorporating approximate second-order derivative information through a quasi-Newton method is crucial for convergence. We also explore the optimization landscape in the neighborhood of a minimizer and find many directions in which the objective is mostly flat, indicating ample freedom to find simple and thus easy-to-build coils.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Distributed and communication-efficient solutions to linear equations with special sparse structure

In this paper we report two distributed and communication-efficient algorithms based on the multi-agent system are proposed to solve a system of linear equations with the Laplacian sparse system matrix. One algorithm is based on the gradient descent method in optimization. In this algorithm, the agents only share partial information instead of all of their collective state vectors to save significant communication. The other algorithm is obtained by approximating Newton’s method for a faster convergence rate. Although it requires twice as much communication as the first one, it is still communication-efficient given the low dimension of the information shared among agents. The convergence at a linear rate is proved for both algorithms, and a comprehensive comparison of their convergence rate, communication burden, and computation costs is also performed. The proposed algorithms can be applied to various systems to solve those problems that can be modeled as a system of linear equations with a Laplacian sparse system matrix. Simulation results with the electric power system illustrate their effectiveness.

42 ENGINEERING↗
DOE OSTI2025

A compact x-ray spectrometer for measurements of electron temperature distributions in inertial confinement fusion implosions at OMEGA

The Wedge Range Filter (WRF), commonly used for proton spectroscopy at the OMEGA Laser Facility and National Ignition Facility, is adapted to measure the x-ray continuum spectrum through transmission measurement using a continuous-gradient filter. Continuum x rays emitted from the hotspot of an implosion contain information about the plasma composition and electron temperature. The WRF data are leveraged to probe this distribution, specifically the electron temperature distribution. In this work, the data recorded with the WRF are forward modeled using a temperature distribution model folded with the WRF response function. An uncertainty analysis is conducted through a Bayesian regression algorithm using a Hamiltonian Monte Carlo sampler. This analysis enables the uncertainties in the instrument response to be folded into the uncertainty estimation of the electron temperature and absolute x-ray emission. Data analysis for a series of OMEGA implosions is presented and compared with radiation hydrodynamic simulations.

Lasers↗
DOE OSTI2023

Predicting Kyasanur forest disease in resource-limited settings using event-based surveillance and transfer learning

In recent years, the reports of Kyasanur forest disease (KFD) breaking endemic barriers by spreading to new regions and crossing state boundaries is alarming. Effective disease surveillance and reporting systems are lacking for this emerging zoonosis, hence hindering control and prevention efforts. We compared time-series models using weather data with and without Event-Based Surveillance (EBS) information, i.e., news media reports and internet search trends, to predict monthly KFD cases in humans. We fitted Extreme Gradient Boosting (XGB) and Long Short-Term Memory models at the national and regional levels. We utilized the rich epidemiological data from endemic regions by applying Transfer Learning (TL) techniques to predict KFD cases in new outbreak regions where disease surveillance information was scarce. Overall, the inclusion of EBS data, in addition to the weather data, substantially increased the prediction performance across all models. The XGB method produced the best predictions at the national and regional levels. The TL techniques outperformed baseline models in predicting KFD in new outbreak regions. Novel sources of data and advanced machine-learning approaches, e.g., EBS and TL, show great potential towards increasing disease prediction capabilities in data-scarce scenarios and/or resource-limited settings, for better-informed decisions in the face of emerging zoonotic threats.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Prediction of carbon nanostructure mechanical properties and the role of defects using machine learning

Graphene-based nanostructures hold immense potential as strong and lightweight materials, however, their mechanical properties such as modulus and strength are difficult to fully exploit due to challenges in atomic-scale engineering. This study presents a database of over 2,000 pristine and defective nanoscale CNT bundles and other graphitic assemblies, inspired by microscopy, with associated stress–strain curves from reactive molecular dynamics (MD) simulations using the reactive INTERFACE force field (IFF-R). These 3D structures, containing up to 80,000 atoms, enable detailed analyses of structure-stiffness-failure relationships. By leveraging the database and physics- and chemistry-informed machine learning (ML), accurate predictions of elastic moduli and tensile strength are demonstrated at speeds 1,000 to 10,000 times faster than efficient MD simulations. Hierarchical Graph Neural Networks with Spatial Information (HS-GNNs) are introduced, which integrate chemistry knowledge. HS-GNNs as well as extreme gradient boosted trees (XGBoost) achieve forecasts of mechanical properties of arbitrary carbon nanostructures with only 3 to 6% mean relative error. The reliability equals experimental accuracy and is up to 20 times higher than other ML methods. Predictions maintain 8 to 18% accuracy for large CNT bundles, CNT junctions, and carbon fiber cross-sections outside the training distribution. The physics- and chemistry-informed HS-GNN works remarkably well for data outside the training range while XGBoost works well with limited training data inside the training range. The carbon nanostructure database is designed for integration with multimodal experimental and simulation data, scalable beyond 100 nm size, and extendable to chemically similar compounds and broader property ranges. The ML approaches have potential for applications in structural materials, nanoelectronics, and carbon-based catalysts.

Winetrout, Jordan J.↗
DOE OSTI2021

The role of gas flow distributions on CO 2 mineralization within monolithic cemented composites: coupled CFD-factorial design approach

The carbonation kinetics of monolithic cementing composites are strongly affected by gas transport which is, in turn, influenced by microstructural resistances and the presence of liquid water within pore networks. The non-uniform gas flow distribution within the CO 2 mineralization reactor can impart mass transfer resistance in the monolith microstructure, which affects the uptake of CO 2 (“carbonation”) of the cementing composites. This paper demonstrates how the gas spatial distribution (velocity and flow rate; quantified by CFD analysis) and processing conditions (temperature, relative humidity, and flow rate; quantified by factorial design) affect drying and carbonation, and in turn, the engineering properties of a representative ‘monolithic’ carbonate-cemented concrete component (i.e., herein concrete masonry unit: CMUs, also known as concrete block). It is shown that the gas flow distribution affects drying front penetration and results in moisture and carbonation gradients within the monolith. Particularly, variations in drying kinetics caused by non-uniformity of the contacting gas velocity impose gradients in moisture saturation, which results in increasing microstructural resistance to CO 2 transport. The resultant non-uniform carbonate-mineral formation (i.e., carbonate cementation), if not controlled, can produce gradients in mechanical properties and may alter failure patterns upon loading. Finally, these insights inform the optimal design of gas flow distribution systems and processing conditions within CO 2 mineralization reactors for the manufacturing of low-CO 2 concrete components using CO 2 -dilute industrial flue gas streams.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Sensor Reduction for Diversion Detection in a Realistic Heat Pipe Microreactor Using Supervised Machine Learning

Microreactors are designed as a smaller, cheaper, and safer alternative to traditional nuclear power plants. Their non-traditional characteristics and prospect of mass production and deployment will likely require new approaches to nuclear safeguards. The primary proliferation concern with microreactors is the diversion of fuel material. Such diversion may produce measurable defects in key physical attributes like neutron flux, which may in turn be detectable using machine learning models. Preliminary work has demonstrated this ability for modeled nominal and diversion scenarios using large quantities of energy integrated neutron flux data. In practice, the number of available sensors for such measurements will be limited and energy integrated flux information will not be available. This work explores the ability of tree-based gradient boosted ensemble models to classify a given microreactor core is nominal or diversion, and determine the number of fuel pins diverted in the case of diversion with reduced numbers of sensors and more realistic detector responses. Classification accuracy of greater than 98% and regression errors as low as 5% of the total number of fuel pins were achieved with as few as 15 sensors, compared to 99% and 4.1% with a maximum of 240 sensors.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Massive νs through the CNN lens: interpreting the field-level neutrino mass information in weak lensing

Modern cosmological surveys probe the Universe deep into the nonlinear regime, where massive neutrinos suppress cosmic structure. Traditional cosmological analyses, which use the 2-point correlation function to extract information, are no longer optimal in the nonlinear regime, and there is thus much interest in extracting beyond-2-point information to improve constraints on neutrino mass. Quantifying and interpreting the beyond-2-point information is thus a pressing task. We study the field-level information in weak lensing convergence maps using convolution neural networks. We find that the network performance increases as higher source redshifts and smaller scales are considered — investigating up to a source redshift of 2.5 and ℓ max ≃ 10 4 — verifying that massive neutrinos leave a distinct effect on weak lensing. However, the performance of the network significantly drops after scaling out the 2-point information from the maps, implying that most of the field-level information can be found in the 2-point correlation function alone. We quantify these findings in terms of the likelihood ratio and also use Integrated Gradient saliency maps to interpret which parts of the map the network is learning the most from. We find that, in the absence of noise, the network extracts a similar amount of information from the most overdense and underdense regions. However, upon adding noise, the information in underdense regions is distorted as noise disproportionately washes out void-like structures.

Golshan, Malika [University of California, Berkele↗
DOE OSTI2024

Assessment of Machine Learning Wall Modeling Approaches for Large Eddy Simulation of Gas Turbine Film Cooling Flows: An a Priori Study

Here, in this work, a priori analysis of machine learning (ML) strategies is carried out with the goal of data-driven wall modeling for large eddy simulation (LES) of gas turbine film cooling flows. High-fidelity flow datasets are extracted from wall-resolved LES (WRLES) of flow over a flat plate interacting with the coolant flow supplied by a single row of 7-7-7 shaped cooling holes inclined at 30 degrees with the flat plate at different blowing ratios (BR). The WRLES are performed using the high-order Nek5000 spectral element computational fluid dynamics (CFD) solver. Light gradient boosting machine (LightGBM) is employed as the ML algorithm for the data-driven wall model. Parametric tests are conducted to systematically assess the influence of a wide range of input flow features (velocity components, velocity gradients, pressure gradients, and fluid properties) on the accuracy of ML wall model with respect to prediction of wall shear stress. In addition, the use of spatial stencil and time delay is also explored within the ML wall modeling framework. It is shown that features associated with gradients of the streamwise and spanwise velocity components have a major impact on the prediction fidelity of wall model, while the effect of gradients of wall-normal velocity component is found to be negligible. Moreover, adding flow feature information from an x-y-z spatial stencil significantly improves the ML model accuracy and generalizability compared to just using local flow features from the matching location. Overall, highest prediction accuracy is achieved when both spatial stencil and time delay features are incorporated within the data-driven wall modeling paradigm.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Spatiotemporal structure of edge harmonic oscillation and its role in ELM-free QH-mode at KSTAR

In Quiescent H-mode (QH-mode), edge-localized modes (ELMs) are naturally replaced by a low-n edge harmonic oscillation (EHO), yet the self-regulating transport mechanism driven by the EHO remains insufficiently understood. Using high-spatiotemporal-resolution imaging diagnostics on KSTAR—electron cyclotron emission imaging and broadband electron cyclotron emission—we resolve the eigenmode structure of the EHO and elucidate its regulatory role in edge transport. The EHO is localized within the pedestal near the maximum pressure gradient, propagates in the ion-diamagnetic direction, and its radial envelope expands with increasing shear, suggesting that rotational shear is closely associated with the structural evolution of the EHO. Information-theoretic Transfer Entropy analysis identifies a distinct ‘dual-stabilization’ regulatory interaction pattern: the EHO is associated with enhanced outward energy transport to limit the pressure gradient, while the background shear flow is associated with preferential regulatory influence on the EHO saturation amplitude and energy flux. These results demonstrate that the QH-mode pedestal is sustained by a shear-associated regulation mechanism, where the coupling between rotational shear and mode structure appears closely linked to the sustained ELM-free state.

ECEI↗
DOE OSTI2024

High Frequency Monitoring and Nitrate Sourcing Reveals Baseflow and Stormflow Controls on Total Dissolved Nitrogen and Carbon Export Along a Rural‐Urban Gradient

Abstract Efforts to reduce nitrogen and carbon loading from developed watersheds typically target specific flows or sources, but across gradients in development intensity there is no consensus on the contribution of different flows to total loading or sources of nitrogen export. This information is vital to optimize management strategies leveraging source reductions, stormwater controls, and restorations. We investigate how solute loading and sources vary across flows and land‐use using high frequency monitoring and stable nitrate isotope analysis from five catchments with different sanitary infrastructure, along a gradient in development intensity. High frequency monitoring allowed estimation of annual loading and attribution to storm versus baseflows. Nitrate loads were 16 kg/km 2 /yr. from the forested catchment and ranged from 68 to 119 kg/km 2 /yr., across developed catchments, highest for the septic served site. Across developed catchments, baseflow contributions ranged from 40% of N loading to 75% from the septic served catchment, and the contribution from high stormflows increased with development intensity. Stormflows mobilized and mixed many surface and subsurface nitrate sources while baseflow nitrate was dominated by fewer sources which varied by catchment (soil, wastewater, or fertilizer). To help inform future sampling designs, we demonstrate that grab sampling and targeted storm sampling would likely fail to accurately predict annual loadings within the study period. The dominant baseflow loads and subsurface stormflows are not treated by surface water management practices primarily targeted to surface stormflows. Using a balance of green and gray infrastructure and stream/riparian restoration may target specific flow paths and improve management.

Delesantro, Joseph M.↗