Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gradient information”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

STEM Ptychographic Holography of Electric and Magnetic Potentials

The development of fast an efficient direct electron imaging detectors have enabled the advancement of phase-imaging techniques in STEM such as iterative ptychography. As beneficial as these techniques are to imaging phase objects, the information recorded in the raw data is due to phase gradients across the probe, so it can be challenging to reconstruct slowly varying phase at lower spatial frequencies such as those induced by electric or magnetic potentials within the specimen. STEM holography [1,2] is an interferometric 4D-STEM technique where electrons in the beam are coherently divided into a superposition of two or more spatially separated probes which are then scanned over the specimen. For example, in a two-beam superposition, the two probes form overlapping bright field discs at the detector which then interfere (left of Fig. 1). Furthermore, if one probe passes through vacuum while the other transmits through the specimen, the resulting relative phase shift can be measured by recording shifts in the interference pattern. STEM holography is thus directly sensitive to the phase of the probe relative to the reference beam, and this phase can be measured regardless of the convergence angle of the probe, unlike single beam ptychography.

Biological Sciences↗
DOE OSTI2024

Improved filters for angular filter refractometry

Angular filter refractometry is an optical diagnostic that measures the absolute contours of a line-integrated density gradient by placing a filter with alternating opaque and transparent zones in the focal plane of a probe beam, which produce corresponding alternating light and dark regions in the image plane. Identifying transitions between these regions with specific zones on the angular filter (AF) allows the line-integrated density to be determined, but the sign of the density gradient at each transition is degenerate and must be broken using other information about the object plasma. Additional features from diffraction in the filter plane often complicate data analysis. Here, in this paper, we present an improved AF design that uses a stochastic pixel pattern with a sinusoidal radial profile to minimize unwanted diffraction effects in the image caused by the sharp edges of the filter bands. We also present a technique in which a pair of AFs with different patterns on two branches of the same probe beam can be used to break the density gradient degeneracy. Both techniques are demonstrated using a synthetic diagnostic and data collected on the OMEGA EP (extended performance) laser.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

A Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the model parameters. When the analytical expression of the MI is unavailable, e.g.,having implicit models with intractable data distributions, a neural network-based lower bound of the MI was recently proposed and a gradient ascent method was used to maximize the lower bound [1]. However, the approach in [1] requires a pathwise sampling path to compute the gradient of the MI lower bound with respect to the design variables, and such a pathwise sampling path is usually inaccessible for implicit models. In this work, we propose a hybrid gradient approach that leverages recent advances in variational MI estimator and evolution strategies (ES)combined with black-box stochastic gradient ascent (SGA) to maximize the MI lower bound. This allows the design process to be achieved through a unified scalable procedure for implicit models without sampling path gradients. Several experiments demonstrate that our approach significantly improves the scalability of BED for implicit models in high-dimensional design space.

Zhang, Jiaxin↗
DOE OSTI2023

LANSCE CCL Performance Limits

This report summarizes the performance limits of the LANSCE Coupled-Cavity Linac (CCL). These results are captured or summarized directly from the references cited. This report was written in support of the LANSCE Modernization Project (LAMP). Many factors contribute to the performance limits of the CCL accelerator system. One performance limit is set by the CCL mechanical structure and available cooling. Heating of the structure is ultimately linked to the operating RF duty factor of the CCL. Another performance limit is set by the maximum RF and beam duty factors that can be supported by the 805-MHz klystrons and associated HVDC power supplies. The RF and HVDC systems also set limits for the maximum peak beam current that can be accelerated in the CCL. And finally, a maximum beam current limit is set by the beam dynamics determined by the details of the CCL physics design (number of cells per CCL tank, accelerating gradients, magnetic focusing lattice, beam losses, etc.). This limit can be informed by both simulation results and beam measurement data, if available. A detailed explanation of each performance limit is given in the sections below. The results are summarized in the table below. In all cases, it is assumed that the CCL and the RF system are operating in their nominal beam production configuration – nominal magnet set points and nominal cavity fields, unless otherwise specified.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Discovery, Design, Synthesis and Testing of High Performance Structural Alloys (Final Technical Report)

The overarching goal of this project is to understand the phase stability and mechanical behavior of non-stoichiometric multi-principal element alloy (MPEA) materials. In order to identify suitable alloys, we plan to use a combinatorial thin film screening approach, in collaboration with scientists at Lawrence Berkeley National Laboratory who are performing computational work as well as complementary experimental work. Specific tasks within the scope of this project include the fabrication, using thin film deposition from six sputtering targets, of combinatorial samples with multi-dimensional gradients in composition and microstructure. These samples are studied to screen MPEA systems for promising candidate alloys with specific composition(s), based on characterization of composition, structure and mechanical behavior across the thin film. We want to produce single-phase MPEAs with chemical homogeneity in a given thin film region, simple grain structures, and no intermetallic phases present. Gradient films facilitate first-pass screening for desirable characteristics and inform the next stage of work that involves fabrication of bulk MPEA specimens for (tensile) mechanical testing and characterization. To make the bulk alloys, metal (elemental) pieces are melted to form MPEAs, followed by heat treatment to homogenize the composition and microstructure. A subset of alloys is also cast, using vacuum arc melting, to yield larger samples (diameter ~1 cm and length ~5-10 cm) and these allow us to assess viability of scale-up for the alloys in structural applications. Further processing plans include rolling and heat treatment to recrystallize selected bulk MPEAs and grow grains to different extents, in order to investigate size effects in the mechanical behavior of MPEAs. Microspecimen testing will be performed (primarily in tension) to assess the mechanical behavior over a range of temperatures. The deformation microstructure of mechanically tested alloys will be characterized using transmission electron microscopy (TEM) to provide a scientific basis for understanding the structure-property relationships in MPEA mechanical behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Multi-Level Optimal Power Flow Solver in Large Distribution Networks: Preprint

Solving optimal power flow (OPF) problem for large distribution networks incurs high computational complexity. We consider a large multi-phase distribution networks of tree topology with deep penetration of active devices. We divide the network into collaborating areas featuring subtree topology and subareas featuring subsubtree topology. We design a multi-level implementation of the primal-dual gradient algorithm for solving the voltage regulation OPF problems while preserving nodal voltage information and topological information within areas and subareas. Numerical results on a 4,521-node system verifies that the proposed algorithm can significantly improve computational speed without compromising any optimality.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2020

Multi-Level Optimal Power Flow Solver in Large Distribution Networks

Solving optimal power flow (OPF) problems for large distribution networks incurs high computational complexity. We consider a large multi-phase distribution network of tree topology with a deep penetration of active devices. We divide the network into collaborating areas featuring subtree topology and subareas featuring subsubtree topology. We design a multilevel implementation of the primal-dual gradient algorithm to solve the voltage regulation OPF problems while preserving nodal voltage information and topological information within areas and subareas. Numerical results on a 4,521-node system verify that the proposed algorithm can significantly improve the computational speed without compromising any optimality.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2022

Multiscale mechanical design of the lightweight, stiff, and damage-tolerant cuttlebone: A computational study

Cuttlebone, the endoskeleton of cuttlefish, offers an intriguing biological structural model for designing low-density cellular ceramics with high stiffness and damage tolerance. Cuttlebone is highly porous (porosity ~93%) and lightweight (density less than 20% of seawater), constructed mainly by brittle aragonite (95 wt%), but capable of sustaining hydrostatic water pressures over 20 atmospheres and exhibits energy absorption capability under compression comparable to many metallic foams (~4.4 kJ/kg). Here, in this work, we computationally investigate how such remarkable mechanical efficiency is enabled by the multiscale structure of cuttlebone. Using the common cuttlefish, Sepia Officinalis, as a model system, we first conducted high-resolution synchrotron micro-computed tomography (µ-CT) and quantified the cuttlebone's multiscale geometry, including the 3D asymmetric shape of individual walls, the wall assembly patterns, and the long-range structural gradient of walls across the entire cuttlebone (ca. 38 chambers). The acquired 3D structural information enables systematic finite-element simulations, which further reveal the multiscale mechanical design of cuttlebone: at the wall level, wall asymmetry provides optimized energy absorption while maintaining high structural stiffness; at the chamber level, variation of walls (number, pattern, and waviness amplitude) contributes to progressive damage; at the entire skeletal level, the gradient of chamber heights tailors the local mechanical anisotropy of the cuttlebone for reduced stress concentration. Our results provide integrated insights into understanding the cuttlebone's multiscale mechanical design and provide useful knowledge for the designs of lightweight cellular ceramics.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A modeling study of ocean thermal energy conversion resource and potential environmental effects around Kailua-Kona, Hawaii

Ocean Thermal Energy Conversion (OTEC) offers a promising renewable energy solution through a heat exchange process using the temperature difference between warm surface seawater and cold deep seawater. Because accurate resource characterization is critical for the optimal design and implementation of OTEC systems, a high-resolution numerical model is employed to better characterize the OTEC resource at Kona, Hawaii. Our model provides detailed spatial and temporal variability of the thermal gradient, which is essential for assessing the viability and efficiency of OTEC systems. The model results reveal distinct patterns and dynamics not captured by existing observations or models (e.g., lower-resolution information). These findings highlight the importance of using high-resolution models for accurate predictions of thermal gradient variability, ultimately supporting more efficient and sustainable OTEC deployment. Additionally, the study investigates the impacts of mixed water discharge from OTEC plants that can cause shock to organisms living in the surface water and potentially destabilize the water column. Understanding these effects is vital for minimizing any potential negative environmental consequences and ensuring the long-term viability of OTEC operations. Further, our model improves OTEC resource characterization, which can lead to optimal design and deployment of OTEC systems. The analysis of OTEC water discharge impacts can accelerate the development of OTEC technologies, overcoming permitting/consenting challenges. These findings contribute to the broader adoption of high-resolution modeling in ocean energy resource characterization, particularly for OTEC applications.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2026

Ionic Liquids for Direct Air Capture of CO 2 using Electric‐Field‐Mediated Moisture Gradient Process (Final Technical Report)

The final report provides executive summary, a list of publications, and information on training graduate students and postdoctoral researchers. We carried out computational and experimental research on understanding molecular-level mechanism of how CO 2 is absorbed in a solution containing ethylene glycol as the solvent and KOH as the salt in the presence of ionic liquids and under the influence of electric field. In doing so, we developed an automated high-throughput method which allowed us to measure the solubility of CO 2 in a large number of ionic liquids, considerably speeding up the CO 2 solubility measurement. We also demonstrated how varying the concentration of ionic liquids in ethylene glycol can result in a maximum in ionic conductivity. Reaction of CO 2 and subsequent release results in a 50% reduction when the process is operated at an ionic liquid-ethylene glycol concentration yielding maximum ionic conductivity amongst all the ionic liquid-ethylene glycol combinations studied as a part of this research. We utilized machine learning models to identify unique ionic liquid-solvent combinations with ionic conductivity much higher than that measured for ionic liquid-ethylene glycol combinations. We demonstrated that the rate of CO 2 reaction with KOH in ethylene glycol can be optimized with the type of ionic liquid and its concentration. Overall, the research led to publication of 10 peer-reviewed research articles and several presentations at national conferences. We are also in the process of developing additional manuscripts based on the research carried out as a part of this project. Two graduate students and two postdoctoral researchers were supported on the funding.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Machine learning approaches for influenza A virus risk assessment identifies predictive correlates using ferret model in vivo data

In vivo assessments of influenza A virus (IAV) pathogenicity and transmissibility in ferrets represent a crucial component of many pandemic risk assessment rubrics, but few systematic efforts to identify which data from in vivo experimentation are most useful for predicting pathogenesis and transmission outcomes have been conducted. To this aim, we aggregated viral and molecular data from 125 contemporary IAV (H1, H2, H3, H5, H7, and H9 subtypes) evaluated in ferrets under a consistent protocol. Three overarching predictive classification outcomes (lethality, morbidity, transmissibility) were constructed using machine learning (ML) techniques, employing datasets emphasizing virological and clinical parameters from inoculated ferrets, limited to viral sequence-based information, or combining both data types. Among 11 different ML algorithms tested and assessed, gradient boosting machines and random forest algorithms yielded the highest performance, with models for lethality and transmission consistently better performing than models predicting morbidity. Comparisons of feature selection among models was performed, and highest performing models were validated with results from external risk assessment studies. Our findings show that ML algorithms can be used to summarize complex in vivo experimental work into succinct summaries that inform and enhance risk assessment criteria for pandemic preparedness that take in vivo data into account.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

DP-TwoLevel: two-stage gradient subspace learning for differentially private federated learning

Federated learning (FL) enables collaborative model training across distributed data sources without sharing raw data, but faces fundamental challenges in communication efficiency and privacy. Differentially private (DP) training mitigates information leakage but introduces noise that degrades model performance, especially in high-dimensional settings. We propose DP-TwoLevel, a hierarchical gradient projection method that improves utility under fixed DP constraints by exploiting low-dimensional structure in model updates. Our approach learns a two-level PCA-based representation of gradients and applies DP noise in a reduced-dimensional subspace, thereby lowering the effective noise magnitude while preserving dominant signal components. We evaluate the method across three datasets (MNIST, Fashion-MNIST, CIFAR-10) and three privacy regimes (ϵ∈0.5, 1.0, 2.0). Across nine experimental settings, DP-TwoLevel consistently outperforms DP-FedAvg, achieving an average accuracy improvement of 9.44%, with larger gains observed in lower ϵ(higher-noise) regimes (up to +22.31%). We further analyze scalability across models ranging from 100K to 1.49M parameters and identify a variance-based success criterion: performance remains strong when the projection preserves more than 75% of gradient variance, degrades in a marginal regime (65–75%), and fails below this threshold. Our results demonstrate that structure-aware dimensionality reduction can significantly improve the privacy–utility tradeoff in FL without modifying formal privacy guarantees. We also provide empirical evidence of scaling limitations for global projections and motivate per-layer extensions for larger models.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2021

When and why PINNs fail to train: A neural tangent kernel perspective

Physics-informed neural networks (PINNs) have lately received great attention thanks to their flexibility in tackling a wide range of forward and inverse problems involving partial differential equations. However, despite their noticeable empirical success, little is known about how such constrained neural networks behave during their training via gradient descent. More importantly, even less is known about why such models sometimes fail to train at all. Here in this work, we aim to investigate these questions through the lens of the Neural Tangent Kernel (NTK); a kernel that captures the behavior of fully-connected neural networks in the infinite width limit during training via gradient descent. Specifically, we derive the NTK of PINNs and prove that, under appropriate conditions, it converges to a deterministic kernel that stays constant during training in the infinite-width limit. This allows us to analyze the training dynamics of PINNs through the lens of their limiting NTK and find a remarkable discrepancy in the convergence rate of the different loss components contributing to the total training error. To address this fundamental pathology, we propose a novel gradient descent algorithm that utilizes the eigenvalues of the NTK to adaptively calibrate the convergence rate of the total training error. Finally, we perform a series of numerical experiments to verify the correctness of our theory and the practical effectiveness of the proposed algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

D2NO: Efficient handling of heterogeneous input function spaces with distributed deep neural operators

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions that exhibit heterogeneous properties, requiring multiple sensors to handle functions with minimal regularity. To address this issue, discretization-invariant neural operators have been used, allowing the sampling of diverse input functions with different sensor locations. However, existing frameworks still require an equal number of sensors for all functions. We propose a novel distributed approach to further relax the discretization requirements and solve the heterogeneous dataset challenges. Our method involves partitioning the input function space and processing individual input functions using independent and separate neural networks. A centralized neural network is used to handle shared information across all output functions. This distributed methodology reduces the number of gradient descent back-propagation steps, improving efficiency while maintaining accuracy. Here, we demonstrate that the corresponding neural network is a universal approximator of continuous nonlinear operators and present three numerical examples to validate its performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Controlling homogenization length scales and microstructure in additively manufactured Ti-Ta functionally graded materials

Materials with smooth compositional gradients or functionally grade materials (FGMs) produced via additive manufacturing (AM), enables joining dissimilar materials and optimizing multiple properties in advanced engineering applications. However, as-printed AM microstructures exhibit micro-segregation and solidification defects which, when combined with controlling macroscale gradient properties, complicates necessary post-processing. Here, we use CALPHAD-informed diffusion modelling to design post-processing heat treatments for lightweight to refractory FGMs. Ti-Ta (0 to 85 at. % Ta) FGMs were fabricated using laser-based directed energy deposition AM. Post-processing heat treatments at 1000° C and 1500° C were designed to promote homogenization across specific length scales and experimentally validated. Investigation of chemical segregation and microstructures demonstrated that the length scale of homogenization is controlled as a function of time, temperature, and local composition. Ta-rich regions exhibited incomplete homogenization compared to Ti-rich layers. Unmelted Ta particles were found to completely dissolve at 1500 °C. By controlling cooling rate (200 °C/min), martensitic structures were produced between 14–36 at. % Ta, consistent with martensite-start temperatures calculations, while furnace cooling (2 °C/min) produced α+β morphologies. This work establishes a validated predictive framework for designing post-processing to tailor microstructure and chemical architecture in AM FGMs, facilitating their deployment in demanding environments.

Materials science↗
DOE OSTI2022

Machine learning and atomic layer deposition: Predicting saturation times from reactor growth profiles using artificial neural networks

In this work, we explore the application of deep neural networks to the optimization of atomic layer deposition (ALD) processes. In particular, we focus on a one-shot optimization problem, where we try to predict the optimal dose time that leads to saturation everywhere in the reactor based on thickness values measured at different points of an ALD reactor after a single trial growth. In order to tackle this problem, we introduce a dataset designed to train neural networks to predict saturation times based on these inputs for a cross-flow ALD reactor. Here, we then explore the predictive ability of artificial neural networks of different depths and sizes using a separate testing dataset to evaluate their accuracies. The results obtained show that networks trained using stochastic gradient descent methods can accurately predict saturation times without requiring any additional information on the surface kinetics. This provides a viable approach to minimize the number of experiments required to optimize new ALD processes in a known reactor, and it highlights the way machine learning can be leveraged for thin film growth and manufacturing. While the datasets and training procedure depend on the reactor geometry, the trained neural networks provide a general surrogate model connecting thickness values and trial dose times with optimal saturation times that can be reused for different ALD processes within the same reactor.

36 MATERIALS SCIENCE↗
DOE OSTI2022

GAAF: Searching Activation Functions for Binary Neural Networks Through Genetic Algorithm

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computation and storage demand, but at the cost of degraded performance. To close the accuracy gap, in this paper we propose to add a complementary activation function (AF) ahead of the sign based binarization, and rely on the genetic algorithm (GA) to automatically search for the ideal AFs. These AFs can help extract extra information from the input data in the forward pass, while allowing improved gradient approximation in the backward pass. Fifteen novel AFs are identified through our GA-based search, while most of them show improved performance (up to 2.54% on ImageNet) when testing on different datasets and network models. Interestingly, periodic functions are identified as a key component for most of the discovered AFs, which rarely exist in human designed AFs. Our method offers a novel approach for designing general and application-specific BNN architecture.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Federated Machine Learning-Based Anomaly Detection System for Synchrophasor Network Using Heterogeneous Data Sets: Preprint

Synchrophasor technology is widely deployed in the energy management system to monitor the grid health at micro level and perform necessary corrective actions in real time; however, integrated phasor devices and data aggregators are exposed to several cybersecurity threats. This paper proposes a federated ML(FML)-based ADS to detect several data integrity attacks in the synchrophasor network. The proposed approach integrates the horizontal FML technique and consists of substation-based local models and a control center-based global model. The proposed methodology includes training local models using heterogeneous data sets that include network and grid information and updating the global model through multiple iterations by sharing model gradients. Finally, the trained global model is applied to identify cyberattacks, normal operation, and physical events. To validate the proof of concept, we used synthetic data sets generated by Mississippi State University and Oak Ridge National Laboratory for training and testing the classification models using the National Renewable Energy Laboratory's high performance computing resources. Our experimental results, computed through several performance measures, reveal that the proposed approach shows consistent performance during the binary, three-class, and multiclass classifications while ensuring privacy of synchrophasor data.

anomaly detection system↗