Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “activation function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Combinatorial optimization and spatial remodeling of CYPs to control product profile

Activating inert substrates is a challenge in nature and synthetic chemistry, but essential for creating functionally active molecules. In this work, we used a combinatorial optimization approach to assemble cytochrome P450 monooxygenases (CYPs) and reductases (CPRs) to achieve a target product profile. By creating 110 CYP-CPR pairs and iteratively screening different pairing libraries, we demonstrated a framework for establishing a CYP network that catalyzes six oxidation reactions at three different positions of a chemical scaffold. Target product titer was improved by remodeling endoplasmic reticulum (ER) size and spatially controlling the CYPs’ configuration on the ER. Out of 47 potential products that could be synthesized, 86% of the products synthesized by the optimized network was our target compound quillaic acid (QA), the aglycone backbone of many pharmaceutically important saponins, and fermentation achieved QA titer 2.23 g/L.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Massively parallel and universal approximation of nonlinear functions using diffractive processors

Nonlinear computation is essential for a wide range of information processing tasks, yet implementing nonlinear functions using optical systems remains a challenge due to the weak and power-intensive nature of optical nonlinearities. Overcoming this limitation without relying on nonlinear optical materials could unlock unprecedented opportunities for ultrafast and parallel optical computing systems. Here, we demonstrate that large-scale nonlinear computation can be performed using linear optics through optimized diffractive processors composed of passive phase-only surfaces. In this framework, the input variables of nonlinear functions are encoded into the phase of an optical wavefront—e.g., via a spatial light modulator (SLM)—and transformed by an optimized diffractive structure with spatially varying point-spread functions to yield output intensities that approximate a large set of unique nonlinear functions–all in parallel. We provide proof establishing that this architecture serves as a universal function approximator for an arbitrary set of bandlimited nonlinear functions, also covering wavelength-multiplexed nonlinear functions as well as multi-variate and complex-valued functions that are all-optically cascadable. Our analysis also indicates the successful approximation of typical nonlinear activation functions commonly used in neural networks, including the sigmoid, tanh, ReLU (rectified linear unit), and softplus. We numerically demonstrate the parallel computation of one million distinct nonlinear functions, accurately executed at wavelength-scale spatial density at the output of a diffractive optical processor. Furthermore, we experimentally validated this framework using in situ optical learning and approximated 35 unique nonlinear functions in a single shot using a compact setup consisting of an SLM and an image sensor. These results establish diffractive optical processors as a scalable platform for massively parallel universal nonlinear function approximation, paving the way for new capabilities in analog optical computing based on linear materials.

Rahman, Md Sadman Sakib [University of California,↗
DOE OSTI2025

Factorization Machine‐Based Active Learning for Functional Materials Design with Optimal Initial Data

The optimization of functional materials is important to enhance their properties, but their complex geometries pose great challenges to optimization. Data-driven algorithms efficiently navigate such complex design spaces by learning relationships between material structures and performance metrics to discover high-performance functional materials. Surrogate-based active learning, continually improving its surrogate model by iteratively including high-quality data points, has emerged as a cost-effective data-driven approach. Furthermore, it can be coupled with quantum computing to enhance optimization processes, especially when paired with a special form of surrogate model (i.e., quadratic unconstrained binary optimization), formulated by factorization machine (FM). However, current practices often overlook the variability in design space sizes when determining the initial data size for optimization. In this work, we investigate the optimal initial data sizes required for efficient convergence across various design space sizes. By employing averaged piecewise linear regression, we identify initiation points where convergence begins, highlighting the crucial role of employing adequate initial data in achieving efficient optimization. These results contribute to the efficient optimization of functional materials by ensuring faster convergence and reducing computational costs in FM-based active learning.

active learning↗
DOE OSTI2022

CoordNet: Data Generation and Visualization Generation for Time-Varying Volumes via a Coordinate-Based Neural Network

Although deep learning has demonstrated its capability in solving diverse scientific visualization problems, it still lacks generalization power across different tasks. To address this challenge, we propose CoordNet, a single coordinate-based framework that tackles various tasks relevant to time-varying volumetric data visualization without modifying the network architecture. The core idea of our approach is to decompose diverse task inputs and outputs into a unified representation (i.e., coordinates and values) and learn a function from coordinates to their corresponding values. We achieve this goal using a residual block-based implicit neural representation architecture with periodic activation functions. We evaluate CoordNet on data generation (i.e., temporal super-resolution and spatial super-resolution) and visualization generation (i.e., view synthesis and ambient occlusion prediction) tasks using time-varying volumetric data sets of various characteristics. Here, the experimental results indicate that CoordNet achieves better quantitative and qualitative results than the state-of-the-art approaches across all the evaluated tasks. Source code and pre-trained models are available at https://github.com/stevenhan1991/CoordNet.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Hybrid interatomic potential for Sn

To design materials for extreme applications, it is important to understand and predict phase transitions and their influence on material properties under high pressures and temperatures. Atomistic modeling can be a useful tool to assess these behaviors. However, this can be difficult due to the lack of fidelity of the interatomic potentials in reproducing this high pressure and temperature extreme behavior. Here, in this work, a hybrid EAM-R—which is the combination of embedded atom method (EAM) and rapid artificial neural network potential—for Tin (Sn) is described which is capable of accurately modeling the complex sequence of phase transitions between different metallic polymorphs as a function of pressure. This hybrid approach ensures that a basic empirical potential like EAM is used as a lower energy bound. By using the final activation function, the neural network contribution to energy must be positive, assuring stability over the whole configuration space. This implementation has the capacity to reproduce density functional theory results at 6 orders of magnitude slower than a pair potential for molecular dynamics simulation, including elastic and plastic characteristics and relative energies of each phase. Using calculations of the Gibbs free energy, it is demonstrated that the potential precisely predicts the experimentally observed phase changes at temperatures and pressures across the whole phase diagram. At 10.2 GPa, the present potential predicts a first-order phase transition between body-centered tetragonal (BCT) β-Sn and another polymorph of BCT-Sn. This structure transforms into body-centered cubic near the experimentally reported value at 33 GPa. Thus, the Sn potential developed in this paper can be used to study complex deformation mechanisms under extreme conditions of high pressure and strain rates unlike existing potentials. Moreover, the framework developed in this paper can be extended for different material systems with complex phase diagrams.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Transitional Structures with Continuous Variations in Atomic Positions from Anatase to Rutile Improve Photocatalytic Activity

Abstract TiO 2 polymorphs have distinct properties that are widely employed in various applications. However, mechanisms of transformations between these polymorphs are not fully understood, especially at atomic scale, inhibiting advancing the design and application of the transitional phases. Here, based on results from semi‐in situ transmission electron microscopy, density functional theory, and X‐ray photoemission experiments, a physical picture of transitional structures is discovered, in which continuous variations in atomic positions form along a previously unreported anatase‐to‐rutile phase transformation path of [010] A –to–[] R and (004) A –to– (011) R . These gradient structures give rise to continuous band bending, which promotes electron‐hole separation and inhibits their recombination across the bulk of the particles, leading to a large functionally active volume fraction and resulting in high photoactivity. These findings suggest that interphase matter based on extended gradient structures can be designed to advance new functions not achievable using abrupt interfaces.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Efficient human activity recognition with spatio-temporal spiking neural networks

In this study, we explore Human Activity Recognition (HAR), a task that aims to predict individuals' daily activities utilizing time series data obtained from wearable sensors for health-related applications. Although recent research has predominantly employed end-to-end Artificial Neural Networks (ANNs) for feature extraction and classification in HAR, these approaches impose a substantial computational load on wearable devices and exhibit limitations in temporal feature extraction due to their activation functions. To address these challenges, we propose the application of Spiking Neural Networks (SNNs), an architecture inspired by the characteristics of biological neurons, to HAR tasks. SNNs accumulate input activation as presynaptic potential charges and generate a binary spike upon surpassing a predetermined threshold. This unique property facilitates spatio-temporal feature extraction and confers the advantage of low-power computation attributable to binary spikes. We conduct rigorous experiments on three distinct HAR datasets using SNNs, demonstrating that our approach attains competitive or superior performance relative to ANNs, while concurrently reducing energy consumption by up to 94%.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Chemical Imaging for In Situ Detection and Discrimination of Aquatic Toxins Targeting Voltage Gated Sodium Channels

Biologically derived neurotoxins from cyanobacteria and algae impact environmental resources in addition to being considered a potential biological threat to human and animal health. Activity based assays are essential to detecting and responding to toxic neurotoxin events either naturally occurring or deliberate. Two toxins of interest include saxitoxin and brevetoxin. These toxins bind to and alter the function of voltage-gated sodium channels (NaV channels) which are essential for generating cell membrane action potential. We report the development and refinement of a System for Analysis at Liquid Vacuum Interface (SALVI) to assess the functional activity of saxitoxin and brevetoxin. This approach utilizes a vacuum-compatible microfluidic reactor that permits analysis at the liquid vacuum interface of human derived cells with a neurotoxin of interest in a biologically relevant environment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

In silico evaluation of a targeted metaproteomics strategy for broad screening of cellulolytic enzyme capacities in anaerobic microbiome bioreactors

Microbial-driven solubilization of lignocellulosic material is a natural mechanism that is exploited in anaerobic digesters (ADs) to produce biogas and other valuable bioproducts. Glycoside hydrolases (GHs) are the main enzymes that bacterial and archaeal populations use to break down complex polysaccharides in these reactors. Methodologies for rapidly screening the physical presence and types of GHs can provide information about their functional activities as well as the taxonomical diversity within AD systems but are largely unavailable. Targeted proteomic methods could potentially be used to provide snapshots of the GHs expressed by microbial consortia in ADs, giving valuable insights into the functional lignocellulolytic degradation diversity of a community. Such observations would be essential to evaluate the hydrolytic performance of a reactor or potential issues with it.

09 BIOMASS FUELS↗
DOE OSTI2022

Self-healing oxygen evolution catalysts

Abstract Electrochemical and photoelectrochemical water splitting offers a scalable approach to producing hydrogen from renewable sources for sustainable energy storage. Depending on the applications, oxygen evolution catalysts (OECs) may perform water splitting under a variety of conditions. However, low stability and/or activity present challenges to the design of OECs, prompting the design of self-healing OECs composed of earth-abundant first-row transition metal oxides. The concept of self-healing catalysis offers a new tool to be employed in the design of stable and functionally active OECs under operating conditions ranging from acidic to basic solutions and from a variety of water sources.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems

When learning, the brain modifies individual synaptic connections to reach a desired behavior. Animal and human brains have been shown to be incredibly capable of learning complex and varied functions across a wide variety of tasks. In recent years, artificial neural networks, inspired by human and animal brains, have shown great capabilities in learning a wide variety of difficult tasks. However, artificial neural networks primarily teach themselves through the use of backpropagation, a learning method which has no clear analogue within the brain. Additionally, Artificial Neural Networks primarily use continuous activation functions, which differ significantly from the spiking neuronal behavior present in the brain. In this paper, we discuss and demonstrate a biologically plausible learning method that approximates backpropagation through two techniques on Spiking Neural Networks. First, we show that the local temporal derivatives that are necessary for backpropagation can be approximately recovered through reconstruction using spike timings. Second, we show that through learning during a sleep phase, inspired by neuroscience research into memory replay, the localized parallel feedback path can learn to approximate the derivative through the forward path weight matrix, thus solving the weight transport problem. Lastly, we demonstrate that the combination of these two methods can approach or exceed the accuracy of backpropagation-based methods for a variety of neuromorphic vision tasks while maintaining biological plausibility.

42 ENGINEERING↗
DOE OSTI2025

Triangle Method for Dense ReLU Layers [SWR-25-72]

This software is an implementation of the methods for initializing and training neural networks to be more efficient per parameter, described more fully below and in the related publication: In theory, depth should make a ReLU network EXPONENTIALLY more efficient by enabling it to produce an exponential number of piecewise linear sections in its output. This reasoning is largely based on the work of mathematicians that have hand-constructed networks that make good use of depth. In practice however, even very deep ReLU networks that have been randomly initialized will behave identically to their shallow counterparts - missing an entire exponential dimension of efficiency. The triangle method is a first attempt at realizing the exponential potential of deep networks. Instead of randomly setting weights, we force pairs of neurons in each layer learn to build triangles (i.e. functions from [0,1] -> [0,1] that look like triangles). This is a very efficient pattern for generating lots of linear pieces because composing two triangular functions doubles the number of pieces with each composition. The triangle method is more than just a different initialization, it is a new paradigm of training. Instead of making direct updates to the matrix weights, we do an extra step of backpropagation to collect the derivatives of the loss function with respect to the shapes of the triangles, training them to tilt left or right. This process essentially holds the networks hand throughout the loss landscape and forces it to always use depth effectively by producing triangular shapes internally. This can produce several orders of magnitude of improvement on convex one-dimensional regression problems. Much more theoretical work is needed to realize its full potential beyond this context, but the implementation in this repository will still work in arbitrary numbers of dimensions. The file Triangle_Method.py is a generalized form of the method that will build each neuron its own custom 1-d convex activation function (with exponential efficiency). Example usage on one dimensional problems can be found in Example_Usage.ipynb and an example of using this in a real neural network can be found in Example_VGG16_CIFAR10.ipynb.

Milkert, Max [National Renewable Energy Laboratory↗
DOE OSTI2025

Shape Anisotropy-Dependent Leaking in Magnetic Neurons for Bio-Mimetic Neuromorphic Computing

Spiking neural networks seek to emulate biological computation through interconnected artificial neuron and synapse devices. Spintronic neurons can leverage magnetization physics to mimic biological neuron functions, such as integration tied to magnetic domain wall (DW) propagation in a patterned nanotrack and firing tied to the resistance change of a magnetic tunnel junction (MTJ), captured in the domain wall-magnetic tunnel junction (DW-MTJ) device. Leaking, relaxation of a neuron when it is not under stimulation, is also predicted to be implemented based on DW drift as a DW relaxes to a low energy position, but it has not been well explored or demonstrated in device prototypes. Here, in this work, we study DW-MTJ artificial neurons capable of leaky integrate-and-fire (LIF) behavior and demonstrate geometry-dependent leaking dynamics that results in repeatable, tunable LIF operation. Studying the behavior of five different device designs, we show tuning the geometry, stimulating fields and currents, and location of electrical contacts results in a wide range of neuron behavior. Additionally, implementation of an asymmetric notch allows for nonlinear pinning which increased expressivity without sacrificing leaking. The measured behavior is implemented in a simulated spiking neural network that outperforms a 1D model of continuous DW motion and approaches the performance of an ideal LIF activation function. The results show that the analog LIF capability of DW-MTJ neurons combines many desirable neuron functions into a single device, which can result in varied forms of multifunctional neuromorphic computing.

42 ENGINEERING↗
DOE OSTI2022

High thermal conductivity in wafer-scale cubic silicon carbide crystals

High thermal conductivity electronic materials are critical components for high-performance electronic and photonic devices as both active functional materials and thermal management materials. We report an isotropic high thermal conductivity exceeding 500 W m –1 K –1 at room temperature in high-quality wafer-scale cubic silicon carbide (3C-SiC) crystals, which is the second highest among large crystals (only surpassed by diamond). Furthermore, the corresponding 3C-SiC thin films are found to have record-high in-plane and cross-plane thermal conductivity, even higher than diamond thin films with equivalent thicknesses. Our results resolve a long-standing puzzle that the literature values of thermal conductivity for 3C-SiC are lower than the structurally more complex 6H-SiC. We show that the observed high thermal conductivity in this work arises from the high purity and high crystal quality of 3C-SiC crystals which avoids the exceptionally strong defect-phonon scatterings. Moreover, 3C-SiC is a SiC polytype which can be epitaxially grown on Si. We show that the measured 3C-SiC-Si thermal boundary conductance is among the highest for semiconductor interfaces. These findings provide insights for fundamental phonon transport mechanisms, and suggest that 3C-SiC is an excellent wide-bandgap semiconductor for applications of next-generation power electronics as both active components and substrates.

42 ENGINEERING↗
DOE OSTI2022

Interactions between molecular-scale processes and hyporheic exchange for understanding Fe-S-C cycling in riparian wetlands (Final Report)

Wetlands represent some of the most productive ecosystems on the planet and critically influence global environmental health. Specifically, wetlands promote water quality by transforming nutrients and organic compounds and sequestering metals and contaminants. Riparian wetland hyporheic zones, where toxic surface water and anoxic groundwater mix, exhibit dynamic conditions that drive steep redox gradients and promote hotspots of diverse and fluctuating microbial activity. Changes in climate, water quality, and water quantity can disturb hydrologic flow and biogeochemical processing in these environments. Understanding how sulfate loading, impacted by hydrologic flux and anthropogenic inputs, influences iron and carbon cycling in wetlands will be crucial for predicting water quality issues driven by iron mineral precipitation and sorption, such as the release of heavy metals and other toxic elements. We used a fully integrated multi-scale and multi-method approach to develop a mechanistic understanding of how hydrologic flow influences coupled iron and sulfur cycles in riparian wetlands. This entailed hydrological, geochemical, and microbial observations at two locations: an anthropogenic sulfate-impacted riparian wetland in northern Minnesota, and a low-sulfate Fe-rich riparian wetland in Tims Branch at the Savannah River Site (SRS). These sites were characterized by hydrologically dynamic conditions where the stream and wetland systems oscillated between gaining (upward flow) and losing (downward flow) conditions that recharged the system occasionally with oxidants that fueled a variety of biogeochemical reactions. Aqueous geochemical measurements of surface water, groundwater, and porewater samples were made alongside solid-phase geochemical analyses of sediment gravity cores. Bulk X-ray absorption spectroscopy at the Advanced Photon Source (APS; Argonne) interrogated the speciation and distribution of Fe and S mineral phases of the sediments. Interestingly, it was discovered that, despite strongly reducing conditions, Fe(III) compounds and a variety of intermediate valence S compounds were stable in the subsurface. Indeed, compounds like thiosulfate, S(0), and intermediate valence organosulfur compounds were more prevalent than FeS and pyrite. The composition of the sediments did change with changes in hydrologic flow, showing their reactivity in changing redox conditions. The abundance of these intermediate S compounds was likely formed as a result of anaerobic oxidation by aqueous and solid-phase Fe(III) compounds, fueling a cryptic S cycle that is driving the breakdown of organic matter in the hyporheic zone. Microbiome surveys showed a core community that seemed stable across the landscape, but changed with increasing depth into the sediment. The community composition did not seem to change dramatically with changes in season or hydrologic flow, except for some organisms that have the potential to contribute to S cycling. More work is needed to confirm their functional activity. These fine process-scale analyses were placed within a dynamic field context using physical flow parameters from surface water and groundwater level measurements. These data helped shed light on sulfur-driven biogeochemical processes in hydrologically dynamic riparian wetlands, addressing a gap in our understanding about the impacts of pollution and other anthropogenic changes on ecologically sensitive environments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Chemical Recycling Processes of Waste Polyethylene Terephthalate Using Solid Catalysts

Polyethylene terephthalate (PET) is a non-degradable single-use plastic and a major component of plastic waste in landfills. Chemical recycling is one of the most widely adopted methods to transform post-consumer PET into PET's building block chemicals. Non-catalytic depolymerization of PET is very slow and requires high temperatures and/or pressures. Recent advancements in the field of material science and catalysis have delivered several innovative strategies to promote PET depolymerization under mild reaction conditions. Particularly, heterogeneous catalysts assisted depolymerization of post-consumer PET to monomers and other value-added chemicals is the most industrially compatible method. Here, this review includes current progresses on the heterogeneously catalyzed chemical recycling of PET. It describes four key pathways for PET depolymerization including, glycolysis, pyrolysis, alcoholysis, and reductive depolymerization. The catalyst function, active sites and structure-activity correlations are briefly outlined in each section. An outlook for future development is also presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Human IgE monoclonal antibodies define two unusual epitopes trapping dog allergen Can f 1 in different conformations

Abstract Molecular analysis of interactions between IgE antibody and allergen allows the structural basis of IgE recognition to be defined. Human IgE (hIgE) epitopes of respiratory lipocalin allergens, including Can f 1, remain elusive due to a lack of IgE‐allergen complexes. This study aims to map the structure of allergenic epitopes on Can f 1. The fragment antigen‐binding (Fab) regions of Can f 1 specific human IgE monoclonal antibodies (hIgE mAb) were used to determine the structures of IgE epitopes. Epitope mutants were designed to target Can f 1 epitopes. Immunoassays and a human FcεRIαtransgenic mouse model of passive anaphylaxis in vivo were used to assess the functional activity of epitope mutants. Crystal structures of natural or recombinant Can f 1 complexed with two hIgE mAb 1J11 and 12F3 Fabs, respectively, were determined. The hIgE mAb bound to two partially overlapping epitopes and recognized two different Can f 1 conformations. The hIgE mAb 12F3 showed an unusual mode of binding by protruding its heavy chain CDR3 inside the Can f 1 calyx. Epitope mutants generated based on the structural analyses displayed a 64%–89% reduction in IgE antibody binding and failed to induce passive anaphylaxis in a human FcεRIαtransgenic mouse model. In summary, the structures of Can f 1‐hIgE Fab complexes revealed two unique and partially overlapping epitopes on Can f 1. The modification of the identified IgE epitopes provides a pathway for the design of hypoallergens to treat dog allergies.

Biochemistry & Molecular Biology↗
DOE OSTI2025

The Psyche Gamma-Ray and Neutron Spectrometer

A Gamma-Ray and Neutron Spectrometer (GRNS) instrument has been developed as part of the science payload for NASA’s Discovery Program Psyche mission to the M-class asteroid (16) Psyche. The GRNS instrument is designed to measure the elemental composition of Psyche with the goal to understand the origin of this mysterious, potentially metal-rich planetary body. The GRNS will measure the near-surface abundances for the elements Ni, Fe, Si, K, S, Al, and Ca, as well as the spatial distribution of Psyche’s metal-to-silicate fraction (or metal fraction). These measurements address three of the five Psyche mission science objectives: determine if Psyche is a core; determine whether small metal bodies incorporate light elements into the metal phase; and determine whether Psyche was formed under reducing conditions. The Gamma-Ray Spectrometer (GRS) uses a cryocooled, high-purity Ge (HPGe) sensor to detect cosmic-ray generated gamma rays in the 60 to 9000-keV energy range. The HPGe sensor is surrounded by a borated plastic anticoincidence shield that provides three functions: active background rejection from charged particle interactions in the HPGe sensor; fast neutron measurements; and direct measurements of the incident galactic cosmic ray flux. The Neutron Spectrometer (NS) uses three 3 He gas proportional sensors, each with different material wraps to measure thermal (<0.4 eV), low-energy epithermal (0.4 eV to 1 keV), and high-energy epithermal (up to 100 keV) neutrons. This paper provides an overview of the Psyche GRNS, including: its science and measurement objectives; the design of the instrument hardware, software, and operation; pre-launch performance measurements and its initial performance in space; and an overview of its data products and expected operation for different Psyche mission phases.

Engineering - Instrumentation related to nuclear s↗