Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Activation function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Systems and methods for dynamically reconfigurable artificial synapses and neurons with tunable activation functions

An ionic redox transistor comprises a solid channel, a solid reservoir layer, and a solid electrolyte layer disposed between the channel and the reservoir layer. The channel exhibits a substantially linear current-voltage relationship in a first range of voltages, and a nonlinear current-voltage relationship in a second range of voltages that is greater than the first range of voltages. One or both of the substantially linear current-voltage relationship or the nonlinear current-voltage relationship of the channel is varied by changing the concentration of ions such as oxygen vacancies in the channel. Ion or vacancy transport between the channel and the reservoir layer across the electrolyte layer occurs in response to applying a voltage between the channel and the reservoir layer. Subject to the first range of voltages, the channel can function as a synapse device. Subject to the second range of voltages, the channel can function as a neuron device.

Talin, Albert Alec↗
DOE OSTI2019

Elucidation of Fe-N-C electrocatalyst active site functionality via in-situ X-ray absorption and operando determination of oxygen reduction reaction kinetics in a PEFC

In the past decade the notable effort placed on improving intrinsic electrochemical kinetics of platinum group metal (PGM)-free electrocatalysts for the oxygen reduction reaction (ORR) has led to a significant improvement in both performance and understanding of this class of electrocatalysts. However, a limited amount of this development and understanding has been undertaken using operando electrochemical diagnostics at the membrane electrode assembly (MEA) level. In this work, the operando ORR kinetics on an atomically dispersed iron-nitrogen-carbon ((AD)Fe-N-C) PGM-free electrocatalyst have been examined to extract the reaction order and the activation energy of the ORR. The experiments were carefully designed to ensure the stability/predictability of the electrocatalyst during the data collection process and thus validate the relevance of the values obtained for the aforementioned parameters. A kinetic model that considers a potential-dependent availability of active sites (θ) is proposed. Active site availability is shown to be a function of both the change in the oxidation state (nR) and the redox potential at which the metal center transitions from a higher oxidation state to a lower one (). The resulting model fitting parameters for nR and (0.71 and 0.788 V, respectively) obtained from the analysis of operando data correlate well with those from in situ X-ray absorption near edge structure measurements (nR=0.57) and in situ cyclic voltammetry measurements (0.75 V < <0.8 V) in the MEA environment. The resulting model provides an excellent fit of MEA performance across the range of pressures, temperatures, and potentials under which the data were collected.

Activation energy↗
DOE OSTI2023

A unified and constructive framework for the universality of neural networks

Abstract One of the reasons why many neural networks are capable of replicating complicated tasks or functions is their universal approximation property. Though the past few decades have seen tremendous advances in theories of neural networks, a single constructive and elementary framework for neural network universality remains unavailable. This paper is an effort to provide a unified and constructive framework for the universality of a large class of activation functions including most of the existing ones. At the heart of the framework is the concept of neural network approximate identity (nAI). The main result is as follows: any nAI activation function is universal in the space of continuous functions on compacta. It turns out that most of the existing activation functions are nAI, and thus universal. The framework induces several advantages over the contemporary counterparts. First, it is constructive with elementary means from functional analysis, probability theory, and numerical analysis. Second, it is one of the first unified and constructive attempts that is valid for most of the existing activation functions. Third, it provides new proofs for most activation functions. Fourth, for a given activation and error tolerance, the framework provides precisely the architecture of the corresponding one-hidden neural network with a predetermined number of neurons and the values of weights/biases. Fifth, the framework allows us to abstractly present the first universal approximation with a favorable non-asymptotic rate. Sixth, our framework also provides insights into the developments, and hence providing constructive derivations, of some of the existing approaches.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

Optimal Space Station solar array gimbal angle determination via radial basis function neural networks

The potential for excessive plume impingement loads on Space Station Freedom solar arrays, caused by jet firings from an approaching Space Shuttle, is addressed. An artificial neural network is designed to determine commanded solar array beta gimbal angle for minimum plume loads. The commanded angle would be determined dynamically. The network design proposed involves radial basis functions as activation functions. Design, development, and simulation of this network design are discussed.

Clancy, Daniel J.↗
NASA NTRS2014

Customizing Countermeasure Prescriptions using Predictive Measures of Sensorimotor Adaptability

Astronauts experience sensorimotor disturbances during the initial exposure to microgravity and during the readapation phase following a return to a gravitational environment. These alterations may lead to disruption in the ability to perform mission critical functional tasks during and after these gravitational transitions. Astronauts show significant inter-subject variation in adaptive capability following gravitational transitions. The ability to predict the manner and degree to which each individual astronaut will be affected would improve the effectiveness of a countermeasure comprised of a training program designed to enhance sensorimotor adaptability. Due to this inherent individual variability we need to develop predictive measures of sensorimotor adaptability that will allow us to predict, before actual space flight, which crewmember will experience challenges in adaptive capacity. Thus, obtaining this information will allow us to design and implement better sensorimotor adaptability training countermeasures that will be customized for each crewmember's unique adaptive capabilities. Therefore the goals of this project are to: 1) develop a set of predictive measures capable of identifying individual differences in sensorimotor adaptability, and 2) use this information to design sensorimotor adaptability training countermeasures that are customized for each crewmember's individual sensorimotor adaptive characteristics. To achieve these goals we are currently pursuing the following specific aims: Aim 1: Determine whether behavioral metrics of individual sensory bias predict sensorimotor adaptability. For this aim, subjects perform tests that delineate individual sensory biases in tests of visual, vestibular, and proprioceptive function. Aim 2: Determine if individual capability for strategic and plastic-adaptive responses predicts sensorimotor adaptability. For this aim, each subject's strategic and plastic-adaptive motor learning abilities are assessed using a test of locomotor function designed specifically to delineate both mechanisms. Aim 3: Develop predictors of sensorimotor adaptability using brain structural and functional metrics. We will measure individual differences in regional brain volumes (structural MRI), white matter integrity (diffusion tensor imaging, or DTI), functional network integrity (resting state functional connectivity MRI), and sensorimotor adaptation task-related functional brain activation (functional MRI). We decided to complete the data collection for Specific Aims 1, 2 and 3 simultaneously on the same subjects to increase data capture. By having the same subjects perform all three specific aims we can enhance our ability to detect how a wider range of factors can predict adaptability in a specific individual. This provides a much richer database and potentially a better understanding of the predictive power of the selected factors. In this presentation I will discuss preliminary data obtained to date.

Bloomberg, J. J.↗
DOE OSTI2025

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Adaptive Interface-PINNs (AdaI-PINNs): An Efficient Physics-Informed Neural Networks Framework for Interface Problems

Here, we present an efficient physics-informed neural networks (PINNs) framework, termed Adaptive Interface-PINNs (AdaI-PINNs), to improve the modeling of interface problems with discontinuous coefficients and/or interfacial jumps. This framework is an enhanced version of its predecessor, Interface PINNs or I-PINNs (Sarma et al.; https://doi.org/10.1016/j.cma.2024.117135), which involves domain decomposition and assignment of different predefined activation functions to the neural networks in each subdomain across a sharp interface, while keeping all other parameters of the neural networks identical. In AdaI-PINNs, the activation functions vary solely in their slopes, which are trained along with the other parameters of the neural networks. This makes the AdaI-PINNs framework fully automated without requiring preset activation functions. Comparative studies on one-dimensional, two-dimensional, and three-dimensional benchmark elliptic interface problems reveal that AdaI-PINNs outperform I-PINNs, reducing computational costs by 2-6 times while producing similar or better accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Synthesis and Exploratory Catalysis of 3d Metals: Atom and Group-Transfer Reactions and the Activation and Functionalization of Small Molecules Including Greenhouse Gases

Determining ways to convert natural gas, with zero emissions, and to more value-added materials such as olefins is one of the main goals in my research group. Over this funding period, we explored the chemistry of early-transition metals with metal-nitrogen multiple bonds, specifically titanium and zirconium nitrides, and explored their redox properties, basicity and reactivity with small molecules including greenhouses gases such as carbon dioxide. Some of these work serve as inspiration for the chemistry of important materials such as uranium nitride along with its unprecedented basicity and ability to activate C-H bonds. Using robust chelating templates we also examined rare examples of trivalent group 4 transition metal ions, and studied these spectroscopically. Using early transition metal ions we also explored synthetic routes to new phosphide based products using the phosphaethynolate salt. In addition, we also explored the chemistry of ferrous systems, and redox active ligand that can allow us to reversibly break and make C-S as well as N-N bonds, activate dinitrogen forming unusual MNNM topologies. Our final component describes how we activate methane and dehydrocouple if with a carbene source to form ethylene. Using this information, we also discovered a simple to make iridium catalyst that activate and functionalize methane with 9:1 selectivity for mono-functionalization. We have established a pathway that leads to poisoning of the catalyst and have found optimal conditions for higher selectivity and with over 170 Turnovers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1991

Total recall in distributive associative memories

Iterative error correction of asymptotically large associative memories is equivalent to a one-step learning rule. This rule is the inverse of the activation function of the memory. Spectral representations of nonlinear activation functions are used to obtain the inverse in closed form for Sparse Distributed Memory, Selected-Coordinate Design, and Radial Basis Functions.

Danforth, Douglas G.↗
DOE OSTI2020

Transition Metal Activation And Functionalization Of Carbon-Hydrogen And Carbon-Carbon Bonds

This project has as its overall goal improvement in the intelligent use of our energy resources, specifically petroleum derived products, and is aimed at the development of new routes for the manipulation of C-H and C-C bonds. During this project period, our research is focused on the following general goals: (1) C-H bond activation reactions in functionalized substrates, including alkylnitriles, ketones, esters, ethers, fluoromethanes, alcohols, amines, and alkynes, and fundamental studies of their effects on metal-carbon bond strengths using trispyrazolylborate-rhodium (TpRh) complexes; (2) Hydrogenation reactions using first-row transition metals; and (3) C–CN bond activation in aryl-nitriles and allyl-nitriles.

02 PETROLEUM↗
NASA NTRS2002

A quantitative comparison of simultaneous BOLD fMRI and NIRS recordings during functional brain activation

Near-infrared spectroscopy (NIRS) has been used to noninvasively monitor adult human brain function in a wide variety of tasks. While rough spatial correspondences with maps generated from functional magnetic resonance imaging (fMRI) have been found in such experiments, the amplitude correspondences between the two recording modalities have not been fully characterized. To do so, we simultaneously acquired NIRS and blood-oxygenation level-dependent (BOLD) fMRI data and compared Delta(1/BOLD) (approximately R(2)(*)) to changes in oxyhemoglobin, deoxyhemoglobin, and total hemoglobin concentrations derived from the NIRS data from subjects performing a simple motor task. We expected the correlation with deoxyhemoglobin to be strongest, due to the causal relation between changes in deoxyhemoglobin concentrations and BOLD signal. Instead we found highly variable correlations, suggesting the need to account for individual subject differences in our NIRS calculations. We argue that the variability resulted from systematic errors associated with each of the signals, including: (1) partial volume errors due to focal concentration changes, (2) wavelength dependence of this partial volume effect, (3) tissue model errors, and (4) possible spatial incongruence between oxy- and deoxyhemoglobin concentration changes. After such effects were accounted for, strong correlations were found between fMRI changes and all optical measures, with oxyhemoglobin providing the strongest correlation. Importantly, this finding held even when including scalp, skull, and inactive brain tissue in the average BOLD signal. This may reflect, at least in part, the superior contrast-to-noise ratio for oxyhemoglobin relative to deoxyhemoglobin (from optical measurements), rather than physiology related to BOLD signal interpretation.

Non-NASA Center↗