Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functionalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Aligned Carbon Nanotube Array Functionalization for Enhanced Atomic Layer Deposition of Platinum Electrocatalysts

Uniform metal deposition onto high surface area supports is a key challenge of developing successful efficient catalyst materials. Atomic layer deposition (ALD) circumvents permeation difficulties, but relies on gas-surface reactions to initiate growth. Our work demonstrates that modified surfaces within vertically aligned carbon nanotube (CNT) arrays, from plasma and molecular precursor treatments, can lead to improved catalyst deposition. Gas phase functionalization influences the number of ALD nucleation sites and the onset of ALD growth and, in turn, affects the uniformity of the coating along the length of the CNTs within the aligned arrays. The induced chemical changes for each functionalization route are identified by X-ray photoelectron and Raman spectroscopies. The most effective functionalization routes increase the prevalence of oxygen moieties at defect sites on the carbon surfaces. The striking effects of the functionalization are demonstrated with ALD Pt growth as a function of surface treatment and ALD cycles examined by electron microscopy of the arrays and the individual CNTs. Finally, we demonstrate applicability of these materials as fuel cell electrocatalysts and show that surface functionalization affects their performance towards oxygen reduction reaction.

08 HYDROGEN↗

The Lateral Trigger Probability function for the ultra-high energy cosmic ray showers detected by the Pierre Auger Observatory

In this paper we introduce the concept of Lateral Trigger Probability (LTP) function, i.e., the probability for an Extensive Air Shower (EAS) to trigger an individual detector of a ground based array as a function of distance to the shower axis, taking into account energy, mass and direction of the primary cosmic ray. We apply this concept to the surface array of the Pierre Auger Observatory consisting of a 1.5 km spaced grid of about 1600 water Cherenkov stations. Using Monte Carlo simulations of ultra-high energy showers the LTP functions are derived for energies in the range between 10{sup 17} and 10{sup 19} eV and zenith angles up to 65{sup o}. A parametrization combining a step function with an exponential is found to reproduce them very well in the considered range of energies and zenith angles. The LTP functions can also be obtained from data using events simultaneously observed by the fluorescence and the surface detector of the Pierre Auger Observatory (hybrid events). We validate the Monte Carlo results showing how LTP functions from data are in good agreement with simulations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Mobile sensing of point-source gas emissions using Bayesian inference: An empirical examination of the likelihood function

This paper evaluates likelihood function forms for Bayesian inference of point-source gas emissions using a mobile sensor. Whereas Bayesian inference has been successfully used to estimate emission rates from time-averaged concentration data measured by stationary sensors, data collected by mobile sensors do not represent ensemble or time-averaged conditions. To examine the potential impact of this contrast, controlled release experiments were conducted with a mobile sensor measuring concentrations repeatedly along transverse cross sections of the downwind plumes. Experiments were conducted with measurements made at different downwind distances, different sensor heights, and with different obstacle states. An examination is made between two commonly-used likelihood functions, the Gaussian and the log-normal. For experiments conducted in the absence of obstacles, the Bayesian estimates using the log-normal likelihood function yield a much smaller bias than those based on the Gaussian likelihood function. This finding is consistent with the non-Gaussian nature of concentration fluctuations near a point-source. For experiments conducted in the presence of obstacles, the Bayesian inference based on the Gaussian likelihood function exhibits a better performance. This can be explained by the enhanced turbulent mixing due to the obstacle-introduced wake eddies. Overall, we find that the selection of the likelihood function can be physically related to the underlying conditions, and the proper selection is critical to ensure the performance of the Bayesian inference for source characterization using mobile sensing data.

54 ENVIRONMENTAL SCIENCES↗

Repression of estrogen receptor {beta} function by putative tumor suppressor DBC1

It has been well established that estrogen is involved in the pathophysiology of breast cancer. Estrogen receptor (ER) {alpha} appears to promote the proliferation of cancer tissues, while ER{beta} can protect against the mitogenic effect of estrogen in breast tissue. The expression status of ER{alpha} and ER{beta} may greatly influence on the development, treatment, and prognosis of breast cancer. Previous studies have indicated that the deleted in breast cancer 1 (DBC1/KIAA1967) gene product has roles in regulating functions of nuclear receptors. The gene encoding DBC1 is a candidate for tumor suppressor identified by genetic search for breast cancer. Caspase-dependent processing of DBC1 promotes apoptosis, and depletion of the endogenous DBC1 negatively regulates p53-dependent apoptosis through its specific inhibition of SIRT1. In addition, DBC1 modulates ER{alpha} expression and promotes breast cancer cell survival by binding to ER{alpha}. Here we report an ER{beta}-specific repressive function of DBC1. Immunoprecipitation and immunofluorescence studies show that ER{beta} and DBC1 interact in a ligand-independent manner similar to ER{alpha}. In vitro pull-down assays revealed a direct interaction between DBC1 amino-terminus and activation function-1/2 domain of ER{beta}. Although DBC1 shows no influence on the ligand-dependent transcriptional activation function of ER{alpha}, the expression of DBC1 negatively regulates the ligand-dependent transcriptional activation function of ER{beta}in vivo, and RNA interference-mediated depletion of DBC1 stimulates the transactivation function of ER{beta}. These results implicate the principal role of DBC1 in regulating ER{beta}-dependent gene expressions.

60 APPLIED LIFE SCIENCES↗

Lentiviral-mediated transfer of CDNF promotes nerve regeneration and functional recovery after sciatic nerve injury in adult rats

Highlights: •CDNF was successfully transfected by a lentiviral vector into the distal sciatic nerve. •CDNF improved S-100, NF200 expression and nerve regeneration after sciatic injury. •CDNF improved the remyelination and thickness of the regenerated sciatic nerve. •CDNF improved gastrocnemius muscle weight and sciatic functional recovery. -- Abstract: Peripheral nerve injury is often followed by incomplete and unsatisfactory functional recovery and may be associated with sensory and motor impairment of the affected limb. Therefore, a novel method is needed to improve the speed of recovery and the final functional outcome after peripheral nerve injuries. This report investigates the effect of lentiviral-mediated transfer of conserved dopamine neurotrophic factor (CDNF) on regeneration of the rat peripheral nerve in a transection model in vivo. We observed notable overexpression of CDNF protein in the distal sciatic nerve after recombinant CDNF lentiviral vector application. We evaluated sciatic nerve regeneration after surgery using light and electron microscopy and the functional recovery using the sciatic functional index and target muscle weight. HE staining revealed better ordered structured in the CDNF-treated group at 8 weeks post-surgery. Quantitative analysis of immunohistochemistry of NF200 and S-100 in the CDNF group revealed significant improvement of axonal and Schwann cell regeneration compared with the control groups at 4 weeks and 8 weeks after injury. The thickness of the myelination around the axons in the CDNF group was significantly higher than in the control groups at 8 weeks post-surgery. The CDNF group displayed higher muscle weights and significantly increased sciatic nerve index values. Our findings suggest that CDNF gene therapy could provide durable and stable CDNF protein concentration and has the potential to enhance peripheral nerve regeneration, morphological and functional recovery following nerve injury, which suggests a promising strategy for peripheral nerve repair.

60 APPLIED LIFE SCIENCES↗

Tribbles 3 inhibits brown adipocyte differentiation and function by suppressing insulin signaling

Recent studies have demonstrated that adult humans have substantial amounts of functioning brown adipose tissue (BAT). Since BAT has been implicated as an anti-obese and anti-diabetic tissue, it is important to understand the signaling molecules that regulate BAT function. There has been a link between insulin signaling and BAT metabolism as deletion or pharmaceutical inhibition of insulin signaling impairs BAT differentiation and function. Tribbles 3 (TRB3) is a pseudo kinase that has been shown to regulate metabolism and insulin signaling in multiple tissues but the role of TRB3 in BAT has not been studied. In this study, we found that TRB3 expression was present in BAT and overexpression of TRB3 in brown preadipocytes impaired differentiation and decreased expression of BAT markers. Furthermore, TRB3 overexpression resulted in significantly lower oxygen consumption rates for basal and proton leakage, indicating decreased BAT activity. Based on previous studies showing that deletion or pharmaceutical inhibition of insulin signaling impairs BAT differentiation and function, we assessed insulin signaling in brown preadipocytes and BAT in vivo. Overexpression of TRB3 in cells impaired insulin-stimulated IRS1 and Akt phosphorylation, whereas TRB3KO mice displayed improved IRS1 and Akt phosphorylation. Finally, deletion of IRS1 abolished the function of TRB3 to regulate BAT differentiation and metabolism. These data demonstrate that TRB3 inhibits insulin signaling in BAT, resulting in impaired differentiation and function. - Highlights: • TRB3 is expressed in brown adipose tissue and its expression is increased during differentiation. • Overexpression of TRB3 inhibits differentiation and its activity. • Overexpression of TRB3 in brown preadipocytes inhibits insulin signaling. • TRB3KO mice displays improved insulin signaling in brown adipose tissue. • Insulin signaling is required for the effects of TRB3 to regulate brown adipose tissue differentiation and activity.

60 APPLIED LIFE SCIENCES↗

Sexual Function in Males After Radiotherapy for Rectal Cancer

Purpose: Knowledge of sexual problems after pre- or postoperative radiotherapy (RT) with 50 Gy for rectal cancer is limited. In this study, we aimed to compare self-rated sexual functioning in irradiated (RT+) and nonirradiated (RT-) male patients at least 2 years after surgery for rectal cancer. Methods and Materials: Patients diagnosed with rectal cancer from 1993 to 2003 were identified from the Norwegian Rectal Cancer Registry. Male patients without recurrence at the time of the study. The International Index of Erectile Function, a self-rated instrument, was used to assess sexual functioning, and serum levels of serum testosterone were measured. Results: Questionnaires were returned from 241 patients a median of 4.5 years after surgery. The median age was 67 years at survey. RT+ patients (n = 108) had significantly poorer scores for erectile function, orgasmic function, intercourse satisfaction, and overall satisfaction with sex life compared with RT- patients (n = 133). In multiple age-adjusted analysis, the odds ratio for moderate-severe erectile dysfunction in RT+ patients was 7.3 compared with RT- patients (p <0.001). Furthermore, erectile dysfunction of this degree was associated with low serum testosterone (p = 0.01). Conclusion: RT for rectal cancer is associated with significant long-term effects on sexual function in males.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Functional Interference Clusters in Cancer Patients With Bone Metastases: A Secondary Analysis of RTOG 9714

Purpose: To explore the relationships (clusters) among the functional interference items in the Brief Pain Inventory (BPI) in patients with bone metastases. Methods: Patients enrolled in the Radiation Therapy Oncology Group (RTOG) 9714 bone metastases study were eligible. Patients were assessed at baseline and 4, 8, and 12 weeks after randomization for the palliative radiotherapy with the BPI, which consists of seven functional items: general activity, mood, walking ability, normal work, relations with others, sleep, and enjoyment of life. Principal component analysis with varimax rotation was used to determine the clusters between the functional items at baseline and the follow-up. Cronbach's alpha was used to determine the consistency and reliability of each cluster at baseline and follow-up. Results: There were 448 male and 461 female patients, with a median age of 67 years. There were two functional interference clusters at baseline, which accounted for 71% of the total variance. The first cluster (physical interference) included normal work and walking ability, which accounted for 58% of the total variance. The second cluster (psychosocial interference) included relations with others and sleep, which accounted for 13% of the total variance. The Cronbach's alpha statistics were 0.83 and 0.80, respectively. The functional clusters changed at week 12 in responders but persisted through week 12 in nonresponders. Conclusion: Palliative radiotherapy is effective in reducing bone pain. Functional interference component clusters exist in patients treated for bone metastases. These clusters changed over time in this study, possibly attributable to treatment. Further research is needed to examine these effects.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Insulin-Like Growth Factor-1 Preserves Salivary Gland Function After Fractionated Radiation

Purpose: Radiotherapy for head-and-neck cancer consists of fractionated radiation treatments that cause significant damage to salivary glands leading to chronic salivary gland dysfunction with only limited prevention and treatment options currently available. This study examines the feasibility of IGF-1 in preserving salivary gland function following a fractionated radiation treatment regimen in a pre-clinical model. Methods and Materials: Mice were exposed to fractionated radiation, and salivary gland function and histological analyses of structure, apoptosis, and proliferation were evaluated. Results: In this study, we report that treatment with fractionated doses of radiation results in a significant level of apoptotic cells in FVB mice after each fraction, which is significantly decreased in transgenic mice expressing a constitutively active mutant of Akt1 (myr-Akt1). Salivary gland function is significantly reduced in FVB mice exposed to fractionated radiation; however, myr-Akt1 transgenic mice maintain salivary function under the same treatment conditions. Injection into FVB mice of recombinant insulin-like growth factor-1 (IGF-1), which activates endogenous Akt, suppressed acute apoptosis and preserved salivary gland function after fractionated doses of radiation 30 to 90 days after treatment. FVB mice exposed to fractionated radiation had significantly lower levels of proliferating cell nuclear antigen-positive salivary acinar cells 90 days after treatment, which correlated with a chronic loss of function. In contrast, FVB mice injected with IGF-1 before each radiation treatment exhibited acinar cell proliferation rates similar to those of untreated controls. Conclusion: These studies suggest that activation of IGF-1-mediated pathways before head-and-neck radiation could modulate radiation-induced salivary gland dysfunction and maintain glandular homeostasis.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Abdominal {gamma}-Radiation Induces an Accumulation of Function-Impaired Regulatory T Cells in the Small Intestine

Purpose: To assess the frequency and the functional characteristics of one major component of immune tolerance, the CD4{sup +}FoxP3{sup +} regulatory T cells (Tregs) in a mouse model of abdominal irradiation. Methods and Materials: Mice were exposed to a single abdominal dose of {gamma}-radiation (10 Gy). We evaluated small intestine Treg infiltration by Foxp3 immunostaining and the functional suppressive activity of Tregs isolated from mesenteric lymph nodes. Results: Foxp3 immunostaining showed that radiation induced a long-term infiltration of the intestine by Tregs (levels 5.5 times greater than in controls). Co-culture of Tregs from mesenteric lymph nodes with CD4{sup +} effector cells showed that the Tregs had lost their suppressive function. This loss was associated with a significant decrease in the levels of Foxp3, TGF-{beta}, and CTLA-4 mRNA, all required for optimal Treg function. At Day 90 after irradiation, Tregs regained their suppressive activity as forkhead box P3 (Foxp3), transforming growth factor beta (TGF-{beta}), and cytotoxic T-lymphocyte antigen 4 (CTLA-4) expression returned to normal. Analysis of the secretory function of mesenteric lymph node Tregs, activated in vitro with anti-CD3/anti-CD28 Abs, showed that this dysfunction was independent of a defect in interleukin-10 secretion. Conclusion: Radiation caused a long-term accumulation of function-impaired Foxp3{sup +}CD4{sup +} Tregs in the intestine. Our study provides new insights into how radiation affects the immune tolerance in peripheral tissues.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Changes in Global Function and Regional Ventilation and Perfusion on SPECT During the Course of Radiotherapy in Patients With Non-Small-Cell Lung Cancer

Purpose: This study aimed to (1) examine changes in dyspnea, global pulmonary function test (PFT) results, and functional activity on ventilation (V)/perfusion (Q) single-photon emission computerized tomography (SPECT) scans during the course of radiation (RT), and (2) factors associated with the changes in patients with non-small-cell lung cancer (NSCLC). Methods and Materials: Fifty-six stage I to III NSCLC patients treated with definitive RT with or without chemotherapy were enrolled prospectively. Dyspnea was graded according to Common Terminology Criteria for Adverse Events version 3.0 prior to and weekly during RT. V/Q SPECT-computed tomography (CT) and PFTs were performed prior to and during RT at approximately 45 Gy. Functions of V and Q activities were assessed using a semiquantitative scoring of SPECT images. Results: Breathing improved significantly at the third week (mean dyspnea grade, 0.8 vs. 0.6; paired t-test p = 0.011) and worsened during the later course of RT (p > 0.05). Global PFT results did not change significantly, while regional lung function on V/Q SPECT improved significantly after {approx}45 Gy. The V defect score (DS) was 4.9 pre-RT versus 4.3 during RT (p = 0.01); Q DS was 4.3 pre-RT versus 4.0 during RT (p < 0.01). Improvements in V and Q functions were seen primarily in the ipsilateral lung (V DS, 1.9 pre-RT versus 1.4 during RT, p < 0.01; Q DS, 1.7 pre-RT versus 1.5 during RT, p < 0.01). Baseline primary tumor volume was significantly correlated with pre-RT V/Q DS (p < 0.01). Patients with central lung tumors had greater interval changes in V and Q than those with more peripheral tumors (p <0.05 for both V and Q DS). Conclusions: Regional ventilation and perfusion improved during RT at 45 Gy. This suggests that adaptive planning based on V/Q SPECT during RT may allow sparing of functionally recoverable lung tissue.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Functional Image-Guided Radiotherapy Planning in Respiratory-Gated Intensity-Modulated Radiotherapy for Lung Cancer Patients With Chronic Obstructive Pulmonary Disease

Purpose: To investigate the incorporation of functional lung image-derived low attenuation area (LAA) based on four-dimensional computed tomography (4D-CT) into respiratory-gated intensity-modulated radiotherapy (IMRT) or volumetric modulated arc therapy (VMAT) in treatment planning for lung cancer patients with chronic obstructive pulmonary disease (COPD). Methods and Materials: Eight lung cancer patients with COPD were the subjects of this study. LAA was generated from 4D-CT data sets according to CT values of less than than -860 Hounsfield units (HU) as a threshold. The functional lung image was defined as the area where LAA was excluded from the image of the total lung. Two respiratory-gated radiotherapy plans (70 Gy/35 fractions) were designed and compared in each patient as follows: Plan A was an anatomical IMRT or VMAT plan based on the total lung; Plan F was a functional IMRT or VMAT plan based on the functional lung. Dosimetric parameters (percentage of total lung volume irradiated with {>=}20 Gy [V20], and mean dose of total lung [MLD]) of the two plans were compared. Results: V20 was lower in Plan F than in Plan A (mean 1.5%, p = 0.025 in IMRT, mean 1.6%, p = 0.044 in VMAT) achieved by a reduction in MLD (mean 0.23 Gy, p = 0.083 in IMRT, mean 0.5 Gy, p = 0.042 in VMAT). No differences were noted in target volume coverage and organ-at-risk doses. Conclusions: Functional IGRT planning based on LAA in respiratory-guided IMRT or VMAT appears to be effective in preserving a functional lung in lung cancer patients with COPD.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Prediction of Liver Function by Using Magnetic Resonance-based Portal Venous Perfusion Imaging

Purpose: To evaluate whether liver function can be assessed globally and spatially by using volumetric dynamic contrast-enhanced magnetic resonance imaging MRI (DCE-MRI) to potentially aid in adaptive treatment planning. Methods and Materials: Seventeen patients with intrahepatic cancer undergoing focal radiation therapy (RT) were enrolled in institution review board-approved prospective studies to obtain DCE-MRI (to measure regional perfusion) and indocyanine green (ICG) clearance rates (to measure overall liver function) prior to, during, and at 1 and 2 months after treatment. The volumetric distribution of portal venous perfusion in the whole liver was estimated for each scan. We assessed the correlation between mean portal venous perfusion in the nontumor volume of the liver and overall liver function measured by ICG before, during, and after RT. The dose response for regional portal venous perfusion to RT was determined using a linear mixed effects model. Results: There was a significant correlation between the ICG clearance rate and mean portal venous perfusion in the functioning liver parenchyma, suggesting that portal venous perfusion could be used as a surrogate for function. Reduction in regional venous perfusion 1 month after RT was predicted by the locally accumulated biologically corrected dose at the end of RT (P<.0007). Regional portal venous perfusion measured during RT was a significant predictor for regional venous perfusion assessed 1 month after RT (P<.00001). Global hypovenous perfusion pre-RT was observed in 4 patients (3 patients with hepatocellular carcinoma and cirrhosis), 3 of whom had recovered from hypoperfusion, except in the highest dose regions, post-RT. In addition, 3 patients who had normal perfusion pre-RT had marked hypervenous perfusion or reperfusion in low-dose regions post-RT. Conclusions: This study suggests that MR-based volumetric hepatic perfusion imaging may be a biomarker for spatial distribution of liver function, which could aid in individualizing therapy, particularly for patients at risk for liver injury after RT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Emotional and Behavioral Functioning After Conformal Radiation Therapy for Pediatric Ependymoma

Purpose: The standard of care for pediatric patients with ependymoma involves postoperative radiation therapy. Prior research suggests that conformal radiation therapy (CRT) is associated with relative sparing of cognitive and academic functioning, but little is known about the effect of CRT on emotional and behavioral functioning. Methods and Materials: A total of 113 patients with pediatric ependymoma underwent CRT using photons as part of their enrollment on an institutional trial. Patients completed annual evaluations of neurocognitive functioning during the first 5 years after CRT. Emotional and behavioral functioning was assessed via the Child Behavior Checklist. Results: Before CRT, emotional and behavioral functioning were commensurate with those of the normative population and within normal limits. After 5 years, means remained within normal limits but were significantly below the normative mean. Linear mixed models revealed a significant increase in attention problems over time. These problems were associated with age at diagnosis/CRT, tumor location, and extent of resection. A higher-than-expected incidence of school problems was present at all assessment points after baseline. Conclusions: The use of photon CRT for ependymoma is associated with relatively stable emotional and behavioral functioning during the first 5 years after treatment. The exception is an increase in attention problems. Results suggest that intervening earlier in the survivorship period—during the first year posttreatment—may be beneficial.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Results of a Multi-institutional Phase 2 Clinical Trial for 4DCT-ventilation Functional Avoidance Thoracic Radiation Therapy

Radiation pneumonitis remains a major limitation in the radiation therapy treatment of patients with lung cancer. Functional avoidance radiation therapy uses functional imaging to reduce pulmonary toxic effects by designing radiation therapy plans that reduce doses to functional regions of the lung. Lung functional imaging has been developed that uses 4-dimensional computed tomography (4DCT) imaging to calculate 4DCT-based lung ventilation (4DCT-ventilation). A phase 2 multicenter study was initiated to evaluate 4DCT-ventilation functional avoidance radiation therapy. The study hypothesis was that functional avoidance radiation therapy could reduce the rate of grade ≥2 radiation pneumonitis to 12% compared with a 25% historical rate, with the trial being positive if ≤16.4% of patients experienced grade ≥2 pneumonitis.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Machine learning reveals sequence-function relationships in family 7 glycoside hydrolases

Family 7 glycoside hydrolases (GH7) are among the principal enzymes for cellulose degradation in nature and industrially. These important enzymes are often bimodular, including a catalytic domain and carbohydrate binding module (CBM) attached via a flexible linker, and exhibit an active site that binds cello-oligomers of up to ten glucosyl moieties. GH7 cellulases consist of two major subtypes: cellobiohydrolases (CBH) and endoglucanases (EG). Despite the critical importance of GH7 enzymes, there remain gaps in our understanding of how GH7 sequence and structure relate to function. Here, we employed machine learning to gain data-driven insights into relationships between sequence, structure, and function across the GH7 family. Machine-learning models, trained only on the number of residues in the active-site loops as features, were able discriminate GH7 CBHs and EGs with up to 99% accuracy, demonstrating that the lengths of loops A4, B2, B3, and B4 strongly correlate with functional subtype across the GH7 family. Classification rules were derived such that specific residues at 42 different sequence positions each predicted the functional subtype with accuracies surpassing 87%. A random forest model trained on residues at 19 positions in the catalytic domain predicted the presence of a CBM with 89.5% accuracy. Our ML results recapitulate, as top-performing features, a substantial number of the sequence positions determined by previous experimental studies to play vital roles in GH7 activity. We surmise that the yet-to-be-explored sequence positions among the top-performing features also contribute to GH7 functional variation and may be exploited to understand and manipulate function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

Anti-symmetric barron functions and their approximation with sums of determinants

A fundamental problem in quantum physics is to encode functions that are completely anti-symmetric under permutations of identical particles. The architecture of neural network models for the electron wave function typically comprises an equivariant component followed by a summation of determinants. The recently introduced Generic Antisymmetric (GA) block is designed to enhance the expressivity of such neural wave functions, and it was found that the 2-layer GA block achieved more accurate energies than the corresponding single-determinant FermiNet architecure, suggesting its promise as a way to improve the expressivity of neural wave functions. In this paper we show how the function expressed by the 2-layer GA block can be decomposed into a sum of determinants. We formalize this result by defining the antisymmetric Barron space as a generalized version of the 2-layer GA block and providing an appromation theorem for this function class. This result can be viewed as a negative result showing that the 2-layer GA block is not more expressive than using multiple determinants.

Abrahamsen, Nilin↗