Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Ice-VII inclusions in diamonds: Evidence for aqueous fluid in Earth’s deep mantle

Water-rich regions in Earth’s deeper mantle are suspected to play a key role in the global water budget and the mobility of heat-generating elements. Here, we show that ice-VII occurs as inclusions in natural diamond and serves as an indicator for such water-rich regions. Ice-VII, the residue of aqueous fluid present during growth of diamond, crystallizes upon ascent of the host diamonds but remains at pressures as high as 24 gigapascals; it is now recognized as a mineral by the International Mineralogical Association. In particular, ice-VII in diamonds points toward fluid-rich locations in the upper transition zone and around the 660-kilometer boundary.

58 GEOSCIENCES↗
DOE OSTI2020

Prediction of histone post-translational modifications using deep learning

Abstract Motivation Histone post-translational modifications (PTMs) are involved in a variety of essential regulatory processes in the cell, including transcription control. Recent studies have shown that histone PTMs can be accurately predicted from the knowledge of transcription factor binding or DNase hypersensitivity data. Similarly, it has been shown that one can predict PTMs from the underlying DNA primary sequence. Results In this study, we introduce a deep learning architecture called DeepPTM for predicting histone PTMs from transcription factor binding data and the primary DNA sequence. Extensive experimental results show that our deep learning model outperforms the prediction accuracy of the model proposed in Benveniste et al. (PNAS 2014) and DeepHistone (BMC Genomics 2019). The competitive advantage of our framework lies in the synergistic use of deep learning combined with an effective pre-processing step. Our classification framework has also enabled the discovery that the knowledge of a small subset of transcription factors (which are histone-PTM and cell-type-specific) can provide almost the same prediction accuracy that can be obtained using all the transcription factors data. Availabilityand implementation https://github.com/dDipankar/DeepPTM. Supplementary information Supplementary data are available at Bioinformatics online.

Baisya, Dipankar Ranjan (ORCID:0000000267847359)↗
DOE OSTI2021

Where’s Swimmy?: Mining unique color features buried in galaxies by deep anomaly detection using Subaru Hyper Suprime-Cam data

Abstract We present the Swimmy (Subaru WIde-field Machine-learning anoMalY) survey program, a deep-learning-based search for unique sources using multicolored (grizy) imaging data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). This program aims to detect unexpected, novel, and rare populations and phenomena, by utilizing the deep imaging data acquired from the wide-field coverage of the HSC-SSP. This article, as the first paper in the Swimmy series, describes an anomaly detection technique to select unique populations as “outliers” from the data-set. The model was tested with known extreme emission-line galaxies (XELGs) and quasars, which consequently confirmed that the proposed method successfully selected $\sim\!\! 60\%$–$70\%$ of the quasars and $60\%$ of the XELGs without labeled training data. In reference to the spectral information of local galaxies at z = 0.05–0.2 obtained from the Sloan Digital Sky Survey, we investigated the physical properties of the selected anomalies and compared them based on the significance of their outlier values. The results revealed that XELGs constitute notable fractions of the most anomalous galaxies, and certain galaxies manifest unique morphological features. In summary, deep anomaly detection is an effective tool that can search rare objects, and, ultimately, unknown unknowns with large data-sets. Further development of the proposed model and selection process can promote the practical applications required to achieve specific scientific goals.

Astronomy & Astrophysics↗
DOE OSTI2021

DeepLearnMOR: a deep-learning framework for fluorescence image-based classification of organelle morphology

Abstract The proper biogenesis, morphogenesis, and dynamics of subcellular organelles are essential to their metabolic functions. Conventional techniques for identifying, classifying, and quantifying abnormalities in organelle morphology are largely manual and time-consuming, and require specific expertise. Deep learning has the potential to revolutionize image-based screens by greatly improving their scope, speed, and efficiency. Here, we used transfer learning and a convolutional neural network (CNN) to analyze over 47,000 confocal microscopy images from Arabidopsis wild-type and mutant plants with abnormal division of one of three essential energy organelles: chloroplasts, mitochondria, or peroxisomes. We have built a deep-learning framework, DeepLearnMOR (Deep Learning of the Morphology of Organelles), which can rapidly classify image categories and identify abnormalities in organelle morphology with over 97% accuracy. Feature visualization analysis identified important features used by the CNN to predict morphological abnormalities, and visual clues helped to better understand the decision-making process, thereby validating the reliability and interpretability of the neural network. This framework establishes a foundation for future larger-scale research with broader scopes and greater data set diversity and heterogeneity.

Plant Sciences↗
NASA NTRS2013

SEDS: The Spitzer Extended Deep Survey. Survey Design, Photometry, and Deep IRAC Source Counts

The Spitzer Extended Deep Survey (SEDS) is a very deep infrared survey within five well-known extragalactic science fields: the UKIDSS Ultra-Deep Survey, the Extended Chandra Deep Field South, COSMOS, the Hubble Deep Field North, and the Extended Groth Strip. SEDS covers a total area of 1.46 deg(exp 2) to a depth of 26 AB mag (3sigma) in both of the warm Infrared Array Camera (IRAC) bands at 3.6 and 4.5 micron. Because of its uniform depth of coverage in so many widely-separated fields, SEDS is subject to roughly 25% smaller errors due to cosmic variance than a single-field survey of the same size. SEDS was designed to detect and characterize galaxies from intermediate to high redshifts (z = 2-7) with a built-in means of assessing the impact of cosmic variance on the individual fields. Because the full SEDS depth was accumulated in at least three separate visits to each field, typically with six-month intervals between visits, SEDS also furnishes an opportunity to assess the infrared variability of faint objects. This paper describes the SEDS survey design, processing, and publicly-available data products. Deep IRAC counts for the more than 300,000 galaxies detected by SEDS are consistent with models based on known galaxy populations. Discrete IRAC sources contribute 5.6 +/- 1.0 and 4.4 +/- 0.8 nW / square m/sr at 3.6 and 4.5 micron to the diffuse cosmic infrared background (CIB). IRAC sources cannot contribute more than half of the total CIB flux estimated from DIRBE data. Barring an unexpected error in the DIRBE flux estimates, half the CIB flux must therefore come from a diffuse component.

Spitzer↗
DOE OSTI2022

Deep Neural Network High Spatiotemporal Resolution Precipitation Estimation (Deep-STEP) Using Passive Microwave and Infrared Data

Recent developments in “headline-making” deep neural networks (DNNs), specifically convolutional neural networks (CNNs), along with advancements in computational power, open great opportunities to integrate massive amounts of real-time observations to characterize spatiotemporal structures of surface precipitation. This study aims to develop a CNN algorithm, named Deep Neural Network High Spatiotemporal Resolution Precipitation Estimation (Deep-STEP), that ingests direct satellite passive microwave (PMW) brightness temperatures (Tbs) at emission and scattering frequencies combined with infrared (IR) Tbs from geostationary satellites and surface information to automatically extract geospatial features related to the precipitable clouds. These features allow the end-to-end Deep-STEP algorithm to instantaneously map surface precipitation intensities with a spatial resolution of 4 km. The main advantages of Deep-STEP, as compared to current state-of-the-art techniques, are 1) it learns and estimates complex precipitation systems directly from raw measurements in near–real time, 2) it uses the automatic spatial neighborhood feature extraction approach, and 3) it fuses coarse-resolution PMW footprints with IR images to reliably retrieve surface precipitation at a high spatial resolution. We anticipate our proposed DNN algorithm to be a starting point for more sophisticated and efficient precipitation retrieval systems in terms of accuracy, fine spatial pattern detection skills, and computational costs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Seasonal variation of shallow-to-deep convection transition and its link to the environmental conditions over the Central Amazon: Shallow-to-Deep Convection Transition

This study aims to characterize the seasonal variation of the shallow-to-deep convection transition and understand how environmental conditions impact the behavior of this transition using data collected from the Observations and Modeling of the Green Ocean Amazon (GOAmazon) field campaign in the Central Amazon (Manaus). The diurnal cycle of the rain/cloud fraction shows that the wet season has more extensive shallow convection before the transition to deep convection with larger fractional coverage and rainfall; deep convection in the transition season is more intense and has higher vertical extension and a stronger updraft. Surface meteorology, atmospheric moisture, instability, and wind shear are contrasted for the shallow/congestus convection (SC) cases and the locally formed shallow-to-deep convection transition (LD) cases. The comparisons suggest that occurrence of the LD is generally promoted under the conditions of high atmospheric moisture and instability but has a weaker dependence on wind shear. The relative importance of these environmental controls also varies in different seasons: The dry and transition seasons require a deeper moist layer from the boundary layer to midtroposphere than the wet season; convective available potential energy (CAPE) is higher during the transition season, but it is a less important factor for shallow-to-deep convection transition than in other seasons; LD only has significantly larger wind shears than SC during the dry season.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Evolving Deep Networks Using HPC

While a large number of deep learning networks have been studiedand published that produce outstanding results on natural imagedatasets, these datasets only make up a fraction of those to whichdeep learning can be applied. These datasets include text data, audiodata, and arrays of sensors that have very different characteristicsthan natural images. As these “best” networks for natural imageshave been largely discovered through experimentation and cannotbe proven optimal on some theoretical basis, there is no reasonto believe that they are the optimal network for these drasticallydifferent datasets. Hyperparameter search is thus often a very im-portant process when applying deep learning to a new problem. Inthis work we present an evolutionary approach to searching thepossible space of network hyperparameters and construction thatcan scale to 18, 000 nodes. This approach is applied to datasets ofvarying types and characteristics where we demonstrate the abilityto rapidly find best hyperparameters in order to enable practitionersto quickly iterate between idea and result.

Young, Steven↗
NASA NTRS1999

The Future of the Deep Space Network: Technology Development for K2-Band Deep Space Communications

Projections indicate that in the future the number of NASA's robotic deep space missions is likely to increase significantly. A launch rate of up to 4-6 launches per year is projected with up to 25 simultaneous missions active [I]. Future high resolution mapping missions to other planetary bodies as well as other experiments are likely to require increased downlink capacity. These future deep space communications requirements will, according to baseline loading analysis, exceed the capacity of NASA's Deep Space Network in its present form. There are essentially two approaches for increasing the channel capacity of the Deep Space Network. Given the near-optimum performance of the network at the two deep space communications bands, S-Band (uplink 2.025-2.120 GHz, downlink 2.2-2.3 GHz), and X-Band (uplink 7.145-7.19 GHz, downlink 8.48.5 GHz), additional improvements bring only marginal return for the investment. Thus the only way to increase channel capacity is simply to construct more antennas, receivers, transmitters and other hardware. This approach is relatively low-risk but involves increasing both the number of assets in the network and operational costs.

Bhanji, Alaudin M.↗
NASA NTRS2020

Results of the Deep Space Atomic Clock Deep Space Navigation Analog Experiment

The timing and frequency stability provided by the Deep Space Atomic Clock (DSAC) is almost comparable with the Deep Space Network’s ground clocks, and will enable one-way radiometric measurements with accuracy equivalent to cur- rent two-way tracking data. A demonstration unit of the clock was launched into low Earth orbit on June 25, 2019, for the purpose of validating DSAC’s perfor- mance in the space environment. GPS data collected throughout the mission was utilized not only for precise clock estimation, but also as a proxy for deep space tracking data to conduct the Deep Space Navigation Analog Experiment. Through careful processing of GPS Doppler data and limited modeling fidelity representa- tive of deep space navigation capabilities, the analog orbit solutions are compared to higher-fidelity solutions, demonstrating DSAC’s viability as a navigation instru- ment in conditions typical for a low altitude Mars orbiter.

Stuart, Jeffrey↗
DOE OSTI2016

Neurogenesis Deep Learning: Extending deep networks to accommodate new classes

Neural machine learning methods, such as deep neural networks (DNN), have achieved remarkable success in a number of complex data processing tasks. These methods have arguably had their strongest impact on tasks such as image and audio processing – data processing domains in which humans have long held clear advantages over conventional algorithms. In contrast to biological neural systems, which are capable of learning continuously, deep artificial networks have a limited ability for incorporating new information in an already trained network. As a result, methods for continuous learning are potentially highly impactful in enabling the application of deep networks to dynamic data sets. Here, inspired by the process of adult neurogenesis in the hippocampus, we explore the potential for adding new neurons to deep layers of artificial neural networks in order to facilitate their acquisition of novel information while preserving previously trained data representations. Our results on the MNIST handwritten digit dataset and the NIST SD 19 dataset, which includes lower and upper case letters and digits, demonstrate that neurogenesis is well suited for addressing the stability-plasticity dilemma that has long challenged adaptive machine learning algorithms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

Effect of Z{sub 1/2}, EH{sub 5}, and Ci1 deep defects on the performance of n-type 4H-SiC epitaxial layers Schottky detectors: Alpha spectroscopy and deep level transient spectroscopy studies

Spectroscopic performance of Schottky barrier alpha particle detectors fabricated on 50 μm thick n-type 4H-SiC epitaxial layers containing Z{sub 1/2}, EH{sub 5}, and Ci1 deep levels were investigated. The device performance was evaluated on the basis of junction current/capacitance characterization and alpha pulse-height spectroscopy. Capacitance mode deep level transient spectroscopy revealed the presence of the above-mentioned deep levels along with two shallow level defects related to titanium impurities (Ti(h) and Ti(c)) and an unidentified deep electron trap located at 2.4 eV below the conduction band minimum, which is being reported for the first time. The concentration of the lifetime killer Z{sub 1/2} defects was found to be 1.7 × 10{sup 13} cm{sup −3}. The charge transport and collection efficiency results obtained from the alpha particle pulse-height spectroscopy were interpreted using a drift-diffusion charge transport model. Based on these investigations, the physics behind the correlation of the detector properties viz., energy resolution and charge collection efficiency, the junction properties like uniformity in barrier-height, leakage current, and effective doping concentration, and the presence of defects has been discussed in details. The studies also revealed that the dominating contribution to the charge collection efficiency was due to the diffusion of charge carriers generated in the neutral region of the detector. The 10 mm{sup 2} large area detectors demonstrated an impressive energy resolution of 1.8% for 5486 keV alpha particles at an optimized operating reverse bias of 130 V.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Physics-Guided Deep Learning for Time-Series State Estimation Against False Data Injection Attacks

The modern power grid is a cyber-physical system. While the grid is becoming more intelligent with emerging sensing and communication techniques, new vulnerabilities are introduced and cyber security becomes a major concern. One type of cyber-attacks - False Data Injection Attacks (FDIAs) - exploits the limitations in traditional power system state estimation, and modifies system states without being detected. In this paper, we propose a physics-guided deep learning (PGDL) approach to defend against FDIAs. The PGDL takes real-time measurements as inputs to neural networks, outputs the estimated states, and reconstructs measurements considering power system physics. A deep recurrent neural network - Long Short-Term Memory (LSTM) - is employed to learn the temporal correlations among states. This hybrid learning model leads to a time-series state estimation method to defend against FDIAs. The simulation results using IEEE 14-bus test system demonstrate the accuracy and robustness of the proposed time-series state estimation under FDIAs.

Cyber security, state estimation, physics-guided d↗
DOE OSTI2017

Scaling Deep Learning on GPU and Knights Landing clusters

The speed of deep neural networks training has become a big bottleneck of deep learning research and development. For example, training GoogleNet by ImageNet dataset on one Nvidia K20 GPU needs 21 days. To speed up the training process, the current deep learning systems heavily rely on the hardware accelerators. However, these accelerators have limited on-chip memory compared with CPUs. To handle large datasets, they need to fetch data from either CPU memory or remote processors. We use both self-hosted Intel Knights Landing (KNL) clusters and multi-GPU clusters as our target platforms. From an algorithm aspect, current distributed machine learning systems are mainly designed for cloud systems. These methods are asynchronous because of the slow network and high fault-tolerance requirement on cloud systems. We focus on Elastic Averaging SGD (EASGD) to design algorithms for HPC clusters. Original EASGD used round-robin method for communication and updating. The communication is ordered by the machine rank ID, which is inefficient on HPC clusters. First, we redesign four efficient algorithms for HPC systems to improve EASGD's poor scaling on clusters. Async EASGD, Async MEASGD, and Hogwild EASGD are faster \textcolor{black}{than} their existing counterparts (Async SGD, Async MSGD, and Hogwild SGD, resp.) in all the comparisons. Finally, we design Sync EASGD, which ties for the best performance among all the methods while being deterministic. In addition to the algorithmic improvements, we use some system-algorithm codesign techniques to scale up the algorithms. By reducing the percentage of communication from 87% to 14%, our Sync EASGD achieves 5.3x speedup over original EASGD on the same platform. We get 91.5% weak scaling efficiency on 4253 KNL cores, which is higher than the state-of-the-art implementation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Degradation-related defect level in weathered silicon heterojunction modules characterized by deep level transient spectroscopy

Commercial silicon heterojunction photovoltaic modules, known as amorphous-silicon-based heterojunction with intrinsic thin-film layer (HIT) modules, show average degradation after 10 years in the field. HIT modules weathered outdoors in Colorado and Florida display mostly uniform decreases in intensity when mapped with photoluminescence (PL) imaging compared to a control module. Flash-table-based current-voltage curves show that degradation is dominated by voltage loss. Samples are cored from each of the modules, and deep level transient spectroscopy (DLTS) detects three electron-trap defect states in all modules with activation energies of electron emission from the defects of 0.07, 0.16, and 0.50 eV. DLTS measurements on the weathered modules show an additional deep-level, electron-trap defect state with an activation energy of 0.51 eV and a trap density of approximately 10 12 cm –3 . The capture rate is measured using varying short filling pulse times, and the resulting capture cross section is estimated to be 1.1x10 –16 cm 2 . The development of the weathering-related defect level correlates to decreases in carrier lifetime, PL intensity, and module voltage. Various depths of the space charge region are probed with increments in applied reverse bias and filling-pulse bias. Furthermore, this DLTS depth profiling shows a trend of trap density increasing with less applied reverse bias, suggesting that the weathering-related defect increases carrier recombination toward the interface between the bulk silicon wafer and the junction-forming amorphous-silicon passivation layers.

14 SOLAR ENERGY↗
DOE OSTI2018

Effects of Scavenging, Entrainment, and Aqueous Chemistry on Peroxides and Formaldehyde in Deep Convective Outflow Over the Central and Southeast United States

Deep convective transport of gaseous precursors to ozone (O3) and aerosols to the upper troposphere is affected by liquid phase and mixed-phase scavenging, entrainment of free tropospheric air and aqueous chemistry. The contributions of these processes are examined using aircraft measurements obtained in storm inflow and outflow during the 2012 Deep Convective Clouds and Chemistry (DC3) experiment combined with high-resolution (dx = 3 km) WRF-Chem simulations of a severe storm, an air mass storm, and a mesoscale convective system (MCS). The simulation results for the MCS suggest that formaldehyde (CH2O) is not retained in ice when cloud water freezes, in agreement with previous studies of the severe storm. By analyzing WRF-Chem trajectories, the effects of scavenging, entrainment, and aqueous chemistry on outflow mixing ratios of CH2O, methyl hydroperoxide (CH3OOH), and hydrogen peroxide (H2O2) are quantified. Liquid phase microphysical scavenging was the dominant process reducing CH2O and H2O2 outflow mixing ratios in all three storms. Aqueous chemistry did not significantly affect outflow mixing ratios of all three species. In the severe storm and MCS, the higher than expected reductions in CH3OOH mixing ratios in the storm cores were primarily due to entrainment of low-background CH3OOH. In the air mass storm, lower CH3OOH and H2O2 scavenging efficiencies (SEs) than in the MCS were partly due to entrainment of higher background CH3OOH and H2O2. Overestimated rain and hail production in WRF-Chem reduces the confidence in ice retention fraction values determined for the peroxides and CH2O.

Bela, Megan↗