Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “layered networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Effective cosmic density field reconstruction with convolutional neural network

ABSTRACT We present a cosmic density field reconstruction method that augments the traditional reconstruction algorithms with a convolutional neural network (CNN). Following previous work, the key component of our method is to use the reconstructed density field as the input to the neural network. We extend this previous work by exploring how the performance of these reconstruction ideas depends on the input reconstruction algorithm, the reconstruction parameters, and the shot noise of the density field, as well as the robustness of the method. We build an eight-layer CNN and train the network with reconstructed density fields computed from the Quijote suite of simulations. The reconstructed density fields are generated by both the standard algorithm and a new iterative algorithm. In real space at z = 0, we find that the reconstructed field is 90 per cent correlated with the true initial density out to $k\sim 0.5 \, \mathrm{ h}\, \rm {Mpc}^{-1}$, a significant improvement over $k\sim 0.2 \, \mathrm{ h}\, \rm {Mpc}^{-1}$ achieved by the input reconstruction algorithms. We find similar improvements in redshift space, including an improved removal of redshift space distortions at small scales. We also find that the method is robust across changes in cosmology. Additionally, the CNN removes much of the variance from the choice of different reconstruction algorithms and reconstruction parameters. However, the effectiveness decreases with increasing shot noise, suggesting that such an approach is best suited to high density samples. This work highlights the additional information in the density field beyond linear scales as well as the power of complementing traditional analysis approaches with machine learning techniques.

Astronomy & Astrophysics↗

Search Tree Pruning for Progressive Neural Architecture Search

Our neural architecture search algorithm progressively searches a tree of neural network architectures. Child nodes are created by inserting new layers determined by a transition graph into a parent network up to a maximum depth and pruned when performance is worse than its parent. This increases efficiency but makes the algorithm greedy. Simpler networks are successfully found before more complex ones that can achieve benchmark performance similar to other top-performing networks.

Deanna Flynn↗

Quantum oscillations from networked topological interfaces in a Weyl semimetal

Layered transition metal chalcogenides are promising hosts of electronic Weyl nodes and topological superconductivity. MoTe 2 is a striking example that harbors both noncentrosymmetric T d and centrosymmetric T’ phases, both of which have been identified as topologically nontrivial. Applied pressure tunes the structural transition separating these phases to zero temperature, stabilizing a mixed T d –T’ matrix that entails a network of interfaces between the two nontrivial topological phases. Here, we show that this critical pressure range is characterized by distinct coherent quantum oscillations, indicating that the difference in topology between topologically nonvtrivial T d and T’ phases gives rise to an emergent electronic structure: a network of topological interfaces. A rare combination of topologically nontrivial electronic structures and locked-in transformation barriers leads to this counterintuitive situation, wherein quantum oscillations can be observed in a structurally inhomogeneous material. These results further open the possibility of stabilizing multiple topological phases coexisting with superconductivity.

36 MATERIALS SCIENCE↗

Neural Network and Response Surface Methodology for Rocket Engine Component Optimization

The goal of this work is to compare the performance of response surface methodology (RSM) and two types of neural networks (NN) to aid preliminary design of two rocket engine components. A data set of 45 training points and 20 test points obtained from a semi-empirical model based on three design variables is used for a shear coaxial injector element. Data for supersonic turbine design is based on six design variables, 76 training, data and 18 test data obtained from simplified aerodynamic analysis. Several RS and NN are first constructed using the training data. The test data are then employed to select the best RS or NN. Quadratic and cubic response surfaces. radial basis neural network (RBNN) and back-propagation neural network (BPNN) are compared. Two-layered RBNN are generated using two different training algorithms, namely solverbe and solverb. A two layered BPNN is generated with Tan-Sigmoid transfer function. Various issues related to the training of the neural networks are addressed including number of neurons, error goals, spread constants and the accuracy of different models in representing the design space. A search for the optimum design is carried out using a standard gradient-based optimization algorithm over the response surfaces represented by the polynomials and trained neural networks. Usually a cubic polynominal performs better than the quadratic polynomial but exceptions have been noticed. Among the NN choices, the RBNN designed using solverb yields more consistent performance for both engine components considered. The training of RBNN is easier as it requires linear regression. This coupled with the consistency in performance promise the possibility of it being used as an optimization strategy for engineering design problems.

Vaidyanathan, Rajkumar↗

Discontinuous Inter-Granular Separations (DIGS) in the Gas Nitride Layer of ISS Race Rings

The starboard solar alpha rotary joint (SARJ) race ring on the International space station (ISS) failed due to severe spalling of the outer diameter, 45 degree (outer canted) nitrided surface. Subsequent analysis at NASA-KSC revealed that almost all of the debris generated due to the failure was nitrided 15-5 stainless steel. Subsequent analysis of the nitride control coupons (NCC) at NASA-JSC revealed the presence of discontinuous inter-granular separations (DIGS) in the gas nitride layer. These DIGS were present in the inter-granular networking located in the top 2 mils of the nitride layer. The manufacturer's specification requires the maximum white structure to be 0.0003 inches and intergranular networking below the allowable white structure depth to be cause for rejection; a requirement that the NCCs did not meet. Subsequent testing and analysis revealed that lower DIGS content significantly lowered the probability of nitride spalling in simulated, dry condition runs. One batch of nitride samples with DIGS content similar to the port SARJ (did not fail on orbit) which exhibited almost no nitride spalling after being run on one test rig. Another batch of nitride samples with DIGS content levels similar to the starboard SARJ exhibited significant nitride spalling on the same test rig with the same load under dry conditions. Although DIGS were not the root cause of starboard race ring failure, testing indicates that increased DIGS reduced the robustness of the gas nitride layer under dry operating conditions.

Figert, John↗

Structural differences between human and mouse neurons and their implementation in generative AIs

Mouse and human brains have different functions that depend on their neuronal networks. We analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. We implemented these characteristics of mouse neurons in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, birds, and automobiles. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the five datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.

generative AI↗

Hypergravity Loading the Cultured Osteoblasts: Modeling and Experimental Analysis of Cellular Morphology and the Cytoskeleton

Bone forming cells, osteoblasts, respond to various mechanical forces, including mechanical strain and fluid-induced shear stress. This study examined whether osteoblasts detect changes in gravity as a mechanical force, as assessed by cellular morphology and dimensions of the cytoskeletal network. We used modeling to evaluate how gravity influences cell morphology given theoretical differences in densities between the surrounding medium, cytoplasm, and nucleus. A mechanical model was built based on analysis of axisymmetric shell structures (Fast4 software) to study the effects of 10 times gravity (10G) on cell height. The model indicated 0.02% decrease in overall cell height when the medium was 10% denser than the nucleus or cytoplasm, 5.9 x 10(exp-5)% decrease when the nucleus was 10% denser than the cytoplasm or medium, and 1.3 x 10(exp-5)% decrease when the cell cytoplasm was 10% denser than the nucleus or medium. To experimentally evaluate the influence of gravity, cultured primary fetal rat osteoblasts were grown to near confluence and centrifuged at 10G for 3 hours. Actin, microtubules, and nuclei were fluorescently labeled and analyzed by confocal microscopy to determine overall microtubule and actin network height. Centrifugation led to an apparent reduction in height of both the microtubule (-16%) and the actin (-20%) networks relative to stationary controls. Thus, both modeling and experiments indicate that hypergravity reduces the height of the osteoblast cell layer and their microtubule and actin networks. This combination of modeling and experimental analyses will help us to better understand the mechanical loading of osteoblasts.

Searby, N. D.↗

Integrated RF/Optical Interplanetary Networking Preliminary Explorations and Empirical Results

Over the last decade interplanetary telecommunication capabilities have been significantly expanded--specifically in support of the Mars exploration rover and lander missions. NASA is continuing to drive advances in new, high payoff optical communications technologies to enhance the network to Gbps performance from Mars, and the transition from technology demonstration to operational system is examined through a hybrid RF/optical approach. Such a system combines the best features of RF and optical communications considering availability and performance to realize a dual band trunk line operating within characteristic constraints. Disconnection due to planetary obscuration and solar conjunction, link delays, timing, ground terminal mission congestion and scheduling policy along with space and atmospheric weather disruptions all imply the need for network protocol solutions to ultimately manage the physical layer in a transparent manner to the end user. Delay Tolerant Networking (DTN) is an approach under evaluation which addresses these challenges. A multi-hop multi-path hybrid RF and optical test bed has been constructed to emulate the integrated deep space network and to support protocol and hardware refinement. Initial experimental results characterize several of these challenges and evaluate the effectiveness of DTN as a solution to mitigate them.

Raible, Daniel E.↗

A Space Operations Network Alternative: Using Globally Connected Research and Education Networks for Space-Based Science Operations

Earth based networking in support of various space agency projects has been based on leased service/circuits which has a high associated cost. This cost is almost always taken from the science side resulting in less science. This is a proposal to use Research and Education Networks (RENs) worldwide to support space flight operations in general and space-based science operations in particular. The RENs were developed to support scientific and educational endeavors. They do not provide support for general Internet traffic. The connectivity and performance of the research and education networks is superb. The connectivity at Layer 3 (IP) virtually encompasses the globe. Most third world countries and all developed countries have their own research and education networks, which are connected globally. Performance of the RENs especially in the developed countries is exceptional. Bandwidth capacity currently exists and future expansion promises that this capacity will continue. REN performance statistics has always exceeded minimum requirements for spaceflight support. Research and Education networks are more loosely managed than a corporate network but are highly managed when compared to the commodity Internet. Management of RENs on an international level is accomplished by the International Network Operations Center at Indiana University at Indianapolis. With few exceptions, each regional and national REN has its own network ops center. The acceptable use policies (AUP), although differing by country, allows any scientific program or project the use of their networks. Once in compliance with the first RENs AUP, all others will accept that specific traffic including regional and transoceanic networks. RENs can support spaceflight related scientific programs and projects. Getting the science to the researcher is obviously key to any scientific project. RENs provide a pathway to virtually any college or university in the world, as well as many governmental institutes and science centers. RENs are not to be used for mission critical types of network traffic, even though RENs performance characteristics would support it.

Bradford, Robert N.↗

Novel Class of Rhenium Borides Based on Hexagonal Boron Networks Interconnected by Short B 2 Dumbbells

Transition metal borides are known due to their attractive mechanical, electronic, refractive, and other properties. A new class of rhenium borides was identified by synchrotron single-crystal X-ray diffraction experiments in laser-heated diamond anvil cells between 26 and 75 GPa. Recoverable to ambient conditions, compounds rhenium triboride (ReB 3 ) and rhenium tetraboride (ReB 4 ) consist of close-packed single layers of rhenium atoms alternating with boron networks built from puckered hexagonal layers, which link short bonded (~ 1.7 angstrom) axially oriented B 2 dumbbells. The short and incompressible Re-B and B-B bonds oriented along the hexagonal c-axis contribute to low axial compressibility comparable with the linear compressibility of diamond. Sub-millimeter samples of ReB 3 and ReB 4 were synthesized in a large-volume press at pressures as low as 33 GPa and used for material characterization. Crystals of both compounds are metallic and hard (Vickers hardness, H V = 34(3) GPa). Geometrical, crystal-chemical, and theoretical analysis considerations suggest that potential ReB x compounds with x > 4 can be based on the same principle of structural organization as in ReB 3 and ReB 4 and possess similar mechanical and electronic properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The NIST Real-Time Control System (RCS): A Reference Model Architecture for Computational Intelligence

The Real-time Control System (RCS) developed at NIST and elsewhere over the past two decades defines a reference model architecture for design and analysis of complex intelligent control systems. The RCS architecture consists of a hierarchically layered set of functional processing modules connected by a network of communication pathways. The primary distinguishing feature of the layers is the bandwidth of the control loops. The characteristic bandwidth of each level is determined by the spatial and temporal integration window of filters, the temporal frequency of signals and events, the spatial frequency of patterns, and the planning horizon and granularity of the planners that operate at each level. At each level, tasks are decomposed into sequential subtasks, to be performed by cooperating sets of subordinate agents. At each level, signals from sensors are filtered and correlated with spatial and temporal features that are relevant to the control function being implemented at that level.

Albus, James S.↗

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Here, we use Gaussian stochastic weight averaging (SWAG) to assess the epistemic uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the 'mean estimation', whereas its standard deviation can be used to construct 'confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of epistemic uncertainty. This capability supports its use for a wide range of problems in science and engineering.

97 MATHEMATICS AND COMPUTING↗

Improving deep learning model performance under parametric constraints for materials informatics applications

Abstract Modern machine learning (ML) and deep learning (DL) techniques using high-dimensional data representations have helped accelerate the materials discovery process by efficiently detecting hidden patterns in existing datasets and linking input representations to output properties for a better understanding of the scientific phenomenon. While a deep neural network comprised of fully connected layers has been widely used for materials property prediction, simply creating a deeper model with a large number of layers often faces with vanishing gradient problem, causing a degradation in the performance, thereby limiting usage. In this paper, we study and propose architectural principles to address the question of improving the performance of model training and inference under fixed parametric constraints. Here, we present a general deep-learning framework based on branched residual learning (BRNet) with fully connected layers that can work with any numerical vector-based representation as input to build accurate models to predict materials properties. We perform model training for materials properties using numerical vectors representing different composition-based attributes of the respective materials and compare the performance of the proposed models against traditional ML and existing DL architectures. We find that the proposed models are significantly more accurate than the ML/DL models for all data sizes by using different composition-based attributes as input. Further, branched learning requires fewer parameters and results in faster model training due to better convergence during the training phase than existing neural networks, thereby efficiently building accurate models for predicting materials properties.

36 MATERIALS SCIENCE↗

Hybrid Piezoelectric/Fiber-Optic Sensor Sheets

Hybrid piezoelectric/fiber-optic (HyPFO) sensor sheets are undergoing development. They are intended for use in nondestructive evaluation and long-term monitoring of the integrity of diverse structures, including aerospace, aeronautical, automotive, and large stationary ones. It is anticipated that the further development and subsequent commercialization of the HyPFO sensor systems will lead to economic benefits in the form of increased safety, reduction of life-cycle costs through real-time structural monitoring, increased structural reliability, reduction of maintenance costs, and increased readiness for service. The concept of a HyPFO sensor sheet is a generalization of the concept of a SMART Layer(TradeMark), which is a patented device that comprises a thin dielectric film containing an embedded network of distributed piezoelectric actuator/sensors. Such a device can be mounted on the surface of a metallic structure or embedded inside a composite-material structure during fabrication of the structure. There is has been substantial interest in incorporating sensors other than piezoelectric ones into SMART Layer(TradeMark) networks: in particular, because of the popularity of the use of fiber-optic sensors for monitoring the "health" of structures in recent years, it was decided to incorporate fiber-optic sensors, giving rise to the concept of HyPFO devices.

Lin, Mark↗

First Impressions: Early-time Classification of Supernovae Using Host-galaxy Information and Shallow Learning

Substantial effort has been devoted to the characterization of transient phenomena from photometric information. Automated approaches to this problem have taken advantage of complete phase coverage of an event, limiting their use for triggering rapid follow-up of ongoing phenomena. In this work, we introduce a neural network with a single recurrent layer designed explicitly for early photometric classification of supernovae (SNe). Our algorithm leverages transfer learning to account for model misspecification, host-galaxy photometry to solve the data-scarcity problem soon after discovery, and a custom weighted loss to prioritize accurate early classification. We first train our algorithm using state-of-the-art transient and host-galaxy simulations, then adapt its weights and validate it on the spectroscopically confirmed SNe Ia, SNe II, and SNe Ib/c from the Zwicky Transient Facility Bright Transient Survey. On observed data, our method achieves an overall accuracy of 82% ± 2% within 3 days of an event’s discovery, and an accuracy of 87% ± 5% within 30 days of discovery. At both early and late phases, our method achieves comparable or superior results to the leading classification algorithms with a simpler network architecture. These results help pave the way for rapid photometric and spectroscopic follow-up of scientifically valuable transients discovered in massive synoptic surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Method for fabricating solar cells having integrated collector grids

A heterojunction or Schottky barrier photovoltaic device comprising a conductive base metal layer compatible with and coating predominately the exposed surface of the p-type substrate of the device such that a back surface field region is formed at the interface between the device and the base metal layer, a transparent, conductive mixed metal oxide layer in integral contact with the n-type layer of the heterojunction or Schottky barrier device having a metal alloy grid network of the same metal elements of the oxide constituents of the mixed metal oxide layer embedded in the mixed metal oxide layer, an insulating layer which prevents electrical contact between the conductive metal base layer and the transparent, conductive metal oxide layer, and a metal contact means covering the insulating layer and in intimate contact with the metal grid network embedded in the transparent, conductive oxide layer for conducting electrons generated by the photovoltaic process from the device.

Evans, J. C., Jr.↗

Deep Learning Based Workflow for Accelerated Industrial X-Ray Computed Tomography

X-ray computed tomography (XCT) is an important tool for high-resolution non-destructive characterization of additively-manufactured metal components. XCT reconstructions of metal components may have beam hardening artifacts such as cupping and streaking which makes reliable detection of flaws and defects challenging. Furthermore, traditional workflows based on using analytic reconstruction algorithms require a large number of projections for accurate characterization - leading to longer measurement times and hindering the adoption of XCT for in-line inspections. In this paper, we introduce a new workflow based on the use of two neural networks to obtain high-quality accelerated reconstructions from sparse-view XCT scans of single material metal parts. The first network, implemented using fully-connected layers, helps reduce the impact of BH in the projection data without the need of any calibration or knowledge of the component material. The second network, a convolutional neural network, maps a low-quality analytic 3D reconstruction to a high-quality reconstruction. Using experimental data, we demonstrate that our method robustly generalizes across several alloys, and for a range of sparsity levels without any need for retraining the networks thereby enabling accurate and fast industrial XCT inspections.

Rahman, Obaid↗

Integration of the White Sands Complex into a Wide Area Network

The NASA White Sands Complex (WSC) satellite communications facility consists of two main ground stations, an auxiliary ground station, a technical support facility, and a power plant building located on White Sands Missile Range. When constructed, terrestrial communication access to these facilities was limited to copper telephone circuits. There was no local or wide area communications network capability. This project incorporated a baseband local area network (LAN) topology at WSC and connected it to NASA's wide area network using the Program Support Communications Network-Internet (PSCN-I). A campus-style LAN is configured in conformance with the International Standards Organization (ISO) Open Systems Interconnect (ISO) model. Ethernet provides the physical and data link layers. Transmission Control Protocol and Internet Protocol (TCP/IP) are used for the network and transport layers. The session, presentation, and application layers employ commercial software packages. Copper-based Ethernet collision domains are constructed in each of the primary facilities and these are interconnected by routers over optical fiber links. The network and each of its collision domains are shown to meet IEEE technical configuration guidelines. The optical fiber links are analyzed for the optical power budget and bandwidth allocation and are found to provide sufficient margin for this application. Personal computers and work stations attached to the LAN communicate with and apply a wide variety of local and remote administrative software tools. The Internet connection provides wide area network (WAN) electronic access to other NASA centers and the world wide web (WWW). The WSC network reduces and simplifies the administrative workload while providing enhanced and advanced inter-communications capabilities among White Sands Complex departments and with other NASA centers.

Boucher, Phillip Larry↗