Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Complex networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Full-field imaging learning machine (FILM)

A method of determining dynamic properties of a structure (linear or nonlinear) includes receiving spatio-temporal inputs, generating mode shapes and modal components corresponding to the spatio-temporal inputs using a trained deep complexity coding artificial neural network, and subsequently generating the dynamic properties by analyzing each modal component using a trained learning machine. A computing system for non-contact determination of dynamic properties of a structure includes a camera, a processor, and a memory including computer-executable instructions. When the instructions are executed, the system is caused to receive spatio-temporal image data, decompose the spatio-temporal image data into constituent manifold components using an autoencoder, and analyze the constituent manifold components using a trained learning machine to determine the dynamic properties.

Yang, Yongchao↗
DOE OSTI2024

Complexity-calibrated benchmarks for machine learning reveal when prediction algorithms succeed and mislead

Abstract Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a “next-generation” reservoir computer was introduced in which the memory trace involves only a finite number of previous symbols. We explore the inherent limitations of finite-past memory traces in this intriguing proposal. A lower bound from Fano’s inequality shows that, on highly non-Markovian processes generated by large probabilistic state machines, next-generation reservoir computers with reasonably long memory traces have an error probability that is at least $$\sim 60\%$$ ∼ 60 % higher than the minimal attainable error probability in predicting the next observation. More generally, it appears that popular recurrent neural networks fall far short of optimally predicting such complex processes. These results highlight the need for a new generation of optimized recurrent neural network architectures. Alongside this finding, we present concentration-of-measure results for randomly-generated but complex processes. One conclusion is that large probabilistic state machines—specifically, large $$\epsilon$$ ϵ -machines—are key to generating challenging and structurally-unbiased stimuli for ground-truthing recurrent neural network architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Quantum-inspired weight-constrained neural network: Reducing variable numbers by 100× compared to standard neural networks

Although quantum machine learning has shown great promise, the practical application of quantum computers remains constrained in the noisy intermediate-scale quantum era. To take advantage of quantum machine learning, we investigate the underlying mathematical principles of these quantum models and find that the quantum neural network with amplitude encoding is equivalent to a weight-constrained neural network. Motivated by this discovery, we develop a classical weight-constrained neural network. We find that this approach can reduce the number of variables in a classical neural network by a factor of 135 while preserving its accuracy. In addition, we develop a dropout method to enhance the robustness of quantum machine learning models, which are highly susceptible to adversarial attacks. This technique can also be applied to improve the adversarial robustness of the classical weight-constrained neural network, which is essential for industry applications, such as self-driving vehicles. Our work offers an approach to reduce the complexity of large classical neural networks, addressing a critical challenge in machine learning.

quantum algorithms & computation↗
DOE OSTI2022

Data-driven modeling of coarse mesh turbulence for reactor transient analysis using convolutional recurrent neural networks

Advanced nuclear reactors often exhibit complex thermal-fluid phenomena during transients. To accurately capture such phenomena, a coarse-mesh three-dimensional (3-D) modeling capability is desired for modern nuclear-system code. In the coarse-mesh 3-D modeling of advanced-reactor transients that involve flow and heat transfer, accurately predicting the turbulent viscosity is a challenging task that requires an accurate and computationally efficient model to capture the unresolved fine-scale turbulence. In this work, we propose a data-driven coarse-mesh turbulence model based on local flow features for the transient analysis of thermal mixing and stratification in a sodium-cooled fast reactor. The model has a coarse mesh setup to ensure computational efficiency, while it is trained by fine-mesh computational fluid dynamics (CFD) data to ensure accuracy. A novel neural network architecture, combining a densely connected convolutional network and a long-short-term-memory network, is developed that can efficiently learn from the spatial temporal CFD transient simulation results. The neural network model was trained and optimized on a loss-of flow transient and demonstrated high accuracy in predicting the turbulent viscosity field during the whole transient. The trained model's generalization capability was also investigated on two other transients with different inlet conditions. The study demonstrates the potential of applying the proposed data-driven approach to support the coarse-mesh multi-dimensional modeling of advanced reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2020

Search Tree Pruning for Progressive Neural Architecture Search

Our neural architecture search algorithm progressively searches a tree of neural network architectures. Child nodes are created by inserting new layers determined by a transition graph into a parent network up to a maximum depth and pruned when performance is worse than its parent. This increases efficiency but makes the algorithm greedy. Simpler networks are successfully found before more complex ones that can achieve benchmark performance similar to other top-performing networks.

Deanna Flynn↗
DOE OSTI2022

BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset

The BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset adds node-level energy consumption data from watt-meters to the primary sweep of the BUTTER - Empirical Deep Learning Dataset. This dataset contains energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network "shapes", and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects. BUTTER-E is intended to be joined with the BUTTER dataset (see "BUTTER - Empirical Deep Learning Dataset on OEDI" resource below) which characterizes the performance of 483k distinct fully connected neural networks but does not include energy measurements.

Array↗
DOE OSTI2022

Medial packing and elastic asymmetry stabilize the double-gyroid in block copolymers

Triply-periodic networks are among the most complex and functionally valuable self-assembled morphologies, yet they form in nearly every class of biological and synthetic soft matter building blocks. In contrast to simpler assembly motifs – spheres, cylinders, layers – networks require molecules to occupy variable local environments, confounding attempts to understand their formation. Here, we examine the double-gyroid network phase by using a geometric formulation of the strong stretching theory of block copolymer melts, a prototypical soft self-assembly system. The theory establishes the direct link between molecular packing, assembly thermodynamics and the medial map, a generic measure of the geometric center of complex shapes. We show that “medial packing” is essential for stability of double-gyroid in strongly-segregated melts, reconciling a long-standing contradiction between infinite- and finite-segregation theories. Additionally, we find a previously unrecognized non-monotonic dependence of network stability on the relative entropic elastic stiffness of matrix-forming to tubular-network forming blocks. The composition window of stable double-gyroid widens for both large and small elastic asymmetry, contradicting intuitive notions that packing frustration is localized to the tubular domains. This study demonstrates the utility of optimized medial tessellations for understanding soft-molecular assembly and packing frustration via an approach that is readily generalizable far beyond gyroids in neat block copolymers.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Softwarized Federations of Science Instruments with Edge-Continuum Containers

Significant expansion of capabilities of DOE science complex of supercomputers, instruments and networks is expected as powerful experimental facilities, exascale computers and terabit networks are added. Combined with the advances in edge and cloud computing technologies, DOE science users now have the promise of unprecedented execution of complex, continuum workflows, namely, small and latency-sensitive computations at the edge and site, massive computations at remote HPC systems, and everything in between on the cloud. But, bringing this capability to the science user requires overcoming the overwhelming complexity of forming the federations of systems, and efficiently and effectively orchestrating the workflows while ensuring high utilization of the expensive facilities. Current manual configuration of the federated systems simply will not scale, since the coordination across sites may take weeks to months, often leading to under-utilized and hard-to-diagnose compositions. A powerful, composable software stack will be developed to (i) wrap the systems so that federations can be composed fast in software, and (ii) containerize computations to be orchestrated across the edge, site, cloud and HPC resources.

Rao, Nageswara S.↗
DOE OSTI2022

Netostat: analyzing dynamic flow patterns in high-speed networks

Understanding flow traffic patterns in networks, such as the Internet or service provider networks, is crucial to improving their design and building them robustly. However, as networks grow and become more complex, it is increasingly cumbersome and challenging to study how the many flow patterns, sizes and the continually changing source-destination pairs in the network evolve with time. Here, we present Netostat, a visualization-based network analysis tool that uses visual representation and a mathematics framework to study and capture flow patterns, using graph theoretical methods such as clustering, similarity and difference measures. Netostat generates an interactive graph of all traffic patterns in the network, to isolate key elements that can provide insights for traffic engineering. We present results for U.S. and European research networks, ESnet and GEANT, demonstrating network state changes, to identify major flow trends, potential points of failure, and bottlenecks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Xylem network connectivity and embolism spread in grapevine( Vitis vinifera L.)

Abstract Xylem networks are vulnerable to the formation and spread of gas embolisms that reduce water transport. Embolisms spread through interconduit pits, but the three-dimensional (3D) complexity and scale of xylem networks means that the functional implications of intervessel connections are not well understood. Here, xylem networks of grapevine (Vitis vinifera L.) were reconstructed from 3D high-resolution X-ray micro-computed tomography (microCT) images. Xylem network performance was then modeled to simulate loss of hydraulic conductivity under increasingly negative xylem sap pressure simulating drought stress conditions. We also considered the sensitivity of xylem network performance to changes in key network parameters. We found that the mean pit area per intervessel connection was constant across 10 networks from three, 1.5-m stem segments, but short (0.5 cm) segments fail to capture complete network connectivity. Simulations showed that network organization imparted additional resistance to embolism spread beyond the air-seeding threshold of pit membranes. Xylem network vulnerability to embolism spread was most sensitive to variation in the number and location of vessels that were initially embolized and pit membrane vulnerability. Our results show that xylem network organization can increase stem resistance to embolism spread by 40% (0.66 MPa) and challenge the notion that a single embolism can spread rapidly throughout an entire xylem network.

Wason, Jay↗
DOE OSTI2023

Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equations

Physics-informed neural networks have emerged as an alternative method for solving partial differential equations. However, for complex problems, the training of such networks can still require high-fidelity data which can be expensive to generate. To reduce or even eliminate the dependency on high-fidelity data, we propose a novel multi-fidelity architecture which is based on a feature space shared by the low- and high-fidelity solutions. In the feature space, the projections of the low-fidelity and high-fidelity solutions are adjacent by constraining their relative distance. The feature space is represented with an encoder and its mapping to the original solution space is effected through a decoder. In conclusion, the proposed multi-fidelity approach is validated on forward and inverse problems for steady and unsteady problems described by partial differential equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

DeepGRN: prediction of transcription factor binding site across cell-types using attention-based deep neural networks

Abstract Background Due to the complexity of the biological systems, the prediction of the potential DNA binding sites for transcription factors remains a difficult problem in computational biology. Genomic DNA sequences and experimental results from parallel sequencing provide available information about the affinity and accessibility of genome and are commonly used features in binding sites prediction. The attention mechanism in deep learning has shown its capability to learn long-range dependencies from sequential data, such as sentences and voices. Until now, no study has applied this approach in binding site inference from massively parallel sequencing data. The successful applications of attention mechanism in similar input contexts motivate us to build and test new methods that can accurately determine the binding sites of transcription factors. Results In this study, we propose a novel tool (named DeepGRN) for transcription factors binding site prediction based on the combination of two components: single attention module and pairwise attention module. The performance of our methods is evaluated on the ENCODE-DREAM in vivo Transcription Factor Binding Site Prediction Challenge datasets. The results show that DeepGRN achieves higher unified scores in 6 of 13 targets than any of the top four methods in the DREAM challenge. We also demonstrate that the attention weights learned by the model are correlated with potential informative inputs, such as DNase-Seq coverage and motifs, which provide possible explanations for the predictive improvements in DeepGRN. Conclusions DeepGRN can automatically and effectively predict transcription factor binding sites from DNA sequences and DNase-Seq coverage. Furthermore, the visualization techniques we developed for the attention modules help to interpret how critical patterns from different types of input features are recognized by our model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Developing stable, simplified, functional consortia from Brachypodium rhizosphere for microbial application in sustainable agriculture

The rhizosphere microbiome plays a crucial role in supporting plant productivity and ecosystem functioning by regulating nutrient cycling, soil integrity, and carbon storage. However, deciphering the intricate interplay between microbial relationships within the rhizosphere is challenging due to the overwhelming taxonomic and functional diversity. Here we present our systematic design framework built on microbial colocalization and microbial interaction, toward successful assembly of multiple rhizosphere-derived Reduced Complexity Consortia (RCC). We enriched co-localized microbes from Brachypodium roots grown in field soil with carbon substrates mimicking Brachypodium root exudates, generating 768 enrichments. By transferring the enrichments every 3 or 7 days for 10 generations, we developed both fast and slow-growing reduced complexity microbial communities. Most carbon substrates led to highly stable RCC just after a few transfers. 16S rRNA gene amplicon analysis revealed distinct community compositions based on inoculum and carbon source, with complex carbon enriching slow growing yet functionally important soil taxa like Acidobacteria and Verrucomicrobia. Network analysis showed that microbial consortia, whether differentiated by growth rate (fast vs. slow) or by succession (across generations), had significantly different network centralities. Besides, the keystone taxa identified within these networks belong to genera with plant growth-promoting traits, underscoring their critical function in shaping rhizospheric microbiome networks. Furthermore, tested consortia demonstrated high stability and reproducibility, assuring successful revival from glycerol stocks for long-term viability and use. Our study represents a significant step toward developing a framework for assembling rhizosphere consortia based on microbial colocalization and interaction, with future implications for sustainable agriculture and environmental management.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Science Uses Deployment Operations-Advanced Wireless: Exploring Open Radio Access Network Technologies for Energy Science

Open Radio Access Network is emerging as a solution to the increasing demand for more flexible, cost-effective, and advanced mobile network infrastructures. This evolution is driven by advancements in wireless technologies and the growing complexity of deploying and managing these networks. O-RAN represents a significant shift in wireless technology, building upon the 3rd Generation Partnership Project framework to foster openness, flexibility, and interoperability. By decoupling hardware and software components, Open Radio Access Network enables a multi-vendor ecosystem that encourages innovation and diverse solutions. Open Radio Access Network's potential extends beyond traditional wireless applications, with growing interest in its role in advancing energy systems, particularly in the context of smart grids, microgrids, and the integration of renewable energy sources. While the role of open-wireless technologies in driving energy transformation is increasingly recognized, further exploration is needed. Vendors and utilities are investigating how Open Radio Access Network technologies can optimize energy use cases and improve the performance of 5G and beyond applications. This report outlines efforts under the Science Uses Deployment Operations Advance Wireless project, a collaboration between the National Laboratory of the Rockies' Cybersecurity Research Center, Argonne National Laboratory, Lawrence Berkeley National Laboratory, and the Department of Energy's Energy Science Network research and operations staff. The focus of this project is on due diligence, through testing and evaluation, preparing for the deployment of advanced wireless infrastructure for scientific use cases, with an emphasis on Open Radio Access Network technology, its components, integrations, and its ability to support vertical stack application across the energy sector. Additionally, the report highlights the value cases for utilities, underscoring how adopting open wireless standards can accelerate the evolution of energy systems, foster innovation, and improve the integration of critical energy technologies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRSDate not supplied

Emulated Spacecraft Communication Testbed for Evaluating Cognitive Networking Technology

The ability to emulate the full space protocol stack is an essential aspect required to evaluate and mature cognitive communication capabilities. The interaction between the physical layer and network layers is key to developing network optimizations for a dynamic and complex environment. We present a laboratory testbed for the evaluation of cognitive radio and networking techniques applied to space communications. The testbed is a high fidelity, flight-like hardware testbed consisting of software-defined radios, channel emulators, modems, and orbital analysis and scheduling software. The testbed uses RF links with signal quality, propagation delay, and Doppler effects driven by orbital mechanics simulations of emulated spacecraft. Our framework enables control of link bidirectionality, data rates, and interference sources. In addition to hardware radio nodes, the testbed can incorporate virtualized emulated nodes for larger and more challenging network scenarios. Our approach to a cognitive communication system uses delay tolerant networking (DTN) to mitigate the challenges of the space environment. While many DTN networks use only preplanned schedules, our system uses User-Initiated Service (UIS) to dynamically schedule service providers. Software-defined radio allows the system to adapt to a variety of service providers. Integration of DTN, UIS, and software-defined radio technologies provides a framework for the implementation of a cognitive communication system. This paper describes the testbed capabilities, network emulation approach, component integration, and initial end-to-end testing results.

cognitive radio↗
DOE OSTI2022

Estimating the randomness of quantum circuit ensembles up to 50 qubits

Random quantum circuits have been utilized in the contexts of quantum supremacy demonstrations, variational quantum algorithms for chemistry and machine learning, and blackhole information. The ability of random circuits to approximate any random unitaries has consequences on their complexity, expressibility, and trainability. To study this property of random circuits, we develop numerical protocols for estimating the frame potential, the distance between a given ensemble and the exact randomness. Our tensor-network-based algorithm has polynomial complexity for shallow circuits and is high-performing using CPU and GPU parallelism. We study 1. local and parallel random circuits to verify the linear growth in complexity as stated by the Brown–Susskind conjecture, and; 2. hardware-efficient ansätze to shed light on its expressibility and the barren plateau problem in the context of variational algorithms. Our work shows that large-scale tensor network simulations could provide important hints toward open problems in quantum information science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness

We report the accuracy of deep learning, i.e., deep neural networks, can be characterized by dividing the total error into three main types: approximation error, optimization error, and generalization error. Whereas there are some satisfactory answers to the problems of approximation and optimization, much less is known about the theory of generalization. Most existing theoretical works for generalization fail to explain the performance of neural networks in practice. To derive a meaningful bound, we study the generalization error of neural networks for classification problems in terms of data distribution and neural network smoothness. We introduce the cover complexity (CC) to measure the difficulty of learning a data set and the inverse of the modulus of continuity to quantify neural network smoothness. A quantitative bound for expected accuracy/error is derived by considering both the CC and neural network smoothness. Although most of the analysis is general and not specific to neural networks, we validate our theoretical assumptions and results numerically for neural networks by several data sets of images. The numerical results confirm that the expected error of trained networks scaled with the square root of the number of classes has a linear relationship with respect to the CC. We also observe a clear consistency between test loss and neural network smoothness during the training process. In addition, we demonstrate empirically that the neural network smoothness decreases when the network size increases whereas the smoothness is insensitive to training dataset size.

97 MATHEMATICS AND COMPUTING↗