Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Neural-network decoders for measurement induced phase transitions

Open quantum systems have been shown to host a plethora of exotic dynamical phases. Measurement-induced entanglement phase transitions in monitored quantum systems are a striking example of this phenomena. However, naive realizations of such phase transitions requires an exponential number of repetitions of the experiment which is practically unfeasible on large systems. Recently, it has been proposed that these phase transitions can be probed locally via entangling reference qubits and studying their purification dynamics. In this work, we leverage modern machine learning tools to devise a neural network decoder to determine the state of the reference qubits conditioned on the measurement outcomes. We show that the entanglement phase transition manifests itself as a stark change in the learnability of the decoder function. We study the complexity and scalability of this approach in both Clifford and Haar random circuits and discuss how it can be utilized to detect entanglement phase transitions in generic experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Single-cell stable isotope probing in microbial ecology

Abstract Environmental and host-associated microbiomes are typically diverse assemblages of organisms performing myriad activities and engaging in a network of interactions that play out in spatially structured contexts. As the sum of these activities and interactions give rise to overall microbiome function, with important consequences for environmental processes and human health, elucidating specific microbial activities within complex communities is a pressing challenge. Single-cell stable isotope probing (SC-SIP) encompasses multiple techniques that typically utilize Raman microspectroscopy or nanoscale secondary ion mass spectrometry (NanoSIMS) to enable spatially resolved tracking of isotope tracers in cells, cellular components, and metabolites. SC-SIP techniques are uniquely suited for illuminating single-cell activities in microbial communities and for testing hypotheses about cellular functions generated for example from meta-omics datasets. Here, we illustrate the insights enabled by SC-SIP techniques by reviewing selected applications in microbiology and offer a perspective on their potential for future research.

Alcolombri, Uria (ORCID:0000000335615091)↗

Correlative X-ray micro-nanotomography with scanning electron microscopy at the Advanced Light Source

Geological samples are inherently multi-scale. Understanding their bulk physical and chemical properties requires characterization down to the nano-scale. A powerful technique to study the three-dimensional microstructure is X-ray tomography, but it lacks information about the chemistry of samples. To develop a methodology for measuring the multi-scale 3D microstructure of geological samples, correlative X-ray micro- and nanotomography were performed on two rocks followed by scanning electron microscopy with energy-dispersive spectroscopy (SEM-EDS) analysis. The study was performed in five steps: (i) micro X-ray tomography was performed on rock sample cores, (ii) samples for nanotomography were prepared using laser milling, (iii) nanotomography was performed on the milled sub-samples, (iv) samples were mounted and polished for SEM analysis and (v) SEM imaging and compositional mapping was performed on micro and nanotomography samples for complimentary information. Correlative study performed on samples of serpentine and basalt revealed multiscale 3D structures involving both solid mineral phases and pore networks. Significant differences in the volume fraction of pores and mineral phases were also observed dependent on the imaging spatial resolution employed. This highlights the necessity for the application of such a multiscale approach for the characterization of complex aggregates such as rocks. Information acquired from the chemical mapping of different phases was also helpful in segmentation of phases that did not exhibit significant contrast in X-ray imaging. Adoption of the protocol used in this study can be broadly applied to 3D imaging studies being performed at the Advanced Light Source and other user facilities.

58 GEOSCIENCES↗

Supramolecular dynamic binary complexes with pH and salt-responsive properties for use in unconventional reservoirs

Hydraulic fracturing of unconventional reservoirs has seen a boom in the last century, as a means to fulfill the growing energy demand in the world. The fracturing fluid used in the process plays a substantial role in determining the results. Hence, several research and development efforts have been geared towards developing more sustainable, efficient, and improved fracturing fluids. Herein, we present a dynamic binary complex (DBC) solution, with potential to be useful in the hydraulic fracturing domain. It has a supramolecular structure formed by the self-assembly of low molecular weight viscosifiers (LMWVs) oleic acid and diethylenetriamine into an elongated entangled network under alkaline conditions. With less than 2 wt% constituents dispersed in aqueous solution, a viscous gel that exhibits high viscosities even under shear was formed. Key features include responsiveness to pH and salinity, and a zero-shear viscosity that could be tuned by a factor of ~280 by changing the pH. Furthermore, its viscous properties were more pronounced in the presence of salt. Sand settling tests revealed its potential to hold up sand particles for extended periods of time. In conclusion, this DBC solution system has potential to be utilized as a smart salt-responsive, pH-switchable hydraulic fracturing fluid.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Argonne Leadership Computing Facility: 2021 Operational Assessment Report

This Operational Assessment Report describes how the Argonne Leadership Computing Facility (ALCF) met or exceeded every one of its goals for calendar year (CY) 2021 as an advanced scientific computing center. In CY 2021, the ALCF operated its production resource, Theta, an Intel-based Cray XC40 system (11.7-petaflops) augmented with 24 NVIDIA DGX A100-based nodes (3.9-petaflops) that supports diverse workloads, integrating data analytics with artificial intelligence (AI) training and learning in a single platform. In 2021, we began deploying Polaris, our newest 40- petaflops system, and augmented this powerful testbed system with an additional 28 nodes to support the integration of real-time experiments and HPC resources. We also deployed our two largest storage systems yet, named Grand and Eagle, that will bring new services to our users and will power data-driven research for years to come. Last year, Theta delivered a total of 20.8 million node-hours to 16 Innovative and Novel Computational Impact on Theory and Experiment (INCITE) projects and 7.2 million node-hours to ASCR Leadership Computing Challenge (ALCC) projects (32 awarded during the 2020–2021 ALCC year and 17 awarded during the 2021–2022 ALCC year), as well as substantial support to Director’s Discretionary (DD) projects (5.5 million node-hours). As Table ES.1 shows, Theta performed exceptionally well in terms of overall availability (95.1 percent), scheduled availability (99.4 percent), and utilization (98.1 percent; Table 2.1). As of the submission date of this document, ALCF’s user community has published 249 papers in high-quality, peer-reviewed journals and technical proceedings. At the 2021 International Conference for High Performance Computing, Networking, Storage and Analysis (SC’21), Argonne researchers won two HPCwire Readers’ Choice Awards and were part of a Gordon Bell Prize finalist team recognized for developing an AI-enabled, multi-resolution simulation framework for studying complex biomolecular machines. Their framework was used to observe the SARS-CoV-2 replication-transcription machinery in action, by directly integrating experimental data. ALCF also provided a comprehensive program of high-performance computing (HPC) support services to help our community make productive use of the facility’s diverse and growing collection of resources. We are now entering the exascale era, with exascale machines being planned for national laboratories across the country, including Aurora at Argonne National Laboratory (Argonne) in 2023. ALCF researchers have been leading and guiding numerous strategic activities that will push the boundaries of what’s possible in computational science and engineering and allow us to deliver science on day one.

97 MATHEMATICS AND COMPUTING↗

Arbitrary Polynomial Separations in Trainable Quantum Machine Learning

Recent theoretical results in quantum machine learning have demonstrated a general trade-off between the expressive power of quantum neural networks (QNNs) and their trainability; as a corollary of these results, practical exponential separations in expressive power over classical machine learning models are believed to be infeasible as such QNNs take a time to train that is exponential in the model size. We here circumvent these negative results by constructing a hierarchy of efficiently trainable QNNs that exhibit unconditionally provable, polynomial memory separations of arbitrary constant degree over classical neural networks—including state-of-the-art models, such as Transformers—in performing a classical sequence modeling task. This construction is also computationally efficient, as each unit cell of the introduced class of QNNs only has constant gate complexity. We show that contextuality—informally, a quantitative notion of semantic ambiguity—is the source of the expressivity separation, suggesting that other learning tasks with this property may be a natural setting for the use of quantum learning algorithms.

Anschuetz, Eric R. [California Institute of Techno↗

DeepGhostBusters: Using Mask R-CNN to Detect and Mask Ghosting and Scattered-Light Artifacts from Optical Survey Images

Wide-field astronomical surveys are often affected by the presence of undesirable reflections (often known as "ghosting artifacts" or "ghosts") and scattered-light artifacts. The identification and mitigation of these artifacts is important for rigorous astronomical analyses of faint and low-surface-brightness systems. However, the identification of ghosts and scattered-light artifacts is challenging due to a) the complex morphology of these features and b) the large data volume of current and near-future surveys. In this work, we use images from the Dark Energy Survey (DES) to train, validate, and test a deep neural network (Mask R-CNN) to detect and localize ghosts and scattered-light artifacts. We find that the ability of the Mask R-CNN model to identify affected regions is superior to that of conventional algorithms and traditional convolutional neural networks methods. We propose that a multi-step pipeline combining Mask R-CNN segmentation with a classical CNN classifier provides a powerful technique for the automated detection of ghosting and scattered-light artifacts in current and near-future surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Microgrid Communications Using the Open-Source Open Field Message Bus (OpenFMB) Framework Applied to a 480V, 100kW Laboratory Microgrid

Microgrids require an extensive communication infrastructure to allow interoperability between the microgrid controller and assets. However, the lack of standardization of data structures combined with the variety of communication protocols poses several challenges to the implementation of a communication network. This paper presents an application of the open-source Open Field Message Bus (OpenFMB) framework to simplify the communication layer in microgrids. This work leverages the OpenFMB protocol translation and data model extensions to reduce the complexity in the microgrid communications. Conducted in a laboratory microgrid, the case study demonstrates how the OpenFMB provides predefined data models and simplifies the communication layer by providing information exchange between multiple legacy communication protocols.

Ferrari Maglia, Max↗

Data-Driven Model Predictive Control for Temperature Management of Heat Pipe Microreactor

To enable the self-regulating capability of heat pipe (HP) microreactors, an anticipatory control strategy through model predictive control (MPC) could proactively respond to potential disturbances and deviations in operating setpoints. However, a key factor prohibiting the widespread adoption of MPCs in nuclear applications is the effort and computational costs associated with learning and calibrating first-principles-based process models when the target system is complex and when there are gaps between modeled and target reactor systems. In this paper, we demonstrate data-driven MPC using three approaches for modeling the system dynamics, including a linear state-space model, feedforward neural network, and recurrent neural networks long short-term memory. We present the development and validation process of each model and compare the performance of data-driven MPCs in controlling the temperatures of selected HPs at the evaporator and condenser regions in a 37-HP-monolith system. Our results show that, qualitatively, all data-driven MPCs are producing similar control actions, while quantitatively, with artificial neural nets (especially feedforward neural nets), MPC can better follow drastic changes in setpoints with smallest errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Harnessing the Power of AI: Status and Expansion of Current Domestic Transport Security Through Flexible Embedded Hardware

As applications of Artificial Intelligence (AI) continue to expand, there are increasing opportunities to leverage applied AI methodologies with mobile transportation focused embedded systems. Current applications of AI in transportation focus on a variety of areas, including fuel efficiency, safety, security, and other broad fields of optimization or detection. To leverage these AI workflows and methodologies in the field, teams must utilize complex embedded systems capable of implementing these AI-enabled algorithms in real-time. In this paper, we will investigate how these algorithms can be integrated into existing technologies leveraging vehicle data - such as the Controller Area Network Transport Security Tracking and Reporting Unit (C-STAR). The C-STAR technology is an embedded platform with onboard computation capable of running next generation algorithms in vehicle systems AI, such as preventative maintenance, driver authentication, and transport security. As deployed in the field, the C-STAR has a limited AI functionality –this paper will directly discuss how a device like C-STAR can be utilized and the advantages of integrating these new technologies. We will open with relevant background information and transportation projects that leverage AI, focusing specifically on those around transport security such as vehicle identification, anomaly detection, and deterrence. We will then extend this into potential opportunities and scaling for AI methodologies using platforms like the C-STAR. Finally, we will speak directly to the challenges of deploying AI-powered workflows, such as computing power needs, bandwidth, hallucinations, and other regulatory considerations.

Cook, Adian [ORNL] (ORCID:0000000160825395)↗

Predicting lake surface water phosphorus dynamics using process-guided machine learning

Phosphorus (P) loading to lakes is degrading the quality and usability of water globally. Accurate predictions of lake P dynamics are needed to understand whole-ecosystem P budgets, as well as the consequences of changing lake P concentrations for water quality. However, complex biophysical processes within lakes, along with limited observational data, challenge our capacity to reproduce short-term lake dynamics needed for water quality predictions, as well as long-term dynamics needed to understand broad scale controls over lake P. Here we use an emerging paradigm in modeling, process-guided machine learning (PGML), to produce a phosphorus budget for Lake Mendota (Wisconsin, USA) and to accurately predict epilimnetic phosphorus over a time range of days to decades. In our implementation of PGML, which we term a Process-Guided Recurrent Neural Network (PGRNN), we combine a process-based model for lake P with a recurrent neural network, and then constrain the predictions with ecological principles. We test independently the process-based model, the recurrent neural network, and the PGRNN to evaluate the overall approach. The process-based model accounted for most of the observed pattern in lake P; however it missed the long-term trend in lake P and had the worst performance in predicting winter and summer P in surface waters. The root mean square error (RMSE) for the process-based model, the recurrent neural network, and the PGRNN was 33.0 μg P L -1 , 22.7 μg P L -1 , and 20.7 μg P L -1 , respectively. All models performed better during summer, with RMSE values for the three models (same order) equal to 14.3 μg P L -1 , 10.9 μg P L -1 , and 10.7 μg P L -1 . Although the PGRNN had only marginally better RMSE during summer, it had lower bias and reproduced long-term decreases in lake P missed by the other two models. For all seasons and all years, the recurrent neural network had better predictions than process alone, with root mean square error (RMSE) of 23.8 μg P L -1 and 28.0 μg P L -1 , respectively. The output of PGRNN indicated that new processes related to water temperature, thermal stratification, and long term changes in external loads are needed to improve the process model. By using ecological knowledge, as well as the information content of complex data, PGML shows promise as a technique for accurate prediction in messy, real-world ecological dynamics, while providing valuable information that can improve our understanding of process.

54 ENVIRONMENTAL SCIENCES↗

Variable rate neural compression for sparse detector data

Particle colliders produce data at extraordinary rates, posing major challenges for transmission and storage. High-throughput compression algorithms are therefore essential. In the sPHENIX experiment taking data at the Relativistic Heavy Ion Collider, a time projection chamber records three-dimensional (3D) particle trajectories that are highly sparse, making conventional learning-free lossy compression ineffective. Convolutional neural networks have surpassed traditional methods in compression ratio and accuracy. However, they fail to exploit sparsity for efficiency. To address these gaps, we present BCAE-VS, a bicephalous convolutional autoencoder with variable compression ratio for sparse data, which adapts compression to input complexity through key-point identification and sparse convolution. BCAE-VS achieves higher accuracy and compression ratios than prior neural approaches while being orders of magnitude smaller. Moreover, its throughput increases with sparsity—a property not observed in other methods. Although it was developed for collider experiments, BCAE-VS readily extends to other sparse data domains, such as light detection and ranging (LiDAR) sensing and 3D microscopy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Chemical Potential Driven Reorganization of Anions between Stern and Diffuse Layers at the Air/Water Interface

We report ion adsorption and transfer at charged interfaces play key roles in various industrial and environmental processes. Molecular scale details of ion-ion, ion-water, and ion-surface interactions are still debated. Complex ions, such as SCN - and SeCN - , are particularly interesting due to their unexpected adsorption trends. Here, we combine vibrational sum frequency generation (VSFG) spectroscopy and surface-sensitive synchrotron X-ray studies to provide a detailed description of SeCN - adsorption at a floating charged monolayer. Polarimetry studies show that the average orientation of SeCN - anions with respect to the surface normal decreases from 45° to 22° with the increasing KSeCN concentration. Interfacial SeCN - coverage saturates at very low bulk concentrations, but their orientational organization, distribution between Stern and diffuse layers, and effects on the hydrogen-bonding network of the interfacial water continue to change with increasing bulk KSeCN concentration. These results show that the increasing chemical potential may lead to further reorganization of the adsorbed ions, even though the total interfacial ion population does not change. The reorganization of the interfacial ions and the water may be very important in chemical separations of heavy metals, where metal-anion complexes drive the selective ion transfer at aqueous interfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A comprehensive and fair comparison of two neural operators (with practical extensions) based on $\mathrm{FAIR}$ data

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and engineering. Herein, we investigate the performance of two neural operators, which have shown promising results so far, and we develop new practical extensions that will make them more accurate and robust and importantly more suitable for industrial-complexity applications. The first neural operator, DeepONet, was published in 2019 (Lu et al., 2019), and its original architecture was based on the universal approximation theorem of Chen & Chen (1995). The second one, named Fourier Neural Operator or FNO, was published in 2020, and it is based on parameterizing the integral kernel in the Fourier space. DeepONet is represented by a summation of products of neural networks (NNs), corresponding to the branch NN for the input function and the trunk NN for the output function; both NNs are general architectures, e.g., the branch NN can be replaced with a CNN or a ResNet. According to Kovachki et al. (2021), FNO in its continuous form can be viewed conceptually as a DeepONet with a specific architecture of the branch NN and a trunk NN represented by a trigonometric basis. In order to compare FNO with DeepONet computationally for realistic setups, we develop several extensions of FNO that can deal with complex geometric domains as well as mappings where the input and output function spaces are of different dimensions. We also develop an extended DeepONet with special features that provide inductive bias and accelerate training, and we present a faster implementation of DeepONet with cost comparable to the computational cost of FNO, which is based on the Fast Fourier Transform. Here we consider 16 different benchmarks to demonstrate the relative performance of the two neural operators, including instability wave analysis in hypersonic boundary layers, prediction of the vorticity field of a flapping airfoil, porous media simulations in complex-geometry domains, etc. We follow the guiding principles of FAIR (Findability, Accessibility, Interoperability, and Reusability) for scientific data management and stewardship. The performance of DeepONet and FNO is comparable for relatively simple settings, but for complex geometries the performance of FNO deteriorates greatly. We also compare theoretically the two neural operators and obtain similar error estimates for DeepONet and FNO under the same regularity assumptions.

42 ENGINEERING↗

Utilizing a Dynamic Segmentation Convolutional Neural Network for Microstructure Analysis of Additively Manufactured Superalloy 718

Additive manufacturing (AM) is revolutionizing almost all industries through the production of intricate geometries previously prohibited by cost or machinability. Ni-based superalloys form a primary alloy class for high temperature applications in the petrochemical, aerospace, and nuclear industries because of their intrinsic resistance to creep and the ability to heat treat the superalloy for high strength. Despite these attractive properties, the extreme work hardening of Ni-based superalloys makes traditional manufacturing of complex shapes difficult and thus, these alloys are an attractive target for AM. Superalloy 718 was chosen as an example superalloy because of the wide variety of precipitates that can form within its composition space from the repetitive heating and cooling cycles of the AM process. The precipitates and other microstructure features, such as grain boundaries and dislocations, will dictate the mechanical properties and thus, there is an extensive challenge to characterize the size, number density, composition, and volume fraction of each microstructural feature from AM fabrication using analytical electron microscopy. This work focused on the application of a pixel-wise classification machine learning (ML) model called a dynamic segmentation convolutional neural network (DSCNN) to identify the microstructural features of an as-fabricated additively manufactured superalloy 718.

Taller, Stephen↗

Nanoparticle self-assemblies with modern complexity

Thanks to decades of tireless efforts, nanoparticle assemblies have reached at an extremely high level of controllability, sophistication, and complexity, with new insights provided by integration with graph theory, cutting-edge characterization, and machine learning (ML)-based computation and modeling, as well as with ever-diversifying applications in energy, catalysis, biomedicine, optics, electronics, magnetics, organic biosynthesis, and quantum technology. Nanoparticle assemblies can be crystalline, known as superlattices or supracrystals. Their assembly entails a transition from disorder—dispersed nanoparticles—to order, which can be achieved through classical nucleation pathways or nonclassical pathways via prenucleation precursors or particle aggregation. Further, the periodic lattices allow facile manipulations of electrons, phonons, photons, and even spins, leading to advanced device components and metamaterials. Meanwhile, aperiodic assemblies out of nanoparticles, such as gels, networks, and amorphous solids, also start to attract attentions. Despite the loss of periodicity, symmetry-lowering or symmetry-breaking three-dimensional (3D) structures emerge with unique properties, such as chiroptical activity, topological mechanical strength, and quantum entanglement. Real-space imaging such as electron microscopy and X-ray based tomography methods are utilized to characterize these complex structures, while mathematical tools such as graph theories are in need to describe such complex structures. This issue aims to provide a timely review of the efforts in this greatly broadened materials design space including experiment, simulation, theory, and applications. Nine top experts (and their teams) from four countries deliver six review papers, summarizing fundamental mechanistic understandings of nanoparticle assemblies, highlighted with the developments of state-of-the-art in situ characterization tools and ML-assisted reverse engineering, and newly emergent applications of nanoarchitectures.

36 MATERIALS SCIENCE↗

Community stability is related to animal diversity change

Abstract Understanding the drivers of community stability in times of increasing anthropogenic pressure is an urgent issue. Biodiversity is known to promote community stability, but studies of the biodiversity–stability relationship rarely consider the full complexity of biodiversity change. Furthermore, finding generalities that hold across taxonomic groups and spatial and temporal scales remains challenging because most investigations have narrow taxonomic, spatial, and temporal scopes. We used organismal data collected through the National Ecological Observatory Network (NEON) at sites across the contiguous United States to evaluate linkages between community stability and biodiversity change for four taxonomic groups: small mammals, ground beetles, fish, and freshwater macroinvertebrates. We defined community stability as constancy of aggregate species' abundance. We quantified change in biodiversity as (1) dissimilarity in community taxonomic and functional composition and species replacement and richness change components of that dissimilarity and (2) change in species' abundance distributions as captured by change in species rank, richness, and evenness. We found that community stability increased with species replacement and with contribution of species replacement to overall dissimilarity for all taxonomic groups, but declined with increasing change in species richness and evenness. This is consistent with the notion that temporal fluctuations in species abundance can help stabilize community properties. We also found that community stability was highest when change in community functional composition was either lower or higher than expected given reshuffling of each community's taxonomic composition. This suggests that long‐term community stability can result from fluctuations of functionally similar species in assemblages with high taxonomic reshuffling. On the contrary, the functional uniqueness of fluctuating species compensates for lower taxonomic reshuffling to drive stabilization of community properties. Our study provides an initial assessment of the relationship between community stability and biodiversity change and illustrates the utility of fine temporal resolution data collected across ecosystems and biomes to understand the general mechanisms underlying biodiversity–stability relationships.

54 ENVIRONMENTAL SCIENCES↗