Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Complex networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Physically Informed Machine Learning Prediction of Electronic Density of States

The electronic structure of a material, such as its density of states (DOS), provides key insights into its physical and functional properties and serves as a valuable source of high-quality features for many materials screening and discovery workflows. Still, the computational cost of calculating the DOS, most commonly with density functional theory (DFT), becomes prohibitive for meeting high-fidelity or high-throughput requirements, necessitating a cheaper but sufficiently accurate surrogate. To fulfill this demand, we develop a general machine learning method based on graph neural networks for predicting the DOS purely from atomic positions, six orders of magnitude faster than DFT. This approach can effectively use large materials databases and be applied generally across the entire periodic table to materials classes of arbitrary compositional and structural diversity. We furthermore devise a highly adaptable scheme for physically informed learning which encourages the DOS prediction to favor physically reasonable solutions defined by any set of desired constraints. This functionality provides a means for ensuring that the predicted DOS is reliable enough to be used as an input to downstream materials screening workflows to predict more complex functional properties, which rely on accurate physical features.

36 MATERIALS SCIENCE↗

Probing reaction channels via reinforcement learning

Abstract Chemical reactions are dynamical processes involving the correlated reorganization of atomic configurations, driving the conversion of an initial reactant into a result product. By virtue of the metastability of both the reactants and products, chemical reactions are rare events, proceeding fleetingly. Reaction pathways can be modelled probabilistically by using the notion of reactive density in the phase space of the molecular system. Such density is related to a function known as the committor function, which describes the likelihood of a configuration evolving to one of the nearby metastable regions. In theory, the committor function can be obtained by solving the backward Kolmogorov equation (BKE), which is a partial differential equation (PDE) defined in the full dimensional phase space. However, using traditional methods to solve this problem is not practical for high dimensional systems. In this work, we propose a reinforcement learning based method to identify important configurations that connect reactant and product states along chemical reaction paths. By shooting multiple trajectories from these configurations, we can generate an ensemble of states that concentrate on the transition path ensemble. This configuration ensemble can be effectively employed in a neural network-based PDE solver to obtain an approximation solution of a restricted BKE, even when the dimension of the problem is very high. The resulting solution provides an approximation for the committor function that encodes mechanistic information for the reaction, paving a new way for understanding of complex chemical reactions and evaluation of reaction rates.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference

Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. In this work, we explore the interplay between pruning and quantization during the training of neural networks for ultra low latency applications targeting high energy physics use cases. Techniques developed for this study have potential applications across many other domains. We study various configurations of pruning during quantization-aware training, which we term quantization-aware pruning, and the effect of techniques like regularization, batch normalization, and different pruning schemes on performance, computational complexity, and information content metrics. We find that quantization-aware pruning yields more computationally efficient models than either pruning or quantization alone for our task. Further, quantization-aware pruning typically performs similar to or better in terms of computational efficiency compared to other neural architecture search techniques like Bayesian optimization. Surprisingly, while networks with different training configurations can have similar performance for the benchmark application, the information content in the network can vary significantly, affecting its generalizability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

Oak Ridge National Laboratory’s (ORNL) Manufacturing Demonstration Facility (MDF) worked with EOS Group to evaluate the current in-situ sensor capabilities of an EOS M290 Laser Powder Bed Fusion machine. The M290 was fitted with a 1 Mega-Pixel (MP) grayscale visible-light camera and a 5 MP temporally integrated (TI) near-infrared (NIR) camera. One print from stainless steel (SS) 316 and two from Inconel 625 (IN625) were performed where data including in-situ imaging and a machine log file were captured. These data were subsequently analyzed using a Dynamic Multi-Scale Segmentation Convolutional Neural Network (DMSCNN) trained on user defined classes and correlated to as-printed flaws, in the form of porosity, discovered in X-Ray Computed Tomography (XCT). In Phase I, two indications were detected in-situ and spatially correlated to stochastic lack-of-fusion flaws discovered using XCT. In Phase II, using these links from in-situ signatures to XCT flaw populations, a second neural network (NN) was trained to create a Voxelized Property Prediction Model (VPPM) to predict porosity percentages within the part using only features garnered from the in-situ data from two IN625 complex geometries. The VPPM was able to accurately predict porosity values for IN625 parts with an R 2 value of 0.764.

36 MATERIALS SCIENCE↗

Interplay of surface energy and rheology in biopolymer soil enhancement

Biopolymers such as xanthan gum (XG) and locust bean gum (LBG) hold great potential as eco-friendly alternative soil binders. In this work, we investigated the impact of XG/LBG mixtures on the unconfined compressive strength (UCS) of sand. The high strength of dry biopolymer/sand arises from the cohesion between solid polymer films and sand particles which supported by work of adhesion calculation and soil mechanics measurement. LBG exhibits much lower sand reinforcement efficacy because polymers unevenly distributed within sand matrix. The formation of a core-shell structure in LBG/sand is an interplay of surface free energy and viscoelastic properties of polymer solutions. This structure is altered when LBG mixed with XG at varying ratios as those physical properties changed due to the complexity of polymer chains association. By probing these factors, we aim to elucidate the role of surface energies and polymer physics in governing the strength of the sand/polymer network, thereby contributing to a more comprehensive understanding polymer-sand interface. The low strength of gels (G’ ∼10Pa) cannot solely account for the increased UCS of wet sand over 10 kPa. Instead, the high strength of biopolymer/sand is more likely derived from the granular particles with biopolymers as solid glue.

36 MATERIALS SCIENCE↗

Geodetic Evidence for Distributed Shear Below the Brittle Crust of the Walker Lane, Western United States

Abstract Models of active deformation of the Earth's crust are predominantly represented with dislocations having a downdip continuation into the lower crust, where the fault slips continuously. This model predicts surface strain accumulation concentrated near the fault during the interseismic period. In an alternative model, faults do not extend beneath the elastic portion of the crust and are accompanied by a wide zone of distributed shear underneath, predicting a more constant strain rate lacking concentrations at the faults. We use high‐precision GPS data collected across the northern and central Walker Lane, USA— a region of complex faulting near the western edge of the Basin and Range Province to evaluate which model is appropriate. Despite the existence of dense continuous and semi‐continuous geodetic networks that have been surveyed for ∼20 years, the horizontal velocities reveal no evidence of localized strain accumulation across the fault surface expressions. Instead, deformation within the Walker Lane is uniformly linear, suggesting that the surface deformation reflects distributed shear within the ductile crust rather than focused deformation at faults. This suggests no downdip extension of the faults below the seismogenic layer. The shear zone is 172 ± 6 km wide in the northernmost Walker Lane narrowing to 116 ± 4 km in the central Walker Lane. The total velocity budget across the shear zone is 7.2 ± 0.1 mm/yr in the north, increasing to 10.1 ± 0.1 mm/yr in the central Walker Lane. We conclude that assuming the presence of lower crustal dislocations when estimating geodetic faults slip rates may be inappropriate.

Geochemistry & Geophysics↗

4D structural changes and pore network model of biomass during pyrolysis

Biochar is an engineered carbon-rich substance used for soil improvement, environmental management, and other diverse applications. To date, the understanding of how biomass affects biochar microstructure has been limited due to the complexity of analysis involved in tracing the changes in the physical structure of biomass as it undergoes thermochemical conversion. In this study, we used synchrotron x-ray micro-tomography to visualize changes in the internal structure of biochar from diverse feedstock (miscanthus straw pellets, wheat straw pellets, oilseed rape straw pellets, and rice husk) during pyrolysis by collecting a sequence of 3D scans at 50 °C intervals during progressive heating from 50 °C to 800 °C. The results show a strong dependence of biochar porosity on feedstock as well as pyrolysis temperature, with observed porosity in the range of 7.41–60.56%. Our results show that the porosity, total surface area, pore volume, and equivalent diameter of the largest pore increases with increasing pyrolysis temperature up to about 550 °C. The most dramatic development of pore structure occurred in the temperature range of 350–450 °C. This understanding is pivotal for optimizing biochar’s properties for specific applications in soil improvement, environmental management, and beyond. By elucidating the nuanced variations in biochar’s physical characteristics across different production temperatures and feedstocks, this research advances the practical application of biochar, offering significant benefits in agricultural, environmental, and engineering contexts.

54 ENVIRONMENTAL SCIENCES↗

2019 Computing Sciences Strategic Plan

Computing has transformed nearly every aspect of scientific inquiry — across disciplines and across scales — from the behavior of subatomic particles to the formation of structures in the early universe, from the assembly of the human genome to the evolution of earth systems. Over the past two decades, computing has become an integral part of how Berkeley Lab is “Bringing Science Solutions to the World.” Advances in computing and mathematics have been key, with new mathematical models of complex physical phenomena, new methods for analyzing complex data, new algorithms for accuracy and scaling and sophisticated software systems that encapsulate these techniques into open, reusable tools. The performance of NERSC computers and the ESnet network have grown by several orders of magnitude, along with our understanding of how to map scientific computations and workflows onto these systems. From research to facility operations, the passion, talent and dedication of the Computing Sciences Area staff has been the cornerstone of our success. The plan outlined in this document describes the next step in a journey to expand the influence and impact of our efforts, building an increasingly connected global enterprise for science that places more powerful instruments in the hands of scientists, along with more powerful methods and tools for modeling, analysis and prediction.

97 MATHEMATICS AND COMPUTING↗

Membrane-based Carbon Capture Process Optimization using CFD Modeling

Carbon capture is a promising option to mitigate CO2 emissions from existing coal-fired power plants, cement and steel industries, and petrochemical complexes. Among the available technologies, membrane-based carbon capture presents the lowest energy consumption, operating costs, and carbon footprint. In addition, membrane processes have important operational flexibility and response times. On the other hand, the major challenges to widespread application of this technology are related to reducing capital costs and improving membrane stability and durability. To upscale the technology into stacked flat sheet configurations, high fidelity computational fluid dynamics (CFD) that describes the separation process accurately are required. High fidelity simulations have been shown to be effective in studying the complex transport phenomena in membrane systems. In addition, obtaining high CO2 recovery percentages and product purity re-quires a multi-stage membrane process, where the optimal network configuration of the mem-brane modules must be studied in a systematic way. In order to address the design problem at process scale, we formulate a superstructure for the membrane-based carbon capture, including up to three separation stages. In the formulation of the optimization problem, we include reduced models, based on rigorous CFD simulations of the membrane modules.

Pedrozo, Hector A.↗

Decode the Workload: Training Deep Learning Models for Efficient Compute Cluster Representation

Monitoring the status of a high throughput computing cluster running computationally intensive production jobs is a crucial yet challenging system administration task due to the complexity of such systems. To this end, we train autoencoders using the Linux kernel CPU metrics of the cluster. Additionally, we explore assisting these models with graph neural networks to share information across threads within a compute node. The models are compared in terms of their ability to: 1) Produce a compressed latent representation that captures the salient features of the input, 2) Detect anomalous activity, and 3) Make distinction between different kinds of jobs run at Jefferson Lab. The goal is to have a robust encoder whose compressed embeddings are used for several downstream tasks. We extend this study further by deploying these models in a human-in-the-loop production-based setting for the anomaly detection task and discuss the associated implementation aspects such as continual learning and the criterion to generate alarms. This study represents a first step in the endeavor towards building self-supervised large-scale foundation models for computing centers.

Mohammed, Ahmed↗

Control of Energy Transport and Transduction in Photosynthetic Down-Conversion (Final Technical Report)

The research conducted under this contract focused on three areas related to control of energy transport and transduction in natural and synthetic light harvesting systems: (1) experimental and theoretical studies exploring the use of ultrafast laser pulse shaping to manipulate the initially excited states of multi-chromophore biological light harvesting networks and influence the early time energy transfer and electronic and vibrational relaxation pathways, (2) fundamental theoretical developments aimed at computing and analyzing the dynamics of excitations of complex heterogeneous environments and nano structures, and (3) joint experimental and theoretical design studies of artificial light harvesting materials exploring the influence of incorporating different types of organic layers in low dimensional lead halide perovskite materials on their hot carrier relaxation dynamics, and theoretical studies of the design of nano structured light harvesting antenna systems. These research projects supported the training of three theoretical and computational graduate students, one experimental graduate student, and one experimental post-doctoral researcher. The research has been published in seven peer reviewed papers and presented at several international meetings and workshops.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Human Factors Design for Particle Accelerator Control Room Interfaces

Fermilab, the birthplace of many scientific discoveries in physics and particle accelerator sciences, is in the midst of a widescale modernization effort. The Accelerator Control Operations Research Network (ACORN project’s goal is to modernize the accelerator control system by replacing end-of-life power supplies and enhance future operations of the Fermilab accelerator complex with megawatt particle beams. Within ACORN, opportunities for process improvement concerning software development, human-system interface design, and task performance are also being considered. Human factors researchers from Idaho National Laboratory in collaboration with usability experts from Fermilab, are currently investigating human-centered design improvements for the accelerator control system. For example, substantial tribal knowledge and memory recall are required to effectively operate the accelerator system. This contributes to high cognitive workload and potential burnout of accelerator operators. Developing guidance for consistent visual and functional design enables a more intuitive interaction and relieves operators of cognitive burden. Additionally, developing more intuitive and integrated interfaces can also lead to improved accelerator efficacy by empowering operators with greater understanding and control of the systems. The challenge in developing such interfaces is in designing for a wide variety of user goals, system specifications, and level of experience in users. The challenges need to be met while e also considering the maintainability of the control system. The purpose of this paper is to detail the human factors process and design within the ACORN project, describe results gathered thus far, and discuss the larger implications for this work.

43 PARTICLE ACCELERATORS↗

Efficient mapping between void shapes and stress fields using Deep Convolutional Neural Networks with sparse data

Establishing fast and accurate structure-to-property relationships is an important component in the design and discovery of advanced materials. Physics-based simulation models like the finite element method (FEM) are often used to predict deformation, stress, and strain fields as a function of material microstructure in material and structural systems. Such models may be computationally expensive and time intensive if the underlying physics of the system is complex. This limits their application to solve inverse design problems and identify structures that maximize performance. In such scenarios, surrogate models are employed to make the forward mapping computationally efficient to evaluate. However, the high dimensionality of the input microstructure and the output field of interest often renders such surrogate models inefficient, especially when dealing with sparse data. Deep convolutional neural network (CNN) based surrogate models have shown great promise in handling such high-dimensional problems. In this paper, a single ellipsoidal void structure under a uniaxial tensile load represented by a linear elastic, high-dimensional and expensive-to-query, FEM model. We consider two deep CNN architectures, a modified convolutional autoencoder framework with a fully connected bottleneck and a UNet CNN, and compare their accuracy in predicting the von Mises stress field for any given input void shape in the FEM model. Additionally, a sensitivity analysis study is performed using the two approaches, where the variation in the prediction accuracy on unseen test data is studied through numerical experiments by varying the number of training samples from 20 to 100.

surrogate modeling; convolutional neural networks;↗

Processes in DNA damage response from a whole-cell multi-omics perspective

Technological advances have made it feasible to collect multi-condition multi-omic time courses of cellular response to perturbation, but the complexity of these datasets impedes discovery due to challenges in data management, analysis, visualization, and interpretation. Here, we report a whole-cell mechanistic analysis of HL-60 cellular response to bendamustine. We integrate both enrichment and network analysis to show the progression of DNA damage and programmed cell death over time in molecular, pathway, and process-level detail using an interactive analysis framework for multi-omics data. Our framework, Mechanism of Action Generator Involving Network analysis (MAGINE), automates network construction and enrichment analysis across multiple samples and platforms, which can be integrated into our annotated gene-set network to combine the strengths of networks and ontology-driven analysis. Taken together, our work demonstrates how multi-omics integration can be used to explore signaling processes at various resolutions and demonstrates multi-pathway involvement beyond the canonical bendamustine mechanism.

59 BASIC BIOLOGICAL SCIENCES↗

DancePartner: Python Package to Mine Multiomics Relationship Networks from Literature and Databases

A goal of multi-omics experiments is to understand how mechanistic molecular biology is altered between conditions, typically a control group and experimental groups. Oftentimes this involves studying changes in biomolecule relationships (e.g. interactions, metabolic relationships) of several types of biomolecules (e.g. proteins, lipids, metabolites). Though several databases contain relationships between biomolecules, understudied species may have little to no relationship information in databases and thus must be mined from literature. There are several challenges to literature mining, including automated full-text extraction, duplicate biomolecule term collapsing, and implementing complex machine learning tools. To make relationship extraction more accessible to the community, a python package called DancePartner was developed to allow for the extraction of relationships from literature and databases, with functions to map biomolecule synonyms to standardized identifiers and visualize and characterize the resulting multi-omics network. Here, in this study, an example dataset involving Caenorhabditis elegans is presented, where relationships are mined from 1443 publications using DancePartner. These relationships are combined with relationships from KEGG, WikiPathways, UniProt, and LipidMaps, and visualized.

BERT↗

A Model-Free Voltage Control Approach to Mitigate Motor Stalling and FIDVR for Smart Grids

Electric power networks are large and highly nonlinear dynamical systems that present unique challenges to control design. Though there is a large number of dynamic models for power system stability and control, many models are only useful with right assumptions and wrong for other tasks. Moreover, the dynamic behavior of the grid is increasingly complex under the banner of smart grids. These lead to the difficulty of developing appropriate dynamic modeling, and thus an efficient control strategy. To avoid such modeling challenges, here we present a novel dynamic voltage control strategy based on a model-free control (MFC) approach, requiring no modeling procedure. In particular, it focuses on fault-induced delayed voltage recovery (FIDVR) events, which require complex and accurate dynamic load models to replicate such events. This work utilizes MFC as an online controller to achieve the desired voltage stability under the FIDVR event. The proposed MFC strategy allows simple implementation and low computational cost for efficient mitigation of FIDVR. For benchmarking, a reasonably accurate dynamic performance model is explored. Simulation results with the IEEE 57 bus test network demonstrate the enhanced dynamic voltage profile for load buses having induction motors with the support of reactive power resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SIDDA: SInkhorn Dynamic Domain Adaptation

Modern neural networks (NNs) often do not generalize well in the presence of a "covariate shift"; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels remains unchanged. In such cases, NN generalization can be reduced to a problem of learning more domain-invariant features. Domain adaptation (DA) methods include a range of techniques aimed at achieving this; however, these methods have struggled with the need for extensive hyperparameter tuning, which then incurs significant computational costs. In this work, we introduce SIDDA, an out-of-the-box DA training algorithm built upon the Sinkhorn divergence, that can achieve effective domain alignment with minimal hyperparameter tuning and computational overhead. We demonstrate the efficacy of our method on multiple simulated and real datasets of varying complexity, including simple shapes, handwritten digits, and real astronomical observations. SIDDA is compatible with a variety of NN architectures, and it works particularly well in improving classification accuracy and model calibration when paired with equivariant neural networks (ENNs). We find that SIDDA enhances the generalization capabilities of NNs, achieving up to a ≈40% improvement in classification accuracy on unlabeled target data. We also study the efficacy of DA on ENNs with respect to the varying group orders of the dihedral group DN, and find that the model performance improves as the degree of equivariance increases. Finally, we find that SIDDA enhances model calibration on both source and target data--achieving over an order of magnitude improvement in the ECE and Brier score. SIDDA's versatility, combined with its automated approach to domain alignment, has the potential to advance multi-dataset studies by enabling the development of highly generalizable models.

Pandya, Sneh [Northeastern U.]↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗