Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Two-Step Hyperparameter Optimization Method: Accelerating Hyperparameter Search by Using a Fraction of a Training Dataset

Abstract Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic—primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms introduces added complexity to the workflow, leading to longer computation times. This poses a notable challenge to ML applications, as suboptimal hyperparameter selections curtail the potential of ML model performance, ultimately obstructing the full exploitation of ML techniques. In this article, we present a two-step HPO method as a strategic solution to curbing computational demands and wait times, gleaned from practical experiences in applied ML parameterization work. The initial phase involves a preliminary evaluation of hyperparameters on a small subset of the training dataset, followed by a reevaluation of the top-performing candidate models postretraining with the entire training dataset. This two-step HPO method is universally applicable across HPO search algorithms, and we argue it has attractive efficiency gains. As a case study, we present our recent application of the two-step HPO method to the development of neural network emulators for aerosol activation. Although our primary use case is a data-rich limit with many millions of samples, we also find that using up to 0.0025% of the data—a few thousand samples—in the initial step is sufficient to find optimal hyperparameter configurations from much more extensive sampling, achieving up to 135× speedup. The benefits of this method materialize through an assessment of hyperparameters and model performance, revealing the minimal model complexity required to achieve the best performance. The assortment of top-performing models harvested from the HPO process allows us to choose a high-performing model with a low inference cost for efficient use in global climate models (GCMs).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

DNA Reaction–Diffusion Attractor Patterns

Living systems can form and recover complex chemical patterns with precisely sized features in the ranges of tens or hundreds of microns. We show how designed reaction-diffusion processes can likewise produce precise patterns, termed attractor patterns, that reform their precise shape after being perturbed. We use oligonucleotide reaction networks, photolithography and microfluidic delivery to form precisely controlled attractor patterns and study the responses of these patterns to different localized perturbations. Linear and ‘hill’-shaped patterns formed and stabilized into shapes and at time scales consistent with reaction-diffusion models. When patterns were perturbed in particular locations with UV light, they reliably reformed their steady state profiles. Recovery also occurred after repeated perturbations. As a result, by designing the far-from-equilibrium dynamics of a chemical system, this study shows how it is possible to design spatial patterns of molecules that are sustained and regenerated by continually evolving towards a specific steady state configuration

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Physics-informed semantic inpainting: Application to geostatistical modeling

A fundamental problem in geostatistical modeling is to infer the heterogeneous geological field based on limited measurements and some prior spatial statistics. Semantic inpainting, a technique for image processing using deep generative models, has been recently applied for this purpose, demonstrating its effectiveness in dealing with complex spatial patterns. However, the original semantic inpainting framework incorporates only information from direct measurements, while in geostatistics indirect measurements are often plentiful. In this work, to overcome this limitation, we propose a physics-informed semantic inpainting framework, employing the Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) and jointly incorporating the direct and indirect measurements by exploiting the underlying physical laws. Our simulation results for a high-dimensional problem with 512 dimensions show that in the new method, the physical conservation laws are satisfied and contribute in enhancing the inpainting performance compared to using only the direct measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A native IgE in complex with profilin provides insights into allergen recognition and cross-reactivity

Allergies have become a rising health problem, where plentiful substances can trigger IgE-mediated allergies in humans. While profilins are considered minor allergens, these ubiquitous proteins are primary molecules involved in cross-reactivity and pollen-food allergy syndrome. Here we report the first crystal structures of murine Fab/IgE, with its chains naturally paired, in complex with the allergen profilin from Hevea brasiliensis (Hev b 8). The crystallographic models revealed that the IgE’s six complementarity-determining regions (CDRs) interact with the allergen, comprising a rigid paratope-epitope surface of 926 Å 2 , which includes an extensive network of interactions. Interestingly, we also observed previously unreported flexibility at Fab/IgE’s elbow angle, which did not influence the shape of the paratope. The Fab/IgE exhibits a high affinity for Hev b 8, even when using 1 M NaCl in BLI experiments. Finally, based on the encouraging cross-reactivity assays using two mutants of the maize profilin (Zea m 12), this antibody could be a promising tool in IgE engineering for diagnosis and research applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Physics-informed machine learning

Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into existing algorithms, mesh generation remains complex, and high-dimensional problems governed by parameterized PDEs cannot be tackled. Moreover, solving inverse problems with hidden physics is often prohibitively expensive and requires different formulations and elaborate computer codes. Machine learning has emerged as a promising alternative, but training deep neural networks requires big data, not always available for scientific problems. Instead, such networks can be trained from additional information obtained by enforcing the physical laws (for example, at random points in the continuous space-time domain). Such physics-informed learning integrates (noisy) data and mathematical models, and implements them through neural networks or other kernel-based regression networks. Moreover, it may be possible to design specialized network architectures that automatically satisfy some of the physical invariants for better accuracy, faster training and improved generalization. Furthermore, we review some of the prevailing trends in embedding physics into machine learning, present some of the current capabilities and limitations and discuss diverse applications of physics-informed learning both for forward and inverse problems, including discovering hidden physics and tackling high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Vanadium spin qubits as telecom quantum emitters in silicon carbide

Solid-state quantum emitters with spin registers are promising platforms for quantum communication, yet few emit in the narrow telecom band necessary for low-loss fiber networks. Here, we create and isolate near-surface single vanadium dopants in silicon carbide (SiC) with stable and narrow emission in the O band, with brightness allowing cavity-free detection in a wafer-scale material. In vanadium ensembles, we characterize the complex d 1 orbital physics in all five available sites in 4H-SiC and 6H-SiC. The optical transitions are sensitive to mass shifts from local silicon and carbon isotopes, enabling optically resolved nuclear spin registers. Optically detected magnetic resonance in the ground and excited orbital states reveals a variety of hyperfine interactions with the vanadium nuclear spin and clock transitions for quantum memories. Last, we demonstrate coherent quantum control of the spin state. These results provide a path for telecom emitters in the solid state for quantum applications.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

A dynamic protein interactome drives energy conservation and electron flux in Thermococcus kodakarensis

ABSTRACT Life is supported by energy gains fueled by catabolism of a wide range of substrates, each reliant on the selective partitioning of electrons through redox ( red uction and ox idation) reactions. Electron flux through tunable and regulated protein interactions provides dynamic routes for energy conservation, but how electron flux is regulated in vivo , particularly for archaeal metabolisms that support rapid growth at the thermodynamic limits of life, is poorly understood. Identification of bona fide in vivo protein assemblies and how such assemblies dictate the totality of electron flux is critical to our understanding of the regulation imposed on metabolism, energy production, and energy conservation. Here, 25 key proteins in central metabolic redox pathways in the model, genetically accessible, hyperthermophilic archaeon Thermococcus kodakarensis , were purified to reveal an extensive, dynamic, and tightly interconnected network of protein interactions that responds to environmental cues (such as the availability of various reductive sinks) to direct electron flux to maximize energetic gains. Interactions connecting disparate functions suggest many catabolic and anabolic activities occur in spatial proximity in vivo , and while protein complexes have been historically defined under optimal conditions, many of these complexes appear to maintain alternative partnerships in changing conditions. The totality of the results obtained redefines our understanding of in vivo assemblies driving ancient metabolic strategies supporting the growth of modern Archaea. IMPORTANCE Given the potential for rational genetic manipulations of biofuel- and biotech-promising archaea to yield transformative results for major markets, it is a priority to define how the metabolisms of such species are controlled, at least in part, by in vivo protein assemblies, and from such, define routes of energy flux that can be most efficiently altered toward biofuel or biotechnological gains. Proteinaceous electron carriers (PECs, such as ferredoxins) offer the potential for specific protein–protein interactions to coordinate selective reductive flow. Employing the model, genetically accessible, hyperthermophilic archaeon, Thermococcus kodakarensis , we establish the metabolic protein interactome of 25 key redox proteins, revealing that each redox active protein has a dynamic partnership profile, suggesting catabolic and anabolic activities may occur in concert and in temporal and spatial proximity in vivo . These results reveal critical importance in evaluating the newly identified partnerships and their role and utility in providing regulated redox flux in T. kodakarensis .

Williams, Sere A. (ORCID:0000000235509590)↗
DOE OSTI2020

Synchrophasor Measurements-based Events Detection Using Deep Learning

Deep learning algorithms have been developed for phasor measurement units (PMUs) analysis aiming at providing grid operators to observe and react to significant real-time changes in the grid associated with multiple factors (e.g., power generation and load variations, different type of faults, and equipment mailfunction), or for offline post-event system diagnostics. In this study, a Long Short-Term Memory (LSTM)-based deep neural network (DNN) is adopted and evaluated to identify the most appropriate model configurations for event detection and longer-term anomalous pattern extraction. The proposed DNN model shows the potential on long-term predictions with the ability to capture nonlinear and nonstationary mixture complex patterns in PMU datasets. Real-world PMU in the WECC system were used for model development and validation.

deep learning↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2022

Sivers extraction with Neural Network

Pseudo-data with simulated experimental errors can be generated to train an ensemble of Artificial Neural Networks (ANN) implemented on a regression to extract Transverse Momentum-dependent Distributions (TMDs). A preliminary analysis is presented on the reliability in extraction of the Sivers function imposed in the pseudo-data given the bounds on the experimental errors, data sparsity, and complexity of phase-space.

Fernando, Ishara↗
DOE OSTI2024

7-8 GHz Point-to-Point Testing

Wireless spectrum is a limiting resource for continued economic growth in the United States. As discussed in the recent National Spectrum Strategy (NSS), wireless spectrum underpins several aspects of the U.S. economy and the demand for additional spectrum is driving the need for realizing spectrum sharing to enable continued development. At the same time, wireless spectrum is an essential foundation of critical energy infrastructure, including electric, oil, and natural gas resources. In particular, wireless point-to-point (P2P) links are the backbone of vast infrastructure networks that enable the flow of sensor and control information needed to manage critical energy sector infrastructure in the United States. These links will only become more important as the energy sector incorporates more diverse sensing and more efficient control mechanisms, which increases system complexity and data volume requiring more resilient communications. Therefore, the continued economic development of the U.S. depends on determining novel approaches to spectrum management that balance both broad access for advanced wireless technologies and resilience for critical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Editorial for Special Issue “Advances in Soil Microbiome”

The soil microbiome (the community of all soil microorganisms and their surrounding environment) is a critical part of our ecological network. These microbial communities carry out several important functions, including the promotion of plant growth and the cycling of carbon and nitrogen sources. Despite the importance of this community, and the recent advances in multi-omic analysis and other methods designed to query complex systems, there is a still a large knowledge gap regarding the soil microbiome, its response to changing climates and moisture levels, the specific molecular mechanisms that drive its role in the environment, and how these questions can be answered through the use of model systems. Here, we present eleven new papers that seek to answer these questions and expand our knowledge of the soil microbiome.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Robust PCA-Deep Belief Network Surrogate Model for Distribution System Topology Identification with DERs

With the expansion of distribution networks and increased penetration of distributed energy resources (DERs), it is becoming increasingly important to obtain accurate distribution network topology in real-time. In this paper, a robust principal component analysis coupled deep belief network (PCA-DBN) surrogate model is proposed for distribution system topology identification. It integrates the benefits of robust feature extraction from PCA to deal with data quality issues and filter out noise, and the strength of DBN in capturing the nonlinear relationship between voltage amplitudes and the binary states of switchable connections. This also significantly reduces the DBN training complexity without loss of accuracy. It is shown that the widely used standard deviation of voltage drop and the voltage covariance matrix features yield less accuracy as compared to that of the voltage amplitudes in presence of high penetration of DERs and ZIP loads. Comparison results with other alternatives, such as the random forest (RF), multi-output regression (MOR) and the traditional DBN methods demonstrate that the proposed method can achieve a much higher topology identification accuracy while maintaining robustness to missing data and measurement noise under various penetration levels of DERs.

deep belief network↗
DOE OSTI2025

Accelerating computational fluid dynamics simulation of post-combustion carbon capture modeling with MeshGraphNets

Packed columns are commonly used in post-combustion processes to capture CO 2 emissions by providing enhanced contact area between a CO 2 -laden gas and CO 2 -absorbing solvent. To study and optimize solvent-based post-combustion carbon capture systems (CCSs), computational fluid dynamics (CFD) can be used to model the liquid–gas countercurrent flow hydrodynamics in these columns and derive key determinants of CO 2 -capture efficiency. However, the large design space of these systems hinders the application of CFD for design optimization due to its high computational cost. In contrast, data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. We build our surrogates using MeshGraphNets (MGN), a graph neural network framework that efficiently learns and produces mesh-based simulations. We apply MGN to a random packed column modeled with over 160K graph nodes and a design space consisting of three key input parameters: solvent surface tension, inlet velocity, and contact angle. Our models can adapt to a wide range of these parameters and accurately predict the complex interactions within the system at rates over 1700 times faster than CFD, affirming its practicality in downstream design optimization tasks. This underscores the robustness and versatility of MGN in modeling complex fluid dynamics for large-scale CCS analyses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Accurate Thermochemistry of Complex Lignin Structures via Density Functional Theory, Group Additivity, and Machine Learning

A molecular-level understanding of lignin structures and bond dissociation energies could facilitate depolymerization technologies. Still, this information is currently limited due to the lack of databases and the simplification of surrogate models. Here, substitution effects on seven common linkages in lignin polymers are systematically investigated. An automated reaction network generator is employed to create a database of structures. A new group additivity (GA) model based on principal component analysis (PCA) descriptors is introduced and trained on gas-phase density functional theory data of 4100 species at the M06-2X/6-311++G(d,p) level. Hydrogen bonds, local steric, and nonaromatic ring contributions are also incorporated. Lastly, we improve the accuracy of the group additivity model to reach the G4 theory by computing a data set of 770 species at this level and using a data fusion approach.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A Sustainable Multi-Dimensional Printable Material

Polymeric materials are usually tailored for specific functionality. A single polymer exhibiting multiple simultaneous functionalities often requires intricate molecular architecture, which is difficult to manufacture at scale because of its complex synthesis routes. In this work, a facile, partly renewable composition—prepared via reactive melt processing—that induces tunable functionalities such as 3D printability, shape recovery, and self-healing while exhibiting satisfactory mechanical properties is reported. The system with a hydrogen-bonded 3D network consists of thermally reversible nano-scale agglomerates of sustainable, rigid phenolic oligomers and crystallizable flexible polymer. Local molecular mobility and temperature-dependent relaxation and recovery of the non-equilibrium networked states enable exploiting these simultaneous functionalities. Transitions involving solidification and structure stabilization at ambient temperature spanning several hours after preheating only at 70 °C directly contrast typical thermoplastic or thermoplastic elastomer behaviors. Results from this study can inform the design of future rheology modifiers and materials for soft robotics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A Study on Efficient Reinforcement Learning Through Knowledge Transfer

Although Reinforcement Learning (RL) algorithms have made impressive progress in learning complex tasks over the past years, there are still prevailing short-comings and challenges. Specifically, the sample-inefficiency and limited adaptation across tasks often make classic RL techniques impractical for real-world applications despite the gained representational power when combining deep neural networks with RL, known as Deep Reinforcement Learning (DRL). Recently, a number of approaches to address those issues have emerged. Many of those solutions are based on smart DRL architectures that enhance single task algorithms with the capability to share knowledge between agents and across tasks by introducing Transfer Learning (TL) capabilities. Here this survey addresses strategies of knowledge transfer from simple parameter sharing to privacy preserving federated learning and aims at providing a general overview of the field of TL in the DRL domain, establishes a classification framework, and briefly describes representative works in the area.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Enabling site-specific well leakage risk estimation during geologic carbon sequestration using a modular deep-learning-based wellbore leakage model

Geologic carbon sequestration (GCS) is a promising technology for mitigating net carbon emissions and growing climate concern by storing CO 2 in reservoirs. Oil and gas brownfields are an attractive option for CO 2 storage, but these sites have many historical wellbores from petroleum production and can be a potential leakage pathway for CO 2 or formation brine. Therefore, risk management of GCS operations requires an assessment of potential well leakage. Due to the high uncertainty of the system, stochastic approaches are ideal for quantifying the range of risk behaviors, but they must be computationally efficient in the face of complex physics. Here, we develop a new physics-centric deep learning wellbore model to predict the leakage of CO 2 and brine through leaky wellbores. Multi-physics numerical simulations were used to generate data sets, and physics-informed features were introduced. Neural networks were optimized with an automated searching algorithm. Feature analysis quantifies the impact of each feature on model prediction and confirms the role of physics-inspired parameters. The model shows high predictive performance across a wide range of geologic and injection conditions and well attributes. In conclusion, a case study illustrates how the model is applied to assess well leakage in GCS operations.

58 GEOSCIENCES↗