Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

PlasmidHostFinder: Prediction of Plasmid Hosts Using Random Forest

Plasmids play a major role facilitating the spread of antimicrobial resistance between bacteria. Understanding the host range and dissemination trajectories of plasmids is critical for surveillance and prevention of antimicrobial resistance. Identification of plasmid host ranges could be improved using automated pattern detection methods compared to homology-based methods due to the diversity and genetic plasticity of plasmids. In this study, we developed a method for predicting the host range of plasmids using machine learning—specifically, random forests. We trained the models with 8,519 plasmids from 359 different bacterial species per taxonomic level; the models achieved Matthews correlation coefficients of 0.662 and 0.867 at the species and order levels, respectively. Our results suggest that despite the diverse nature and genetic plasticity of plasmids, our random forest model can accurately distinguish between plasmid hosts. This tool is available online through the Center for Genomic Epidemiology (https://cge.cbs.dtu.dk/services/PlasmidHostFinder/).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Projecting the Thermal Response in a HTGR-Type System during Conduction Cooldown Using Graph-Laplacian Based Machine Learning

Accurate prediction of an off-normal event in a nuclear reactor is dependent upon the availability of sensory data, reactor core physical condition, and understanding of the underlying phenomenon. This work presents a method to project the data from some discrete sensory locations to the overall reactor domain during conduction cooldown scenarios similar to High Temperature Gas-cooled Reactors (HTGRs). The existing models for conductive cooldown in a heterogeneous multi-body system, such as an assembly of prismatic blocks or pebble beds relies on knowledge of the thermal contact conductance, requiring significant knowledge of local thermal contacts and heat transport possibilities across those contacts. With a priori knowledge of bulk geometry features and some discrete sensors, a machine learning approach was devised. The presented work uses an experimental facility to mimic conduction cooldown with an assembly of 68 cylindrical rods initially heated to 1200 K. High-fidelity temperature data were collected using an infrared (IR) camera to provide training data to the model and validate the predicted temperature data. The machine learning approach used here first converts the macroscopic bulk geometry information into Graph-Laplacian, and then uses the eigenvectors of the Graph-Laplacian to develop Kernel functions. Support vector regression (SVR) was implemented on the obtained Kernels and used to predict the thermal response in a packed rod assembly during a conduction cooldown experiment. The usage of SVR modeling differs from most models today because of its representation of thermal coupling between rods in the core. When trained with thermographic data, the average normalized error is less than 2% over 400 s, during which temperatures of the assembly have dropped by more than 500 K. The rod temperature prediction performance was significantly better for rods in the interior of the assembly compared to those near the exterior, likely due to the model simplification of the surroundings.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

An intercomparison of wall fluxes in a turbulent thermal convection chamber: Direct numerical simulations and wall-modeled large-eddy simulations enhanced by machine learning

Thermal convection in a closed chamber is driven by a warm bottom, a cold top, and side walls at various temperatures. Although wall fluxes are the source of convection energy, accurately modeling these fluxes (i.e., the wall model) is challenging. In large-eddy simulations (LESs), many wall models are traditionally derived from the canonical boundary layer, which may be unsuitable for thermal convection bounded by both horizontal and vertical walls. This study conducts a model intercomparison of dry convection in a cubic-meter chamber using three direct numerical simulations (DNSs) and four LESs with different wall models. The LESs employ traditional wall models, a new wall model employing physics-aware neural networks, and a refined grid near the walls. The experiment involves four cases with varying sidewall temperatures. Our results show that LESs capture the main flow features and the trends of mean fluxes. The physics-aware neural networks and refined wall grids can improve the temporally averaged local fluxes when the large-scale circulation has a preferred direction. Even without the local improvement of wall fluxes, the LES flow quantities (temperature and velocities) can still largely match those in DNSs, provided the mean flux largely matches the DNSs. Additionally, DNSs reveal that a variation in corner treatments has minimal impacts on the flow quantities away from corners. Finally, LESs underestimate the mean fluxes of the entire wall due to their inability to resolve corner regions, but their mean flux away from the corner can better match DNS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Subsurface Characterization of Hydraulic Fracture Test Site-2 (HFTS-2), Delaware Basin

Hydraulic Fracturing Test Site-2 (HFTS-2) is a field-based research experiment performed in the Wolfcamp Formation of the Permian (Delaware) Basin. This paper focuses on integration, advanced geological characterization, and 3D subsurface modeling of the comprehensive HFTS-2 dataset. The study showcases a multidisciplinary reservoir characterization approach that incorporates geology, petrophysics, geochemistry, geomechanics, microseismic, and subsurface engineering analysis. Subsurface characterization of organic-rich mudstone formations requires understanding complex hydraulic fracture network growth in relation to inherent lithology, geomechanical properties, and interaction with pre-existing natural fractures. This paper presents a characterization workflow incorporating pre- and post-stimulation subsurface data, unique to the HFTS-2 dataset. The study integrated: (1) rock properties from logs, cores, and thin sections; (2) natural and hydraulic fracture descriptions from cores and image logs; (3) local and regional stresses; (4) geomechanics; (5) microseismic; (6) fiber optic (FO) and bottomhole pressure gauge (BHPG) response; and (7) produced fluids analysis. During a stimulation treatment, creation of the stimulated rock volume (SRV) is influenced by several subsurface factors. Key contributing factors include structural context, stress conditions, lithology, facies architecture, pre-existing natural fractures, and geomechanical properties. The HFTS-2 subsurface data integration indicates that the SRV is comprised of a complex juxtaposition of hydraulic fracture swarms, as evidenced by image logs analysis, core description, and microseismic monitoring. The HFTS-2 microseismic event density was used to generate 3D heat maps that serve as a representative SRV footprint, corroborated by secondary datasets. These maps were further integrated with petrophysical and geomechanical characteristics, as well as responses from FO and BHPG, to estimate the lateral and vertical dimensions of the effective fractures. The geological characterization for the HFTS-2 dataset combined with 3D modeling for petrophysical and geomechanical properties provides a strong foundation for subsurface simulation and optimization studies. Downloaded from http://onepetro.org/URTECONF/proceedings-pdf/21URTC/1-21URTC/D011S005R001/2477501/urtec-2021-5243-ms.pdf/1 by Carol Worster on 28 February 2022 URTeC 5243 The workflow improved our understanding of HFTS-2 hydraulic fracture propagation and characteristics in relation to offset pressure depletion and interaction with pre-existing natural fractures. Analysis showed that fracture geometry varies by stage and by well, and a complex fracture network is generated with varying fracture density. The multidisciplinary workflow presented herein for integration and characterization serves as a foundation to evaluate completion efficiency and estimate areal and vertical stimulation and depletion extent for the project. Furthermore, the workflow and learnings can also be transferred to other unconventional plays.

58 GEOSCIENCES↗
DOE OSTI2020

ADPSM Learning Team Review 2015-001. NPI-7 Drum/POC Dropped – Leads to Improved Lifting

As part of the ADPSM Safety Improvement Plan, the WSST has established a subcommittee for a Learning Team. The purpose of a Learning Team is to transfer and communicate the information into operational feedback and improvement. We want to pay attention to the small things that go wrong because they are often early warning signals and may provide insight into the health of the whole system.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems

The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.

DER integration↗
DOE OSTI2025

Potential Cost Reduction in New Nuclear Deployments Based on Recent AP1000 Experience

The completion of Vogtle Units 3 and 4, despite significant cost and schedule overruns, a major bankruptcy, and a pandemic, demonstrates that the U.S. nuclear industry can still develop new supply chains, train a highly skilled workforce, and build large nuclear power plants. Vogtle, being a first-of-a-kind (FOAK) plant, faced overruns, but FOAK overruns can decrease with more deployments through a combination of design standardization and modularization, transferring and implementing lessons learned between consecutive projects, and innovation. This report quantifies the potential cost and schedule reductions in future AP1000 plants in the US and identifies the barriers in achieving those reductions. It starts with a summary and analysis of the cost and construction timeline data for AP1000 plants that started construction in the United States (Vogtle) and China. Motivated by the steep schedule reductions from the first to second series of AP1000 plants in China, a cost reduction model was developed to quantify potential reductions for future AP1000 builds in the US. Results show that within about 3 more builds, AP1000s can become economically attractive in large markets in the U.S., without leveraging the Investment Tax Credit (ITC) or Production Tax Credit (PTC), and much sooner if these tax credits are available. Importantly the financial risks for future AP1000 builds in the US might be much smaller than observed in the FOAK plants. The study also identifies various barriers for future builds including the availability of a supply chain and a skilled workforce, and emphasizes the importance of making investments to gather and implement lessons learned between consecutive projects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Data-driven, structure-preserving approximations to entropy-based moment closures for kinetic equations

In this study, we present a data-driven approach for approximating entropy-based closures of moment systems from kinetic equations. The proposed closure learns the entropy function by fitting the map between the moments and the entropy of the moment system, and thus does not depend on the spacetime discretization of the moment system or specific problem configurations such as initial and boundary conditions. With convex and C 2 approximations, this data-driven closure inherits several structural properties from entropy-based closures, such as entropy dissipation, hyperbolicity, and H-Theorem. We construct convex approximations to the Maxwell–Boltzmann entropy using convex splines and neural networks, test them on the plane source benchmark problem for linear transport in slab geometry, and compare the results to the standard, entropy-based systems which solve a convex optimization problem to find the closure. Numerical results indicate that these data-driven closures provide accurate solutions in much less computation time than that required by the optimization routine.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Transferable Water Potentials Using Equivariant Neural Networks

Machine learning interatomic potentials (MLIPs) have emerged as a technique that promises quantum theory accuracy for reduced cost. It has been proposed [J. Chem. Phys. 2023, 158, 084111] that MLIPs trained on solely liquid water data cannot accurately transfer to the vapor–liquid equilibrium while recovering the many-body decomposition (MBD) analysis of gas-phase water clusters. This suggests that MLIPs do not directly learn the physically correct interactions of water molecules, limiting transferability. In this work, we show that MLIPs using equivariant architecture and trained on 3200 liquid water structures reproduces liquid-phase water properties (e.g., density within 0.003 g/cm 3 between 230 and 365 K), vapor–liquid equilibrium properties up to 550 K, the MBD analysis of gas-phase water cluster up to six-body interactions, and the relative energy and the vibrational density of states of ice phases. We show that potentials developed using equivariant MLIPs allow transferability for arbitrary phases of water that remain stable in nanosecond long simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Exploratory analysis and performance prediction of big data transfer in High-performance Networks

Big data transfer in large-scale scientific and business applications is increasingly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) via advance bandwidth reservation. Provisioning agents need to carefully schedule data transfer requests, compute network paths, and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized, could be simply wasted due to the exclusive access during the approved time window, and cause extra overhead and complexity for resource management. This calls for accurate performance prediction to reserve bandwidths that match actual needs and avoid over-provisioning. We employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements collected in the past several years from data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated testbeds. We first analyze the performance patterns in response to a comprehensive list of parameters in end-host systems, network connections, and data transfer applications, which motivate the use of machine learning and also help us identify the effects of latent factors. We then propose threshold- and clustering-based methods to eliminate negative effects of latent factors in data preprocessing and build a robust performance predictor based on customized domain-oriented loss functions. The performance of the proposed methods is verified by extensive experiments using SVR and RFR as well as theoretical analysis of the general performance bound.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding

Free-space optical information transfer through diffusive media is critical in many applications, such as biomedical devices and optical communication, but remains challenging due to random, unknown perturbations in the optical path. We demonstrate an optical diffractive decoder with electronic encoding to accurately transfer the optical information of interest, corresponding to, e.g., any arbitrary input object or message, through unknown random phase diffusers along the optical path. This hybrid electronic-optical model, trained using supervised learning, comprises a convolutional neural network-based electronic encoder and successive passive diffractive layers that are jointly optimized. After their joint training using deep learning, our hybrid model can transfer optical information through unknown phase diffusers, demonstrating generalization to new random diffusers never seen before. The resulting electronic-encoder and optical-decoder model was experimentally validated using a 3D-printed diffractive network that axially spans <70λ, where λ = 0.75 mm is the illumination wavelength in the terahertz spectrum, carrying the desired optical information through random unknown diffusers. The presented framework can be physically scaled to operate at different parts of the electromagnetic spectrum, without retraining its components, and would offer low-power and compact solutions for optical information transfer in free space through unknown random diffusive media.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Catalyst carbonylation: a hidden, but essential, step in reaction initiation

The proliferation of increasingly useful reactions for hydrogen transfer in organic synthesis has included the introduction of many new homogeneous catalysts into the organic synthesis lexicon. Unlike the proliferation of palladium-based cross-coupling reactions in which the mechanism is generally conserved, we are learning that these emerging hydrogen transfer catalysts have a rich diversity of mechanisms for catalyst activation, speciation, C–H bond cleavage and formation, and ultimately deactivation. We find that an underappreciated commonality in the catalytic activation for some of these systems is the generation of a (carbonyl)metal group, which dominates the downstream speciation of the catalyst system. In this mini-review we highlight a few well-documented cases of this phenomenon as food for thought for those who are designing new catalytic systems to introduce into this dynamic and impactful area.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Accurate Prediction of Voltage of Battery Electrode Materials Using Attention-Based Graph Neural Networks

Performing first-principles calculations to discover electrodes’ properties in the large chemical space is a challenging task. While machine learning (ML) has been applied to effectively accelerate those discoveries, most of the applied methods ignore the materials’ spatial information and only use predefined features: based only on chemical compositions. Here, we propose two attention-based graph convolutional neural network techniques to learn the average voltage of electrodes. Our proposed methods, which combine both atomic composition and atomic coordinates in 3D-space, improve the accuracy in voltage prediction significantly when compared to composition-based ML models. The first model directly learns the chemical reaction of electrodes and metal ions to predict their average voltage, whereas the second model combines electrodes’ ML predicted formation energy (E form ) to compute their average voltage. Our E form -based model demonstrates improved accuracy in transferability from our subset of learned Li ions to Na ions. Moreover, we predicted the theoretical voltage of 10 Na x MPO 4 F (M = Ti, Cr, Fe, Cu, Mn, Co, and Ni) fluorophosphate battery frameworks, which are unavailable in the Material Project database. It could be shown that we can expect average voltages higher than 3.1 V from those Na battery frameworks except from the NaTiPO 4 F and TiPO 4 F pair of electrodes, which offer an average voltage of 1.32 V.

25 ENERGY STORAGE↗
DOE OSTI2022

Classification of bacterial plasmid and chromosome derived sequences using machine learning

Plasmids are important genetic elements that facilitate horizonal gene transfer between bacteria and contribute to the spread of virulence and antimicrobial resistance. Most bacterial genome sequences in the public archives exist in draft form with many contigs, making it difficult to determine if a contig is of chromosomal or plasmid origin. Using a training set of contigs comprising 10,584 chromosomes and 10,654 plasmids from the PATRIC database, we evaluated several machine learning models including random forest, logistic regression, XGBoost, and a neural network for their ability to classify chromosomal and plasmid sequences using nucleotide k-mers as features. Based on the methods tested, a neural network model that used nucleotide 6-mers as features that was trained on randomly selected chromosomal and plasmid subsequences 5kb in length achieved the best performance, outperforming existing out-of-the-box methods, with an average accuracy of 89.38% ± 2.16% over a 10-fold cross validation. The model accuracy can be improved to 92.08% by using a voting strategy when classifying holdout sequences. In both plasmids and chromosomes, subsequences encoding functions involved in horizontal gene transfer—including hypothetical proteins, transporters, phage, mobile elements, and CRISPR elements—were most likely to be misclassified by the model. This study provides a straightforward approach for identifying plasmid-encoding sequences in short read assemblies without the need for sequence alignment-based tools.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Size-Transferable Prediction of Excited State Properties for Molecular Assemblies with a Machine Learning Exciton Model

Computational modeling of the excited states of molecular aggregates faces significant computational challenges and size heterogeneity. Current machine learning (ML) models, typically trained on specific-sized aggregates, struggle with scalability. We found that the exciton model Hamiltonian of large aggregates can be decomposed into dimer pairs, allowing an ML model trained on dimers to reconstruct Hamiltonians for aggregates of any size. We also proposed a new method to address the phase-correction problem by introducing coupling terms’ approximations. Our model accurately predicted the excitation energies of the trimer and tetramer of perylene and tetracene and estimated S1 oscillator strengths of perylene aggregates. Leveraging our ML model, the optical gaps of nanosized perylene aggregates with up to 50 monomers are analyzed, qualitatively revealing the role of different couplings on their size dependency. Future work will explore transferability across different monomers to predict optical properties in heterogeneous assemblies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗