Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Accelerating the Structure Exploration of Diverse Bi–Pt Nanoclusters via Physics‐Informed Machine Learning Potential and Particle Swarm Optimization

Bimetallic Bi–Pt nanoclusters exhibit diverse structural motifs, including core-shell, Janus, and mixed alloy configurations, due to the unique bonding characteristics between Bi and Pt atoms. Using density functional theory refinements from ChIMES physically machine-learned potential and CALYPSO particle swarm optimization global searches, 34 Bi20-Pt20 nanoclusters are systematically classified. The results reveal that Bi atoms predominantly occupy surface sites, driven by charge transfer effects. Cohesive energy trends alone prove insufficient for structure differentiation, necessitating a data-driven approach employing principal component analysis and K-means clustering. Furthermore, vibrational, electronic, and infrared spectral analyses provide additional insights into structure-property relationships. The findings offer an original framework for the automated classification and analysis of bimetallic nanoclusters, enhancing the understanding of their stability and functional properties.

bimetallic nanoparticles↗

The International Space Station (ISS) Solar Alpha Rotary Joint (SARJ): Materials & Processes (M&P) Lessons Learned for a Large, Spacecraft Rotating Mechanism

The ISS utilizes two large rotating mechanisms, the SARJ, as part of the solar arrays alignment system for more efficient power generation. The SARJ is a 10.3m circumference, nitrided 15-5PH steel race ring of triangular cross-section, with 12 sets of trundle bearing assemblies transferring load across the rolling joint. The SARJ mechanism rotates continuously and slowly - once every orbit, or every 90 minutes. In 2008, the starboard SARJ suffered a lubrication failure, resulting in severe damage (spalling) of one of the race ring surfaces. Extensive effort was conducted to prevent the port SARJ from suffering the same failure, and fortunately was ultimately successful in recovering the functionality of the starboard SARJ. The M&P function was key in determining the cause of failure and the means for mechanism recovery. From a M&P lessons-learned perspective, observations are made concerning the original SARJ design parameters (boundary conditions), the perceived need for nitriding the race ring, the test conditions employed during qualification, the environmental controls used for the hardware preflight, and the lubrication robustness necessary for complex kinematic mechanisms expecting high-reliability and long-life.

Golden, Johnny L.↗

DelPlasmid: Finding Plasmids with Deep Learning and Machine Learning v1

Extrachromosomal genetic elements or plasmids are an important driver of DNA exchange and genetic innovation in prokaryotes. The success of plasmids has been attributed to their independent replication from host cell chromosomes and their frequent self-transfer. In recent years, the Department of Energy has recognized the importance of plasmid DNA to the viability and success of microbial communities and JGI has responded with funding to support the research and development of new methods and tools for the efficient sequencing of plasmid DNA. LBNL #2019-037 is responsive to this call.

Andreopoulos, William↗

Machine learning predictions of near-surface permafrost extent at Teller 27, Teller 47, and the Kougarok 64 Hillslope sites on the Seward Peninsula, Alaska: Supporting Data

Geophysical surveys were conducted at the NGEE Arctic Teller mile marker 27 site, Teller mile marker 47 site, and Kougarok mile marker 64 site during the summers of 2018, 2019, and 2021. Additional data was collected at Teller mile marker 47 during September 2021 and August 2022. These surveys were used to identify locations of near-surface permafrost during the period of maximum seasonal thaw depth for ground truth data used in machine learning predictions of near-surface permafrost extent at each site. This dataset contains CSV files of ground truth observations of near-permafrost presence or absence for each site, where PF = 1 indicates permafrost presence and PF = 0 indicates permafrost absence. The dataset also includes 2 sets of binary rasters (WGS84 UTM zone 3) of permafrost extent for each site using 1) all of the training data and 2) the transferred model. For both sets of rasters, 0 = non-permafrost and 1 = permafrost. Included are 6 *.tif files and 5 *.csv files that include a data dictionary (dd.csv) and file-level metadata (flmd.csv). This dataset is in support of the paper "Machine learning-derived high-resolution maps of near-surface permafrost for three watersheds on the Seward Peninsula, Alaska" that is in review (May 2023). The Next-Generation Experiments: Arctic (NGEE Arctic), a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Neural network potential from bispectrum components: A case study on crystalline silicon

In this article, we present a systematic study on developing machine learning force fields (MLFFs) for crystalline silicon. While the main-stream approach of fitting a MLFF is to use a small and localized training set from molecular dynamics simulations, it is unlikely to cover the global features of the potential energy surface. Additionally, to remedy this issue, we used randomly generated symmetrical crystal structures to train a more general Si-MLFF. Furthermore, we performed substantial benchmarks among different choices of material descriptors and regression techniques on two different sets of silicon data. Our results show that neural network potential fitting with bispectrum coefficients as descriptors is a feasible method for obtaining accurate and transferable MLFFs.

36 MATERIALS SCIENCE↗

Inverse model based error detection in beamline optics

Optics tuning in transfer lines and LINACs can be challenging due to the fact that multiple combinations of machine settings can lead to the same diagnostic output. Moreover, the lack of a periodic solution can limit the ability to infer optics in the same way as rings from BPM signals. Model based approaches are often used to assist with the optics tuning in combination with optimization or parameter estimation. Here we have developed a novel approach using machine learning inverse models trained on a known configuration to detect variations in quadrupole settings without explicitly including them in the model. This paper shows a comparison of neural network models and linear models on both a simulation based study and experimental studies conducted at the AGS to RHIC transfer line at Brookhaven National Lab.

43 PARTICLE ACCELERATORS↗

Investigation of Mechanisms Associated with Nucleate Boiling Under Microgravity Conditions

The focus of the present work is to experimentally study and to analytically/numerically model the mechanisms of growth of bubbles attached to, and sliding along, a heated surface. To control the location of the active cavities, the number, the spacing, and the nucleation superheat, artificial cavities will be formed on silicon wafers. In order to study the effect of magnitude of components of gravitational acceleration acting parallel to, and normal to the surface, experiments will be conducted on surfaces inclined at different angles including a downward facing surface. Information on the temperature field around bubbles, bubble shape and size, and bubble induced liquid velocities will be obtained through the use of holography, video/high speed photography and hydrogen bubble techniques, respectively. Analytical/numerical models will be developed to describe the heat transfer including that through the micro-macro layer underneath and around a bubble. In the micro layer model capillary and disjoining pressures will be included. Evolution of the interface along with induced liquid motion will be modelled. Subsequent to the world at normal gravity, experiments will be conducted in the KC-135 or the Lear jet especially to learn about bubble growth/detachment under low gravity conditions. Finally, an experiment will be defined to be conducted under long duration of microgravity conditions in the space shuttle. The experiment in the space shuttle will provide microgravity data on bubble growth and detachment and will lead to a validation of the nucleate boiling heat transfer model developed from the preceding studies performed at normal and low gravity (KC-135 or Lear jet) conditions.

Dhir, Vijay K.↗

Davis Computational Spectroscopy Workflow—From Structure to Spectra

Here, we describe an automated workflow that connects a series of atomic simulation tools to investigate the relationship between atomic structure, lattice dynamics, materials properties, and inelastic neutron scattering (INS) spectra. Starting from the atomic simulation environment (ASE) as an interface, we demonstrate the use of a selection of calculators, including density functional theory (DFT) and density functional tight binding (DFTB), to optimize the structures and calculate interatomic force constants. We present the use of our workflow to compute the phonon frequencies and eigenvectors, which are required to accurately simulate the INS spectra in crystalline solids like diamond and graphite as well as molecular solids like rubrene. We have also implemented a machine-learning force field based on Chebyshev polynomials called the Chebyshev interaction model for efficient simulation (ChIMES) to improve the accuracy of the DFTB simulations. We then explore the transferability of our DFTB/ChIMES models by comparing simulations derived from different training sets. We show that DFTB/ChIMES demonstrates ~100× reduction in computational expense while retaining most of the accuracy of DFT as well as yielding high accuracy for different materials outside of our training sets. The DFTB/ChIMES method within the workflow expands the possibilities to use simulations to accurately predict materials properties of increasingly complex structures that would be unfeasible with ab initio methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fracture Characterization Via AI‐Assisted Analysis of Temperature Logs

Abstract Fractures control fluid flow, mass transport, and heat transfer in a geothermal reservoir. This makes accurate characterization of fracture networks a prerequisite for optimal design and control of a reservoir's exploitation. We develop a deep‐learning procedure to identify fracture locations via interpretation of temporally and spatially continuous downhole temperature measurements. A long short‐term memory fully convolutional network (LSTM‐FCN) is used both to capture long‐term dependencies in sequential temperature data and to distill local features around fractures. A wellbore and fractured‐reservoir thermal model is established to generate temperature data for network training. The trained LSTM‐FCN exhibits a unique ability to detect multiple fractures intersecting a borehole. We use the LSTM‐FCN algorithm to evaluate the effectiveness of different‐stage wellbore temperature measurements on fracture detection in a complex fractured system. Our experiments reveal that the use of various‐stage temperature information as an input feature set improves the robustness of fracture detection to noise interference. This study indicates the practical feasibility of obtaining accurate fracture‐network reconstructions from temperature signals, at reasonable computational cost.

Yang, Xiaoyu↗

Performance of Regolith Feed Systems for Analog Field Tests of In-Situ Resource Utilization Oxygen Production Plants in Mauna Kea, Hawaii

This paper focuses on practical aspects of mechanical auger and pneumatic regolith conveying system feeding In-Situ Resource Utilization Oxygen production plants. The subsystems of these feedstock delivery systems include an enclosed auger device, pneumatic venturi educator, jet-lift regolith transfer, innovative electro-cyclone gas-particle separation/filtration systems, and compressors capable of dealing with hot hydrogen and/or methane gas re-circulating in the system. Lessons learned from terrestrial laboratory, reduced gravity and field testing on Mauna Kea Volcano in Hawaii during NASA lunar analog field tests will be discussed and practical design tips will be presented.

Townsend, Ivan I.↗

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗

From the Knowledge-based Digital Platform (KbDP) Concept for Advanced Air Mobility Research to a Preliminary Prototype

Advanced Air Mobility (AAM) encompasses a range of innovative operational and technological changes to aviation (electric aircraft, increasingly automated aircraft, increasingly automated airspace operations, etc.) that are transforming aviation’s role in everyday movement of people and goods. There are multiple associated concepts and use cases for AAM, all interrelated, including small Unmanned Aircraft System (UAS) Traffic Management (UTM), Upper-Class E Traffic Management (ETM), Extensible Traffic Management (xTM), Regional Air Mobility (RAM), and Urban Air Mobility (UAM). These AAM operations must integrate with traditional Air Traffic Management (ATM) operations, as well as non-aviation modes of transportation and logistics. National Aeronautics and Space Administration (NASA) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of multi-modal transportation systems. The Knowledge-based Digital Platform (KbDP) is a concept being developed that ties the workflows of Project Managers (PM), Principal Investigators (PI), and System Engineers together across organizational boundaries. It does so through the management of an information database defined by mathematical, data science, and system engineering principles. Machine Learning (ML) algorithms play a key role in this concept by extracting meaningful knowledge from the information database, which the human user leverages to greatly improve the efficiency and effectiveness of their research. Expected benefits of this concept include improved technology transfers from research to production, improved research portfolio investments, and research outcomes that are more integrated with all aspects of the multi-modal transportation problem. The preliminary KbDP prototype has been realized using UAM as a pathfinder use case and developed by a team of system engineer, software developer, data scientist, and interns.

Systems Engineering↗

An Entropy-Maximization Approach to Automated Training Set Generation for Interatomic Potentials

Machine learning-based interatomic potentials are currently garnering a lot of attention as they strive to achieve the accuracy of electronic structure methods at the computational cost of empirical potentials. Given their generic functional forms, the transferability of these potentials is highly dependent on the quality of the training set, the generation of which can be highly labor-intensive. Good training sets should at once contain a very diverse set of configurations while avoiding redundancies that incur cost without providing benefits. We formalize these requirements in a local entropy-maximization framework and propose an automated sampling scheme to sample from this objective function. We show that this approach generates much more diverse training sets than unbiased sampling and is competitive with hand-crafted training sets.

74 ATOMIC AND MOLECULAR PHYSICS↗

Multitask Recommender Systems for Cancer Drug Response

The problem we are currently trying to address is that there are many types of cancer drugs and many types of cancers and there is not always experimental data for a specific cancer type and cancer drug interaction. While there is a large possible set of feasible drug and cancer combinations, testing each pair is not realistic due to the high monetary cost of cell-based assays. Thus, this leaves researchers with a difficult choice of what drugs they should test on specific cancer types. This issue is known as the cold-start problem. Our focus is on developing recommender systems capable of addressing the cold-start problem as it relates to interaction between cancer types and cancer drugs. One of the most effective ways to address the cold-start problem is through large data analysis, however due to the cost prohibitive nature of cancer research the largest available data set size is the Genomics of Drug Sensitivity in Cancer with 494,973 genomic associations. To achieve optimal model performance on the cold-start problem, it is advantageous to employ multitask algorithms that are capable of transferring information between cancer datasets. The aim of this report is to draw from adaptations and state of the art developments in both algorithms for recommender systems and multitask learning to model the interaction between cancer cell lines and cancer drugs. Cancer cell lines are defined by the US National Cancer Institute as "cancer cells that keep dividing and growing over time, under certain conditions in a laboratory". This paper will focus on evaluating the performance of Neural Collaborative Filtering and Gaussian Processes, as well as their multitask adaptations, on cancer datasets from CCLE, NCI60, GDSC and CTRP. These methods will be evaluated on model performance in regression prediction but also in interpretability.

60 APPLIED LIFE SCIENCES↗

Conversion of METL Diagnostic Flowmeters to Permanent Magnet Based Electromagnetic Flowmeters

The Mechanisms Engineering Test Loop (METL) uses three flowmeters to monitor sodium circulation through the main loop, the Cold Trap leg, and the Plugging Meter leg. When constructed, the Cold Trap flowmeter (CTFM) and Plugging Meter flowmeter (PMFM) were equipped with permanent magnets and Hall Sensors. By October of 2019, during normal operations, both the CTFM and PMFM failed, producing either erroneous or zero signals. Repairs to the flowmeters were attempted in January of 2020 but failed to resolve the issues. Therefore, starting in March of 2021, a plan was developed to convert the installed flowmeters to more robust permanent magnet based electromagnetic flowmeters (EMFMs). The Cold Trap EMFM (CT EMFM) and Plugging Meter EMFM (PM EMFM) were fully installed by August of 2021. Initial testing and commissioning were completed in November of 2021. Finally, the first calibration runs were finished in March of 2022. This report discusses the design, conversion, and calibration of the as-built CTFM and PMFM to robust permanent magnet based EMFMs. During the design phase, theoretical models were used to estimate the signal output and required magnet sizes. Then, the CTFM and PMFM were disassembled and converted to EMFMs. After commissioning, the CT EMFM and PM EMFM were calibrated using a ‘Time Transfer Procedure’ carried out with METL Expansion Vessels and Test Vessel Two. The accuracy of the calibration was estimated through an uncertainty analysis. Finally, the report describes some lessons learned for future flowmeter conversions and follow-up work. In total, both METL EMFM’s met the desired performance targets. Testing data showed that the METL EMFMs provide a output signal of roughly 2 mV at 1 GPM and 250 °C. During calibration, flowrates between 0.7 GPM and 2.4 GPM were achieved. In this flow range, calibration coefficients of 0.485 and 0.935 were measured as with errors ranging from 15-5% and 16-5% for the CT EMFM and PM EMFM, respectively. Above 1.5 GPM, the error was assumed to be about 5% for both METL EMFMs. Several points will be considered for future follow-up work on the METL EMFM’s. First, the signal noise issues in the PM EMFM will be addressed. It is likely the source of the noise is due to some stray EMF from a heater. Secondly, the NdFeB magnets will be replaced with a grade that has a Curie temperature above 80 °C. For example, a few grades of NeFeB magnets have Curie temperatures which exceed 150 °C and some SmCo magnets have Curie temperatures as high as 500 °C. Third, more calibration runs will be completed in the range of 0.5-2.5 GPM. This will further improve the accuracy of the calibration coefficient. Fourth, calibration runs will be completed up to 5 GPM. This requires a larger pressure relief valve to be installed on the Expansion Vessel and Test Vessel 2, as well as a revised calibration procedure. Lastly, calibration runs will be completed to account for cold spots in the system, which reduced the inlet temperature of the METL EMFMs. Overall, these points will improve the calibration coefficients derived in this work and also improve the performance of the METL EMFMs.

42 ENGINEERING↗

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine-learning modeling of magnetization dynamics in quasi-equilibrium and driven metallic spin systems

Here, we present a perspective on recent progress in machine-learning (ML) force-field approaches for large-scale Landau–Lifshitz–Gilbert (LLG) simulations of metallic spin systems. Building on a generalization of the Behler–Parrinello (BP) architecture originally developed for quantum molecular dynamics, we develop scalable and transferable ML models that faithfully capture the complex, environment-dependent electron-mediated exchange fields characteristic of itinerant magnets. A central ingredient of this framework is the implementation of symmetry-aware magnetic descriptors based on group-theoretical bispectrum formalisms. Leveraging these ML force fields, LLG simulations faithfully reproduce hallmark non-collinear magnetic orders—such as the 120° and tetrahedral states—on the triangular lattice, and successfully capture the complex spin textures emerging in the mixed-phase states of a square-lattice double-exchange model under thermal quench. We further discuss a generalized potential theory that extends the BP formalism to incorporate both conservative and nonconservative electronic torques, thereby enabling ML models to learn nonequilibrium exchange fields from computationally demanding microscopic approaches such as nonequilibrium Green’s-function techniques. This extension yields quantitatively accurate predictions of voltage-driven domain-wall motion and establishes a foundation for quantum-accurate, multiscale modeling of nonequilibrium spin dynamics and spintronic functionalities.

Descriptors↗