Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

DOE Data Days 2023 Report

The DOE Data Days (D3) workshop brings together data managers, developers, researchers, and program managers across the Department of Energy (DOE) and national laboratories to highlight data management successes, identify potential synergies and common problems, and establish channels for collaboration across the DOE data management community. The fourth D3 workshop was held on October 24th to 26th, 2023 held entirely in-person at Lawrence Livermore National Laboratory (LLNL). The workshop was organized by a multi laboratory committee in an effort to bring data management practitioners at the DOE laboratories together to share their work and results, facilitating knowledge transfers and best practices across project teams. Tools and platforms to support data management and analysis are rapidly evolving and provide enormous opportunities. This report summarizes the important discussions and recommendations from the different working sessions and contains the agenda, submitted abstracts, presentations with links to recorded presentations, breakout session summaries, list of registered attendees, and lessons learned for future organizing committee. The report will be distributed to the DOE, each participating institution’s programmatic stakeholders, and attendees. The dedicated D3 website will host presentations, agenda, and report that is accessible by all labs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Autonomous closed-loop mechanistic investigation of molecular electrochemistry via automation

Abstract Electrochemical research often requires stringent combinations of experimental parameters that are demanding to manually locate. Recent advances in automated instrumentation and machine-learning algorithms unlock the possibility for accelerated studies of electrochemical fundamentals via high-throughput, online decision-making. Here we report an autonomous electrochemical platform that implements an adaptive, closed-loop workflow for mechanistic investigation of molecular electrochemistry. As a proof-of-concept, this platform autonomously identifies and investigates an EC mechanism, an interfacial electron transfer ( E step) followed by a solution reaction ( C step), for cobalt tetraphenylporphyrin exposed to a library of organohalide electrophiles. The generally applicable workflow accurately discerns the EC mechanism’s presence amid negative controls and outliers, adaptively designs desired experimental conditions, and quantitatively extracts kinetic information of the C step spanning over 7 orders of magnitude, from which mechanistic insights into oxidative addition pathways are gained. This work opens opportunities for autonomous mechanistic discoveries in self-driving electrochemistry laboratories without manual intervention.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Probing interfacial momentum closures in two-phase bubbly flow with machine learning-aided methods

Computational fluid dynamics (CFD) approach has already reached a high level of maturity for single-phase flows, however the development of closure models for two-phase flow requires additional attention. Multiphase CFD (M-CFD) methods resolve the conservation equations for mass, momentum and energy while differing in the approaches and strategies adopted in the physical closure models. The most widely adopted framework for M-CFD is the Eulerian-Eulerian two-fluid approach which assumes that all phases are co-existing inside each computational cell. For each fluid, the full set of conservation equations is solved; therefore, each fluid has a different velocity field. For adiabatic two-phase flow, the mechanisms of the interfacial momentum transfer are modeled by the interfacial forces representing different physical mechanisms. One of the crucial issues in the development and application of two-fluid model is the understanding of the interfacial momentum closures which determines the bubble distribution and migration behaviors. Dedicated experiments are performed to support the physical understanding and drive the closures’ development. However, limitations exist due to the uncertainties in the experimental measurement and the simplified analytical assumptions which have difficulties on representing the complex non-linear flow fields. In this paper, a data-driven approach, Feature Similarity Measurement (FSM), is developed and proposed to resolve the challenges of modeling the interfacial forces closures. Case study is performed with two-phase flow scenarios where the high-fidelity experimental data is available. Within the Eulerian-Eulerian two-fluid framework, only momentum equations for gas and liquid phases are solved and reduced-order interfacial momentum closures are aided with FSM. Predictions of void fraction and velocity fields are analyzed and demonstrate the potential of machine learning-driven interfacial forces closures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Process-informed adsorbent design guidelines for direct air capture

Direct air capture using solid adsorbents is a proven technology critical to reducing our net greenhouse gas emissions to zero and beyond. Currently, academic research into the technology mainly focuses on the development of new adsorbents. However, there is a discord between the adsorbent design and process performance. Many materials scientists focus on maximising metrics such as the CO 2 capacity of their adsorbent. Here, we combine detailed process modelling, machine learning, and extensive global sensitivity analysis, which entails varying all of the model parameters together, on a direct air capture process to show that the dry CO 2 adsorption capacity does not influence process performance for an amine-functionalised adsorbent operating in a temperature vacuum swing adsorption (TVSA) process, while it is important in a steam-assisted TVSA (S-TVSA) process. In fact, adsorption kinetics, density, and thermal conductivity are all critical attributes to obtaining a low energy penalty and reduced costs. The analysis also highlights the importance of heat transfer, directing process engineers to (alternative) adsorber designs that maximise this. By an in-depth evaluation of how process performance indicators are affected by materials properties and process operating parameters, this work provides guidance to both material scientists and process engineers towards the design of a “unicorn adsorbent” and intensified DAC processes. This will improve the performance of solid adsorbent direct air capture and help drive down the costs of this vital technology to avert the worst impacts of climate change.

42 ENGINEERING↗
DOE OSTI2021

Deep Learning Analysis of Polaritonic Wave Images

Deep learning (DL) is an emerging analysis tool across the sciences and engineering. Encouraged by the successes of DL in revealing quantitative trends in massive imaging data, we applied this approach to nanoscale deeply subdiffractional images of propagating polaritonic waves in complex materials. Utilizing the convolutional neural network (CNN), we developed a practical protocol for the rapid regression of images that quantifies the wavelength and the quality factor of polaritonic waves. Using simulated near-field images as training data, the CNN can be made to simultaneously extract polaritonic characteristics and material parameters in a time scale that is at least 3 orders of magnitude faster than common fitting/processing procedures. The CNN-based analysis was validated by examining the experimental near-field images of charge-transfer plasmon polaritons at graphene/α-RuCl3 interfaces. Our work provides a general framework for extracting quantitative information from images generated with a variety of scanning probe methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Deep learning of interface structures from simulated 4D STEM data: cation intermixing vs. roughening ∗

Abstract Interface structures in complex oxides remain an active area of condensed matter physics research, largely enabled by recent advances in scanning transmission electron microscopy (STEM). Yet the nature of the STEM contrast in which the structure is projected along the given direction precludes separation of possible structural models. Here, we utilize deep convolutional neural networks (DCNN) trained on simulated 4D STEM datasets to predict structural descriptors of interfaces. We focus on the widely studied interface between LaAlO 3 and SrTiO 3 , using dynamical diffraction theory and leveraging high performance computing to simulate thousands of possible 4D STEM datasets to train the DCNN to learn properties of the underlying structures on which the simulations are based. We test the DCNN on simulated data and show that it is possible (with >95% accuracy) to identify a physically rough from a chemically diffuse interface and create a DCNN regression model to predict step positions. We quantify the applicability of the model to different thicknesses and the transferability of the approach. The method shown here is general and can be applied for any inverse imaging problem where forward models are present.

42 ENGINEERING↗
DOE OSTI2023

Measurement of Beam Energy in the Fermilab's Linac taken at the transfer Line

Linac is the first machine in the Accelerator chain at Fermilab where 𝐻− particles are accelerated from 35 keV to 400 MeV and travel to the Booster where they are stripped. of the extra electrons to become protons. The Booster requires stable beam energy at injection. The Linac extraction energy tuning has been performed using two Beam Velocity Monitors (a.k.a Griffin detectors) to maintain stable relative energy between the Booster and the Linac. Our goal is to control the Linac energy parameters using Machine Learning techniques to increase reliability and quality of beam delivered from Linac. The first step is to understand the data from the Linac extraction diagnostics; and develop reliable, accurate methods for energy measurement and control before implementing machine learning. There were two methods of energy measurement implemented, and the results of these are compared. The first method was time of flight measurements using the Phase probes inside B eam Position Monitors (BPM) that provide the beam’s phase of arrival data. The second method used the relation between beam position data from the BPMs and dispersion values from the 400MeV MAD-X model to calculate momentum variation. The results of these two energy measurement methods compare well as the Linac energy is varied.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Creation Synthetic Data to Train a Digital Twin to Predict Reactor Operations

Understanding techniques to strengthen the nuclear safeguards regime is crucial in preventing nuclear proliferation due to recent advancements in the nuclear energy industry such as Generation IV reactors and microreactors. Prior to the construction of a nuclear power plant, it is necessary to understand the proliferation potential of the plant's reactor. Digital twins serve as a unique solution to recognizing reactor behavior indicative of nuclear proliferation. A digital twin is defined as a virtual model that works in unison to represent a physical asset, with a transference of data between the virtual and physical assets [1]. This work serves as validation for training a digital twin on synthetic data fabricated via means of Serpent reactor physics and point kinetics equations simulations. In this case this work is based on parameters of Idaho State University's AGN-201 reactor. The synthetic data can then be utilized to train machine learning models in the future to further investigate the utility of these methods. The accuracy of the predicted data is measured against real operational data to verify the reliability of the synthetic data creation methods and decide whether these methods should be used in the future to inform inspectors of a reactor's proliferation potential.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2023

Layer-wise Imaging Dataset from Powder Bed Additive Manufacturing Processes for Machine Learning Applications (Peregrine v2022-10.1)

This release consists of six datasets which together include multi-modal layer-wise powder bed images from two different powder bed printing technologies. These datasets are designed primarily to facilitate the development and testing of new computer vision and machine learning based anomaly and defect detection algorithms. The authors provide both training data with corresponding ground truth pixel masks and evaluation data with corresponding baseline prediction pixel masks made by a trained neural network. The laser powder bed fusion (L-PBF) datasets are sourced from EOS M290 and AddUp FormUp 350 printers and the binder jet (BJ) dataset is sourced from an ExOne M-Flex printer. The materials represented in these datasets include 17-4 PH Stainless Steel, GammaPrint-700, Inconel 718, Maraging Steel, and H13 Steel. The sensor imaging modalities represented include visible-light (VL), temporally-integrated (i.e., long duration exposure) near-infrared (TI-NIR), and wide-band infrared (IR). To download the dataset: (1) Create a Globus account. (2) Create a Globus Endpoint on your computer. (3) Transfer the dataset from the OLCF DOI-DOWNLOADS Collection to your Collection. Common troubleshooting steps: (a) Confirm that the transfer is going from OLCF DOI-DOWNLOADS to your Collection. (b) Create an exception for Globus in your antivirus software so that it can create an Endpoint. (c) Manually create a Globus access directory (where the data will be downloaded) by going to the Preferences > Access tab.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A foundation model for non-destructive defect identification from vibrational spectra

Defects are ubiquitous in solids and strongly influence materials’ functional properties. However, non-destructive characterization and quantification of defects, especially when multiple types coexist, remain a long-standing challenge. Here, we introduce DefectNet, a foundation machine learning model that predicts the chemical identity and concentration of substitutional point defects with multiple coexisting elements directly from vibrational spectra, specifically phonon density-of-states (PDoS). Trained on over 16,000 simulated spectra from 2,000 semiconductors, DefectNet employs a tailored attention mechanism to identify up to six distinct defect elements at concentrations ranging from 0.2% to 25%. The model generalizes well to unseen crystals across 56 elements and can be fine-tuned on experimental data. Validation using inelastic scattering measurements of SiGe alloys and MgB 2 superconductor demonstrates its accuracy and transferability. Furthermore, our work establishes vibrational spectroscopy as a viable, non-destructive probe for bulk point defect quantification, and highlights the promise of foundation models in data-driven defect engineering.

artificial intelligence↗
DOE OSTI2023

Geospatial mapping of distribution grid with machine learning and publicly-accessible multi-modal data

Abstract Detailed and location-aware distribution grid information is a prerequisite for various power system applications such as renewable energy integration, wildfire risk assessment, and infrastructure planning. However, a generalizable and scalable approach to obtain such information is still lacking. In this work, we develop a machine-learning-based framework to map both overhead and underground distribution grids using widely-available multi-modal data including street view images, road networks, and building maps. Benchmarked against the utility-owned distribution grid map in California, our framework achieves > 80% precision and recall on average in the geospatial mapping of grids. The framework developed with the California data can be transferred to Sub-Saharan Africa and maintain the same level of precision without fine-tuning, demonstrating its generalizability. Furthermore, our framework achieves a R 2 of 0.63 in measuring the fraction of underground power lines at the aggregate level for estimating grid exposure to wildfires. We offer the framework as an open tool for mapping and analyzing distribution grids solely based on publicly-accessible data to support the construction and maintenance of reliable and clean energy systems around the world.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Synthesis and Analysis of Performance-Advantaged Bioproducts

Performance-advantaged bioproducts (PABPs) are "novel products where the bio-based product does not resemble an existing petroleum-derived molecule but offers a performance advantage over existing products" (Fitzgerald, Bailey 2018). PABPs are an exciting area with near-term potential to accelerate the bioeconomy. We focus on synthesis, characterization, and economic and sustainability analyses for PABPs, aiming to leverage the inherent chemical functionality of molecules from carbohydrates and lignin via chemical and biological transformations. We collaborate with other BETO projects to source new molecules. Our work is integrated with the Inverse Design project, which provides computational predictions for PABPs and first principles-based results to explain observed properties. Primary outcomes include 1) a Nature Reviews Materials paper that establishes PABP design principles, 2) PA nylons from beta-ketoadipic acid, 3) new recyclable thermosets from bio-aromatic amines, 4) new PA plasticizers that are less toxic, and 5) the experimental validation of a machine learning tool, PolyML, from the Inverse Design project. Going forward, we are working towards an integrated framework to dramatically narrow PABP design space and a materials flow analysis of commodity chemicals as a benchmark for PABPs. Our main challenges are in the sourcing of new molecules that are not commercially available and the need for comprehensive characterizations and scale-up for technology transfer.

BIOMASS FUELS↗
DOE OSTI2023

Frost prediction using machine learning and deep neural network models

This study describes accurate, computationally efficient models that can be implemented for practical use in predicting frost events for point-scale agricultural applications. Frost damage in agriculture is a costly burden to farmers and global food security alike. Timely prediction of frost events is important to reduce the cost of agricultural frost damage and traditional numerical weather forecasts are often inaccurate at the field-scale in complex terrain. In this paper, we developed machine learning (ML) algorithms for the prediction of such frost events near Alcalde, NM at the point-scale. ML algorithms investigated include deep neural network, convolution neural networks, and random forest models at lead-times of 6–48 h. Our results show promising accuracy (6-h prediction RMSE = 1.53–1.72°C) for use in frost and minimum temperature prediction applications. Seasonal differences in model predictions resulted in a slight negative bias during Spring and Summer months and a positive bias in Fall and Winter months. Additionally, we tested the model transferability by continuing training and testing using data from sensors at a nearby farm. We calculated the feature importance of the random forest models and were able to determine which parameters provided the models with the most useful information for predictions. We determined that soil temperature is a key parameter in longer term predictions (>24 h), while other temperature related parameters provide the majority of information for shorter term predictions. The model error compared favorable to previous ML based frost studies and outperformed the physically based High Resolution Rapid Refresh forecasting system making our ML-models attractive for deployment toward real-time monitoring of frost events and damage at commercial farming operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Modeling antiphase boundary energies of Ni 3 Al-based alloys using automated density functional theory and machine learning

Antiphase boundaries (APBs) are planar defects that play a critical role in strengthening Ni-based superalloys, and their sensitivity to alloy composition offers a flexible tuning parameter for alloy design. Here, we report a computational workflow to enable the development of sufficient data to train machine-learning (ML) models to automate the study of the effect of composition on the (111) APB energy in Ni 3 Al-based alloys. We employ ML to leverage this wealth of data and identify several physical properties that are used to build predictive models for the APB energy that achieve a cross-validation error of 0.033 J m –2 . We demonstrate the transferability of these models by predicting APB energies in commercial superalloys. Moreover, our use of physically motivated features such as the ordering energy and stoichiometry-based features opens the way to using existing materials properties databases to guide superalloy design strategies to maximize the APB energy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Low Cost Glass-Ceramic Matrix Composite Heat Exchanger

As part of ARPA-E’s High Intensity Thermal Exchange through Materials and Manufacturing Processes (HITEMMP) program, this project sought to develop novel heat exchanger (HX) capabilities to enable efficient and power dense power generation cycles. This class of HX comes under the category of ceramic/composite materials with the higher temperature goal in the program of ≥1100 °C inlet temperature operation. The enabling capability of this effort is the use of glass-ceramic matrix composite (GCMC) material which provides the high temperature durability of a ceramic, the flaw tolerance of a composite, a significantly faster and lower cost manufacturing process than conventional matrix CMCs and very low porosity levels < 0.5%. For thin-walled HX structures and the need to minimize leakage, the low porosity differentiator is particularly important. RTRC has prior experience with this material system and in the current project advanced the component design and manufacturing methods into new territory to produce features required for effective heat exchange under high pressures. In this approach, silicon carbide fiber is fabricated into a fiber preform using various textile processes. Graphite tooling is used both during the build-up of the fiber preform (interior tooling) and after the fiber preform has been completed (exterior tooling). This tooling assembly is heated to high temperature in an environment that has been evacuated and backfilled with inert gas. A reservoir of specialty glass is present and once the desired temperature has been reached to achieve the desired glass viscosity, an actuator distributes the glass throughout the fiber preform using passageways which are part of the tooling design in a process known as glass transfer molding. After the tooling has been removed, the composite is heat treated to convert the amorphous glass to a crystalline ceramic, providing improved properties. The project was divided into three phases focusing on the following: 1) 10 kW HX design and coupon-level tube sheet fabrication, 2) 10 kW HX fabrication, 3) 50 kW HX fabrication. During Budget Period 1 (BP1), additional risks were encountered and the need for additional funds was agreed upon by ARPA-E program leadership. Due to a variety of factors, the contract modification required nominally 18 months to execute at which time the HITEMMP program was effectively concluding. Because of this and the time that would be required to perform BP2 tasks, it was decided to conclude the project at the end of BP1. During the design of the 10 kW HX, manufacturing constraints were learned and incorporated, leading to a revised configuration for the fiber preform and HX. Heat exchange and pressure drop predictions also played a role in modifying the original design concept to be a higher aspect ratio shell-and-tube HX, simplifying the manufacturing process and improving the heat exchanger performance. Good gravimetric and volumetric thermal power densities of 11.2 kW/kg and 10,200 kW/m3 for the entire HX were projected that involved thermo-structural Finite Element Analysis to determine the structural mass needed for the high operation pressures of 250 bar cold inlet and 80 bar hot inlet. Fiber preforms using textile processes were produced for multiple headered tube sheets. Additional challenges were encountered during the glass transfer molding step for which solutions were identified, but programmatics did not allow them to be implemented in BP1. While complete HX test articles were not fabricated, the benefits of this GCMC material for a variety of high temperature applications remain.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2020

Semi-supervised Machine Learning Enables the Robust Detection of Multireference Character at Low Cost

Multireference (MR) diagnostics are common tools for identifying strongly correlated electronic structure that makes single-reference (SR) methods (e.g., density functional theory or DFT) insufficient for accurate property prediction. However, MR diagnostics typically require computationally demanding correlated wave function theory (WFT) calculations, and diagnostics often disagree or fail to predict MR effects on properties. To overcome these challenges, we introduce a semi-supervised machine learning (ML) approach with virtual adversarial training (VAT) of an MR classifier using 15 WFT and DFT MR diagnostics as inputs. In semi-supervised learning, only the most extreme SR or MR points are labeled, and the remaining point labels are learned. The resulting VAT model outperforms the alternatives, as quantified by the distinct property distributions of SR- and MR-classified molecules. Additionally, to reduce the cost of generating inputs to the VAT model, we leverage the VAT model’s robustness to noisy inputs by replacing WFT MR diagnostics with regression predictions in an MR decision engine workflow that preserves excellent performance. We demonstrate the transferability of our approach to larger molecules and those with distinct chemical composition from the training set. This MR decision engine demonstrates promise as a low-cost, high-accuracy approach to the automatic detection of strong correlation for predictive high-throughput screening.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A caloritronics-based Mott neuristor

Abstract Machine learning imitates the basic features of biological neural networks at a software level. A strong effort is currently being made to mimic neurons and synapses with hardware components, an approach known as neuromorphic computing. While recent advances in resistive switching have provided a path to emulate synapses at the 10 nm scale, a scalable neuron analogue is yet to be found. Here, we show how heat transfer can be utilized to mimic neuron functionalities in Mott nanodevices. We use the Joule heating created by current spikes to trigger the insulator-to-metal transition in a biased VO 2 nanogap. We show that thermal dynamics allow the implementation of the basic neuron functionalities: activity, leaky integrate-and-fire, volatility and rate coding. This approach could enable neuromorphic hardware to take full advantage of the rapid advances in memristive synapses, allowing for much denser and complex neural networks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗