Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transfer Learning Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Maps of ice wedge thermokarst pool expansion from twenty-seven circumpolar survey areas

This repository includes data and code to accompany the manuscript 'Topography controls variability in circumpolar permafrost thaw pond expansion' by Abolt et al. The data include satellite imagery and derived maps of thermokarst pools from twenty-seven survey areas in North America and Siberia. The code, written in MATLAB (R2021a), contains demonstrations of the workflow for generating the maps. The demonstrations include training a generalized UNet for mapping thermokarst pools using data from three survey areas, 'fine tuning' the UNet for use at a specific survey area using transfer learning, applying a trained UNet to infer thermokarst pool extent within satellite imagery, and performing histogram matching as a pre-processing step to improve satellite imagery contrast. Contains MATLAB script files and M files, TIF files, shape files, XML, Excel, TXT, and CSV files.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Conversion of METL Diagnostic Flowmeters to Permanent Magnet Based Electromagnetic Flowmeters

The Mechanisms Engineering Test Loop (METL) uses three flowmeters to monitor sodium circulation through the main loop, the Cold Trap leg, and the Plugging Meter leg. When constructed, the Cold Trap flowmeter (CTFM) and Plugging Meter flowmeter (PMFM) were equipped with permanent magnets and Hall Sensors. By October of 2019, during normal operations, both the CTFM and PMFM failed, producing either erroneous or zero signals. Repairs to the flowmeters were attempted in January of 2020 but failed to resolve the issues. Therefore, starting in March of 2021, a plan was developed to convert the installed flowmeters to more robust permanent magnet based electromagnetic flowmeters (EMFMs). The Cold Trap EMFM (CT EMFM) and Plugging Meter EMFM (PM EMFM) were fully installed by August of 2021. Initial testing and commissioning were completed in November of 2021. Finally, the first calibration runs were finished in March of 2022. This report discusses the design, conversion, and calibration of the as-built CTFM and PMFM to robust permanent magnet based EMFMs. During the design phase, theoretical models were used to estimate the signal output and required magnet sizes. Then, the CTFM and PMFM were disassembled and converted to EMFMs. After commissioning, the CT EMFM and PM EMFM were calibrated using a ‘Time Transfer Procedure’ carried out with METL Expansion Vessels and Test Vessel Two. The accuracy of the calibration was estimated through an uncertainty analysis. Finally, the report describes some lessons learned for future flowmeter conversions and follow-up work. In total, both METL EMFM’s met the desired performance targets. Testing data showed that the METL EMFMs provide a output signal of roughly 2 mV at 1 GPM and 250 °C. During calibration, flowrates between 0.7 GPM and 2.4 GPM were achieved. In this flow range, calibration coefficients of 0.485 and 0.935 were measured as with errors ranging from 15-5% and 16-5% for the CT EMFM and PM EMFM, respectively. Above 1.5 GPM, the error was assumed to be about 5% for both METL EMFMs. Several points will be considered for future follow-up work on the METL EMFM’s. First, the signal noise issues in the PM EMFM will be addressed. It is likely the source of the noise is due to some stray EMF from a heater. Secondly, the NdFeB magnets will be replaced with a grade that has a Curie temperature above 80 °C. For example, a few grades of NeFeB magnets have Curie temperatures which exceed 150 °C and some SmCo magnets have Curie temperatures as high as 500 °C. Third, more calibration runs will be completed in the range of 0.5-2.5 GPM. This will further improve the accuracy of the calibration coefficient. Fourth, calibration runs will be completed up to 5 GPM. This requires a larger pressure relief valve to be installed on the Expansion Vessel and Test Vessel 2, as well as a revised calibration procedure. Lastly, calibration runs will be completed to account for cold spots in the system, which reduced the inlet temperature of the METL EMFMs. Overall, these points will improve the calibration coefficients derived in this work and also improve the performance of the METL EMFMs.

42 ENGINEERING↗
NASA NTRSDate not supplied

Flow Boiling and Condensation Experiment (FBCE): Latest Findings from the Summary ISS Experiments

Since 2011, researchers from Purdue University and NASA Glenn Research Center (GRC) have been collaborating to investigate the effects of gravity on several aspects of flow boiling and flow condensation. This massive research endeavor, termed the Flow Boiling and Condensation Experiment (FBCE), has culminated in development of NASA’s largest and most complex facility for investigation of two-phase fluid physics onboard the ISS. FBCE consists of two separate studies: flow boiling, using the Flow Boiling Module (FBM), and flow condensation, using the Condensation Module for Heat Transfer Measurements (CM-HT); the FBM experiments have already been completed while the condensation experiments began in 2024. This presentation will summarize mostly new results from the flow boiling experiments, with a focus on analysis of pressure drop and two-phase flow instabilities in microgravity using both experimental data and video records from the ISS experiments, as well as development of machine learning models. These new predictive tools are part of the arsenal of predictive methods developed by the Purdue-Glenn team for design of future space systems.

Microgravity↗
DOE OSTI2022

Understanding and Leveraging the I/O Patterns of Emerging Machine Learning Analytics

The scientific community is currently experiencing unprecedented amounts of data generated by cutting-edge science facilities. Soon facilities will be producing up to 1 PB/s which will force scientist to use more autonomous techniques to learn from the data. The adoption of machine learning methods, like deep learning techniques, in large-scale workflows comes with a shift in the workflow’s computational and I/O patterns. These changes often include iterative processes and model architecture searches, in which datasets are analyzed multiple times in different formats with different model configurations in order to find accurate, reliable and efficient learning models. This shift in behavior brings changes in I/O patterns at the application level as well at the system level. These changes also bring new challenges for the HPC I/O teams, since these patterns contain more complex I/O workloads. In this paper we discuss the I/O patterns experienced by emerging analytical codes that rely on machine learning algorithms and highlight the challenges in designing efficient I/O transfers for such workflows. We comment on how to leverage the data access patterns in order to fetch in a more efficient way the required input data in the format and order given by the needs of the application and how to optimize the data path between collaborative processes. We will motivate our work and show performance gains with a study case of medical applications.

Gainaru, Ana↗
DOE OSTI2020

Accelerating high-strain continuum-scale brittle fracture simulations with machine learning

Failure in brittle materials under dynamic loading conditions is a result of the propagation and coalescence of microcracks. Simulating this discrete crack evolution at the continuum level is computationally expensive or, in some cases, intractable, resulting in the need to make broad assumptions or neglect key physics. In this work, we have developed an approach using machine learning that overcomes the current inability to represent meso-scale physics at the macro-scale. Our approach leverages damage and stress data from a computationally expensive high-fidelity model that explicitly resolves microcrack behavior to build an inexpensive machine learning emulator. Once trained, the machine learning emulator is used to predict the evolution of crack length statistics, which then informs a continuum-scale constitutive model. This results in a significant speed-up of the workflow by four orders of magnitude. Both the machine learning emulator and the continuum-scale model are validated against the high-fidelity model and experimental data, respectively, showing excellent agreement. There are two key findings. The first is that we can reduce the dimensionality of the problem, establishing that the machine learning emulator only needs the length of the longest crack and one of the maximum stress components to capture the necessary physics. Another compelling finding is that the emulator can be trained in one experimental setting and transferred successfully to predict behavior in a different setting.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Machine Learning Based Prediction of Airflow Maldistribution in A-Type Heat Exchangers

Airflow maldistribution is one of the primary causes of performance degradation in air-to refrigerant heat exchangers (HX) and has been shown to decrease heat transfer by as much as 35%. As a result, many units are oversized to meet the target capacity, resulting in increased system cost and refrigerant charge. Several studies have explored how characteristics like package type and HX geometry impact the flow profile, but results are restricted to a limited range of parameters and cannot be extrapolated to new designs. In this work, a machine learning (ML) model is trained to predict the inlet flow profile of dry air entering A-type HXs across a broad range of geometries and conditions. Flow profiles are generated using a porous media CFD model and used to train an Artificial Neural Network (ANN) which exhibits maximum and average relative L2 norm errors of 0.48 and 0.05. Additionally, these predictions take less than a second to generate resulting in a speed up factor of 2.42E5 compared to CFD. Component-level simulations are conducted to determine the performance degradation resulting from the predicted airflow maldistribution profiles. The new ML model will enable rapid and accurate prediction of performance degradation resulting from airflow maldistribution in A-type HXs, allowing for more accurate and cost-effective HX design.

42 ENGINEERING↗
DOE OSTI2020

Probing interfacial momentum closures in two-phase bubbly flow with machine learning-aided methods

Computational fluid dynamics (CFD) approach has already reached a high level of maturity for single-phase flows, however the development of closure models for two-phase flow requires additional attention. Multiphase CFD (M-CFD) methods resolve the conservation equations for mass, momentum and energy while differing in the approaches and strategies adopted in the physical closure models. The most widely adopted framework for M-CFD is the Eulerian-Eulerian two-fluid approach which assumes that all phases are co-existing inside each computational cell. For each fluid, the full set of conservation equations is solved; therefore, each fluid has a different velocity field. For adiabatic two-phase flow, the mechanisms of the interfacial momentum transfer are modeled by the interfacial forces representing different physical mechanisms. One of the crucial issues in the development and application of two-fluid model is the understanding of the interfacial momentum closures which determines the bubble distribution and migration behaviors. Dedicated experiments are performed to support the physical understanding and drive the closures’ development. However, limitations exist due to the uncertainties in the experimental measurement and the simplified analytical assumptions which have difficulties on representing the complex non-linear flow fields. In this paper, a data-driven approach, Feature Similarity Measurement (FSM), is developed and proposed to resolve the challenges of modeling the interfacial forces closures. Case study is performed with two-phase flow scenarios where the high-fidelity experimental data is available. Within the Eulerian-Eulerian two-fluid framework, only momentum equations for gas and liquid phases are solved and reduced-order interfacial momentum closures are aided with FSM. Predictions of void fraction and velocity fields are analyzed and demonstrate the potential of machine learning-driven interfacial forces closures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Data and scripts associated with a manuscript on residence time distribution simulation in two 10-kilometer long river sections

This data package is associated with the publication “On the Transferability of Residence Time Distributions in Two 10-km Long River Sections with Similar Hydromorphic Units” submitted to the Journal of Hydrology (Bao et al. 2024).Quantifying hydrologic exchange fluxes (HEFs) at the stream-groundwater interface, along with their residence time distributions (RTDs) in the subsurface, is crucial for managing water quality and ecosystem health in dynamic river corridors. However, directly simulating high-spatial resolution HEFs and RTDs can be a time-consuming process, particularly for watershed-scale modeling. Efficient surrogate models that link RTDs to hydromorphic units (HUs) may serve as alternatives for simulating RTDs in large-scale models. One common concern with these surrogate models, however, is the transferability of the relationship between the RTDs and HUs from one river corridor to another. To address this, we evaluated the HEFs and the resulting RTD-HU relationships for two 10-kilometer-long river corridors along the Columbia River, using a one-way coupled three-dimensional transient surface-subsurface water transport modeling framework that we previously developed. Applying this framework to the two river corridors with similar HUs allows for quantitative comparisons of HEFs and RTDs using both statistical tests and machine learning classification models. This data package includes the model inputs files and the simulation results data. This data package contains 10 folders. The modeling simulation results data are in the folders 100H_pt_data and 300area_pt_data, for the study domain Hanford 100H and 300 area respectively. The remaining eight folders contain the scripts and data to generate the manuscript figures. The file-level metadata file (Bao_2024_Residence_Time_Distribution _flmd.csv) includes a list of all files contained in this data package and descriptions for each. The data dictionary file (Bao_2024_Residence_Time_Distribution _dd.csv) includes column header definitions and units of all tabular files.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Optimizing collimator positions using bayesian optimization in the Fermilab MI-8 transfer line

Collimators are used to minimize losses and to remove particles that would otherwise get lost downstream and irradiate the machine. Finding the optimal jaw positions is time consuming and with the upstream beam properties changing, the collimation settings would need to be readjusted each time. Therefore, a method to optimize collimator positions and to operate them at full capacity in a short time is required for loss control downstream. A study of collimator positions was conducted and a machine learning (ML) model was developed to predict optimal collimator positions. Bayesian Optimization (BO) was used to calculate new jaw positions from the ML model. The results of BO and usage of ML for better performance of the collimation system are presented in this paper.

Babacan, Betiay [Fermilab]↗
NASA NTRS2011

Eta Carinae: An Observational Testbed for 3-D Interacting Wind Modeling

Eta Car, with its very massive interacting winds, provides shocked arc-like structures dense enough to trace in forbidden emission lines out to 0.7" (1700 AU). As the massive binary is in a very elliptical orbit (e approx. 0.9), the spatial and velocity structures of these winds change over the 5.54 year period. We can tract ionization structures by several forbidden emission lines. With the addition of radiative transfer on a time-step frame-by-frame basis, we are learning much new information on the ballistic structures, and may gain insight on how molecules and dust might form in these very massive systems.

Gull, Theodore↗
DOE OSTI2024

Accelerating data acquisition with FPGA-based edge machine learning: a case study with LCLS-II

New scientific experiments and instruments generate vast amounts of data that need to be transferred for storage or further processing, often overwhelming traditional systems. Edge machine learning (EdgeML) addresses this challenge by integrating machine learning (ML) algorithms with edge computing, enabling real-time data processing directly at the point of data generation. EdgeML is particularly beneficial for environments where immediate decisions are required, or where bandwidth and storage are limited. In this paper, we demonstrate a high-speed configurable ML model in a fully customizable EdgeML system using a field programmable gate array (FPGA). Our demonstration focuses on an angular array of electron spectrometers, referred to as the ‘CookieBox,’ developed for the Linac Coherent Light Source II project. The EdgeML system captures 51.2 Gbps from a 6.4 GS s −1 analog to digital converter and is designed to integrate data pre-processing and ML inside an FPGA. Our implementation achieves an inference latency of 0.2 µs for the ML model, and a total latency of 0.4 µs for the complete EdgeML system, which includes pre-processing, data transmission, digitization, and ML inference. The modular design of the system allows it to be adapted for other instrumentation applications requiring low-latency data processing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A hybrid CNN-LSTM surrogate model for hyper-resolution spatiotemporal flood forecasting in Norfolk, Virginia

Study region: Norfolk, Virginia, United States Study focus: Accurate and timely flood forecasting is essential for enhancing resilience in coastal urban areas in the context of increasing frequency and intensity of rainfall, sea level rise and urbanization. This study presents a hybrid deep learning-based surrogate model that integrates Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks to enable real-time spatiotemporal flood forecasting. The model leverages CNN to capture spatial features from inputs such as elevation and Topographic Wetness Index (TWI), while LSTM processes time-series inputs of rainfall and tide data to capture temporal features. New hydrologic insights for the region: The hybrid CNN-LSTM model was trained using the physics-based hydrodynamic model simulations obtained from the Two-dimensional Unsteady FLOW (TUFLOW) model for Norfolk, Virginia, and achieved high predictive accuracy across diverse flood-prone areas. The reduced computational time from four to six hours using TUFLOW to 3.2 min per event using CNN-LSTM enables rapid flood inundation mapping and early warning applications. The model effectively captured both spatial flood extents and their temporal evolution across different flooding scenarios, providing forecasts at a 2.5-m spatial resolution and 15-min temporal resolution and a one-hour-ahead prediction horizon. While challenges remain in terms of transferability to new regions and real-time data assimilation, this approach demonstrates strong potential for supporting operational flood risk management in coastal urban environments.

Coastal urban flooding↗
DOE OSTI2021

Privacy-Preserving Knowledge Transfer with Bootstrap Aggregation of Teacher Ensembles

There is a need to transfer knowledge among institutions and organizations to save effort in annotation and labeling or in enhancing task performance. However, knowledge transfer is difficult because of restrictions that are in place to ensure data security and privacy. Institutions are not allowed to exchange data or perform any activity that may expose personal information. With the leverage of a differential privacy algorithm in a high-performance computing environment, we propose a new training protocol, Bootstrap Aggregation of Teacher Ensembles (BATE), which is applicable to various types of machine learning models. The BATE algorithm is based on and provides enhancements to the PATE algorithm, maintaining competitive task performance scores on complex datasets with underrepresented class labels.We conducted a proof-of-the-concept study of the information extraction from cancer pathology report data from four cancer registries and performed comparisons between four scenarios: no collaboration, no privacy-preserving collaboration, the PATE algorithm, and the proposed BATE algorithm. The results showed that the BATE algorithm maintained competitive macro-averaged F1 scores, demonstrating that the suggested algorithm is an effective yet privacy-preserving method for machine learning and deep learning solutions.

Yoon, Hong-Jun↗
DOE OSTI2025

Computational Investigation of a CO 2 Conversion Strategy via Diels–Alder Reaction in a Carbon Capture Solvent

Molecular-level insights into reactive separations are crucial for the design of new conversion pathways of carbon dioxide (CO 2 ). This work explores a postulated pathway that directs CO 2 to undergo inverse-electron-demand Diels–Alder reactions to produce heterocycles using the CO 2 chemically fixed on water-lean solvent molecules. Density functional theory calculations are applied to evaluate the lowest unoccupied molecular orbital (LUMO) energies of three types of reactants (1,3-butadiene, 1,3-cyclohexadiene, and 1,2,4,5-tetrazine) with various functional substituents. These calculations also provide a data set (5.8k data) for developing a machine learning model to efficiently predict LUMO energies. A computational screening of LUMO energies for an additional 47k diene and tetrazine candidates is performed, and a list of candidates with lowered LUMO energies by electron-withdrawing substituents is provided. These candidates are further examined by their reaction energy barriers computed from the interatomic potential or density functional theory. Two major energy barriers are identified, one for the proton transfer within the water-lean solvent and the other for the CO 2 transfer from the solvent molecule to the reactant candidate (diene or tetrazine). The functional substituents have a more significant impact on the second barrier but a very slight one on the first barrier. This exploratory work demonstrates a new possibility for guiding experimental efforts toward the chemical conversion of fixated CO 2 to value-added compounds.

Chemical reactions↗
DOE OSTI2025

Application of machine learning interatomic potentials in heterogeneous catalysis

Heterogeneous catalysts are crucial in modern societies as they promote sustainability by enabling lower-energy pathways for various chemical reactions. While Density Functional Theory (DFT) computations can provide critical insights into how heterogeneous catalysts operate at the atomic level, they are limited by computational costs and unfavorable scaling with system size. Recently, machine learning interatomic potentials (MLIPs) have emerged as a promising alternative to DFT, offering near-DFT accuracy at significantly reduced cost. Here, in this perspective, we discuss the application of MLIPs in heterogeneous catalyst modeling as a surrogate for DFT. We detail how MLIPs have been applied in thermal catalysis to probe active sites, enable studying complex metallic and nanoporous catalysts, and investigate the reconstruction of catalytic surfaces. We review the use of MLIPs in electrocatalysis and photocatalysis, emphasizing their capabilities in studying transition metal oxide surfaces and solid–liquid interfaces. We also discuss the current limitations of MLIPs, particularly their challenges with transferability and description of non-local interactions. Finally, we conclude by identifying promising and underexplored domains in which MLIPs can further advance our understanding of heterogeneous catalysts.

Catalytic surfaces↗
DOE OSTI2026

Robust Design Under Uncertainty in Quantum Error Mitigation

Error mitigation techniques are crucial to achieving near-term quantum advantage. Classical postprocessing of quantum computation outcomes is a popular approach for error mitigation, which includes methods, such as zero noise extrapolation, virtual distillation, and learning-based error mitigation. However, these techniques have limitations due to the propagation of uncertainty resulting from the finite shot number of a quantum measurement. In this work, we introduce general and unbiased methods for quantifying the uncertainty and error of error-mitigated observables based on the strategic sampling of error mitigation outcomes. We then extend our approach to demonstrate the optimization of performance and robustness of error mitigation under uncertainty. To illustrate our methods, we apply them to zero noise extrapolation and Clifford date regression in the ground state of the XY model simulated using depolarizing and International Business Machines Corporation (IBM) Toronto noise models, respectively. In particular, we optimize the choice of noise levels and the allocation of shots for zero noise extrapolation and the distribution of the training circuits for Clifford data regression. While our methods are readily applicable to any postprocessing-based error mitigation approach, in practice they must not be prohibitively expensive—even though they perform optimizations of the error mitigation hyperparameters requiring sampling of a statistical distribution of error mitigation outcomes. By leveraging surrogate-based optimization, we show that our methods can efficiently perform optimal design for a zero noise extrapolation implementation. We then further demonstrate the transferability of learned zero noise extrapolation hyperparameters to other similar circuits.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

LEO Sensor to GEO Sensor Algorithm Transfer Models for Land Surface Temperature

Land surface temperature (LST) is a key climate observable used to detect changes in the Earth’s surface energy budget that influence carbon and water cycles. Land surface temperature exhibits strong diurnal variability, which geostationary satellites can observe at scale thanks to their temporal resolution. Due to anthropogenic climate and land use changes, the surface energy balance has been considerably modified and may be described by changes in diurnal temperature range and extremes. Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from low-earth orbit (LEO) and geostationary (GEO) sensors to develop a deep learning-based method for LEO-to-GEO algorithm emulation. Our model is trained to predict MODIS Terra LST from GOES-16 thermal bands and achieves validation error <2K. Application of the model to unseen times of day (observed by MODIS Aqua) and a new GEO sensor (Himawari-8) observing an unseen spatial domain, demonstrate the generalization of the deep learning model across space, time and spectra. Communicating diurnal LST variability observed by geostationary satellites can have impacts in multiple disciplines, from understanding of snow, vegetation and soil dynamics, to recognizing trends in heat events relevant to human health.

Kate Marie Duffy↗
DOE OSTI2024

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗