Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Predicting Long-Range Traversability from Short-Range Stereo-Derived Geometry

Based only on its appearance in imagery, this program uses close-range 3D terrain analysis to produce training data sufficient to estimate the traversability of terrain beyond 3D sensing range. This approach is called learning from stereo (LFS). In effect, the software transfers knowledge from middle distances, where 3D geometry provides training cues, into the far field where only appearance is available. This is a viable approach because the same obstacle classes, and sometimes the same obstacles, are typically present in the mid-field and the farfield. Learning thus extends the effective look-ahead distance of the sensors.

Turmon, Michael↗

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Electrolytes play a critical role in designing next-generation battery systems, by allowing efficient ion transfer, preventing charge transfer, and stabilizing electrode-electrolyte interfaces. In this work, we develop a differentiable geometric deep learning (GDL) model for chemical mixtures, DiffMix, which is applied in guiding robotic experimentation and optimization towards fast charging battery electrolytes. In particular, we extend mixture thermodynamic and transport laws by creating GDL-learnable physical coefficients. We evaluate our model with mixture thermodynamics and ion transport properties, where we show improved prediction accuracy and model robustness of Diff-Mix than its purely data-driven variants. Furthermore, with a robotic experimentation setup, Clio, we improve ionic conductivity of electrolytes by over 18.8% within 10 experimental steps, via differentiable optimization built on DiffMix gradients. By combining GDL, mixture physics laws, and robotic experimentation, DiffMix expands the predictive modeling methods for chemical mixtures and enables efficient optimization in large chemical spaces.

25 - ENERGY STORAGE↗

Combining synchrotron X-ray diffraction, mechanistic modeling and machine learning for in situ subsurface temperature quantification during laser melting

Laser melting, such as that encountered during additive manufacturing, produces extreme gradients of temperature in both space and time, which in turn influence microstructural development in the material. Qualification and model validation of the process itself and the resulting material necessitate the ability to characterize these temperature fields. However, well established means to directly probe the material temperature below the surface of an alloy while it is being processed are limited. To address this gap in characterization capabilities, a novel means is presented to extract subsurface temperature-distribution metrics, with uncertainty, from in situ synchrotron X-ray diffraction measurements to provide quantitative temperature evolution data during laser melting. Temperature-distribution metrics are determined using Gaussian process regression supervised machine-learning surrogate models trained with a combination of mechanistic modeling (heat transfer and fluid flow) and X-ray diffraction simulation. The trained surrogate model uncertainties are found to range from 5 to 15% depending on the metric and current temperature. The surrogate models are then applied to experimental data to extract temperature metrics from an Inconel 625 nickel superalloy wall specimen during laser melting. The maximum temperatures of the solid phase in the diffraction volume through melting and cooling are found to reach the solidus temperature as expected, with the mean and minimum temperatures found to be several hundred degrees less. The extracted temperature metrics near melting are determined to be more accurate because of the lower relative levels of mechanical elastic strains. However, uncertainties for temperature metrics during cooling are increased due to the effects of thermomechanical stress.

36 MATERIALS SCIENCE↗

Hyperspectral Sounder Spectral Fingerprinting: Using Machine Learning Techniques to Enhance Model-Based Physical Inversion

Different retrieval algorithms have been developed to process top-of-atmosphere (TOA) spectral radiance data provided by hyperspectral infrared sounder missions. Those algorithms are either optimal estimation method (OEM) based schemes with radiative transfer calculation involved in the retrieval process, or machine learning based methods that allow ultra-efficient data procession but lack of radiometric consistency validation based on the directly measured information. Combining both approaches leverages their respective technical advantages, leading to more accurate results. This study introduces a hyperspectral sounder fingerprinting algorithm to explore this hybrid approach. This approach involves the use of a spectral information-based classification method to identify an reference geophysical state and the corresponding radiative kernel. This enables the efficient retrieval of geophysical variables of interest through a radiative kernel-based linear inversion procedure. The fingerprinting method has been applied to analyze a decade-long hyperspectral sounder data record.

Wan Wu↗

Ground State Energy Functional with Hartree–Fock Efficiency and Chemical Accuracy

We introduce the deep post Hartree–Fock (DeePHF) method, a machine learning-based scheme for constructing accurate and transferable models for the ground-state energy of electronic structure problems. DeePHF predicts the energy difference between results of highly accurate models such as the coupled cluster method and low accuracy models such as the Hartree–Fock (HF) method, using the ground-state electronic orbitals as the input. It preserves all the symmetries of the original high accuracy model. The added computational cost is less than that of the reference HF or DFT and scales linearly with respect to system size. We examine the performance of DeePHF on organic molecular systems using publicly available data sets and obtain the state-of-art performance, particularly on large data sets.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalable graphene sensor array for real-time toxins monitoring in flowing water

Abstract Risk management for drinking water often requires continuous monitoring of various toxins in flowing water. While they can be readily integrated with existing water infrastructure, two-dimensional (2D) electronic sensors often suffer from device-to-device variations due to the lack of an effective strategy for identifying faulty devices from preselected uniform devices based on electronic properties alone, resulting in sensor inaccuracy and thus slowing down their real-world applications. Here, we report the combination of wet transfer, impedance and noise measurements, and machine learning to facilitate the scalable nanofabrication of graphene-based field-effect transistor (GFET) sensor arrays and the efficient identification of faulty devices. Our sensors were able to perform real-time detection of heavy-metal ions (lead and mercury) and E. coli bacteria simultaneously in flowing tap water. This study offers a reliable quality control protocol to increase the potential of electronic sensors for monitoring pollutants in flowing water.

47 OTHER INSTRUMENTATION↗

Robust Bioinformatics Recognition with VLSI Biochip Microsystem

A microsystem architecture for real-time, on-site, robust bioinformatic patterns recognition and analysis has been proposed. This system is compatible with on-chip DNA analysis means such as polymerase chain reaction (PCR)amplification. A corresponding novel artificial neural network (ANN) learning algorithm using new sigmoid-logarithmic transfer function based on error backpropagation (EBP) algorithm is invented. Our results show the trained new ANN can recognize low fluorescence patterns better than the conventional sigmoidal ANN does. A differential logarithmic imaging chip is designed for calculating logarithm of relative intensities of fluorescence signals. The single-rail logarithmic circuit and a prototype ANN chip are designed, fabricated and characterized.

bioinformatics↗

Use of TEMPO as a Proxy for Hyperspectral Geostationary Ocean Color Measurements from the GeoXO OCX Instrument: Harnessing Machine Learning and Principal Component Techniques for Atmospheric and Glint Correction

Retrievals of ocean color from space are important for better understanding the ocean ecosystem. The launch of atmospheric geostationary hyperspectral sensors such as TEMPO, provides a unique opportunity to examine the diurnal variability in ocean ecology. While TEMPO does not have as high spatial resolution or full spectral coverage as planned coastal ocean sensors such as the Geosynchronous Littoral Imaging and Monitoring Radiometer (GLIMR) or GeoXO Ocean Color instrument (OCX), its hourly measurements provide coverage of regions such as Lake Erie and the Gulf of Mexico at spatial scales of approximately 5 km. These data can be useful for testing new algorithms. We will apply our newly developed machine learning based atmospheric correction approach for ocean color retrievals to TEMPO data. Our approach begins by decomposing measured radiances from hyperspectral sensors into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface reflectance. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from collocated MODIS/VIIRS physically-based retrievals. This machine learning approach does not rely on radiative transfer modeling, and the use of MODIS/VIIRS data for training accounts for possible calibration b in hyperspectral data. Previously, we applied our approach using blue and UV wavelengths with the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can estimate ocean color properties in less-than-ideal conditions such as lightly to moderately clouded conditions as well as sun glint and thus improve the spatial coverage of ocean color measurements. TEMPO provides an opportunity to improve on this approach since it will provide collocated measurements at green and red wavelengths that were not available from OMI and TROPOMI and are important particularly for coastal waters. Additionally, our technique can be applied early in the mission and has potential to demonstrate the value of near real time ocean color products that are important for monitoring of harmful algae blooms and other oceanic phenomena.

Zachary Fasnacht↗

How Can Arc Support Cld Life Support Requirements

Through conversations with a commercial space flight system developer several areas of interest have become identified. Specifically: What are NASA’s plans for for life support on Gateway and Artemis surface missions? 1) Technology transfer of life support technologies. 2) Lesions learned from NASA system analysis and trade studies.

Life support CLD commercial space↗

NASA’s Exploration and In-Space Services (NExIS) Division OSAM-1 Propellant Transfer Subsystem Progress through FY 2024

The National Aeronautics and Space Administration (NASA) Exploration and In-Space Services (NExIS) Division of Goddard Space Flight Center (GSFC) has been developing technology to robotically refuel both heritage and recently developed satellites on-orbit funded through NASA’s Space Technology Mission Directorate (STMD). The On-orbit Servicing, Assembly, and Manufacturing 1 (OSAM-1) mission, formerly known as Restore-L, developed a system to refuel a satellite in space and assemble a communications antenna. By demonstrating these capabilities, the mission would advance never-before tested technologies for use in future missions (by NASA, other government organizations, and private industries). The purpose of this paper is to capture the lessons learned from the hardware development of the OSAM-1 Propellant Transfer System (PTS) that are highly relevant for the ISAM community. This paper covers a review of in-space servicing extensibility and critical technologies that were being developed within NExIS, focusing on the fluid transfer refueling technology within the framework of the OSAM-1 PTS. An overview of the technology demonstration servicing mission via the OSAM-1 Space Vehicle is provided as an extension of the technology development progress reported in 2018, 2019 and 2020. The general objectives, challenges, and key technologies are presented as an introduction to the context of the OSAM-1 mission, and a precursor to the OSAM-1 PTS specific development status. Final assembly, qualification, and functional tests along with installation and acceptance testing of the Hose Management Assembly (HMA) and Propellant Transfer Assembly (PTA) are discussed. Technology development, challenges, lessons learned, along with installation and testing results are discussed, with particular focus on the OSAM-1 assemblies including the PTA and HMA. In addition, testing utilizing the integrated flight simulator test setups will be summarized. The OSAM-1 PTS made great strides in advancing in-space refueling technology; however, there are unfinished development efforts remaining. This paper concludes with a brief summary of the technology shortfalls (gaps) that remain in the key areas of in-space fluid transfer.

ISAM↗

DeepFreeze: Towards Scalable Asynchronous Checkpointing of Deep Learning Models

In the age of big data, deep learning has emerged as a powerful tool to extract insight and exploit its value, both in industry and scientific applications. One common pattern emerging in such applications is frequent checkpointing of the state of the learning model during training, needed in a variety of scenarios: analysis of intermediate states to explain features and correlations with training data, exploration strategies involving alternative models that share a common ancestor, knowledge transfer, resilience, etc. However, with increasing size of the learning models and popularity of distributed data-parallel training approaches, simple checkpointing techniques used so far face several limitations: low serialization performance, blocking I/O, stragglers due to the fact that only a single process is involved in checkpointing. This paper proposes a checkpointing technique specifically designed to address the aforementioned limitations, introducing efficient asynchronous techniques to hide the overhead of serialization and I/O, and distribute the load over all participating processes. Experiments with two deep learning applications (CANDLE and ResNet) on a pre-Exascale HPC platform (Theta) shows significant improvement over state-of-art, both in terms of checkpointing duration and runtime overhead.

checkpointing↗

Lessons Learned for Improving Spacecraft Ground Operations

NASA policy requires each Program or Project to develop a plan for how they will address Lessons Learned. Projects have the flexibility to determine how best to promote and implement lessons learned. A large project might budget for a lessons learned position to coordinate elicitation, documentation and archival of the project lessons. The lessons learned process crosses all NASA Centers and includes the contactor community. o The Office of The Chief Engineer at NASA Headquarters in Washington D.C., is the overall process owner, and field locations manage the local implementation. One tool used to transfer knowledge between program and projects is the Lessons Learned Information System (LLIS). Most lessons come from NASA in partnership with support contractors. A search for lessons that might impact a new design is often performed by a contractor team member. Knowledge is not found with only one person, one project team, or one organization. Sometimes, another project team, or person, knows something that can help your project or your task. Knowledge sharing is an everyday activity at the Kennedy Space Center through storytelling, Kennedy Engineering Academy presentations and through searching the Lessons Learned Information system. o Project teams search the lessons repository to ensure the best possible results are delivered. o The ideas from the past are not always directly applicable but usually spark new ideas and innovations. Teams have a great responsibility to collect and disseminate these lessons so that they are shared with future generations of space systems designers. o Leaders should set a goal for themselves to host a set numbers of lesson learned events each year and do more to promote multiple methods of lessons learned activities. o High performing employees are expected to share their lessons, however formal knowledge sharing presentation are not the norm for many employees.

Bell, Michael↗

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗

The Activation of Hydrogen by First-Row Transition-Metal Complexes. Final Report

We have assigned the vibrational spectra of Os 1 and Os 2 complexes of propene, butene, and acetylene, and have used them for the assignment of the vibrational frequencies of surface alkenes and alkynes. We have measured the rates of H• transfer from (C 5 R 5 )Cr(CO) 3 H to olefins of many structural types, and have learned that even one substituent on the carbon to which the H• is transferred slows down the reaction considerably. We have shown that these Cr hydrides are useful catalysts for chain transfer during radical polymerization reactions. We have determined the strengths of several M–H bonds (in particular Cr–H ones), and have confirmed that the hydrides of first-row transition metals are particularly useful for generating radicals. We have used H• transfer to terminal methylenes to generate radicals that cyclize. We have shown that (C 5 R 5 )Cr(CO) 3 H can be regenerated under H 2 and is therefore catalytic, but that (P–P)V(CO) 4 H cannot be regenerated from H 2 and therefore can only be used stoichiometrically for radical generation. (The V-H bonds are weaker than the Cr–H ones, and the H• transfer to an olefin is therefore faster.) We have found that, under five atm of H 2 pressure, cobaloximes catalyze H• transfer; they efficiently remove an H• from cyclized radicals, and therefore can be used to catalyze the cycloisomerization of some olefins. We have explored the one- and two-electron oxidation of (Ph 3 P) 6 Cu 6 H 6 . One-electron oxidation (which is reversible) generates a cation radical, whereas two-electron oxidation generates loss of a hydride (i.e., two electrons and a proton). We have found that the hydricity of (Ph 3 P) 6 Cu 6 H 6 is between 36 and 50 kcal/mol. We have shown that uncongested organic radicals (i.e., TEMPO) can catalyze H• transfer from (C 5 R 5 )Cr(CO) 3 H to congested radicals like Ar 3 C•. We have examined the one-electron oxidation of [CpV(CO 3 H] – , and have inferred from the results that the reduction of alkyl iodides with [CpV(CO 3 H] – occurs by one-electron transfer. We have been able to use that reagent to catalyze radical cyclizations from H 2 and appropriate alkyl iodides.

08 HYDROGEN↗

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deploying Traffic Smoothing Cruise Controllers Learned from Trajectory Data

Autonomous vehicle-based traffic smoothing con- trollers are often not transferred to real-world use due to challenges in calibrating many-agent traffic simulators. We show a pipeline to sidestep such calibration issues by collecting trajectory data and learning controllers directly from trajectory data that are then deployed zero-shot onto the highway. We construct a dataset of 772.3 kilometers of recorded drives on the I-24. We then construct a simple simulator using the recorded drives as the lead vehicle in front of a simulated platoon consisting of one autonomous vehicle and five human followers. Using policy-gradient methods with an asymmetric critic to learn the controller, we show that we are able to improve average MPG by 11% in simulation on congested trajectories. We deploy this controller to a mixed platoon of 4 autonomous Toyota RAV-4’s and 7 human drivers in a validation experiment and demonstrate that the expected time-gap of the controller is maintained in the real world test. Finally, we release the driving dataset [1], the simulator, and the trained controller at https://github.com/nathanlct/trajectory-training-icra.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Review of heat transfer enhancement techniques for single phase flows

The thermal energy exchange between a flowing fluid and its confining channel is a ubiquitous process in modern society. To enhance the fluid-to-wall or wall-to-fluid heat transfer, several techniques have been developed to maximize the contact area between the fluid and the inner wall and/or disrupt the flow to enhance circulation or induce turbulence. Deployment of channels having features capable of enhancing heat transfer enables the reduction of heat exchanger size while maintaining performance. Reduction in equipment size is critical due to the ability to minimize the required volume of costly working fluids and to mitigate potential safety concerns associated with total system fluid volume. Here, a comprehensive review of single-phase heat transfer enhancement techniques is presented. The article provides a thorough comparison by analyzing the heat transfer rate, pressure drop, and other operational aspects. Single-phase heat transfer enhancement methods are divided into active and passive techniques. Active methods such as electrohydrodynamic (EHD), magnetohydrodynamics (MHD), or mechanical motion require external power to create enhancement. Passive methods such as dimples, fins, or tape inserts do not require external input and rely only on surface modification. Although active methods are more expensive and difficult to implement compared to passive techniques, it enables active control of heat transfer augmentation. Finally, this review develops and summarizes key learning data for design optimization enabled by additive manufacturing and machine learning algorithms, helping to inform these next-generation heat exchanger design methodologies for a plethora of modern applications such as electrification of vehicles, computing, and classical industries.

42 ENGINEERING↗