Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transfer learning.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Status Quo of Heliostat Field Deployment Processes

Deployment of the solar field of a concentrating solar power plant is one of many factors that are integral to the success of a project. Knowledge transfer from outside the industry is limited due to the unique nature of heliostats, which redirect sunlight to a receiver with high precision while maintaining a high level of reflectivity. Moreover, learning from project to project can be limited due to the site-specific nature of projects, as the market includes several developers, each with their own unique design. In this paper, we discuss the state of the art in heliostat field deployment. We cover all the key aspects of deployment from project assessment to a fully functioning system, which include site selection, layout development, supply chain, assembly, site preparation and construction, calibration, and operations and maintenance.

concentrating solar power↗

Machine learning-accelerated path integral molecular dynamics simulations of reactive organic electrolytes

Hydrogen bonded electrolytes that exhibit accelerated proton transport via sequential reactive hops have drawn interest for their promise in clean energy applications. Molecular dynamics simulations of these electrolytes offer the opportunity to uncover microscopic mechanistic details that could be used to design and tune the properties of candidate electrolyte technologies. However, accurately modeling the proton transfer reactions and transport properties that give rise to high charge conductivites in these electrolytes proves computationally challenging because of the need to perform lengthy condensed phase simulations, treating both the electronic and nuclear degrees of freedom quantum mechanically. In this paper, we demonstrate that such a modeling task can be efficiently achieved with the use of density functional theory (DFT)-trained machine learning potentials (MLP) to accelerate path integral molecular dynamics (PIMD) simulations. We highlight the practical utility of this approach by using it to benchmark how closely PIMD simulations employing different DFT exchange–correlation functionals reproduce the composition-dependent densities, diffusion coefficients, and electrical conductivities of mixtures consisting of imidazole and levulinic acid. Even with the speedup afforded by our MLPs, PIMD simulations remain quite expensive. Furthermore, in order to render PIMD more computationally tractable, we introduce and benchmark the accuracy of a ring polymer contraction approach that leverages a computationally efficient short-range MLP to accelerate our PIMD simulations by an additional factor of four.

Chemical bonding↗

Modeling Equilibrium Solid–Liquid Interfaces under Effective Constant Chemical Potential Using Machine Learning Interatomic Potentials

The chemical potential (μ) of species in solution is essential for understanding various chemical processes at interfaces. Molecular dynamics (MD) simulations, constrained by fixed compositions, cannot maintain constant chemical potential with reference to a targeted concentration or chemical potential under nonequilibrium or dynamic conditions, as solute species can migrate to the interface and deplete (or enrich) the bulk due to solute-interface interactions. In this study, we introduce a simple and computationally efficient approach named iterative quasi-constant chemical potential molecular dynamics (iqCμMD) simulation, which helps simulate targeted molar concentrations of species in solution. iqCμMD overcomes the limitations of conventional MD by adjusting the number of species in the solution to reach a target bulk concentration (chemical potential), which allows simulation of the interface under the bulk conditions comparable to experiment. We demonstrate our approach using machine learning interatomic potential (MLIP)-based MD simulations of the Na 2 SO 4,aq –graphene interface, and to show the transferability of our approach, we also perform classical force field-based MD simulations of NaCl aq –air and NaCl aq –graphite interfaces, which produce comparable results to previous CμMD simulations. Our results also show that the iqCμMD approach efficiently achieves the desired bulk ion concentration within two iterations, and by utilizing MLIPs, we can achieve converged results using relatively small-scale simulations compared to previous CμMD simulations. By combining iqCμMD with MLIP-driven simulations, solid–liquid interfaces can be modeled under an effective constant chemical potential with DFT-level accuracy. Here, we show that iqCμMD offers a robust and simple computational framework for constant chemical potential simulations, as its only requirement is to be able to converge interfacial simulations with a measurable bulk region.

Chemical structure↗

JSC Search System Usability Case Study

The advanced nature of "search" has facilitated the movement from keyword match to the delivery of every conceivable information topic from career, commerce, entertainment, learning... the list is infinite. At NASA Johnson Space Center (JSC ) the Search interface is an important means of knowledge transfer. By indexing multiple sources between directorates and organizations, the system's potential is culture changing in that through search, knowledge of the unique accomplishments in engineering and science can be seamlessly passed between generations. This paper reports the findings of an initial survey, the first of a four part study to help determine user sentiment on the intranet, or local (JSC) enterprise search environment as well as the larger NASA enterprise. The survey is a means through which end users provide direction on the development and transfer of knowledge by way of the search experience. The ideal is to identify what is working and what needs to be improved from the users' vantage point by documenting: (1) Where users are satisfied/dissatisfied (2) Perceived value of interface components (3) Gaps which cause any disappointment in search experience. The near term goal is it to inform JSC search in order to improve users' ability to utilize existing services and infrastructure to perform tasks with a shortened life cycle. Continuing steps include an agency based focus with modified questions to accomplish a similar purpose

Meza, David↗

CMS Token Transition

Within the LHC community, a momentous transition has been occurring in authorization. For nearly 20 years, services within the Worldwide LHC Computing Grid (WLCG) have authorized based on mapping an identity, derived from an X.509 credential, or a group/role, derived from a VOMS extension issued by the experiment. A fundamental shift is occurring to capabilities: the credential, a bearer token, asserts the authorizations of the bearer, not the identity. By the HL-LHC era, the CMS experiment plans for the transition to tokens, based on the WLCG Common JSON Web Token profile, to be complete. Services in the technology architecture include the INDIGO Identity and Access Management server to issue tokens; a HashiCorp Vault server to store and refresh access tokens for users and jobs; a managed token bastion server to push credentials to the HTCondor CredMon service; and HTCondor to maintain valid tokens in long-running batch jobs. We will describe the transition plans of the experiment, current status, configuration of the central authorization server, lessons learned in commissioning token-based access with sites, and operational experience using tokens for both job submissions and file transfers.

43 PARTICLE ACCELERATORS↗

Why Games Work and the Science of Learning

In 2010, the Navy formally added the Damage Control Trainer (DCT) to the recruit training program at Great Lakes, Illinois. Despite the incredibly dense training schedule at the Navy's boot camp, the instructors were willing to set aside two hours of time for recruits to play a game. Why? Because it worked. Even with just one hour of play, research showed that recruits gained a 50-80% improvement in performance that transferred to Battle Stations 21 (B821), the Navy's capstone training event. This paper explores why games makes these kinds of results possible. It argues that the things that are known to improve learning are almost exactly the same reasons why games work: the time-honored laws of learning. It concludes that the traditional gulf between instructional design and game design is really an issue of perspective, rather than fundamentals.

Murphy, Curtiss↗

Accelerating Discovery of Atomistic Defects via Machine Learning

The quantification of defects such as vacancies in crystalline structures is a cornerstone of materials science research. Traditional efforts often rely on manual detection, a process that is time-intensive, prone to human error, and challenging to scale. Here we leverage machine learning (ML) methods to identify and quantify vacancies within a crystalline lattice, aiming to expedite detection while improving accuracy. Additionally, we explore the transferability of these ML techniques, identifying characteristics of atomistic imaging data that complicate this task. We show how the integration of ML can drive innovation, providing a powerful tool that will play an increasingly crucial role in the future of materials science.

2D materials↗

Microscopy modality transfer of steel microstructures: Inferring scanning electron micrographs from optical microscopy using generative AI

Scanning electron microscopy (SEM) is resource intensive, which limits its throughput in some applications. As an alternative, we propose applying computer vision and machine learning to generate high-quality synthetic SEM micrographs from micrographs obtained using light optical microscopy (LOM). Working with a correlated LOM/SEM dataset of dual-phase steel images, we test generative models of various architectures, including encoder-decoder networks, generative adversarial networks (GANs), and diffusion-based models. We find that the diffusion models significantly outperform other methods on both qualitative and quantitative assessments, while preserving key metallurgical meaning. This work establishes diffusion as the state-of-the-art for microscopy modality transfer and demonstrates the potential of AI-powered microscopy to enhance LOM with micron scale structural recreation.

Computer vision↗

A domain wall-magnetic tunnel junction artificial synapse with notched geometry for accurate and efficient training of deep neural networks

Inspired by the parallelism and efficiency of the brain, several candidates for artificial synapse devices have been developed for neuromorphic computing, yet a nonlinear and asymmetric synaptic response curve precludes their use for backpropagation, the foundation of modern supervised learning. Spintronic devices—which benefit from high endurance, low power consumption, low latency, and CMOS compatibility—are a promising technology for memory, and domain-wall magnetic tunnel junction (DW-MTJ) devices have been shown to implement synaptic functions such as long-term potentiation and spike-timing dependent plasticity. In this work, we propose a notched DW-MTJ synapse as a candidate for supervised learning. Using micromagnetic simulations at room temperature, we show that notched synapses ensure the non-volatility of the synaptic weight and allow for highly linear, symmetric, and reproducible weight updates using either spin transfer torque (STT) or spin–orbit torque (SOT) mechanisms of DW propagation. We use lookup tables constructed from micromagnetics simulations to model the training of neural networks built with DW-MTJ synapses on both the MNIST and Fashion-MNIST image classification tasks. Accounting for thermal noise and realistic process variations, the DW-MTJ devices achieve classification accuracy close to ideal floating-point updates using both STT and SOT devices at room temperature and at 400 K. Our work establishes the basis for a magnetic artificial synapse that can eventually lead to hardware neural networks with fully spintronic matrix operations implementing machine learning.

42 ENGINEERING↗

Accelerating high-strain continuum-scale brittle fracture simulations with machine learning

Failure in brittle materials under dynamic loading conditions is a result of the propagation and coalescence of microcracks. Simulating this discrete crack evolution at the continuum level is computationally expensive or, in some cases, intractable, resulting in the need to make broad assumptions or neglect key physics. In this work, we have developed an approach using machine learning that overcomes the current inability to represent meso-scale physics at the macro-scale. Our approach leverages damage and stress data from a computationally expensive high-fidelity model that explicitly resolves microcrack behavior to build an inexpensive machine learning emulator. Once trained, the machine learning emulator is used to predict the evolution of crack length statistics, which then informs a continuum-scale constitutive model. This results in a significant speed-up of the workflow by four orders of magnitude. Both the machine learning emulator and the continuum-scale model are validated against the high-fidelity model and experimental data, respectively, showing excellent agreement. There are two key findings. The first is that we can reduce the dimensionality of the problem, establishing that the machine learning emulator only needs the length of the longest crack and one of the maximum stress components to capture the necessary physics. Another compelling finding is that the emulator can be trained in one experimental setting and transferred successfully to predict behavior in a different setting.

36 MATERIALS SCIENCE↗

Deep Learning Models for Planetary Seismicity Detection

Research in planetary seismology is fundamentally constrained by a lack of data. Seismo-logical science products of future missions can typically only be informed by theoretical signal/noise characteristics of the environment or likely Earth-analogues. Although objectives can be re-assessed after some initial data-collection upon lander arrival, transfer of high-resolution data back to Earth is costly on lander power usage. Over the last several years, development of GPU computing techniques and open-source high-level APIs have led to rapid advances in deep learning within the fields of computer vision, natural language processing, and collaborative filtering. These techniques are actively being adapted in seismology for a variety of tasks, including: earthquake detection, seismic phase discrimination, and ground-motion prediction. Until the recent detection of mars quakes during the Mars InSight mission, the only other measurements of seismicity recorded outside of Earth was on the Moon during the Apollo missions between 1969 to 1977. These unique data sets have been periodically revisited using new seismological methods, including ambient noise interferometry and Hidden Markov Models. Our objective is to develop a deep learning seismic detector and use it to catalog moonquakes from the Apollo 17 Lunar Seismic Profiling Experiment (LSPE) and compare the results with those obtained by other methods. Additionally, we will assess the accuracy tradeoff between using a training set of lunar data and one composed of Earth seismicity. In this document, we present preliminary results using a prototype classifier trained on a small set of earthquakes that was able to obtain detections for LSPE moonquakes with a greater accuracy than a recent study using Hidden Markov Models.

Civilini, F.↗

Decoding substrate specificity determining factors in glycosyltransferase-B enzymes – insights from machine learning models

Substrate specificity is an essential characteristic of any enzyme's function and an understanding of the factors that determine this specificity is crucial for enzyme engineering. Unlike the structure of an enzyme which is directly impacted by its sequence, substrate specificity as an enzyme attribute involves a rather indirect relationship with sequence as it also depends on structural aspects that dictate substrate accessibility and active site dynamics. In this study, we explore the performance of classifier-based machine learning models trained on curated sequence and structural data for a class of glycosyltransferases (GTs), namely GT-Bs, to understand their substrate specificity determining factors. GTs enable the transfer of sugar moieties to other biomolecules such as oligosaccharides or proteins and are found in all kingdoms of life. In plants, GTs participate in the biosynthesis of plant cell wall biopolymers (e.g.: hemicelluloses and pectins) and are an integral part of the enzymatic machinery that enables the storage of carbon and energy as plant biomass. To elucidate the substrate specificity of uncharacterized GT-Bs, we constructed multi-label machine learning models (Support Vector Classifier, K-Nearest Neighbors, Gaussian Naïve-Bayes, Random Forest) that incorporate both sequence and structural features. These models achieve good predictive accuracies on test datasets. However, despite our use of structural information, we highlight that there is further scope for improvement in training these models to draw interpretable relationships between sequence, structure and substrate specificity determining motifs in GT-Bs.

97 MATHEMATICS AND COMPUTING↗

EdgeCortix SAKURA-I Machine-Learning, PCIe Accelerator SEE Heavy Ion Test Report

To enable autonomy in space, machine-learning and computer vision applications become invaluable for sensor processing. However, these algorithms are computationally complex and unfeasible for many embedded central processing units (CPUs) and usually require external coprocessors, such as graphics processing units (GPUs) or accelerators specific to the application, including application specific integrated circuits (ASICs). In power-constrained systems, GPUs tend to consume more power than is acceptable (>40W), so lower-power accelerators have shown promise to provide the performance needed under spacecraft constraints. For radiation engineers, developing methodologies that can properly test CPUs, GPUs, and accelerators, and enable comparisons between them remains a necessary complication to solve as the devices become more complex. The methodology in this test aims to be a start in developing a baseline single-event effect (SEE) test for client-device machine learning accelerators. This category of devices do not host their own operating system. This testing campaign is a continuation of a previous 200 MeV proton test performed in January 2024. This report covers two heavy ion tests of the SAKURA-I card: one in April 2024, and one in June 2024. Additional data was needed after the April test due to ion-range issues experienced at higher linear-energy transfers (LETs). These range issues are described in more detail in Section 8. This experiment characterizes SEEs and data error susceptibility of the EdgeCortix SAKURA-I machine-learning accelerator under heavy ions. The device was monitored for single event upsets (SEUs) and single event functional interrupts (SEFIs) at the Lawrence Berkeley National Laboratory’s 88-inch cyclotron. The SAKURA-I board accelerates machine-learning inference applications on a host computer through a PCIex16 connection. For the purposes of devising an end to end automated analysis workflow for this experiment, the YOLO-V5 and SSD300 objection-detection models, and the ResNet-50, EfficientNet, and MobileNetV2 image classification models were used as a representative suite of analytical machine-learning models.

Seth S Roffe↗

A Nonergodic Ground-Motion Model for the San Francisco Bay Area for Small-Magnitude Earthquakes

ABSTRACT Recently, generative models have become a computationally efficient alternative to physics-based numerical simulations of ground motions. Neural networks can learn from existing ground-motion data to generate unobserved ground-motion data at new source and site locations. A key challenge with generative models is ensuring that predicted ground motions remain within a physically realistic range. For this purpose, we developed an empirical, nonergodic ground-motion model (GMM) for small-magnitude earthquakes in the San Francisco Bay area based on about 5000 recordings per component for Mw ≤ 4 earthquakes. The nonergodic GMM predicts spatially varying median source, site, and path effects for both the Fourier amplitude spectrum (FAS) and the Fourier phase derivative (a proxy for duration), as well as the corresponding epistemic uncertainty for each term. For FAS, our model shows above-average source and site effects in the western part of the region and below-average effects in the eastern part, with regional effects exhibiting larger spatial correlation lengths with increasing frequency. For duration, the source term is negligible for small-magnitude earthquakes, and the site term leads to site-specific variations up to 5 s. Path effects for FAS and duration depend on the source–site pair and are extrapolated spatially using recent methods for path-effect modeling. The aleatory variability of the within-site within-path residuals is similar to the variability found in previous studies for other regions. The nonergodic model provides two key contributions: first, median adjustment terms that are transferable to larger magnitude earthquakes, further reducing aleatory variability in probabilistic seismic hazard analysis; second, region-specific criteria for validating machine learning-based ground-motion generators to evaluate whether synthetic ground motions exhibit physically realistic source, site, and path effects.

Lacour, Maxime↗

Influence of extreme temperature conditions on CO 2 direct air capture using amino-acid solutions

Geological features play a pivotal role in determining the feasibility of deploying CO₂ direct air capture (DAC) technologies, primarily because they influence the availability of cost-effective energy sources, such as natural gas and geothermal energy, and also due to the potential for CO₂ sequestration. Many regions face challenges due to variable weather conditions including seasonal temperature fluctuations, high or low humidity, and sub-ambient temperatures. These extremes can reduce DAC performance or even lead to catastrophic events. Aqueous solvents considered for DAC systems are particularly vulnerable to seasonal variations in colder climates, where the solvent may underperform or freeze. It is therefore essential to investigate the CO₂ capture efficiency of aqueous solvents across a broad range of environmental temperatures, spanning sub-zero to hot conditions (>30 °C). In this study, DAC operation is examined using a high-flux solvent–air crossflow contactor under two major weather scenarios: (i) cold conditions below 0 °C and (ii) hot conditions above 30 °C. A parametric study is conducted to investigate the contactor performance regarding CO₂ removal efficiency, uptake capacity, and reaction kinetics versus temperature when the air velocity through the contactor exceeds 1 m/s. The efficacy of the contactor is systematically investigated using various anti-freeze amino-acid solvent formulations. A mass-transfer mechanistic model is developed to assess the process performance over a wide temperature range and propose scalable design guidelines. Machine learning is also employed to identify key parameters affecting the CO₂ capture efficiency. It is shown that air velocity and temperature are the primary factors influencing CO₂ uptake. Based on performance data obtained under subfreezing temperatures, a technoeconomic analysis is conducted to evaluate the feasibility of using aqueous solvents in seasonal cold regions. In conclusion, the findings of this study provide valuable insights into siting considerations for deploying solvent-based DAC, thereby contributing to the advancement of sustainable carbon removal solutions.

Air–liquid contactor↗

Separation Control at Flight Reynolds Numbers: Lessons Learned and Future Directions

Active separation control, using periodic excitation, was studied experimentally at high Reynolds numbers. The effects of compressibility, mild sweep, location o excitation slot and steady momentum transfer on the efficacy of the method were identified. Tests conducted at chord Reynolds numbers as high as 40 x 10(exp 6) demonstrated that active control using oscillatory flow excitation can effectively delay flow separation from and reattach separated flow to aerodynamic surfaces at flight conditions. The effective frequencies generate one to four vortices over the controlled region at all times, regardless of the Reynolds number. The vortices are initially amplified by the separated shear-layer, and after initiating reattachment, the strength of the vortices decay as they are convected downstream. Large amplitude, low frequency vortices break down to smaller ones upon introduction at the excitation slot. The effects of steady mass transfer were compared to those of periodic excitation. It was found that steady blowing is significantly inferior to periodic excitation in terms o performance benefits and that the response to steady blowing is abrupt, and therefore undesirable from a control point of view. Steady suction and periodic excitation are comparable in effectiveness and both exhibit a gradual response to changes in the magnitude of the control input. The combination of weak steady suction and periodic excitation is extremely effective while the addition of steady blowing could be detrimental. Compressibility effects are weak as long as separation is not caused by a shock-wave/boundary-layer interaction The undesirable effects of the shock-induced separation could be alleviated by the introduction of periodic excitation upstream of the shock wave, inside the region of supersonic flow. The effects of mild sweep were also studied and periodic excitation was found to be very effective in reattaching three-dimensional separated flow. Scaling laws that correlate 2D and 3D controlled flows were tested and verified. Several performance benefits could be gained by applying the method to existing configurations, but it is expected that the full potential of the method can only be realized through the design of new configurations. A comprehensive, fully turbulent, database was generated in order to guide the development, and enable validation, of candidate unsteady CFD design tools.

Seifert, Avi↗

Separation Control at Flight Reynolds Numbers: Lessons Learned and Future Directions

Active separation control, using periodic excitation, was studied experimentally at high Reynolds numbers. The effects of compressibility, mild sweep, location of excitation slot and steady momentum transfer on the efficacy of the method were identified. Tests conducted at chord Reynolds numbers as high as 40 x 10(exp 6) demonstrated that active control using oscillatory flow excitation can effectively delay flow separation from, and reattach separated flow to aerodynamic surfaces at flight conditions. The effective frequencies generate one to four vortices over the controlled region at all times, regardless of the Reynolds number. The vortices are initially amplified by the separated shear-layer, and after initiating reattachment, the strength of the vortices decay as they are convected downstream. Large amplitude, low frequency vortices break down to smaller ones upon introduction at the excitation slot. The effects of steady mass transfer were compared to those of periodic excitation. It was found that steady blowing is significantly inferior to periodic excitation in terms of performance benefits and that the response to steady blowing is abrupt, and therefore undesirable from a control point of view. Steady suction and periodic excitation are comparable in effectiveness and both exhibit a gradual response to changes in the magnitude of the control input. The combination of weak steady suction and periodic excitation is extremely effective while the addition of steady blowing could be detrimental. Compressibility effects are weak as long as separation is not caused by a shock-wave/boundary-layer interaction. The undesirable effects of the shock-induced separation could be alleviated by the introduction of periodic excitation upstream of the shock wave, inside the region of supersonic flow. The effects of mild sweep were also studied and periodic excitation was found to be very effective in reattaching three-dimensional separated flow. Scaling laws that correlate 2D and 3D controlled flows were tested and verified. Several performance benefits could be gained by applying the method to existing configurations, but it is expected that the full potential of the method can only be realized through the design of new configurations. A comprehensive, fully turbulent, database was generated in order to guide the development, and enable validation, of candidate unsteady CFD design tools.

Pack, LaTunia G.↗

Cloud-Vegetation Radiative Interaction: What Can We Learn from it about Cloud Optical Properties?

Because of their radiative interactions, the vegetation canopy and the atmosphere are coupled together; each serves as a boundary condition to the radative transfer equations in the adjacent medium. To better understand radiative processes in these media we need an accurate description of their interactions. This presentation outlines a technique needed to describe interactions between vegetation and clouds and exploits it to retrieve cloud optical depth from ground-based radiance measurements. measurements of zenith radiance in the RED and NIR spectral regions. In addition to an algebraic combinations of spectral radiances such as Normalized Difference Cloud Index (NDCI) that can result in poor retrievals due to its insensitivity to cloud fraction, both RED and NIR radiances as points on the "RED vs. NIR" plane are proposed to be used for retrieval. The proposed method is applied to a multi-channel sunphotometer (as a part of AERONET) measurements at the ARM site in Oklahoma. In addition to cloud optical depth, the new method also infers a "radiatively effective" cloud fraction.

Marshak, Alexander↗