Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hybrid learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A high-throughput and data-driven computational framework for novel quantum materials

Two-dimensional layered materials, such as transition metal dichalcogenides (TMDs), possess an intrinsic van der Waals gap at the layer interface, allowing for remarkable tunability of the optoelectronic features via external intercalation of foreign guests such as atoms, ions, or molecules. Herein, we introduce a high-throughput, data-driven computational framework for the design of novel quantum materials derived from intercalating planar conjugated organic molecules into bilayer transition metal dichalcogenides and dioxides. By combining first-principles methods, material informatics, and machine learning, we characterize the energetic and mechanical stability of this new class of materials and identify the fifty (50) most stable hybrid materials from a vast configurational space comprising ∼105 materials, employing intercalation energy as the screening criterion.

Kastuar, Srihari M. (ORCID:0000000279001561)↗
DOE OSTI2023

Studying the hadron structure with PANDA and CLAS using machine learning techniques

The hadron spectroscopy and structure are currently very active fields of research to study the non-perturbative regime of quantum chronodynamics. The first one studies the complex structure of excited hadrons by looking at their decay products, while the latter uses lepton scattering on nucleons. Both methods require reconstruction algorithms with great efficiency and good particle identification and background rejection rates. This work aims to provide these by either improving the existing methods or developing new ones. The first part of this document presents a feasibility study of a predicted hybrid charmonium state for the PANDA experiment. Lattice QCD calculations predict the ground state hybrid charmonium to be a spin exotic with quantum numbers of JP C = 1?+ at a mass of around 4.3 GeV with a width to be around 20 MeV. A machine learning based data analysis scheme is proposed to further improve the signal efficiency and the background reduction, alongside with improvements of the analysis software (PandaRoot), that are vital for this study. These improvements include a reworked clustering algorithm for the electromagnetic calorimeter (EMC) and an optimized monte carlo matching for neutral particles. The second part of this document is about studying the proton structure. A multidimensional study of the structure function ratio Fsin(?)LU /FUU has been performed for K±, based on the measurement of beam-spin asymmetries. It uses the high statistics data recorded with the CLAS12 spectrometer at Jefferson Laboratory. Fsin(?)LU is a twist-3 quantity that provides information about the quark gluon correlations in the proton. This document will present for the first time a simultaneous analysis of two kaon channels over a large kinematic range of z, xB , PT and Q2 with virtualities Q2 ranging from 1 GeV2 up to 8 GeV2 using machine learning techniques for improved particle identification.

Kripko, Aron↗
DOE OSTI2022

Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets

Quantifying charge-state transition energy levels of impurities in semiconductors is critical to understanding and engineering their optoelectronic properties for applications ranging from solar photovoltaics to infrared lasers. While these transition levels can be measured and calculated accurately, such efforts are time-consuming and more rapid prediction methods would be beneficial. Here, we significantly reduce the time typically required to predict impurity transition levels using multi-fidelity datasets and a machine learning approach employing features based on elemental properties and impurity positions. We use transition levels obtained from low-fidelity (i.e., local-density approximation or generalized gradient approximation) density functional theory (DFT) calculations, corrected using a recently proposed modified band alignment scheme, which well-approximates transition levels from high-fidelity DFT (i.e., hybrid HSE06). Further, the model fit to the large multi-fidelity database shows improved accuracy compared to the models trained on the more limited high-fidelity values. Crucially, in our approach, when using the multi-fidelity data, high-fidelity values are not required for model training, significantly reducing the computational cost required for training the model. Our machine learning model of transition levels has a root mean squared (mean absolute) error of 0.36 (0.27) eV vs high-fidelity hybrid functional values when averaged over 14 semiconductor systems from the II–VI and III–V families. As a guide for use on other systems, we assessed the model on simulated data to show the expected accuracy level as a function of bandgap for new materials of interest. Finally, we use the model to predict a complete space of impurity charge-state transition levels in all zinc blende III–V and II–VI systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

2021 ROMANIA TRANSPORT SECURITY TABLE-TOP EXERCISE (TTX) – LESSONS LEARNED AND GOOD PRACTICES

During the period of 15-18 March 2021, the IAEA conducted a national workshop addressing the security of radioactive material in transport. The workshop was jointly hosted by the Romanian regulatory authority and the General Inspectorate of Romanian Gendarmerie. The workshop assisted Romania in improving its capability to evaluate the ability of response forces to counter a malicious act against radioactive material in transport. The event consisted of briefings, exercises, a demonstration of transport security equipment, and a transport security table-top exercise (TTX). The workshop was conducted in a virtual-hybrid format in such a way as to meet the COVID-19 related requirements in compliance with Romania’s guidelines. This paper provides an overview of the workshop’s activities, lessons-learned, and good practices related to the transport security TTX exercises.

Maican, Catalin↗
DOE OSTI2024

Covalent integration of polymers and porous organic frameworks

Covalent integration of polymers and porous organic frameworks (POFs), including metal-organic frameworks (MOFs), covalent organic frameworks (COFs) and hydrogen-bonded organic frameworks (HOFs), represent a promising strategy for overcoming the existing limitations of traditional porous materials. This integration allows for the combination of the advantages of polymers, i.e., flexibility, processability and chemical versatility etc., and the superiority of POFs, like the structural integrity, tunable porosity and the high surface area, creating a type of hybrid materials. These resulting polymer-POF hybrid materials exhibit enhanced mechanical strength, chemical stability and functional diversity, thus opening up new opportunities for applications across a large variety of fields, such as gas separation, catalysis, biomedical applications, environmental remediation and energy storage. In this review, an overview of synthetic routes and strategies on how to covalently integrate different polymers with various POFs is discussed, especially with a particular focus on methods like polymerization within, on and among POF structures. To investigate the unique properties and functions of these resultant hybrid materials, the characterization techniques, including nuclear magnetic resonance spectroscopy (NMR), Fourier transform infrared spectroscopy (FTIR), X-ray diffraction (XRD), thermogravimetric analysis (TGA), transmission electron microscopy (TEM) and scanning electron microscopy (SEM), gas adsorption analysis (BET) and computational modeling and machine learning, are also presented. The ability of polymer-POFs to manipulate the pore environments at the molecular level affords these materials a wide range of applications, providing a versatile platform for future advancements in material science. Looking forward, to fully realize the potential of these hybrid materials, the authors highlight the scalability, green synthesis methods, and potential for stimuli-responsive polymer-POF materials as critical areas for future research.

Hossain, Md Amjad↗
DOE OSTI2020

A User-Centered Design Study in Scientific Visualization Targeting Domain Experts

The development of usable visualization solutions is essential for ensuring both their adoption and effectiveness. User-centered design principles, which involve users throughout the entire development process, have been shown to be effective in numerous information visualization endeavors. We describe how we applied these principles in scientific visualization over a two year collaboration to develop a hybrid in situ/post hoc solution tailored towards combustion researcher needs. Lastly, we examine the importance of user-centered design and lessons learned over the design process in an effort to aid others seeking to develop effective scientific visualization solutions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Evapotranspiration partitioning estimates from 8 methods from 47 NEON sites, 2019-2021

This dataset provides daily estimates of evapotranspiration (ET) and the transpiration-to-evapotranspiration ratio (T/ET) across 47 terrestrial National Ecological Observatory Network (NEON) sites spanning diverse environmental and biome conditions in the United States across three years of data (2019-2021). Daily ET is reported in both energy units (MJ m⁻² day⁻¹) and equivalent water depth (mm day⁻¹), assuming a constant latent heat of vaporization of 2.45 MJ/kg. The primary method uses a hybrid recurrent neural network–Penman–Monteith framework (RNN-PM), which integrates physically based surface energy balance constraints with data-driven learning to partition ET into transpiration and evaporation components. Model inputs include in situ meteorological observations (air temperature, vapor pressure deficit, wind speed, and radiation) combined with satellite-derived land surface temperature, leaf area index, and soil moisture. For benchmarking and uncertainty assessment, T/ET estimates from seven additional models are included: Priestley-Taylor Jet Propulsion Laboratory (PT-JPL), Penman-Monteith (P-M), Two-Source Energy Balance (TSEB), Support Vector Regression (SVR), and Categorical Boosting (CatBoost), among others—spanning empirical, machine-learning, and process-based approaches (see methods section or linked publication for detailed descriptions). Data Package Contents: The dataset a csv files containing daily ET and T/ET estimates for each site and model, along with associated metadata files these variables. Data can be accessed using common spreadsheet software (e.g., Microsoft Excel, LibreOffice) or programming environments such as R or Python. Together, these data support cross-site comparisons of ecosystem water use, evaluation of ET partitioning methods, and development of improved land–atmosphere exchange models.

EARTH SCIENCE > ATMOSPHERE↗
DOE OSTI2022

Control and Calibration of GlueX Central Drift Chamber Using Gaussian Process Regression

The Gluonic Excitations (GlueX) experiment is designed to search for exotic hybrid mesons using photoproduction, and to study the hybrid meson spectrum predicted from Lattice Quantum Chromodynamics. For the first time, the GlueX Central Drift Chamber was controlled autonomously using machine learning (ML) to calibrate in real time while recording cosmic ray tracks. We demonstrate the ability of a Gaussian Process to predict the gain correction calibration factor used to determine a high voltage setting that will stabilize the CDC gain in response to changing environmental conditions; this is in contrast to the traditional, computationally expensive method of calibrating raw data after data collection is complete.

McSpadden, Helen↗
DOE OSTI2025

Graph-Learning-Assisted State and Event Tracking for Solar-Penetrated Power Grids with Heterogeneous Data Sources

Unlike transmission systems, distribution systems do not typically contain sufficient metering to enable real-time state estimation. The lack of sufficient real-time measurements prohibits accurate and timely monitoring of the state of distribution systems. As a result, control and optimal operation of distribution systems, especially those containing large numbers of renewable generation units are not possible without proper data and information about the current state of the system. The main motivation of this project is to address this shortcoming by developing an approach which provides “predicted” real-time measurements so that they can be used to execute a distribution system state estimator. Thus, the objective of the project is to make the distribution systems fully observable, such that the hosting capacity for solar generation can be accurately estimated, and unnecessary solar curtailments can be avoided. In order to accomplish this goal, the project investigated the use of a grid-model-informed machine learning (ML) tool which integrates heterogeneous data streams obtained from AMI meters, SCADA as well as PMU measurements and created synchronous measurement snapshots for the state estimator (SE); and developed a hybrid robust SE which provides not only accurate state estimates but also real-time feedback for the ML model refinement.

14 SOLAR ENERGY↗
DOE OSTI2023

Opportunities for enhancing MLCommons efforts while leveraging insights from educational MLCommons earthquake benchmarks efforts

MLCommons is an effort to develop and improve the artificial intelligence (AI) ecosystem through benchmarks, public data sets, and research. It consists of members from start-ups, leading companies, academics, and non-profits from around the world. The goal is to make machine learning better for everyone. In order to increase participation by others, educational institutions provide valuable opportunities for engagement. In this article, we identify numerous insights obtained from different viewpoints as part of efforts to utilize high-performance computing (HPC) big data systems in existing education while developing and conducting science benchmarks for earthquake prediction. As this activity was conducted across multiple educational efforts, we project if and how it is possible to make such efforts available on a wider scale. This includes the integration of sophisticated benchmarks into courses and research activities at universities, exposing the students and researchers to topics that are otherwise typically not sufficiently covered in current course curricula as we witnessed from our practical experience across multiple organizations. As such, we have outlined the many lessons we learned throughout these efforts, culminating in the need for benchmark carpentry for scientists using advanced computational resources. The article also presents the analysis of an earthquake prediction code benchmark while focusing on the accuracy of the results and not only on the runtime; notedly, this benchmark was created as a result of our lessons learned. Energy traces were produced throughout these benchmarks, which are vital to analyzing the power expenditure within HPC environments. Additionally, one of the insights is that in the short time of the project with limited student availability, the activity was only possible by utilizing a benchmark runtime pipeline while developing and using software to generate jobs from the permutation of hyperparameters automatically. It integrates a templated job management framework for executing tasks and experiments based on hyperparameters while leveraging hybrid compute resources available at different institutions. The software is part of a collection called cloudmesh with its newly developed components, cloudmesh-ee (experiment executor) and cloudmesh-cc (compute coordinator).

58 GEOSCIENCES↗
DOE OSTI2020

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

Quantum computing is a computational paradigm with the potential to outperform classical methods for a variety of problems. Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term. QAOA is a variational hybrid quantum-classical algorithm for approximately solving combinatorial optimization problems. The quality of the solution obtained by QAOA for a given problem instance depends on the performance of the classical optimizer used to optimize the variational parameters. In this paper, we formulate the problem of finding optimal QAOA parameters as a learning task in which the knowledge gained from solving training instances can be leveraged to find high-quality solutions for unseen test instances. To this end, we develop two machine-learning-based approaches. Our first approach adopts a reinforcement learning (RL) framework to learn a policy network to optimize QAOA circuits. Our second approach adopts a kernel density estimation (KDE) technique to learn a generative model of optimal QAOA parameters. In both approaches, the training procedure is performed on small-sized problem instances that can be simulated on a classical computer; yet the learned RL policy and the generative model can be used to efficiently solve larger problems. Furthermore, extensive simulations using the IBM Qiskit Aer quantum circuit simulator demonstrate that our proposed RL- and KDE-based approaches reduce the optimality gap by factors up to 30.15 when compared with other commonly used off-the-shelf optimizers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Hybrid Analytics Solution for Power Plant Operations

Expert Microsystems, Inc., MapEx Software Inc. and XMPLR Energy LLC have teamed to submit a proposal to the US Department of Energy’s Office of Fossil Energy to improve the efficiency, reliability and flexibility of existing coal-based power plants. The project, titled Hybrid Analytics Solution to Improve Coal Power Plant Operations (the “Hybrid Analytics” project), will develop, demonstrate and commercialize a novel approach that integrates two proven real-time monitoring techniques. The Hybrid Analytics approach integrates into a single, integrated solution: a) an established, advanced data-driven analytics solution that includes artificial intelligence, advanced pattern recognition and machine-learning techniques and b) a well-proven, first principle thermal heat balance model solution. The future role of coal plants will depend on the ability to cycle and follow loads to meet marginal power demands, accommodate renewables and support the grid. Essential to success in this new role is a plant’s ability to maintain high reliability, efficiency and flexibility. However, these changing operational demands put significant stresses on power plant components that directly impact the ability to deliver these requirements. In the past, plants have independently monitored performance using physics-based solutions (heat rate, boiler losses, etc.) and reliability using data-driven analytics (advanced pattern recognition). The Hybrid Analytics solution integrates both approaches to enhance fault detection, provide automated diagnostics and estimates of remaining time to act, and provide critical, enhanced and accurate real-time information to coal plant operators. As a result, coal plants can improve efficiency, reliability, and flexibility and can cost-effectively maintain their key role in the power delivery system.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Revealing the evolution of order in materials microstructures using multi-modal computer vision

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La 1−x Sr x FeO 3 . We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Multimodal Characterization of Crystal Structure and Formation in Rubrene Thin Films Reveals Erasure of Orientational Discontinuities

Abstract Multimodal multiscale characterization provide opportunities to study organic semiconducting thin films with multiple length scales, across multiple platforms, to elucidate crystallization mechanisms of the various microstructures that impact functionality. With polarized scanning transmission X‐ray and 4D‐scanning transmission electron microscopy, hybrid crystalline structures in rubrene thin films in which large crystalline domains surround a common nucleus and transition to a spherulite morphology at larger radii is observed. These high‐resolution techniques reveal how azimuthal orientational discontinuities at smaller radii are erased as spherulite morphology takes hold. In situ crystallization in the films with optical microscopy is also captured, discovering the importance of considering the initial temperature increase of a film during thermal annealing over the crystallization timescale. This kinetic information of the radial crystallization rate and of corresponding film heating kinetics is used to estimate the temperature at which the larger crystalline regions transition into a spherulite. By combining the results obtained from the different characterization modes, it is learned that thermal conditions can sensitively affect the crystallization of rubrene and other organic thin films. The observations suggest opportunities for more complex temperature‐dependent processing to maximize hybrid structures’ functionality in organic thin films and demonstrate that multimodal studies deepen the understanding of structure‐function dynamics.

Tan, Jenna A.↗
DOE OSTI2021

Machine Learning Emulation of Spatial Deposition from a Multi-Physics Ensemble of Weather and Atmospheric Transport Models

In the event of an accidental or intentional hazardous material release in the atmosphere, researchers often run physics-based atmospheric transport and dispersion models to predict the extent and variation of the contaminant spread. These predictions are imperfect due to propagated uncertainty from atmospheric model physics (or parameterizations) and weather data initial conditions. Ensembles of simulations can be used to estimate uncertainty, but running large ensembles is often very time consuming and resource intensive, even using large supercomputers. In this paper, we present a machine-learning-based method which can be used to quickly emulate spatial deposition patterns from a multi-physics ensemble of dispersion simulations. We use a hybrid linear and logistic regression method that can predict deposition in more than 100,000 grid cells with as few as fifty training examples. Logistic regression provides probabilistic predictions of the presence or absence of hazardous materials, while linear regression predicts the quantity of hazardous materials. The coefficients of the linear regressions also open avenues of exploration regarding interpretability—the presented model can be used to find which physics schemes are most important over different spatial areas. A single regression prediction is on the order of 10,000 times faster than running a weather and dispersion simulation. However, considering the number of weather and dispersion simulations needed to train the regressions, the speed-up achieved when considering the whole ensemble is about 24 times. Ultimately, this work will allow atmospheric researchers to produce potential contamination scenarios with uncertainty estimates faster than previously possible, aiding public servants and first responders.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Predicting Drug Effects from High-dimensional Asymmetric Drug Data Sets using Graph Neural Networks: A Comprehensive Analysis of Multi-target Drug Effect Prediction

Graph neural networks (GNNs) have emerged as one of the most effective Machine learning (ML) techniques for drug effect prediction from drug molecular graphs. Despite having immense potential, GNN models lack performance when using data sets that contain high dimensional asymmetrically co-occurrent drug effects as targets with complex correlations between them. Training individual learning models for each drug effect and incorporating every prediction result for a wide spectrum of drug effects is beyond practicality. Such an implication provides a testbed to address this challenge as multi-target prediction problems, aiming to predict all drug effects at a time. We develop standard and hybrid graph neural networks (GNNs)to perform two separate tasks that are multi-regression for continuous values and multi-label classification for categorical values contained in our data sets. Since this step makes the target data even more sparse and introduces asymmetric label co-occurrence, the learning of multi-label classification models becomes difficult and heavily impacts the GNN's performance. To address these challenges, we propose a new data oversampling technique to improve multi-label classification performances on all the given imbalanced molecular graph data sets. Using the technique, we improve the data imbalance ratio of the drug effects better than before while protecting the data set's integrity. Finally, we evaluate multi-label classification performance using the best-performant hybrid GNN model on all the oversampled data sets obtained from the proposed oversampling technique. These results outperform those of other ML models including GNN models when they are trained on the original data sets or oversampled data sets using MLSMOTE (a well-known oversampling technique) in all evaluation metrics precision, recall, and F1 score by a significant margin.

Bose, Avishek [ORNL]↗
DOE OSTI2022

Deep Learning Provides Substantial Improvements to County‐Level Fire Weather Forecasting Over the Western United States

Abstract The recent wildfires in the western United States during 2018 and 2020 caused record‐breaking fire damage and casualties. Despite remarkable advances in fire modeling and weather forecasting, it remains challenging to anticipate catastrophic wildfire events and associated damage. One key missing component is a fire weather prediction system with sufficiently long lead time capable of providing useful regional details. Here, we develop a hybrid prediction model of wildfire danger called CFS with super resolution (CFS‐SR) as a proof of concept to fill that void. The CFS‐SR model is constructed by integrating the Climate Forecast System version 2 with a deep learning (DL) technique from Single Image Super Resolution, a method widely used in enhancing image resolution. We show that for the 2018–2019 fire season, the CFS‐SR model significantly improves accuracy in forecasting fire weather at lead times of up to 7 days with an enhanced spatial resolution up to 4 km. This level of high resolution provides county‐level fire weather forecast, making it more practical for allocating resources to mitigate wildfire danger. Our study demonstrates that a proper combination of ensemble climate predictions with DL techniques can boost predictability at finer spatial scales, increasing the utility of fire weather forecasts for practical applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Data-driven recovery of hidden physics in reduced order modeling of fluid flows

In this article, we introduce a modular hybrid analysis and modeling (HAM) approach to account for hidden physics in reduced order modeling (ROM) of parameterized systems relevant to fluid dynamics. The hybrid ROM framework is based on using first principles to model the known physics in conjunction with utilizing the data-driven machine learning tools to model the remaining residual that is hidden in data. This framework employs proper orthogonal decomposition as a compression tool to construct orthonormal bases and Galerkin projection (GP) as a model to build the dynamical core of the system. Our proposed methodology hence compensates structural or epistemic uncertainties in models and utilizes the observed data snapshots to compute true modal coefficients spanned by these bases. The GP model is then corrected at every time step with a data-driven rectification using a long short-term memory (LSTM) neural network architecture to incorporate hidden physics. A Grassmannian manifold approach is also adopted for interpolating basis functions to unseen parametric conditions. The control parameter governing the system's behavior is thus implicitly considered through true modal coefficients as input features to the LSTM network. The effectiveness of the HAM approach is then discussed through illustrative examples that are generated synthetically to take hidden physics into account. Furthermore, our approach thus provides insights addressing a fundamental limitation of the physics-based models when the governing equations are incomplete to represent underlying physical processes.

42 ENGINEERING↗