Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neural algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

All-Electric Nonassociative Learning in Nickel Oxide

Habituation and sensitization represent nonassociative learning mechanisms in both non-neural and neural organisms. They are essential for a range of functions from survival to adaptation in dynamic environments. Design of hardware for neuroinspired computing strives to emulate such features driven by electric bias and can also be incorporated into neural network algorithms. Herein, cellular-like learning in oxygen-deficient NiO x devices is demonstrated. Both habituation learning and sensitization response can be achieved in a single device by simply controlling the magnitude of the electric field. Spontaneous memory relaxations and dynamic redistribution of oxygen vacancies under electric bias enable such learning behavior of NiO x under sequential training. These characteristics in simple device arrays are implemented to learn alphabets as well as demonstrate simulated algorithmic use cases in digit recognition. Transition metal oxides with carefully prepared defect concentrations can be highly sensitive to electronic structure perturbations under moderate electrical stimulus and serve as building blocks for next-generation neuroinspired computing hardware.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Search for W' bosons decaying to a top and a bottom quark at s=13TeV in the hadronic final state

A search is performed for W' bosons decaying to a top and a bottom quark in the all-hadronic final state, in proton-proton collisions at a center-of-mass energy of 13 TeV. The analyzed data were collected by the CMS experiment between 2016 and 2018 and correspond to an integrated luminosity of 137 fb -1 . Deep neural network algorithms are used to identify the jet initiated by the bottom quark and the jet containing the decay products of the top quark when the W' boson from the top quark decays hadronically. No excess above the estimated standard model background is observed. Upper limits on the production cross sections of W' bosons decaying to a top and a bottom quark are set. Both left- and right-handed W' bosons with masses below 3.4 TeV are excluded at 95% confidence level, and the most stringent limits to date on W bosons decaying to a top and a bottom quark in the all-hadronic final state are obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Scalable algorithms for physics-informed neural and graph networks

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing the physical laws and evaluating them at random points in the space–time domain. Such PIML integrates multimodality and multifidelity data with mathematical models, and implements them using neural networks or graph networks. Here, we review some of the prevailing trends in embedding physics into machine learning, using physics-informed neural networks (PINNs) based primarily on feed-forward neural networks and automatic differentiation. For more complex systems or systems of systems and unstructured data, graph neural networks (GNNs) present some distinct advantages, and here we review how physics-informed learning can be accomplished with GNNs based on graph exterior calculus to construct differential operators; we refer to these architectures as physics-informed graph networks (PIGNs). We present representative examples for both forward and inverse problems and discuss what advances are needed to scale up PINNs, PIGNs and more broadly GNNs for large-scale engineering problems.

42 ENGINEERING↗
DOE OSTI2020

On the Relationship Between Shallow Cumulus Cloud Field Properties and Surface Solar Irradiance

Abstract Shallow cumulus clouds exhibit highly three‐dimensional (3‐D) spatial structure leading to complex variability in the surface solar irradiance (SSI) beneath. This variability is captured by the typically bimodal shape of the SSI probability density function (PDF). Using large eddy simulation to generate well‐resolved cloud fields and Monte Carlo 3‐D radiative transfer to reproduce realistic associated SSI PDFs, we seek direct relationships between the cloud field properties and the SSI PDF shape. Applying both random forest and artificial neural network algorithms, we find variations in the two modes of the SSI PDF are well predicted by just a handful of cloud field properties. The two algorithms utilize cloud properties similarly, with indistinguishable performance despite their different architectures. These results offer a marked improvement in realism relative to one‐dimensional radiative transfer while bypassing computationally expensive 3‐D radiative transfer, with immediate application to renewable energy assessments, and potential for several other geophysical applications.

58 GEOSCIENCES↗
DOE OSTI2022

Assessing Physical Relationships Between Atmospheric State, Fluxes, and Boundary Layer Stability at McMurdo Station, Antarctica

Observations at McMurdo Station, Antarctica from 24 November 2015 through 3 January 2017 were used to characterize the physical relationships between boundary layer stability and atmospheric state and fluxes. The basis of this analysis was self-organizing maps (SOMs), a neural network algorithm, used to identify the range of potential temperature profiles present in the twice-daily radiosonde data during the ARM (Atmospheric Radiation Measurement) West Antarctic Radiation Experiment (AWARE) campaign. The SOM identified profiles ranging from strongly stable to weakly stable regimes over the lowest 500 m of the atmosphere. It was found that in the winter (MJJA), moderate and strongly stable regimes occur most frequently (61%), while weakly stable regimes dominate in the summer (DJ, 83.4%). The mechanisms responsible for the dominance of different stability regimes in each season were analyzed to determine why these regimes occur with varying frequency throughout the year. This analysis found that wind speed variations and radiative cooling are responsible for the stability observed in the winter, radiative warming, as well as weaker wind speeds, are responsible for summer weak stability, and stability variations in the transition seasons (FMA, SON) are characterized by a change in sign of net radiation with increasing stability, as wind speed changes little across stability regimes. Low-level jets were observed to occur about 50% of the time below areas of enhanced stability aloft and were observed most frequently in the transition seasons. The boundary layer depth, as determined by the Bulk Richardson number, was found to decrease with increasing stability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The Role of Mesoscale Cloud Morphology in the Shortwave Cloud Feedback

A supervised neural network algorithm is used to categorize near-global satellite retrievals into three mesoscale cellular convective (MCC) cloud morphology patterns. At constant cloud amount, morphology patterns differ in brightness associated with the amount of optically thin cloud features. Environmentally driven transitions from closed MCC to other morphology patterns, typically accompanied by more optically thin cloud features, are used as a framework to quantify the morphology contribution to the optical depth component of the shortwave cloud feedback. A marine heat wave is used as an out-of-sample test of closed MCC occurrence predictions. Morphology shifts in optical depth between 65°S and 65°N under projected environmental changes (i.e., from an abrupt quadrupling of CO 2 ) assuming constant cloud cover contributes between 0.04 and 0.07 W m -2 K -1 (aggregate of 0.06) to the global mean cloud feedback.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Accurate prediction of carbon dioxide capture by deep eutectic solvents using quantum chemistry and a neural network

Carbon dioxide (CO 2 ) emissions from fossil fuel combustion are a significant source of greenhouse gas, contributing in a major way to global warming and climate change. Carbon dioxide capture and sequestration is gaining much attention as a potential method for controlling these greenhouse gas emissions. Among the environmentally friendly solvents, deep eutectic solvents (DESs) have demonstrated the potential capability for carbon capture. To establish a theoretical framework for DES activity, thermodynamics modeling and solubility predictions are significant factors to anticipate and understand the system behavior. Here, in this study, we combine the COSMO-RS model with machine learning techniques to predict the solubility of CO 2 in various deep eutectic solvents. A comprehensive data set was established comprising 1973 CO 2 solubility data points in 132 different DESs at a variety of temperatures, pressures, and DES molar ratios. This data set was then utilized for the further verification and development of the COSMO-RS model. The CO 2 solubility (ln(x CO 2 )) in DESs calculated with the COSMO-RS model differs significantly from the experiment with an average absolute relative deviation (AARD) of 23.4%. A multilinear regression model was developed using the COSMO-RS predicted solubility and a temperature-pressure dependent parameter, which improved the AARD to 12%. Finally, a machine learning model using COSMO-RS-derived features was developed based on an artificial neural network algorithm. The results are in excellent agreement with the experimental CO 2 solubilities, with an AARD of only 2.72%. The ML model will be a potentially useful tool for the design and selection of DESs for CO 2 capture and utilization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Autonomous Selective Parts-Based Tracking

Object tracking from videos is still a challenging task due to various changes throughout a video sequence including occlusions, motion blur, scale and other deformation changes. In this paper, we propose a selective parts-based approach, using correlation filters, that makes choices based on a consensus of the parts and global tracking. Moreover, we further enhance our parts-based approach by introducing a segmentation-assisted parts initialization. In addition, we present a genetic algorithm-based method to autonomously select various parameters of the tracking algorithm, as opposed to the common practice of manually tuning those parameters. In contrast to existing part-based methods, the proposed method does not dilute accurate tracking by averaging results over multiple parts at every frame. Instead, we take a selective approach based on the relative weight of the responses across parts. Moreover, we only make location corrections when a part diverges, and rely on these location corrections to maintain an accurate appearance model. In the case of occlusions, which are among the main reasons for using a parts-based approach, our proposed approach consistently achieves the best performance. It is due to the ability to handle occlusion and not dilute decisions with incorrect parts, that our proposed approach enables state-of-the-art performance. The approach we propose was evaluated on videos from three different challenging benchmark datasets. Our approach has resulted in better overall precision and success rates for three different base tracking approaches.

42 ENGINEERING↗
DOE OSTI2021

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Neural net detection of seismic features related to gas hydrates and free gas accumulations on the northern U.S. Atlantic margin

Bottom-simulating reflections (BSRs) that sometimes mark the base of the gas hydrate stability zone in marine sediments are often identified based on the reverse polarity reflections that cut across stratigraphic layering in seismic amplitude data. On the northern U.S. Atlantic margin (USAM) between Cape Hatteras and Hudson Canyon, legacy seismic data have revealed pronounced BSRs south of the deepwater extension of Hudson Canyon and more subtle ones from offshore Delaware south to Cape Hatteras, where the reflections sometimes follow stratigraphic layering. Using high-resolution seismic data acquired during the 2018 Mid-Atlantic Resource Imaging Experiment and a supervised neural net, we identify seismic features associated with gas hydrates and/or the top of gas between Hudson Canyon and Cape Hatteras. Using seismic attributes especially sensitive to the presence of gas, we train a neural network algorithm on seismic data from an area with strong BSRs and then apply the model to the rest of the data set. The results indicate that gas hydrate and/or shallow free gas are significantly more widespread on the northern part of the USAM than previously known. Seismic indicators of gas extend landward from the 2000 m isobath to the upper continental slope in sectors with (offshore Virginia) and, to a lesser extent, without (offshore New Jersey) pervasive upper slope methane seeps. Higher sand content and intermediate sediment thickness, factors related to the container size and gas charge in a petroleum systems framework, are associated with more robust gas indicators.

Geochemistry & Geophysics↗
DOE OSTI2024

HLS4ML Integration with QICK

The QICK (Quantum Instrumentation Control Kit) integration aims to enhance the readout of superconducting qubits by leveraging machine learning (ML) techniques. These techniques offer high accuracy, increased speed, and better state preservation for qubit readouts. The integration process employs neural network algorithms to optimize system performance and achieve high accuracy rates. The QICK board uses an FPGA, allowing for efficient real-time processing and high-performance execution of machine learning algorithms.

Ali, Mohamud↗
DOE OSTI2023

Variations in boundary layer stability across Antarctica: a comparison between coastal and interior sites

The range of boundary layer stability profiles, from the surface to 500 m a.g.l. (above ground level), present in radiosonde observations from two continental-interior (South Pole Station and Dome Concordia Station) and three coastal (McMurdo Station, Georg von Neumayer Station III, and Syowa Station) Antarctic sites, is examined using the self-organizing maps (SOMs) neural network algorithm. A wide range of potential temperature profiles is revealed, from shallow boundary layers with strong near-surface stability to deeper boundary layers with weaker or near-neutral stability, as well as profiles with weaker near-surface stability and enhanced stability aloft, above the boundary layer. Boundary layer regimes were defined based on the range of profiles revealed by the SOM analysis; 20 boundary layer regimes were identified to account for differences in stability near the surface as well as above the boundary layer. Strong, very strong, or extremely strong stability, with vertical potential temperature gradients of 5 to in excess of 30 K per 100 m, occurred more than 80 % of the time at South Pole and Dome Concordia in the winter. Weaker stability was found in the winter at the coastal sites, with moderate and strong stability (vertical potential temperature gradients of 1.75 to 15 K per 100 m) occurring 70 % to 85 % of the time. Even in the summer, moderate and strong stability is found across all five sites, either immediately near the surface or aloft, just above the boundary layer. While the mean boundary layer height at the continental-interior sites was found to be approximately 50 m, the mean boundary layer height at the coastal sites was deeper, around 110 m. Further, a commonly described two-stability-regime system in the Arctic associated with clear or cloudy conditions was applied to the 20 boundary layer regimes identified in this study to understand if the two-regime behavior is also observed in the Antarctic. It was found that moderate and strong stability occur more often with clear- than cloudy-sky conditions, but weaker stability regimes occur almost equally for clear and cloudy conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Prediction of DIII-D Pedestal Structure from Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. An experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (ne) and electron temperature (Te) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (Ip), toroidal magnetic field (Bφ), neutral beam heating power (PNBI) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗
DOE OSTI2023

Challenges and Opportunities in Deep Reinforcement Learning With Graph Neural Networks: A Comprehensive Review of Algorithms and Applications

Deep reinforcement learning (DRL) has empowered a variety of artificial intelligence fields, including pattern recognition, robotics, recommendation-systems, and gaming. Similarly, graph neural networks (GNN) have also demonstrated their superior performance in supervised learning for graph-structured data. In recent times, the fusion of GNN with DRL for graph-structured environments has attracted a lot of attention. Here, this paper provides a comprehensive review of these hybrid works. These works can be classified into two categories: (1) algorithmic enhancement, where DRL and GNN complement each other for better utility; (2) application-specific enhancement, where DRL and GNN support each other. This fusion effectively addresses various complex problems in engineering and life sciences. Based on the review, we further analyze the applicability and benefits of fusing these two domains, especially in terms of increasing generalizability and reducing computational complexity. Finally, the key challenges in integrating DRL and GNN, and potential future research directions are highlighted, which will be of interest to the broader machine learning community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Inference of response functions with the help of machine-learning algorithms

Response functions are a key quantity to describe the near-equilibrium dynamics of strongly interacting many-body systems. Recent techniques that attempt to overcome the challenges of calculating these ab initio have employed expansions in terms of orthogonal polynomials. We employ a neural network prediction algorithm to reconstruct a response function 𝑆⁡(𝜔) defined over a range in frequencies 𝜔. Here, we represent the calculated response function as a truncated Chebyshev series whose coefficients can be optimized to reduce the representation error. We compare the quality of response functions obtained using coefficients calculated using a neural network (NN) algorithm with those computed using the Gaussian integral transform (GIT) method. In the regime where only a small number of terms in the Chebyshev series are retained, we find that the NN scheme outperforms the GIT method.

Kurkcuoglu, Doga Murat [Fermi National Accelerator↗
DOE OSTI2024

AGS-GNN: Attribute-guided Sampling for Graph Neural Networks

We propose AGS-GNN, a novel attribute-guided sampling algorithm for Graph Neural Networks (GNNs) that exploits node features and connectivity structure of a graph while simultaneously adapting for both homophily and heterophily in graphs. (In homophilic graphs vertices of the same class are more likely to be connected, and vertices of different classes tend to be linked in heterophilic graphs.) While GNNs have been successfully applied to homophilic graphs, their application to heterophilic graphs remains challenging. The best-performing GNNs for heterophilic graphs do not fit the sampling paradigm, suffer high computational costs, and are not inductive. We employ samplers based on feature-similarity and feature-diversity to select subsets of neighbors for a node, and adaptively capture information from homophilic and heterophilic neighborhoods using dual channels. Currently, AGS-GNN is the only algorithm that we know of that explicitly controls homophily in the sampled subgraph through similar and diverse neighborhood samples. For diverse neighborhood sampling, we employ submodularity, which was not used in this context prior to our work. The sampling distribution is pre-computed and highly parallel, achieving the desired scalability. Using an extensive dataset consisting of 35 small (<=100K nodes) and large (>100K nodes) homophilic and heterophilic graphs, we demonstrate the superiority of AGS-GNN compare to the current approaches in the literature. AGS-GNN achieves comparable test accuracy to the best-performing heterophilic GNNs, even outperforming methods using the entire graph for node classification. AGS-GNN also converges faster compared to methods that sample neighborhoods randomly, and can be incorporated into existing GNN models that employ node or graph sampling.

artificial intelligence↗