Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

LeptonJet Categorization with Decision Tree

With much evidence for dark matter arising from astronomical observations, particle physics has also begun to look for dark matter candidates. Here, a boosted decision tree machine learning algorithm (BDT) is used to distinguish signal from background in a search for self-interacting dark matter at CMS with two different final states of signal. The signal final states are two displaced collimated pairs of leptons (leptonJets). In this project, possible improvements to the BDT are explored. Various methods of signal separation are studied, as well as various accuracy metrics to study and compare the different models. Through the separated models and improvements in training, a slight increase in accuracy score was obtained (0.01% on electrons, 0.46% on muons). Additionally, the separated models were able to recognize a significantly increased percentage of signal, particularly against the electron signal. Separated models are being considered as part of the larger an alysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Direction-optimizing Label Propagation and its Application for Community Detection

Label Propagation is a machine learning algorithm typically used for classification. It has also been found to be an effective method for detecting communities in networks. It has two attractive features as a community detection method: it has nearly linear runtime and it requires no \textit{a priori} community information. We propose a new Direction Optimizing Label Propagation Algorithm (DOLPA) that relies on the use of {\em frontiers} and alternates between label {\em push} and label {\em pull} operations to enhance the performance of LPA. Specifically, DOLPA has parameters for tuning the processing order of vertices in a graph. This reduces the number of edges visited and improves the quality of solution. We apply DOLPA to community detection and present the design and implementation of the algorithm as well as its shared-memory parallelization using OpenMP. Empirically, we evaluate our algorithm using synthetic graphs as well as real-world networks. Compared with the state-of-art \textit{Parallel Label Propagation} algorithm, we achieve at least two times the F-Score while reducing the runtime by 50\% for synthetic graphs with overlapping communities. We also compare DOLPA against the state-of-art parallel implementation of the Louvain method using the same graphs and show that DOLPA achieves about three times the F-Score at 10\% the runtime. On real-world graphs, we get a speedup of up to $10\times$ using 64 threads.

Liu, X↗
DOE OSTI2020

A Learning-based Supervisory Control Architecture for Electric Vehicle Charging System Paired with Energy Storages

A Machine Learning-based predictive model is developed for optimal dispatching energy storage system integrated with Electric Vehicle battery charger. The model is effectively trained using transfer learning algorithm and successfully validated via measurement data to achieve high fidelity and accuracy. The study findings provide possibilities for future development of the presented approach to implement computational heavy predictive algorithms with multi-step predictions in emerging modular bidirectional charger topologies to realize vehicle-to-grid (V2G) technology. The online tuning can be explored using the new measurements obtained during the operation, henceforth, enhancing the controller performance for integrating multiple DERs into distribution power networks that shows huge interest for the utilities and regulatory agencies. Multiple operation scenatios have been evaluated and simulation results are discussed to verify intended performance of the proposed control solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Domain adaptation techniques for improved cross-domain study of galaxy mergers

In astronomy, neural networks are often trained on simulated data with the prospect of being applied to real observations. Unfortunately, simply training a deep neural network on images from one domain does not guarantee satisfactory performance on new images from a different domain. The ability to share cross-domain knowledge is the main advantage of modern deep domain adaptation techniques. Here we demonstrate the use of two techniques - Maximum Mean Discrepancy (MMD) and adversarial training with Domain Adversarial Neural Networks (DANN) - for the classification of distant galaxy mergers from the Illustris-1 simulation, where the two domains presented differ only due to inclusion of observational noise. We show how the addition of either MMD or adversarial training greatly improves the performance of the classifier on the target domain when compared to conventional machine learning algorithms, thereby demonstrating great promise for their use in astronomy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Deep Learning Prediction of Interspecies Interactions from Self-organized Spatiotemporal Patterns of Co-evolving Organisms

Microorganisms colonizing natural habits such as soils co-evolve to form specific spatial patterns through interspecies interactions. These self-organized patterns are a key ecological phenotype, which provides critical information on their interaction mechanisms. However, conventional network inference techniques that analyze species population data in bulk have yet to be extended to account for such spatial heterogeneity. Here we proposed supervised deep learning as a new network inference tool for predicting interspecies interactions from spatiotemporal patterns of microbial evolution. Due to lack of biological imaging data that can be used for training deep learning networks, we used in silico data generated from high-fidelity agent-based models to determine model structure and parameters. Even though networks were trained under simple configurations where interaction coefficients are assumed to be spatially invariant, we demonstrated that the resulting model can be utilized to successfully predict spatial variation of interactions in more complex domains (i.e., configured with a context-dependent mixture of interaction coefficients) as well as in simple domains without further training. In the further test against real biological data obtained through imaging experiments of a binary consortium (Pseudomonas fluorescens and a mutant of Escherichia coli), our model also predicted the dramatic shifts in interactions of the two organisms across different environmental contexts. Through various successful demonstrations in this work, the combined use of the agent-based model and machine learning algorithm provides a means to use new type of data - microscopic images - for extracting microbial interactions, therefore presenting itself as a useful tool for the analysis of more complex microbial community interactions.

Lee, Joon-Yong↗
DOE OSTI2021

Convolutional Neural Networks for the CHIPS Neutrino Detector R&D Project.

The CHerenkov detectors In mine PitS (Chips) neutrino detector R&D project aims to develop novel strategies and technologies for very large yet ‘cheap as chips’ water Cherenkov neutrino detectors. Via deployment in a body of water, use of commercially available components, and instrumentation coverage optimisation for the study of exclusively accelerator beam neutrinos, Chips will enable megaton scale detectors to become a reality at the cost of $200k-$300k per kt of sensitive mass. During the summer of 2019 a prototype Chips detector, Chips-5, was deployed into the Wentworth 2W disused mine pit in northern Minnesota, 7 mrad off the NuMI beam axis. A novel data acquisition system was introduced using cheap single-board computers and open-source software. This work presents a novel approach to water Cherenkov neutrino detector event reconstruction and classification. Three forms of a Convolutional Neural Network, a type of deep learning algorithm, have been trained to reject cosmic muon events, classify beam events, and estimate neutrino energies, all using only the raw detector event as input. When evaluated on the expected distribution of Chips-5 events, this new approach is shown to be robust and explainable as well as providing a significant performance increase over the standard likelihood-based reconstruction and simple neural network classification. Promisingly, the performance presented here is comparable to the more complex (and expensive) neutrino oscillation experiments within the field.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Universal image representation based on a multimodal graph

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Bremer, Peer-Timo↗
DOE OSTI2022

Testing multiflavored ULDM models with SPARC

We perform maximum likelihood estimates (MLEs) for single and double flavor ultralight dark matter (ULDM) models using the Spitzer Photometry and Accurate Rotation Curves (SPARC) database. These estimates are compared to MLEs for several commonly used cold dark matter (CDM) models. By comparing various CDM models we find, in agreement with previous studies, that the Burkert and Einasto models tend to perform better than other commonly used CDM models. We focus on comparisons between the Einasto and ULDM models and analyze cases for which the ULDM particle masses are: free to vary; and fixed. For each of these analyses, we perform fits assuming the soliton and halo profiles are: summed together; and matched at a given radius. When we let the particle masses vary, we find a negligible preference for any particular range of particle masses, within $10^{-25}\,\text{eV}\leq m\leq10^{-19}\,\text{eV}$, when assuming the summed models. For the matched models, however, we find that almost all galaxies prefer particles masses in the range $10^{-23}\,\text{eV}\lesssim m\lesssim10^{-20}\,\text{eV}$. For both double flavor models we find that most galaxies prefer approximately equal particle masses. We find that the summed models give much larger variances with respect to the soliton-halo (SH) relation than the matched models. When the particle masses are fixed, the matched models give median and mean soliton and halo values that fall within the SH relation bounds, for most masses scanned. When the particle masses are fixed in the fitting procedure, we find the best fit results for the particle mass $m=10^{-20.5}\,\text{eV}$ (for the single flavor models) and $m_1=10^{-20.5}\,\text{eV}$, $m_2=10^{-20.2}\,\text{eV}$ for the double flavor, matched model. We discuss how our study will be furthered using a reinforcement learning algorithm.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Investigating Fission Reaction Rate Ratio Sensitivities [Abstract]

Reaction rate ratios are a measurable parameter for reactor and criticality applications. A number of foil irradiations and fission chamber measurements have been performed for critical assemblies at Los Alamos National Laboratory starting in the 1950’s including (i) Godiva, a bare HEU spherical assembly; (ii) Flattop-25, a spherical assembly consisting of an HEU core and a natural uranium reflector; (iii) Jezebel, a bare 239 Pu assembly; and (iv) Flattop-Pu, a spherical assembly consisting of a 239Pu core and a natural uranium reflector. Fission ratio data for 238 U(n,f)/ 235 U(n,f), 237 Np(n,f)/ 235 U(n,f), 233 U(n,f)/ 235 U(n,f) and 239 Pu(n,f)/ 235 U(n,f) were obtained and reported. The EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data) project at Los Alamos National Laboratory (LANL) aims to constrain nuclear data by using a suite of measurement types beyond k-effective. Recent investigations include the use of pulsed spheres for nuclear data validation and other measurement methods of interest. One focus of the work is to determine if other methods are complimentary to the critical experiments utilized for nuclear data validation. It is anticipated the investigations will help inform methods that may be utilized in machine learning algorithms for nuclear validation. In order to use a measurement type for nuclear validation, it is necessary to obtain cross-section sensitivities for parameters. This work looks at reaction rate ratio sensitivities with SENSMG and Monte Carlo N-Particle R Code Version 6.21.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

OPERATIONAL TECHNOLOGY BEHAVIORAL ANALYTICS (OTBA) – A DATA-CENTRIC APPROACH FOR REDUCING CYBERSECURITY RISK

This paper provides a summary of the methodology, findings, lessons learned, and insights from an investigation into the feasibility of the Operational Technology Behavioral Analytics (OTBA) cybersecurity approach. The concept was evaluated with data from the National Carbon Capture Center (NCCC) – a U.S. Department of Energy (DOE) funded facility that is managed and operated by Southern Company at Alabama Power’s E. C. Gaston generating power plant in Wilsonville, Alabama. Appropriate data sources for the post-combustion carbon capture system were identified. Infrastructure was deployed to monitor, capture and archive data for the system. Critical parameters for each subsystem were identified and analyzed. Machine-learning algorithms were used to establish and characterize normal operations and subsequently identify anomalies. This effort yielded valuable insights and formed the basis of a data-centric strategy for detecting cyber-attacks along with a coordinated response philosophy. A significant takeaway is that the OTBA cybersecurity approach is quite portable; it can be applied to other critical infrastructure beyond fossil power generation.

Black, Clifton↗
DOE OSTI2022

Dimensionless parameters to categorize the failure modes of ductile plate perforation

In this work, two dimensionless parameters were derived organically from impact mechanics equations to remove the need for empirical constants. These two dimensionless parameters effectively collapse the ballistic performance of ductile metal plates along two distinct loci, depending on the projectile geometry and the corresponding failure mode. Projectiles that initiate ductile hole enlargement via cavity expansion fall along a linear curve, while shear-plugging failure modes tend to fall along a cubic curve. Results were demonstrated for various projectiles of different calibers impacting aluminum and Ti-6Al-4V alloys. The main advantage of the approach in this work is to drastically reduce the number of features for input into machine learning algorithms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Dimensionless parameters to categorize the failure modes of ductile plate perforation

In this work, two dimensionless parameters were derived organically from impact mechanics equations to remove the need for empirical constants. These two dimensionless parameters effectively collapse the ballistic performance of ductile metal plates along two distinct loci, depending on the projectile geometry and the corresponding failure mode. Projectiles that initiate ductile hole enlargement via cavity expansion fall along a linear curve, while shear-plugging failure modes tend to fall along a cubic curve. Results were demonstrated for various projectiles of different calibers impacting aluminum and Ti-6Al-4V alloys, and further explored for more complex target combinations. The main advantage of the approach in this work is to drastically reduce the number of features for input into machine learning algorithms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

GOOML - Finding Optimization Opportunities for Geothermal Operations: Preprint

Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach. We have used this framework to develop digital twins that provide steamfield operators with an operational environment to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management for real world applications. The GOOML modeling software is built on a generic component-based systems framework that allows for both historical and forecast analysis. A GOOML model can perform historical data-assimilation using first-principal thermodynamics to create a meaningful data model. Historical production data can then be coupled with a forecast framework to train machine-learning models of steamfield components to predict future outputs. This modeling environment enables digital exploration of steamfield design configurations and operational scenarios. GOOML digital twins have been developed for steamfields in New Zealand and the United States representing differing power generation and field conditions. These digital twins have been validated by comparing hindcast predictions against historical production data. Reinforcement learning experiments were conducted to demonstrate the ability to programmatically explore the operations space using machine learning agents. Our initial results are compelling; two to five percent increases in annual energy production were demonstrated by the GOOML models with no additional infrastructure build required. GOOML offers a new approach to geothermal operations by applying state-of-the-art machine learning algorithms, comprehensive data analytics, and interaction with digital twins. Through application of these tools, operators will realize greater availability and higher net generation which will increase the cost effectiveness of geothermal energy projects.

access↗
DOE OSTI2023

Wind Turbine Drivetrain Reliability Research - Gearbox Bearing Axial Cracking Failure Mode Example

The U.S. Department of Energy's National Renewable Energy Laboratory and Argonne National Laboratory have been conducting wind turbine drivetrain (formerly gearbox) reliability research for many years. Although the drivetrain focus has not changed, detailed projects are adjusted every few years based on dynamic needs seen in the field across the wind industry. This webinar will walk through the research methodology by using wind turbine gearbox bearing axial cracking failure mode as an example. The detailed steps include: 1) top failure mode identification based on actual failure data collected from project partners, 2) bench-top testing to identify possible contributing factors and formulate a damage metric, 3) physics domain modeling and validation through testing, 4) reliability assessment and prognosis based on the physics domain model and data domain inputs, and further enhancement through machine learning algorithms, using actual wind plant operational and failure event data. Hopefully, the presented work is of interest to the IISE community, and some members can apply their expertise to wind turbine and plant applications, helping enhance wind power generation technology advancement and its broader deployment.

axial cracking↗
DOE OSTI2022

Fiber Bundle Morphisms as a Framework for Modeling Many-to-Many Maps

While it is not generally reflected in the `nice' datasets used for benchmarking machine learning algorithms, the real-world is full of processes that would be best described as many-to-many. That is, a single input can potentially yield many different outputs (whether due to noise, imperfect measurement, or intrinsic stochasticity in the process) and many different inputs can yield the same output (that is, the map is not injective). For example, imagine a sentiment analysis task where, due to linguistic ambiguity, a single statement can have a range of different sentiment interpretations while at the same time many distinct statements can represent the same sentiment. When modeling such a multivalued function $f: X \rightarrow Y$, it is frequently useful to be able to model the distribution on $f(x)$ for specific input $x$ as well as the distribution on fiber $f^{-1}(y)$ for specific output $y$. Such an analysis helps the user (i) better understand the variance intrinsic to the process they are studying and (ii) understand the range of specific input $x$ that can be used to achieve output $y$. Following existing work which used a fiber bundle framework to better model many-to-one processes we describe how morphisms of fiber bundles provide a template for building models which naturally capture the structure of many-to-many processes.

Coda, Elizabeth D.↗
DOE OSTI2023

Universal image representation based on a multimodal graph

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Bremer, Peer-Timo↗
DOE OSTI2023

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the order of $10^5$, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but the alternative of training only on simulated data results in poor performance on real data. Domain Adaptation may be able to bridge the gap between simulated and real datasets. We utilize domain adaptation for the estimation of Einstein radius ($\Theta_E$) in simulated galaxy-scale gravitational lensing images with different levels of observational realism. We evaluate two domain adaptation techniques - Domain Adversarial Neural Networks (DANN) and Maximum Mean Discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain of lenses simulated to emulate noise conditions in the Dark Energy Survey (DES). We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain dataset. This work is the first application of domain adaptation for a regression task in strong lensing imaging analysis. Our results show the potential of using domain adaptation to perform analysis of future survey data with a deep neural network trained on simulated data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the magnitude of 105, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but training only on simulated data results in poor performance on real data. Domain adaptation can bridge the gap between simulated and real datasets. We adopt domain adaptation on the estimation of Einstein radius in simulated galaxy-scale gravitational lensing images. We evaluate two domain adaptation techniques - domain adversarial neural networks (DANN) and maximum mean discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain with emulation of DES survey conditions. We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain datasets. Our results show the potential of using domain adaptation to perform analysis on future survey data with a deep neural network trained on simulated data.

79 ASTRONOMY AND ASTROPHYSICS↗