Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Simulated meteorological impacts of offshore wind turbines and sensitivity to the amount of added turbulence kinetic energy

Offshore wind energy projects are currently in development off the east coast of the United States and may influence the local meteorology of the region. Wind power production and other commercial uses in this area are related to atmospheric conditions, and so it is important to understand how future wind plants may change the local meteorology. In the absence of measurements of potential wind plant impacts on meteorology, simulations offer the next-best possible insight into wake effects on boundary layer height, temperature, fluxes, and wind speeds. However, simulation tools that capture these effects offer multiple options for representing the amount of turbine-added turbulence that may impact assessments of micrometeorological effects. To explore this sensitivity, we compare 1 year of simulations from the Weather Research and Forecasting (WRF) model with and without wind plants incorporated, focusing on the lease area south of Massachusetts and Rhode Island. The simulations with wind plants are repeated to include both the maximum and minimum amounts of added turbulence to provide bounds on the potential impacts. We assess changes in wind speeds, 2 m temperature, surface heat flux, turbulence kinetic energy (TKE), and boundary layer height during different stability classifications and ambient wind speeds over the entire year and compare results for the degree of added turbulence in the wind plant simulations. Because the wake behavior may be a function of boundary layer stability, in this paper, we also present a machine learning algorithm to quantify the area and distance of the wake generated by the wind plant. This analysis enables us to identify the relationship between wake extent and boundary layer height. We find that hub-height wind speed is reduced within and downwind of the wind plant, with the strongest impacts occurring during stable conditions and faster wind speeds in region 3 of the turbine power curve, although impacts lessen as wind speeds increase past 15 m s−1. In contrast, wind speeds near the surface decrease when no turbine-added turbulence is included but can increase for stably stratified conditions when 100 % of possible TKE is included in the simulations. TKE increases at hub height in the simulations with added TKE for all stability classes, suggesting that atmospheric stability does not immediately modify the TKE generated by turbines. Negligible changes in hub-height TKE manifest in the simulations without the added TKE. At the surface, TKE increases in the simulations with maximum added turbulence only for unstable conditions. In the no-added-turbulence simulations, surface TKE decreases slightly in neutral and unstable simulations. Differences in 2 m temperatures and surface heat fluxes are small but vary considerably with atmospheric stability and the amount of added TKE. Boundary layer heights increase within the wind plant when turbine-added turbulence is included and decrease slightly downwind during stable conditions. In contrast, with no added turbulence, the boundary layer height is in general reduced in stable conditions with wind speeds less than 15 m s −1 and slightly increased in neutral conditions. Finally, shallower upwind boundary layer heights tend to correlate with larger wake areas and distances, though other factors likely also play a role in determining the extent of the wind plant wake. These simulation-based results provide a bound for micrometeorological impacts of wind plant wakes: simulations that couple the atmosphere to the ocean may reduce these impacts, and we await observational verification.

17 WIND ENERGY↗
DOE OSTI2025

Linking large-scale weather patterns to observed and modeled turbine hub-height winds offshore of the US West Coast

The US West Coast holds great potential for wind power generation, although its potential varies due to the complex coastal climate. Characterizing and modeling turbine hub-height winds under different weather conditions are vital for wind resource assessment and management. This study uses a two-stage machine learning algorithm to identify five large-scale meteorological patterns (LSMPs): post-trough, post-ridge, pre-ridge, pre-trough, and California high. The LSMPs are linked to offshore wind patterns, specifically at lidar buoy locations within lease areas for future wind farm development off Humboldt and Morro Bay. While each LSMP is associated with characteristic large-scale atmospheric conditions and corresponding differences in wind direction, diurnal variation, and jet features at the two lidar sites, substantial variability in wind speeds can still occur within each LSMP. Wind speeds at Humboldt increase during the post-trough, pre-ridge, and California-high LSMPs and decrease during the remaining LSMPs. Morro Bay has smaller responses in mean speeds, showing increased wind speed during the post-trough and California-high LSMPs. Besides the LSMPs, local factors, including the land–sea thermal contrast and topography, also modify mean winds and diurnal variation. The High-Resolution Rapid Refresh model analysis does a good job of capturing the mean and variation at Humboldt but produces large biases at Morro Bay, particularly during the pre-ridge and California-high LSMPs. The findings are anticipated to guide the selection of cases for studying the influence of specific large-scale and local factors on California offshore winds and to contribute to refining numerical weather prediction models, thereby enhancing the efficiency and reliability of offshore wind energy production.

17 WIND ENERGY↗
DOE OSTI2024

Tensor Extraction of Latent Features (TELF)

Tensor ELF is a user-friendly parallel tensor decomposition Python toolbox that includes a suite of machine learning algorithms for CPU and GPU architectures for the analysis of sparse and dense data including utility tools for pre-processing and post-processing.

Eren, Maksim↗
DOE OSTI2024

Electrical Resistivity Tomography based monitoring of stress perturbations to optimize placement of high-precision strain meters

The Center for Understanding Subsurface Signals and Permeability is a new U.S. Department of Energy Earthshot Center focused on understanding and predicting the long-term evolution of permeability in enhanced geothermal systems. The center will use a highly instrumented testbed within the Sanford Underground Research Facility to conduct field scale experiments that elucidate and test capabilities to simulate geochemical-geomechanical interactions and permeability evolution. Here we demonstrate initial developments using previously collected electrical resistivity tomography (ERT) monitoring data with high-performance multi-physics modelling advancements to inform the optimal location of two new monitoring boreholes. Specifically, ERT monitoring data collected during shear stimulation testing shows marked responses to changes in stress during borehole pressurization. We demonstrate how the same response is being simulated, ultimately to train a machine-learning algorithm to estimate rock properties and enable enhanced prediction of stress and strain responses anticipated during future testing campaigns.

Stress, EGS, CUSSP, 3D Electrical Imaging↗
DOE OSTI2020

Direction-optimizing Label Propagation and its Application for Community Detection

Label Propagation is a machine learning algorithm typically used for classification. It has also been found to be an effective method for detecting communities in networks. It has two attractive features as a community detection method: it has nearly linear runtime and it requires no \textit{a priori} community information. We propose a new Direction Optimizing Label Propagation Algorithm (DOLPA) that relies on the use of {\em frontiers} and alternates between label {\em push} and label {\em pull} operations to enhance the performance of LPA. Specifically, DOLPA has parameters for tuning the processing order of vertices in a graph. This reduces the number of edges visited and improves the quality of solution. We apply DOLPA to community detection and present the design and implementation of the algorithm as well as its shared-memory parallelization using OpenMP. Empirically, we evaluate our algorithm using synthetic graphs as well as real-world networks. Compared with the state-of-art \textit{Parallel Label Propagation} algorithm, we achieve at least two times the F-Score while reducing the runtime by 50\% for synthetic graphs with overlapping communities. We also compare DOLPA against the state-of-art parallel implementation of the Louvain method using the same graphs and show that DOLPA achieves about three times the F-Score at 10\% the runtime. On real-world graphs, we get a speedup of up to $10\times$ using 64 threads.

Liu, X↗
DOE OSTI2020

Domain adaptation techniques for improved cross-domain study of galaxy mergers

In astronomy, neural networks are often trained on simulated data with the prospect of being applied to real observations. Unfortunately, simply training a deep neural network on images from one domain does not guarantee satisfactory performance on new images from a different domain. The ability to share cross-domain knowledge is the main advantage of modern deep domain adaptation techniques. Here we demonstrate the use of two techniques - Maximum Mean Discrepancy (MMD) and adversarial training with Domain Adversarial Neural Networks (DANN) - for the classification of distant galaxy mergers from the Illustris-1 simulation, where the two domains presented differ only due to inclusion of observational noise. We show how the addition of either MMD or adversarial training greatly improves the performance of the classifier on the target domain when compared to conventional machine learning algorithms, thereby demonstrating great promise for their use in astronomy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Using Machine Learning to Track Objects Across Cameras

Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2020

Deep Learning Prediction of Interspecies Interactions from Self-organized Spatiotemporal Patterns of Co-evolving Organisms

Microorganisms colonizing natural habits such as soils co-evolve to form specific spatial patterns through interspecies interactions. These self-organized patterns are a key ecological phenotype, which provides critical information on their interaction mechanisms. However, conventional network inference techniques that analyze species population data in bulk have yet to be extended to account for such spatial heterogeneity. Here we proposed supervised deep learning as a new network inference tool for predicting interspecies interactions from spatiotemporal patterns of microbial evolution. Due to lack of biological imaging data that can be used for training deep learning networks, we used in silico data generated from high-fidelity agent-based models to determine model structure and parameters. Even though networks were trained under simple configurations where interaction coefficients are assumed to be spatially invariant, we demonstrated that the resulting model can be utilized to successfully predict spatial variation of interactions in more complex domains (i.e., configured with a context-dependent mixture of interaction coefficients) as well as in simple domains without further training. In the further test against real biological data obtained through imaging experiments of a binary consortium (Pseudomonas fluorescens and a mutant of Escherichia coli), our model also predicted the dramatic shifts in interactions of the two organisms across different environmental contexts. Through various successful demonstrations in this work, the combined use of the agent-based model and machine learning algorithm provides a means to use new type of data - microscopic images - for extracting microbial interactions, therefore presenting itself as a useful tool for the analysis of more complex microbial community interactions.

Lee, Joon-Yong↗
DOE OSTI2021

Application-driven Privacy-preserving Data Publishing with Correlated Attributes

Recent advances in computing have allowed for the possibility to collect large amounts of data on personal activities and private living spaces. To address the privacy concerns of users in this environment, we propose a novel framework called PR-GAN that offers privacy-preserving mechanism using generative adversarial networks. Given a target application, PR-GAN automatically modifies the data to hide sensitive attributes - which may be hidden and can be inferred by machine learning algorithms - while preserving the data utility in the target application. Unlike prior works, the public's possible knowledge of the correlation between the target application and sensitive attributes is built into our modeling. We formulate our problem as an optimization problem, show that an optimal solution exists and use generative adversarial networks (GAN) to create perturbations. We further show that our method provides privacy guarantees under the Pufferfish framework, an elegant generalization of the differential privacy that allows for the modeling of prior knowledge on data and correlations. Through experiments, we show that our method outperforms conventional methods in effectively hiding the sensitive attributes while guaranteeing high performance in the target application, for both property inference and training purposes. Finally, we demonstrate through further experiments that once our model learns a privacy-preserving task, such as hiding subjects' identity, on a group of individuals, it can perform the same task on a separate group with minimal performance drops.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Universal image representation based on a multimodal graph

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Bremer, Peer-Timo↗
DOE OSTI2022

Investigating Fission Reaction Rate Ratio Sensitivities [Abstract]

Reaction rate ratios are a measurable parameter for reactor and criticality applications. A number of foil irradiations and fission chamber measurements have been performed for critical assemblies at Los Alamos National Laboratory starting in the 1950’s including (i) Godiva, a bare HEU spherical assembly; (ii) Flattop-25, a spherical assembly consisting of an HEU core and a natural uranium reflector; (iii) Jezebel, a bare 239 Pu assembly; and (iv) Flattop-Pu, a spherical assembly consisting of a 239Pu core and a natural uranium reflector. Fission ratio data for 238 U(n,f)/ 235 U(n,f), 237 Np(n,f)/ 235 U(n,f), 233 U(n,f)/ 235 U(n,f) and 239 Pu(n,f)/ 235 U(n,f) were obtained and reported. The EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data) project at Los Alamos National Laboratory (LANL) aims to constrain nuclear data by using a suite of measurement types beyond k-effective. Recent investigations include the use of pulsed spheres for nuclear data validation and other measurement methods of interest. One focus of the work is to determine if other methods are complimentary to the critical experiments utilized for nuclear data validation. It is anticipated the investigations will help inform methods that may be utilized in machine learning algorithms for nuclear validation. In order to use a measurement type for nuclear validation, it is necessary to obtain cross-section sensitivities for parameters. This work looks at reaction rate ratio sensitivities with SENSMG and Monte Carlo N-Particle R Code Version 6.21.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Estimating Cosmological Constraints from Galaxy Cluster Abundance using Simulation-Based Inference

Inferring the values and uncertainties of cosmological parameters in a cosmology model is of paramount importance for modern cosmic observations. In this paper, we use the simulation-based inference (SBI) approach to estimate cosmological constraints from a simplified galaxy cluster observation analysis. Using data generated from the Quijote simulation suite and analytical models, we train a machine learning algorithm to learn the probability function between cosmological parameters and the possible galaxy cluster observables. The posterior distribution of the cosmological parameters at a given observation is then obtained by sampling the predictions from the trained algorithm. Our results show that the SBI method can successfully recover the truth values of the cosmological parameters within the 2σ limit for this simplified galaxy cluster analysis, and acquires similar posterior constraints obtained with a likelihood-based Markov Chain Monte Carlo method, the current state-of the-art method used in similar cosmological studies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

OPERATIONAL TECHNOLOGY BEHAVIORAL ANALYTICS (OTBA) – A DATA-CENTRIC APPROACH FOR REDUCING CYBERSECURITY RISK

This paper provides a summary of the methodology, findings, lessons learned, and insights from an investigation into the feasibility of the Operational Technology Behavioral Analytics (OTBA) cybersecurity approach. The concept was evaluated with data from the National Carbon Capture Center (NCCC) – a U.S. Department of Energy (DOE) funded facility that is managed and operated by Southern Company at Alabama Power’s E. C. Gaston generating power plant in Wilsonville, Alabama. Appropriate data sources for the post-combustion carbon capture system were identified. Infrastructure was deployed to monitor, capture and archive data for the system. Critical parameters for each subsystem were identified and analyzed. Machine-learning algorithms were used to establish and characterize normal operations and subsequently identify anomalies. This effort yielded valuable insights and formed the basis of a data-centric strategy for detecting cyber-attacks along with a coordinated response philosophy. A significant takeaway is that the OTBA cybersecurity approach is quite portable; it can be applied to other critical infrastructure beyond fossil power generation.

Black, Clifton↗
DOE OSTI2022

Dimensionless parameters to categorize the failure modes of ductile plate perforation

In this work, two dimensionless parameters were derived organically from impact mechanics equations to remove the need for empirical constants. These two dimensionless parameters effectively collapse the ballistic performance of ductile metal plates along two distinct loci, depending on the projectile geometry and the corresponding failure mode. Projectiles that initiate ductile hole enlargement via cavity expansion fall along a linear curve, while shear-plugging failure modes tend to fall along a cubic curve. Results were demonstrated for various projectiles of different calibers impacting aluminum and Ti-6Al-4V alloys. The main advantage of the approach in this work is to drastically reduce the number of features for input into machine learning algorithms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Dimensionless parameters to categorize the failure modes of ductile plate perforation

In this work, two dimensionless parameters were derived organically from impact mechanics equations to remove the need for empirical constants. These two dimensionless parameters effectively collapse the ballistic performance of ductile metal plates along two distinct loci, depending on the projectile geometry and the corresponding failure mode. Projectiles that initiate ductile hole enlargement via cavity expansion fall along a linear curve, while shear-plugging failure modes tend to fall along a cubic curve. Results were demonstrated for various projectiles of different calibers impacting aluminum and Ti-6Al-4V alloys, and further explored for more complex target combinations. The main advantage of the approach in this work is to drastically reduce the number of features for input into machine learning algorithms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

GOOML - Finding Optimization Opportunities for Geothermal Operations: Preprint

Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach. We have used this framework to develop digital twins that provide steamfield operators with an operational environment to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management for real world applications. The GOOML modeling software is built on a generic component-based systems framework that allows for both historical and forecast analysis. A GOOML model can perform historical data-assimilation using first-principal thermodynamics to create a meaningful data model. Historical production data can then be coupled with a forecast framework to train machine-learning models of steamfield components to predict future outputs. This modeling environment enables digital exploration of steamfield design configurations and operational scenarios. GOOML digital twins have been developed for steamfields in New Zealand and the United States representing differing power generation and field conditions. These digital twins have been validated by comparing hindcast predictions against historical production data. Reinforcement learning experiments were conducted to demonstrate the ability to programmatically explore the operations space using machine learning agents. Our initial results are compelling; two to five percent increases in annual energy production were demonstrated by the GOOML models with no additional infrastructure build required. GOOML offers a new approach to geothermal operations by applying state-of-the-art machine learning algorithms, comprehensive data analytics, and interaction with digital twins. Through application of these tools, operators will realize greater availability and higher net generation which will increase the cost effectiveness of geothermal energy projects.

access↗
DOE OSTI2023

Wind Turbine Drivetrain Reliability Research - Gearbox Bearing Axial Cracking Failure Mode Example

The U.S. Department of Energy's National Renewable Energy Laboratory and Argonne National Laboratory have been conducting wind turbine drivetrain (formerly gearbox) reliability research for many years. Although the drivetrain focus has not changed, detailed projects are adjusted every few years based on dynamic needs seen in the field across the wind industry. This webinar will walk through the research methodology by using wind turbine gearbox bearing axial cracking failure mode as an example. The detailed steps include: 1) top failure mode identification based on actual failure data collected from project partners, 2) bench-top testing to identify possible contributing factors and formulate a damage metric, 3) physics domain modeling and validation through testing, 4) reliability assessment and prognosis based on the physics domain model and data domain inputs, and further enhancement through machine learning algorithms, using actual wind plant operational and failure event data. Hopefully, the presented work is of interest to the IISE community, and some members can apply their expertise to wind turbine and plant applications, helping enhance wind power generation technology advancement and its broader deployment.

axial cracking↗
DOE OSTI2023

Adaptive Data-Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗