Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Upscaling instantaneous to daily evapotranspiration using modelled daily shortwave radiation for remote sensing applications: An artificial neural network approach

Upscaling instantaneous evapotranspiration retrieved at any specific time-of-day (ET i ) to daily evapotranspiration (ET d ) is a key challenge in mapping regional ET using polar orbiting sensors. Various studies have unanimously cited the shortwave incoming radiation ( R S ) to be the most robust reference variable explaining the ratio between ET d and ET i . This study aims to contribute in ET i upscaling for global studies using the ratio between daily and instantaneous incoming shortwave radiation ( R Sd / R Si ) as a factor for converting ET i to ET d . This paper proposes an artificial neural network (ANN) machine-learning algorithm first to predict R Sd from R Si followed by using the R Sd / R Si ratio to convert ET i to ET d across different terrestrial ecosystems. Using R Si and R Sd observations from multiple sub-networks of the FLUXNET database spread across different climates and biomes (to represent inputs that would typically be obtainable from remote sensors during the overpass time) in conjunction with some astronomical variables (e.g. solar zenith angle, day length, exoatmospheric shortwave radiation), we developed the ANN model for reproducing R Sd and further used it to upscale ET i to ET d . The efficiency of the ANN is evaluated for different morning and afternoon times of day, under varying sky conditions, and also at different geographic locations. R S -based upscaled ET d produced a significant linear relation ( R 2 = 0.65 to 0.69), low bias (-0.31 to -0.56 MJ m -2 d -1 ; approx. 4 %), and good agreement (RMSE 1.55 to 1.86 MJ m -2 d -1 ; approx. 10 %) with the observed ET d , although a systematic overestimation of ET d was also noted under persistent cloudy sky conditions. Inclusion of soil moisture and rainfall information in ANN training reduced the systematic overestimation tendency in predominantly overcast days. An intercomparison with existing upscaling method at daily, 8-day, monthly, and yearly temporal resolution revealed a robust performance of the ANN-driven R S -based ET i upscaling method and was found to produce lowest RMSE under cloudy conditions. Sensitivity analysis revealed variable sensitivity of the method to biome selection and high ET d prediction errors in forest ecosystems are primarily associated with greater rainfall and cloudiness. As a result, the overall methodology appears to be promising and has substantial potential for upscaling ET i to ET d for field and regional-scale evapotranspiration mapping studies using polar orbiting satellites.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Simulated meteorological impacts of offshore wind turbines and sensitivity to the amount of added turbulence kinetic energy

Offshore wind energy projects are currently in development off the east coast of the United States and may influence the local meteorology of the region. Wind power production and other commercial uses in this area are related to atmospheric conditions, and so it is important to understand how future wind plants may change the local meteorology. In the absence of measurements of potential wind plant impacts on meteorology, simulations offer the next-best possible insight into wake effects on boundary layer height, temperature, fluxes, and wind speeds. However, simulation tools that capture these effects offer multiple options for representing the amount of turbine-added turbulence that may impact assessments of micrometeorological effects. To explore this sensitivity, we compare 1 year of simulations from the Weather Research and Forecasting (WRF) model with and without wind plants incorporated, focusing on the lease area south of Massachusetts and Rhode Island. The simulations with wind plants are repeated to include both the maximum and minimum amounts of added turbulence to provide bounds on the potential impacts. We assess changes in wind speeds, 2 m temperature, surface heat flux, turbulence kinetic energy (TKE), and boundary layer height during different stability classifications and ambient wind speeds over the entire year and compare results for the degree of added turbulence in the wind plant simulations. Because the wake behavior may be a function of boundary layer stability, in this paper, we also present a machine learning algorithm to quantify the area and distance of the wake generated by the wind plant. This analysis enables us to identify the relationship between wake extent and boundary layer height. We find that hub-height wind speed is reduced within and downwind of the wind plant, with the strongest impacts occurring during stable conditions and faster wind speeds in region 3 of the turbine power curve, although impacts lessen as wind speeds increase past 15 m s−1. In contrast, wind speeds near the surface decrease when no turbine-added turbulence is included but can increase for stably stratified conditions when 100 % of possible TKE is included in the simulations. TKE increases at hub height in the simulations with added TKE for all stability classes, suggesting that atmospheric stability does not immediately modify the TKE generated by turbines. Negligible changes in hub-height TKE manifest in the simulations without the added TKE. At the surface, TKE increases in the simulations with maximum added turbulence only for unstable conditions. In the no-added-turbulence simulations, surface TKE decreases slightly in neutral and unstable simulations. Differences in 2 m temperatures and surface heat fluxes are small but vary considerably with atmospheric stability and the amount of added TKE. Boundary layer heights increase within the wind plant when turbine-added turbulence is included and decrease slightly downwind during stable conditions. In contrast, with no added turbulence, the boundary layer height is in general reduced in stable conditions with wind speeds less than 15 m s −1 and slightly increased in neutral conditions. Finally, shallower upwind boundary layer heights tend to correlate with larger wake areas and distances, though other factors likely also play a role in determining the extent of the wind plant wake. These simulation-based results provide a bound for micrometeorological impacts of wind plant wakes: simulations that couple the atmosphere to the ocean may reduce these impacts, and we await observational verification.

17 WIND ENERGY↗
DOE OSTI2025

Linking large-scale weather patterns to observed and modeled turbine hub-height winds offshore of the US West Coast

The US West Coast holds great potential for wind power generation, although its potential varies due to the complex coastal climate. Characterizing and modeling turbine hub-height winds under different weather conditions are vital for wind resource assessment and management. This study uses a two-stage machine learning algorithm to identify five large-scale meteorological patterns (LSMPs): post-trough, post-ridge, pre-ridge, pre-trough, and California high. The LSMPs are linked to offshore wind patterns, specifically at lidar buoy locations within lease areas for future wind farm development off Humboldt and Morro Bay. While each LSMP is associated with characteristic large-scale atmospheric conditions and corresponding differences in wind direction, diurnal variation, and jet features at the two lidar sites, substantial variability in wind speeds can still occur within each LSMP. Wind speeds at Humboldt increase during the post-trough, pre-ridge, and California-high LSMPs and decrease during the remaining LSMPs. Morro Bay has smaller responses in mean speeds, showing increased wind speed during the post-trough and California-high LSMPs. Besides the LSMPs, local factors, including the land–sea thermal contrast and topography, also modify mean winds and diurnal variation. The High-Resolution Rapid Refresh model analysis does a good job of capturing the mean and variation at Humboldt but produces large biases at Morro Bay, particularly during the pre-ridge and California-high LSMPs. The findings are anticipated to guide the selection of cases for studying the influence of specific large-scale and local factors on California offshore winds and to contribute to refining numerical weather prediction models, thereby enhancing the efficiency and reliability of offshore wind energy production.

17 WIND ENERGY↗
DOE OSTI2024

Tensor Extraction of Latent Features (TELF)

Tensor ELF is a user-friendly parallel tensor decomposition Python toolbox that includes a suite of machine learning algorithms for CPU and GPU architectures for the analysis of sparse and dense data including utility tools for pre-processing and post-processing.

Eren, Maksim↗
DOE OSTI2019

HyperSpace

Machine learning (ML) models often contain numerous hyperparameters, free parameters that must be set before the models can be trained. As the number of model hyperparameters increases, their optimization becomes significantly more challenging as we face a combinatorial increase in potential model configurations. Similarly, there is an increased chance that our models’ hyperparameters interact in complex ways. HyperSpace allows a user to optimize complex machine learning algorithms based on their hyperparameters. HyperSpace works by parallelizing parameter search spaces, running Bayesian model based optimization (SMBO) over each of these spaces in parallel. It was designed to be as minimally invasive as possible such that very little change to existing code will be needed to get a user started.

Ramanathan, Arvind↗
DOE OSTI2024

Electrical Resistivity Tomography based monitoring of stress perturbations to optimize placement of high-precision strain meters

The Center for Understanding Subsurface Signals and Permeability is a new U.S. Department of Energy Earthshot Center focused on understanding and predicting the long-term evolution of permeability in enhanced geothermal systems. The center will use a highly instrumented testbed within the Sanford Underground Research Facility to conduct field scale experiments that elucidate and test capabilities to simulate geochemical-geomechanical interactions and permeability evolution. Here we demonstrate initial developments using previously collected electrical resistivity tomography (ERT) monitoring data with high-performance multi-physics modelling advancements to inform the optimal location of two new monitoring boreholes. Specifically, ERT monitoring data collected during shear stimulation testing shows marked responses to changes in stress during borehole pressurization. We demonstrate how the same response is being simulated, ultimately to train a machine-learning algorithm to estimate rock properties and enable enhanced prediction of stress and strain responses anticipated during future testing campaigns.

Stress, EGS, CUSSP, 3D Electrical Imaging↗
DOE OSTI2019

An application of survival analysis to disruption prediction via Random Forests

One of the most pressing challenges facing the fusion community is adequately mitigating or, even better, avoiding disruptions of tokamak plasmas. However, before this can be done, disruptions must first be predicted with sufficient warning time to actuate a response. The established field of survival analysis provides a convenient statistical framework for time-to-event (i.e. time-to-disruption) studies. This paper demonstrates the integration of an existing disruption prediction machine learning algorithm with the Kaplan-Meier estimator of survival probability. Specifically discussed are the implied warning times from binary classification of disruption databases and the interpretation of output signals from Random Forest algorithms trained and tested on these databases. This survival analysis approach is applied to both smooth and noisy test data to highlight important features of the survival and hazard functions. In addition, this method is applied to three Alcator C-Mod plasma discharges and compared to a threshold-based scheme for triggering alarms. In one case, both techniques successfully predict the disruption; although, in another, neither warns of the impending disruption with enough time to mitigate. For the final discharge, the survival analysis approach could avoid the false alarm triggered by the threshold method. Limitations of this analysis and opportunities for future work are also presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1992

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗
NASA NTRS1993

Population-based learning of load balancing policies for a distributed computer system

Effective load-balancing policies use dynamic resource information to schedule tasks in a distributed computer system. We present a novel method for automatically learning such policies. At each site in our system, we use a comparator neural network to predict the relative speedup of an incoming task using only the resource-utilization patterns obtained prior to the task's arrival. Outputs of these comparator networks are broadcast periodically over the distributed system, and the resource schedulers at each site use these values to determine the best site for executing an incoming task. The delays incurred in propagating workload information and tasks from one site to another, as well as the dynamic and unpredictable nature of workloads in multiprogrammed multiprocessors, may cause the workload pattern at the time of execution to differ from patterns prevailing at the times of load-index computation and decision making. Our load-balancing policy accommodates this uncertainty by using certain tunable parameters. We present a population-based machine-learning algorithm that adjusts these parameters in order to achieve high average speedups with respect to local execution. Our results show that our load-balancing policy, when combined with the comparator neural network for workload characterization, is effective in exploiting idle resources in a distributed computer system.

Mehra, Pankaj↗
NASA NTRS1997

Application of Domain Knowledge to Software Quality Assurance

This work focused on capturing, using, and evolving a qualitative decision support structure across the life cycle of a project. The particular application of this study was towards business process reengineering and the representation of the business process in a set of Business Rules (BR). In this work, we defined a decision model which captured the qualitative decision deliberation process. It represented arguments both for and against proposed alternatives to a problem. It was felt that the subjective nature of many critical business policy decisions required a qualitative modeling approach similar to that of Lee and Mylopoulos. While previous work was limited almost exclusively to the decision capture phase, which occurs early in the project life cycle, we investigated the use of such a model during the later stages as well. One of our significant developments was the use of the decision model during the operational phase of a project. By operational phase, we mean the phase in which the system or set of policies which were earlier decided are deployed and put into practice. By making the decision model available to operational decision makers, they would have access to the arguments pro and con for a variety of actions and can thus make a more informed decision which balances the often conflicting criteria by which the value of action is measured. We also developed the concept of a 'monitored decision' in which metrics of performance were identified during the decision making process and used to evaluate the quality of that decision. It is important to monitor those decision which seem at highest risk of not meeting their stated objectives. Operational decisions are also potentially high risk decisions. Finally, we investigated the use of performance metrics for monitored decisions and audit logs of operational decisions in order to feed an evolutionary phase of the the life cycle. During evolution, decisions are revisisted, assumptions verified or refuted, and possible reassessments resulting in new policy are made. In this regard we implemented a machine learning algorithm which automatically defined business rules based on expert assessment of the quality of operational decisions as recorded during deployment.

Wild, Christian W.↗
NASA NTRS2002

Visual Inference Programming

The goal of visual inference programming is to develop a software framework data analysis and to provide machine learning algorithms for inter-active data exploration and visualization. The topics include: 1) Intelligent Data Understanding (IDU) framework; 2) Challenge problems; 3) What's new here; 4) Framework features; 5) Wiring diagram; 6) Generated script; 7) Results of script; 8) Initial algorithms; 9) Independent Component Analysis for instrument diagnosis; 10) Output sensory mapping virtual joystick; 11) Output sensory mapping typing; 12) Closed-loop feedback mu-rhythm control; 13) Closed-loop training; 14) Data sources; and 15) Algorithms. This paper is in viewgraph form.

Wheeler, Kevin↗
NASA NTRS2002

Software for Partly Automated Recognition of Targets

The Feature Analyst is a computer program for assisted (partially automated) recognition of targets in images. This program was developed to accelerate the processing of high-resolution satellite image data for incorporation into geographic information systems (GIS). This program creates an advanced user interface that embeds proprietary machine-learning algorithms in commercial image-processing and GIS software. A human analyst provides samples of target features from multiple sets of data, then the software develops a data-fusion model that automatically extracts the remaining features from selected sets of data. The program thus leverages the natural ability of humans to recognize objects in complex scenes, without requiring the user to explain the human visual recognition process by means of lengthy software. Two major subprograms are the reactive agent and the thinking agent. The reactive agent strives to quickly learn the user's tendencies while the user is selecting targets and to increase the user's productivity by immediately suggesting the next set of pixels that the user may wish to select. The thinking agent utilizes all available resources, taking as much time as needed, to produce the most accurate autonomous feature-extraction model possible.

Opitz, David↗
NASA NTRS2009

Understanding the Scalability of Bayesian Network Inference using Clique Tree Growth Curves

Bayesian networks (BNs) are used to represent and efficiently compute with multi-variate probability distributions in a wide range of disciplines. One of the main approaches to perform computation in BNs is clique tree clustering and propagation. In this approach, BN computation consists of propagation in a clique tree compiled from a Bayesian network. There is a lack of understanding of how clique tree computation time, and BN computation time in more general, depends on variations in BN size and structure. On the one hand, complexity results tell us that many interesting BN queries are NP-hard or worse to answer, and it is not hard to find application BNs where the clique tree approach in practice cannot be used. On the other hand, it is well-known that tree-structured BNs can be used to answer probabilistic queries in polynomial time. In this article, we develop an approach to characterizing clique tree growth as a function of parameters that can be computed in polynomial time from BNs, specifically: (i) the ratio of the number of a BN's non-root nodes to the number of root nodes, or (ii) the expected number of moral edges in their moral graphs. Our approach is based on combining analytical and experimental results. Analytically, we partition the set of cliques in a clique tree into different sets, and introduce a growth curve for each set. For the special case of bipartite BNs, we consequently have two growth curves, a mixed clique growth curve and a root clique growth curve. In experiments, we systematically increase the degree of the root nodes in bipartite Bayesian networks, and find that root clique growth is well-approximated by Gompertz growth curves. It is believed that this research improves the understanding of the scaling behavior of clique tree clustering, provides a foundation for benchmarking and developing improved BN inference and machine learning algorithms, and presents an aid for analytical trade-off studies of clique tree clustering using growth curves.

Mengshoel, Ole Jakob↗
NASA NTRS2009

Finite-difference simulation and visualization of elastodynamics in time-evolving generalized curvilinear coordinates

Modeling and simulation of free and forced structural vibrations is essential to an overall structural health monitoring capability. In the various embodiments, a first principles finite-difference approach is adopted in modeling a structural subsystem such as a mechanical gear by solving elastodynamic equations in generalized curvilinear coordinates. Such a capability to generate a dynamic structural response is widely applicable in a variety of structural health monitoring systems. This capability (1) will lead to an understanding of the dynamic behavior of a structural system and hence its improved design, (2) will generate a sufficiently large space of normal and damage solutions that can be used by machine learning algorithms to detect anomalous system behavior and achieve a system design optimization and (3) will lead to an optimal sensor placement strategy, based on the identification of local stress maxima all over the domain.

Kaul, Upender K.↗
NASA NTRS2011

Collaborative Supervised Learning for Sensor Networks

Collaboration methods for distributed machine-learning algorithms involve the specification of communication protocols for the learners, which can query other learners and/or broadcast their findings preemptively. Each learner incorporates information from its neighbors into its own training set, and they are thereby able to bootstrap each other to higher performance. Each learner resides at a different node in the sensor network and makes observations (collects data) independently of the other learners. After being seeded with an initial labeled training set, each learner proceeds to learn in an iterative fashion. New data is collected and classified. The learner can then either broadcast its most confident classifications for use by other learners, or can query neighbors for their classifications of its least confident items. As such, collaborative learning combines elements of both passive (broadcast) and active (query) learning. It also uses ideas from ensemble learning to combine the multiple responses to a given query into a single useful label. This approach has been evaluated against current non-collaborative alternatives, including training a single classifier and deploying it at all nodes with no further learning possible, and permitting learners to learn from their own most confident judgments, absent interaction with their neighbors. On several data sets, it has been consistently found that active collaboration is the best strategy for a distributed learner network. The main advantages include the ability for learning to take place autonomously by collaboration rather than by requiring intervention from an oracle (usually human), and also the ability to learn in a distributed environment, permitting decisions to be made in situ and to yield faster response time.

Wagstaff, Kiri L.↗
NASA NTRS2003

Software for Partly Automated Recognition of Targets

The Feature Analyst is a computer program for assisted (partially automated) recognition of targets in images. This program was developed to accelerate the processing of high-resolution satellite image data for incorporation into geographic information systems (GIS). This program creates an advanced user interface that embeds proprietary machine-learning algorithms in commercial image-processing and GIS software. A human analyst provides samples of target features from multiple sets of data, then the software develops a data-fusion model that automatically extracts the remaining features from selected sets of data. The program thus leverages the natural ability of humans to recognize objects in complex scenes, without requiring the user to explain the human visual recognition process by means of lengthy software. Two major subprograms are the reactive agent and the thinking agent. The reactive agent strives to quickly learn the user s tendencies while the user is selecting targets and to increase the user s productivity by immediately suggesting the next set of pixels that the user may wish to select. The thinking agent utilizes all available resources, taking as much time as needed, to produce the most accurate autonomous feature-extraction model possible.

Opitz, David↗
NASA NTRS2014

The Seasonal Cycle of Satellite Chlorophyll Fluorescence Observations and its Relationship to Vegetation Phenology and Ecosystem Atmosphere Carbon Exchange

Mapping of terrestrial chlorophyll uorescence from space has shown potentialfor providing global measurements related to gross primary productivity(GPP). In particular, space-based fluorescence may provide information onthe length of the carbon uptake period that can be of use for global carboncycle modeling. Here, we examine the seasonal cycle of photosynthesis asestimated from satellite fluorescence retrievals at wavelengths surroundingthe 740nm emission feature. These retrievals are from the Global OzoneMonitoring Experiment 2 (GOME-2) flying on the MetOp A satellite. Wecompare the fluorescence seasonal cycle with that of GPP as estimated froma diverse set of North American tower gas exchange measurements. Because the GOME-2 has a large ground footprint (40 x 80km2) as compared with that of the flux towers and requires averaging to reduce random errors, we additionally compare with seasonal cycles of upscaled GPP in the satellite averaging area surrounding the tower locations estimated from the Max Planck Institute for Biogeochemistry (MPI-BGC) machine learning algorithm. We also examine the seasonality of absorbed photosynthetically-active radiation(APAR) derived with reflectances from the MODerate-resolution Imaging Spectroradiometer (MODIS). Finally, we examine seasonal cycles of GPP as produced from an ensemble of vegetation models. Several of the data-driven models rely on satellite reflectance-based vegetation parameters to derive estimates of APAR that are used to compute GPP. For forested sites(particularly deciduous broadleaf and mixed forests), the GOME-2 fluorescence captures the spring onset and autumn shutoff of photosynthesis as delineated by the tower-based GPP estimates. In contrast, the reflectance-based indicators and many of the models tend to overestimate the length of the photosynthetically-active period for these and other biomes as has been noted previously in the literature. Satellite fluorescence measurements therefore show potential for improving model GPP estimates.

Joiner, J.↗
NASA NTRS2014

Training Knowledge Bots for Physics-Based Simulations Using Artificial Neural Networks

Millions of complex physics-based simulations are required for design of an aerospace vehicle. These simulations are usually performed by highly trained and skilled analysts, who execute, monitor, and steer each simulation. Analysts rely heavily on their broad experience that may have taken 20-30 years to accumulate. In addition, the simulation software is complex in nature, requiring significant computational resources. Simulations of system of systems become even more complex and are beyond human capacity to effectively learn their behavior. IBM has developed machines that can learn and compete successfully with a chess grandmaster and most successful jeopardy contestants. These machines are capable of learning some complex problems much faster than humans can learn. In this paper, we propose using artificial neural network to train knowledge bots to identify the idiosyncrasies of simulation software and recognize patterns that can lead to successful simulations. We examine the use of knowledge bots for applications of computational fluid dynamics (CFD), trajectory analysis, commercial finite-element analysis software, and slosh propellant dynamics. We will show that machine learning algorithms can be used to learn the idiosyncrasies of computational simulations and identify regions of instability without including any additional information about their mathematical form or applied discretization approaches.

Samareh, Jamshid A.↗