Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Generative learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Transfer Learning to Generate True Color Images from GOES-16

Along with scientific applications, Geostationary imagery is often used to learn about weather patterns through true color visualizations. NOAA/NASA's GOES-R series of satellites uses the advanced baseline imager with 16-bands which, unlike previous generations, does not include the green wavelength (500-565 nm) and hence cannot directly generate true color images. However, Himawari, Japan's geostationary satellite, uses a similar 16-band advanced Himawari imager that does include a green band (but missing cirrus). In this work, we show how transfer learning with convolutional neural networks can be applied across satellites to generate "virtual sensors". We apply this approach to generate a green band for GOES-16 and present near true color images.

transfer learning

Synthesizing Disparate LiDAR and Satellite Datasets through Deep Learning to Generate Wall-to-Wall Regional Inventories for the Complex, Mixed-Species Forests of the Eastern United States

Light detection and ranging (LiDAR) has become a commonly-used tool for generating remotely-sensed forest inventories. However, LiDAR-derived forest inventories have remained uncommon at a regional scale due to varying parameters among LiDAR data acquisitions and the availability of sufficient calibration data. Here, we present a model using a 3-D convolutional neural network (CNN), a form of deep learning capable of scanning a LiDAR point cloud, combined with coincident satellite data (spectral, phenology, and disturbance history). We compared this approach to traditional modeling used for making forest predictions from LiDAR data (height metrics and random forest) and found that the CNN had consistently lower uncertainty. We then applied the CNN to public data over six New England states in the USA, generating maps of 14 forest attributes at a 10 m resolution over 85% of the region. Aboveground biomass estimates produced a root mean square error of 36 Mg ha−1 (44%) and were within the 97.5% confidence of independent county-level estimates for 33 of 38 or 86.8% of the counties examined. CNN predictions for stem density and percentage of conifer attributes were moderately successful, while predictions for detailed species groupings were less successful. The approach shows promise for improving the prediction of forest attributes from regional LiDAR data and for combining disparate LiDAR datasets into a common framework for large-scale estimation.

Elias Ayrey

Learning In networks

Intelligent systems require software incorporating probabilistic reasoning, and often times learning. Networks provide a framework and methodology for creating this kind of software. This paper introduces network models based on chain graphs with deterministic nodes. Chain graphs are defined as a hierarchical combination of Bayesian and Markov networks. To model learning, plates on chain graphs are introduced to model independent samples. The paper concludes by discussing various operations that can be performed on chain graphs with plates as a simplification process or to generate learning algorithms.

Buntine, Wray L.

Identifying Meteorological Influences on Marine Low Cloud Mesoscale Morphology Using Satellite Classifications

Marine low cloud mesoscale morphology in the southeastern Pacific Ocean is analyzed using a large dataset of machine-learning generated classifications spanning three years. Meteorological variables and cloud properties are composited 10by mesoscale cloud type, showing distinct meteorological regimes of marine low cloud organization from the tropics to the midlatitudes. The presentation of mesoscale cellular convection, with respect to geographic distribution, boundary layer structure, and large-scale environmental conditions, agrees with prior knowledge. Two tropical and subtropical cumuliform boundary layer regimes, suppressed cumulus and clustered cumulus, are studied in detail. The patterns in precipitation, circulation, column water vapor, and cloudiness are consistent with the representation of marine shallow mesoscale convective 15 self-aggregation by large eddy simulations of the boundary layer. Although they occur under similar large-scale conditions, the suppressed and clustered low cloud types are found to be well-separated by variables associated with low-level mesoscale circulation, with surface wind divergence being the clearest discriminator between them, whether reanalysis or satellite observations are used. Clustered regimes are associated with surface convergence and suppressed regimes are associated with surface divergence.

Johannes Mohrmann

Innovating Training through Immersive Environments: Generation Y, Exploratory Learning, and Serious Games

Over the next decade, those entering Service and Joint Staff positions within the military will come from a different generation than the current leadership. They will come from Generation Y and have differing preferences for learning. Immersive learning environments like serious games and virtual world initiatives can complement traditional training methods to provide a better overall training program for staffs. Generation Y members desire learning methods which are relevant and interactive, regardless of whether they are delivered over the internet or in person. This paper focuses on a project undertaken to assess alternative training methods to teach special operations staffs. It provides a summary of the needs analysis used to consider alternatives and to better posture the Department of Defense for future training development.

Gendron, Gerald

Using Machine-Learning to Dynamically Generate Operationally Acceptable Strategic Reroute Options

The newly developed Trajectory Option Set (TOS), a preference-weighted set of alternative routes submitted by flight operators, is a capability in the U.S. traffic flow management system that enables automated trajectory negotiation between flight operators and Air Navigation Service Providers. The objective of this paper is to describe and demonstrate an approach for automatically generating pre-departure and airborne TOSs that have a high probability of operational acceptance. The approach uses hierarchical clustering of historical route data to identify route candidates. The probability of operational acceptance is then estimated using predictors trained on historical flight plan amendment data using supervised machine learning algorithms, allowing the routes with highest probability of operational acceptance to be selected for the TOS. Features used describe historical route usage, difference in flight time and downstream demand to capacity imbalance. A random forest was found to be the best performing algorithm for learning operational acceptability, with a model accuracy of 0.96. The approach is demonstrated for an historical pre-departure flight from Dallas/Fort Worth International Airport to Newark Liberty International Airport.

Evans, Antony

Using Machine-Learning to Dynamically Generate Operationally Acceptable Strategic Reroute Options

The newly developed Trajectory Option Set (TOS), a preference-weighted set of alternative routes submitted by flight operators, is a capability in the U.S. traffic flow management system that enables automated trajectory negotiation between flight operators and Air Navigation Service Providers. The objective of this paper is to describe and demonstrate an approach for automatically generating pre-departure and airborne TOSs that have a high probability of operational acceptance. The approach uses hierarchical clustering of historical route data to identify route candidates. The probability of operational acceptance is then estimated using predictors trained on historical flight plan amendment data using supervised machine learning algorithms, allowing the routes with highest probability of operational acceptance to be selected for the TOS. Features used describe historical route usage, difference in flight time and downstream demand to capacity imbalance. A random forest was found to be the best performing algorithm for learning operational acceptability, with a model accuracy of 0.96. The approach is demonstrated for an historical pre-departure flight from Dallas/Fort Worth International Airport to Newark Liberty International Airport.

Evans, Antony

Learning from examples - Generation and evaluation of decision trees for software resource analysis

A general solution method for the automatic generation of decision (or classification) trees is investigated. The approach is to provide insights through in-depth empirical characterization and evaluation of decision trees for software resource data analysis. The trees identify classes of objects (software modules) that had high development effort. Sixteen software systems ranging from 3,000 to 112,000 source lines were selected for analysis from a NASA production environment. The collection and analysis of 74 attributes (or metrics), for over 4,700 objects, captured information about the development effort, faults, changes, design style, and implementation style. A total of 9,600 decision trees were automatically generated and evaluated. The trees correctly identified 79.3 percent of the software modules that had high development effort or faults, and the trees generated from the best parameter combinations correctly identified 88.4 percent of the modules on the average.

Selby, Richard W.

Large-Scale Alfvenic Impulses on the Sun: How They Are Generated and What We Learn From Them

NASA GSFC The Sun's atmosphere hosts a wide variety of magnetosonic disturbances. These wave modes are detected, almost exclusively, by examining images of the Sun's magnetic atmosphere and looking for propagating distortions. Although none of the Sun's plasma parameters are measured directly, we derive a great deal of information from these observations. In fact, by modeling these propagating disturbances, we may be able to derive the most accurate estimates plasma parameters. From observations absorption, refraction, reflection, and coupling of numerous wave modes, we advance our knowledge of the Sun's magnetic field, temperature, density, and current. The Sun's continuous oscillation, coronal mass ejections, flares, and other dynamic phenomena can produce wave disturbances which are observable from near-Earth space. Several of these disturbances have been traced from the inner corona out into the heliosphere. From the generation of these disturbances, we are able to learn about the phenomena which create them as well as the media through which they re-propagating. The presentation will include a discussion of the generation of Alfvenic disturbances on the Sun, ways we observe these disturbances, and how recent advances in modeling and analysis have brought us closer to determining solar in situ parameters.

Thompson, Barbara

Hierarchical screening for Li-based solid electrolytes using fast, interpretable machine-learned potentials

Li-based solid-state electrolyte materials enable safer, all-solid-state batteries but the computational search for candidates with favorable stability and Li-ion conductivity is challenging due to the size of the search space and the cost of evaluating transport properties with ab initio methods. The prohibitive cost of high-throughput screening with DFT has lead to the development of surrogate models using geometric analysis, empirical potentials, and descriptors for ionic transport. Here, I will discuss a hierarchical screening approach for identifying promising materials using a combination of density functional theory, bond-valence methods, and machine learning potentials generated with the Ultra-Fast Force Fields (UF3) framework. We show how the inexpensive bond-valence method can be used to guide the generation of training samples for machine learning, in addition to filtering candidates. Finally, we apply the hierarchical workflow to screen for ionic conductivity across a database of Li-containing compounds.

Materials discovery

Hierarchical Screening for Li-Based Solid Electrolytes Using Fast, Interpretable Machine-Learned Potentials

Li-based solid-state electrolyte materials enable safer, all-solid-state batteries but the computational search for candidates with favorable stability and Li-ion conductivity is challenging due to the size of the search space and the cost of evaluating transport properties with ab initio methods. The prohibitive cost of high-throughput screening with DFT has lead to the development of surrogate models using geometric analysis, empirical potentials, and descriptors for ionic transport. Here, I will discuss a hierarchical screening approach for identifying promising materials using a combination of density functional theory, bond-valence methods, and machine learning potentials generated with the Ultra-Fast Force Fields (UF3) framework. We show how the inexpensive bond-valence method can be used to guide the generation of training samples for machine learning, in addition to filtering candidates.

Materials discovery

Lessons Learned From Developing Three Generations of Remote Sensing Science Data Processing Systems

The Biospheric Information Systems Branch at NASA s Goddard Space Flight Center has developed three generations of Science Investigator-led Processing Systems for use with various remote sensing instruments. The first system is used for data from the MODIS instruments flown on NASA s Earth Observing Systems @OS) Terra and Aqua Spacecraft launched in 1999 and 2002 respectively. The second generation is for the Ozone Measuring Instrument flying on the EOS Aura spacecraft launched in 2004. We are now developing a third generation of the system for evaluation science data processing for the Ozone Mapping and Profiler Suite (OMPS) to be flown by the NPOESS Preparatory Project (NPP) in 2006. The initial system was based on large scale proprietary hardware, operating and database systems. The current OMI system and the OMPS system being developed are based on commodity hardware, the LINUX Operating System and on PostgreSQL, an Open Source RDBMS. The new system distributes its data archive across multiple server hosts and processes jobs on multiple processor boxes. We have created several instances of this system, including one for operational processing, one for testing and reprocessing and one for applications development and scientific analysis. Prior to receiving the first data from OMI we applied the system to reprocessing information from the Solar Backscatter Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) instruments flown from 1978 until now. The system was able to process 25 years (108,000 orbits) of data and produce 800,000 files (400 GiB) of level 2 and level 3 products in less than a week. We will describe the lessons we have learned and tradeoffs between system design, hardware, operating systems, operational staffing, user support and operational procedures. During each generational phase, the system has become more generic and reusable. While the system is not currently shrink wrapped we believe it is to the point where it could be readily adopted, with substantial cost savings, for other similar tasks.

Tilmes, Curt

Augmented Reality Data Generation for Training Deep Learning Neural Network

One of the major challenges in deep learning is retrieving sufficiently large labeled training datasets, which can become expensive and time consuming to collect. A unique approach to training segmentation is to use Deep Neural Network (DNN) models with a minimal amount of initial labeled training samples. The procedure involves creating synthetic data and using image registration to calculate affine transformations to apply to the synthetic data. The method takes a small dataset and generates a highquality augmented reality synthetic dataset with strong variance while maintaining consistency with real cases. Results illustrate segmentation improvements in various target features and increased average target confidence.

Torres, Gil

Neural network error correction for solving coupled ordinary differential equations

A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

Shelton, R. O.

The X-ray properties of normal galaxies. What do we know and what can we learn with the next generation of X-ray telescopes?

Einstein Observatory results are used to assess the possibilities of spaceborne X-ray astronomy projects such as XMM (ESA) and AXAF (NASA). Einstein observations show that normal galaxies of all morphological types are spatially extended sources of X-ray emission with 0.5 to 3.0 keV X-ray luminosities of 10 to the 39th to 41st power erg/sec. X-ray telescopes can study the end products of stellar evolution in galaxies of different morphological types. Phenomena linked to starburst nuclear activity can best be detected and studied in X-ray. Hot coronae or a hot phase of the interstellar medium can only be studied through their X-ray emission. It is shown that high spatial resolution is essential for studying normal galaxies and identifying different emission regions. Good spectral sensitivity and spectral imaging capability are essential for gaining a deeper understanding of the phenomena at work.

Fabbiano, G.

Interstellar PAH in the Laboratory and in Space. What have we Learned from the New Generation of Laboratory and Observational Studies?

Polycyclic Aromatic Hydrocarbons (PAHs) are an important and ubiquitous component of carbon-bearing materials in space. PAHs are the best-known candidates to account for the IR emission bands (UIR bands) and PAH spectral features are now being used as new probes of the ISM. PAHs are also thought to be among the carriers of the diffuse interstellar absorption bands (DIBs). In the model dealing with the interstellar spectral features, PAHs are present as a mixture of radicals, ions and neutral species. PAH ionization states reflect the ionization balance of the medium while PAH size, composition, and structure reflect the energetic and chemical history of the medium. A major challenge for laboratory astrophysics is to reproduce (in a realistic way) the physical conditions that exist in the emission and/or absorption interstellar zones. An extensive laboratory program has been developed at NASA Ames to assess the physical and chemical properties of PAHs in such environments and to describe how they influence the radiation and energy balance in space and the interstellar chemistry. In particular, laboratory experiments provide measurements of the spectral characteristics of interstellar PAH analogs from the ultraviolet and visible range to the infrared range for comparison with astronomical data. This paper will focus on the recent progress made in the laboratory to measure the direct absorption spectra of neutral and ionized PAHs in the gas phase in the near-UV and visible range in astrophysically relevant environments. These measurements provide data on PAHs and nanometer-sized particles that can now be directly compared to astronomical observations. The harsh physical conditions of the IS medium - characterized by a low temperature, an absence of collisions and strong VUV radiation fields - are simulated in the laboratory by associating a molecular beam with an ionizing discharge to generate a cold plasma expansion. PAH ions are formed from the neutral precursors in an isolated environment at low temperature (of the order of 100 K). The spectra of neutral and ionized PAHs are measured using the high sensitivity methods of cavity ring down spectroscopy (CRDS). These experiments provide unique information on the spectra of free, cold large carbon molecules and ions in the gas phase. Intrinsic band profiles and band positions of cold gas-phase PAHs can now be measured with high-sensitivity spectroscopy and directly compared to the astronomical data. The electronic bands measured for ionized PAH are found to be intrinsically broad (about 20 cm(sup -1)) while the bands associated with the neutral precursors are narrower (of the order of 2 - 10 cm(sup -1)). The laboratory data are discussed and compared with recent astronomical spectra of large and narrow DIBs and with the spectra of circumstellar environments of selected carbon stars and the implications for the interstellar PAH population are derived. Preliminary results also show that carbon nanoparticles are formed during the short residence time of the precursors in the plasma.

Salama, Farid

PAHs and the Diffuse Interstellar Bands. What have we Learned from the New Generation of Laboratory and Observational Studies?

Polycyclic Aromatic Hydrocarbons (PAHs) are an important and ubiquitous component of carbon-bearing materials in space. PAHs are the best-known candidates to account for the IR emission bands (UIR bands) and PAH spectral features are now being used as new probes of the ISM. PAHs are also thought to be among the carriers of the diffuse interstellar absorption bands (DIBs). In the model dealing with the interstellar spectral features, PAHs are present as a mixture of radicals, ions and neutral species. PAH ionization states reflect the ionization balance of the medium while PAH size, composition, and structure reflect the energetic and chemical history of the medium. A major challenge for laboratory astrophysics is to reproduce (in a realistic way) the physical conditions that exist in the emission and/or absorption interstellar zones, An extensive laboratory program has been developed at NASA Ames to characterize the physical and chemical properties of PAHs in astrophysical environments and to describe how they influence the radiation and energy balance in space and the interstellar chemistry. In particular, laboratory experiments provide measurements of the spectral characteristics of interstellar PAH analogs from the ultraviolet and visible range to the infrared range for comparison with astronomical data. This paper will focus on the recent progress made in the laboratory to measure the direct absorption spectra of neutral and ionized PAHs in the gas phase in the near-W and visible range in astrophysically relevant environments. These measurements provide data on PAHs and nanometer-sized particles that can now be directly compared to astronomical observations. The harsh physical conditions of the IS medium - characterized by a low temperature, an absence of collisions and strong V W radiation fields - are simulated in the laboratory by associating a molecular beam with an ionizing discharge to generate a cold plasma expansion. PAH ions are formed from the neutral precursors in an isolated environment at low temperature (of the order of 100 K). The spectra of neutral and ionized PAHs are measured using the high sensitivity methods of cavity ring down spectroscopy (CRDS). These experiments provide unique information on the spectra of free, cold large carbon molecules and ions in the gas phase. Intrinsic band profiles and band positions of cold gas-phase PAHs can now be measured with high- sensitivity spectroscopy and directly compared to the astronomical data. The electronic bands measured for ionized PAH are found to be intrinsically broad (about 20/cm) while the bands associated with the neutral precursors are narrower (of the order of 2 - 10/cm).

Salama, Farid