Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Generative learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Hierarchical screening for Li-based solid electrolytes using fast, interpretable machine-learned potentials

Li-based solid-state electrolyte materials enable safer, all-solid-state batteries but the computational search for candidates with favorable stability and Li-ion conductivity is challenging due to the size of the search space and the cost of evaluating transport properties with ab initio methods. The prohibitive cost of high-throughput screening with DFT has lead to the development of surrogate models using geometric analysis, empirical potentials, and descriptors for ionic transport. Here, I will discuss a hierarchical screening approach for identifying promising materials using a combination of density functional theory, bond-valence methods, and machine learning potentials generated with the Ultra-Fast Force Fields (UF3) framework. We show how the inexpensive bond-valence method can be used to guide the generation of training samples for machine learning, in addition to filtering candidates. Finally, we apply the hierarchical workflow to screen for ionic conductivity across a database of Li-containing compounds.

Materials discovery

Hierarchical Screening for Li-Based Solid Electrolytes Using Fast, Interpretable Machine-Learned Potentials

Li-based solid-state electrolyte materials enable safer, all-solid-state batteries but the computational search for candidates with favorable stability and Li-ion conductivity is challenging due to the size of the search space and the cost of evaluating transport properties with ab initio methods. The prohibitive cost of high-throughput screening with DFT has lead to the development of surrogate models using geometric analysis, empirical potentials, and descriptors for ionic transport. Here, I will discuss a hierarchical screening approach for identifying promising materials using a combination of density functional theory, bond-valence methods, and machine learning potentials generated with the Ultra-Fast Force Fields (UF3) framework. We show how the inexpensive bond-valence method can be used to guide the generation of training samples for machine learning, in addition to filtering candidates.

Materials discovery

Lessons Learned From Developing Three Generations of Remote Sensing Science Data Processing Systems

The Biospheric Information Systems Branch at NASA s Goddard Space Flight Center has developed three generations of Science Investigator-led Processing Systems for use with various remote sensing instruments. The first system is used for data from the MODIS instruments flown on NASA s Earth Observing Systems @OS) Terra and Aqua Spacecraft launched in 1999 and 2002 respectively. The second generation is for the Ozone Measuring Instrument flying on the EOS Aura spacecraft launched in 2004. We are now developing a third generation of the system for evaluation science data processing for the Ozone Mapping and Profiler Suite (OMPS) to be flown by the NPOESS Preparatory Project (NPP) in 2006. The initial system was based on large scale proprietary hardware, operating and database systems. The current OMI system and the OMPS system being developed are based on commodity hardware, the LINUX Operating System and on PostgreSQL, an Open Source RDBMS. The new system distributes its data archive across multiple server hosts and processes jobs on multiple processor boxes. We have created several instances of this system, including one for operational processing, one for testing and reprocessing and one for applications development and scientific analysis. Prior to receiving the first data from OMI we applied the system to reprocessing information from the Solar Backscatter Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) instruments flown from 1978 until now. The system was able to process 25 years (108,000 orbits) of data and produce 800,000 files (400 GiB) of level 2 and level 3 products in less than a week. We will describe the lessons we have learned and tradeoffs between system design, hardware, operating systems, operational staffing, user support and operational procedures. During each generational phase, the system has become more generic and reusable. While the system is not currently shrink wrapped we believe it is to the point where it could be readily adopted, with substantial cost savings, for other similar tasks.

Tilmes, Curt

Augmented Reality Data Generation for Training Deep Learning Neural Network

One of the major challenges in deep learning is retrieving sufficiently large labeled training datasets, which can become expensive and time consuming to collect. A unique approach to training segmentation is to use Deep Neural Network (DNN) models with a minimal amount of initial labeled training samples. The procedure involves creating synthetic data and using image registration to calculate affine transformations to apply to the synthetic data. The method takes a small dataset and generates a highquality augmented reality synthetic dataset with strong variance while maintaining consistency with real cases. Results illustrate segmentation improvements in various target features and increased average target confidence.

Torres, Gil

Prediction of Distributed River Sediment Respiration Rates Using Community-Generated Data and Machine Learning

River sediment microbial respiration is a key indicator of ecosystem functioning and the biogeochemical fluxes across this critical zone link surface and subsurface waters. As such, there is tremendous interest in measuring and mapping these respiration rates. Respiration observations are expensive and labor intensive; there is limited data available to the community. An open science, collaborative initiative is collecting samples for respiration rate analysis and multi-scale metadata; this evolving data set is being used for making machine learning (ML) predictions at unsampled sites to help inform continued community engagement. However, it is a challenge to find an optimum configuration for ML models to work with this feature-rich (i.e., 100+ possible input variables) data set. Here, we present results from a two-tiered approach to managing the analysis of this complex data set: (a) a stacked ensemble of models that automatically optimizes hyperparameters and manages the training of many models and (b) feature permutation importance to detect the most important features in the models. The major elements of this workflow are modular, portable, open, and cloud-based thus making this implementation a potential template for other applications. The models developed here predict that sediment organic matter chemistry is one of the most important features for predicting sediment respiration rate. Other larger-scale, important features fall into the categories of climatic, ecological, geological, and fluvial settings. Leveraging these larger-scale features to generate data-driven estimates of river sediment respiration rates reveals spatially consistent but heterogeneous patterns across the river network of the Columbia River Basin.

54 ENVIRONMENTAL SCIENCES

Neural network error correction for solving coupled ordinary differential equations

A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

Shelton, R. O.

The X-ray properties of normal galaxies. What do we know and what can we learn with the next generation of X-ray telescopes?

Einstein Observatory results are used to assess the possibilities of spaceborne X-ray astronomy projects such as XMM (ESA) and AXAF (NASA). Einstein observations show that normal galaxies of all morphological types are spatially extended sources of X-ray emission with 0.5 to 3.0 keV X-ray luminosities of 10 to the 39th to 41st power erg/sec. X-ray telescopes can study the end products of stellar evolution in galaxies of different morphological types. Phenomena linked to starburst nuclear activity can best be detected and studied in X-ray. Hot coronae or a hot phase of the interstellar medium can only be studied through their X-ray emission. It is shown that high spatial resolution is essential for studying normal galaxies and identifying different emission regions. Good spectral sensitivity and spectral imaging capability are essential for gaining a deeper understanding of the phenomena at work.

Fabbiano, G.

Interstellar PAH in the Laboratory and in Space. What have we Learned from the New Generation of Laboratory and Observational Studies?

Polycyclic Aromatic Hydrocarbons (PAHs) are an important and ubiquitous component of carbon-bearing materials in space. PAHs are the best-known candidates to account for the IR emission bands (UIR bands) and PAH spectral features are now being used as new probes of the ISM. PAHs are also thought to be among the carriers of the diffuse interstellar absorption bands (DIBs). In the model dealing with the interstellar spectral features, PAHs are present as a mixture of radicals, ions and neutral species. PAH ionization states reflect the ionization balance of the medium while PAH size, composition, and structure reflect the energetic and chemical history of the medium. A major challenge for laboratory astrophysics is to reproduce (in a realistic way) the physical conditions that exist in the emission and/or absorption interstellar zones. An extensive laboratory program has been developed at NASA Ames to assess the physical and chemical properties of PAHs in such environments and to describe how they influence the radiation and energy balance in space and the interstellar chemistry. In particular, laboratory experiments provide measurements of the spectral characteristics of interstellar PAH analogs from the ultraviolet and visible range to the infrared range for comparison with astronomical data. This paper will focus on the recent progress made in the laboratory to measure the direct absorption spectra of neutral and ionized PAHs in the gas phase in the near-UV and visible range in astrophysically relevant environments. These measurements provide data on PAHs and nanometer-sized particles that can now be directly compared to astronomical observations. The harsh physical conditions of the IS medium - characterized by a low temperature, an absence of collisions and strong VUV radiation fields - are simulated in the laboratory by associating a molecular beam with an ionizing discharge to generate a cold plasma expansion. PAH ions are formed from the neutral precursors in an isolated environment at low temperature (of the order of 100 K). The spectra of neutral and ionized PAHs are measured using the high sensitivity methods of cavity ring down spectroscopy (CRDS). These experiments provide unique information on the spectra of free, cold large carbon molecules and ions in the gas phase. Intrinsic band profiles and band positions of cold gas-phase PAHs can now be measured with high-sensitivity spectroscopy and directly compared to the astronomical data. The electronic bands measured for ionized PAH are found to be intrinsically broad (about 20 cm(sup -1)) while the bands associated with the neutral precursors are narrower (of the order of 2 - 10 cm(sup -1)). The laboratory data are discussed and compared with recent astronomical spectra of large and narrow DIBs and with the spectra of circumstellar environments of selected carbon stars and the implications for the interstellar PAH population are derived. Preliminary results also show that carbon nanoparticles are formed during the short residence time of the precursors in the plasma.

Salama, Farid

PAHs and the Diffuse Interstellar Bands. What have we Learned from the New Generation of Laboratory and Observational Studies?

Polycyclic Aromatic Hydrocarbons (PAHs) are an important and ubiquitous component of carbon-bearing materials in space. PAHs are the best-known candidates to account for the IR emission bands (UIR bands) and PAH spectral features are now being used as new probes of the ISM. PAHs are also thought to be among the carriers of the diffuse interstellar absorption bands (DIBs). In the model dealing with the interstellar spectral features, PAHs are present as a mixture of radicals, ions and neutral species. PAH ionization states reflect the ionization balance of the medium while PAH size, composition, and structure reflect the energetic and chemical history of the medium. A major challenge for laboratory astrophysics is to reproduce (in a realistic way) the physical conditions that exist in the emission and/or absorption interstellar zones, An extensive laboratory program has been developed at NASA Ames to characterize the physical and chemical properties of PAHs in astrophysical environments and to describe how they influence the radiation and energy balance in space and the interstellar chemistry. In particular, laboratory experiments provide measurements of the spectral characteristics of interstellar PAH analogs from the ultraviolet and visible range to the infrared range for comparison with astronomical data. This paper will focus on the recent progress made in the laboratory to measure the direct absorption spectra of neutral and ionized PAHs in the gas phase in the near-W and visible range in astrophysically relevant environments. These measurements provide data on PAHs and nanometer-sized particles that can now be directly compared to astronomical observations. The harsh physical conditions of the IS medium - characterized by a low temperature, an absence of collisions and strong V W radiation fields - are simulated in the laboratory by associating a molecular beam with an ionizing discharge to generate a cold plasma expansion. PAH ions are formed from the neutral precursors in an isolated environment at low temperature (of the order of 100 K). The spectra of neutral and ionized PAHs are measured using the high sensitivity methods of cavity ring down spectroscopy (CRDS). These experiments provide unique information on the spectra of free, cold large carbon molecules and ions in the gas phase. Intrinsic band profiles and band positions of cold gas-phase PAHs can now be measured with high- sensitivity spectroscopy and directly compared to the astronomical data. The electronic bands measured for ionized PAH are found to be intrinsically broad (about 20/cm) while the bands associated with the neutral precursors are narrower (of the order of 2 - 10/cm).

Salama, Farid

Small target detection for search and rescue operations using distributed deep learning and synthetic data generation

It is important to find the target as soon as possible for search and rescue operations. Surveillance camera systems and unmanned aerial vehicles (UAVs) are used to support search and rescue. Automatic object detection is important because a person cannot monitor multiple surveillance screens simultaneously for 24 hours. Also, the object is often too small to be recognized by the human eye on the surveillance screen. This study used UAVs around the Port of Houston and fixed surveillance cameras to build an automatic target detection system that supports the US Coast Guard (USCG) to help find targets (e.g., person overboard). We combined image segmentation, enhancement, and convolution neural networks to reduce detection time to detect small targets. We compared the performance between the auto-detection system and the human eye. Our system detected the target within 8 seconds, but the human eye detected the target within 25 seconds. Our systems also used synthetic data generation and data augmentation techniques to improve target detection accuracy. This solution may help the search and rescue operations of the first responders in a timely manner.

Chow, Edward

Downscaled Earth System Model Data for Resilient Energy System Planning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.

97 MATHEMATICS AND COMPUTING

Deep-learning-based canopy height model generation from sub-meter resolution panchromatic satellite imagery

Canopy height models (CHMs) with sufficient resolution to distinguish individual trees are useful for a variety of applications. However, standard techniques to acquire such data, such as airborne lidar surveying, are often prohibitively expensive. Deep learning techniques for generating CHMs from high-resolution imagery are an attractive option to reduce costs. To date, success with these methods has been demonstrated using multichannel aerial photography and specialized satellite data products derived from multiple sensors, neither of which is commonly available at temporal resolutions finer than one year. Here we demonstrate a method to generate sub-meter resolution CHMs in three forests in California using a more abundant data source: sub-meter resolution, panchromatic satellite imagery from a single sensor. We show that phenology and species composition play important roles in model transferability; when trained using imagery from a single conifer forest in autumn, the model performs well on autumn imagery from a second conifer forest several hundred kilometers distant with no re-training. With modest additions to the training dataset, the same model generates minimally biased estimates of canopy height in both conifer and deciduous forests during multiple seasons. Because the model operates on satellite data with global coverage and a relatively short return interval, we propose its suitability to extrapolate tree-level canopy height data to remote regions and conduct high-temporal resolution monitoring of forest structure. We furthermore demonstrate the workflow’s applicability to fire modeling by conducting simulations in forests populated by trees measured using both this approach and airborne lidar surveying. We find minimal differences in fire behavior relative to a baseline case in which only statistical distributions of tree height and crown area are known. This result underscores the value of forest structural information derived from our workflow for improving the fidelity of wildland fire simulations, among other ecological applications.

54 ENVIRONMENTAL SCIENCES

GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects

Simulation-based approaches to microstructure generation can suffer from a variety of limitations, such as high memory usage, long computational times, and difficulties in generating complex geometries. Generative machine learning models present a way around these issues, but they have previously been limited by the fixed size of their generation area. Here, we present a new microstructure generation methodology leveraging advances in inpainting using denoising diffusion models to overcome this generation area limitation. We show that microstructures generated with the presented methodology are statistically similar to grain structures generated with a kinetic Monte Carlo simulator, SPPARKS.

36 MATERIALS SCIENCE

Image-to-Image Wildfire Detection via Quantum-Compatible Variational Segmentation from Remotely-sensed Data

Over the last decade, the incidence of wildfires has surged, causing widespread destruction globally. To better comprehend and manage these incidents, remote sensing and aerial missions have been implemented in recent efforts. However, this has resulted in an exponential rise in the amount of remote sensing data utilization, leading to a need for intelligent automation of data extraction in wildfire studies. Machine learning provides an accurate automated approach for detecting these natural anomalies and facilitates decision-makers to take prompt actions. To make insightful decisions in wildfire management, it is imperative to move beyond simple detection and explore the potential of probabilistic generative machine learning for creating "what-if" scenarios for various wildfire conditions. Such models offer improved representation of the stochastic nature of wildfire events. However, the optimization of these models can be computationally expensive, especially when using classical computers. Quantum computers have recently emerged as a promising solution to reduce the computational cost of training such models and improve their performance. In this study, we aim to utilize quantum-compatible machine learning techniques to implement our probabilistic generative approach. To that end, we propose a supervised probabilistic variational model consisting of a U-NET-based image-to-image component along with encoder and decoder networks which work as a variational autoencoder (VAE) component. Additionally, we explore the type of latent distribution type in the VAE component and implement different means for modeling the prior distribution. We further investigate the quantum-compatible versions of the model compared to the classical counterpart and benchmark potential benefits of quantum compatibility over the classical model.

quantum machine learning

Solution of the linear wave-particle kinetic equation for global modes of arbitrary frequency in a tokamak

The linear response of a plasma to perturbations of arbitrary frequency and wavelength is derived for any axisymmetric magnetized toroidal plasma. An explicit transformation to action-angle coordinates is achieved using orthogonal magnetic coordinates and the Littlejohn Lagrangian, establishing the validity of this result to arbitrary order in normalized Larmor radius. The global resonance condition for compressional modes is clarified in more detail than in previous works, confirming that the poloidal orbit-average of the cyclotron frequency gives the desired result at lowest order in Larmor radius. The global plasma response to the perturbation at each resonance is captured by a poloidal and gyroaverage of the perturbing potential. A “global gyroaveraging” of the potential is a natural by-product of this analysis which takes into account the changing of the magnetic field over an orbit. The resonance condition depends on two arbitrary integers which completely separately capture the effects poloidal non-uniformity and finite Larmor radius in generating sidebands. We learn that poloidal sidebands generated for compressional modes are dominated by the change in gyrofrequency over the orbit, which is very different to shear modes where the gyrofrequency only contributes via a finite Larmor radius effect. This increases the number of bounce harmonics required to compute the linear drive, giving a more complicated resonance map. An example calculation is given comparing resonance of shear and compressional modes in a published DIII-D case.

Compressional

Developing Data-Driven Synthetic Infrastructure Models for Resilience Analysis

Research on infrastructure resilience has produced promising methods to simulate and optimize complex networks to improve performance. However, restrictions on sharing infrastructure models and the steep cost of developing and maintaining infrastructure models presents a roadblock to adoption. To overcome this limitation, this research focuses on methods to create data-driven infrastructure models that will help improve infrastructure resilience and security. The analysis couples incomplete utility data, geospatial data, machine learning, and synthetic network generation methods to rapidly develop and update infrastructure models. The methods are validated using realistic utility models and site-specific data, with a focus on Puerto Rico due to its unique infrastructure challenges and available data. This research highlights promising opportunities for the use of synthetic network generation and machine learning to create infrastructure models when very little data is available. Results demonstrate that hybrid methods, which combine sparse utility data with synthetic models, can enhance model accuracy, and machine learning can predict model attributes using training data from other models. However, the complexity of infrastructure systems means that even minor changes in network connectivity can significantly impact simulation results. Resilience analysis using synthetic infrastructure models shows that while some system behaviors are preserved, the magnitude of disruptions may not be accurately represented, indicating the need for more research and validation before using synthetic models for critical infrastructure investment decisions. The framework outlined in this report represents a significant advance to infrastructure model development and could be applied to additional domains and sites. Future research will continue to streamline and validate methods to help reduce roadblocks to resilience analysis.

24 POWER TRANSMISSION AND DISTRIBUTION