Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

NEON AOP Imaging Spectroscopy Survey of Upper East River Colorado Watersheds: Raw-Space Radiance and Observational Variable Dataset

Lawrence Berkeley National Laboratory (LBNL) contracted the National Ecological Observatory Network Airborne Observation Platform (NEON AOP) to observe watersheds of interest near Crested Butte, CO with remotely sensed data including imaging spectroscopy. The flight box design encompassed the watersheds, and flight design targeted a minimum of 30% overlap between adjacent flight lines. The total area surveyed was 334 km2 across 72 lines. Flight lines were oriented north-south for consistency in solar illumination geometry. Seven days were required to cover the flight area. Some areas were flown additional times to improve data quality or temporal coincidence between airborne acquisitions and field sampling. In total, 102 lines were collected and can be downloaded here: https://portal.nersc.gov/wfsfa/doi-10-15485-1617204/. The instrument used for the acquisition was an Airborne Visible-Infrared Imaging Spectrometer - Next Generation (AVIRIS-NG), which records radiance within 426 contiguous spectral bands in the wavelength range from 380 to 2510 nm. The instrument was flown at a target aboveground altitude of 1000 m for a processed data spatial resolution of 1 m. These data are non-orthorectified, radiance data that require further processing prior to use as a surface reflectance data set.

2018 NEON and 2025 CHESS Campaigns↗

Coastal environment of the Beaufort Sea from field data and ERTS-1 imagery, summer 1972

The author has identified the following significant results. An extensive field program during the spring and summer in the coastal Beaufort Sea test site has been completed using a wide variety of sensing techniques. Reduction of field data and ERTS-1 image analysis have shown the coastal environment to be complexly influenced by unique processes, most of which involve or are related to sea ice. Active sedimentologic processes along the Arctic coast are set in motion by the melting, flooding, and eventual overflow of rivers onto the sea ice. It is now apparent that only minor amounts of sediment are transported offshore at this stage; however, scouring of the bottom is significant beneath the strudels (drain holes) which develop in the fast ice canopy in the region of overflow. Areal salinity and turbidity patterns together with ERTS-1 imagery confirm a consistent influx of colder, clearer, saltier water towards the coast just east of the Colville River. Strong (up to 3 knots) bidirectional but intermittent currents often manifest themselves in imagery and aerial photographs as wakes behind grounded ice. Ice movement vectors generated from repetitive images indicate that ice drift is closely associated with wind direction, especially in shallow bays, and displacements of 4-22 kilometers were noted in 24 hours.

Reimnitz, E.↗

Universal image representation based on a multimodal graph

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Bremer, Peer-Timo↗

Universal image representation based on a multimodal graph

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Bremer, Peer-Timo↗

A Generative Model for Realistic Galaxy Cluster X-Ray Morphologies

Abstract The X-ray morphologies of clusters of galaxies display significant variations, reflecting their dynamical histories and the nonlinear dependence of X-ray emissivity on the density of the intracluster gas. Qualitative and quantitative assessments of X-ray morphology have long been considered a proxy for determining whether clusters are dynamically active or “relaxed.” Conversely, the use of circularly or elliptically symmetric models for cluster emission can be complicated by the variety of complex features realized in nature, spanning scales from megaparsecs down to the resolution limit of current X-ray observatories. In this work, we use mock X-ray images from simulated clusters from The Three Hundred project to define a basis set of cluster image features. We take advantage of the clusters’ approximate self-similarity to minimize the differences between images before encoding the remaining diversity through a distribution of high-order polynomial coefficients. Principal component analysis then provides an orthogonal basis for this distribution, corresponding to natural perturbations from an average model. This representation allows novel, realistically complex X-ray cluster images to be easily generated, and we provide code to do so. The approach provides a simple way to generate training data for cluster image analysis algorithms and could be straightforwardly adapted to generate clusters displaying specific types of features or selected by physical characteristics available in the original simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Connectivity-informed drainage network generation using deep convolution generative adversarial networks

Abstract Stochastic network modeling is often limited by high computational costs to generate a large number of networks enough for meaningful statistical evaluation. In this study, Deep Convolutional Generative Adversarial Networks (DCGANs) were applied to quickly reproduce drainage networks from the already generated network samples without repetitive long modeling of the stochastic network model, Gibb’s model. In particular, we developed a novel connectivity-informed method that converts the drainage network images to the directional information of flow on each node of the drainage network, and then transforms it into multiple binary layers where the connectivity constraints between nodes in the drainage network are stored. DCGANs trained with three different types of training samples were compared; (1) original drainage network images, (2) their corresponding directional information only, and (3) the connectivity-informed directional information. A comparison of generated images demonstrated that the novel connectivity-informed method outperformed the other two methods by training DCGANs more effectively and better reproducing accurate drainage networks due to its compact representation of the network complexity and connectivity. This work highlights that DCGANs can be applicable for high contrast images common in earth and material sciences where the network, fractures, and other high contrast features are important.

42 ENGINEERING↗

Integrating very-high-resolution UAS data and airborne imaging spectroscopy to map the fractional composition of Arctic plant functional types in Western Alaska

Widespread changes in vegetation cover and composition are driving strong impacts on Arctic ecosystem functioning and global climate feedbacks. An accurate characterization of tundra vegetation composition is required to understand how the Arctic will respond to future climate change. However, quantifying tundra vegetation composition over large areas is challenging as commonly-used satellite observations are too coarse, spatially and spectrally, to differentiate low-lying tundra vegetation types. Recent airborne and spaceborne imaging spectroscopy platforms provide better data to characterize vegetation composition. Yet, our ability to characterize vegetation composition with imaging spectroscopy remains largely unexplored in the Arctic, particularly due to a lack of ground observations needed to train and test classification models. To address this problem, we collected very-high-resolution (VHR, ~5 cm) unoccupied aerial system (UAS) imagery at three low-Arctic tundra sites located on the Seward Peninsula, western Alaska. In this paper, we examine the feasibility of integrating imagery from the UAS and the hyperspectral Airborne Visible/Infrared Imaging Spectrometer, Next Generation (AVIRIS-NG) airborne instrument to map the fractional composition of 12 key Arctic plant functional types (PFTs). To this end, we first mapped the 12 PFTs from our VHR UAS imagery using random forest classification. We then used these UAS-derived PFT maps as ground truth to develop partial least squares regression (PLSR) models to predict the fractional cover (FCover) of each PFT from AVIRIS-NG imagery. Further, we evaluated the performance of our PLSR models using reserved UAS samples, as well as by mapping PFT FCover and dominant PFT for large tundra landscapes. Our results show that 1) Arctic PFTs can be effectively mapped using VHR UAS imagery, with overall accuracy between 86% and 92%, 2) when the UAS mapped PFTs were used to inform PLSR scaling models, the FCover of the 12 PFTs could be effectively estimated from AVIRIS-NG imagery with a mean absolute error (MAE) <0.13, and 3) our PLSR models outperformed traditional, fully constrained least-squares (FCLS) linear mixture analysis and produced high-quality, spatially contiguous PFT FCover and PFT maps that captured vegetation spatial patterns with similar accuracy to those developed from UAS imagery. The developed PLSR models have the potential to be broadly applied for quantifying vegetation composition with AVIRIS-NG images to help monitor tundra vegetation dynamics and improve process-based modeling of tundra ecosystems.

54 ENVIRONMENTAL SCIENCES↗

X-Ray Detector for 1 to 30 keV

Array of silicon X-ray detecting diodes measures photon energy and provides image of X-ray pattern. Regardless of thickness of new X-ray detector, depletion region extends through it. Impinging X-rays generate electrons in quantities proportional to X-ray energy. X-ray detector is mated to chargecoupled-device array for image generation and processing. Useful in industrial part inspection, pulsed-plasma research and medical application.

Alcorn, G.↗

Lossless Compression of Classification-Map Data

A lossless image-data-compression algorithm intended specifically for application to classification-map data is based on prediction, context modeling, and entropy coding. The algorithm was formulated, in consideration of the differences between classification maps and ordinary images of natural scenes, so as to be capable of compressing classification- map data more effectively than do general-purpose image-data-compression algorithms. Classification maps are typically generated from remote-sensing images acquired by instruments aboard aircraft (see figure) and spacecraft. A classification map is a synthetic image that summarizes information derived from one or more original remote-sensing image(s) of a scene. The value assigned to each pixel in such a map is the index of a class that represents some type of content deduced from the original image data for example, a type of vegetation, a mineral, or a body of water at the corresponding location in the scene. When classification maps are generated onboard the aircraft or spacecraft, it is desirable to compress the classification-map data in order to reduce the volume of data that must be transmitted to a ground station.

Hua, Xie↗

Two dimensional convolute integers for machine vision and image recognition

Machine vision and image recognition require sophisticated image processing prior to the application of Artificial Intelligence. Two Dimensional Convolute Integer Technology is an innovative mathematical approach for addressing machine vision and image recognition. This new technology generates a family of digital operators for addressing optical images and related two dimensional data sets. The operators are regression generated, integer valued, zero phase shifting, convoluting, frequency sensitive, two dimensional low pass, high pass and band pass filters that are mathematically equivalent to surface fitted partial derivatives. These operators are applied non-recursively either as classical convolutions (replacement point values), interstitial point generators (bandwidth broadening or resolution enhancement), or as missing value calculators (compensation for dead array element values). These operators show frequency sensitive feature selection scale invariant properties. Such tasks as boundary/edge enhancement and noise or small size pixel disturbance removal can readily be accomplished. For feature selection tight band pass operators are essential. Results from test cases are given.

Edwards, Thomas R.↗

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗

Point containment algorithms for constructive solid geometry with unbounded primitives

Here, we present several algorithms for evaluating point containment in constructive solid geometry (CSG) trees with unbounded primitives. Three algorithms are presented based on postfix, prefix, and infix notations of the CSG binary expression tree. We show that prefix and infix notations enable short-circuiting logic, which reduces the number of primitives that must be checked during point containment. To evaluate the performance of the algorithms, each algorithm was implemented in the OpenMC Monte Carlo particle transport code, which relies on CSG to represent solid bodies through which subatomic particles travel. Two sets of tests were carried out. First, the execution time to generate a rasterized image of a 2D slice of three CSG models of varying complexity was measured. Use of both prefix and infix notations offered significant speedup over the postfix notation that has traditionally been used in particle transport codes, with infix resulting in a 6 x reduction in execution time relative to postfix for a model of a tokamak fusion device. We then measured the execution time of neutron transport simulations of the same three models using each of the algorithms. The results and performance improvements reveal the same trends as for the rasterization test, with a 5.52 x overall speedup using the infix notation relative to the original postfix notation in OpenMC for the tokamak model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Neural-based time series forecasting of loss of coolant accidents in nuclear power plants

During the last few years, deep learning in neural networks has demonstrated impressive successes in the areas of computer vision, speech and image recognition, text generation, and many others. However, sensitive engineering areas such as nuclear engineering benefited less from these efficient techniques. In this work, deep learning expert systems are utilized to model and predict time series progression of a design-basis nuclear accident, featuring a loss of coolant accident. Two major findings are accomplished in this work. First, the ability to train expert systems with high accuracy, which could help nuclear power plant operators to figure out plant responses during the accident. Second, building fast, efficient, and accurate deep models to simulate nuclear phenomena, which could be valuable to nuclear computational science. In this work, large amount of time series data is obtained from simulation tools by simulating different conditions of the base-case/nominal accident scenario. Four critical outputs/responses are monitored during the accident (e.g. temperature, pressure, break flow rate, water level). Two approaches are adopted in this work. The first approach is to use feedforward deep neural networks (DNN) to fit all time steps and outputs in a single model. The second approach is to use long short-term memory (LSTM) to fit all time steps together for each reactor response separately. Both DNN and LSTM demonstrate very good performance in predicting the test and base-case scenarios, with accuracy as low as 92% and as high as 99%, where these test scenarios are unknown to the expert systems and are not included in the model training. In addition, both approaches demonstrate a significant reduction in computational costs, as the deep expert system is able to accurately predict the accident 100,000 times faster than the original simulation tool. Given sufficient data, the methodology adopted in this study demonstrates that DNN/LSTM expert systems can be used as a decision support system to model advanced time series phenomena within nuclear power plants with high accuracy and negligible computational costs.

42 ENGINEERING↗

A Stereo Camera Simulator for Large-Eddy Simulations of Continental Shallow Cumulus Clouds Based on Three-Dimensional Path-Tracing

The complex spatial and temporal structure of cumulus clouds complicates their representation in weather and climate models. Classic meteorological instrumentation struggles to fully capture these features. Networks of multiple high-resolution hemispheric cameras are increasingly used to fill this data gap, and provide information on this missing multi-dimensional spatial information. In this study, a path-tracing algorithm is used to generate virtual camera images of resolved clouds in large-eddy simulations (LES). These images are then used as a camera network simulator, allowing reconstructions of three-dimensional cloud edges from the model output. Because the actual LES cloud field is fully known, the combined path-tracing and reconstruction method can be statistically analyzed. The method is applied to LES realizations of summertime shallow cumulus at the Jülich Observatory for Cloud Evolution (JOYCE), Germany, which also routinely operates a camera network. We find that the path-tracing method allows accurate reconstruction of up to 70% of the visible cloud edges. Additional sensitivity tests show that the method is robust for changes in its hyperparameters. The sensitivity to cloud optical thickness is also investigated, finding a cloud boundary placement error of approximately 182 m. This error can be considered typical for cloud boundary reconstruction using real stereo camera imagery. The results provide proof of principle for future use of the method for evaluating LES clouds against camera network imagery, and for further optimizing the configuration of such camera networks.

54 ENVIRONMENTAL SCIENCES↗

The impact of anisotropic redshift distributions on angular clustering

A leading way to constrain physical theories from cosmological observations is to test their predictions for the angular clustering statistics of matter tracers, a technique that is set to become ever more central with the next generation of large imaging surveys. Interpretation of this clustering requires knowledge of the projection kernel, or the redshift distribution of the sources, and the typical assumption is an isotropic redshift distribution for the objects. However, variations in the kernel are expected across the survey footprint due to photometric variations and residual observational systematic effects. Here, we develop the formalism for anisotropic projection and present several limiting cases that elucidate the key aspects. We quantify the impact of anisotropies in the redshift distribution on a general class of angular two-point statistics. In particular, we identify a mode-coupling effect that can add power to auto-correlations, including galaxy clustering and cosmic shear, and remove it from certain cross-correlations. If the projection anisotropy is primarily at large scales, the mode-coupling depends upon its variance as a function of redshift; furthermore, it is often of similar shape to the signal. In contrast, the cross-correlation of a field whose selection function is anisotropic with another one featuring no such variations — such as CMB lensing — is immune to these effects. We discuss explicitly several special cases of the general formalism including galaxy clustering, galaxy-galaxy lensing, cosmic shear and cross-correlations with CMB lensing, and publicly release a code to compute the biases.

79 ASTRONOMY AND ASTROPHYSICS↗

Seismotectonic evidence for subduction beneath the Eastern Greater Caucasus

SUMMARY We generated high-resolution 3-D seismic velocity models as well as a relocated earthquake catalogue across the eastern Greater Caucasus and Kura basins. This work was done using data from the recently upgraded Republic Seismological Survey Center's (RSSC) seismic network. We generated our tomographic images of crustal velocity structure in Azerbaijan using double-difference inversions (i.e. tomoDD and hypoDD). Earthquake catalogues from the RSSC between 2011 and 2016 were used; these catalogues include absolute arrival times of 103 288 P- and 120 952 S-wave traveltime picks for 7574 events recorded at 35 stations in Azerbaijan. Beginning with a layered, 1-D velocity model that was estimated using VELEST, we inverted simultaneously for relative location, Vp and Vs on a 3-D grid with dimensions 670 × 445 × 45 km, with a uniform grid spacing of 55 × 55 × 5 km for all of Azerbaijan. We observe that the relocated hypocentres cluster into two depth ranges, at the surface and at depth, that appear to correspond to major fault zones and the top of a subducting plate. Additionally, we note intermediate depth seismicity (∼50–60 km) beneath the Kura Basin, and a northward deepening of earthquake depths. Seismic velocities vary significantly throughout the study region; we observe very slow velocities throughout the Kura Basin between 5 and 15 km, and elevated velocities at 20–35 km. The wholesale velocity structure and seismic structure of Kura Basin strongly mirrors that of the Caspian Sea, which suggests that the geodynamics of the Caspian continue westwards into Azerbaijan. The key results of this study suggest that the northward subduction observed in the Caspian Sea continues beneath the Eastern Greater Caucasus, as well as provides evidence for active faulting along the southern margin of the mountain range.

Gunnels, Michael↗

Phase-weighted slant stacking for surface wave dispersion measurement

SUMMARY Surface wave retrieval from ambient noise records using seismic interferometry techniques has been widely used for multiscale shear wave velocity (Vs) imaging. One key step during Vs imaging is the generation of dispersion spectra and the extraction of a reliable dispersion curve from the retrieved surface waves. However, the sparse array geometry usually affects the ability for high-frequency (>1 Hz) seismic signals’ acquisition. Dispersion measurements are degraded by array response due to sparse sampling and often present smeared dispersion spectra with sidelobe artefacts. Previous studies usually focus on interferograms’ domain (e.g. cross-correlation function) and attempt to enhance coherent signals before dispersion measurement. We propose an alternative technique to explicitly deblur dispersion spectra through use of a phase-weighted slant-stacking algorithm. Numerical examples demonstrate the strength of the proposed technique to attenuate array responses as well as incoherent noise. Three different field examples prove the flexibility and superiority of the proposed technique: the first data set consists of ambient noise records acquired using a nodal seismometer array; the second data set utilizes distributed acoustic sensing (DAS) and a marine fibre-optic cable to acquire a similar ambient noise data set; the last data set is a vibrator-based active-source surface wave data. The enhanced dispersion measurements provide cleaner and higher-resolution spectra without distortions which will assist both human interpreters as well as ML algorithms in efficiently picking curves for subsequent Vs inversion.

58 GEOSCIENCES↗

Evaluation of Electron Tomography Capabilities for Shale Imaging

Despite the advantageous resolution of electron tomography (ET), reconstruction of three-dimensional (3D) images from multiple two-dimensional (2D) projections presents several challenges, including small signal-to-noise ratios, and a limited projection range. This study evaluates the capabilities of ET for thin sections of shale, a complex nanoporous medium. A numerical phantom with 1.24 nm pixel size is constructed based on the tomographic reconstruction of a Barnett shale. A dataset of 2D projection images is numerically generated from the 3D phantom and studied over a range of conditions. First, common reconstruction techniques are used to reconstruct the shale structure. The reconstruction uncertainty is quantified by comparing overall values of storage and transport metrics, as well as the misclassification of pore voxels compared to the phantom. We then select the most robust reconstruction technique and we vary the acquisition conditions to quantify the effect of artifacts. We find a strong agreement for large pores over the different acquisition workflows, while a wider variability exists for nanometer-scale features. Furthermore, the limited projection range and reconstruction are identified as the main experimental bottlenecks, thereby suggesting that sample thinning, advanced holders, and advanced reconstruction algorithms offer opportunities for improvement.

3D scanning transmission electron microscopy↗