Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

ChemPix: automated recognition of hand-drawn hydrocarbon structures using deep learning

Inputting molecules into chemistry software, such as quantum chemistry packages, currently requires domain expertise, expensive software and/or cumbersome procedures. Leveraging recent breakthroughs in machine learning, we develop ChemPix: an offline, hand-drawn hydrocarbon structure recognition tool designed to remove these barriers. A neural image captioning approach consisting of a convolutional neural network (CNN) encoder and a long short-term memory (LSTM) decoder learned a mapping from photographs of hand-drawn hydrocarbon structures to machine-readable SMILES representations. We generated a large auxiliary training dataset, based on RDKit molecular images, by combining image augmentation, image degradation and background addition. Additionally, a small dataset of ~600 hand-drawn hydrocarbon chemical structures was crowd-sourced using a phone web application. These datasets were used to train the image-to-SMILES neural network with the goal of maximizing the hand-drawn hydrocarbon recognition accuracy. By forming a committee of the trained neural networks where each network casts one vote for the predicted molecule, we achieved a nearly 10 percentage point improvement of the molecule recognition accuracy and were able to assign a confidence value for the prediction based on the number of agreeing votes. The ensemble model achieved an accuracy of 76% on hand-drawn hydrocarbons, increasing to 86% if the top 3 predictions were considered.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1973

Investigation of uses of holographic optical elements

The data represent a thorough study of the aberrations and imaging properties of holographic optical elements. Principle studies include (1) the indepth experimental investigation of single holographic optical elements, (2) the verification of the accuracy of the theoretical computer-based description of hologram behavior, (3) the computer-generation of interferograms that are characteristic of a prescribed aberrated imaging condition, (4) the experimental verification of wavelength optimization, (5) the experimental determination of the space bandwidth product of single holographic optical elements as a function of bending and field angle, and (6) the first experimental study of the aberration properties of holographic optical elements constructed in very thick (750 microns) recording media.

Zech, R. G.↗
NASA NTRS1995

Estimating Slopes In Images Of Terrain By Use Of BRDF

Proposed method of estimating slopes of terrain features based on use of bidirectional reflectivity distribution function (BRDF) in analyzing aerial photographs, satellite video images, or other images produced by remote sensors. Estimated slopes integrated along horizontal coordinates to obtain estimated heights; generating three-dimensional terrain maps. Method does not require coregistration of terrain features in pairs of images acquired from slightly different perspectives nor requires Sun or other source of illumination to be low in sky over terrain of interest. On contrary, best when Sun is high. Works at almost all combinations of illumination and viewing angles.

Scholl, Marija S.↗
DOE OSTI2020

Transport of intensity equation: a tutorial

When it comes to “phase measurement” or “quantitative phase imaging”, many people will automatically connect them with “laser” and “interferometry”. Indeed, conventional quantitative phase imaging and phase measurement techniques generally rely on the superposition of two beams with a high degree of coherence: complex interferometric configurations, stringent requirements on the environmental stabilities, and associated laser speckle noise severely limit their applications in optical imaging and microscopy. On a different note, as one of the most well-known phase retrieval approaches, the transport of intensity equation (TIE) provides a new non-interferometric way to access quantitative phase information through intensity only measurement. Despite the insufficiency for interferometry, TIE is applicable under partially coherent illuminations (like the Köhler’s illumination in a conventional microscope), permitting optimum spatial resolution, higher signal-to-noise ratio, and better image quality. In this tutorial, we give an overview of the basic principle, research fields, and representative applications of TIE, focus particularly on optical imaging, metrology, and microscopy. The purpose of this tutorial is twofold. It should serve as a self-contained introduction to TIE for readers with little or no knowledge of TIE. On the other hand, it attempts to give an overview of recent developments in this field. These results highlight a new era in which strict coherence and interferometry are no longer prerequisites for quantitative phase imaging and diffraction tomography, paving the way toward new generation label-free three-dimensional microscopy, with applications in all branches of biomedicine.

42 ENGINEERING↗
DOE OSTI2020

Toward nanoscale molecular mass spectrometry imaging via physically constrained machine learning on co-registered multimodal data

Mass spectrometry imaging (MSI) plays a pivotal role in investigating the chemical nature of complex systems that underly our understanding in biology and medicine. Multiple fields of life science such as proteomics, lipidomics and metabolomics benefit from the ability to simultaneously identify molecules and pinpoint their distribution across a sample. However, achieving the necessary submicron spatial resolution to distinguish chemical differences between individual cells and generating intact molecular spectra is still a challenge with any single imaging approach. Here, we developed an approach that combines two MSI techniques, matrix-assisted laser desorption/ionization (MALDI) and time-of-flight secondary ion mass spectrometry (ToF-SIMS), one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The known relationships between the two MSI channels of information are enforced via a physically constrained machine-learning approach and directly incorporated in the data processing. We demonstrate the robustness of this method by generating intact molecular MALDI-type spectra and chemical maps at ToF-SIMS resolution when imaging mouse brain thin tissue sections. This approach can be readily adopted for other types of bioimaging where physical relationships between methods have to be considered to boost the confidence in the reconstruction product.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Subject-specific modeling framework for particle deposition using computational fluid dynamics

Quantifying particle deposition and dose in the respiratory tract requires a physiologically realistic representation and reproducible computational workflows. However, existing modeling frameworks, such as the International Commission on Radiological Protection (ICRP) compartmental models and the Multiple Path Particle Dosimetry (MPPD) tool, lack detailed deposition profiles and subject-specific capabilities. The combination of advances in computer vision algorithms applied to the respiratory tract and Computational Fluid and Particle Dynamics (CFPD) allows high-fidelity simulations of particle behavior in anatomically accurate geometries derived from individual CT scans. The segmentation, preprocessing, and file preparation task for a CFPD simulation was often time-consuming, and no prior studies to-date have yet presented a fully automated framework. This work presents a fully automated workflow to obtain individualized particle deposition profiles in the human respiratory tract. The pipeline starts with segmenting upper and lower airway geometries using morphological and deep learning-based methods, generating three-dimensional (3D) models from CT imaging data. Next, a series of algorithms are presented to quality check and prepare the 3D geometry for a CFD or CFPD simulation. The preprocessing step includes correcting geometric artifacts, enforcing a physically consistent mesh, and automatically identifying and capping multiple outlets, which is required for CFD/CFPD simulations. These processed models are then input into open-source (OpenFOAM) or commercial (StarCCM+) CFD solvers, where flow and transient particle transport equations — including turbulence and particle–wall interactions are solved under realistic breathing conditions. Finally, the resulting particle deposition profiles can be integrated with Monte Carlo radiation transport codes and state-of-the-art computational phantoms to assess organ-specific absorbed doses in scenarios of radioactive aerosol inhalation. The presented work streamlines respiratory tract segmentation, preprocessing for CFD/CFPD simulations, and integration with dose assessment workflows, reducing manual intervention and improving access to high-fidelity, subject-specific modeling. The high precision in predicted particle deposition and dose distributions can improve personalized treatment strategies in respiratory medicine and refine dose estimates for radiation protection.

AI↗
DOE OSTI2022

Very-High Dynamic Range, 10,000 Frames/Second Pixel Array Detector for Electron Microscopy

Precision and accuracy of quantitative scanning transmission electron microscopy (STEM) methods such as ptychography, and the mapping of electric, magnetic, and strain fields depend on the dose. Reasonable acquisition time requires high beam current and the ability to quantitatively detect both large and minute changes in signal. A new hybrid pixel array detector (PAD), the second-generation Electron Microscope Pixel Array Detector (EMPAD-G2), addresses this challenge by advancing the technology of a previous generation PAD, the EMPAD. The EMPAD-G2 images continuously at a frame-rates up to 10 kHz with a dynamic range that spans from low-noise detection of single electrons to electron beam currents exceeding 180 pA per pixel, even at electron energies of 300 keV. The EMPAD-G2 enables rapid collection of high-quality STEM data that simultaneously contain full diffraction information from unsaturated bright-field disks to usable Kikuchi bands and higher-order Laue zones. Test results from 80 to 300 keV are presented, as are first experimental results demonstrating ptychographic reconstructions, strain and polarization maps. We introduce a new information metric, the maximum usable imaging speed (MUIS), to identify when a detector becomes electron-starved, saturated or its pixel count is mismatched with the beam current.

36 MATERIALS SCIENCE↗
DOE OSTI2022

TIA: A forward model and analyzer for Talbot interferometry experiments of dense plasmas

Interferometry is one of the most sensitive and successful diagnostic methods for plasmas. However, owing to the design of most common interferometric systems, the wavelengths of operation and, therefore, the range of densities and temperatures that can be probed are severely limited. Talbot–Lau interferometry offers the possibility of extending interferometry measurements to x-ray wavelengths by means of the Talbot effect. While there have been several proof-of-concept experiments showing the efficacy of this method, it is only recently that experiments to probe High Energy Density (HED) plasmas using Talbot–Lau interferometry are starting to take place. To improve these experimental designs, we present here the Talbot-Interferometry Analyzer (TIA) tool, a forward model for generating and postprocessing synthetic x-ray interferometry images from a Talbot–Lau interferometer. Although TIA can work with any two-dimensional hydrodynamic code to study plasma conditions as close to reality as possible, this software has been designed to work by default with output files from the hydrodynamic code FLASH, making the tool user-friendly and accessible to the general plasma physics community. Here, the model has been built into a standalone app, which can be installed by anyone with access to the MATLAB runtime installer and is available upon request to the authors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

The role of CenKR in the coordination of Rhodobacter sphaeroides cell elongation and division

ABSTRACT Cell elongation and division are essential aspects of the bacterial life cycle that must be coordinated for viability and replication. The impact of misregulation of these processes is not well understood as these systems are often not amenable to traditional genetic manipulation. Recently, we reported on the CenKR two-component system (TCS) in the Gram-negative bacterium Rhodobacter sphaeroides that is genetically tractable, widely conserved in α-proteobacteria, and directly regulates the expression of components crucial for cell elongation and division, including genes encoding subunit of the Tol-Pal complex. In this work, we show that overexpression of cenK results in cell filamentation and chaining. Using cryo-electron microscopy (cryo-EM) and cryo-electron tomography (cryo-ET), we generated high-resolution two-dimensional (2D) images and three-dimensional (3D) volumes of the cell envelope and division septum of wild-type cells and a cenK overexpression strain finding that these morphological changes stem from defects in outer membrane (OM) and peptidoglycan (PG) constriction. By monitoring the localization of Pal, PG biosynthesis, and the bacterial cytoskeletal proteins MreB and FtsZ, we developed a model for how increased CenKR activity leads to changes in cell elongation and division. This model predicts that increased CenKR activity decreases the mobility of Pal, delaying OM constriction, and ultimately disrupting the midcell positioning of MreB and FtsZ and interfering with the spatial regulation of PG synthesis and remodeling. IMPORTANCE By coordinating cell elongation and division, bacteria maintain their shape, support critical envelope functions, and orchestrate division. Regulatory and assembly systems have been implicated in these processes in some well-studied Gram-negative bacteria. However, we lack information on these processes and their conservation across the bacterial phylogeny. In R. sphaeroides and other α-proteobacteria, CenKR is an essential two-component system (TCS) that regulates the expression of genes known or predicted to function in cell envelope biosynthesis, elongation, and/or division. Here, we leverage unique features of CenKR to understand how increasing its activity impacts cell elongation/division and use antibiotics to identify how modulating the activity of this TCS leads to changes in cell morphology. Our results provide new insight into how CenKR activity controls the structure and function of the bacterial envelope, the localization of cell elongation and division machinery, and cellular processes in organisms with importance in health, host-microbe interactions, and biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Automatic Report Generator (ARG)

ARG is a computational simulation tool. It generates user-configurable reports, including graphs and images, from user data in various formats.SAND2019-9525 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Clay, Robert↗
DOE OSTI2022

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Power System Event Classification and Localization Using a Convolutional Neural Network

Detection and timely identification of power system disturbances are essential for situation awareness and reliable electricity grid operation. Because records of actual events in the system are limited, ensemble simulation-based events are needed to provide adequate data for building event-detection models through deep learning; e.g., a convolutional neural network (CNN). An ensemble numerical simulation-based training data set have been generated through dynamic simulations performed on the Polish system with various types of faults in different locations. Such data augmentation is proven to be able to provide adequate data for deep learning. The synchronous generators’ frequency signals are used and encoded into images for developing and evaluating CNN models for classification of fault types and locations. With a time-domain stacked image set as the benchmark, two different time-series encoding approaches, i.e., wavelet decomposition-based frequency-domain stacking and polar coordinate system-based Gramian Angular Field (GAF) stacking, are also adopted to evaluate and compare the CNN model performance and applicability. The various encoding approaches are suitable for different fault types and spatial zonation. With optimized settings of the developed CNN models, the classification and localization accuracies can go beyond 84 and 91%, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A Catalog of Candidate Double and Lensed Quasars from Gaia and WISE Data

Making use of strong correlations between closely separated multiple or double sources and photometric and astrometric metadata in Gaia Early Data Release 3 (EDR3), we generate a catalog of candidate double- and multiply imaged lensed quasars and active galactic nuclei (AGNs), comprising 3140 systems. It includes two partially overlapping parts: a sample of distant (redshifts mostly greater than 1) sources with perturbed data; and systems that have been resolved into separate components by Gaia at separations less than 2''. For the first part, which is roughly one-third of the published catalog, we synthesized 0.617 million redshifts using multiple machine-learning prediction and classification methods, using independent photometric and astrometric data from Gaia EDR3 and the Wide-field Infrared Survey Explorer, with accurate spectroscopic redshifts from the Sloan Digital Sky Survey (SDSS) as a training set. Using these synthetic redshifts, we estimate a 4.9% rate of interlopers with spectroscopic redshifts below 1 in this part of the catalog. Unresolved candidate double and dual AGNs and quasars are selected as sources with a marginally high BP/RP excess factor (phot_bp_rp_excess_factor), which is sensitive to source extent, limiting our search to high-redshift quasars. For the second part of the catalog, additional filters on measured parallax and near-neighbor statistics are applied to diminish the propagation of the remaining stellar contaminants. The estimated rate of the positives (double or multiple sources) is 98%, and the estimated rate of dual (physically related) quasars is greater than 54%. A few dozen serendipitously found objects of interest are discussed in more detail, including known and new lensed images, planetary nebulae, young IR stars of peculiar morphology, and quasars with catastrophic redshift errors in SDSS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Real-time Anomaly Detection for Liquid Argon Time Projection Chambers

We present a real-time anomaly detection framework for liquid argon time projection chambers (LArTPCs), targeting applications in particle physics experiments such as the Short Baseline Near Detector (SBND) or the future Deep Underground Neutrino Experiment (DUNE). These experiments employ detectors that generate and stream high-resolution but sparse images of neutrino and other particle interactions. Our approach utilizes anomaly detection with autoencoders, compressed through knowledge distillation (KD), to enable the detection of anomalous signals in the data through efficient inference on resource-constrained hardware. The framework is targeted for deployment on computing platforms equipped with field-programmable gate arrays (FPGAs), GPUs, or CPUs, allowing low-latency selection of relevant activity directly from the raw detector data stream. We demonstrate that our approach is suitable for the detection and localization of anomalously "high-multiplicity" activity, and outline promising applications for LArTPC online data filtering and triggering.

FOS: Physical sciences↗
DOE OSTI2022

UAS remote sensing (DJI Phantom 4 RTK platform): RGB orthomosaic, digital surface and canopy height models, plant functional type map, Seward Peninsula, Alaska, 2019

Airborne remote sensing data collected using a DJI Phantom 4 RTK unoccupied aerial system (UAS) ? operated by the University of Maine Wheatland Geospatial Lab (https://wheatlandlab.org/). This package includes data from 17 flights flown over the NGEE-Arctic Council, Kougarok, Kougarok Mile80, Teller, and Teller Mile32 sites in July 2019. The Phantom 4 RTK is a drone platform that collects very high spatial resolution optical red/green/blue (RGB) imagery. Derived image products include point cloud, ortho-mosaiced RGB, a digital surface model (DSM) using the structure from motion (SfM) technique, and a canopy height model (CHM). Unprocessed and processed data products (1,000+ files) are included in this package (processing levels 0-3). Data and metadata are provided as text (*.txt, *.json, *hdr,), ENVI image file (*.dat), point cloud (*.laz) and image (*.jpg, *.tif, *png) formats. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

UAS remote sensing (3DR SOLO platform): multispectral reflectance, canopy height model, normalized difference vegetation index, Seward Peninsula, Alaska, 2021

Airborne remote sensing data collected using a Parrot Sequoia+ multispectral sensor installed on a 3DR SOLO unoccupied aerial system (UAS) - operated by the Terrestrial Ecosystem Science Technology group at Brookhaven National Laboratory. This package includes data from 10 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71, Kougarok MM64, and Teller MM27 sites on the Seward Peninsula, Alaska, in August 2021. Derived image products include point cloud, ortho-mosaiced multispectral image, ortho-mosaiced RGB image, a digital surface model (DSM) using the structure from motion (SfM) technique, a canopy height model (CHM), and a normalized difference vegetation index (NDVI) map. Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.txt, *.json, *hdr,), tabular (*.dat, *.csv), point cloud (*.laz), Cloud Optimized GeoTIFF (COG, *.tif), and image (*.jpg, *.tif, *png) formats. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1969

Fluorescent photography of spray droplets using a laser light source

Monochromatic laser emission transformed by a fluorescent process into droplet emission over a wavelength band provides high light intensities for obtaining adequate time resolution to stop droplet motion in photographic spray studies. Experiments showed that the Q-switched laser-optical harmonic generator combination produced sharp, well-exposed droplet images.

Groeneweg, J.↗