Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Evolutionary Computing Methods for Spectral Retrieval

A methodology for processing spectral images to retrieve information on underlying physical, chemical, and/or biological phenomena is based on evolutionary and related computational methods implemented in software. In a typical case, the solution (the information that one seeks to retrieve) consists of parameters of a mathematical model that represents one or more of the phenomena of interest. The methodology was developed for the initial purpose of retrieving the desired information from spectral image data acquired by remote-sensing instruments aimed at planets (including the Earth). Examples of information desired in such applications include trace gas concentrations, temperature profiles, surface types, day/night fractions, cloud/aerosol fractions, seasons, and viewing angles. The methodology is also potentially useful for retrieving information on chemical and/or biological hazards in terrestrial settings. In this methodology, one utilizes an iterative process that minimizes a fitness function indicative of the degree of dissimilarity between observed and synthetic spectral and angular data. The evolutionary computing methods that lie at the heart of this process yield a population of solutions (sets of the desired parameters) within an accuracy represented by a fitness-function value specified by the user. The evolutionary computing methods (ECM) used in this methodology are Genetic Algorithms and Simulated Annealing, both of which are well-established optimization techniques and have also been described in previous NASA Tech Briefs articles. These are embedded in a conceptual framework, represented in the architecture of the implementing software, that enables automatic retrieval of spectral and angular data and analysis of the retrieved solutions for uniqueness.

Terrile, Richard↗
NASA NTRS2003

Genetic Algorithm Phase Retrieval for the Systematic Image-Based Optical Alignment Testbed

Phase retrieval requires calculation of the real-valued phase of the pupil fimction from the image intensity distribution and characteristics of an optical system. Genetic 'algorithms were used to solve two one-dimensional phase retrieval problem. A GA successfully estimated the coefficients of a polynomial expansion of the phase when the number of coefficients was correctly specified. A GA also successfully estimated the multiple p h e s of a segmented optical system analogous to the seven-mirror Systematic Image-Based Optical Alignment (SIBOA) testbed located at NASA s Marshall Space Flight Center. The SIBOA testbed was developed to investigate phase retrieval techniques. Tiphilt and piston motions of the mirrors accomplish phase corrections. A constant phase over each mirror can be achieved by an independent tip/tilt correction: the phase Conection term can then be factored out of the Discrete Fourier Tranform (DFT), greatly reducing computations.

Taylor, Jaime↗
DOE OSTI2024

Atomic resolution coherent x-ray imaging with physics-based phase retrieval

Coherent x-ray imaging and scattering from accelerator based sources such as synchrotrons continue to impact biology, medicine, technology, and materials science. Many synchrotrons around the world are currently undergoing major upgrades to increase their available coherent x-ray flux by approximately two orders of magnitude. The improvement of synchrotrons may enable imaging of materials in operando at the atomic scale which may revolutionize battery and catalysis technologies. Current algorithms used for phase retrieval in coherent x-ray imaging are based on the projection onto sets method. These traditional iterative phase retrieval methods will become more computationally expensive as they push towards atomic resolution and may struggle to converge. Additionally, these methods do not incorporate physical information that may additionally constrain the solution. In this work, we present an algorithm which incorporates molecular dynamics into Bragg coherent diffraction imaging (BCDI). This algorithm, which we call PRAMMol (Phase Retrieval with Atomic Modeling and Molecular Dynamics) combines statistical techniques with molecular dynamics to solve the phase retrieval problem. We present several examples where our algorithm is applied to simulated coherent diffraction from 3D crystals and show convergence to the correct solution at the atomic scale.

47 OTHER INSTRUMENTATION↗
NASA NTRSDate not supplied

A 3-Channel Algorithm for Retrieving Spatially and Temporally Continuous Cloud Properties Across Different Geostationary Satellite Imagers

Cloud property retrieval algorithms for passive satellite imagers are generally designed to take advantage of all the useful spectral information available for a particular satellite. This strategy optimizes accuracy and reduces misidentification and retrieval biases, particularly for modern satellites with many spectral channels. However, the application of dissimilar algorithms tailored for different satellite sensor scan present a problem within the climate data record (CDR). Algorithm inconsistencies can introduce artificial trends in the CDR that are tied to instrument changes rather than physical changes, especially when older satellites with limited spectral information are included. The NASA CERES (Clouds and the Earth’s Radiant Energy System) data record provides global cloud property retrievals across 23 years and more than 25 satellites. With the goal of producing a spatially and temporally continuous record of cloud properties, the CERES cloud working group has developed algorithms that use only 3 channels that are common to most geostationary satellite imagers: 0.65, 3.9, and 10.8 μm.

Sarah Bedka↗
DOE OSTI2021

Two-dimensional retrieval methods for ultrafast imaging of molecular structure using laser-induced electron diffraction

Molecular structural retrieval based on electron diffraction has been proposed to determine the atomic positions of molecules with sub-angstrom spatial and femtosecond temporal resolutions. Given its success on small molecular systems, in this work, we point out that the accuracy of structure retrieval is constrained by the availability of a wide range of experimental data in the momentum space in all molecular systems. To mitigate the limitations, for laser-induced electron diffraction, here we retrieve molecular structures using two-dimensional (energy and angle) electron momentum spectra in the laboratory frame for a number of small molecular systems, which have previously been studied with 1D methods. Compared to the conventional single-energy or single-angle analysis, our 2D methods effectively expand the momentum range of the measured data. Besides utilization of the 2D data, two complementary methods are developed for consistency check on the retrieved results. Further, the 2D nature of our methods also offers a way of estimating the error from retrieval, which has never been explored before. Comparing with results from prior experiments, our findings show evidence that our 2D methods outperform the conventional 1D methods. Paving the way to the retrieval of large molecular systems, in which their tunneling ionization rates are challenging to obtain, we estimate the error of using the isotropic model in place of including the orientation-dependent ionization rate.

74 ATOMIC AND MOLECULAR PHYSICS↗
NASA NTRS2013

Space Images for NASA JPL Android Version

This software addresses the demand for easily accessible NASA JPL images and videos by providing a user friendly and simple graphical user interface that can be run via the Android platform from any location where Internet connection is available. This app is complementary to the iPhone version of the application. A backend infrastructure stores, tracks, and retrieves space images from the JPL Photojournal and Institutional Communications Web server, and catalogs the information into a streamlined rating infrastructure. This system consists of four distinguishing components: image repository, database, server-side logic, and Android mobile application. The image repository contains images from various JPL flight projects. The database stores the image information as well as the user rating. The server-side logic retrieves the image information from the database and categorizes each image for display. The Android mobile application is an interfacing delivery system that retrieves the image information from the server for each Android mobile device user. Also created is a reporting and tracking system for charting and monitoring usage. Unlike other Android mobile image applications, this system uses the latest emerging technologies to produce image listings based directly on user input. This allows for countless combinations of images returned. The backend infrastructure uses industry-standard coding and database methods, enabling future software improvement and technology updates. The flexibility of the system design framework permits multiple levels of display possibilities and provides integration capabilities. Unique features of the software include image/video retrieval from a selected set of categories, image Web links that can be shared among e-mail users, sharing to Facebook/Twitter, marking as user's favorites, and image metadata searchable for instant results.

Nelson, Jon D.↗
NASA NTRS2018

Hurricane Imaging Radiometer (HIRAD) Wind Speed Retrievals and Assessment Using Dropsondes

The Hurricane Imaging Radiometer (HIRAD) is an experimental C-band passive microwave radiometer designed to map the horizontal structure of surface wind speed fields in hurricanes. New data processing and customized retrieval approaches were developed after the 2015 Tropical Cyclone Intensity (TCI) experiment, which featured flights over Hurricanes Patricia, Joaquin, Marty, and the remnants of Tropical Storm Erika. These new approaches produced maps of surface wind speed that looked more realistic than those from previous campaigns. Dropsondes from the High Definition Sounding System (HDSS) that was flown with HIRAD on a WB-57 high altitude aircraft in TCI were used to assess the quality of the HIRAD wind speed retrievals. The root mean square difference between HIRAD-retrieved surface wind speeds and dropsonde-estimated surface wind speeds was 6.0 meters per second. The largest differences between HIRAD and dropsonde winds were from data points where storm motion during dropsonde descent compromised the validity of the comparisons. Accounting for this and for uncertainty in the dropsonde measurements themselves, we estimate the root mean square error for the HIRAD retrievals as around 4.7 meters per second. Prior to the 2015 TCI experiment, HIRAD had previously flown on the WB-57 for missions across Hurricanes Gonzalo (2014), Earl (2010), and Karl (2010). Configuration of the instrument was not identical to the 2015 flights, but the methods devised after the 2015 flights may be applied to that previous data in an attempt to improve retrievals from those cases.

wind retrieval↗
NASA NTRS2001

Inter-Comparison of GOES-8 Imager and Sounder Skin Temperature Retrievals

Skin temperature (ST) retrievals derived from geostationary satellite observations have both high temporal and spatial resolutions and are therefore useful for applications such as assimilation into mesoscale forecast models, nowcasting, and diagnostic studies. Our retrieval method uses a Physical Split Window technique requiring at least two channels within the longwave infrared window. On current GOES satellites, including GOES-11, there are two Imager channels within the required spectral interval. However, beginning with the GOES-M satellite the 12-um channel will be removed, leaving only one longwave channel. The Sounder instrument will continue to have three channels within the longwave window, and therefore ST retrievals will be derived from Sounder measurements. This research compares retrievals from the two instruments and evaluates the effects of the spatial resolution and sensor calibration differences on the retrievals. Both Imager and Sounder retrievals are compared to ground-truth data to evaluate the overall accuracy of the technique. An analysis of GOES-8 and GOES-11 intercomparisons is also presented.

Haines, Stephanie L.↗
DOE OSTI2022

AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

Abstract The problem of phase retrieval underlies various imaging methods from astronomy to nanoscale imaging. Traditional phase retrieval methods are iterative and are therefore computationally expensive. Deep learning (DL) models have been developed to either provide learned priors or completely replace phase retrieval. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on experimental datasets. Using 3D X-ray Bragg coherent diffraction imaging (BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the imaging physics into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data in a single shot without ever being shown real space images. Once trained, AutoPhaseNN can be effectively used in the 3D BCDI data inversion about 100× faster than iterative phase retrieval methods while providing comparable image quality.

36 MATERIALS SCIENCE↗
NASA NTRS2003

Optical Depth Retrievals from HRSC Stereo Images

Mars Express is due to arrive in orbit around Mars during the last days of 2003. A primary task of its mission is to map Mars in stereo with the High Resolution Stereo Camera (HRSC) at a spatial resolution of up to 12 m. The Martian atmosphere contains large amounts of dust and other aerosols that scatter light and influence the images. Therefore, image analysis requires careful consideration of these atmospheric effects. An essential parameter to consider is the optical depth. It will be possible to map the optical depth of the Martian atmosphere from HRSC stereo images by analyzing contrast differences. Software to this purpose has been developed at the Max-Planck Institute for Aeronomy in Lindau Germany. We present examples of optical depth-retrievals from airborne HRSC-A images of a region in the French Alps.

N M Hoekzema↗
NASA NTRS2018

Compact Mid-Wave Imaging System (CMIS) for Retrieval of Cloud Motion Vectors and Cloud Geometric Heights

The Johns Hopkins University Applied Physics Laboratory (JHU/APL) is developing a compact, light-weight, and low power midwave-infrared (MWIR) imager called the Compact Midwave Imaging Sensor (CMIS), under the support of the NASA Earth Science Technology Office Instrument Incubator Program. The goal of this CMIS instrument development and demonstration project is to increase the technical readiness of CMIS, a multi-spectral sensor capable of retrieving 3D winds and cloud heights 24/7, for a space mission. The CMIS instrument employs an advanced MWIR detector that requires less cooling than traditional technologies and thus permits a compact, low-power design, which enables accommodation on small spacecraft such as CubeSats. CMIS provides the critical midwave component of a multi-spectral sensor suite that includes a high-resolution Day-Night Band and a longwave infrared (LWIR) imager to provide global cloud characterization and theater weather imagery. In this presentation, an overview of the CMIS project, including the high-level sensor design, the concept of operations, and measurement capability will be presented. System performance for a variety of different scenes generated by a cloud resolving model (CRM) will also be discussed.

midwave↗
NASA NTRS1988

VICAR/IBIS Software System

Collection of programs provides extensive capabilities for manipulation of imagery and geographical data. VICAR/IBIS software system is combination of JPL VICAR (Video Image Communications and Retrieval System) image-processing system and JPL IBIS (Image Based Information System) geographic-information-management system. Provides user with extensive general-purpose image-processing capabilities, also information-management system for accepting, converting, and operating on vector (graphical) and tabular data. System used to perform various image processing functions on any sort of digitized image data, including such remotely sensed data as those from Landsat multispectral scanner.

Stanfill, Daniel F., IV↗
NASA NTRS2003

Java Library for Input and Output of Image Data and Metadata

A Java-language library supports input and output (I/O) of image data and metadata (label data) in the format of the Video Image Communication and Retrieval (VICAR) image-processing software and in several similar formats, including a subset of the Planetary Data System (PDS) image file format. The library does the following: It provides low-level, direct access layer, enabling an application subprogram to read and write specific image files, lines, or pixels, and manipulate metadata directly. Two coding/decoding subprograms ("codecs" for short) based on the Java Advanced Imaging (JAI) software provide access to VICAR and PDS images in a file-format-independent manner. The VICAR and PDS codecs enable any program that conforms to the specification of the JAI codec to use VICAR or PDS images automatically, without specific knowledge of the VICAR or PDS format. The library also includes Image I/O plugin subprograms for VICAR and PDS formats. Application programs that conform to the Image I/O specification of Java version 1.4 can utilize any image format for which such a plug-in subprogram exists, without specific knowledge of the format itself. Like the aforementioned codecs, the VICAR and PDS Image I/O plug-in subprograms support reading and writing of metadata.

Deen, Robert↗
NASA NTRSDate not supplied

The Radiometric Scaling of the MODIS and VIIRS Imagers to a Common Reference and Stability Analysis for the Next Edition of CERES Products

The NASA CERES project has provided the climate quality observed TOA and computed surface fluxes to the scientific community. CERES uses MODIS and VIIRS imagers to retrieve cloud properties needed to convert Terra, Aqua, NPP, and NOAA-20 CERES footprint radiance observations into fluxes. The imagers are also used to radiometrically scale the geostationary sensors (GEO) radiances to the imager calibration reference to ensure that the GEO derived cloud properties and broadband TOA fluxes are consistent in both space and time. Both the imager and GEO retrieved cloud properties are used to compute the surface fluxes. The CERES imager and GEO calibration team uses ray-matched radiance pairs to radiometrically scale the SNPP and NOAA-20 VIIRS sensors to the Aqua-MODIS calibration reference. The radiometric scaling is further validated using geostationary imagers as transfer radiometers. The team will rely primarily on deep convective clouds to monitor the imager channel calibration stability and to correct for short term calibration drifts. The DSCOVR satellite was launched on February 25, 2015 and orbits around the L1 Lagrange point directly between the Earth and the sun. The EPIC sensor contains no onboard calibration systems. However, multiple inter-calibration studies have shown that the EPIC imager is very stable in time. The excellent radiometric stability of EPIC allows the use of EPIC observations as a stable reference to validate both the short term drift corrections of the imagers, as well as to validate the radiometric scaling factors between them. Examples of the imager relative calibration using EPIC before and after radiometric scaling will be shown along with the results from the use of invariant targets to remove imager calibration drifts.

DSCOVR-EPIC↗
NASA NTRS2020

Uncertainties in CERES Top-of-Atmosphere Fluxes Caused by Changes in Accompanying Imager

The Clouds and the Earth’s Radiant Energy System (CERES) project provides observations of Earth’s radiation budget using measurements from CERES instruments on board the Terra, Aqua, Suomi National Polar-orbiting Partnership (S-NPP), and NOAA-20 satellites. The CERES top-of-atmosphere (TOA) fluxes are produced by converting radiance measurements using empirical angular distribution models, which are functions of cloud properties that are retrieved from imagers flying with the CERES instruments. As the objective is to create a long-term climate data record, not only calibration consistency of the six CERES instruments needs to be maintained for the entire time period, it is also important to maintain the consistency of other input data sets used to produce this climate data record. In this paper, we address aspects that could potentially affect the CERES TOA flux data quality. Discontinuities in imager calibration can affect cloud retrieval which can lead to erroneous flux trends. When imposing an artificial 0.6 per decade decreasing trend to cloud optical depth, which is similar to the trend difference between CERES Edition 2 and Edition 4 cloud retrievals, the decadal SW flux trend changed from −0.3 5 ± 0.18 Wm −2 to 0.61 ± 0.18 Wm −2 . This indicates that a 13% change in cloud optical depth results in about 1% change in the SW flux. Furthermore, different CERES instruments provide valid fluxes at different viewing zenith angle ranges, and including fluxes derived at the most oblique angels unique to S-NPP (>66 ∘ ) can lead to differences of 0.8 Wm −2 and 0.3 Wm −2 in global monthly mean instantaneous SW flux and LW flux. To ensure continuity, the viewing zenith angle ranges common to all CERES instruments (<66 ∘ ) are used to produce the long-term Earth’s radiation budget climate data record. The consistency of cloud properties retrieved from different imagers also needs to be maintained to ensure the TOA flux consistency.

Wenying Su↗
NASA NTRS2016

Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties

Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.

spectroscopy↗
DOE OSTI2026

Generative modeling enables molecular structure retrieval from Coulomb explosion imaging

Capturing the structural changes that molecules undergo during chemical reactions in real space and time is a long-standing dream and an essential prerequisite for understanding and ultimately controlling femtochemistry. A key approach to tackle this challenging task is Coulomb explosion imaging, which benefited decisively from recently emerging high-repetition-rate X-ray free-electron laser sources. With this technique, information on the molecular structure is inferred from the momentum distributions of the ions produced by the rapid Coulomb explosion of molecules. Retrieving molecular structures from these distributions poses a highly non-linear inverse problem that remains unsolved for molecules consisting of more than a few atoms. Here, we address this challenge using a diffusion-based Transformer neural network. We show that the network reconstructs unknown molecular geometries from ion-momentum distributions with a mean absolute error below one Bohr radius, which is half the length of a typical chemical bond.

Artificial Intelligence (cs.AI)↗
NASA NTRS2004

Hexagonal Pixels and Indexing Scheme for Binary Images

A scheme for resampling binaryimage data from a rectangular grid to a regular hexagonal grid and an associated tree-structured pixel-indexing scheme keyed to the level of resolution have been devised. This scheme could be utilized in conjunction with appropriate image-data-processing algorithms to enable automated retrieval and/or recognition of images. For some purposes, this scheme is superior to a prior scheme that relies on rectangular pixels: one example of such a purpose is recognition of fingerprints, which can be approximated more closely by use of line segments along hexagonal axes than by line segments along rectangular axes. This scheme could also be combined with algorithms for query-image-based retrieval of images via the Internet. A binary image on a rectangular grid is generated by raster scanning or by sampling on a stationary grid of rectangular pixels. In either case, each pixel (each cell in the rectangular grid) is denoted as either bright or dark, depending on whether the light level in the pixel is above or below a prescribed threshold. The binary data on such an image are stored in a matrix form that lends itself readily to searches of line segments aligned with either or both of the perpendicular coordinate axes. The first step in resampling onto a regular hexagonal grid is to make the resolution of the hexagonal grid fine enough to capture all the binaryimage detail from the rectangular grid. In practice, this amounts to choosing a hexagonal-cell width equal to or less than a third of the rectangular- cell width. Once the data have been resampled onto the hexagonal grid, the image can readily be checked for line segments aligned with the hexagonal coordinate axes, which typically lie at angles of 30deg, 90deg, and 150deg with respect to say, the horizontal rectangular coordinate axis. Optionally, one can then rotate the rectangular image by 90deg, then again sample onto the hexagonal grid and check for line segments at angles of 0deg, 60deg, and 120deg to the original horizontal coordinate axis. The net result is that one has checked for line segments at angular intervals of 30deg. For even finer angular resolution, one could, for example, then rotate the rectangular-grid image +/-45deg before sampling to perform checking for line segments at angular intervals of 15deg.

Johnson, Gordon G.↗