Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Model-based VQ for image data archival, retrieval and distribution

An ideal image compression technique for image data archival, retrieval and distribution would be one with the asymmetrical computational requirements of Vector Quantization (VQ), but without the complications arising from VQ codebooks. Codebook generation and maintenance are stumbling blocks which have limited the use of VQ as a practical image compression algorithm. Model-based VQ (MVQ), a variant of VQ described here, has the computational properties of VQ but does not require explicit codebooks. The codebooks are internally generated using mean removed error and Human Visual System (HVS) models. The error model assumed is the Laplacian distribution with mean, lambda-computed from a sample of the input image. A Laplacian distribution with mean, lambda, is generated with uniform random number generator. These random numbers are grouped into vectors. These vectors are further conditioned to make them perceptually meaningful by filtering the DCT coefficients from each vector. The DCT coefficients are filtered by multiplying by a weight matrix that is found to be optimal for human perception. The inverse DCT is performed to produce the conditioned vectors for the codebook. The only image dependent parameter used in the generation of codebook is the mean, lambda, that is included in the coded file to repeat the codebook generation process for decoding.

Manohar, Mareboyana↗

Thermospheric O/N2 Based on DE-1 FUV Dayglow Imaging Data

Work performed during the second half of Year 1 of the contract is summarized. The primary objective of the work is to derive global dayside thermospheric oxygen concentrations from DE-1 far ultraviolet imaging data which we are considering under both magnetically quiet and disturbed times. Work to date has been more qualitative in producing maps showing intensity variations beyond those that can be explained by changes in solar zenith angle (SZA) and look angle across an image (Craven et al., 1995; Meier et al., 1994; Gladstone, 1994). In meeting our primary objective, four tasks have been addressed during the reporting period: (1) Investigating the uniqueness of the relationship between the dayglow emission seen using DE-1's 123 filter (dominated by OI 130.4 nm emission) and the column abundance of O relative to N2 referenced to an N2 depth of 10(exp 17) cm(exp 2); (2) Completion of the algorithm for rapid conversion of DE-1 disk dayglow measurements to O/N2 values; (3) Applying the algorithm to a simulation in which a model DE image was constructed using TIGCM atmospheres. The retrieved image of O/N2 was compared to TIGCM O/N2 obtained by integrations of the TIGCM densities; and (4) Applying the algorithm to selected DE-1 data.

Strickland, Douglas J.↗

Broadband Phase Retrieval for Image-Based Wavefront Sensing

A focus-diverse phase-retrieval algorithm has been shown to perform adequately for the purpose of image-based wavefront sensing when (1) broadband light (typically spanning the visible spectrum) is used in forming the images by use of an optical system under test and (2) the assumption of monochromaticity is applied to the broadband image data. Heretofore, it had been assumed that in order to obtain adequate performance, it is necessary to use narrowband or monochromatic light. Some background information, including definitions of terms and a brief description of pertinent aspects of image-based phase retrieval, is prerequisite to a meaningful summary of the present development. Phase retrieval is a general term used in optics to denote estimation of optical imperfections or aberrations of an optical system under test. The term image-based wavefront sensing refers to a general class of algorithms that recover optical phase information, and phase-retrieval algorithms constitute a subset of this class. In phase retrieval, one utilizes the measured response of the optical system under test to produce a phase estimate. The optical response of the system is defined as the image of a point-source object, which could be a star or a laboratory point source. The phase-retrieval problem is characterized as image-based in the sense that a charge-coupled-device camera, preferably of scientific imaging quality, is used to collect image data where the optical system would normally form an image. In a variant of phase retrieval, denoted phase-diverse phase retrieval [which can include focus-diverse phase retrieval (in which various defocus planes are used)], an additional known aberration (or an equivalent diversity function) is superimposed as an aid in estimating unknown aberrations by use of an image-based wavefront-sensing algorithm. Image-based phase-retrieval differs from such other wavefront-sensing methods, such as interferometry, shearing interferometry, curvature wavefront sensing, and Shack-Hartmann sensing, all of which entail disadvantages in comparison with image-based methods. The main disadvantages of these non-image based methods are complexity of test equipment and the need for a wavefront reference.

Dean, Bruce H.↗

Image understanding and interpretation in microwave diversity imaging

The authors investigate microwave imaging of metallic objects using a diversity method and interpret and predict the reconstructed image from an approach based on analysis of the scattering mechanism and a back-projection algorithm used in image retrieval. The connection between the various scattering mechanisms and the reconstructed images is discussed, what the images represent is interpreted, and a prediction is made as to what the image will look like over given spectral and angular windows. A brief description is given of the microwave diversity imaging system and the formulation of the microwave diversity imaging based on the physical optics approximation. The scattering mechanism of a complex shaped metallic object is then briefly reviewed and an alternate approach to interpreting the reconstructed image based on the understanding of the scattering mechanism and the reconstruction algorithm is given. Several numerical and experimental examples are included to support this interpretation approach.

Li, Hsueh-Jyh↗

Image Search for Scientific Data (camBIR) v1.0

camBIR is the CAMERA based image retrieval, a software that takes several different kinds of imagery, such as 2 dimensional images, both scientific as well as non scientific. camBIR is specially designed for training different kinds of Deep Convolutional Neural Network, including new Deep Learning architectures, such as ResNet, Inception-ResNet, NasNet, DenseNet…. It can be used to automate the classification, sort and rank of X-ray imagery such as microCT, GISAXS, GIWAXS, SAXS and WAXS.

Ushizima, Daniela↗

Detecting Thin Cirrus in Multiangle Imaging Spectroradiometer Aerosol Retrievals

Thin cirrus clouds (optical depth (OD) < 03) are often undetected by standard cloud masking in satellite aerosol retrieval algorithms. However, the Mu]tiangle Imaging Spectroradiometer (MISR) aerosol retrieval has the potential to discriminate between the scattering phase functions of cirrus and aerosols, thus separating these components. Theoretical tests show that MISR is sensitive to cirrus OD within Max{0.05 1 20%l, similar to MISR's sensitivity to aerosol OD, and MISR can distinguish between small and large crystals, even at low latitudes, where the range of scattering angles observed by MISR is smallest. Including just two cirrus components in the aerosol retrieval algorithm would capture typical MISR sensitivity to the natural range of cinus properties; in situations where cirrus is present but the retrieval comparison space lacks these components, the retrieval tends to underestimate OD. Generally, MISR can also distinguish between cirrus and common aerosol types when the proper cirrus and aerosol optical models are included in the retrieval comparison space and total column OD is >-0.2. However, in some cases, especially at low latitudes, cirrus can be mistaken for some combinations of dust and large nonabsorbing spherical aerosols, raising a caution about retrievals in dusty marine regions when cirrus is present. Comparisons of MISR with lidar and Aerosol Robotic Network show good agreement in a majority of the cases, but situations where cirrus clouds have optical depths >0.15 and are horizontally inhomogeneous on spatial scales shorter than 50 km pose difficulties for cirrus retrieval using the MISR standard aerosol algorithm..

Pierce, Jeffrey R.↗

Managing an Archive of Images

The SSC Multimedia Archive is an automated electronic system to manage images, acquired both by film and digital cameras, for the Public Affairs Office (PAO) at Stennis Space Center (SSC). Previously, the image archive was based on film photography and utilized a manual system that, by today s standards, had become inefficient and expensive. Now, the SSC Multimedia Archive, based on a server at SSC, contains both catalogs and images for pictures taken both digitally and with a traditional, film-based camera, along with metadata about each image. After a "shoot," a photographer downloads the images into the database. Members of the PAO can use a Web-based application to search, view and retrieve images, approve images for publication, and view and edit metadata associated with the images. Approved images are archived and cross-referenced with appropriate descriptions and information. Security is provided by allowing administrators to explicitly grant access privileges to personnel to only access components of the system that they need to (i.e., allow only photographers to upload images, only PAO designated employees may approve images).

Andres, Vince↗

Backup Optical Navigation Attitude for Artemis-1 Backup Attitude Ground Tool

The Backup Optical Navigation Attitude (BONA) software was developed as a response to the Artemis1 Power Distribution Unit (PDU) hardware problems found early in 2021. The hardware problem, a capacitor installed incorrectly, removes the intended redundant path for which the PDU can relay its power and data to attached devices. Specific to the BONA context, the concern is that a failure of the single remaining path in this PDU would lead to an inability to communicate with one of the two-star trackers (STs) on Orion. By flight rule, being reduced to a single star tracker means an immediate turn around end-of-mission. The BONA software is not intended to extend the mission, but instead act as a single star tracker attitude confirmation tool. Insurance, if you will, for the Orion project that a ground tool is available to compare the single remaining ST results with optical navigation images retrieved during the mission. Engineers operating BONA in the Mission Control Center (MCC) Mission Evaluation Room (MER) will analyze the downlinked star field images and based on the stars identified and known time of image, derive vehicle attitude estimates, which can be compared with the ST results. Potentially, in extreme situations, and with expert recommendation, the derivations could lead to navigation state updates being commanded to Orion.

GNC↗

Diagnosing Aircraft Icing Potential from Satellite Cloud Retrievals

The threat for aircraft icing in clouds is a significant hazard that routinely impacts aviation operations. Accurate diagnoses and forecasts of aircraft icing conditions requires identifying the location and vertical distribution of clouds with super-cooled liquid water (SLW) droplets, as well as the characteristics of the droplet size distribution. Traditional forecasting methods rely on guidance from numerical models and conventional observations, neither of which currently resolve cloud properties adequately on the optimal scales needed for aviation. Satellite imagers provide measurements over large areas with high spatial resolution that can be interpreted to identify the locations and characteristics of clouds, including features associated with adverse weather and storms. This paper describes new techniques for interpreting cloud products derived from satellite data to infer the flight icing threat to aircraft. For unobscured low clouds, the icing threat is determined using empirical relationships developed from correlations between satellite imager retrievals of liquid water path and droplet size with icing conditions reported by pilots (PIREPS). For deep ice over water cloud systems, ice and liquid water content (IWC and LWC) profiles are derived by using the imager cloud properties to constrain climatological information on cloud vertical structure and water phase obtained apriori from radar and lidar observations, and from cloud model analyses. Retrievals of the SLW content embedded within overlapping clouds are mapped to the icing threat using guidance from an airfoil modeling study. Compared to PIREPS and ground-based icing remote sensing datasets, the satellite icing detection and intensity accuracies are approximately 90% and 70%, respectively, and found to be similar for both low level and deep ice over water cloud systems. The satellite-derived icing boundaries capture the reported altitudes over 90% of the time. Satellite analyses corresponding to the time and location of several recent aviation accidents and with icing PIREPS are also presented that reveal skill in identifying severe icing conditions. These results demonstrate the utility of satellite cloud retrievals for quantitatively diagnosing the potential for icing conditions on temporal and spatial scales that should be useful to the aviation community. Plans are being developed to deliver these new satellite products to the GOES-R Proving Ground in the near future so that they can be evaluated in operational applications.

Smith, William L., Jr.↗

Short Time Scale Stability Monitoring of GOES-16 Visible Channels by Utilizing Daily Inter-Calibration Events with both VIIRS and MODIS Sensors

The CERES project relies on MODIS, VIIRS and geostationary (GEO) imager retrieved cloud properties to compute surface fluxes and convert CERES and GEO radiances into TOA fluxes. The CERES TOA and surface fluxes need to be of climate quality and any anomaly or discontinuity in the calibration of the MODIS, VIIRS, GEO radiances need to be mitigated or avoided. Due to the nature of the CERES instrument calibration, there is a lag time of 3 months before the processing of the CERES product. This allows the CERES team to investigate any unforeseen problems in the input datasets or GEO calibration discontinuities or anomalies before processing. The CERES geostationary imager calibration team is developing a daily monitoring system of GEO, MODIS and VIIRS visible channel radiances in order to detect any day to day discontinuities as part of the CERES/GEO coincident ray-matching calibration efforts. a GEO discontinuity can be detected using two MODIS and 2 VIIRS sensors simultaneously, thus increasing the sampling greatly over a single GEO/LEO radiance pairs. This method is being automated and has already detected three erroneous radiometric calibration events, which were verified with the GOES-16 event log page. One advantage of daily monitoring is that the time period needed to verify calibration drifts is reduced and the confidence to detect even smaller magnitudes of the calibration drift is increased over monthly monitoring. By utilizing Terra and Aqua MODIS and NPP and NOAA20 VIIRS imagers to inter-calibrate GOES-16, the GOES-16 calibration can be referenced to anyone of these imagers. If the CERES project transitions between the Aqua-MODIS imager to the NOAA20 VIIRS imager, the NOAA-20 VIIRS imager can be radiometrically scale to Aqua-MODIS calibration, thus avoiding a GOES-16 calibration discontinuity.

David Robert Doelling↗

Distribution to the Astronomy Community of the Compressed Digitized Sky Survey

The Space Telescope Science Institute has compressed an all-sky collection of ground-based images and has printed the data on a two volume, 102 CD-ROM disc set. The first part of the survey (containing images of the southern sky) was published in May 1994. The second volume (containing images of the northern sky) was published in January 1995. Software which manages the image retrieval is included with each volume. The Astronomical Society of the Pacific (ASP) is handling the distribution of the lOx compressed data and has sold 310 sets as of October 1996. ASP is also handling the distribution of the recently published 100x version of the northern sky survey which is publicly available at a low cost. The target markets for the 100x compressed data set are the amateur astronomy community, educational institutions, and the general public. During the next year, we plan to publish the first version of a photometric calibration database which will allow users of the compressed sky survey to determine the brightness of stars in the images.

Postman, Marc↗

Content-based retrieval of remote sensed images using a feature-based approach

A feature-based representation model for content-based retrieval from a remote sensed image database is described in this work. The representation is formed by clustering spatially local pixels, and the cluster features are used to process several types of queries which are expected to occur frequently in the context of remote sensed image retrieval. Preliminary experimental results show that the feature-based representation provides a very promising tool for content-based access.

Vellaikal, Asha↗

A Portable Ground-Based Atmospheric Monitoring System (PGAMS) for the Calibration and Validation of Atmospheric Correction Algorithms Applied to Aircraft and Satellite Images

Detecting changes in the Earth's environment using satellite images of ocean and land surfaces must take into account atmospheric effects. As a result, major programs are underway to develop algorithms for image retrieval of atmospheric aerosol properties and atmospheric correction. However, because of the temporal and spatial variability of atmospheric transmittance it is very difficult to model atmospheric effects and implement models in an operational mode. For this reason, simultaneous in situ ground measurements of atmospheric optical properties are vital to the development of accurate atmospheric correction techniques. Presented in this paper is a spectroradiometer system that provides an optimized set of surface measurements for the calibration and validation of atmospheric correction algorithms. The Portable Ground-based Atmospheric Monitoring System (PGAMS) obtains a comprehensive series of in situ irradiance, radiance, and reflectance measurements for the calibration of atmospheric correction algorithms applied to multispectral. and hyperspectral images. The observations include: total downwelling irradiance, diffuse sky irradiance, direct solar irradiance, path radiance in the direction of the north celestial pole, path radiance in the direction of the overflying satellite, almucantar scans of path radiance, full sky radiance maps, and surface reflectance. Each of these parameters are recorded over a wavelength range from 350 to 1050 nm in 512 channels. The system is fast, with the potential to acquire the complete set of observations in only 8 to 10 minutes depending on the selected spatial resolution of the sky path radiance measurements

Schiller, Stephen↗

Expert evaluation of LLM world models: A high-T c superconductivity case study

Large Language Models (LLMs) show great promise as a powerful tool for scientific literature exploration. However, their effectiveness in providing scientifically accurate and comprehensive answers to complex questions within specialized domains remains an active area of research. Using the field of high-temperature cuprates as an exemplar, we evaluate the ability of LLM systems to understand the literature at the level of an expert. We construct an expert-curated database of 1,726 scientific papers that covers the history of the field, and a set of 67 expert-formulated questions that probe deep understanding of the literature. We then evaluate six different LLM-based systems for answering these questions, including both commercially available closed models and a custom retrieval-augmented generation (RAG) system capable of retrieving images alongside text. Experts then evaluate the answers of these systems against a rubric that assesses balanced perspectives, factual comprehensiveness, succinctness, and evidentiary support. Among the six systems, two using RAG on curated literature outperformed existing closed models across key metrics, particularly in providing comprehensive and well-supported answers. We discuss promising aspects of LLM performances as well as critical short-comings of all the models. The set of expert-formulated questions and the rubric will be valuable for assessing expert level performance of LLM based reasoning systems.

36 MATERIALS SCIENCE↗

DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

Abstract Recent advances in computer vision (CV) and natural language processing have been driven by exploiting big data on practical applications. However, these research fields are still limited by the sheer volume, versatility, and diversity of the available datasets. CV tasks, such as image captioning, which has primarily been carried out on natural images, still struggle to produce accurate and meaningful captions on sketched images often included in scientific and technical documents. The advancement of other tasks such as 3D reconstruction from 2D images requires larger datasets with multiple viewpoints. We introduce DeepPatent2, a large-scale dataset, providing more than 2.7 million technical drawings with 132,890 object names and 22,394 viewpoints extracted from 14 years of US design patent documents. We demonstrate the usefulness of DeepPatent2 with conceptual captioning. We further provide the potential usefulness of our dataset to facilitate other research areas such as 3D image reconstruction and image retrieval.

97 MATHEMATICS AND COMPUTING↗

Comparison of the MODIS Multilayer Cloud Detection and Thermodynamic Phase Products with CALIPSO and CloudSat

CALIPSO and CloudSat, launched in June 2006, provide global active remote sensing measurements of clouds and aerosols that can be used for validation of a variety of passive imager retrievals derived from instruments flying on the Aqua spacecraft and other A-Train platforms. The most recent processing effort for the MODIS Atmosphere Team, referred to as the "Collection 5" stream, includes a research-level multilayer cloud detection algorithm that uses both thermodynamic phase information derived from a combination of solar and thermal emission bands to discriminate layers of different phases, as well as true layer separation discrimination using a moderately absorbing water vapor band. The multilayer detection algorithm is designed to provide a means of assessing the applicability of 1D cloud models used in the MODIS cloud optical and microphysical product retrieval, which are generated at a 1 h resolution. Using pixel-level collocations of MODIS Aqua, CALIOP, and CloudSat radar measurements, we investigate the global performance of the thermodynamic phase and multilayer cloud detection algorithms.

Platnick, Steven↗

Comparison of the MODIS Collection 5 Multilayer Cloud Detection Product with CALIPSO

CALIPSO, launched in June 2006, provides global active remote sensing measurements of clouds and aerosols that can be used for validation of a variety of passive imager retrievals derived from instruments flying on the Aqua spacecraft and other A-Train platforms. The most recent processing effort for the MODIS Atmosphere Team, referred to as the Collection 5 scream, includes a research-level multilayer cloud detection algorithm that uses both thermodynamic phase information derived from a combination of solar and thermal emission bands to discriminate layers of different phases, as well as true layer separation discrimination using a moderately absorbing water vapor band. The multilayer detection algorithm is designed to provide a means of assessing the applicability of 1D cloud models used in the MODIS cloud optical and microphysical product retrieval, which are generated at a 1 km resolution. Using pixel-level collocations of MODIS Aqua, CALIOP, we investigate the global performance of multilayer cloud detection algorithms (and thermodynamic phase).

Platnick, Steven↗

Wormhole: A Powerful Data Mashup

The mobile platform is quickly becoming the standard way that users interact with online resources. The iOS operating system allows iPhone and iPad users to seamlessly access highly interactive web applications that until recently were only available via a desktop or laptop. Wormhole is an AJAX application implemented as a smart web widget that allows users to easily supplement web pages with data directly from the Instrument Operations Subsystems division (IOS) at JPL. It creates an interactive mashup using a website's core content enhanced by dynamically retrieved image and metadata supplied by IOS using the webification API. Currently, this technology is limited in scope to NASA data; however, it can easily be augmented to serve many other needs. This web widget can be delivered in various ways, including as a bookmarklet. The underlying technology that powers Wormhole also has applications to other divisions while they are running current missions.

maship↗