Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

(abstract) Synthesis of Speaker Facial Movements to Match Selected Speech Sequences

We are developing a system for synthesizing image sequences the simulate the facial motion of a speaker. To perform this synthesis, we are pursuing two major areas of effort. We are developing the necessary computer graphics technology to synthesize a realistic image sequence of a person speaking selected speech sequences. Next, we are developing a model that expresses the relation between spoken phonemes and face/mouth shape. A subject is video taped speaking an arbitrary text that contains expression of the full list of desired database phonemes. The subject is video taped from the front speaking normally, recording both audio and video detail simultaneously. Using the audio track, we identify the specific video frames on the tape relating to each spoken phoneme. From this range we digitize the video frame which represents the extreme of mouth motion/shape. Thus, we construct a database of images of face/mouth shape related to spoken phonemes. A selected audio speech sequence is recorded which is the basis for synthesizing a matching video sequence; the speaker need not be the same as used for constructing the database. The audio sequence is analyzed to determine the spoken phoneme sequence and the relative timing of the enunciation of those phonemes. Synthesizing an image sequence corresponding to the spoken phoneme sequence is accomplished using a graphics technique known as morphing. Image sequence keyframes necessary for this processing are based on the spoken phoneme sequence and timing. We have been successful in synthesizing the facial motion of a native English speaker for a small set of arbitrary speech segments. Our future work will focus on advancement of the face shape/phoneme model and independent control of facial features.

graphics audio digitizing morphing enunciation pho↗
DOE OSTI2020

Toward Large-Scale Image Segmentation on Summit

Semantic segmentation of images is an important computer vision task that emerges in a variety of application domains such as medical imaging, robotic vision and autonomous vehicles to name a few. While these domain-specific image analysis tasks involve relatively small image sizes (~ 10 2 × 10 2 ), there are many applications that need to train machine learning models on image data with extents that are orders of magnitude larger (~10 4 × 10 4 ). Training deep neural network (DNN) models on large extent images is extremely memory-intensive and often exceeds the memory limitations of a single graphical processing unit, a hardware accelerator of choice for computer vision workloads. Here, an efficient, sample parallel approach to train U-Net models on large extent image data sets is presented. Its advantages and limitations are analyzed and near-linear strong-scaling speedup demonstrated on 256 nodes (1536 GPUs) of the Summit supercomputer. Using a single node of the Summit supercomputer, an early evaluation of a recently released model parallel framework called GPipe is demonstrated to deliver ~ 2X speedup in executing a U-Net model with an order of magnitude larger number of trainable parameters than reported before. Performance bottlenecks for pipelined training of U-Net models are identified and mitigation strategies to improve the speedups are discussed. Together, these results open up the possibility of combining both approaches into a unified scalable pipelined and data parallel algorithm to efficiently train U-Net models with very large receptive fields on data sets of ultra-large extent images.

Seal, Sudip↗
NASA NTRS1990

Truncation Of Images For Correlation

Correlation performed on relatively small computer. Proposed method for processing video images in slowly changing scenes, renditions of complicated objects truncated to points, lines, polygons, or other simplified geometrical objects. Processed by image-correlating algorithms to extract information: recognize features and to track displacements of features in subsequent image frames to determine velocities. Entails correlation of far fewer data than original images.

Shimada, Katsunori↗
DOE OSTI2024

A machine learning decision criterion for reducing scan time for hyperspectral neutron computed tomography systems

We present the first machine learning-based autonomous hyperspectral neutron computed tomography experiment performed at the Spallation Neutron Source. Hyperspectral neutron computed tomography allows the characterization of samples by enabling the reconstruction of crystallographic information and elemental/isotopic composition of objects relevant to materials science. High quality reconstructions using traditional algorithms such as the filtered back projection require a high signal-to-noise ratio across a wide wavelength range combined with a large number of projections. This results in scan times of several days to acquire hundreds of hyperspectral projections, during which end users have minimal feedback. To address these challenges, a golden ratio scanning protocol combined with model-based image reconstruction algorithms have been proposed. This novel approach enables high quality real-time reconstructions from streaming experimental data, thus providing feedback to users, while requiring fewer yet a fixed number of projections compared to the filtered back projection method. In this paper, we propose a novel machine learning criterion that can terminate a streaming neutron tomography scan once sufficient information is obtained based on the current set of measurements. Our decision criterion uses a quality score which combines a reference-free image quality metric computed using a pre-trained deep neural network with a metric that measures differences between consecutive reconstructions. The results show that our method can reduce the measurement time by approximately a factor of five compared to a baseline method based on filtered back projection for the samples we studied while automatically terminating the scans.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1997

Alaskan Auroral All-Sky Images on the World Wide Web

In response to a 1995 NASA SPDS announcement of support for preservation and distribution of important data sets online, the Geophysical Institute, University of Alaska Fairbanks, Alaska, proposed to provide World Wide Web access to the Poker Flat Auroral All-sky Camera images in real time. The Poker auroral all-sky camera is located in the Davis Science Operation Center at Poker Flat Rocket Range about 30 miles north-east of Fairbanks, Alaska, and is connected, through a microwave link, with the Geophysical Institute where we maintain the data base linked to the Web. To protect the low light-level all-sky TV camera from damage due to excessive light, we only operate during the winter season when the moon is down. The camera and data acquisition is now fully computer controlled. Digital images are transmitted each minute to the Web linked data base where the data are available in a number of different presentations: (1) Individual JPEG compressed images (1 minute resolution); (2) Time lapse MPEG movie of the stored images; and (3) A meridional plot of the entire night activity.

Stenbaek-Nielsen, H. C.↗
NASA NTRS1999

Technologies for Nondestructive Evaluation of Surfaces and Thin Coatings

The effort included in this project included several related activities encompassing basic understanding, technological development, customer identification and commercial transfer of several methodologies for nondestructive evaluation of surfaces and thin surface coatings. Consistent with the academic environment, students were involved in the effort working with established investigators to further their training, provide a nucleus of experienced practitioners in the new technologies during their industrial introduction, and utilize their talents for project goals. As will be seen in various portions of the report, some of the effort has led to commercialization. This process has spawned other efforts related to this project which are supported from outside sources. These activities are occupying the efforts of some of the people who were previously supported within this grant and its predecessors. The most advanced of the supported technologies is thermography, for which the previous joint efforts of the investigators and NASA researchers have developed several techniques for extending the utility of straight thermographic inspection by producing methods of interpretation and analysis accessible to automatic image processing with computer data analysis. The effort reported for this technology has been to introduce the techniques to new user communities, who are then be able to add to the effective uses of existing products with only slight development work. In a related development, analysis of a thermal measurement situation in past efforts led to a new insight into the behavior of simple temperature probes. This insight, previously reported to the narrow community in which the particular measurement was made, was reported to the community of generic temperature measurement experts this year. In addition to the propagation of mature thermographic techniques, the development of a thermoelastic imaging system has been an important related development. Part of the work carried out in the effort reported here has been to prepare reports introducing the newly commercially available thermoelastic measurements to the appropriate user communities.

Source record↗
DOE OSTI2023

Simulation studies of a full-ring, CZT SPECT system for whole-body imaging of 99m Tc and 177 Lu

Single photon emission computed tomography (SPECT) is an imaging modality that has demonstrated its utility in a number of clinical indications. Despite this progress, a high sensitivity, high spatial resolution, multi-tracer SPECT with a large field of view suitable for whole-body imaging of a broad range of radiotracers for theranostics is not available. With the goal of filling this technological gap, we have designed a cadmium zinc telluride (CZT) full-ring SPECT scanner instrumented with a broad-energy tungsten collimator. The final purpose is to provide a multi-tracer solution for brain and whole-body imaging. Our static SPECT does not rely on the dual- and the triple-head rotational SPECT standard paradigm, enabling a larger effective area in each scan to increase the sensitivity. We provide a demonstration of the performance of our design using a realistic model of our detector with simulated body-sized phantoms filled with 99m Tc and 177 Lu. Our SPECT design can resolve 7.9 mm rods for 99m Tc (140 keV) and 9.5 mm for 177 Lu (208 keV) in a hot-rod Derenzo phantom with a 3-min exposure and reach an image contrast of 78% for 99m Tc and 57% for 177 Lu using the NEMA IQ phantom with a 6-min exposure. Our modified scatter correction shows an improved contrast-recovery ratio compared to a standard correction. In this paper, we demonstrate the good performance of our design for whole-body imaging purposes. This adds to our previous demonstration of improved qualitative and quantitative 99m Tc imaging of brain perfusion and 123 I imaging of dopamine transport with respect to state-of-the-art NaI dual-head cameras. We show that our design provides similar IQ and contrast to the commercial full-ring SPECT VERITON for 99m Tc. Regarding 177 Lu imaging of the 208 keV emissions, our design provides similar contrast to that of other state-of-the-art SPECTs with a significant reduction in exposure. In conclusion, the high sensitivity and extended energy range up to 250 keV makes our SPECT design a promising alternative for clinical imaging and theranostics of emerging radionuclides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1992

Experimental Optoelectronic Associative Memory

Optoelectronic associative memory responds to input image by displaying one of M remembered images. Which image to display determined by optoelectronic analog computation of resemblance between input image and each remembered image. Does not rely on precomputation and storage of outer-product synapse matrix. Size of memory needed to store and process images reduced.

Chao, Tien-Hsin↗
NASA NTRS2002

Battling Brittle Bones

The accuDEXA(R) Bone Mineral Density Assessment System, manufactured by Schick Technologies, Inc., utilizes "camera on a chip" sensor technology invented and developed by NASA's Jet Propulsion Laboratory. Schick's accuDEXA system offers several advantages over traditional osteoporosis tests, which assess bone density loss in the hip and spine, and require specialized personnel to conduct. With accuDEXA, physicians can test the entire body's bone density at a peripheral site, such as the finger, without applying gels or having patients remove garments. Results are achieved in 30 seconds and printed out in less than a minute, compared to the estimated exam time of 15 minutes for hip and spine density analyses. Schick has also applied the CMOS APS technology to a new software product that performs dental radiography using up to 90 percent less radiation exposure than conventional X-rays. Called Computed Dental Radiography(R), the new digital imaging product utilizes an electronic sensor in place of X-ray film to generate sharp and clear images that appear on a computer screen within 3 seconds, and can be enlarged and enhanced to identify problems.

Source record↗
NASA NTRS2007

An Attempt to Observe Debris from the Breakup of a Titan 3C-4 Transtage

In February 2007 dedicated observations were made of the orbital space predicted to contain debris from the breakup of the Titan 3C-4 transtage back on February 21, 1992. These observations were carried out on the Michigan Orbital DEbris Survey Telescope (MODEST) in Chile with its 1.3deg field of view. The search region or orbital space (inclination and right ascension of the ascending node (RAAN) was predicted using NASA#s LEGEND (LEO-to-GEO Environment Debris) code to generate a Titan debris cloud. Breakup fragments are created based on the NASA Standard Breakup Model (including fragment size, area-to-mass (A/M), and delta-V distributions). Once fragments are created, they are propagated forward in time with a subroutine GEOPROP. Perturbations included in GEOPROP are those due to solar/lunar gravity, radiation pressure, and major geopotential terms. Barker, et. al, (AMOS Conference Proceedings, 2006, pp. 596-604) used similar LEGEND predictions to correlate survey observations made by MODEST (February 2002) and found several possible night-to-night correlations in the limited survey dataset. One conc lusion of the survey search was to dedicate a MODEST run to observing a GEO region predicted to contain debris fragments and actual Titan debris objects (SSN 25000, 25001 and 30000). Such a dedicated run was undertaken with MODEST between February 17 and 23, 2007 (UT dates). MODEST#s limiting magnitude of 18.0 (S\N approx.10) corresponds to a size of 22cm assuming a diffuse Lambertian albedo of 0.2. However, based on observed break-up data, we expect most debris fragments to be smaller than 22cm which implies a need to increase the effective sensitivity of MODEST for smaller objects. MODEST#s limiting size can be lowered by increasing the exposure time (20 instead of 5 seconds) and applying special image processing. The special processing combines individual CCD images to detect faint objects that are invisible on a single CCD image. Sub-images are cropped from six consecutive CCD images with pixel shifts between images being consistent with the predicted movement of a Titan object. A median image of all the sub-images is then created leaving only those objects with the proper Titan motion. Limiting the median image in this manner brings the needed computer time to process all images taken on one night down to about 50 hours of CPU time.

Barker, E. S.↗
NASA NTRS2017

Advances in Medical Analytics Solutions for Autonomous Medical Operations on Long-Duration Missions

A review will be presented on the progress made under STMDGame Changing Development Program Funding towards the development of a Medical Decision Support System for augmenting crew capabilities during long-duration missions, such as Mars Transit. To create an MDSS, initial work requires acquiring images and developing models that analyze and assess the features in such medical biosensor images that support medical assessment of pathologies. For FY17, the project has focused on ultrasound images towards cardiac pathologies: namely, evaluation and assessment of pericardial effusion identification and discrimination from related pneumothorax and even bladder-induced infections that cause inflammation around the heart. This identification is substantially changed due to uncertainty due to conditions of fluid behavior under space-microgravity. This talk will present and discuss the work-to-date in this Project, recognizing conditions under which various machine learning technologies, deep-learning via convolutional neural nets, and statistical learning methods for feature identification and classification can be employed and conditioned to graphical format in preparation for attachment to an inference engine that eventually creates decision support recommendations to remote crew in a triage setting.

Medical Decision Support Systems↗
NASA NTRS1980

Study of stray light suppression for the large space telescope

Analysis of light scattering, using the APART computer program, begins at the image plane and progresses through the optical system to the front end of the telescope tube. The approach identifies all critical surfaces, computes the geometrical configuration factors (GCF) from each area of the system under study to all other areas of the system, and determines incident and reflected angles which are important for baffle surfaces which do not have Lambertian scattering characteristics. The power input into the optical surface from either point source objects or extended objects such as the bright Earth are computed. The surface scattering characteristics and the GCF values are combined so that the power transfer to the image plane is computed. Capabilities for handling light scattering from baffle surfaces, specular reflectance from black surfaces, scattering from mirror surfaces, diffraction, internal scattering from transmissive optics, and internal thermal emission are assessed.

Fannin, B. B.↗
NASA NTRS1990

Ray tracing on distributed memory parallel systems

Among the many techniques in computer graphics, ray tracing is prized because it can render realistic images, albeit at great computational expense. In this note, the performance of several approaches to ray tracing on a distributed memory parallel system is evaluated. A set of performance instrumentation tools and their associated visualization software are used to identify the underlying causes of performance differences.

Jensen, David W.↗
NASA NTRS1991

Endoscopic inspection using a panoramic annular lens

The objective of this one year study was to design, build, and demonstrate a prototype system for cavity inspection. A cylindrical view of the cavity interior was captured in real time through a compound lens system consisting of a unique panoramic annular lens and a collector lens. Images, acquired with a digitizing camera and stored in a desktop computer, were manipulated using image processing software to aid in visual inspection and qualitative analysis. A detailed description of the lens and its applications is given.

Gilbert, John A.↗
NASA NTRS2004

Physical Analysis and Scaling of a Jet and Vortex Actuator

Our previous studies have shown that the Jet and Vortex Actuator generates free-jet, wall-jet, and near- wall vortex flow fields. That is, the actuator can be operated in different modes by simply varying the driving frequency and/or amplitude. For this study, variations are made in the actuator plate and wide-slot widths and sine/asymmetrical actuator plate input forcing (drivers) to further study the actuator induced flow fields. Laser sheet flow visualization, particle- image velocimetry, and laser velocimetry are used to measure and characterize the actuator induced flow fields. Laser velocimetry measurements indicate that the vortex strength increases with the driver repetition rate for a fixed actuator geometry (wide slot and plate width). For a given driver repetition rate, the vortex strength increases as the plate width decreases provided the wide-slot to plate-width ratio is fixed. Using an asymmetric plate driver, a stronger vortex is generated for the same actuator geometry and a given driver repetition rate. The nondimensional scaling provides the approximate ranges for operating the actuator in the free jet, wall jet, or vortex flow regimes. Finally, phase-locked velocity measurements from particle image velocimetry indicate that the vortex structure is stationary, confirming previous computations. Both the computations and the particle image velocimetry measurements (expectantly) show unsteadiness near the wide-slot opening, which is indicative of mass ejection from the actuator.

Lachowicz, Jason T.↗
DOE OSTI2020

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples.

Cherukara, Mathew J↗
NASA NTRS1972

Analyses of requirements for computer control and data processing experiment subsystems. Volume 2: ATM experiment S-056 image data processing system software development

The IDAPS (Image Data Processing System) is a user-oriented, computer-based, language and control system, which provides a framework or standard for implementing image data processing applications, simplifies set-up of image processing runs so that the system may be used without a working knowledge of computer programming or operation, streamlines operation of the image processing facility, and allows multiple applications to be run in sequence without operator interaction. The control system loads the operators, interprets the input, constructs the necessary parameters for each application, and cells the application. The overlay feature of the IBSYS loader (IBLDR) provides the means of running multiple operators which would otherwise overflow core storage.

Source record↗