Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Concurrent Image Processing Executive (CIPE). Volume 1: Design overview

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are described. The target machine for this software is a JPL/Caltech Mark 3fp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules: user interface, host-resident executive, hypercube-resident executive, and application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube, a data management method which distributes, redistributes, and tracks data set information was implemented. The data management also allows data sharing among application programs. The CIPE software architecture provides a flexible environment for scientific analysis of complex remote sensing image data, such as planetary data and imaging spectrometry, utilizing state-of-the-art concurrent computation capabilities.

Lee, Meemong↗
NASA NTRS2017

Multi Modality Brain Mapping System (MBMS) Using Artificial Intelligence and Pattern Recognition

A Multimodality Brain Mapping System (MBMS), comprising one or more scopes (e.g., microscopes or endoscopes) coupled to one or more processors, wherein the one or more processors obtain training data from one or more first images and/or first data, wherein one or more abnormal regions and one or more normal regions are identified; receive a second image captured by one or more of the scopes at a later time than the one or more first images and/or first data and/or captured using a different imaging technique; and generate, using machine learning trained using the training data, one or more viewable indicators identifying one or abnormalities in the second image, wherein the one or more viewable indicators are generated in real time as the second image is formed. One or more of the scopes display the one or more viewable indicators on the second image.

Kateb, Babak↗
NASA NTRS1988

Concurrent Image Processing Executive (CIPE)

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are discussed. The target machine for this software is a JPL/Caltech Mark IIIfp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules; (1) user interface, (2) host-resident executive, (3) hypercube-resident executive, and (4) application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube a data management method which distributes, redistributes, and tracks data set information was implemented.

Lee, Meemong↗
DOE OSTI2023

Multimodal microscopy of extended defects in β-Ga 2 O 3 (010) EFG crystals

Beta-phase gallium oxide (β-Ga 2 O 3 ) has attracted attention in recent years as a potentially low cost, large area substrate and active layer material for high power, high temperature power electronics and sensing devices. However, growth of β-Ga 2 O 3 crystals is complicated by easily activated (100) and (001) cleavage planes, the presence of low angle grain boundaries (LAGBs) and twins, and the potential formation of polycrystalline grains. In this study, β-Ga 2 O 3 crystals were grown by the edge-defined film-fed growth technique with an (010) principal face. Two crystals with apparently randomly formed high angle grain boundaries (HAGBs) were selected and analyzed by electron backscatter diffraction, electron channeling contrast imaging, and cathodoluminescence to investigate the nature of the LAGBs and the source of the HAGB formation. It was discovered that planar LAGBs lying parallel to the (010) plane exist in the region immediately preceding the start of an HAGB. Increased misorientation across the LAGB was observed, approaching the initiation of a new grain. We present multimodal microscopy characterization, correlating misorientation and variation in optoelectronic properties with LAGBs and the associated dislocations.

14 SOLAR ENERGY↗
NASA NTRS2006

NASA Tech Briefs, August 2006

Topics covered include: Measurement and Controls Data Acquisition System IMU/GPS System Provides Position and Attitude Data Using Artificial Intelligence to Inform Pilots of Weather Fast Lossless Compression of Multispectral-Image Data Developing Signal-Pattern-Recognition Programs Implementing Access to Data Distributed on Many Processors Compact, Efficient Drive Circuit for a Piezoelectric Pump; Dual Common Planes for Time Multiplexing of Dual-Color QWIPs; MMIC Power Amplifier Puts Out 40 mW From 75 to 110 GHz; 2D/3D Visual Tracker for Rover Mast; Adding Hierarchical Objects to Relational Database General-Purpose XML-Based Information Managements; Vaporizable Scaffolds for Fabricating Thermoelectric Modules; Producing Quantum Dots by Spray Pyrolysis; Mobile Robot for Exploring Cold Liquid/Solid Environments; System Would Acquire Core and Powder Samples of Rocks; Improved Fabrication of Lithium Films Having Micron Features; Manufacture of Regularly Shaped Sol-Gel Pellets; Regulating Glucose and pH, and Monitoring Oxygen in a Bioreactor; Satellite Multiangle Spectropolarimetric Imaging of Aerosols; Interferometric System for Measuring Thickness of Sea Ice; Microscale Regenerative Heat Exchanger Protocols for Handling Messages Between Simulation Computers Statistical Detection of Atypical Aircraft Flights NASA's Aviation Safety and Modeling Project Multimode-Guided-Wave Ultrasonic Scanning of Materials Algorithms for Maneuvering Spacecraft Around Small Bodies Improved Solar-Radiation-Pressure Models for GPS Satellites Measuring Attitude of a Large, Flexible, Orbiting Structure

Source record↗
DOE OSTI2026

QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding

Quantum computing calibration depends on interpreting experimental data, and calibration plots provide the most universal human-readable representation for this task, yet no systematic evaluation exists of how well vision-language models (VLMs) interpret them. We introduce QCalEval, the first VLM benchmark for quantum calibration plots: 243 samples across 87 scenario types from 22 experiment families, spanning superconducting qubits and neutral atoms, evaluated on six question types in both zero-shot and in-context learning settings. The best general-purpose zero-shot model reaches a mean score of 72.3, and many open-weight models degrade under multi-image in-context learning, whereas frontier closed models improve substantially. A supervised fine-tuning ablation at the 9-billion-parameter scale shows that SFT improves zero-shot performance but cannot close the multimodal in-context learning gap. As a reference case study, we release NVIDIA Ising Calibration 1, an open-weight model based on Qwen3.5-35B-A3B that reaches 74.7 zero-shot average score.

Cao, Shuxiang↗
NASA NTRS1991

Magellan imaging radar mission to Venus

The Magellan imaging-radar mapping mission has collected and processed data from the spacecraft in an elliptical orbit around Venus. A brief description is given of the mission and the spacecraft, followed by a more detailed description of the radar system design, which used earth-orbiting SAR experience and several innovations in its design to operate from an orbit around another planet. The radar sensor, ground processing, and data products are described. This multimode radar is the only science instrument on the mission and has the objective of mapping at least 70 percent of the planet surface. It has three modes: SAR, altimetry, and passive radiometry. The radar system has produced maps of almost all of the Venusian surface with a resolution better than 600-m equivalent optical line pair, and the best resolution obtained is equivalent to less than 300 m. Some of the early radar images are shown.

Johnson, William T. K.↗
NASA NTRS1986

Venus Radar Mapper (VRM): Multimode radar system design

The surface of Venus has remained a relative mystery because of the very dense atmosphere that is opaque to visible radiation and, thus, normal photographic techniques used to explore the other terrestrial objects in the solar system are useless. The atmosphere is, however, almost transparent to radar waves and images of the surface have been produced via Earth-based and orbital radars. The technique of obtaining radar images of a surface is variously called side looking radar, imaging radar, or synthetic aperture radar (SAR). The radar requires a moving platform in which the antenna is side looking. High resolution is obtained in the cross-track or range direction by conventional radar pulse encoding. In the along-track or azimuth direction, the resolution would normally be the antenna beam width, but for the SAR case, a much longer antenna (or much sharper beam) is obtained by moving past a surface target as shown, and then combining the echoes from many pulses, by using the Doppler data, to obtain the images. The radar design of the Venus Radar Mapper (VRM) is discussed. It will acquire global radar imagery and altimetry data of the surface of Venus.

Johnson, William T. K.↗
NASA NTRS2015

Multimodal Neurodiagnostic Tool for Exploration Missions

Linea Research Corporation has developed a neurodiagnostic tool that detects behavioral stress markers for astronauts on long-duration space missions. Lightweight and compact, the device is unobtrusive and requires minimal time and effort for the crew to use. The system provides a real-time functional imaging of cortical activity during normal activities. In Phase I of the project, Linea Research successfully monitored cortical activity using multiparameter sensor modules. Using electroencephalography (EEG) and functional near-infrared spectroscopy signals, the company obtained photoplethysmography and electrooculography signals to compute the heart rate and frequency of eye movement. The company also demonstrated the functionality of an algorithm that automatically classifies the varying degrees of cognitive loading based on physiological parameters. In Phase II, Linea Research developed the flight-capable neurodiagnostic device. Worn unobtrusively on the head, the device detects and classifies neurophysiological markers associated with decrements in behavior state and cognition. An automated algorithm identifies key decrements and provides meaningful and actionable feedback to the crew and ground-based medical staff.

Lee, Yong Jin↗
DOE OSTI2023

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Charging Reactions Promoted by Geometrically Necessary Dislocations in Battery Materials Revealed by In Situ Single-Particle Synchrotron Measurements

Crystallographic defects exist in many redox active energy materials, e.g., battery and catalyst materials, which significantly alter their chemical properties for energy storage and conversion. However, there is lack of quantitative understanding of the interrelationship between crystallographic defects and redox reactions. Herein, crystallographic defects, such as geometrically necessary dislocations, are reported to influence the redox reactions in battery particles through single-particle, multimodal, and in situ synchrotron measurements. Through Laue X-ray microdiffraction, many crystallographic defects are spatially identified and statistically quantified from a large quantity of diffraction patterns in many layered oxide particles, including geometrically necessary dislocations, tilt boundaries, and mixed defects. The in situ and ex situ measurements, combining microdiffraction and X-ray spectroscopy imaging, reveal that LiCoO 2 particles with a higher concentration of geometrically necessary dislocations provide deeper charging reactions, indicating that dislocations may facilitate redox reactions in layered oxides during initial charging. The present study illustrates that a precise control of crystallographic defects and their distribution can potentially promote and homogenize redox reactions in battery materials.

25 ENERGY STORAGE↗
DOE OSTI2020

Imaging biomarkers in neurodegeneration: current and future practices

There is an increasing role for biological markers (biomarkers) in the understanding and diagnosis of neurodegenerative disorders. The application of imaging biomarkers specifically for the in vivo investigation of neurodegenerative disorders has increased substantially over the past decades and continues to provide further benefits both to the diagnosis and understanding of these diseases. This review forms part of a series of articles which stem from the University College London/University of Gothenburg course “Biomarkers in neurodegenerative diseases”. In this review, we focus on neuroimaging, specifically positron emission tomography (PET) and magnetic resonance imaging (MRI), giving an overview of the current established practices clinically and in research as well as new techniques being developed. We will also discuss the use of machine learning (ML) techniques within these fields to provide additional insights to early diagnosis and multimodal analysis.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2004

Multifunction Imaging and Spectroscopic Instrument

A proposed optoelectronic instrument would perform several different spectroscopic and imaging functions that, heretofore, have been performed by separate instruments. The functions would be reflectance, fluorescence, and Raman spectroscopies; variable-color confocal imaging at two different resolutions; and wide-field color imaging. The instrument was conceived for use in examination of minerals on remote planets. It could also be used on Earth to characterize material specimens. The conceptual design of the instrument emphasizes compactness and economy, to be achieved largely through sharing of components among subsystems that perform different imaging and spectrometric functions. The input optics for the various functions would be mounted in a single optical head. With the exception of a targeting lens, the input optics would all be aimed at the same spot on a specimen, thereby both (1) eliminating the need to reposition the specimen to perform different imaging and/or spectroscopic observations and (2) ensuring that data from such observations can be correlated with respect to known positions on the specimen. The figure schematically depicts the principal components and subsystems of the instrument. The targeting lens would collect light into a multimode optical fiber, which would guide the light through a fiber-selection switch to a reflection/ fluorescence spectrometer. The switch would have four positions, enabling selection of spectrometer input from the targeting lens, from either of one or two multimode optical fibers coming from a reflectance/fluorescence- microspectrometer optical head, or from a dark calibration position (no fiber). The switch would be the only moving part within the instrument.

Mouroulis, Pantazis↗
DOE OSTI2021

Recurrence analysis of friction based dry-couplant ultrasonic Lamb waves in plate-like structures

Here, in this study, the effect of friction on the generation of dry-coupled Lamb waves is experimentally investigated. Recurrence analysis is performed to analyze the complex behavior of friction based dry-coupled Lamb waves. In particular, the effect of the normal force, which is necessary for a stronger dry-coupled Lamb wave generation and the friction, on the transmission of mechanical energy and determinism characteristics of Lamb waves are investigated. The results verify that larger friction coefficient and friction force are crucial for generation and propagation of strong Lamb waves supporting the fact that the main mechanism to transfer mechanical energy using dry-couplant is friction. The sensitivity of Lamb waves to the friction coefficient, highlights the importance of designing specific pads with respect to condition of the surface. Besides, the results show that the normal force and friction coefficient can change the determinism characteristics behavior of multimode Lamb waves. Furthermore, it is shown that the determinism value is sensitive to the friction coefficient and normal force. A similar trend is observed in the determinism values and friction coefficient. In general, a smaller friction coefficient indicates smaller determinism value. Additionally, it is shown that a normal load can change the behavior of a system, as observed from recurrence plots, owing to changes in the Lamb waves trajectories in the phase-space domain. In addition, it is shown that recurrence plots enable the detection of mode transitions in multimode Lamb waves. Recurrence analysis is a complementary tool to frequency domain methods for accurate analysis of multimode Lamb waves behavior.

42 ENGINEERING↗
DOE OSTI2023

From Optimization to Sampling Through Gradient Flows

Optimization and sampling algorithms play a central role in science and engineering as they enable finding optimal predictions, policies, and recommendations, as well as expected and equilibrium states of complex systems. The notion of “optimality” is formalized by the choice of an objective function, while the notion of an “expected” state is specified by a probabilistic model for the distribution of states. Optimizing rugged objective functions and sampling multimodal distributions is computationally challenging, especially in high-dimensional problems. Here, for this reason, many optimization and sampling methods have been developed by researchers working in disparate fields such as Bayesian statistics, molecular dynamics, genetics, quantum chemistry, machine learning, weather forecasting, econometrics, and medical imaging.

Trillos, N. García↗
DOE OSTI2023

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1972

Development of a model of machine hand eye coordination and program specifications for a topological machine vision system

A unified approach to computer vision and manipulation is developed which is called choreographic vision. In the model, objects to be viewed by a projected robot in the Viking missions to Mars are seen as objects to be manipulated within choreographic contexts controlled by a multimoded remote, supervisory control system on Earth. A new theory of context relations is introduced as a basis for choreographic programming languages. A topological vision model is developed for recognizing objects by shape and contour. This model is integrated with a projected vision system consisting of a multiaperture image dissector TV camera and a ranging laser system. System program specifications integrate eye-hand coordination and topological vision functions and an aerospace multiprocessor implementation is described.

Source record↗
NASA NTRS1991

Cassini Titan Radar Mapper

The Cassini Titan Radar Mapper is a multimode radar instrument designed to probe the optically inaccessible surface of Titan, Saturn's largest moon. The instrument is to be included in the payload of the Cassini Saturn Mission, scheduled for launch in 1995. The individual modes of Cassini Radar Mapper will allow topographic mapping and surface imaging at few hundred meters resolution. The requirements that lay behind the design are briefly discussed, and the configuration and capability of the instrument are described. The present limited knowledge of Titan's surface and the measurement requirements imposed on the radar instrument are addressed. Also discussed are the Cassini mission and the projected orbits, which imposed another set of design constraints that led to the multitude of modes and to an unconventional antenna configuration. The antenna configuration and the different radar modes are described.

Elachi, Charles↗