Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

High-Performance Scanning Acousto-Ultrasonic System

A high-performance scanning acousto-ultrasonic system, now undergoing development, is designed to afford enhanced capabilities for imaging microstructural features, including flaws, inside plate specimens of materials. The system is expected to be especially helpful in analyzing defects that contribute to failures in polymer- and ceramic-matrix composite materials, which are difficult to characterize by conventional scanning ultrasonic techniques and other conventional nondestructive testing techniques. Selected aspects of the acousto-ultrasonic method have been described in several NASA Tech Briefs articles in recent years. Summarizing briefly: The acousto-ultrasonic method involves the use of an apparatus like the one depicted in the figure (or an apparatus of similar functionality). Pulses are excited at one location on a surface of a plate specimen by use of a broadband transmitting ultrasonic transducer. The stress waves associated with these pulses propagate along the specimen to a receiving transducer at a different location on the same surface. Along the way, the stress waves interact with the microstructure and flaws present between the transducers. The received signal is analyzed to evaluate the microstructure and flaws. The specific variant of the acousto-ultrasonic method implemented in the present developmental system goes beyond the basic principle described above to include the following major additional features: Computer-controlled motorized translation stages are used to automatically position the transducers at specified locations. Scanning is performed in the sense that the measurement, data-acquisition, and data-analysis processes are repeated at different specified transducer locations in an array that spans the specimen surface (or a specified portion of the surface). A pneumatic actuator with a load cell is used to apply a controlled contact force. In analyzing the measurement data for each pair of transducer locations in the scan, the total (multimode) acousto-ultrasonic response of the specimen is utilized. The analysis is performed by custom software that extracts parameters of signals in the time and frequency domains. The computer hardware and software provide both real-time and postscan processing and display options. For example, oscilloscope displays of waveforms and power spectral densities are available in real time. Images can be computed while scanning continues. Signals can be digitally preprocessed and/or post-processed by filtering, windowing, time-segmenting, and running-waveform-averaging algorithms. In addition, the software affords options for off-line simulation of the waveform-data-acquisition and scanning processes. In tests, the system has been shown to be capable of characterizing microstructural changes and defects in SiC/SiC and C/SiC ceramic-matrix composites. Delaminations, variations in density, microstructural changes attributable to infiltration by silicon, and crack-space indications (defined in the next sentence) have been revealed in images formed from several time- and frequency-domain parameters of scanning acousto-ultrasonic signals. The crack-space indications were image features that were not revealed by other nondestructive testing methods and are so named because they turned out to mark locations where cracking eventually occurred.

Roth, Don↗
DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Simultaneous on-chip generation of violet, blue, cyan, green, yellow, orange, and red light from an octave-spanning infrared frequency comb

An integrated, multi-spectral visible-light source could significantly benefit technologies such as displays, medical imaging, spectroscopy, visible-light communications, and astrophysics. However, despite recent advances in chip-scale visible lasers, simultaneously generating light of all colors in a single chip has been challenging. Existing solutions are either not suitable for full chip-scale integration, or are fundamentally difficult to scale. Here we demonstrate the simultaneous on-chip generation of infrared, red, orange, yellow, green, cyan, blue, and violet light. Leveraging the low loss, low dispersion, and high density of modes of an adiabatic multimode silicon nitride (SiN) microresonator, we use a single infrared pump of moderate power (~130 mW) to produce an octave-spanning infrared frequency comb that is then converted to different portions of the visible spectrum. We measure non-mode-locked combs and soliton steps corresponding to mode-locked states, making our comb generator suitable for applications that demand either low or high coherence. Since the required pump power is compatible with high-power lasers demonstrated in the same SiN platform, our multi-octave light generator can be fully integrated in a chip-scale form factor. We envision that such a light source will be a catalyst for the development and deployment of miniaturized multi-spectral technologies for quantum systems, medical imaging, displays, and spectroscopy.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Correlated 4D-STEM and EDS for the classification of fine Beta-precipitates in aluminum alloy AA 6063-T6

Tuning the properties of aluminum alloys AA 6063-T6 involves artificial aging to induce precipitate formation, particularly β’’ and β’ phases. Previous characterization challenges due to their similar appearance are addressed here by correlating 4D scanning transmission electron microscopy (4DSTEM) and energy-dispersive spectroscopy (EDS) mapping. This approach allows us to analyze the structure and composition of precipitates individually, overcoming limitations of conventional imaging and structural analysis techniques when the precipitates appear simultaneously, as is often the case. We present detailed characterizations of needle-shaped Beta precipitates, revealing distinct diffraction patterns (DPs) and compositional differences. The method's applicability extends beyond aluminum alloys, offering a promising strategy for complex composite material characterization with multimodal scanning transmission electron microscopy (STEM) techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Probing corrosion using a simple and versatile in situ multimodal corrosion measurement system

In this work, we have developed a unique in situ multimodal corrosion system that is capable of acquiring electrochemical data, sample imaging/visualization and hydrogen collection, simultaneously. Each of these modalities yield valuable information pertaining to the ongoing corrosion process. Combining them can yield holistic information on the role of microstructure, processing history, presence of coatings, etc., on the sequence of steps occurring during the corrosion process, and how they correlate with the acquired electrochemical data. Four materials systems, namely AA6061-T6 aluminum alloy, AZ91 magnesium alloy, galvanized DP590 steel, and pure Zn, were investigated under open circuit potential and under potentiodynamic polarization. The multimodal corrosion system was utilized to observe processes such as surface passivation and dissolution, pit and filiform corrosion initiation and propagation, and was correlated with location and magnitude of hydrogen evolution. This approach is shown to yield a truly multimodal understanding of the ongoing corrosion processes.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Highly efficient visible and near-IR photon pair generation with thin-film lithium niobate

Efficient on-chip entangled photon pair generation at telecom wavelengths is an integral aspect of emerging quantum optical technologies, particularly for quantum communication and computing. However, moving to shorter wavelengths enables the use of more accessible silicon detector technology, and opens up applications in imaging and spectroscopy. Here, we present high brightness ((1.6 ± 0.3) × 10 9 pairs/s/mW/nm) visible–near-IR photon pair generation in a periodically poled lithium niobate nanophotonic waveguide. The degenerate spectrum of the photon pairs is centered at 811 nm with a bandwidth of 117 nm when pumped with a spectrally multimode laser diode. The measured on-chip source efficiency of (2.3 ± 0.5) × 10 11 pairs/s/mW is on par with source efficiencies at telecom wavelengths and is also orders of magnitude higher than the efficiencies of other visible sources implemented in bulk crystal or diffused waveguide-based technologies. Further improvements in the brightness and efficiencies are possible by pumping the device with a single-frequency laser, which would also shrink the pair bandwidth. These results represent the shortest wavelength of photon pairs generated in a nanophotonic waveguide reported to date by nearly an octave.

42 ENGINEERING↗
DOE OSTI2022

Electron Tomography and Machine Learning for Understanding the Highly Ordered Structure of Leafhopper Brochosomes

Insects known as leafhoppers (Hemiptera: Cicadellidae) produce hierarchically structured nanoparticles known as brochosomes that are exuded and applied to the insect cuticle, thereby providing camouflage and anti-wetting properties to aid insect survival. Although the physical properties of brochosomes are thought to depend on the leafhopper species, the structure–function relationships governing brochosome behavior are not fully understood. Brochosomes have complex hierarchical structures and morphological heterogeneity across species, due to which a multimodal characterization approach is required to effectively elucidate their nanoscale structure and properties. In this work, we study the structural and mechanical properties of brochosomes using a combination of atomic force microscopy (AFM), electron microscopy (EM), electron tomography, and machine learning (ML)-based quantification of large and complex scanning electron microscopy (SEM) image data sets. This suite of techniques allows for the characterization of internal and external brochosome structures, and ML-based image analysis methods of large data sets reveal correlations in the structure across several leafhopper species. Our results show that brochosomes are relatively rigid hollow spheres with characteristic dimensions and morphologies that depend on leafhopper species. Nanomechanical mapping AFM is used to determine a characteristic compression modulus for brochosomes on the order of 1–3 GPa, which is consistent with crystalline proteins. Altogether, this work provides an improved understanding of the structural and mechanical properties of leafhopper brochosomes using a new set of ML-based image classification tools that can be broadly applied to nanostructured biological materials.

Chemical structure↗
DOE OSTI2021

X-ray linear dichroic ptychography

Biominerals such as seashells, coral skeletons, bone, and tooth enamel are optically anisotropic crystalline materials with unique nanoscale and microscale organization that translates into exceptional macroscopic mechanical properties, providing inspiration for engineering new and superior biomimetic structures. Using Seriatopora aculeata coral skeleton as a model, here, we experimentally demonstrate X-ray linear dichroic ptychography and map the c-axis orientations of the aragonite (CaCO 3 ) crystals. Linear dichroic phase imaging at the oxygen K-edge energy shows strong polarization-dependent contrast and reveals the presence of both narrow (<35°) and wide (>35°) c-axis angular spread in the coral samples. These X-ray ptychography results are corroborated by four-dimensional (4D) scanning transmission electron microscopy (STEM) on the same samples. Evidence of co-oriented, but disconnected, corallite subdomains indicates jagged crystal boundaries consistent with formation by amorphous nanoparticle attachment. We expect that the combination of X-ray linear dichroic ptychography and 4D STEM could be an important multimodal tool to study nano-crystallites, interfaces, nucleation, and mineral growth of optically anisotropic materials at multiple length scales.

4D scanning transmission electron microscopy↗
NASA NTRS1997

Robotic multimodality stereotactic brain tissue identification: work in progress

Real-time identification of tissue would improve procedures such as stereotactic brain biopsy (SBX), functional and implantation neurosurgery, and brain tumor excision. To standard SBX equipment has been added: (1) computer-controlled stepper motors to drive the biopsy needle/probe precisely; (2) multiple microprobes to track tissue density, detect blood vessels and changes in blood flow, and distinguish the various tissues being penetrated; (3) neural net learning programs to allow real-time comparisons of current data with a normative data bank; (4) three-dimensional graphic displays to follow the probe as it traverses brain tissue. The probe can differentiate substances such as pig brain, differing consistencies of the 'brain-like' foodstuff tofu, and gels made to simulate brain, as well as detect blood vessels imbedded in these substances. Multimodality probes should improve the safety, efficacy, and diagnostic accuracy of SBX and other neurosurgical procedures.

Brain/anatomy & histology/surgery↗
DOE OSTI2021

A multimodal and integrated approach to interrogate human kidney biopsies with rigor and reproducibility: guidelines from the Kidney Precision Medicine Project

Comprehensive and spatially mapped molecular atlases of organs at a cellular level are a critical resource to gain insights into pathogenic mechanisms and personalized therapies for diseases. The Kidney Precision Medicine Project (KPMP) is an endeavor to generate three-dimensional (3-D) molecular atlases of healthy and diseased kidney biopsies by using multiple state-of-the-art omics and imaging technologies across several institutions. Obtaining rigorous and reproducible results from disparate methods and at different sites to interrogate biomolecules at a single-cell level or in 3-D space is a significant challenge that can be a futile exercise if not well controlled. Here we describe a “follow the tissue” pipeline for generating a reliable and authentic single-cell/region 3-D molecular atlas of human adult kidney. Our approach emphasizes quality assurance, quality control, validation, and harmonization across different omics and imaging technologies from sample procurement, processing, storage, shipping to data generation, analysis, and sharing. We established benchmarks for quality control, rigor, reproducibility, and feasibility across multiple technologies through a pilot experiment using common source tissue that was processed and analyzed at different institutions and different technologies. A peer review system was established to critically review quality control measures and the reproducibility of data generated by each technology before their being approved to interrogate clinical biopsy specimens. The process established economizes the use of valuable biopsy tissue for multiomics and imaging analysis with stringent quality control to ensure rigor and reproducibility of results and serves as a model for precision medicine projects across laboratories, institutions and consortia.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Electron Microscopy Approaches to Unraveling the Structure of Amorphous Materials

Determining atomic structures in crystalline materials—where atoms are arranged in rigid, periodic lattices—has been highly successful using probes such as electrons, X-rays, and neutrons. In contrast, amorphous materials, despite their ubiquity and technological importance, remain far more challenging to characterize with comparable accuracy and precision. This review highlights existing, emerging, and potential (scanning) transmission electron microscopy ((S)TEM) techniques for probing short- and medium-range order in amorphous materials. Approaches ranging from high-resolution (S)TEM imaging and selected electron diffraction pattern to four-dimensional STEM (4D-STEM) based pair distribution function, fluctuation electron microscopy, tomography, ptychography, and spectroscopic methods are discussed, emphasizing their ability to provide complementary insights across multiple length scales—from sub-angstrom local environments to nanometer-scale correlations. Here, we further explore the promise of multimodal and correlative strategies, as well as the growing role of machine learning and physics-informed AI in enabling real-time, quantitative interpretation of complex structural signatures. Together, these advances point toward a future where electron microscopy not only reveals the hidden order in amorphous systems but also establishes robust structure–property relationships, paving the way for materials innovation in disordered matter.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
NASA NTRS1986

Progress in holographic applications; Proceedings of the Meeting, Cannes, France, December 5, 6, 1985

Papers are presented on a holographic recording material containing poly-n-vinylcarbozole, photoelectrochemical etching of holographic gratings in semiconductors, the analysis and construction of powered reflection holographic optical elements, achromatic display holograms in dichromated gelatin, and image blurring in display holograms and in holographic optical elements. Topics discussed include two-dimensional optical beam switching techniques using dynamnic holography, a new holographic interferometer with monomode fibers for integrated optics applications, computer controlled holography, and the copying of holograms using incoherent light. Consideration is given to holography of very far objects, rainbow holography with a multimode laser source, and the use of an endoscope for optical fiber holography.

Ebbeni, Jean↗
NASA NTRS1992

The STIS MAMA status: Current detector performance

The STIS (Space Telescope Imaging Spectrograph) is a second generation Hubble instrument scheduled to fly in 1997. Through a variety of modes, the instrument will provide spectral resolutions from R approximately 50 in the objective spectroscopy mode to 100,000 in the high resolution echelle mode in the wavelength region from 115 to 1000 nm. In the UV the instrument employs two MAMA (Multimode Anode Microchannel plate Arrays) 1024 by 1024 pixel detectors, which provide high DQE (Detective Quantum Efficiency), and good dynamic range and resolution. The current progress and performance of these detectors are reported, illustrating that the technology is mature and that the performance is very close to flight requirements.

Danks, A. C.↗
DOE OSTI2025

Quantum Sensing in Micro-Architected Scaffolds

Quantum sensing with nitrogen-vacancy centers in diamond has emerged as a powerful tool for measuring diverse physical parameters, yet the versatility of these measurement approaches is often limited by the achievable layout and dimensionality of bulk-crystal platforms. Here, in this study, we demonstrate a versatile approach to creating designer quantum sensors by surface-functionalizing multiphoton lithography microstructures with NV-containing nanodiamonds. We showcase this capability by fabricating a 150 μm × 150 μm × 150 μm triply periodic minimal surface gyroid structure with millions of attached nanodiamonds. We demonstrate a means to volumetrically image these structures using a refractive index matching confocal imaging technique and extract ODMR spectra from 1.86 μm × 1.86 μm areas of highly concentrated nanodiamonds across a cross-section of the gyroid. Furthermore, the high density of sensing elements enables ensemble temperature measurements with a sensitivity of 0.548 ± 0.084 K/√Hz at 5 mW excitation power. This approach to creating quantum-enabled microarchitectures opens new possibilities for multimodal sensing in complex three-dimensional environments.

Materials science↗
DOE OSTI2022

Nanoscale electric field imaging with an ambient scanning quantum sensor microscope

Nitrogen-vacancy (NV) center in diamond is a promising quantum sensor with remarkably versatile sensing capabilities. While scanning NV magnetometry is well-established, NV electrometry has been so far limited to bulk diamonds. Here we demonstrate imaging external alternating (AC) and direct (DC) electric fields with a single NV at the apex of a diamond scanning tip under ambient conditions. A strong electric field screening effect is observed at low frequencies. We quantitatively measure its frequency dependence and overcome this screening by mechanically oscillating the tip for imaging DC fields. Our scanning NV electrometry achieved an AC E-field sensitivity of 26 mV μm -1 Hz -1/2 , a DC E-field gradient sensitivity of 2 V μm -2 Hz -1/2 , and sub-100 nm resolution limited by the NV-sample distance. Our work represents an important step toward building a scanning-probe-based multimodal quantum sensing platform.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

AI‐Driven Robot Enables Synthesis‐Property Relation Prediction for Metal Halide Perovskites in Humid Atmosphere

Materials Acceleration Platforms (MAPs) – also known as self-driving laboratories– present a new paradigm for materials science and promise an order of magnitude accelerated materials discovery compared to the traditional trial-and-error approach. Metal halide perovskites (MHPs) are an emerging class of materials for optoelectronic applications but are plagued by irreproducible optoelectronic quality, particularly for films fabricated in a humid atmosphere. Here, in this work, a machine learning (ML)-guided closed-loop platform is developed with a multimodal data fusion approach to predict synthesis–property relations for the optical quality of MHP thin films in relative humidities (RHs) ranging from 5–55%. The efficiency of this approach is confirmed by the fast-dropping learning rate to 2% after experimentally sampling less than 1% of the possible 5,000+ combinations. The prediction of synthesis–property relations is done by optical and imaging characterizations. In situ photoluminescence characterization revealed the origin of thin film quality variation at different RH. These insights provide an avenue for controlling the MHP crystallization by fine-tuning the synthesis parameters and RH for a given chemistry, thus lifting the need for stringent atmosphere control. The MAP enables an accelerated screening and understanding of the synthesis design space, facilitating rational synthesis recipe choice for a wide range of materials.

AI-driven robot↗
DOE OSTI2024

Resolving the Electron Plume within a Scanning Electron Microscope

Scanning electron microscopy (SEM), a century-old technique, is today a ubiquitous method of imaging the surface of nanostructures. However, most SEM detectors simply count the number of secondary electrons from a material of interest, and thereby overlook the rich material information contained within them. Here, by simple modifications to a standard SEM tool, we resolve the momentum and energy information on secondary electrons by directly imaging the electron plume generated by the electron beam of the SEM. Leveraging these spectroscopic imaging capabilities, our technique is able to image lateral electric fields across a prototypical silicon p–n junctions and to distinguish differently doped regions, even when buried beyond depths typically accessible by SEM. Intriguingly, the subsurface sensitivity of this technique reveals unexpectedly strong surface band bending within nominally passivated semiconductor structures, providing useful insights for complex layered component designs, in which interfacial dynamics dictate device operation. Further, these capabilities for noninvasive, multimodal probing of complicated electronic components are crucial in today’s electronic manufacturing but is largely inaccessible even with sophisticated techniques. These results show that seemingly simple SEM can be extended to probe complex and useful material properties.

36 MATERIALS SCIENCE↗