Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and sensing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Scintillation event imaging with a single photon avalanche diode camera

Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower in spatial resolution. Camera-based designs use sensors that are lower in temporal resolution or readout rate and cannot image individual interactions. Here we propose to image scintillation events in a thick, monolithic scintillator using a high-resolution SPAD camera. We demonstrate that a commercial SPAD camera is able to gather sufficient signal to image individual scintillation events and observe 3D shifts in their spatial distribution. Simulations show that a SPAD camera can localize individual scintillation events in 3D. We report direct imaging of gamma-ray interactions in a scintillator with a SPAD camera. The proposed design may allow to measure complex signatures of individual particles interacting in the scintillator.

47 OTHER INSTRUMENTATION↗

Element differentiation with a Hartmann- based X-ray phase imaging system

Significant efforts are currently ongoing in X-ray imaging to provide multimodal imaging systems, targeting better sensitivity and specificity for both biomedical or non-destructive testing applications. Knowing the elemental composition of specific structures, such as breast microcalcifications in mammography, would help to differentiate malign and benign tumours. Standard X-ray Phase Contrast Imaging techniques provide only qualitative information on elements with similar absorption properties. However, their chemical composition can be determined from the measurement of the phase as it is directly related to the optical index of elemental materials. We will show new experimental results obtained with an X-ray phase imaging system based on a Hartmann mask. Early data treatment succeeded in retrieving both the real and imaginary parts of the refractive index. The system demonstrates the capability to discriminate materials based on elemental composition.

36 MATERIALS SCIENCE↗

Tunable phase-change metasurfaces coupled with mid-infrared molecular vibrations

Chiral optical metasurfaces have emerged as a promising platform in coupling with molecular vibrational fingerprints through the enhanced light-matter interaction under different circularly polarized light illumination. Here, this work reports the mode coupling between the mid-infrared phonon vibrations of polymethyl methacrylate (PMMA) molecules and the thermally tunable chiral metasurfaces based on the phase-change material Ge₂Sb₂Te₅ (GST-225). Phase-change chiral metasurfaces with high circular dichroism (CD) in absorption and tunable plasmonic resonance in the frequency range of 48–56 THz are demonstrated, which covers the phonon vibrational frequency of PMMA molecules at 52 THz. The mode splitting features are observed in the absorption and CD spectra when the metasurface resonance is tuned across the phonon vibrational frequency of PMMA molecules during the phase transition of GST-225. The underlying mechanism of molecule-metasurface coupling is further revealed by studying the electric field and power loss density distributions of the phonon–plasmon coupled modes under both left-handed and right-handed circularly polarized (LCP and RCP) light. The demonstrated results show the potential of dynamically tunable chiral metasurfaces for the applications in label-free molecular sensing, biomedical diagnostics, thermal imaging, and mid-infrared photonics.

Tang, Haotian [Missouri Univ. of Science and Techn↗

Synergizing human expertise and AI efficiency with language model for microscopy operation and automated experiment design

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material synthesis, characterization, analysis and discovery. Here, we explore the utility of LLMs, particularly ChatGPT4, in combination with application program interfaces (APIs) in tasks of experimental design, programming workflows, and data analysis in scanning probe microscopy, using both in-house developed APIs and APIs given by a commercial vendor for instrument control. We find that the LLM can be especially useful in converting ideations of experimental workflows to executable code on microscope APIs. Beyond code generation, we find that the GPT4 is capable of analyzing microscopy images in a generic sense. At the same time, we find that GPT4 suffers from an inability to extend beyond basic analyses for more in-depth technical experimental design. We argue that an LLM specifically fine-tuned for individual scientific domains can potentially be a better language interface for converting scientific ideations from human experts to executable workflows. Such a synergy between human expertise and LLM efficiency in experimentation can open new doors for accelerating scientific research, enabling effective experimental protocols sharing in the scientific community.

97 MATHEMATICS AND COMPUTING↗

Light transport with weak angular dependence in fog

Random scattering and absorption of light by tiny particles in aerosols, like fog, reduce situational awareness and cause unacceptable down-time for critical systems or operations. Computationally efficient light transport models are desired for computational imaging to improve remote sensing capabilities in degraded optical environments. To this end, we have developed a model based on a weak angular dependence approximation to the Boltzmann or radiative transfer equation that appears to be applicable in both the moderate and highly scattering regimes, thereby covering the applicability domain of both the small angle and diffusion approximations. An analytic solution was derived and validated using experimental data acquired at the Sandia National Laboratory Fog Chamber facility. The evolution of the fog particle density and size distribution were measured and used to determine macroscopic absorption and scattering properties using Mie theory. A three-band (0.532, 1.55, and 9.68 µ m) transmissometer with lock-in amplifiers enabled changes in fog density of over an order of magnitude to be measured due to the increased transmission at higher wavelengths, covering both the moderate and highly scattering regimes. The meteorological optical range parameter is shown to be about 0.6 times the transport mean free path length, suggesting an improved physical interpretation of this parameter.

74 ATOMIC AND MOLECULAR PHYSICS↗

Low-Power Deep Learning Inference using the SpiNNaker Neuromorphic Platform

n this presentation we will discuss recent results on using the SpiNNaker neuromorphic platform (48-chip model) for deep learning neural network inference. We use the Sandia Labs developed Whet stone spiking deep learning library to train deep multi-layer perceptrons and convolutional neural networks suitable for the spiking substrate on the neural hardware architecture. By using the massively parallel nature of SpiNNaker, we are able to achieve, under certain network topologies, substantial network tiling and consequentially impressive inference throughput. Such high-throughput systems may have eventual application in remote sensing applications where large images need to be chipped, scanned, and processed quickly. Additionally, we explore complex topologies that push the limits of the SpiNNaker routing hardware and investigate how that impacts mapping software-implemented networks to on-hardware instantiations.

97 MATHEMATICS AND COMPUTING↗

The Urban Observatory: A Multi-Modal Imaging Platform for the Study of Dynamics in Complex Urban Systems

We describe an “Urban Observatory” facility designed for the study of complex urban systems via persistent, synoptic, and granular imaging of dynamical processes in cities. An initial deployment of the facility has been demonstrated in New York City and consists of a suite of imaging systems—both broadband and hyperspectral—sensitive to wavelengths from the visible (∼400 nm) to the infrared (∼13 micron) operating at cadences of ∼0.01–30 Hz (characteristically ∼0.1 Hz). Much like an astronomical survey, the facility generates a large imaging catalog from which we have extracted observables (e.g., time-dependent brightnesses, spectra, temperatures, chemical species, etc.), collecting them in a parallel source catalog. We have demonstrated that, in addition to the urban science of cities as systems, these data are applicable to a myriad of domain-specific scientific inquiries related to urban functioning including energy consumption and end use, environmental impacts of cities, and patterns of life and public health. We show that an Urban Observatory facility of this type has the potential to improve both a city’s operations and the quality of life of its inhabitants.

54 ENVIRONMENTAL SCIENCES↗

Systems and methods for verification and authentication of remote sensing imagery

A system for generating and authenticating remote sensing imagery includes a remote sensing platform. The remote sensing platform includes an imaging sensor and a hardware logic device that is directly coupled to the imaging sensor. The hardware logic device receives image data from the imaging sensor and generates a cryptographic signature based upon the image data. The hardware logic device outputs a signed image that includes the image data and the cryptographic signature. A computing device operated by a downstream user receives the signed image and can determine whether the image data has been modified from its original content based upon the cryptographic signature.

Crosby, Sean Michael↗

Membrane potential sensing: Material design and method development for single particle optical electrophysiology

We review the development of “single” nanoparticle-based inorganic and organic voltage sensors, which can eventually become a viable tool for “non-genetic optogenetics.” The voltage sensing is accomplished with optical imaging at the fast temporal response and high spatial resolutions in a large field of view. Inorganic voltage nanosensors utilize the Quantum Confined Stark Effect (QCSE) to sense local electric fields. Engineered nanoparticles achieve substantial single-particle voltage sensitivity (~2% Δλ spectral Stark shift up to ~30% ΔF/F per 160 mV) at room temperature due to enhanced charge separation. A dedicated home-built fluorescence microscope records spectrally resolved images to measure the QCSE induced spectral shift at the single-particle level. Biomaterial based surface ligands are designed and developed based on theoretical simulations. The hybrid nanobiomaterials satisfy anisotropic facet-selective coating, enabling effective compartmentalization beyond non-specific staining. Self-spiking- and patched-HEK293 cells and cortical neurons, when stained with hybrid nanobiomaterials, show clear photoluminescence intensity changes in response to membrane potential (MP) changes. Organic voltage nanosensors based on polystyrene beads and nanodisk technology utilize Fluorescence (Förster) Resonance Energy Transfer (FRET) to sense local electric fields. Voltage sensing FRET pairs achieve voltage sensitivity up to ~35% ΔF/F per 120 mV in cultures. Non-invasive MP recording from individual targeted sites (synapses and spines) with nanodisks has been realized. However, both of these QCSE- and FRET-based voltage nanosensors yet need to reach the milestone of recording individual action potentials from individual targeted sites.

59 BASIC BIOLOGICAL SCIENCES↗

Imaging beyond the surface region: Probing hidden materials via atomic force microscopy

Probing material properties at surfaces down to the single-particle scale of atoms and molecules has been achieved, but high-resolution subsurface imaging remains a nanometrology challenge due to electromagnetic and acoustic dispersion and diffraction. The atomically sharp probe used in scanning probe microscopy (SPM) has broken these limits at surfaces. Subsurface imaging is possible under certain physical, chemical, electrical, and thermal gradients present in the material. Of all the SPM techniques, atomic force microscopy has entertained unique opportunities for nondestructive and label-free measurements. Here, we explore the physics of the subsurface imaging problem and the emerging solutions that offer exceptional potential for visualization. We discuss materials science, electronics, biology, polymer and composite sciences, and emerging quantum sensing and quantum bio-imaging applications. The perspectives and prospects of subsurface techniques are presented to stimulate further work toward enabling noninvasive high spatial and spectral resolution investigation of materials including meta- and quantum materials.

74 ATOMIC AND MOLECULAR PHYSICS↗

Using Dark Fiber and Distributed Acoustic Sensing to Characterize a Geothermal System in the Imperial Valley, Southern California

The Imperial Valley, CA, is a tectonically active transtensional basin located south of the Salton Sea; the area hosts numerous geothermal fields, including significant hidden hydrothermal resources without surface manifestations. Development of inexpensive, rugged, and highly sensitive exploration techniques for undiscovered geothermal systems is critical for accelerating geothermal power deployment as well as unlocking a low-carbon energy future. We present a case study utilizing distributed acoustic sensing (DAS) and ambient noise interferometry for geothermal reservoir imaging, utilizing unlit fiber-optic telecommunication infrastructure (dark fiber). The study exploits two days of passive DAS data acquired in early November 2020 over a ~28-km section of fiber from Calipatria, CA to Imperial, CA. We apply ambient noise interferometry to retrieve coherent signals from DAS records and develop a bin stacking technique to attenuate the effects from persistent localized noise sources and to enhance retrieval of coherent surface waves. As a result, we are able to obtain high-resolution two-dimensional (2D) S wave velocity ($V_s$) structure to 3 km depth, based on joint inversion of both the fundamental and higher overtones. We observe a previously unmapped high $V_s$ and low $V_p$/$V_s$ ratio feature beneath the Brawley geothermal system, which we interpret to be a zone of hydrothermal mineralization and lower porosity. This interpretation is consistent with a host of other measurements including surface heat flow, gravity anomalies, and available borehole wireline data. These results demonstrate the potential utility of DAS deployed on dark fiber for geothermal system exploration and characterization in the appropriate geological settings.

Vp/Vs imaging↗

Optical recognition of constructs using hyperspectral imaging and detection (ORCHID)

Abstract Challenges to deep sample imaging have necessitated the development of special techniques such as spatially offset optical spectroscopy to collect signals that have travelled through several layers of tissue. However, these techniques provide only spectral information in one dimension (i.e., depth). Here, we describe a general and practical method, referred to as Optical Recognition of Constructs Using Hyperspectral Imaging and Detection (ORCHID). The sensing strategy integrates (1) the spatial offset detection concept by computationally binning 2D optical data associated with digital offsets based on selected radial pixel distances from the excitation source; (2) hyperspectral imaging using tunable filter; and (3) digital image binding and collation. ORCHID is a versatile modality that is designed to collect optical signals deep inside samples across three spatial (X, Y, Z) as well as spectral dimensions. The ORCHID method is applicable to various optical techniques that exhibit narrow-band structures, from Raman scattering to quantum dot luminescence. Samples containing surface-enhanced Raman scattering (SERS)-active gold nanostar probes and quantum dots embedded in gel were used to show a proof of principle for the ORCHID concept. The resulting hyperspectral data cube is shown to spatially locate target emitting nanoparticle volumes and provide spectral information for in-depth 3D imaging.

47 OTHER INSTRUMENTATION↗

Near-zero photon bioimaging by fusing deep learning and ultralow-light microscopy

Enhancing the reliability and reproducibility of optical microscopy by reducing specimen irradiance continues to be an important biotechnology target. As irradiance levels are reduced, however, the particle nature of light is heightened, giving rise to Poisson noise, or photon sparsity that restricts only a few (0.5%) image pixels to comprise a photon. Photon sparsity can be addressed by collecting approximately 200 photons per pixel; this, however, requires long acquisitions and, as such, suboptimal imaging rates. Here, we introduce near-zero photon bioimaging, a method that operates at kHz rates and 10,000-fold lower irradiance than standard microscopy. To achieve this level of performance, we uniquely combined a judiciously designed epifluorescence microscope enabling ultralow background levels and AI that learns to reconstruct biological images from as low as 0.01 photons per pixel. We demonstrate that near-zero photon bioimaging captures the structure of multicellular and subcellular features with high fidelity, including features represented by nearly zero photons. Beyond optical microscopy, the near-zero photon bioimaging paradigm can be applied in remote sensing, covert applications, and biomedical imaging that utilize damaging or quantum light.

AI↗

Quantifying Seasonal and Diurnal Cycles of Solar‐Induced Fluorescence With a Novel Hyperspectral Imager

Abstract Solar‐induced fluorescence (SIF) is a proxy of ecosystem photosynthesis that often scales linearly with gross primary productivity (GPP) at the canopy scale. However, the mechanistic relationship between GPP and SIF is still uncertain, especially at smaller temporal and spatial scales. We deployed a ultra‐hyperspectral imager over two grassland sites in California throughout a soil moisture dry down. The imager has high spatial resolution that limits mixed pixels, enabling differentiation between plants and leaves within one scene. We find that imager SIF correlates well with diurnal changes in leaf‐level physiology and gross primary productivity under well‐watered conditions. These relationships deteriorate throughout the dry down event. Our results demonstrate an advancement in SIF imaging with new possibilities in remotely sensing plant canopies from the leaf to the ecosystem. These data can be used to resolve outstanding questions regarding SIF's meaning and usefulness in terrestrial ecosystem monitoring.

60 APPLIED LIFE SCIENCES↗

Object sense and avoid system for autonomous vehicles

A system for determining a travel path for an autonomous vehicle (“AV”) to travel to a target while avoiding objects (i.e., obstacles) without the use of an imaging system is provided. An object sense and avoid (“OSA”) system detects objects in an object field that is adjacent to the AV and dynamically generates, as the AV travels, a travel path to the target to avoid the objects. The OSA system repeatedly uses sensors to collect sensor data of any objects in the object field. An object detection system then detects the objects and determines their locations based on triangulating ranges to an object as indicated by different sensors. The path planner system then plans a next travel direction for the AV to avoid the detected objects while seeking to minimize the distance traveled. The OSA system then instructs the AV to travel in the travel direction.

Beer, N. Reginald↗