Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

The United States Department of Energy and National Institutes of Health Collaboration: Medical Care Advances by Discovery in Radiation Detection

A National Institutes of Health (NIH) and U.S. Department of Energy (DOE) Office of Science virtual workshop on shared general topics was held in July of 2021 and reported on in this publication in January of 2023. Following the inaugural 2021 joint meeting representatives from the DOE Office of Science and NIH met to discuss organizing a second joint workshop that would concentrate on radiation detection to bring together teams from both agencies and their grantee populations to stimulate collaboration and efficiency. To meet this scientific mission within the NIH and DOE radiation detection space, the organizers assembled workshop sessions covering the state–of–the–art in cameras, detectors, and sensors for radiation external and internal (diagnostic and therapeutic) to human, data acquisition and electronics, image reconstruction and processing, and the application of artificial intelligence. NIH and DOE are committed to continuing the process of convening a joint workshop every 12–24 months. This Special Report recaps the findings of this second workshop. Beyond showing only the innovations and areas of success, important gaps in our knowledge were defined and presented. Finally, we summarize by defining four areas of greatest opportunity and need that emerged from the unique, dynamic dialogue the in–person workshop provided the attendees.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2024

Hot, cold, or just right? An infrared biometric sensor to improve occupant comfort and reduce overcooling in buildings via closed-loop control

To improve occupant comfort and save energy in buildings, we have developed a closed-loop air conditioning (AC) sensor-controller that predicts occupant thermal sensation from the thermographic measurement of skin temperature distribution, then uses this information to reduce overcooling (cooling-energy overuse that discomforts occupants) by regulating AC output. Taking measures to protect privacy, it combines thermal-infrared (TIR) and color (visible spectrum) cameras with machine vision to measure the skin-surface temperature profile. Since the human thermoregulation system uses skin blood flow to maintain thermoneutrality, the distribution of skin temperature can be used to predict warm, neutral, and cool thermal states. We conducted a series of human-subject thermal-sensation trials in cold-to-hot environments, measuring skin temperatures and recording thermal sensation votes. We then trained random-forest classification machine-learning models (classifiers) to estimate thermal sensation from skin temperatures or skin-temperature differences. The estimated thermal sensation was input to a proportional integral (PI) control algorithm for the AC, targeting a sensation level between neutral and warm. Our sensor-controller includes a sensor assembly, server software, and client software. The server software orients the cameras and transmits images to the client software, which in turn assesses occupant skin temperature distribution, estimates occupant thermal sensation, and controls AC operation. A demonstration conducted in a conference room in an office building near Houston, TX showed that our system reduced overcooling, decreasing AC load by 42% when the room was occupied while improving occupant comfort (fraction of “comfortable” votes) by 15 percentage points.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Using High-Performance Cameras for Advanced Plasma Diagnostics

We will present insights, challenges, and recent progress on using a multi-megapixel deep-depletion CCD camera for quantitative X-ray spectra in a single-hit exposure mode in order to optimize X-ray diffraction experiments. We will also present some applications of Sandia’s in-house developed hybrid CMOS (hCMOS) sensors, which can record up to four full frames of optical or X-ray images in sequences with only a few nanoseconds interframe timing in a single line-of-sight.

Geissel, Matthias [Sandia National Laboratories (S↗
DOE OSTI2023

Increased range and contrast in fog with circularly polarized imaging

Fogs, low lying clouds, and other highly scattering environments pose a challenge for many commercial and national security sensing systems. Current autonomous systems rely on optical sensors for navigation whose performance is degraded by highly scattering environments. In our previous simulation work, we have shown that polarized light can penetrate through a scattering environment such as fog. We have demonstrated that circularly polarized light maintains its initial polarization state better than linearly polarized light, even through large numbers of scattering events and thus ranges. This has recently been experimentally verified by other researchers. In this work, we present the design, construction, and testing of active polarization imagers at short-wave infrared and visible wavelengths. We explore multiple polarimetric configurations for the imagers, focusing on linear and circular polarization states. The polarized imagers were tested at the Sandia National Laboratories Fog Chamber under realistic fog conditions. Here, we show that active circular polarization imagers can increase range and contrast in fog better than linear polarization imagers. We show that when imaging typical road sign and safety retro-reflective films, circularly polarized imaging has enhanced contrast throughout most fog densities/ranges compared to linearly polarized imaging and can penetrate over 15 to 25 m into the fog beyond the range limit of linearly polarized imaging, with a strong dependence on the interaction of the polarization state with the target materials.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Characterizing electron-collecting CdTe for use in a 77 ns burst-rate imager

The Keck-PAD (pixel array detector) was developed at Cornell as a burst-rate imager capable of recording images from successive electron bunches (153 ns period) from the Advanced Photon Source (APS). Both Si and hole-collecting Schottky CdTe have been successfully bonded to this ASIC (application-specific integrated circuit) and used with this frame rate. The facility upgrades at the APS will lower the bunch period to 77 ns, which will require modifications to the Keck-PAD electronics to image properly at this reduced period. In addition, operation at high X-ray energies will require a different sensor material having a shorter charge collection time. For the target energy of 40 keV for this project, simulations have shown that electron-collecting CdTe should allow >90% charge collection within 35 ns. This collection time will be sufficient to sample the signal from one frame and prepare for the next. 750 µm-thick electron-collecting Schottky CdTe has been obtained from Acrorad and bonded to two different charge-integrating ASICs developed at Cornell, the Keck-PAD and the CU-APS-PAD. Carrier mobility has been investigated using the detector response to single X-ray bunches at the Cornell High Energy Synchrotron Source and to a pulsed optical laser. The tests indicate that the collection time will meet the requirements for 77 ns imaging.

36 MATERIALS SCIENCE↗
DOE OSTI2022

In situ detection and characterization of alkali-silica reaction damage in concrete using contactless ultrasonic wavefield imaging

Here we present work to characterize cracking damage in concrete caused by alkali-silica reactivity distress. We apply contactless ultrasonic scan inspection, exploiting Rayleigh wave scattering from concrete inhomogeneities. The scanning system utilizes a multi-channel MEMS sensor array to collect ultrasonic wavefield data from concrete subjected to ASR-promoting environments. The location and extent of ASR damage are established by internal expansion measurements from embedded strain gauges, scanning electron microscope images of cored samples, and expansion measurements from companion samples. A wavefield data processing method extracts oscillatory fields from the ultrasonic wavefield data to detect distinct zones of ASR damage. A damage index is proposed to further characterize the extent of ASR damage. The results confirm the feasibility and accuracy of the approach to characterize ASR damage in concrete. The fully contactless ultrasonic scanning measurement system does not require separate material samples and enables in situ characterization of ASR damage within concrete structures.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Thermal images collected during large-scale 3D printing with Ingersoll MasterPrint

This data set contains images produced to test the performance of anomaly and fault detection methods in the context of additive manufacturing. Two print jobs were executed using the Ingersoll MasterPrint with the Model 30 Strangpresse extruder. The material used was Techmer compounded polylactic acid (PLA) with wood flour as a filler (80/20 PLA/WF by weight). The first print job consists of the 3D printing of a hexagonal cylinder with a two-bead wall. This print was sliced at a gantry velocity of 3000 millimeter per minute, and an extruder screw speed of 68.14 rotations per minute. This are considered the normal operating conditions. A second hexagonal cylinder was printed using a reduced extruder screw speed, 15% lower than under normal operating conditions. The images were collected with a Teledyne FLIR Lepton 3.5 infra-red camera, a small form factor radiometric long-wave infrared camera with a spectral range of 8 µm to 14 µm. Sensor resolution was 160x120 pixels, with a pixel size of 12 µm, a temperature range of -10 - 450°C, and an accuracy of +/- 10°C in its low gain configuration. Images in this data set were collected with cameras oriented at the printer nozzle. The nozzle camera setup consisted of two cameras located 12.5cm from the nozzle center. These were mounted directly to the print head, so that the camera positions relative to the print direction would remain constant as it rotated around its C-axis to follow the print path. One camera was placed ahead of the nozzle to capture the previous layer immediately before being covered by the new layer of material, while the second camera was placed behind the nozzle and captured the freshly extruded bead. Images are collecting during each phase of the print: (a) idle (i.e., no material deposited), (b) extrusion (i.e., to prime the extruder), and (c) printing (deposition of material to manufacture the hexagonal cylinder).

36 MATERIALS SCIENCE↗
DOE OSTI2023

Low power and privacy preserving sensor platform for occupancy detection

A low-cost, low-power, stand-alone sensor platform having a visible-range camera sensor, a thermopile array, a microphone, a motion sensor, and a microprocessor that is configured to perform occupancy detection and counting while preserving the privacy of occupants. The platform is programmed to extract shape/texture from images in spatial domain; motion from video in time domain; and audio features in frequency domain. Embedded binarized neural networks are used for efficient object of interest detection. The platform is also programmed with advanced fusion algorithms for multiple sensor modalities addressing dependent sensor observations. The platform may be deployed for (i) residential use in detecting occupants for autonomously controlling building systems, such as HVAC and lighting systems, to provide energy savings, (ii) security and surveillance, such as to detect loitering and surveil places of interest, (iii) analyzing customer behavior and flows, (iv) identifying high performing stores by retailers.

Velipasalar, Senem↗
DOE OSTI2026

Evaluation of an event-driven 3FI ASIC for spectroscopic X-ray detection with synchrotron radiation

The novel design and evaluation on the NSLS-II beamline of the 3FI application-specific integrated circuit (ASIC) bump-bonded to a simple, planar, 2D segmented silicon sensor are presented. The ASIC was developed for full-field fluorescence spectral X-ray imaging (3FI). It is a small-scale prototype that features a square array of 32 × 32 pixels, and the size of the pixels is 100 µm × 100 µm. The ASIC was implemented in a 65 nm CMOS integrated circuit fabrication process. Each pixel incorporates a charge-sensitive amplifier, a shaping filter, a discriminator, a peak detector and a sample-and-hold circuit, allowing detection of events and storage of signal amplitudes. The system operates in a frameless event-driven readout mode, outputting analog values for threshold-triggered events, allowing high-speed multi-element X-ray fluorescence data acquisition. The 3FI ASIC achieves per-channel spectrometric performance at a power consumption of only 200 µW per pixel, with nearly all dissipation confined to the analog front-end. An energy resolution is measured at the level of 308 eV full width at half-maximum (FWHM) at 8.04 keV (Cu Kα), and 138 eV FWHM at 3.69 keV (Ca Kα). This per-pixel capability makes the prototype suitable for in situ trace element microanalysis in biological and environmental studies. Moreover, the frameless architecture of the detector is designed to address limitations of conventional X-ray fluorescence microscopy, which typically requires mechanical scanning, by enabling continuous high-throughput data acquisition in future full-field implementations.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗
DOE OSTI2025

WHYMSIE-SGP Field Campaign Report

Through a partnership between the U.S. National Aeronautics and Space Administration (NASA) and the National Oceanic and Atmospheric Administration (NOAA), this field campaign demonstrated first-of-its-kind hyperspectral microwave airborne measurements (Conical Scanning Millimeter-wave Imaging Radiometer [CoSMIR-H]). It was complemented by other passive (infrared, visible) and active (lidar) sensors onboard the NASA ER-2 aircraft. Serving as a future NASA planetary boundary-layer (PBL) mission prototype, the Westcoast and Heartland Hyperspectral Microwave Intensive Experiment (WH 2 yMSIE, formerly WHyMSIE) aimed to capture a wide variety of thermodynamic, moisture, and PBL regimes across a variety of surface types. The intensive operating period of the campaign spanned from October 22, 2024, through November 15, 2024, and included a large network of collaborators.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

An Algorithm to Retrieve Total Precipitable Water Vapor in the Atmosphere from FengYun 3D Medium Resolution Spectral Imager 2 (FY-3D MERSI-2) Data

The atmosphere has substantial effects on optical remote sensing imagery of the Earth’s surface from space. These effects come through the functioning of atmospheric particles on the radiometric transfer from the Earth’s surface through the atmosphere to the sensor in space. Precipitable water vapor (PWV), CO 2 , ozone, and aerosol in the atmosphere are very important among the particles through their functioning. This study presented an algorithm to retrieve total PWV from the Chinese second-generation polar-orbiting meteorological satellite FengYun 3D Medium Resolution Spectral Imager 2 (FY-3D MERSI-2) data, which have three near-infrared (NIR) water vapor absorbing channels, i.e., channel 16, 17, and 18. The algorithm was improved from the radiance ratio technique initially developed for Moderate-Resolution Imaging Spectroradiometer (MODIS) data. MODTRAN 5 was used to simulate the process of radiant transfer from the ground surfaces to the sensor at various atmospheric conditions for estimation of the coefficients of ratio technique, which was achieved through statistical regression analysis between the simulated radiance and transmittance values for FY-3D MERSI-2 NIR channels. The algorithm was then constructed as a linear combination of the three-water vapor absorbing channels of FY-3D MERSI-2. Measurements from two ground-based reference datasets were used to validate the algorithm: the sun photometer measurements of Aerosol Robotic Network (AERONET) and the microwave radiometer measurements of Energy’s Atmospheric Radiation Measurement Program (ARMP). The validation results showed that the algorithm performs very well when compared with the ground-based reference datasets. The estimated PWV values come with root mean square error (RMSE) of 0.28 g/cm 2 for the ARMP and 0.26 g/cm 2 for the AERONET datasets, with bias of 0.072 g/cm 2 and 0.096 g/cm 2 for the two reference datasets, respectively. The accuracy of the proposed algorithm revealed a better consistency with ground-based reference datasets. Thus, the proposed algorithm could be used as an alternative to retrieve PWV from FY-3D MERSI-2 data for various remote sensing applications such as agricultural monitoring, climate change, hydrologic cycle, and so on at various regional and global scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Using Fiducial Markers for Pose Estimation of an OSWEC in a Wave Tank: Preprint

In this study, we consider a novel method of sensing the motion of a wave energy converter during testing in a wave flume under the influence of incoming waves. The wave energy converter considered in our research is an oscillating surge wave energy converter, which is a hinged paddle that responds to incoming waves. Motion sensing is normally done with inertial sensors, which can hinder the motion due to suspended cables that carry power and transmit signals. Our proposed method is contactless and can be implemented economically. A camera is used to record different marker patterns affixed to the moving paddle and the motion deduced by pose estimation algorithms. Fiducial markers are commonly used for robot localization and in augmented reality. There are many types of fiducial markers, including ArUco-type markers which are accurate, fast and robust. The system consists of markers attached to the paddle element and recorded using a machine vision camera. A pose estimation algorithm is then applied to the detected markers to estimate the tilt of the paddle. In this work, we examine the challenges of image acquisition and calibration for underwater targets, compare the motion obtained by this new system with a calibrated tilt sensor and identify areas where the new system may be superior.

computer vision↗
DOE OSTI2024

A modular chemigenetic calcium indicator for multiplexed in vivo functional imaging

Abstract Genetically encoded fluorescent calcium indicators allow cellular-resolution recording of physiology. However, bright, genetically targetable indicators that can be multiplexed with existing tools in vivo are needed for simultaneous imaging of multiple signals. Here we describe WHaloCaMP, a modular chemigenetic calcium indicator built from bright dye-ligands and protein sensor domains. Fluorescence change in WHaloCaMP results from reversible quenching of the bound dye via a strategically placed tryptophan. WHaloCaMP is compatible with rhodamine dye-ligands that fluoresce from green to near-infrared, including several that efficiently label the brain in animals. When bound to a near-infrared dye-ligand, WHaloCaMP shows a 7× increase in fluorescence intensity and a 2.1-ns increase in fluorescence lifetime upon calcium binding. We use WHaloCaMP1a to image Ca 2+ responses in vivo in flies and mice, to perform three-color multiplexed functional imaging of hundreds of neurons and astrocytes in zebrafish larvae and to quantify Ca 2+ concentration using fluorescence lifetime imaging microscopy (FLIM).

Biochemistry & Molecular Biology↗
DOE OSTI2024

Persistent global greening over the last four decades using novel long-term vegetation index data with enhanced temporal consistency

Advanced Very High-Resolution Radiometer (AVHRR) satellite observations have provided the longest global daily records from 1980s, but the remaining temporal inconsistency in vegetation index datasets has hindered reliable assessment of vegetation greenness trends. To tackle this, we generated novel global long-term Normalized Difference Vegetation Index (NDVI) and Near-Infrared Reflectance of vegetation (NIRv) datasets derived from AVHRR and Moderate Resolution Imaging Spectroradiometer (MODIS). We addressed residual temporal inconsistency through three-step post processing including cross-sensor calibration among AVHRR sensors, orbital drifting correction for AVHRR sensors, and machine learning-based harmonization between AVHRR and MODIS. After applying each processing step, we confirmed the enhanced temporal consistency in terms of detrended anomaly, trend and interannual variability of NDVI and NIRv at calibration sites. Our refined NDVI and NIRv datasets showed a persistent global greening trend over the last four decades (NDVI: 0.0008 yr -1 ; NIRv: 0.0003 yr -1 ), contrasting with those without the three processing steps that showed rapid greening trends before 2000 (NDVI: 0.0017 yr -1 ; NIRv: 0.0008 yr -1 ) and weakened greening trends after 2000 (NDVI: 0.0004 yr -1 ; NIRv: 0.0001 yr -1 ). These findings highlight the importance of minimizing temporal inconsistency in long-term vegetation index datasets, which can support more reliable trend analysis in global vegetation response to climate changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Utilizing machine learning to improve the precision of fluorescence imaging of cavity-generated spin squeezed states

We present a supervised learning model to calibrate the photon collection rate during the fluorescence imaging of cold atoms. The linear regression model finds the collection rate at each location on the sensor such that the atomic population difference equals that of a highly precise optical cavity measurement. This 192 variable regression results in a measurement variance 27% smaller than our previous single variable regression calibration. The measurement variance is now in agreement with the theoretical limit due to other known noise sources. This model efficiently trains in less than a minute on a standard personal computer's CPU and requires less than 10 min of data collection. Furthermore, the model is applicable across a large change in population difference and across data collected on different days.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Electronic structure orientation as a map of in-plane antiferroelectricity in β'-In 2 Se 3

Antiferroelectric (AFE) materials are excellent candidates for sensors, capacitors, and data storage due to their electrical switchability and high-energy storage capacity. However, imaging the nanoscale landscape of AFE domains is notoriously inaccessible, which has hindered development and intentional tuning of AFE materials. Here, we demonstrate that polarization-dependent photoemission electron microscopy can resolve the arrangement and orientation of in-plane AFE domains on the nanoscale, despite the absence of a net lattice polarization. Through direct determination of electronic transition orientations and analysis of domain boundary constraints, we establish that antiferroelectricity in β'-In 2 Se 3 is a robust property from the scale of tens of nanometers to tens of micrometers. Ultimately, the method for imaging AFE domain organization presented here opens the door to investigations of the influence of domain formation and orientation on charge transport and dynamics.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Tesla Model 3 Autopilot On-road Data

This dataset encompasses about 60 individual drives of a 2020 Tesla Model 3 with Autopilot in its relevant operational domain covering more than 1,000 miles. The majority of the data was collected during highway and suburban driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![tesla m3 image](tesla-m3.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗