Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Imaging pyrometry for most color cameras using a triple pass filter

A simple combination of the Planck blackbody emission law, optical filters, and digital image processing is demonstrated to enable most commercial color cameras (still and video) to be used as an imaging pyrometer for flames and explosions. The hardware and data processing described take advantage of the color filter array (CFA) that is deposited on the surface of the light sensor array present in most digital color cameras. In this work, a triple-pass optical filter incorporated into the camera lens allows light in three 10-nm wide bandpass regions to reach the CFA/light sensor array. These bandpass regions are centered over the maxima in the blue, green, and red transmission regions of the CFA, minimizing the spectral overlap of these regions normally present. A computer algorithm is used to retrieve the blue, green, and red image matrices from camera memory and correct for remaining spectral overlap. A second algorithm calibrates the corrected intensities to a gray body emitter of known temperature, producing a color intensity correction factor for the camera/filter system. The Wien approximation to the Planck blackbody emission law is used to construct temperature images from the three color (blue, green, red) matrices. A short pass filter set eliminates light of wavelengths longer than 750 nm, providing reasonable accuracy (±10%) for temperatures between 1200 and 6000 K. The effectiveness of this system is demonstrated by measuring the temperature of several systems for which the temperature is known.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Spatiotemporal cytokinin response imaging and ISOPENTENYLTRANSFERASE 3 function in Medicago nodule development

Most legumes can establish a symbiotic association with soil rhizobia that trigger the development of root nodules. These nodules host the rhizobia and allow them to fix nitrogen efficiently. The perception of bacterial lipo-chitooligosaccharides (LCOs) in the epidermis initiates a signaling cascade that allows rhizobial intracellular infection in the root and de-differentiation and activation of cell division that gives rise to the nodule. Thus, nodule organogenesis and rhizobial infection need to be coupled in space and time for successful nodulation. The plant hormone cytokinin (CK) contributes to the coordination of this process, acting as an essential positive regulator of nodule organogenesis. However, the temporal regulation of tissue-specific CK signaling and biosynthesis in response to LCOs or Sinorhizobium meliloti inoculation in Medicago truncatula remains poorly understood. In this study, using a fluorescence-based CK sensor (pTCSn::nls:tGFP), we performed a high-resolution tissue-specific temporal characterization of the sequential activation of CK response during root infection and nodule development in M. truncatula after inoculation with S. meliloti. Loss-of-function mutants of the CK-biosynthetic gene ISOPENTENYLTRANSFERASE 3 (IPT3) showed impairment of nodulation, suggesting that IPT3 is required for nodule development in M. truncatula. Simultaneous live imaging of pIPT3::nls:tdTOMATO and the CK sensor showed that IPT3 induction in the pericycle at the base of nodule primordium contributes to CK biosynthesis, which in turn promotes expression of positive regulators of nodule organogenesis in M. truncatula.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Fourier-based three-dimensional multistage transformer for aberration correction in multicellular specimens

High-resolution tissue imaging is often compromised by sample-induced optical aberrations that degrade resolution and contrast. Although wavefront sensor-based adaptive optics (AO) can measure these aberrations, such hardware solutions are typically complex, expensive to implement and slow when serially mapping spatially varying aberrations across large fields of view. Here we introduce AOViFT (adaptive optical vision Fourier transformer)—a machine learning-based aberration sensing framework built around a three-dimensional multistage vision transformer that operates on Fourier domain embeddings. AOViFT infers aberrations and restores diffraction-limited performance in puncta-labeled specimens with substantially reduced computational cost, training time and memory footprint compared to conventional architectures or real-space networks. We validated AOViFT on live gene-edited zebrafish embryos, demonstrating its ability to correct spatially varying aberrations using either a deformable mirror or postacquisition deconvolution. By eliminating the need for the guide star and wavefront sensing hardware and simplifying the experimental workflow, AOViFT lowers technical barriers for high-resolution volumetric microscopy across diverse biological samples.

Alshaabi, Thayer [Howard Hughes Medical Institute,↗
DOE OSTI2023

Multi-campaign ship and aircraft observations of marine cloud condensation nuclei and droplet concentrations

In situ marine cloud droplet number concentrations (CDNCs), cloud condensation nuclei (CCN), and CCN proxies, based on particle sizes and optical properties, are accumulated from seven field campaigns: ACTIVATE; NAAMES; CAMP 2 EX; ORACLES; SOCRATES; MARCUS; and CAPRICORN2. Each campaign involves aircraft measurements, ship-based measurements, or both. Measurements collected over the North and Central Atlantic, Indo-Pacific, and Southern Oceans, represent a range of clean to polluted conditions in various climate regimes. With the extensive range of environmental conditions sampled, this data collection is ideal for testing satellite remote detection methods of CDNC and CCN in marine environments. Remote measurement methods are vital to expanding the available data in these difficult-to-reach regions of the Earth and improving our understanding of aerosol-cloud interactions. The data collection includes particle composition and continental tracers to identify potential contributing CCN sources. Several of these campaigns include High Spectral Resolution Lidar (HSRL) and polarimetric imaging measurements and retrievals that will be the basis for the next generation of space-based remote sensors and, thus, can be utilized as satellite surrogates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

High resolution atomic force microscopy with an active piezoelectric microcantilever

Active microcantilevers with on-chip sensing and actuation provide significant advantages in tapping mode Atomic Force Microscopy (AFM). Collocated transduction allows for effective manipulation of cantilever dynamics through feedback control, enabling higher scan rates. However, the adjacency of the sensing and actuation electrodes is known to result in a high level of feedthrough, leading to a low imaging resolution. Readout circuit noise further deteriorates the imaging precision. Here, we investigate the noise sources that affect AFM microcantilevers with collocated aluminum nitride (AlN) actuator–sensor pairs. We reported these cantilevers in earlier work and demonstrated that they display a very low level of feedthrough between the actuation and sensing electrodes. We present a high signal-to-noise ratio (SNR) sensing method that enables us to demonstrate high-resolution AFM on a calibration grating with nm-step silicon carbide (SiC) terraces. In conclusion, measuring the Lorentzian response of the cantilever’s Brownian motion with the on-chip active sensor at resonance enables us to calibrate the dynamic stiffness at the first fundamental resonance mode, without utilizing an optical sensor.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Multi-amplifier Sensing Charge-coupled Devices for Next Generation Spectroscopy

We present characterization results and performance of a prototype Multiple-Amplifier Sensing (MAS) silicon charge-coupled device (CCD) sensor with 16 channels potentially suitable for faint object astronomical spectroscopy and low-signal, photon-limited imaging. The MAS CCD is designed to reach sub-electron readout noise by repeatedly measuring charge through a line of amplifiers during the serial transfer shifts. Using synchronized readout electronics based on the Dark Energy Spectroscopic Instrument CCD controller, we report a read noise of 1.03 e$^{−}$ rms pix$^{−1}$ at a speed of 26 μs pix$^{−1}$ with a single-sample readout scheme where charge in a pixel is measured only once for each output stage. At these operating parameters, we find the amplifier-to-amplifier charge transfer efficiency (ACTE) to be >0.9995 at low counts for all amplifiers but one for which the ACTE is 0.997. This charge transfer efficiency falls above 50,000 electrons for the read-noise optimized voltage configuration we chose for the serial clocks and gates. The amplifier linearity across a broad dynamic range from ∼300 to 35,000 e$^{−}$ was also measured to be ±2.5%. We describe key operating parameters to optimize on these characteristics and describe the specific applications for which the MAS CCD may be a suitable detector candidate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Cadillac CT6 Super Cruise On-road Data

This dataset encompasses about 60 individual drives of a 2019 Cadillac CT6 with Super Cruise in its relevant operational domain covering more than 1,000 miles. Adhering to the limited operational design domain of the investigated version of the Supercruise system, the majority of the data was collected during highway driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![cadillac-ct6 image](ct6.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

28nm front end ASIC and 12” LGADs for 3D integration

The 3DIntSenS Collaboration—a joint effort between SLAC, Fermilab, and LLNL—is developing enabling technologies for next-generation radiation imaging detectors that combine ultra-fine spatial resolution (≈10 μm) with precision timing (<20 ps), while maintaining low power <1 W/cm2 and high data throughput. The approach leverages 3D integration between advanced CMOS readout ASICs and finely pixelated LGAD sensors to achieve the performance and scalability required for large-area, high-rate applications. High-granularity, precision-timing detectors are essential for scientific advances in HEP, NP, BES, and FES, but widespread adoption is limited by the cost and complexity of 3D integration. To close this gap, the collaboration is developing LGAD sensors compatible with 12-inch commercial CMOS processes, enabling cost-effective integration with high-performance ASICs under development. We present the design and results from a 28 nm CMOS ASIC prototype, including a low-jitter front end, and in-pixel TDC demonstrating sub-10 ps timing resolution. We also report on the co-design and characterization of reticle-scale LGAD sensors with 50 μm and 100 μm pixels and introduce the next 10k-pixel ASIC designed for full 3D integration. These advances represent a critical step toward scalable, high-resolution radiation imaging systems for future scientific instrumentation.

England, Troy [Fermilab] (ORCID:0000000154405255)↗
DOE OSTI2025

Improved Gas Plume Identification Using Nearest Neighbor Methods for Background Estimation

Longwave infrared (LWIR) hyperspectral imaging (HSI) can be used for many tasks in remote sensing, including detecting and identifying effluent gases by LWIR sensors on airborne platforms. Identification is used after detection to increase confidence in weakly detected plumes, reduce false positives from detection, and distinguish between similar and confounding material signatures. Background estimation is an important step used to reveal the unique spectral characteristics of the detected gas, allowing the identification model to determine what the gas is specifically. The importance of proper background estimation increases when dealing with weak signals, large libraries of gases of interest, and uncommon or heterogeneous backgrounds. In this article, we propose two methods for background estimation: a novel k-nearest segments (KNS) algorithm and the standard k-nearest neighbors (KNN) algorithm. We test our methods and three existing background estimation methods for comparison against global background estimation to determine which performs best at estimating the true background radiance under a plume and for increasing identification confidence using a neural network classification model. We compare the different methods using 640 simulated weak plumes in an urban environment. For identification, our KNS algorithm improves median neural network identification confidence by 53.2%. For background radiance estimation, the KNN algorithm provides a median of 49 times less RMSE than global background estimation. Furthermore, KNN is the easiest method to tune for different plumes, making it an excellent “out of the box” background estimator.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Identification and demonstration of roGFP2 as an environmental sensor for cryogenic correlative light and electron microscopy

Cryogenic correlative light and electron microscopy (cryo-CLEM) seeks to leverage orthogonal information present in two powerful imaging modalities. While recent advances in cryogenic electron microscopy (cryo-EM) allow for the visualization and identification of structures within cells at the nanometer scale, information regarding the cellular environment, such as pH, membrane potential, ionic strength, etc., which influences the observed structures remains absent. Fluorescence microscopy can potentially be used to reveal this information when specific labels, known as fluorescent biosensors, are used, but there has been minimal use of such biosensors in cryo-CLEM to date. Here we demonstrate the applicability of one such biosensor, the fluorescent protein roGFP2, for cryo-CLEM experiments. At room temperature, the ratio of roGFP2 emission brightness when excited at 425 nm or 488 nm is known to report on the local redox potential. When samples containing roGFP2 are rapidly cooled to 77 K in a manner compatible with cryo-EM, the ratio of excitation peaks remains a faithful indicator of the redox potential at the time of freezing. Using purified protein in different oxidizing/reducing environments, we generate a calibration curve which can be used to analyze in situ measurements. As a proof-of-principle demonstration, we investigate the oxidation/reduction state within vitrified Caulobacter crescentus cells. The polar organizing protein Z (PopZ) localizes to the polar regions of C. crescentus where it is known to form a distinct microdomain. Finally, by expressing an inducible roGFP2-PopZ fusion we visualize individual microdomains in the context of their redox environment.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Shallow cumuli cover and its uncertainties from ground-based lidar–radar data and sky images

Cloud cover estimates of single-layer shallow cumuli obtained from narrow field-of-view (FOV) lidar–radar and wide-FOV total sky imager (TSI) data are compared over an extended period (2000–2017 summers) at the established United States Atmospheric Radiation Measurement mid-continental Southern Great Plains site. We quantify the impacts of two factors on hourly and sub-hourly cloud cover estimates: (1) instrument-dependent cloud detection and data merging criteria and (2) FOV configuration. Enhanced observations at this site combine the advantages of the ceilometer, micropulse lidar (MPL) and cloud radar in merged data products. Data collected by these three instruments are used to calculate narrow-FOV cloud fraction (CF) as a temporal fraction of cloudy returns within a given period. Sky images provided by TSI are used to calculate the wide-FOV fractional sky cover (FSC) as a fraction of cloudy pixels within a given image. To assess the impact of the first factor on CF obtained from the merged data products, we consider two additional subperiods (2000–2010 and 2011–2017 summers) that mark significant instrumentation and algorithmic advances in the cloud detection and data merging. We demonstrate that CF obtained from ceilometer data alone and FSC obtained from sky images provide the most similar and consistent cloud cover estimates; hourly bias and root-mean-square difference (RMSD) are within 0.04 and 0.12, respectively. However, CF from merged MPL–ceilometer data provides the largest estimates of the multiyear mean cloud cover, about 0.12 (35 %) and 0.08 (24 %) greater than FSC for the first and second subperiods, respectively. CF from merged ceilometer–MPL–radar data has the strongest subperiod dependence with a bias of 0.08 (24 %) compared to FSC for the first subperiod and shows no bias for the second subperiod. The strong period dependence of CF obtained from the combined ceilometer–MPL–radar data is likely results from a change in what sensors are relied on to detect clouds below 3 km. After 2011, the MPL stopped being used for cloud top height detection below 3 km, leaving the radar as the only sensor used in cloud top height retrievals. To quantify the FOV impact, a narrow-FOV FSC is derived from the TSI images. We demonstrate that FOV configuration does not modify the bias but impacts the RMSD (0.1 hourly, 0.15 sub-hourly). In particular, the FOV impact is significant for sub-hourly observations, where 41 % of narrow- and wide-FOV FSC differ by more than 0.1. A new “quick-look” tool is introduced to visualize impacts of these two factors through integration of CF and FSC data with novel TSI-based images of the spatial variability in cloud cover. The influence of cloud field organization, such cloud streets parallel to the wind direction, on narrow- and wide-FOV cloud cover estimates can be visually assessed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The impact of multi-sensor land data assimilation on river discharge estimation

River discharge is one of the most critical renewable water resources. Accurately estimating river discharge with land surface models (LSMs) remains challenging due to the difficulty in estimating land water storages such as snow, soil moisture, and groundwater. While data assimilation (DA) ingesting optical, microwave, and gravity measurements from space can help constrain theses storage states, its impacts on runoff and eventually river discharge are not fully understood. In this study, by taking advantage of recently published land DA results that jointly assimilate eight different combinations of observations from the Moderate Resolution Imaging Spectroradiometer (MODIS), Gravity Recovery and Climate Experiment (GRACE), and Advanced Microwave Scanning Radiometer for EOS (AMSR-E), we quantify to what degree multi-sensor land DA improves the river discharge simulation skills over 40 global river basins, and investigate the complementary strengths of different satellite measurements on river discharge. To be more specific, river discharge is updated by feeding gridded runoff from the eight multi-sensor DA simulations into a vector-based river routing model named the Routing Application for Parallel computatIon of Discharge (RAPID). Our modeling results, including 7-year simulations at 177,458 river reaches globally, are used to study the seasonal to interannual variability of river discharge. It is found that assimilating GRACE has the greatest impact on global runoff patterns, leading to the most pronounced improvements in spatial river discharge in the middle and high latitudes with the R 2 increased by 0.16. The seasonal variation of spatial discharge is most skillful during the boreal summer. However, our evaluation also shows model and DA still struggle to generate reasonable variability and averaged discharge over permafrost regions. Finally, by assessing how different satellites add value to discharge forecasts, this study paves the way for more advanced multi-sensor satellite data assimilation to predict the terrestrial hydrological cycle.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Effect of Image Classification Accuracy on Dasymetric Population Estimation

Dasymetric mapping involves the disaggregation of count data, usually relating to population/demographics, from census enumeration areas to smaller target zones with the aid of an ancillary layer related to population density. The ancillary layer is often a binary classification such as developed versus undeveloped, building versus non-building, and residential versus non-residential, in which one class is treated as populated and the other as unpopulated. While dasymetric mapping relies heavily on ancillary data, little research has been done to address the error in ancillary data and its effects on dasymetric mapping accuracy. This chapter reports our research effort to investigate the effect of image classification accuracy on dasymetric population estimates by developing a binomial classification of buildings from high-resolution remote sensor imagery. The classifier was systematically and iteratively manipulated to generate a series of outputs with variegated accuracy characteristics. Lastly, we generated a corresponding series of population estimates based on the mapped building area from each iteration to investigate the relationship between the accuracy of classification and population estimation.

McKee, Jacob↗
DOE OSTI2021

Relocating microseismicity from downhole monitoring of the Decatur CCS site using a modified double-difference algorithm

SUMMARY The injection of CO2 at the Decatur carbon capture and storage site has generated significant microseismic activity, which occurs in distinct spatial clusters up to approximately 2.2 km from the primary injection well. Accurate and precise event locations are vital for the characterization of the microseismicity to help understand the reservoir response to the CO2 injection, whilst enabling the identification of minor faults and fractures below the resolution of conventional active seismic imaging. However, microseismic monitoring of fluid injection sites, such as Decatur, is often performed using a network of borehole sensors often from a single well. While these downhole sensors have excellent detection capabilities, their poor azimuthal coverage limits the ability to precisely determine event locations. We have developed a modified double-difference relocation algorithm suitable for both 1-D and 3-D velocity models, and which incorporates differential back azimuth observations to allow the benefits of the original double-difference algorithm to be applicable to a downhole microseismic monitoring setting. Applying the modified double-difference algorithm to the microseismicity at Decatur, we have successfully relocated 4293 events. The relocation included over 59 million observations for 757 285 event pairs, split across seven geographic regions. Despite the majority of observations being recorded in only two boreholes, with an almost identical azimuthal coverage, the results have shown to be reliable with significantly reduced residuals and low uncertainties associated with the final locations. We have analysed the residuals in terms of their association with each geographic region, data type, station and individual events, to fully appreciate their influence in the inversion and the fit of the data to the final set of event locations. For each region, the relocated seismicity has become less diffuse with improved clustering, and with newly visible linear features often orientated in a NE–SW direction. These results show the potential improvements that can be made to microseismic event locations recorded by a borehole network with a limited and variable azimuthal distribution.

58 GEOSCIENCES↗
DOE OSTI2025

First Direct-Detection Results on Sub-GeV Dark Matter Using the SENSEI Detector at SNOLAB

Here, we present the first results from a dark matter search using six Skipper-CCDs in the SENSEI detector operating at SNOLAB. We employ a bias-mitigation technique of hiding approximately 46% of our total data and aggressively mask images to remove backgrounds. Given a total exposure after masking of 100.72 gram-days from well-performing sensors, we observe 55 two-electron events, 4 three-electron events, and no events containing 4–10 electrons. The two-electron events are consistent with pileup from one-electron events. Among the 4 three-electron events, 2 appear in pixels that are likely impacted by detector defects, although not strongly enough to trigger our “hot-pixel” mask. We use these data to set world-leading constraints on sub-GeV dark matter interacting with electrons and nuclei.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

First flight performance of the Micro-X microcalorimeter X-ray sounding rocket

The flight of the Micro-X sounding rocket on July 22, 2018, marked the first operation of transition-edge sensors and their superconducting quantum interference device readouts in space. Here, the instrument combines the microcalorimeter array with an imaging mirror to take high-resolution spectra from extended X-ray sources. The first flight target was the Cassiopeia A supernova remnant. Although a rocket pointing malfunction led to no time on-target, data from the flight were used to evaluate the performance of the instrument and demonstrate the flight viability of the payload. The instrument successfully achieved a stable cryogenic environment, executed all flight operations, and observed X-rays from the on-board calibration source. The flight environment did not significantly affect the performance of the detectors compared with ground operation. The flight provided an invaluable test of the impact of external magnetic fields and the instrument configuration on detector performance. This flight provides a milestone in the flight readiness of these detector and readout technologies, both of which have been selected for future X-ray observatories.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗