SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Evaluation of UAV-derived multimodal remote sensing data for biomass prediction and drought tolerance assessment in bioenergy sorghum

Screening for drought tolerance is critical to ensure high biomass production of bioenergy sorghum in arid or semi-arid environments. The bottleneck in drought tolerance selection is the challenge of accurately predicting biomass for a large number of genotypes. Although biomass prediction by low-altitude remote sensing has been widely investigated on various crops, the performance of the predictions are not consistent, especially when applied in a breeding context with hundreds of genotypes. In some cases, biomass prediction of a large group of genotypes benefited from multimodal remote sensing data; while in other cases, the benefits were not obvious. In this study, we evaluated the performance of single and multimodal data (thermal, RGB, and multispectral) derived from an unmanned aerial vehicle (UAV) for biomass prediction for drought tolerance assessments within a context of bioenergy sorghum breeding. The biomass of 360 sorghum genotypes grown under well-watered and water-stressed regimes was predicted with a series of UAV-derived canopy features, including canopy structure, spectral reflectance, and thermal radiation features. Biomass predictions using canopy features derived from the multimodal data showed comparable performance with the best results obtained with the single modal data with coefficients of determination (R 2 ) ranging from 0.40 to 0.53 under water-stressed environment and 0.11 to 0.35 under well-watered environment. The significance in biomass prediction was highest with multispectral followed by RGB and lowest with the thermal sensor. Finally, two well-recognized yield-based drought tolerance indices were calculated from ground truth biomass data and UAV predicted biomass, respectively. Results showed that the geometric mean productivity index outperformed the yield stability index in terms of the potential for reliable predictions by the remotely sensed data. Collectively, this study demonstrated a promising strategy for the use of different UAV-based imaging sensors to quantify yield-based drought tolerance.

09 BIOMASS FUELS↗

DOE OSTI2021

WHISPER: Wireless Home Identification and Sensing Platform for Energy Reduction

Many regions of the world benefit from heating, ventilating, and air-conditioning (HVAC) systems to provide productive, comfortable, and healthy indoor environments, which are enabled by automatic building controls. Due to climate change, population growth, and industrialization, HVAC use is globally on the rise. Unfortunately, these systems often operate in a continuous fashion without regard to actual human presence, leading to unnecessary energy consumption. As a result, the heating, ventilation, and cooling of unoccupied building spaces makes a substantial contribution to the harmful environmental impacts associated with carbon-based electric power generation, which is important to remedy. For our modern electric power system, transitioning to low-carbon renewable energy is facilitated by integration with distributed energy resources. Automatic engagement between the grid and consumers will be necessary to enable a clean yet stable electric grid, when integrating these variable and uncertain renewable energy sources. We present the WHISPER (Wireless Home Identification and Sensing Platform for Energy Reduction) system to address the energy and power demand triggered by human presence in homes. The presented system includes a maintenance-free and privacy-preserving human occupancy detection system wherein a local wireless network of battery-free environmental, acoustic energy, and image sensors are deployed to monitor homes, record empirical data for a range of monitored modalities, and transmit it to a base station. Several machine learning algorithms are implemented at the base station to infer human presence based on the received data, harnessing a hierarchical sensor fusion algorithm. Results from the prototype system demonstrate an accuracy in human presence detection in excess of 95%; ongoing commercialization efforts suggest approximately 99% accuracy. Using machine learning, WHISPER enables various applications based on its binary occupancy prediction, allowing situation-specific controls targeted at both personalized smart home and electric grid modernization opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Comparison of pyrometry and thermography for thermal analysis of thermite reactions

This article examines the thermal behavior of a laser ignited thermite composed of aluminum and bismuth trioxide. Temperature data were collected during the reaction using a four-color pyrometer and a high-speed color camera modified for thermography. The two diagnostics were arranged to collect data simultaneously, with similar fields of view and with similar data acquisition rates, so that the two techniques could be directly compared. Results show that at initial and final stages of the reaction, a lower signal-to-noise ratio affects the accuracy of the measured temperatures. Both diagnostics captured the same trends in transient thermal behavior, but the average temperatures measured with thermography were about 750 K higher than those from the pyrometer. This difference was attributed to the lower dynamic range of the thermography camera’s image sensor, which was unable to resolve cooler temperatures in the field of view as well as the photomultiplier tube sensors in the pyrometer. Overall, while the camera could not accurately capture the average temperature of a scene, its ability to capture peak temperatures and spatial data make it the preferred method for tracking thermal behavior in thermite reactions.

36 MATERIALS SCIENCE↗

DOE OSTI2021

System Calibration Including Time Delay Estimation for GNSS/INS-Assisted Pushbroom Scanners Onboard UAV Platforms

Unmanned aerial vehicles (UAVs ) equipped with imaging sensors and integrated global navigation satellite system/inertial navigation system (GNSS/INS ) units are used for numerous applications. Deriving reliable 3D coordinates from such UAVs is contingent on accurate geometric calibration, which encompasses the estimation of mounting parameters and synchronization errors. Through a rigorous impact analysis of such systematic errors, this article proposes a direct approach for spatial and temporal calibration (estimating system parameters through a bundle adjustment procedure) of a GNSS/INS -assisted pushbroom scanner onboard a UAV platform. The calibration results show that the horizontal and vertical accuracies are within the ground sampling distance of the sensor. Unlike for frame camera systems, this article also shows that the indirect approach is not a feasible solution for pushbroom scanners due to their limited ability for decoupling system parameters. This finding provides further support that the direct approach is recommended for spatial and temporal calibration of UAV pushbroom scanner systems.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Layer-wise Imaging Dataset from Powder Bed Additive Manufacturing Processes for Machine Learning Applications (Peregrine v2022-10)

36 MATERIALS SCIENCE↗

DOE OSTI2023

Layer-wise Imaging Dataset from Powder Bed Additive Manufacturing Processes for Machine Learning Applications (Peregrine v2022-10.1)

This release consists of six datasets which together include multi-modal layer-wise powder bed images from two different powder bed printing technologies. These datasets are designed primarily to facilitate the development and testing of new computer vision and machine learning based anomaly and defect detection algorithms. The authors provide both training data with corresponding ground truth pixel masks and evaluation data with corresponding baseline prediction pixel masks made by a trained neural network. The laser powder bed fusion (L-PBF) datasets are sourced from EOS M290 and AddUp FormUp 350 printers and the binder jet (BJ) dataset is sourced from an ExOne M-Flex printer. The materials represented in these datasets include 17-4 PH Stainless Steel, GammaPrint-700, Inconel 718, Maraging Steel, and H13 Steel. The sensor imaging modalities represented include visible-light (VL), temporally-integrated (i.e., long duration exposure) near-infrared (TI-NIR), and wide-band infrared (IR). To download the dataset: (1) Create a Globus account. (2) Create a Globus Endpoint on your computer. (3) Transfer the dataset from the OLCF DOI-DOWNLOADS Collection to your Collection. Common troubleshooting steps: (a) Confirm that the transfer is going from OLCF DOI-DOWNLOADS to your Collection. (b) Create an exception for Globus in your antivirus software so that it can create an Endpoint. (c) Manually create a Globus access directory (where the data will be downloaded) by going to the Preferences > Access tab.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Helical Photonic Metamaterials for Encrypted Chiral Holograms

Helical structures are among the most quintessential three-dimensional (3D) forms that exhibit mirror asymmetry, a hallmark of chirality. Various structural parameters of helices directly linked to chiroptical properties highlight their importance as essential optical metamaterials for polarization-resolved sensors, imaging, and spectroscopies. However, such function-defining properties remain incompletely understood due to fabrication challenges and the lack of a relationship between structure and optical properties. Here, helical structures are analyzed parametrically, and correlations are established that are applicable to the design of chiral helical optical metamaterials. By systematically varying independent parameters—such as from single-turn to five-turn helices and from small major radii to larger ones optimized to fit the unit cell—the underlying relationships with ellipticty are revealed. In addition to theoretical modeling, the findings are experimentally validated using 3D printing and terahertz spectroscopy. The results demonstrate that optimized helical structures are mechanically tunable and exhibit unprecedented optical properties, including broadband and high-magnitude ellipticity spectra. Being embedded in soft elastomers, helical arrays can serve as soft, stretchable optical-mechanical sensors and holograms containing encoded information, such as barcodes and quick response (QR) codes. Chiral QR codes are realized using pixelated single helices with different handedness, demonstrating their potential as advanced encryption/decryption systems for security applications and chiral metaholograms.

Encrypted QR codes↗

DOE OSTI2023

Improved noise performance from the next-generation buried-channel p-MOSFET SiSeROs

The Single electron Sensitive Read Out (SiSeRO) is a novel on-chip charge detector output stage for charge-coupled device (CCD) image sensors. Developed at MIT Lincoln Laboratory, this technology uses a p-MOSFET transistor with a depleted internal gate beneath the transistor channel. The transistor source-drain current is modulated by the transfer of charge into the internal gate. At Stanford, we have developed a readout module based on the drain current of the on-chip transistor to characterize the device. In our earlier work, we characterized a number of first prototype SiSeROs with the MOSFET transistor channels at the surface layer. An equivalent noise charge (ENC) of around 15 electrons root mean square (RMS) was obtained. In this work, we examine the first buried-channel SiSeRO. Here we have achieved substantially improved noise performance of around 4.5 electrons root mean square (RMS) and a full width half maximum (FWHM) energy resolution of 132 eV at 5.9 keV, for a readout speed of 625 kpixel/s. We also discuss how digital filtering techniques can be used to further improve the SiSeRO noise performance. Additional measurements and device simulations will be essential to further mature the SiSeRO technology. This new device class presents an exciting new technology for the next-generation astronomical X-ray telescopes requiring fast, low-noise, radiation-hard megapixel imagers with moderate spectroscopic resolution.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Estimation of cutting tool wear using an elastomeric tactile sensor

Machining performance of cutting tools and part quality are affected by the geometric condition of the cutting edge, which is influenced by thermomechanical loads experienced during the process. Tool condition monitoring (TCM) systems provide insight for timely replacement of cutting tools. However, existing TCM systems are expensive and require specialized equipment or sensors, hindering widespread adoption. A novel TCM system is developed herein using an elastomeric tactile sensor. Sensor images of the cutting edge are used to quantify wear using two distinct algorithms. In the first algorithm, the unworn and worn edges are identified based on Canny edge detect. In the second, the unworn edge is identified using edge detection while the region of wear is identified using a relative intensity method. In both cases, the maximum wear width is calculated based on an experimentally determined pixel to-physical distance scale. The TCM system is first used to estimate flank wear on a solid carbide helical end mill before evaluating its robustness by employing it to estimate insert wear of an indexable helical end mill. Measurements are also performed manually using an optical microscope and a high-resolution focus variation microscope for verification. The novel technique estimates flank wear in the solid carbide tool with a high accuracy of 98%. Larger discrepancies are observed for the inserts, however, with overlapping uncertainties. In conclusion, the technique shows promise in adaptability, automation, and closed loop control of machine tools.

Machining↗

DOE OSTI2025

Semiconductor-compatible topological digital alloys

Recently, GeSn alloys have attracted much interest for direct-gap infrared photonics and as potential topological materials which are compatible with the semiconductor industry. However, for photonics, the high-Sn content required leads to low detectivity, associated with poor material quality, and the (>35 %) Sn required for topological properties have been out of reach experimentally. Here, we demonstrate that by patterning the Sn distribution within Ge, the electronic properties have a far greater tunability than is possible with the random alloy. For the GeSn δ-digital alloy (DA) formed by confining Sn atoms in atomic layer(s) along the [111] direction of Ge, we show that ∼ 10 % Sn can lead to a triple-point semimetal. These findings are understood in terms of Sn ordering causing spatial separation of Sn and Ge band edges, leading to band inversion. This mechanism can also lead to a weak topological insulator, Weyl semimetal, and enables tunable direct bandgaps down to 2 meV, covering the entire infrared range. This DA induced topological properties are also identified in compound semiconductors, such as InAs 1-x Sb x , showing the general applicability of the DA design for realizing topological properties on conventional semiconductor platforms. Furthermore, our findings not only point to a new class of currently unexplored topological systems accessible by epitaxy, but also establish the promise of low-Sn GeSn DAs for application as infrared laser diodes and photodetectors in Si photonic integrated circuits and infrared image sensors.

3D topological semimetal↗

DOE OSTI2025

Gate-Tunable Short-Wave Infrared Polycrystalline GeSn Phototransistors on Noncrystalline Substrates

GeSn is a group-IV alloy with immense potential to advance microelectronics technology due to its intrinsic compatibility with existing Si CMOS processes. With a sufficiently high Sn composition, GeSn is classified as a direct bandgap semiconductor. Polycrystalline GeSn holds several additional advantages, including its significantly lower synthesis cost compared to its epitaxial counterpart, as well as the versatility to grow these films on a variety of substrates. Here, in this work, we present a polycrystalline thin-film GeSn phototransistor on a fused silica substrate with a Sn composition of ~10%, showing a photoresponse in the short-wave infrared wavelength range, critical for emerging sensing applications. This device shows a gate-tunable response, with responsivities approaching up to 1.7 mA/W with only a 30 nm-thick GeSn layer. Furthermore, phototransistors offer additional adaptability through gating, which allows for the reduction of dark current. This not only enhances the signal-to-noise ratio but also offers more flexible integration with various image sensor readout implementations using different substrates. The specific detectivity of this phototransistor is within an order of magnitude of those of previously reported GeSn photodetectors grown by molecular beam epitaxy and chemical vapor deposition, even though the absorber is 3 to 20× thinner while the electrode spacing for photocarrier transport is approximately 15× longer than the carrier diffusion length in this work, showing great potential benefits of extending similar device structures to epitaxial GeSn layers. As these GeSn phototransistors utilize a noncrystalline substrate, our work establishes a fundamentally more versatile path toward monolithically integrated GeSn-based photodetectors for next-generation multimodal sensors.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Software for High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling

SF-26-078 This software provides a high-level workflow for satellite-based flood and surface-water mapping using Sentinel-1 SAR and Sentinel-2 multispectral imagery. It supports preparation of remote-sensing data, training and evaluation of deep-learning models, and generation of high-resolution water extent predictions, including methods to improve robustness to SAR speckle noise and cross-sensor image misalignment.

Feinstein, Jeremy [Argonne National Laboratory (AN↗

DOE OSTI2025

Massively parallel and universal approximation of nonlinear functions using diffractive processors

Nonlinear computation is essential for a wide range of information processing tasks, yet implementing nonlinear functions using optical systems remains a challenge due to the weak and power-intensive nature of optical nonlinearities. Overcoming this limitation without relying on nonlinear optical materials could unlock unprecedented opportunities for ultrafast and parallel optical computing systems. Here, we demonstrate that large-scale nonlinear computation can be performed using linear optics through optimized diffractive processors composed of passive phase-only surfaces. In this framework, the input variables of nonlinear functions are encoded into the phase of an optical wavefront—e.g., via a spatial light modulator (SLM)—and transformed by an optimized diffractive structure with spatially varying point-spread functions to yield output intensities that approximate a large set of unique nonlinear functions–all in parallel. We provide proof establishing that this architecture serves as a universal function approximator for an arbitrary set of bandlimited nonlinear functions, also covering wavelength-multiplexed nonlinear functions as well as multi-variate and complex-valued functions that are all-optically cascadable. Our analysis also indicates the successful approximation of typical nonlinear activation functions commonly used in neural networks, including the sigmoid, tanh, ReLU (rectified linear unit), and softplus. We numerically demonstrate the parallel computation of one million distinct nonlinear functions, accurately executed at wavelength-scale spatial density at the output of a diffractive optical processor. Furthermore, we experimentally validated this framework using in situ optical learning and approximated 35 unique nonlinear functions in a single shot using a compact setup consisting of an SLM and an image sensor. These results establish diffractive optical processors as a scalable platform for massively parallel universal nonlinear function approximation, paving the way for new capabilities in analog optical computing based on linear materials.

Rahman, Md Sadman Sakib [University of California,↗

DOE OSTI2025

Content-aware foveated camera for multi-target tracking

Modern image sensors deliver substantial space-time bandwidth, yet indiscriminate acquisition often overwhelms memory, computation, and downstream perception. We present a content-aware, multi-foveated camera that dynamically reallocates sensing and magnification to multiple regions of interest (ROIs). A phase-only spatial light modulator (SLM) serves as a solid-state, inertia-free beam-steering and lens element, enabling per-frame field-of-view (FOV) reconfiguration and content-aware target tracking. By interleaving frames across foveae, our system preserves a wide-FOV situational context while refreshing each ROI at high rates, thereby reducing data volume without degrading task performance. We constructed a prototype employing a single-SLM, single-sensor architecture and demonstrated its application in real-time multi-object tracking with dynamic ROI maintenance across multiple viewpoints. The approach offers a general pathway to integrate detection, tracking, and segmentation algorithms in the acquisition loop, shifting workload from post hoc processing to intelligent capture.

Zang, Zihan [Univ. of California, Los Angeles, CA ↗

DOE OSTI2024

Field-resolved space–time characterization of few-cycle structured light pulses

Accompanied by the rapid development of ultrafast laser platforms in recent decades, the spatiotemporal manipulation of ultrashort laser pulses has attracted much attention due to the potential for cutting-edge applications of structured light, including optical tweezers, optical communications, super-resolution imaging, time-resolved spectroscopy in molecules and quantum materials, and strong-field physics. Today, techniques capable of characterizing the full spatial, temporal, and polarization state properties of structured light are strongly desired. Here, we demonstrate a technique, termed 3D TIPTOE, for characterizing structured mid-infrared waveforms, which uses only a two-dimensional silicon-based image sensor as both the detector and the nonlinear medium. By combining the advantages of the sub-cycle time resolution afforded by nonlinear excitation and the spatial resolution inherent to the two-dimensional sensor, the 3D TIPTOE technique allows full characterization of structured electric fields, significantly reducing the complexity of detection compared to other techniques. The validity of the technique is established by measuring both few-cycle Bessel–Gaussian pulses and radially polarized femtosecond vector beams.

Liu, Yangyang (ORCID:0000000335205332)↗

DOE OSTI2024

Imaging Enhanced Simulation Validation for Directed Energy Deposition Additive Manufacturing (Final CRADA Report – NFE-22-09107)

Directed Energy Deposition (DED) is a welding-based metal Additive Manufacturing (AM) process that relies on the programmed rastering of an electric arc or laser induced weld pool to construct a component in a layerwise fashion. The induced complex thermal field and uneven thermal contraction depends on the printed geometry and scan pattern, and as such, accumulated residual stresses and distortions are complex and difficult to predict. Several prior works have resulted in tools to combat this issue; ANSYS has developed a thermoplastic simulation package targeting DED AM, and ORNL has developed an in-situ imaging sensor package ‘Stereo Correlated Optical and Pyrometric System’ (SCOPS) that can spatially monitor temperature and full field strain. In this CRADA, these tools are compared in order to validate the results and complimentarily address the weaknesses in each other.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Di-CNN: Domain-Knowledge-Informed Convolutional Neural Network for Manufacturing Quality Prediction

In manufacturing, convolutional neural networks (CNNs) are widely used on image sensor data for data-driven process monitoring and quality prediction. However, as purely data-driven models, CNNs do not integrate physical measures or practical considerations into the model structure or training procedure. Consequently, CNNs’ prediction accuracy can be limited, and model outputs may be hard to interpret practically. This study aims to leverage manufacturing domain knowledge to improve the accuracy and interpretability of CNNs in quality prediction. A novel CNN model, named Di-CNN, was developed that learns from both design-stage information (such as working condition and operational mode) and real-time sensor data, and adaptively weighs these data sources during model training. It exploits domain knowledge to guide model training, thus improving prediction accuracy and model interpretability. A case study on resistance spot welding, a popular lightweight metal-joining process for automotive manufacturing, compared the performance of (1) a Di-CNN with adaptive weights (the proposed model), (2) a Di-CNN without adaptive weights, and (3) a conventional CNN. The quality prediction results were measured with the mean squared error (MSE) over sixfold cross-validation. Model (1) achieved a mean MSE of 6.8866 and a median MSE of 6.1916, Model (2) achieved 13.6171 and 13.1343, and Model (3) achieved 27.2935 and 25.6117, demonstrating the superior performance of the proposed model.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Time resolved X-ray diffraction using the FIDDLE diagnostic at NIF: Preliminary assessment of diffraction precision

The Flexible Imaging Diffraction Diagnostic for Laser Experiments (FIDDLE) is a new diagnostic at the National Ignition Facility (NIF) designed to observe in situ solid-solid phase changes at high pressures using time resolved X-ray diffraction. FIDDLE currently incorporates five Icarus Ultrafast X-ray Imager sensors that take 2 ns snapshots and can be tuned to collect X-rays for tens of ns. The platform utilizes the laser power at NIF for both the laser drive and the generation of 10 keV X-rays for ~10 ns using a Ge backlighter foil. We aim to use FIDDLE to observe diffraction at different times during compression to probe the kinetics of phase changes. Pb undergoes two solid-solid phase transitions during ramp compression: from FCC to HCP and HCP to BCC. Results will be reported on some of the first shots using the FIDDLE diagnostic at NIF on ramp compressed Pb to a peak pressure of ~110 GPa and a single undriven CeO2 calibration shot. A discussion of the uncertainties in the observed diffraction is included.

Vennari, C. E.↗