Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Pixel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Cross-scale sensing of field-level crop residue cover: Integrating field photos, airborne hyperspectral imaging, and satellite data

Conservation tillage practices can bring benefits to agricultural sustainability. Accurate spatial and temporal resolved information of field-scale crop residue cover, which reflects tillage intensity, is highly valuable for evaluating the outcomes of government conservation programs and voluntary ecosystem service markets, as well as facilitating agroecosystem modeling to quantify cropland biogeochemical processes. Remote sensing has the potential to cost-effectively detect crop residue cover, however, existing regional-scale studies were limited by insufficient ground truth data, scale mismatch between coarse satellite pixels and ground data, and the lack of key spectral data for detecting crop residues. Therefore, this study developed an innovative cross-sensing framework to integrate proximal sensing, airborne hyperspectral imaging, and satellite Earth Observation through deep learning to quantify field-level crop residue cover fractions at the regional scale. Specifically, we have collected intensive ground orthographic photos and conducted airborne hyperspectral surveys at corn and soybean fields of Champaign and nearby counties in Illinois, the heartland of the U.S. Corn Belt. Through semi-automatic labeling aided by ResNet-50 and superpixel image segmentation, we obtained 6719 records of ground residue fractions. With these ground data, we developed the 1-dimensional convolution neural network (CNN) model using airborne hyperspectral reflectance, which has 0.5m spatial resolution and 3–5 nm spectral resolution from 400 to 2400 nm, to predict residue fractions. By applying the CNN model to airborne pixels, we augmented “ground truth” data of crop residues and further combined them with Harmonized Landsat and Sentinel-2 (HLS) satellite data to quantify regional residue fractions at 30 m resolution. Results show that airborne hyperspectral imagery with CNN can accurately detect residue fractions (R 2 = 0.82, relative RMSE = 11.73%) to effectively generate quasi “ground truth” data to support satellite upscaling to all fields. With independent ground data for testing, we found that the ground-airborne-satellite integrative framework achieved better predictions in estimating crop residue cover (R 2 = 0.67, relative RMSE = 17.53%) than the conventional ground-satellite upscaling (R 2 = 0.22, relative RMSE = 32.09%). Here we also found that the shortwave infrared wavelengths, particularly 2100–2300 nm, are vital for predicting crop residue cover. Sentinel-2 and Landsat-8 data have a comparable capability to track residue fractions due to similar shortwave infrared wavelengths. This study highlights the high accuracy of hyperspectral imaging to detect agroecosystem tillage management practices and the advantages of cross-scale sensing to cost-effectively integrate multi-source data to quantify field-level agroecosystem variables across scales.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Long-term spatial and temporal solar resource variability over America using the NSRDB version 3 (1998–2017)

The study assesses the long-term spatial and temporal solar resource variability in America using the 20-year National Renewable Energy Laboratory's (NREL's) National Solar Radiation Database (NSRDB). Specifically, the coefficient of variation (COV) is used to analyze the spatial and temporal (interannual and seasonal) variability. Further, both spatial and temporal long-term variability are analyzed using the Köppen-Geiger climate classification. The temporal variability is found that, on average, the continental United States (CONUS) COV reaches up to 5% for global horizontal irradiance (GHI) and 10% for direct normal irradiance (DNI), and that the NSRDB domain's COV is roughly twice that of CONUS. For the seasonal variability analysis, the winter months are found to exhibit higher COV than the other seasons. In particular, December exhibits the highest variability, reaching on average 30% for DNI and 20% for GHI over various areas. On the other hand, the summer months demonstrate significantly lower variability, reaching only less than 20% for DNI and 10% for GHI, on average. Similarly, the spatial variability is analyzed by comparing each pixel to its neighbors. The long-term spatial variability is found to increase with the number of neighboring pixels being considered, which is equivalent to an increase in distance (within a 100-km x 100-km square grid). As expected, the DNI spatial variability is higher than that of GHI. Moreover, the annual solar irradiance anomalies are found to reach ±25% for both GHI and DNI (and even exceed those value in some instances) during each year of the 20-year period.

14 SOLAR ENERGY↗
DOE OSTI2013

Tile-Based Fisher-Ratio Software for Improved Feature Selection Analysis of Comprehensive Two-Dimensional Gas Chromatography Time-of-Flight Mass Spectrometry Data

Two-dimensional (2D) gas chromatography coupled with time-of-flight mass spectrometry (GC × GC – TOFMS) is a highly capable instrumental platform that produces complex and information-rich multi-dimensional chemical data. The complex data can be overwhelming, especially when many samples (of various sample classes) are analyzed with multiple injections for each sample. Thus, the data must be analyzed in such a way to extract the most meaningful information. The pixel-based and peak table-based algorithmic use of Fisher ratios has been used successfully in the past to reduce the multi-dimensional data down to those chemical compounds that are changing between classes relative to those that are not (i.e., chemical feature selection). We report on the initial development of a computationally fast novel tile-based Fisher-ratio software that addresses challenges due to 2D retention time misalignment without explicitly aligning the data, which is a problem for both pixel-based and peak table- based methods. Concurrently, the tile-based Fisher-ratio software maximizes the sensitivity contrast of true positives against a background of potential false positives and noise. To study this software, eight compounds, plus one internal standard, were spiked into diesel at various concentrations. The tile-based F-ratio software was able to discover all spiked analytes, within the complex diesel sample matrix with thousands of potential false positives, in each possible concentration comparison, even at the lowest absolute spiked analyte concentration ratio of 1.06.

chemometrics↗
DOE OSTI2016

Practical aspects of diffractive imaging using an atomic-scale coherent electron probe

Four-dimensional scanning transmission electron microscopy (4D-STEM) is a technique where a full two-dimensional convergent beam electron diffraction (CBED) pattern is acquired at every STEM pixel scanned. Capturing the full diffraction pattern provides a rich dataset that potentially contains more information about the specimen than is contained in conventional imaging modes using conventional integrating detectors. In this work, using 4D datasets in STEM from two specimens, monolayer MoS 2 and bulk SrTiO 3 , we demonstrate multiple STEM imaging modes on a quantitative absolute intensity scale, including phase reconstruction of the transmission function via differential phase contrast imaging. Finally, practical issues about sampling (i.e. number of detector pixels), signal-to-noise enhancement and data reduction of large 4D-STEM datasets are emphasized.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Experimental Assessment of Mammalian Lipidome Complexity Using Multimodal 21 T FTICR Mass Spectrometry Imaging

Herein, we assess the complementarity and complexity of data that can be detected within mammalian lipidome mass spectrometry imaging (MSI) via matrix-assisted laser desorption ionization (MALDI) and nanospray desorption electrospray ionization (nano-DESI). We do so by employing 21 T Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) with absorption mode FT processing in both cases, allowing unmatched mass resolving power per unit time (≥613k at m/z 760, 1.536 s transients). While our results demonstrated that molecular coverage and dynamic range capabilities were greater in MALDI analysis, nano-DESI provided superior mass error, and all annotations for both modes had sub-ppm error. Taken together, these experiments highlight the coverage of 1676 lipids and serve as a functional guide for expected lipidome complexity within nano-DESI-MSI and MALDI-MSI. To further assess the lipidome complexity, mass splits (i.e., the difference in mass between neighboring peaks) within single pixels were collated across all pixels from each respective MSI experiment. The spatial localization of these mass splits was powerful in informing whether the observed mass splits were biological or artificial (e.g., matrix related). Mass splits down to 2.4 mDa were observed (i.e., sodium adduct ambiguity) in each experiment, and both modalities highlighted comparable degrees of lipidome complexity. Further, we highlight the persistence of certain mass splits (e.g., 8.9 mDa; double bond ambiguity) independent of ionization biases. Here, we also evaluate the need for ultrahigh mass resolving power for mass splits ≤4.6 mDa (potassium adduct ambiguity) at m/z > 1000, which may only be resolved by advanced FTICR-MS instrumentation.

21T-FTICR-MS↗
DOE OSTI2016

Hyperspectral Dark Field Optical Microscopy of Single Silver Nanospheres

We record spectrally (400 nm ≤ λ ≤ 675 nm, Δλ < 4.69 nm) and spatially (diffraction-limited, sampled at 85 nm2/pixel) resolved dark field (DF) scattering from single silver nanospheres of 100 nm in diameter. Hyperspectral DF optical microscopy is achieved by coupling a hyperspectral detector to an optical microscope, whereby spectrally resolved diffraction-limited images of hundreds of silver nanoparticles can be recorded in ~30 seconds. We demonstrate how the centers and edges of individual particles can be localized in 2D to within a single pixel (85 nm2), using a statistical method for examining texture based on a co-occurrence matrix. Subsequently, spatial averaging of the spectral response in a 3x3 pixel area around the particle centers affords ample signal-to-noise to resolve the plasmon resonance of a single silver nanosphere. A close inspection of the scattering spectra of 31 different nanospheres reveals that each particle has its unique (i) relative scattering efficiency, and (ii) plasmon resonance maximum and dephasing time. These observations are suggestive of nanometric structural variations over length scales much finer than the spatial resolution attainable using the all-optical technique described herein.

Dark Field Scattering↗
DOE OSTI2018

Rapid Construction of Fe–Co–Ni Composition-Phase Map by Combinatorial Materials Chip Approach

100 nm thick Fe-Co-Ni materials chips were prepared and isothermally annealed at 500, 600 and 700oC, respectively. Pixel-by-pixel composition and structural mapping was performed by micro-beam X-ray at synchrotron light source. Diffraction images were recorded at a rate of 1 pattern/s. The XRD patterns were automatically processed, phase-identified and categorized by hierarchical clustering algorithm to construct the composition-phase map. Furthermore, the resulting maps are consistent with corresponding isothermal sections reported in the ASM Alloy Phase Diagram DatabaseTM, verifying the effectiveness of the present approach in phase diagram construction.

36 MATERIALS SCIENCE↗
DOE OSTI2019

First Observations of Gigantic Jets from Geostationary Orbit

In this work, we present the first observations of gigantic jets (GJs) by the Geostationary Lightning Mapper (GLM) on board the Geostationary Operational Environmental Satellite-R series. Fourteen GJs produced by Tropical Storm Harvey on 19 August 2017 were observed by both GLM and a ground-based low-light-level camera system. The majority of the GJs produced distinguishable signatures in the GLM data, which include long continuous emissions, large peak flash optical energies, and small lateral propagation distances in comparison with other flashes observed by GLM. For two GJs with the best ground-based images, each have a single pixel that contains the largest optical energy throughout the duration of the GJ and also coincides with the azimuth of the GJ from the video images. The optical energy of the pixel increases as the GJ propagates upward, reaches its peak when the GJ connects to the ionosphere, and then fades away.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Relative Controls of Vapor Pressure Deficit and Soil Water Stress on Canopy Conductance in Global Simulations by an Earth System Model

Climate change impacts drought and vapor pressure deficit (VPD) that critically influence land-atmosphere water vapor and CO 2 exchange. There is a lack of model-based global evaluation of the relative roles of the two types of water stresses in limiting canopy conductance (G c ). Using the Energy Exascale Earth System Model (E3SM), we conducted four land-atmosphere coupled simulations for the historical period with and without a plant hydraulics scheme (PHS) and under present-day and quadrupling of CO 2 concentrations. By fitting an empirical model of G c to the E3SM simulations, we evaluated the sensitivity of G c to water stresses caused by VPD and soil water (SW) in the growing season. The empirical model is based on a multiplicative algorithm that adjusts G c according to VPD, soil water saturation, and their interaction. Our results show positive trends of VPD over land during the historical period, with large differences between simulations with and without PHS. Despite the differences, a majority of land pixels that experience both SW and VPD stresses are in semi-arid and tropical savanna ecosystems. G c is more sensitive to VPD than SW in less than 20% of land pixels where the empirical model provides a good fit for the simulated G c . Ignoring SW and VPD interaction may underestimate the relative role of VPD on G c by as much as 28%. Including PHS accentuates SW stress limitation on G c by simulating wetter soil and higher ET that lower VPD. Elevated CO 2 reduces G c by increasing water use efficiency and ameliorates SW stress on G c .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Operating organic light-emitting diodes imaged by super-resolution spectroscopy

Super-resolution stimulated emission depletion microscopy is adapted here for materials characterization that would not otherwise be possible. With the example of organic lightemitting diodes (OLEDs), spectral imaging with pixel-by-pixel wavelength discrimination allows us to resolve local-chain environment encoded in the spectral response of the semiconducting polymer, and correlate chain packing with local electroluminescence by using externally applied current as the excitation source. We observe nanoscopic defects that would be unresolvable by traditional microscopy. They are revealed in electroluminescence maps in operating OLEDs with 50 nm spatial resolution. We find that brightest emission comes from regions with more densely packed chains. Conventional microscopy of an operating OLED would lack the resolution needed to discriminate these features, while traditional methods to resolve nanoscale features generally cannot be performed when the device is operating. Furthermore, this points the way towards real-time analysis of materials design principles in devices as they actually operate.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2020

A micromirror array with annular partitioning for high-speed random-access axial focusing

Dynamic axial focusing functionality has recently experienced widespread incorporation in microscopy, augmented/virtual reality (AR/VR), adaptive optics and material processing. However, the limitations of existing varifocal tools continue to beset the performance capabilities and operating overhead of the optical systems that mobilize such functionality. The varifocal tools that are the least burdensome to operate (e.g. liquid crystal, elastomeric or optofluidic lenses) suffer from low (≈100 Hz) refresh rates. Conversely, the fastest devices sacrifice either critical capabilities such as their dwelling capacity (e.g. acoustic gradient lenses or monolithic micromechanical mirrors) or low operating overhead (e.g. deformable mirrors). Here, we present a general-purpose random-access axial focusing device that bridges these previously conflicting features of high speed, dwelling capacity and lightweight drive by employing low-rigidity micromirrors that exploit the robustness of defocusing phase profiles. Geometrically, the device consists of an 8.2 mm diameter array of piston-motion and 48-μm-pitch micromirror pixels that provide 2π phase shifting for wavelengths shorter than 1100 nm with 10–90% settling in 64.8 μs (i.e., 15.44 kHz refresh rate). The pixels are electrically partitioned into 32 rings for a driving scheme that enables phase-wrapped operation with circular symmetry and requires <30 V per channel. Optical experiments demonstrated the array’s wide focusing range with a measured ability to target 29 distinct resolvable depth planes. Overall, the features of the proposed array offer the potential for compact, straightforward methods of tackling bottlenecked applications, including high-throughput single-cell targeting in neurobiology and the delivery of dense 3D visual information in AR/VR.

42 ENGINEERING↗
DOE OSTI2023

Snapshot multispectral imaging using a diffractive optical network

Abstract Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal-plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 λ m , where λ m is the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially repeating virtual spectral filter array with 2 × 2 = 4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Detection and imaging of chemicals and hidden explosives using terahertz time-domain spectroscopy and deep learning

Detecting concealed chemicals and explosives remains a critical challenge in global security. Terahertz time-domain spectroscopy (THz-TDS) offers a promising non-invasive and stand-off detection technique owing to its ability to penetrate optically opaque materials without causing ionization damage. While many chemicals exhibit distinct spectral features in the terahertz range, conventional terahertz-based detection methods often struggle in real-world environments, where variations in sample geometry, thickness, and packaging can lead to inconsistent spectral responses. In this study, we present a chemical imaging system that integrates THz-TDS with deep learning to enable accurate pixel-level identification and classification of different explosives. Operating in reflection mode and enhanced with plasmonic nanoantenna arrays, our THz-TDS system achieves a peak dynamic range of 96 dB and a detection bandwidth of 4.5 THz, supporting practical, stand-off operation. By analyzing individual time-domain pulses with deep neural networks, the system exhibits strong resilience to environmental variations and sample inconsistencies. Blind testing across eight chemicals—including pharmaceutical excipients and explosive compounds—resulted in an average classification accuracy of 99.42% at the pixel level. Notably, the system maintained an average accuracy of 88.83% when detecting explosives concealed under opaque paper coverings, demonstrating its robust generalization capability. These results highlight the potential of combining advanced terahertz spectroscopy with neural networks for highly sensitive and specific chemical and explosive detection in diverse and operationally relevant scenarios.

Imaging and sensing↗
DOE OSTI2017

Origami silicon optoelectronics for hemispherical electronic eye systems

Digital image sensors in hemispherical geometries offer unique imaging advantages over their planar counterparts, such as wide field of view and low aberrations. Deforming miniature semiconductor-based sensors with high-spatial resolution into such format is challenging. Here we introduce a simple origami approach for fabricating single-crystalline silicon-based focal plane arrays and artificial compound eyes that have hemisphere-like structures. Convex isogonal polyhedral concepts allow certain combinations of polygons to fold into spherical formats. Using each polygon block as a sensor pixel, the silicon-based devices are shaped into maps of truncated icosahedron and fabricated on flexible sheets and further folded either into a concave or convex hemisphere. These two electronic eye prototypes represent simple and low-cost methods as well as flexible optimization parameters in terms of pixel density and design. Results demonstrated in this work combined with miniature size and simplicity of the design establish practical technology for integration with conventional electronic devices.

42 ENGINEERING↗
DOE OSTI2019

Manifold learning of four-dimensional scanning transmission electron microscopy

Four-dimensional scanning transmission electron microscopy (4D-STEM) of local atomic diffraction patterns is emerging as a powerful technique for probing intricate details of atomic structure and atomic electric fields. However, efficient processing and interpretation of large volumes of data remain challenging, especially for two-dimensional or light materials because the diffraction signal recorded on the pixelated arrays is weak. Here we employ data-driven manifold leaning approaches for straightforward visualization and exploration analysis of 4D-STEM datasets, distilling real-space neighboring effects on atomically resolved deflection patterns from single-layer graphene, with single dopant atoms, as recorded on a pixelated detector. These extracted patterns relate to both individual atom sites and sublattice structures, effectively discriminating single dopant anomalies via multi-mode views. We believe manifold learning analysis will accelerate physics discoveries coupled between data-rich imaging mechanisms and materials such as ferroelectric, topological spin, and van der Waals heterostructures.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

A study of real-world micrograph data quality and machine learning model robustness

Abstract Machine-learning (ML) techniques hold the potential of enabling efficient quantitative micrograph analysis, but the robustness of ML models with respect to real-world micrograph quality variations has not been carefully evaluated. We collected thousands of scanning electron microscopy (SEM) micrographs for molecular solid materials, in which image pixel intensities vary due to both the microstructure content and microscope instrument conditions. We then built ML models to predict the ultimate compressive strength (UCS) of consolidated molecular solids, by encoding micrographs with different image feature descriptors and training a random forest regressor, and by training an end-to-end deep-learning (DL) model. Results show that instrument-induced pixel intensity signals can affect ML model predictions in a consistently negative way. As a remedy, we explored intensity normalization techniques. It is seen that intensity normalization helps to improve micrograph data quality and ML model robustness, but microscope-induced intensity variations can be difficult to eliminate.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Quantifying dislocation-type defects in post irradiation examination via transfer learning

The quantitative analysis of dislocation-type defects in irradiated materials is critical to materials characterization in the nuclear energy industry. The conventional approach of an instrument scientist manually identifying any dislocation defects is both time-consuming and subjective, thereby potentially introducing inconsistencies in the quantification. This work approaches dislocation-type defect identification and segmentation using a standard open-source computer vision model, YOLO11, that leverages transfer learning to create a highly effective dislocation defect quantification tool while using only a minimal number of annotated micrographs for training. This model demonstrates the ability to segment both dislocation lines and loops concurrently in micrographs with high pixel noise levels and on two alloys not represented in the training set. Inference of dislocation defects using transmission electron microscopy on three different irradiated alloys relevant to the nuclear energy industry are examined in this work with widely varying pixel noise levels and with completely unrelated composition and dislocation formations for practical post irradiation examination analysis. Code and models are available at https://github.com/idaholab/PANDA.

36 MATERIALS SCIENCE↗