Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pixel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Brighter-fatter Effect in Near-infrared Detectors—III. Fourier-domain Treatment of Flat Field Correlations and Application to WFIRST

Weak gravitational lensing has emerged as a leading probe of the growth of cosmic structure. However, the shear signal is very small and accurate measurement depends critically on our ability to understand how non-ideal instrumental effects affect astronomical images. The Wide-Field Infrared Survey Telescope (WFIRST) will fly a focal plane containing 18 Teledyne H4RG-10 near-infrared detector arrays, which present different instrument calibration challenges from previous weak lensing observations. Previous work [Paper I: Hirata & Choi, PASP, 132, 014501 (2020); and Paper II: Choi & Hirata, PASP, 132, 014502 (2020)] has shown that correlation functions of flat field images, including cross-correlations between different time slices that are enabled by the non-destructive read capability of the infrared detectors, are effective tools for disentangling linear and nonlinear inter-pixel capacitance (IPC) and the brighter-fatter effect (BFE). Here we present a Fourier-domain treatment of the flat field correlations, which allows us to expand the previous formalism to all orders in IPC, BFE, and classical nonlinearity. We show that biases in simulated flat field analyses in Paper I are greatly reduced through the use of this formalism. We then apply this updated formalism to flat field data from three WFIRST flight candidate detectors, and explore the robustness to variations in the analysis. We find that the BFE is present in all three detectors, and that its contribution to the flat field correlations dominates over the nonlinear IPC, in accordance with the results from Paper II on a development detector. The magnitude of the BFE is such that the effective area of a pixel is increased by (3.54 ± 0.03) × 10 -7 for every electron deposited in a neighboring pixel (sensor chip assembly [SCA] 20829, statistical error, not IPC-deconvolved). We compare IPC maps from flat field autocorrelation measurements to those obtained from the single pixel reset method and find a median difference of 0.113% for SCA 20829. After further diagnosis of this difference, we ascribe it largely to an additional source of cross-talk, the vertical trailing pixel effect, and recommend further work to develop a model for this effect. These results represent a significant step toward calibration of the non-ideal effects in WFIRST detectors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Optics-Free Chip-Scale Intraoperative Imaging Using NIR-Excited Upconverting Nanoparticles

Here we present an optics-free CMOS image sensor that incorporates a novel time-gated dual-photodiode pixel design to allow filter- and lens-less image acquisition of near-infrared-excited (NIR-excited) upconverting nanoparticles. Recent biomedical advances have highlighted the benefits of NIR excitation, but NIR interaction with silicon has remained a challenge, even with high-performance optical blocking filters. Using a secondary diode and a dual-photodiode design, this sensor is able to remove the 100s of mV of NIR background on pixels and bring it down to single-digit mV level, nearing its noise floor of 2.2 mV rms, not achievable with any optical filter. Non-linear effects of background cancellation using the diode pair has been mitigated using an initial one-time pixel-level curve fitting and calibration in a post-processing setting. This imager comprises a highly linear 11 fF metal-oxide-metal (MOM) capacitor and includes integrated angle-selective gratings to reject oblique light and enhance sharpness. Each pixel also includes two distinct correlated double sampling schemes, to remove low frequency flicker noise and systematic offset in the datapath. We demonstrate the performance of this imager using pulsed NIR-excited upconverting nanoparticles on standard United-States-Air-Force (USAF) resolution targets and achieve an SNR of 15 dB, while keeping NIR background below 6 mV. This 36-by-80-pixel array measures only 2.3 mm by 4.8 mm and can be thinned down to 25 µm, allowing it to become surgically compatible with intraoperative instruments and equipment, while remaining optics-free.

42 ENGINEERING↗
DOE OSTI2018

Transparent Ceramic Garnet Gamma-Ray Spectrometer With Directionality

We have developed a handheld γ -ray spectrometer based on 1024 pixels, 2.8mm×2.8mm×6 mm in size, of gadolinium–yttrium–gallium–aluminum garnet (GYGAG) ((Gd,Y,Ce) 3 (Ga,Al) 5 O 12 ) ceramic scintillator (total of 48-cm 3 detector volume) coupled to silicon photodiode (SiPD) arrays. The SiPD arrays and readout ASIC, originally developed for medical imaging applications, have been adapted for portability in a lightweight box with heatsink and thermoelectric cooling. Custom readout firmware for γ-ray spectroscopy has been implemented, and a system user interface was developed that runs on an Android tablet. Here, we have optimized the processing of the GYGAG(Ce), the pixel optical coupling, and electronics readout parameters to obtain single pixel energy resolution as good as R(662keV)=3.1 % full-width at half-maximum and full device resolution with singles events from all pixels summed of 4.5%. When Compton-summed events are included, full-energy peak efficiency increases by ~2× , and R(662keV)=4.7 % is obtained for the full device. The pixelated architecture is leveraged to locate point sources of radiological materials using Compton imaging and active masking techniques. Directional detection of a 1 mCi Cs-137 source at 10 m can be made to ±10° in ~2 s.

42 ENGINEERING↗
DOE OSTI2018

In-flight verification of the calibration and performance of the ASTRO-H (Hitomi) Soft X-ray Spectrometer

The Soft X-ray Spectrometer onboard the Astro-H (Hitomi) orbiting x-ray observatory featured an array of 36 silicon thermistor x-ray calorimeters optimized to perform high spectral resolution x-ray imaging spectroscopy of astrophysical sources in the 0.3- to 12-keV band. Extensive preflight calibration measurements are the basis for our modeling of the pulse height–energy relation and energy resolution for each pixel and event grade, telescope collecting area, detector efficiency, and pulse arrival time. Because of the early termination of mission operations, we needed to extract the maximum information from observations performed only days into the mission when the onboard calibration sources had not yet been commissioned and the dewar was still coming into thermal equilibrium, so our technique for reconstructing the per-pixel time-dependent pulse height–energy relation had to be modified. The gain scale was reconstructed using a combination of an absolute energy scale calibration at a single time using a fiducial from an onboard radioactive source and calibration of a dominant time-dependent gain drift component using a dedicated calibration pixel, as well as a residual time-dependent variation using spectra from the Perseus cluster of galaxies. The energy resolution was also measured using the onboard radioactive sources. It is consistent with instrument-level measurements accounting for the modest increase in noise due to spacecraft systems interference. We use observations of two pulsar wind nebulae to validate our models of the telescope area and detector efficiency and to derive a more accurate value for the thickness of the gate-valve Be window, which had not been opened by the time mission operations ceased. We use observations of the Crab nebula to refine the pixel-to-pixel timing and validate the absolute timing.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

SU-D-201-06: Random Walk Algorithm Seed Localization Parameters in Lung Positron Emission Tomography (PET) Images

Purpose: The objective of this study was to find the best seed localization parameters in random walk algorithm application to lung tumor delineation in Positron Emission Tomography (PET) images. Methods: PET images suffer from statistical noise and therefore tumor delineation in these images is a challenging task. Random walk algorithm, a graph based image segmentation technique, has reliable image noise robustness. Also its fast computation and fast editing characteristics make it powerful for clinical purposes. We implemented the random walk algorithm using MATLAB codes. The validation and verification of the algorithm have been done by 4D-NCAT phantom with spherical lung lesions in different diameters from 20 to 90 mm (with incremental steps of 10 mm) and different tumor to background ratios of 4:1 and 8:1. STIR (Software for Tomographic Image Reconstruction) has been applied to reconstruct the phantom PET images with different pixel sizes of 2×2×2 and 4×4×4 mm{sup 3}. For seed localization, we selected pixels with different maximum Standardized Uptake Value (SUVmax) percentages, at least (70%, 80%, 90% and 100%) SUVmax for foreground seeds and up to (20% to 55%, 5% increment) SUVmax for background seeds. Also, for investigation of algorithm performance on clinical data, 19 patients with lung tumor were studied. The resulted contours from algorithm have been compared with nuclear medicine expert manual contouring as ground truth. Results: Phantom and clinical lesion segmentation have shown that the best segmentation results obtained by selecting the pixels with at least 70% SUVmax as foreground seeds and pixels up to 30% SUVmax as background seeds respectively. The mean Dice Similarity Coefficient of 94% ± 5% (83% ± 6%) and mean Hausdorff Distance of 1 (2) pixels have been obtained for phantom (clinical) study. Conclusion: The accurate results of random walk algorithm in PET image segmentation assure its application for radiation treatment planning and diagnosis.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-E-J-113: Effects of Deformable Registration On First-Order Texture Maps Calculated From Thoracic Lung CT Scans

Purpose: To determine the stability of eight first-order texture features following the deformable registration of serial computed tomography (CT) scans. Methods: CT scans at two different time points from 10 patients deemed to have no lung abnormalities by a radiologist were collected. Following lung segmentation using an in-house program, texture maps were calculated from 32×32-pixel regions of interest centered at every pixel in the lungs. The texture feature value of the ROI was assigned to the center pixel of the ROI in the corresponding location of the texture map. Pixels in the square ROI not contained within the segmented lung were not included in the calculation. To quantify the agreement between ROI texture features in corresponding pixels of the baseline and follow-up texture maps, the Fraunhofer MEVIS EMPIRE10 deformable registration algorithm was used to register the baseline and follow-up scans. Bland-Altman analysis was used to compare registered scan pairs by computing normalized bias (nBias), defined as the feature value change normalized to the mean feature value, and normalized range of agreement (nRoA), defined as the range spanned by the 95% limits of agreement normalized to the mean feature value. Results: Each patient’s scans contained between 6.8–15.4 million ROIs. All of the first-order features investigated were found to have an nBias value less than 0.04% and an nRoA less than 19%, indicating that the variability introduced by deformable registration was low. Conclusion: The eight first-order features investigated were found to be registration stable. Changes in CT texture maps could allow for temporal-spatial evaluation of the evolution of lung abnormalities relating to a variety of diseases on a patient-by-patient basis. SGA and HA receives royalties and licensing fees through the University of Chicago for computer-aided diagnosis technology. Research reported in this publication was supported by the National Institute Of General Medical Sciences of the National Institutes of Health under Award Number R25GM109439.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-E-T-33: A Feasibility-Seeking Algorithm Applied to Planning of Intensity Modulated Proton Therapy: A Proof of Principle Study

Purpose: To investigate the applicability of feasibility-seeking cyclic orthogonal projections to the field of intensity modulated proton therapy (IMPT) inverse planning. Feasibility of constraints only, as opposed to optimization of a merit function, is less demanding algorithmically and holds a promise of parallel computations capability with non-cyclic orthogonal projections algorithms such as string-averaging or block-iterative strategies. Methods: A virtual 2D geometry was designed containing a C-shaped planning target volume (PTV) surrounding an organ at risk (OAR). The geometry was pixelized into 1 mm pixels. Four beams containing a subset of proton pencil beams were simulated in Geant4 to provide the system matrix A whose elements a-ij correspond to the dose delivered to pixel i by a unit intensity pencil beam j. A cyclic orthogonal projections algorithm was applied with the goal of finding a pencil beam intensity distribution that would meet the following dose requirements: D-OAR < 54 Gy and 57 Gy < D-PTV < 64.2 Gy. The cyclic algorithm was based on the concept of orthogonal projections onto half-spaces according to the Agmon-Motzkin-Schoenberg algorithm, also known as ‘ART for inequalities’. Results: The cyclic orthogonal projections algorithm resulted in less than 5% of the PTV pixels and less than 1% of OAR pixels violating their dose constraints, respectively. Because of the abutting OAR-PTV geometry and the realistic modelling of the pencil beam penumbra, complete satisfaction of the dose objectives was not achieved, although this would be a clinically acceptable plan for a meningioma abutting the brainstem, for example. Conclusion: The cyclic orthogonal projections algorithm was demonstrated to be an effective tool for inverse IMPT planning in the 2D test geometry described. We plan to further develop this linear algorithm to be capable of incorporating dose-volume constraints into the feasibility-seeking algorithm.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-F-303-11: Implementation and Applications of Rapid, SIFT-Based Cine MR Image Binning and Region Tracking

Purpose: To develop a novel and rapid, SIFT-based algorithm for assessing feature motion on cine MR images acquired during MRI-guided radiotherapy treatments. In particular, we apply SIFT descriptors toward both partitioning cine images into respiratory states and tracking regions across frames. Methods: Among a training set of images acquired during a fraction, we densely assign SIFT descriptors to pixels within the images. We cluster these descriptors across all frames in order to produce a dictionary of trackable features. Associating the best-matching descriptors at every frame among the training images to these features, we construct motion traces for the features. We use these traces to define respiratory bins for sorting images in order to facilitate robust pixel-by-pixel tracking. Instead of applying conventional methods for identifying pixel correspondences across frames we utilize a recently-developed algorithm that derives correspondences via a matching objective for SIFT descriptors. Results: We apply these methods to a collection of lung, abdominal, and breast patients. We evaluate the procedure for respiratory binning using target sites exhibiting high-amplitude motion among 20 lung and abdominal patients. In particular, we investigate whether these methods yield minimal variation between images within a bin by perturbing the resulting image distributions among bins. Moreover, we compare the motion between averaged images across respiratory states to 4DCT data for these patients. We evaluate the algorithm for obtaining pixel correspondences between frames by tracking contours among a set of breast patients. As an initial case, we track easily-identifiable edges of lumpectomy cavities that show minimal motion over treatment. Conclusions: These SIFT-based methods reliably extract motion information from cine MR images acquired during patient treatments. While we performed our analysis retrospectively, the algorithm lends itself to prospective motion assessment. Applications of these methods include motion assessment, identifying treatment windows for gating, and determining optimal margins for treatment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

WE-G-204-06: Grid-Line Artifact Minimization for High Resolution Detectors Using Iterative Residual Scatter Correction

Purpose: Anti-scatter grid-line artifacts are more prominent for high-resolution x-ray detectors since the fraction of a pixel blocked by the grid septa is large. Direct logarithmic subtraction of the artifact pattern is limited by residual scattered radiation and we investigate an iterative method for scatter correction. Methods: A stationary Smit-Rοntgen anti-scatter grid was used with a high resolution Dexela 1207 CMOS X-ray detector (75 µm pixel size) to image an artery block (Nuclear Associates, Model 76-705) placed within a uniform head equivalent phantom as the scattering source. The image of the phantom was divided by a flat-field image obtained without scatter but with the grid to eliminate grid-line artifacts. Constant scatter values were subtracted from the phantom image before dividing by the averaged flat-field-with-grid image. The standard deviation of pixel values for a fixed region of the resultant images with different subtracted scatter values provided a measure of the remaining grid-line artifacts. Results: A plot of the standard deviation of image pixel values versus the subtracted scatter value shows that the image structure noise reaches a minimum before going up again as the scatter value is increased. This minimum corresponds to a minimization of the grid-line artifacts as demonstrated in line profile plots obtained through each of the images perpendicular to the grid lines. Artifact-free images of the artery block were obtained with the optimal scatter value obtained by this iterative approach. Conclusion: Residual scatter subtraction can provide improved grid-line artifact elimination when using the flat-field with grid “subtraction” technique. The standard deviation of image pixel values can be used to determine the optimal scatter value to subtract to obtain a minimization of grid line artifacts with high resolution x-ray imaging detectors. This study was supported by NIH Grant R01EB002873 and an equipment grant from Toshiba Medical Systems Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Improved accuracy of quantitative parameter estimates in dynamic contrast-enhanced CT study with low temporal resolution

Purpose: A previously proposed method to reduce radiation dose to patient in dynamic contrast-enhanced (DCE) CT is enhanced by principal component analysis (PCA) filtering which improves the signal-to-noise ratio (SNR) of time-concentration curves in the DCE-CT study. The efficacy of the combined method to maintain the accuracy of kinetic parameter estimates at low temporal resolution is investigated with pixel-by-pixel kinetic analysis of DCE-CT data. Methods: The method is based on DCE-CT scanning performed with low temporal resolution to reduce the radiation dose to the patient. The arterial input function (AIF) with high temporal resolution can be generated with a coarsely sampled AIF through a previously published method of AIF estimation. To increase the SNR of time-concentration curves (tissue curves), first, a region-of-interest is segmented into squares composed of 3 × 3 pixels in size. Subsequently, the PCA filtering combined with a fraction of residual information criterion is applied to all the segmented squares for further improvement of their SNRs. The proposed method was applied to each DCE-CT data set of a cohort of 14 patients at varying levels of down-sampling. The kinetic analyses using the modified Tofts’ model and singular value decomposition method, then, were carried out for each of the down-sampling schemes between the intervals from 2 to 15 s. The results were compared with analyses done with the measured data in high temporal resolution (i.e., original scanning frequency) as the reference. Results: The patients’ AIFs were estimated to high accuracy based on the 11 orthonormal bases of arterial impulse responses established in the previous paper. In addition, noise in the images was effectively reduced by using five principal components of the tissue curves for filtering. Kinetic analyses using the proposed method showed superior results compared to those with down-sampling alone; they were able to maintain the accuracy in the quantitative histogram parameters of volume transfer constant [standard deviation (SD), 98th percentile, and range], rate constant (SD), blood volume fraction (mean, SD, 98th percentile, and range), and blood flow (mean, SD, median, 98th percentile, and range) for sampling intervals between 10 and 15 s. Conclusions: The proposed method of PCA filtering combined with the AIF estimation technique allows low frequency scanning for DCE-CT study to reduce patient radiation dose. The results indicate that the method is useful in pixel-by-pixel kinetic analysis of DCE-CT data for patients with cervical cancer.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2018

Direct binary search for improved coherent beam shaping and optical differentiation wavefront sensing

Spatially dithered distributions of binary amplitude pixels are optimized using a full direct binary search taking into account the experimental configuration for amplitude modulation of coherent waves. This design process is shown to yield a significant reduction of the noise induced by binarization and pixelation over the region of interest. In this study, we demonstrate this approach for beam shaping and optical differentiation wavefront sensing, where the region of interest is in an image plane of the pixel distribution and in the far field of the pixel distribution, respectively. Lastly, the observed reduction in error compared to a standard error diffusion algorithm is significant for both applications because it improves performance without the tighter fabrication tolerance and cost associated with smaller pixels.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

CHESS 2025: Orthorectified airborne RGB imagery from NEON AOP surveys

This dataset provides Level 1 (L1) and Level 3 (L3) orthorectified Red-Green-Blue (RGB) imagery collected for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). This high-resolution imagery is a photographic record of red, green, and blue visible light from sunlight reflected off of the Earth’s surface. The data comprise full-color images of the ground surface and are primarily intended to provide context to imaging spectroscopy and light detection and ranging (LiDAR) data. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. RGB images were acquired using the PhaseOne IXM-RS150F high-resolution digital camera onboard the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP). The package data include both an L1 product comprising one camera frame per file and an L3 mosaic aligned to the Universal Transverse Mercator (UTM) Zone 13N grid and the World Geodetic System (WGS) 84 projection. Both products are provided in geotif (.tif) format at 0.1 m ground resolution. The bulk of the imagery was collected during the main CHESS field campaign from June 13 to July 15, 2025. Additional images of a portion of the Upper Taylor (UPTA) domain were collected on September 18, 2025, to fill gaps in imagery identified after the main campaign was complete. RGB camera imagery is not radiometrically calibrated, and therefore pixel values should not be exploited for scientific analysis. Pixel values have undergone a manual adjustment to enhance feature identification. The imagery is rigorously geolocated which does allow for reliable geometric information to be retrieved. To generate the orthorectified imagery, the NEON AOP camera captured visible spectrum in red, green, and blue bands. The raw images were then processed using NEON’s camera orthorectification workflow. A boresight calibration flight was made to build a complete camera, distortion, and alignment model. Color balance/white balance and exposure correction were applied to the raw RGB images. The corrected images were orthorectified by ray-tracing image pixels to a lidar-derived digital surface model (DSM) mesh using the refined camera model, outputting orthorectified raster pixels on a regular grid. Flightline-level data were mosaicked by selecting per-pixel contributions from overlapping orthorectified images using line-of-sight (LOS) zenith angle minimization to reduce edge distortions. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2017

Manufacturing Technology Development for Visible Color Filters

Sandia National Laboratories (SNL) and Rockwell Collins Inc. (RCI) developed new metallic filters for separating red, green, and blue channels. These designs were not based on traditional absorptive dye layers. This technology is well-established, but difficult to change from pixel to pixel as pixels shrink in size and increase in number. These films are also quite lossy: throwing away needed light in low-light applications. The SNL-RCI technology investigated metal plasmonic filters. These patterns are a single thin layer and the metal pattern may be changed from one pixel to the next simply by varying the metal pattern shape or dimensions. This allows adjacent pixels to view different colors with an efficient processing method and without loss of as much loss as the dye technology.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Production-Ready CsPbBr3 Module Fabrication

The purpose of this SBIR was to work on evaluation, development, and testing of CsPbBr3 semiconductors for use in commercial gamma-ray detection. The overarching goal was to demonstrate the capability to fabricate functional detectors through resources available to H3D, Inc in pursuit of an alternative to CdZnTe for room-temperature semiconductor detectors. Throughout the project, CdZnTe crystals from Redlen were used as a control group to demonstrate whether the fabrication processes could produce reasonable results. The CdZnTe crystals were diced into roughly 6 mm x 6 mm x 4.5 mm pieces and electrodes were evaporated onto planar faces. In one case, pixels were patterned through a laser ablation method; in the other, a rudimentary pixel shadow-mask was fabricated, and the pixels were generated in the evaporation process. A 16 mm x 16 mm x 14 mm CsPbBr3 crystal was diced into four smaller crystals. These CsPbBr3 had electrodes applied in a similar way to the CdZnTe samples with a rudimentary mask used for pixels on the cathode. Tested CdZnTe pieces were found to generally function with reasonable, low-energy performance. CsPbBr3 crystals were found to be non-functional under forward bias with a large dark-current. A separate attempt, using reverse bias in a non-H3D, Inc test system, observed a dark current similar to previous observations, and some active pixels but no waveforms were observed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2017

Triton: Igiugig Fish Video Analysis (Project Report)

This document summarizes the analysis of video data collected around the Ocean Renewable Power Company’s RivGen® device in the Kvichak River during July and August 2015. Human (manual) analysis of the data was undertaken and used to develop automated algorithms to detect fish in the frames and describe interaction behavior. In addition, a web application, EyeSea, was developed to combine manual and automated processing, so that ultimately the automated algorithms could be used to identify where human analysis was needed (i.e., when fish are present in video frames). The aim of the project was to develop algorithms that could identify video frames with fish present that could then be used to enable faster manual analysis. However, the project has also identified recommendations for future data collection, and research that could help analysis and interpretation. The manual analysis started to look at all data from the start of the deployment; this was to ensure rare events were seen, and initially focused on night-time data when more fish were present. This process highlighted the amount of time taken to identify fish, and ultimately only 42.33 hours of video were reviewed due to the time-consuming analysis. The data were classified as ‘Fish’, when the reviewer was confident it was a fish, and ‘Maybe’ fish, when it was difficult to distinguish. This was based on the movement, shape and color characteristics. ‘Fish’ were further classified as ‘adult’, ‘juvenile’, or ‘unidentifiable’. Behavioral attributes were noted, which were broadly divided into passive and avoidance activities. In over 42 hours data, there were only 20 potential contact interactions, of which 3 were ‘Maybe’ classifications, 12 were juveniles and 5 were adults; on only one occasion was an actual contact confirmed, and this was an adult fish with the camera, not the turbine itself. This also highlights the difficulties associated with confirming a strike or collision event as occurring or being a near-miss. More interactions were detected at night; this was probably biased by nighttime artificial light use, which may have attracted fish, but also could have increased detection probability as the light is reflected from the fish itself. For the algorithm development, background subtraction, optical flow, and deep learning techniques were considered. The deep learning approach was determined as needing too much training data for this application, and therefore was not continued. The optical flow analysis was considered promising, but did not give immediate results, so would need further investigation. Therefore, background subtraction was the main focus. Three methods of background subtraction were tried: Robust Principal Components Analysis (RPCA), Gaussian Mixture Model (GMM) and Video Background Extraction(ViBE). A classification technique was then applied to the foreground images to determine fish presence. Using this combination, it was found that fish could be accurately detected when occupying more pixels (>200 pixels, 98.2% correct; 100-200 pixels, 99.6% correct; 5-100 pixels, 85.4% correct; 2-5 pixels, 66.3% correct). In parallel, EyeSea was developed to convert the video data to a usable form and to enable manual and automated analysis of the data that would have a standardized output. Recommendations for further research, and standardized methods for data collection are given.

13 HYDRO ENERGY↗
DOE OSTI2025

Even Higher-Level Synthesis: An Exploration of AI Hardware Accelerators using HLS4ML

With the rise of artificial intelligence, the popularization of deep learning, and a constantly evolving industry, the demand for flexible and efficient tools has never been greater. As algorithms grow more complex, their runtime and energy consumption increase exponentially. Customized hardware accelerators, long used for specific mathematical operations, remain essential for managing modern applications' computational and power demands. Hardware accelerators can speed up complex computations by orders of magnitude, but their manual design and verification processes are often challenging and time-consuming. High-Level Synthesis (HLS) provides a solution by transforming high-level algorithm descriptions, typically written in C++ or SystemC, into synthesizable RTL suitable for hardware implementation. This approach reduces development time for RTL engineers while offering flexibility beyond what traditional handwritten RTL can provide. We extended this capability to the machine-learning domain with the open-source framework hls4ml, which allows neural networks trained in Python frameworks like Tensorflow or PyTorch to be synthesized into efficient hardware representations for the traditional FPGA and ASIC flows. This breakthrough addresses the growing need for reduced design turnaround and easy verification of ML hardware accelerators with low latency and power efficiency constraints. During this tutorial, we will demonstrate how Python complements HLS by simplifying the ML design process, bridging the gap between software and hardware development. Attendees will explore how we translate neural networks modeled in Python into fixed-point C++ models suitable for HLS workflows. We will dive into strategies like Value-Range Analysis and Quantization-Aware Training, which optimize these designs for deployment and evaluate their accuracy, power consumption, and energy efficiency. To exemplify these concepts, experts from Fermilab will share their experiences applying this technology to high-energy physics experiments, where real-time, low-latency processing is critical. Over the years, Fermilab engineers have demonstrated how deep neural networks, optimized for hardware using hls4ml, can meet the stringent requirements of trigger systems at the CERN Large Hadron Collider. These systems rely on rapid decision-making to process immense data volumes while retaining only the most relevant events for further analysis. The application of hls4ml has also been extended to innovative technologies like smart pixel arrays. These smart pixels integrate ML inference capabilities directly into sensor devices, enabling localized data processing at the pixel level. This approach drastically reduces the need to transmit raw data to external processing units, significantly decreasing power consumption and latency. By embedding neural networks within the pixel architecture, the smart pixels can identify and prioritize relevant data in real time, providing a highly efficient solution for edge computing in scenarios such as particle detectors and imaging systems. Fermilab's work highlights the potential of hardware-accelerated ML in scenarios where both speed and power efficiency are mission-critical. Through this tutorial, attendees will gain valuable insights into the challenges and solutions of deploying ML in hardware. Understanding how HLS and hls4ml streamline the development of neural network-based hardware accelerators is fundamental for the industry's future. Participants will learn how these technologies are shaping the future of AI and scientific computing.

Di Guglielmo, Giuseppe [Fermilab]↗
DOE OSTI2016

REPEATABILITY OF SPITZER/IRAC EXOPLANETARY ECLIPSES WITH INDEPENDENT COMPONENT ANALYSIS

The research of effective and reliable detrending methods for Spitzer data is of paramount importance for the characterization of exoplanetary atmospheres. To date, the totality of exoplanetary observations in the mid- and far-infrared, at wavelengths >3 μm, have been taken with Spitzer. In some cases, in past years, repeated observations and multiple reanalyses of the same data sets led to discrepant results, raising questions about the accuracy and reproducibility of such measurements. Morello et al. (2014, 2015) proposed a blind-source separation method based on the Independent Component Analysis of pixel time series (pixel-ICA) to analyze InfraRed Array Camera (IRAC) data, obtaining coherent results when applied to repeated transit observations previously debated in the literature. Here we introduce a variant to the pixel-ICA through the use of wavelet transform, wavelet pixel-ICA, which extends its applicability to low-signal-to-noise-ratio cases. We describe the method and discuss the results obtained over 12 eclipses of the exoplanet XO3b observed during the “Warm Spitzer” era in the 4.5 μm band. The final results are reported, in part, also in Ingalls et al. (2016), together with results obtained with other detrending methods, and over 10 synthetic eclipses that were analyzed for the “IRAC Data Challenge 2015.” Our results are consistent within 1σ with the ones reported in Wong et al. (2014) and with most of the results reported in Ingalls et al. (2016), which appeared on arXiv while this paper was under review. Based on many statistical tests discussed in Ingalls et al. (2016), the wavelet pixel-ICA method performs as well as or better than other state-of-art methods recently developed by other teams to analyze Spitzer/IRAC data, and, in particular, it appears to be the most repeatable and the most reliable, while reaching the photon noise limit, at least for the particular data set analyzed. Another strength of the ICA approach is its highest objectivity, as it does not use prior information about the instrument systematics, making it a promising method to analyze data from other observatories. The self-consistency of individual measurements of eclipse depth and phase curve slope over a span of more than three years proves the stability of Warm Spitzer/IRAC photometry within the error bars, at the level of 1 part in 10{sup 4} in stellar flux.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1975

Investigation of correlation classification techniques

A two-step classification algorithm for processing multispectral scanner data was developed and tested. The first step is a single pass clustering algorithm that assigns each pixel, based on its spectral signature, to a particular cluster. The output of that step is a cluster tape in which a single integer is associated with each pixel. The cluster tape is used as the input to the second step, where ground truth information is used to classify each cluster using an iterative method of potentials. Once the clusters have been assigned to classes the cluster tape is read pixel-by-pixel and an output tape is produced in which each pixel is assigned to its proper class. In addition to the digital classification programs, a method of using correlation clustering to process multispectral scanner data in real time by means of an interactive color video display is also described.

Haskell, R. E.↗