Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

CubeSat constellations provide enhanced crop phenology and digital agricultural insights using daily leaf area index retrievals

Satellite remote sensing has great potential to deliver on the promise of a data-driven agricultural revolution, with emerging space-based platforms providing spatiotemporal insights into precision-level attributes such as crop water use, vegetation health and condition and crop response to management practices. Using a harmonized collection of high-resolution Planet CubeSat, Sentinel-2, Landsat-8 and additional coarser resolution imagery from MODIS and VIIRS, we exploit a multi-satellite data fusion and machine learning approach to deliver a radiometrically calibrated and gap-filled time-series of daily leaf area index (LAI) at an unprecedented spatial resolution of 3 m. The insights available from such high-resolution CubeSat-based LAI data are demonstrated through tracking the growth cycle of a maize crop and identifying observable within-field spatial and temporal variations across key phenological stages. Daily LAI retrievals peaked at the tasseling stage, demonstrating their value for fertilizer and irrigation scheduling. An evaluation of satellite-based retrievals against field-measured LAI data collected from both rain-fed and irrigated fields shows high correlation and captures the spatiotemporal development of intra- and inter-field variations. Novel agricultural insights related to individual vegetative and reproductive growth stages were obtained, showcasing the capacity for new high-resolution CubeSat platforms to deliver actionable intelligence for precision agricultural and related applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Thunderstorm Cloud-Type Classification from Space-Based Lightning Imagers

The organization and structure of thunderstorms determines the extent and severity of their hazards to the general public and their consequences for the Earth system. Distinguishing vigorous convective regions that produce heavy rain and hail from adjacent regions of stratiform clouds or overhanging anvil clouds that produce light to no rainfall is valuable in operations and physical research. Cloud-type algorithms that partition convection from stratiform regions have been developed for space-based radar, passive microwave, and now Geostationary Operational Environmental Satellites (GOES) Advanced Baseline Imager (ABI) multispectral products. However, there are limitations for each of these products including temporal availability, spatial coverage, and the degree to which they based on cloud microphysics. We report we have developed a cloud-type algorithm for GOES Geostationary Lightning Mapper (GLM) observations that identifies convective/nonconvective regions in thunderstorms based on signatures of interactions with nonconvective charge structures in the lightning flash data. The GLM sensor permits a rapid (20 s) update cycle over the combined GOES-16–GOES-17 domain across all hours of the day. Storm regions that do not produce lightning will not be classified by our algorithm, however. The GLM cloud-type product is intended to provide situational awareness of electrified nonconvective clouds and to complement other cloud-type retrievals by providing a contemporary assessment tied to lightning physics. We propose that a future combined ABI–GLM cloud-type algorithm would be a valuable product that could draw from the strengths of each instrument and approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Patterson function as auto-hologram and graph enables the direct solution to the phase problem for coherently illuminated atomistic structures

Abstract The coherent Patterson function, derived from the coherent scattering intensities from N atoms, can be described as an auto-holographic image, i.e., the superposition of N -holographic images in which each atom serves as the source of a different reference wave, and as a mathematical graph of the unknown structure. These insights indicate that the unknown structure is significantly over-determined by the inherent information content in a Patterson function by a factor of ( N − 1)/2 (for non-degenerate structures), independent of dimensionality. However, we also show that the ability to resolve the distinct features in the Patterson function depends strongly on details of the experimental design (data range, sampling frequency, and dimensionality). This re-interpretation suggests that the coherent Patterson function provides a natural context for describing the information content in coherent scattering, reveals that there is no inherent phase problem for coherently illuminated pointwise structures, and enables the design of an algorithm which retrieves the structure directly from the Patterson function, without using error metric minimization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Global mapping of urban thermal anisotropy reveals substantial potential biases for remotely sensed urban climates

Urban thermal anisotropy (UTA) drastically biases satellite-derived urban surface temperatures and fluxes, and consequently inhibits a more comprehensive understanding of global urban climates. However, UTA patterns and associated biases in observed urban climate variables have not been investigated across an adequate number of global cities with diverse contexts; nor is it known whether there are globally measurable factors that are closely related to the UTA intensity (UTAI, quantified as the maximum difference between the nadir and off-nadir urban thermal radiation). Here we investigate the UTAI over more than 5500 cities worldwide using the moderate resolution imaging spectroradiometer (MODIS) multi-angle land surface temperature (LST) observations from 2003 to 2021. The results show that the global mean UTAI can reach 5.1, 2.7, 2.4, and 1.7 K during summer daytime, winter daytime, summer nighttime, and winter nighttime, respectively. Using nadir LST observations as a reference, our analysis reveals that UTA can lead to an underestimation of satellite-based urban surface sensible heat fluxes ( H ) by 45.4% and surface urban heat island intensity ( I s ) by 43.0% when using LST observations obtained from sensor viewing zenith angles (VZAs) of ±60°. However, practitioners can limit the biases of H and I s within ±10% by using LSTs from sensor VZAs within ±30°. We find that UTAI is closely related to urban impervious surface percentage and surface air temperature across global cities. In conclusion, these findings have implications for angular normalization of satellite-retrieved instantaneous LST observations across cities worldwide.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Spatial-Temporal Recurrent Graph Neural Networks for Fault Diagnostics in Power Distribution Systems

Fault diagnostics are extremely important to decide proper actions toward fault isolation and system restoration. The growing integration of inverter-based distributed energy resources imposes strong influences on fault detection using traditional overcurrent relays. This paper utilizes emerging graph learning techniques to build new temporal recurrent graph neural network models for fault diagnostics. The temporal recurrent graph neural network structures can extract the spatial-temporal features from data of voltage measurement units installed at the critical buses. From these features, fault event detection, fault type/phase classification, and fault location are performed. Compared with previous works, the proposed temporal recurrent graph neural networks provide a better generalization for fault diagnostics. Moreover, the proposed scheme retrieves the voltage signals instead of current signals so that there is no need to install relays at all lines of the distribution system. Therefore, the proposed scheme is generalizable and not limited by the number of relays installed. The effectiveness of the proposed method is comprehensively evaluated on the Potsdam microgrid and IEEE 123-node system in comparison with other neural network structures.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Proton radiography inversions with source extraction and comparison to mesh methods

In this article, proton radiography is a central diagnostic technique for measuring electromagnetic (EM) fields in high-energy-density, laser-produced plasmas. In this technique, protons traverse the plasma where they accumulate small EM deflections which lead to variations in the proton fluence pattern on a detector. Path-integrated EM fields can then be extracted from the fluence image through an inversion process. In this work, experiments of laser-driven foils were conducted on the OMEGA laser and magnetic field reconstructions were performed using both “fluence-based” techniques and high-fidelity “mesh-based” methods. We implement nonzero boundary conditions into the inversion and show their importance by comparing against mesh measurements. Good agreement between the methods is found only when nonzero boundary conditions are used. We also introduce an approach to determine the unperturbed proton source profile, which is a required input in fluence reconstruction algorithms. In this approach, a fluence inversion is embedded inside of a mesh region, which provides overconstrained magnetic boundary conditions. A source profile is then iteratively optimized to satisfy the boundary information. This method substantially enhances the accuracy in recovering EM fields. Lastly, we propose a scheme to quantify uncertainty in the final inversion that is introduced through errors in the source retrieval.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Humming Trains in Seismology: An Opportune Source for Probing the Shallow Crust

Abstract Seismologists are eagerly seeking new and preferably low-cost ways to map and track changes in the complex structure of the top few kilometers of the crust. By understanding it better, they can build on what is known regarding important, practical issues. These include telling us whether imminent earthquakes and volcanic eruptions are generating telltale underground signs of hazard, about mitigation of induced seismicity such as from deep injection of wastewater, how the Earth and its atmosphere couple, and where accessible natural resources are. Passive seismic imaging usually relies on blind correlations within extended recordings of Earth’s ceaseless “hum” or coda of well-mixed, small vibrations. In this article, we propose a complementary approach. It is seismic interferometry using opportune sources—specifically ones not stationary in time and moving in a well-understood configuration. Its interpretation relies on an accurate understanding of how these sources radiate seismic waves, precise timing, careful placement of pairs of listening stations, and seismic phase differentiation (surface and body waves). Massive freight trains were only recently recognized as such a persistent, powerful cultural (human activity-caused) seismic source. One train passage may generate a tremor with an energy output of a magnitude 1 earthquake and be detectable for up to 100 km from the track. We discuss the source mechanisms of train tremors and review the basic theory on sources. Finally, we present case studies of body- and surface-wave retrieval as an aid to mineral exploration in Canada and to monitoring of a southern California fault zone. We believe noise recovery from this new signal source, together with dense data acquisition technologies such as nodes or distributed acoustic sensing, will deeply transform our ability to monitor activity in the shallow crust at sharpened resolution in time and space.

Geochemistry & Geophysics↗
DOE OSTI2024

Lambda baryon production in neutrino-nucleus interactions and light signals reconstruction in the Short-Baseline Near Detector

The field of neutrino physics is nowadays entering the era of precision measurements, with new detectors capable of capturing neutrino interactions with unprecedented detail and high intensity neutrino beams. Liquid Argon Time Projection Chambers (LArTPCs) have become one of the main neutrino detection technologies, providing excellent imaging capabilities and particle identification. The Short-Baseline Near Detector (SBND) at Fermilab is a LArTPC experiment designed to capture neutrinos from the Booster Neutrino Beam (BNB). Its proximity to the beam target (110\,m) and large size (112\,ton) enable the recording of millions of neutrino interactions annually. SBND provides the highest statistics worldwide for neutrino-argon cross-section measurements, facilitating the study of rare channels like Cabibbo-suppressed quasielastic hyperon production. Specifically, this thesis focuses on neutral $\Lambda$ baryon production for which only tens of events have been observed up to date. Our work introduces a novel selection strategy leveraging LArTPC imaging capabilities to identify the distinctive decay signatures of $\Lambda$ baryons, enhancing sensitivity to this channel. Besides being a very mature technology, LArTPCs are an evolving technology. Part of the focus of the new developments lies in harnessing the potential of scintillation light signals. The Photon Detection System (PDS) in SBND has been designed to provide an efficient detection of the scintillation light, representing a major R\&D opportunity in the LArTPC community. Its design provides a high and more uniform light yield, an excellent timing resolution and an independent 3D reconstruction of the events, including the drift coordinate, using exclusively the light signals. This work presents the first comprehensive study of the SBND PDS capabilities. The new developments in the simulation and reconstruction of the light signals in SBND are presented. The whole chain is applied to accurately tag neutrino events through timing information, with a predicted resolution $\mathcal{O}$(2\,ns), and ultimately retrieve the pulse structure of the BNB.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Multi-frame, ultrafast, x-ray microscope for imaging shockwave dynamics

Inertial confinement fusion (ICF) holds increasing promise as a potential source of abundant, clean energy, but has been impeded by defects such as micro-voids in the ablator layer of the fuel capsules. It is critical to understand how these micro-voids interact with the laser-driven shock waves that compress the fuel pellet. At the Matter in Extreme Conditions (MEC) instrument at the Linac Coherent Light Source (LCLS), we utilized an x-ray pulse train with ns separation, an x-ray microscope, and an ultrafast x-ray imaging (UXI) detector to image shock wave interactions with micro-voids. To minimize the high- and low-frequency variations of the captured images, we incorporated principal component analysis (PCA) and image alignment for flat-field correction. After applying these techniques we generated phase and attenuation maps from a 2D hydrodynamic radiation code (xRAGE), which were used to simulate XPCI images that we qualitatively compare with experimental images, providing a one-to-one comparison for benchmarking material performance. Moreover, we implement a transport-of-intensity (TIE) based method to obtain the average projected mass density (areal density) of our experimental images, yielding insight into how defect-bearing ablator materials alter microstructural feature evolution, material compression, and shock wave propagation on ICF-relevant time scales.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Mapping snow depth and volume at the alpine watershed scale from aerial imagery using Structure from Motion

Time series mapping of snow volume in the mountains at global scales and at resolutions needed for water resource management is an unsolved challenge to date. Snow depth mapping by differencing surface elevations from airborne lidar is a mature measurement approach filling the observation gap operationally in a few regions, primarily in mountain headwaters in the Western United States. The same concept for snow depth retrieval from stereo- or multi-view photogrammetry has been demonstrated, but these previous studies had limited ability to determine the uncertainties of photogrammetric snow depth at the basin scale. For example, assessments used non-coincident or discrete points for reference, masked out vegetation, or compared a subset of the fully snow-covered study domain. Here, using a unique data set with simultaneously collected airborne data, we compare snow depth mapped from multi-view Structure from Motion photogrammetry to that mapped by lidar at multiple resolutions over an entire mountain basin (300 km 2 ). After excluding reconstruction errors (negative depths), SfM had lower snow-covered area (~27%) and snow volume (~16%) compared to lidar. The reconstruction errors were primarily in areas with vegetation, shallow snow (< 1 m), and steep slopes (> 60°C). Across the overlapping snow extent, snow depths compared well to lidar with similar mean values (< 0.03 m difference) and snow volume (± 5%) for output resolutions of 3 m and 50 m, and with a normalized median absolute deviation of 0.19 m. Our results indicate that photogrammetry from aerial images can be applied in the mountains but would perform best for deeper snowpacks above tree line.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Estimating SHmax azimuth with P sources and vertical geophones: Use P-P reflection amplitudes or use SV-P reflection times?

We compared two methods for extracting the azimuth of maximum horizontal stress (SHmax) from 3D land-based seismic data generated by a P source and recorded with vertical geophones. In the first method, we used the direct-SV mode that is produced by all land-based P sources. P sources generate SV illumination that radiates in all azimuth directions from a source station and creates SV-P reflections that are recorded by vertical geophones. Unless stratigraphy has steep dip, SV-P raypaths recorded by vertical geophones are the reverse of P-SV raypaths recorded by horizontal geophones. Thus, SV-P data provide the same S-wave sensitivity to stress fields as popular P-SV data do. In the second method, we retrieved P-P reflections and then performed an amplitude-variation-with-azimuth (AVA) analysis of the amplitude-gradient behavior of P-P reflection wavelets. We did this analysis in narrow azimuth corridors to determine the gradient of reflection-wavelet amplitudes as a function of azimuth. This P-P AVA amplitude-gradient method has been of great interest in the reflection seismology community since it was introduced in the late 1990s. Each of these methods, AVA analysis of the gradient of P-P reflection amplitudes and azimuth-dependent arrival times of SV-P reflections, can be used to determine the azimuth of SHmax stress. We compare the results of the two methods with ground truth measurements of SHmax azimuth at a CO 2 sequestration site in the Michigan Basin. SHmax azimuths were determined from P-P and SV-P data at three major boundaries at depths of approximately 3500 ft (1067 m), 5500 ft (1676 m), and 7500 ft (2286 m). Two estimates of SHmax azimuth (one using SV-P data and one using P-P data) were made at each stacking bin inside a 24 mi 2 (62 km 2 ) image space. The result was approximately 98,000 estimates of SHmax azimuth across each of these three boundaries for each of these two prediction strategies. Histogram displays of PP AVA gradient estimates had peaks at correct azimuths of SHmax at all three depths, but the spread of the distributions widened with depth and split into two peaks at the deepest boundary. In contrast, each histogram of SHmax azimuth predicted by azimuth-dependent SV-P traveltimes had a single, definitive peak that was positioned at the correct SHmax azimuth at all three boundary depths.

Geochemistry & Geophysics↗
DOE OSTI2024

Geospatial Data Platform for All

Spatiotemporal data has evolved in scale due to augmented use in cross-domain applications. Simultaneously, there is substantial growth in the availability of Geographic Information Systems (GIS) data provided by the United States Geological Survey (USGS) along with other federal, state, county, or local agencies through open-data portals and public access APIs. However, data availability does not equate with accessibility. Large-scale analyses and applications require robust, performant data management with co-location of data storage and computing. The insufficiency of data management infrastructure compels researchers to adopt ad hoc project- specific GIS data storage solutions (e.g., copying data to High-Performance computer file systems). As an ad hoc storage strategy does not scale, it hampers cross-domain analyses causing difficulty in data reuse and utilizing existing code bases. Furthermore, GIS data is complex and requires expertise to analyze and manipulate due to its intricate data structures and data-specific projection transformations. Despite the challenges, we recognize that derived GIS data products, e.g., satellite or LIDAR-based images, can be used in downstream applications such as AI by domain, but non-GIS experts. To address the data needs and overcome the challenges, we are working towards a GIS Data Platform focused on efficient data storage, data discovery and access, and an API to enable common workflows. We propose a knowledge-graph (KG) approach for data discovery, whereby datasets are semantically linked to higher- level constructs such as projects and research areas. The semantic data links enable researchers to explore datasets in a top-down approach by specifying relevant and meaningful terms (assists in finding hidden data). An advantage is that the nodes and edges in a knowledge graph create built-in semantic documentation. Deeper spatiotemporal connections between data sources can be encoded via Graph Neural Networks (GNN) (Zhang et al., 2021). The KG approach can be extended to integrate the data itself in a Virtual KG (VKG). Our work will derive inspiration from large-scale VKG efforts that have been undertaken or are currently underway as part of the OpenStreetMap project (Ding et al., 2021). For DOE Data Days, we share the proposed geospatial data platform hybrid (cloud/on-prem) architecture, our work-to-date on storing, retrieving, and transforming LiDAR and raster data relevant to two important NREL use-cases, including the Renewable Energy Potential (reV) Model, and present our proposal for a KG based data discovery engine.

data platform↗
DOE OSTI2023

Projected Multi-Agent Consensus Equilibrium (PMACE) With Application to Ptychography

Multi-Agent Consensus Equilibrium (MACE) formulates an inverse imaging problem as a balance among multiple update agents such as data-fitting terms and denoisers. However, each such agent operates on a separate copy of the full image, leading to redundant memory use and slow convergence when each agent affects only a small subset of the full image. In this article, we extend MACE to Projected Multi-Agent Consensus Equilibrium (PMACE), in which each agent updates only a projected component of the full image, thus greatly reducing memory use for some applications. We describe PMACE in terms of an equilibrium problem and an equivalent fixed-point problem and show that in most cases the PMACE equilibrium is not the solution of an optimization problem. To demonstrate the value of PMACE, we apply it to the problem of ptychography, in which a sample is reconstructed from the diffraction patterns resulting from coherent X-ray illumination at multiple overlapping spots. In our PMACE formulation, each spot corresponds to a separate data-fitting agent, with the final solution found as an equilibrium among all the agents. In conclusion, our results demonstrate that the PMACE reconstruction algorithm generates more accurate reconstructions at a lower computational cost than existing ptychography algorithms when the spots are sparsely sampled.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Hydrodynamic and Radiographic Toolbox (HART)

With a multi-lab and university team, we propose to develop new methods for a Hydrodynamic and Radiographic Toolbox (HART) that will enable a fuller and more extensive use of experimental radiographic data towards better characterizing and reducing uncertainties in predictive modeling of weapons performance. We will achieve this by leveraging recent developments in areas of computational imaging, statistical and machine learning, and reduced order modeling of hydrodynamics. In terms of software practices, by partnering with XCP (RISTRA Project) we will conform to recent XCP standards that are inline with modern software practices and standards and ensure compatibility and ease of inter-operability with existing codes. Three new activities under this proposal include (a) the development and use of deep learning-based surrogates to accelerate reconstruction and variational inference of density fields from radiographs of hydrotests, (b) a model-data fusion strategy that couples deep learning-based density reconstructions with fast hydrodynamics simulators to better constrain the reconstruction, and (c) a method for treating asymmetries using techniques adopted from limited view tomography. All three new activities will be based on improved treatment of scatter, noise, beam spot movement, detector blur, and flat fielding in the forward model, and a use of sophisticated priors to aid in the re construction. The improvements to the forward model and improved algorithmic design of the reconstruction when complete will be contained in the iterative reconstruction code SHIVA—a code project that we have recently initiated. The many ways in which machine learning can be used in the reconstruction work will be contained in a code HERMES that has been initiated with DTRA support. For example, the significant levels of acceleration that will likely be achieved by the use of machine learning techniques will permit us (and are required) to quantify uncertainties in density retrievals. Next, the two-way coupling between density reconstruction and model-based simulation of the hydrodynamics will be contained in code EREBUS, and will permit a fuller realization of the potential of the data to constrain the hydrodynamic model and better address issues related to asymmetries in the problem. Finally, we anticipate that the better consistency with physics achieved in our reconstructions will allow them to be used by X-Division more so than today.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Evaluation of VEGETATION and PROBA-V Phenology Using PhenoCam and Eddy Covariance Data

High-quality retrieval of land surface phenology (LSP) is increasingly important for understanding the effects of climate change on ecosystem function and biosphere–atmosphere interactions. We analyzed four state-of-the-art phenology methods: threshold, logistic-function, moving-average and first derivative based approaches, and retrieved LSP in the North Hemisphere for the period 1999–2017 from Copernicus Global Land Service (CGLS) SPOT-VEGETATION and PROBA-V leaf area index (LAI) 1 km V2.0 time series. We validated the LSP estimates with near-surface PhenoCam and eddy covariance FLUXNET data over 80 sites of deciduous forests. Results showed a strong correlation (R 2 > 0.7) between the satellite LSP and ground-based observations from both PhenoCam and FLUXNET for the timing of the start (SoS) and R 2 > 0.5 for the end of season (EoS). The threshold-based method performed the best with a root mean square error of ~9 d with PhenoCam and ~7 d with FLUXNET for the timing of SoS (30th percentile of the annual amplitude), and ~12 d and ~10 d, respectively, for the timing of EoS (40th percentile).

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Selecting XFEL single-particle snapshots by geometric machine learning

A promising new route for structural biology is single-particle imaging with an X-ray Free-Electron Laser (XFEL). This method has the advantage that the samples do not require crystallization and can be examined at room temperature. However, high-resolution structures can only be obtained from a sufficiently large number of diffraction patterns of individual molecules, so-called single particles. Here, we present a method that allows for efficient identification of single particles in very large XFEL datasets, operates at low signal levels, and is tolerant to background. This method uses supervised Geometric Machine Learning (GML) to extract low-dimensional feature vectors from a training dataset, fuse test datasets into the feature space of training datasets, and separate the data into binary distributions of “single particles” and “non-single particles.” As a proof of principle, we tested simulated and experimental datasets of the Coliphage PR772 virus. We created a training dataset and classified three types of test datasets: First, a noise-free simulated test dataset, which gave near perfect separation. Second, simulated test datasets that were modified to reflect different levels of photon counts and background noise. These modified datasets were used to quantify the predictive limits of our approach. Third, an experimental dataset collected at the Stanford Linear Accelerator Center. The single-particle identification for this experimental dataset was compared with previously published results and it was found that GML covers a wide photon-count range, outperforming other single-particle identification methods. Moreover, a major advantage of GML is its ability to retrieve single particles in the presence of structural variability.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Removal of spurious data in Bragg coherent diffraction imaging: an algorithm for automated data preprocessing

Bragg coherent diffraction imaging (BCDI) provides a powerful tool for obtaining high-resolution structural information from nanocrystalline materials. Here a BCDI sample consisting of a large number of randomly oriented nanoscale crystals is considered. Ideally, only one crystal is oriented to produce a Bragg peak on the detector. However, diffraction from other crystals often produces additional signals on the detector. Before the measured diffraction patterns can be processed into structural images, scientists routinely need to manually identify and remove the `alien' intensities from sources other than the intended crystal. With the development of modern high-coherence storage rings, such as the upgraded Advanced Photon Source (APS), the already slow process of manual preprocessing will be untenable for the large volumes of data that will be produced. An automated method of identifying and deleting alien intensities is proposed. This method exploits the fact that BCDI of a perfect crystal produces diffraction data with inversion symmetry around the Bragg peak. This approach uses the machine learning clustering method DBSCAN to distinguish between diffraction from multiple sources, and then calculates cluster size and inversion symmetry to assess whether clusters of intensity belong to desired data or alien signals. This approach can dramatically reduce the amount of time spent manually processing data, allowing BCDI data processing capabilities to keep pace with the technological advances of fourth-generation synchrotron light sources.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Disentangling error structures of precipitation datasets using decision trees

Characterizing error structures in precipitation products not only facilitates their proper applications for scientific and practical purposes but also helps improve their retrieval algorithms and processing methods. Despite the fact that multiple precipitation products have been assessed in the literature, factors that affect their error structures remain inadequately addressed. By interpreting 60 binary decision trees, this study disentangles the error characteristics of precipitation products in terms of their spatiotemporal patterns and geographical factors. Three independent precipitation products - two satellite-based and one reanalysis datasets: the Integrated Multi-satellitE Retrievals for GPM (Global Precipitation Measurement) late run (IMERG-L), Soil Moisture to Rain-Advanced SCATterometer (SM2RAIN-ASCAT), and the Modern-Era Retrospective analysis for Research and Applications, Version 2 uncorrected precipitation output (MERRA2-UC), are evaluated across the contiguous United States from 2010 to 2019. Here, the ground-based Stage IV precipitation dataset is used as the ground truth. Results indicate that the MERRA2-UC outperforms the IMERG-L and SM2RAIN-ASCAT with higher accuracy and more stable interannual patterns for the analysis period. Decision trees cross-assess three spatiotemporal factors and find that the underestimation of MERRA2-UC occurs in the east of the Rocky Mountains, and SM2RAIN-ASCAT underestimates precipitation over high latitudes, especially in winter. Additionally, the decision tree method ascribes system errors to nine different geographical characteristics, of which the distance to the coast, soil type, and DEM are the three dominant features. On the other hand, the land cover type, topography position index, and aspect are three relatively weak factors.

54 ENVIRONMENTAL SCIENCES↗