Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data staging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Let’s get our hands dirty: a comprehensive evaluation of DAQDB, key-value store for petascale hot storage

Data acquisition systems are a key component for successful data taking in any experiment. The DAQ is a complex distributed computing system and coordinates all operations, from the data selection stage of interesting events to storage elements. For the High Luminosity upgrade of the Large Hadron Collider, the experiments at CERN need to meet challenging requirements to record data with a much higher occupancy in the detectors. The DAQ system will receive and deliver data with a significantly increased trigger rate, one million events per second, and capacity, terabytes of data per second. An effective way to meet these requirements is to decouple real-time data acquisition from event selection. Data fragments can be temporarily stored in a large distributed key-value store. Fragments belonging to the same event can be then queried on demand, by the data selection processes. Implementing such a model relies on a proper combination of emerging technologies, such as persistent memory, NVMe SSDs, scalable networking, and data structures, as well as high performance, scalable software. In this paper, we present DAQDB (Data Acquisition Database) — an open source implementation of this design that was presented earlier, with an extensive evaluation of this approach, from the single node to the distributed performance. Furthermore, we complement our study with a description of the challenges faced and the lessons learned while integrating DAQDB with the existing software framework of the ATLAS experiment.

Abed Abud, Adam↗
DOE OSTI2021

Model, data, and code for paper "Modeling of streamflow in a 30-kilometer-long reach spanning 5 years using OpenFOAM 5.x"

The data package includes data, model, and code that support the analyses and conclusions in the paper titled “modeling of streamflow in a 30-kilometer-long reach spanning 5 years using OpenFOAM 5.x”. The primary goal of this paper is to demonstrate that key streamflow properties such as water depth, flow velocity, and dynamic pressure in a natural river at 30-kilometer scale over 5 years can be reliably and efficiently modeled using the computational framework presented in this paper. To support the paper, various data types from remote sensing, field observations, and computational models are used. Specific details are described as follows. Firstly, the river bathymetry data was obtained from a Light Detection and Ranging (LiDAR) survey. This data is then converted to a triangulated surface format, STL, for mesh generation in OpenFOAM. The STL data can be found in Model_Setups/BaseCase_2013To2015/constant/triSurface. The OpenFOAM mesh generated using this STL file can be found in constant/polyMesh. Other model setups, boundary and initial conditions can be found in /system and /0.org under folder BaseCase_2013To2015. A similar data structure can also be found in BaseCase_2018To2019 for the simulations during 2018 and 2019. Secondly, the OpenFOAM simulations need the upstream discharge and water depth information at the upstream boundary to drive the model. These data are generated from a one-dimensional hydraulic model and the data can be found under the folder Model_Setups /1D model Mass1 data. The mass1_65.csv and mass1_191.csv files include the results of the 1D model at the model inlet and outlet, respectively. The Matlab source code Mass1ToOFBC20182019.m is used to convert these data into OpenFOAM boundary condition setups.With the above OpenFOAM model, it can generate data for water surface elevation, flow velocity, and dynamic pressure. In this paper, the water surface elevation was measured at 7 locations during different periods between 2011 and 2019. The exact survey locations (see Fig1_SurveyLocations.txt) can be found in folder Fig_1. The variation of water stage over time at the 7 locations can be found in folder /Observation_WSE. The data type include .txt, .csv, .xlsx, and .mat. The .mat data can be loaded by Matlab.We also measured the flow velocities at 12 cross-sections along the river. At each cross-section, we recorded the x, y locations, depth, three velocity components u,v,w. These data are saved to a Matlab format which can be found under folder /Observation_Velocity and /Fig_1. The relative locations of velocity survey locations to the river bathymetry can be found in Figure 1c.The water stage data at the 7 locations from OpenFOAM, 1D, and 2D hydraulic models are also provided to evaluate the long-term performance of 3D models vs 1D/2D models. The water stage data for the 7 locations from OpenFOAM have been saved to .mat format and can be found in /OpenFOAM_WSE. The water stage data from the 1D model are saved in .csv format and can be found in /Mass1_WSE. The water stage from the 2D model is saved as .mat format and can be found in / Mass2_WSEIn addition, the OpenFOAM model outputs the information of hydrostatic and hydrodynamic pressure. They are saved as .mat format under folder /Fig_11/2013_1. As the files are too large, we only uploaded the data for January 2013. The area of different ratio of dynamic pressure to static pressure for all simulation range, i.e., 2013-2015, are saved to .mat format. They can be found in /Fig_11/PA. Further, the data of wall clock time versus the solution time of the OpenFOAM modeling are also saved to .mat format under folder /Fig_13/LogsMat. In summary, the data package contains seven data types, including .txt, .csv, .xlsx, .dat, .stl, .m, and .mat. The former 4 types can be directly open using a text editor or Microsoft Office. The .mat format needs to be read by Matlab. The Matlab source code .m files need to be run with Matlab. The OpenFOAM setups can be visualized in ParaView. The .stl file can be opened in ParaView or Blender. The data in subfolders Fig_1 to Fig_10 and Fig_12 are copied from the aforementioned data folders to generate specific figures for the paper. A readME.txt file is included in each subfolder to further describe how the data in each folder are generated and used to support the paper.Please use the data package's DOI to cite the data package. Please contact yunxiang.chen@pnnl.gov if you need more data related to the paper.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Characterizing the performance of node-aware strategies for irregular point-to-point communication on heterogeneous architectures

Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data to be communicated and the number of potential data flow paths. In this work, we characterize the performance of irregular point-to-point communication with MPI on heterogeneous compute environments through performance modeling, demonstrating the limitations of standard communication strategies for both device-aware and staging-through-host communication techniques. Presented models suggest staging communicated data through host processes then using node-aware communication strategies for high inter-node message counts. Notably, the models also predict that node-aware communication utilizing all available CPU cores to communicate inter-node data leads to the most performant strategy when communicating with a high number of nodes. Furthermore, model validation is provided via a case study of irregular point-to-point communication patterns in distributed sparse matrix–vector products. Importantly, we include a discussion on the implications model predictions have on communication strategy design for emerging supercomputer architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Dynamics of Global Gene Expression and Regulatory Elements in Growing Brachypodium Root System

Root systems are dynamic and adaptable organs that play critical roles in plant development. However, how roots grow and accumulate biomass during plant life cycle and in relation to shoot growth phenology remains understudied. A comprehensive time-dependent root morphological analysis integrated with molecular signatures is then required to advance our understanding of root growth and development. Here we studied Brachypodium distachyon rooting process by monitoring root morphology, biomass production, and C/N ratios during developmental stages. To provide insight into gene regulation that accompanies root growth, we generated comprehensive transcript profiles of Brachypodium whole-root system at four developmental stages. Our data analysis revealed that multiple biological processes including trehalose metabolism and various families of transcription factors (TFs) were differentially expressed in root system during plant development. In particular, the AUX/IAA, ERFs, WRKY, NAC, and MADS TF family members were upregulated as plant entered the booting/heading stage, while ARFs and GRFs were downregulated suggesting these TF families as important factors involved in specific phases of rooting, and possibly in regulation of transition to plant reproductive stages. We identified several Brachypodium candidate root biomass-promoting genes and cis -regulatory elements for further functional validations and root growth improvements in grasses.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Chromatographic Modeling of 1-Foot Detritiation Test Column Results for the Optimization of Regeneration Time

This report documents the methods and results of a modeling study on a series of data generated by 1-foot test columns for the Water Detritiation project. In order to compliment modeling work already in progress on this project, a purely empirical curve-fitting approach is used in this study to determine chromatographic performance indicators such as retention time, curve width, and the number of chromatographic stages. The data used in this study comes from four sets of chromatographic test separations performed in March through May of 2017 using 1-foot columns. All are using the same flow rates and temperature (room temperature, nominally 25 C°). The first set of data (referred to in this report as the Column 1 data) is a series of twelve breakthrough curve measurements. Prior to each of these twelve runs, the column was regenerated by flowing hydrogen gas through the column, for increasing amounts of time, ranging from 2 hours to 25 hours. The second set of data (referred to as the Column 2 data) is comprised of five measurements of breakthrough curves measured in similar fashion as the Column 1 data, across a range of regeneration times from 2 to 21 hours. The third set of data (referred to as the Purge data) is of three breakthrough curves, measured after a regeneration time of 8 hours, which takes place after a nitrogen purge of 15, 30, or 45 minutes. The fourth data set is a series of five breakthrough curve measurements using a 2 nd batch of stationary phase, taken after regeneration times ranging from 2 to 20 hours. The overall modeling approach is as follows. First, the data is pre-processed for formatting, artifact removal, and is normalized. The data is then fit by integrated versions of four common chromatographic models. The best model is chosen based on the predictive performance of the model, and chromatographic performance values are calculated based on the best model’s fit parameters. Each of these processes are detailed below.

42 ENGINEERING↗
DOE OSTI2024

Boosted Dark Matter Search with the ICARUS Detector at the Gran Sasso Underground National Laboratory

The quest to discover dark matter is one of the most pressing topics in modern physics. Evidence of gravitational anomalies is present at different cosmological scales, spanning the stability and rotation of galaxies to the overall density profile of the entire observable Universe. Due to the discrepancy between the mass measured and the gravitational influence on the mass, if General Relativity is to correctly describe gravity at different scales, extra electromagnetically invisible matter termed dark matter must exist. In recent decades, many experiments have been performed to detect dark matter with masses that span many orders of magnitude, from Mass Compact Halo Objects (MACHOs) with masses several orders of magnitude that of our sun to very light particles on the order of $\sim\mu$eV. However, experiments have only been able to constrain the possible parameter space of dark matter models and, in general, probe dark matter models with single constituent dark matter like Weakly Interacting Massive Particles (WIMPs). In the Boosted Dark Matter (BDM) paradigm, there are four particles in the dark sector: $\chi_0$, $\chi_1$, $\chi_2$, and the dark photon $X$. WIMP-like properties are ascribed to $\chi_0$ to describe the physics of the gravitational anomalies, while relativistic components are assigned to $\chi_1$ and $\chi_2$. The inelastic boosted dark matter (iBDM) channel $\chi_1 e^-\rightarrow \chi_2 e^-\rightarrow \chi_1 Xe^-\rightarrow \chi_1 (e^+ e^- ) e^-$, where $\chi_2$ is an excited state of $\chi_1$, has a unique signature that is distinguishable from neutrino interactions, making neutrino experiments a viable search environment for BDM. Using data collected by the ICARUS collaboration with ICARUS T-600 Liquid Argon Time Projection Chamber (LArTPC) during its operation at the Gran Sasso Underground Laboratory (LNGS), the first-ever LArTPC dark matter search using the ICARUS detector is presented. With a total detector exposure of 0.13 kton$\cdot$year, a total of 4 iBDM candidate events were identified by several stages of data scanning. All were rejected due to defined selection criteria and a wire-by-wire $dE/dx$ evaluation, giving a null result. Exclusion plots at 90\%C.L. for the dark photon ($m_X$, $\epsilon$) parameter space for fixed ($m_0,m_1,m_2$) DM mass sets are presented, setting new limits on the dark photon visible decay parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Identification and correction of temporal and spatial distortions in scanning transmission electron microscopy

Scanning transmission electron microscopy (STEM) has become the technique of choice for quantitative characterization of atomic structure of materials, where the minute displacements of atomic columns from high-symmetry positions can be used to map strain, polarization, octahedra tilts, and other physical and chemical order parameter fields. The latter can be used as inputs into mesoscopic and atomistic models, providing insight into the correlative relationships and generative physics of materials on the atomic level. However, these quantitative applications of STEM necessitate understanding the microscope induced image distortions and developing the pathways to compensate them both as part of a rapid calibration procedure for in situ imaging, and the post-experimental data analysis stage. Here, we explore the spatiotemporal structure of the microscopic distortions in STEM using multivariate analysis of the atomic trajectories in the image stacks. Based on the behavior of principal component analysis (PCA), we develop the Gaussian process (GP)-based regression method for quantification of the distortion function. The limitations of such an approach and possible strategies for implementation as a part of in-line data acquisition in STEM are discussed. Here, the analysis workflow is summarized in a Jupyter notebook that can be used to retrace the analysis and analyze the reader's data.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Modeling of streamflow in a 30 km long reach spanning 5 years using OpenFOAM 5.x

Abstract. Developing accurate and efficient modeling techniques for streamflow at the tens-of-kilometers spatial scale and multi-year temporal scale is critical for evaluating and predicting the impact of climate- and human-induced discharge variations on river hydrodynamics. However, achieving such a goal is challenging because of limited surveys of streambed hydraulic roughness, uncertain boundary condition specifications, and high computational costs. We demonstrate that accurate and efficient three-dimensional (3-D) hydrodynamic modeling of natural rivers at 30 km and 5-year scales is feasible using the following three techniques within OpenFOAM, an open-source computational fluid dynamics platform: (1) generating a distributed hydraulic roughness field for the streambed by integrating water-stage observation data, a rough wall theory, and a local roughness optimization and adjustment strategy; (2) prescribing the boundary condition for the inflow and outflow by integrating precomputed results of a one-dimensional (1-D) hydraulic model with the 3-D model; and (3) reducing computational time using multiple parallel runs constrained by 1-D inflow and outflow boundary conditions. Streamflow modeling for a 30 km long reach in the Columbia River (CR) over 58 months can be achieved in less than 6 d using 1.1 million CPU hours. The mean error between the modeled and the observed water stages for our simulated CR reach ranges from −16 to 9 cm (equivalent to approximately ±7 % relative to the average water depth) at seven locations during most of the years between 2011 and 2019. We can reproduce the velocity distribution measured by the acoustic Doppler current profiler (ADCP). The correlation coefficients of the depth-averaged velocity between the model and ADCP measurements are in the range between 0.71 and 0.83 at 75 % of the survey cross sections. With the validated model, we further show that the relative importance of dynamic pressure versus hydrostatic pressure varies with discharge variations and topography heterogeneity. Given the model's high accuracy and computational efficiency, the model framework provides a generic approach to evaluate and predict the impacts of climate- and human-induced discharge variations on river hydrodynamics at tens-of-kilometers and decadal scales.

58 GEOSCIENCES↗
DOE OSTI2020

Countercurrent Actinide Lanthanide Separation Process (ALSEP) Demonstration Test with a Simulated PUREX Raffinate in Centrifugal Contactors on the Laboratory Scale

An Actinide Lanthanide Separation Process (ALSEP) for the separation of trivalent actinides (An(III)) from simulated raffinate solution was successfully demonstrated using a 32-stage 1 cm annular centrifugal contactor setup. The ALSEP solvent was composed of a mixture of 2-ethylhexylphosphonic acid mono-2-ethylhexyl ester (HEH[EHP]) and N,N,N',N'-tetra-(2-ethylhexyl)-diglycolamide (T2EHDGA) in n-dodecane. Flowsheet calculations and evaluation of the results were done using the Argonne’s Model for Universal Solvent Extraction (AMUSE) code using single-stage distribution data. The co-extraction of Zr(IV) and Pd(II) was prevented using CDTA (trans-1,2-diaminocyclohexane-N,N,N',N'-tetraacetic acid) as a masking agent in the feed. For the scrubbing of co-extracted Mo; citrate-buffered acetohydroxamic acid was used. The separation of An(III) from the trivalent lanthanides (Ln(III)) was achieved using citrate-buffered diethylene-triamine-N,N,N',N",N"-pentaacetic acid (DTPA), and Ln(III) were efficiently back extracted using N,N,N',N'-tetraethyl-diglycolamide (TEDGA). A clean An(III) product was obtained with a recovery of 95% americium and curium. The Ln(III) were efficiently stripped; but the Ln(III) product contained 5% of the co-stripped An(III). The carryover of Am and Cm into the Ln(III) product is attributed to too few actinide stripping stages, which was constrained by the number of centrifugal contactors available. Improved separation would be achieved by increasing the number of An strip stages. The heavier lanthanides (Pr, Nd, Sm, Eu, and Gd) and yttrium were mainly routed to the Ln product, whereas the lighter lanthanides (La and Ce) were mostly routed to the raffinate.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Chemical Looping of Manganese to Synthesize Ammonia at Atmospheric Pressure: Sodium as Promoter

Abstract Affordable synthetic ammonia (NH 3 ) enables the production of nearly half of the food we eat and is emerging as a renewable energy carrier. Sodium‐promoted chemical looping NH 3 synthesis at atmospheric pressure using manganese (Mn) is here demonstrated. The looping process may be advantageous when inexpensive renewable hydrogen from electrolysis is available. Avoiding the high pressure of the Haber‐Bosch process by chemical looping using earth‐abundant materials may reduce capital cost, facilitate intermittent operation, and allow operation in geographic areas where infrastructure is less sophisticated. At this early stage, the data suggest that 0.28 m 3 of a 50 % porosity solid Mn bed may suffice to produce 100 kg NH 3 per day by chemical looping, with abundant opportunities for improvement.

Aframehr, Wrya Mohammadi↗
DOE OSTI2025

Efficient lattice QCD computation of radiative-leptonic-decay form factors at multiple positive and negative photon virtualities

In previous work [D. Giusti, Methods for high-precision determinations of radiative-leptonic decay form factors using lattice QCD, Phys. Rev. D 107, 074507 (2023)], we showed that form factors for radiative leptonic decays of pseudoscalar mesons can be determined efficiently and with high precision from lattice QCD using the “three-dimensional (3D) method,” in which three-point functions are computed for all values of the current insertion time and the time integral is performed at the data-analysis stage. Here, we demonstrate another benefit of the 3D method: the form factors can be extracted for any number of nonzero photon virtualities from the same three-point functions at no extra cost. We present results for the $D_s → ℓνγ*$ vector form factor as a function of photon energy and photon virtuality, for both positive and negative virtuality, for a single ensemble with 340 MeV pion mass and 0.11 fm lattice spacing. In our analysis, we separately consider the two different time orderings and the different quark flavors in the electromagnetic current. We discuss in detail the behavior of the unwanted exponentials contributing to the three-point functions, as well as the choice of fit models and fit ranges used to remove them for various values of the virtuality. While positive photon virtuality is relevant for decays to multiple charged leptons, negative photon virtuality suppresses soft contributions and is of interest in QCD-factorization studies of the form factors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Ti-6Al-4V to over 1.2 TPa: Shock Hugoniot experiments, ab initio calculations, and a broad-range multiphase equation of state

Titanium alloys are used in a large array of applications. In this work we focus our attention on the most used alloy, Ti-6Al-4V (Ti64), which has excellent mechanical and biocompatibility properties with applications in aerospace, defense, biomedical, and other fields. Here we present high-fidelity experimental shock compression data measured on Sandia’s Z machine. We extend the principal shock Hugoniot for Ti64 to more than threefold compression, up to over 1.2 TPa. We use the data to validate our ab initio molecular dynamics simulations and to develop a highly reliable, multiphase equation of state (EOS) for Ti64, spanning a broad range of temperature and pressures. The first-principles simulations show very good agreement with Z data and with previous three-stage gas gun data from Sandia’s STAR facility. The resulting principal Hugoniot and the broad-range EOS and phase diagram up to 10 TPa and 10 5 K are suitable for use in shock experiments and in hydrodynamic simulations. The high-precision experimental results and high-fidelity simulations demonstrate that the Hugoniot of the Ti64 alloy is stiffer than that of pure Ti and reveal that Ti64 melts on the Hugoniot at a significantly lower pressure and temperature than previously modeled.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Towards Diverse and Representative Global Pretraining Datasets for Remote Sensing Foundation Models

The design of a pretraining dataset is emerging as a critical component for the generality of foundation models. In the remote sensing realm, large volumes of imagery and benchmark datasets exist that can be leveraged to pretrain foundation models, however using this imagery in absence of a well-crafted sampling strategy is inefficient and has the potential to create biased and less generalizable models. Here, we provide a discussion and vision for the curation and assessment of pretraining datasets for remote sensing geospatial foundation models. We highlight the importance of geographic, temporal, and image acquisition diversity and review possible strategies to enable such diversity at global scale. In addition to these characteristics, support for various spatial-temporal pretext tasks within the dataset is also critical. Ultimately, our primary objective is to place emphasis on and draw attention to the data curation stage of the foundation model development pipeline. By doing so, we think it is possible to reduce biases of geospatial foundation models, as well as enable broader generalization to downstream remote sensing tasks and applications.

Arndt, Jacob↗
DOE OSTI2022

HL-LHC Computing Review Stage 2, Common Software Projects: Data Science Tools for Analysis

This paper was prepared by the HEP Software Foundation (HSF) PyHEP Working Group as input to the second phase of the LHCC review of High-Luminosity LHC (HL-LHC) computing, which took place in November, 2021. It describes the adoption of Python and data science tools in HEP, discusses the likelihood of future scenarios, and recommendations for action by the HEP community.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Evaluation of data collection bias of third molar stages of mineralisation for age estimation in the living

Abstract Age assessment of the living is a fundamental procedure in the process of human identification, in order to guarantee fair treatment of individuals, which has ethical, civil, legal, and medical repercussions. The careful selection of the appropriate methods requires evaluation of several parameters: accuracy, precision of the method, as well as its reproducibility. The approach proposed by Mincer et al. adapted from Demirjian et al. exploring third molar mineralisation, is one of the most frequently considered for age estimation of the living. Thus, this work aims to assess potential bias in the data collection when applying the classification stages for dental mineralisation adapted by Mincer et al. A total of 102 orthopantomographs, of clinical origin, belonging to individuals aged between 12 and 25 years ($ \bar{\textit x} $ = 20.12 years, SD = 3.49 years; 65 females, 37 males, all of Portuguese nationality) were included and a retrospective analysis performed by five observers with different levels of experience (high, average, and basic). The performance and agreement between five observers were evaluated using Weighted Cohen’s Kappa and the Intraclass Correlation Coefficient. To access the influence of impaction on third molar classification, variables were tested using ordinal logistic regression Generalised Linear Model. It was observed that there were variations in the number of teeth identified among the observers, but the agreement levels ranged from moderate to substantial (0.4–0.8). Upon closer examination of the results, it was observed that although there were discernible differences between highly experienced observers and those with less experience, the gap was not as significant as initially hypothesised, and a greater disparity between the classifications of the upper (0.24–0.49) and lower third molars (>0.55) was observed. When bone superimposition is present, the classification process is not significantly influenced; however, variation in teeth angulation affects the assessment. The results suggest that with an efficient preparation, the level of experience as a factor can be overcome. Mincer and colleague's classification system can be replicated with ease and consistency, even though the classification of upper and lower third molars presents distinct challenges.

de Oliveira Santos, Inês (ORCID:0000000267324347)↗
DOE OSTI2021

Particle-Tracking Proton Computed Tomography—Data Acquisition, Preprocessing, and Preconditioning

Proton CT (pCT) is a promising new imaging technique that can reconstruct relative stopping power (RSP) more accurately than x-ray CT in each cubic millimeter voxel of the patient. This, in turn, will result in better proton range accuracy and, therefore, smaller planned tumor volumes (PTV). The hardware description and some reconstructed images have previously been reported. In a series of two contributions, we focus on presenting the software algorithms that convert pCT detector data to the final reconstructed pCT images for application in proton treatment planning. There were several options on how to accomplish this, and we will describe our solutions at each stage of the data processing chain. In the first paper of this series, we present the data acquisition with the pCT tracking and energy-range detectors and how the data are preprocessed, including the conversion to the well-formatted track information from tracking data and water-equivalent path length from the data of a calibrated multi-stage energy-range detector. These preprocessed data are then used for the initial image formation with an FDK cone-beam CT algorithm. The output of data acquisition, preprocessing, and FDK reconstruction is presented along with illustrative imaging results for two phantoms, including a pediatric head phantom. The second paper in this series will demonstrate the use of iterative solvers in conjunction with the superiorization methodology to further improve the images resulting from the upfront FDK image reconstruction and the implementation of these algorithms on a hybrid CPU/GPU computer cluster.

42 ENGINEERING↗
DOE OSTI2022

Serial crystallography with multi-stage merging of thousands of images

KAMO and BLEND provide particularly effective tools to automatically manage the merging of large numbers of data sets from serial crystallography. The requirement for manual intervention in the process can be reduced by extending BLEND to support additional clustering options such as the use of more accurate cell distance metrics and the use of reflection-intensity correlation coefficients to infer `distances' among sets of reflections. This increases the sensitivity to differences in unit-cell parameters and allows clustering to assemble nearly complete data sets on the basis of intensity or amplitude differences. If the data sets are already sufficiently complete to permit it, one applies KAMO once and clusters the data using intensities only. When starting from incomplete data sets, one applies KAMO twice, first using unit-cell parameters. In this step, either the simple cell vector distance of the original BLEND or the more sensitive NCDist is used. This step tends to find clusters of sufficient size such that, when merged, each cluster is sufficiently complete to allow reflection intensities or amplitudes to be compared. One then uses KAMO again using the correlation between reflections with a common hkl to merge clusters in a way that is sensitive to structural differences that may not have perturbed the unit-cell parameters sufficiently to make meaningful clusters. Many groups have developed effective clustering algorithms that use a measurable physical parameter from each diffraction still or wedge to cluster the data into categories which then can be merged, one hopes, to yield the electron density from a single protein form. Since these physical parameters are often largely independent of one another, it should be possible to greatly improve the efficacy of data-clustering software by using a multi-stage partitioning strategy. Here, one possible approach to multi-stage data clustering is demonstrated. The strategy is to use unit-cell clustering until the merged data are sufficiently complete and then to use intensity-based clustering. Using this strategy, it is demonstrated that it is possible to accurately cluster data sets from crystals that have subtle differences.

36 MATERIALS SCIENCE↗