Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Improving unfolding and systematic uncertainty estimation using generative diffusion networks (Final Technical Report)

This final technical report summarizes the key accomplishments on the unfolding using diffusion model project, a DOE award received by PI Pierre-Hugues Beauchemin at Tufts University. This project main goal was to investigate the potential of diffusion models for unfolding experimental High Energy Physics data from detector effects while controlling systematics uncertainties. The project accomplished its goals by completing the following objectives: 1) Performing an object-by-object, event-by-event unfolding of various kinematic distributions reconstructed from detector data in HEP in a way that keeps correlations between unfolded observables while demonstrating competitive performance compared to standard algorithms used in the field; 2) Address the generalization problem by developing an unfolding algorithm capable to correctly infer the underlying distributions of observables and processes never seen before, while controlling the dominant theoretical uncertainties affecting the process, therefore increasing the effectiveness, the precision, and the applicability of the developed algorithm; 3) Understand the theoretical foundations between the developed algorithm so to extend it to applications beyond experimental HEP, for broader benefits to the society. This report provides an overview of the accomplishments related to each of these key objectives.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-resolution lithospheric structure of continental China from joint inversion of surface wave and gravity data

The lithospheric structure of continental China has been previously determined by seismic travel time tomography, surface wave tomography, and joint inversion of body wave and surface wave data. However, due to the inherent limitations of seismic data, the lithospheric structure of continental China is still not well resolved in the shallow part and in some regions where the station coverage is relatively sparse. In this study, we aim at improving the lithospheric structure by joint inversion of seismic surface wave data and satellite gravity data to take advantage of the uniform distribution and complementary strength of the gravity data. Here, the empirical relationship between velocity and density is used as a bridge for joint inversion of surface wave and gravity data. The joint inversion shear-wave velocity Vs (density) model, named as USTClitho1.0g, can fit both surface wave and gravity data well. This high-resolution Vs model can better fit the active airgun source seismic arrival times and better delineate some features in continental China, such as the velocity contrast across the north–south gravity lineament (NSGL), the lithosphere thinning in eastern China, the crustal footprint of the Hainan mantle plume, the likely magma chamber beneath volcanos in northeast China, the middle-lower crust low velocity layer beneath the Tibetan plateau, and the tearing of subducted Indian mantle lithosphere. Our joint inversion Vs model can provide a reference model for geosciences in continental China and surrounding areas.

58 GEOSCIENCES↗

Interpretation of HFTS 2 Microseismic Data Using Bedding-Plane-Slip Mechanism

Summary The objective of this study is to understand how microseismic events are generated during hydraulic fracturing, as well as the role of geomechanical conditions (i.e., stress and mechanical stratigraphy) in this process. In the industry, microseismic event clouds have been generally used as an “outer boundary” of the “stimulated reservoir volume” (SRV). However, by comparing with other surveillance data (low-frequency distributed acoustic sensing, or LF-DAS, strain) in the Hydraulic Fracturing Test Site (HFTS) 2 experiment, we show that this assumption is fundamentally flawed. The HFTS 2 data have three unique observations that have not been commonly observed in other datasets: (1) Due to the influence of offset pad depletion, microseismic data show that hydraulic fractures from the child well can propagate over 3,000 ft into the depleted low-stress zone. (2) By comparing microseismic and horizontal fiber LF-DAS strain data, we observe that the microseismic event cloud does not necessarily reflect the created hydraulic fracture volume. Particularly, the extent of microseismic event clouds near heel stages is much shorter than what is shown with LF-DAS strain data. (3) Microseismic event magnitudes are larger in the depleted regions. Through geomechanical analysis, we demonstrate that the “bedding-plane-slip” model is likely the mechanism for microseismic generation during hydraulic fracturing. This model successfully explains the above field observations from the HFTS 2 experiment. We also provide a quantitative relationship connecting the microseismic event magnitude with fracture width increment and layer mechanical property contrast.

Engineering↗

Robust Distributed State Estimator for Interconnected Transmission and Distribution Networks (Final Report RPPR-1)

This project’s objective is to develop a combined transmission and distribution state estimator which accounts for very large system size and model complexity (by way of distributing the computations) and large number of solar PV units connected to the distribution system on multiple feeders. The project not only provides a robust formulation and solution to this problem but also tests the solution by implementing it on a well-established large utility system. It introduces several improvements with respect to the state of the art in existing state estimation software: (a) The developed state estimator (SE) allows robust and accurate monitoring of bidirectional flows in distribution systems which result due to the distributed energy sources which are not observable and thus not incorporated in generation dispatch; (b) Large utility systems with tens of thousands of transmission buses and hundreds of thousands of distribution nodes are difficult to model as a single integrated system. This shortcoming is addressed by developing a “scalable distributed computational framework” which allows splitting the ultra large system models into several small subsystems and coordinating their solution by a robust and practical state estimation formulation; (c) Measurement errors irrespective of their locations are detected and removed by the developed state estimator. Historically, transmission and distribution systems were analyzed and operated as two independent systems. Given the non-transposed short feeder sections, unevenly loaded phases, strictly radial configuration and unidirectional power flows in the absence of remote generation, distribution system analysis was customized to account for these characteristics. However, some of these assumptions are no longer valid (non-radial configuration, bidirectional power flows) and thus distribution system analysis should be revisited. Furthermore, in the past, the interaction between the transmission and distribution systems was quite passive, where distribution substations were modeled as lumped loads in the transmission system model. With substantial generation injected by renewable generation located in the distribution systems, such modeling will no longer be accurate. The developed state estimator facilitates proper monitoring of the interactions between the transmission and distribution systems and enables smart dispatch of these units which are made observable by the state estimator.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

State of the art astronomical simulations have provided datasets which enabled the training of novel deep learning techniques for constraining cosmological parameters. However, differences in subgrid physics implementation and numerical approximations among simulation suites lead to differences in simulated datasets, which pose a hard challenge when trying to generalize across diverse data domains and ultimately when applying models to observational data. Recent work reveals deep learning algorithms are able to extract more information from complex cosmological simulations than summary statistics like power spectra. We introduce Domain Adaptive Graph Neural Networks (DA-GNNs), trained on CAMELS data, inspired by CosmoGraphNet (Villanueva-Domingo et al 2023). By utilizing GNNs, we can capitalize on their capacity to capture both astrophysical and topological features of galaxy distributions. Mixing these capabilities with domain adaptation techniques such as Maximum Mean Discrepancy (MMD), which enable extraction of domain-invariant features, our framework demonstrates enhanced accuracy and robustness. We present experimental results, including the alignment of distributions across domains through data visualization. These findings suggest that DA-GNNs are an efficient way of extracting domain independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying the impact of climate change on erosion - 20397

The New York State Energy Research and Development Authority (NYSERDA) is the owner of the Western New York Nuclear Service Center (WNYNSC), a 1,351-ha (3,338-ac) site located approximately 48 km (30 mi) south of Buffalo, New York. In 1962, Nuclear Fuel Services, Inc. (NFS) entered into Agreements with the Atomic Energy Commission and New York State to construct the first commercial reprocessing plant of nuclear fuel in the United States. NFS, a private company, built and operated the spent fuel reprocessing plant and waste disposal facilities, processing 640 Mg (metric tons, or 705 short tons) of spent nuclear fuel from 1966 to 1972 under an Atomic Energy Commission license. Nuclear fuel reprocessing operations ended in 1972 and never reopened, leaving behind radioactive and chemical wastes. Erosion can play an important role in the fate and transport of waste at sites where disposal of long-lived waste is anticipated. The statistical characterization of key processes related to erosion is essential to the understanding of site stability through time. One of the key processes governing erosion is extreme precipitation and it is critical that trends in the distribution of extreme precipitation events through time be represented. The evidence of climate change is increasingly well documented and projected impacts on extreme precipitation events should be incorporated in performance assessment studies when relevant. Not evaluating future climate states in a performance assessment is contradictory to good modeling practice. Specifically, excluding climate change limits development of modeling information that could aid in effective decision making. The current climate literature provides both observational evidence and climate model projections of climate trends and/or climate change in the late 20. and early 21. centuries for North America and the northeast United States. In this work, this information was used to assess the impacts of potential changes in climate on erosion processes. The goal was to understand how projections of future climate relate to the performance of the WNYNSC through time. In the first stage of this work multi-temporal historical aerial images were analyzed in conjunction with orthophotography and Lidar data to develop probability distributions for variables representing important erosion processes. The information from these analyses was then used in conjunction with simulated data from the West Valley Erosion Working Group (EWG). Analysis of EWG simulations provides estimates for the change in erosion rates through time that is driven by changes in climate. The time-varying rates of erosion change were applied to the historical aerial imagery data in order to inform time-varying rates of erosion that are driven by changes in climate. Ultimately, this process resulted in the identification of locations for features like gully heads using both the Lidar dataset and projection of the estimated location from the historical aerial photo under consideration back to the Lidar dataset. The distance between the estimate of the location from the historical image and that of the Lidar dataset was the estimated distance the feature has moved. This distance was then divided by the number of years between the Lidar dataset and the year of the historical aerial image of interest to get a rate of movement through time. This was done for several dozen points on each historical aerial image. The analyses from the EWG were used to characterize the relative impact of climate change on the erosion rates. This relative impact was quantified by comparing the LEM based estimates of erosion that were derived using historical climate data with LEM based estimates of erosion that were derived using projections of future climate. The relative increase in the erosion rates was then applied to the historical estimates of erosion derived from the analysis of the historical aerial imagery. This approach was used since the LEM-based estimated of the historical erosion rates from the past century have a bias towards underestimating erosion. This underestimation is hypothesized to be a consequence of an inability of the LEMs to account for the impacts of land-use change (i.e. deforestation) which had been shown to significantly increase erosion in similar Northern hardwood forest ecosystems. In summary, gully head retreat rate and gully widening rate were characterized using statistical probability distributions from the historical aerial image analysis. Simulated data from the EWG was used to estimate the climatically-driven changes in erosion rates through time. The changes through time from the EWG were applied to the gully head retreat rate and gully widening rate characterized using the historical aerial image analysis. This information can be used to inform PPA models to project future risks from a given site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Comprehensive Characterization of Water Group Ion Composition and Distributions in Saturn's Magnetosphere With Cassini Plasma Spectrometer Data

Saturn's magnetosphere is continuously supplied with neutrals from the Enceladus plume and the icy rings, which undergo ionization and charge-exchange to form a complex water-group plasma environment. While the Cassini Plasma Spectrometer (CAPS) instrument has provided extensive compositional information, detailed separation of individual water-group ion species in time-of-flight (TOF) data has not previously been achieved. In this study, we perform forward modeling of CAPS-IMS energy-per-charge (E/Q) and TOF spectra obtained between 2004 and 2012 to resolve O + , OH + , H 2 O + , and H 3 O + and to characterize their plasma properties, including number density, temperature, and thermodynamic κ. Our results demonstrate that O + is the dominant thermal ion species throughout Saturn's magnetosphere, comprising up to ∼70% of the total ion population beyond ∼5 Saturn radii (R S ). In contrast, molecular ions such as OH + , H 2 O + , and H 3 O + dominate closer to Enceladus but rapidly dissociate into atomic ions between ∼5 and 10 R S . This radial region is also characterized by the steepest increase in plasma flow speed, which rises from ∼40% to ∼80% of rigid corotation. Simultaneously, ion velocity distributions approach Maxwell–Boltzmann equilibrium, as indicated by high kappa values. These findings provide new constraints on the ion–neutral chemistry that regulates the balance between molecular and atomic ions in Saturn's magnetosphere. They also emphasize the critical role of the 5–10 R S region as a transition zone for both plasma composition and dynamics. Our results refine previous CAPS-based studies and underscore the need to incorporate seasonal variability and ionospheric coupling into future global models of Saturn's plasma environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SAIL-Net CloudPuck CCN Data

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleations particles (INP). This network enables the investigation of small-scale variations in complex terrain. This specific dataset provides the cleaned data recorded from the CloudPuck, an in house instrument made by Handix Scientific that counts CCN concentrations. The CloudPuck was deployed at the sites for the summer/fall of 2022 before winter conditions were too harsh to maintain the instrument. For more information on the the CloudPuck or how the raw data are processed, see the read me.

54 ENVIRONMENTAL SCIENCES↗

Gray-Box Modeling for Distribution Systems With Inverter-Based Resources: Integrating Physics-Based and Data-Driven Approaches

Here, in this paper, we develop a novel gray-box modeling approach for distribution systems with inverter-based resources (IBRs). The proposed gray-box modeling method aims to improve estimation accuracy by taking advantages of both physics-based (white-box) and data-driven (black-box) modeling approaches. To this end, we utilize partial physical knowledge of the system, including the inverters’ structures and control diagrams, as well as the equivalent network model simplified through Kron reduction. The white-box model containing unknown parameters is then constructed with mathematical equations and an optimization-based method is subsequently employed to identify these unknown parameters within the white-box model. Next, the graybox modeling framework is then constructed by embedding the output variables of the white-box model into the input vector of a black-box model (represented using a neural network). Finally, the black-box section is trained using the collected input-output datasets and the gray-box model is then obtained. Furthermore, case studies demonstrate that our gray-box modeling approach effectively improves estimation accuracy compared to purely physics-based or data-driven methods.

42 ENGINEERING↗

Residuals-based distributionally robust optimization with covariate information

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in the sense that it can accommodate a variety of regression setups and DRO ambiguity sets. We investigate asymptotic and finite sample properties of solutions obtained using Wasserstein, sample robust optimization, and phi-divergence-based ambiguity sets within our DRO formulations, and explore cross-validation approaches for sizing these ambiguity sets. Through numerical experiments, we validate our theoretical results, study the effectiveness of our approaches for sizing ambiguity sets, and illustrate the benefits of our DRO formulations in the limited data regime even when the prediction model is misspecified.

97 MATHEMATICS AND COMPUTING↗

Synthesis of historical reservoir operations from 1980 to 2020 for the evaluation of reservoir representation in large-scale hydrologic models

Abstract. All the major river systems in the contiguous United States (CONUS) (and many in the world) are impacted by dams, yet reservoir operations remain difficult to quantify and model due to a lack of data. Reservoir operation data are often inaccessible or distributed across many local operating agencies, making the acquisition and processing of data records quite time-consuming. As a result, large-scale models often rely on simple parameterizations for assumed reservoir operations and have a very limited ability to evaluate how well these approaches match actual historical operations. Here, we use the first national dataset of historical reservoir operations in the CONUS domain, ResOpsUS, to analyze reservoir storage trends and operations in more than 600 major reservoirs across the US. Our results show clear regional differences in reservoir operations. In the eastern US, which is dominated by flood control storage, we see storage peaks in the winter months with sharper decreases in the operational range (i.e., the difference between monthly maximum and minimum storage) in the summer. In the more arid western US where storage is predominantly for irrigation, we find that storage peaks during the spring and summer with increases in the operational range during the summer months. The Lower Colorado region is an outlier because its seasonal storage dynamics more closely mirrored those of flood control basins, yet the region is classified as arid, and most reservoirs have irrigation uses. Consistent with previous studies, we show that average annual reservoir storage has decreased over the past 40 years, although our analyses show a much smaller decrease than previous work. The reservoir operation characterizations presented here can be used directly for development or evaluation of reservoir operations and their derived parameters in large-scale models. We also evaluate how well historical operations match common assumptions that are often applied in large-scale reservoir parameterizations. For example, we find that 100 dams have maximum storage values greater than the reported reservoir capacity from the Global Reservoirs and Dams database (GRanD). Finally, we show that operational ranges have been increasing over time in more arid regions and decreasing in more humid regions, pointing to the need for operating policies which are not solely based on static values.

Geology↗

SAIL-Net Raw and Post Corrected POPS Data Fall 2021 - Summer 2023

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleation particles (INP). This network enables the investigation of small-scale variations in complex terrain. Two datasets are provided - one containing raw data and the other containing post-corrected data. The raw dataset provides the raw data recorded from the POPS which were deployed at each of the six sites. These data are organized by site and broken down into daily data files. The six site names used here are: “gothic”, “irwin”, “cbtop”, “cbmid”, “pumphouse”, and “snodgrass”. These data are not cleaned or post-corrected, but some flags have been added. The data are reported at 1 second time resolution. The post-corrected dataset provides the post-corrected and cleaned data recorded from the POPS which were deployed at each of the six sites. This data are also organized by site (same as those found in the raw data) and broken down into daily data files. Unlike the raw POPS data, these data have already been cleaned to remove what we believe are bad values. These data should be ready to use with no cleaning. For a full description of the cleaning and post-correction process, see the readme.

54 ENVIRONMENTAL SCIENCES↗

Multi-Fidelity Gaussian Process for Distribution System Voltage Probabilistic Estimation with PVs

The increasing penetration of behind-the-meter PVs causes challenges to maintain voltage security due to the lack of distribution system visibility. This paper proposes a nonlinear autoregressive Gaussian process (NARGP) approach to fuse limited number of SCADA/AMI data together with historical pseudo measurements for distribution node voltage probabilistic estimation. The high-fidelity SCADA data are fused with the low-fidelity AMI and pseudo measurements by the autoregressive algorithm embedded in the Gaussian process. This allows us to use multi-fidelity data to achieve entire distribution system voltage visibility. Numerical results carried out on the IEEE 123node system demonstrate that the NARGP method is able to obtain high accuracy in estimating bus voltage and quantifying estimation uncertainties as compared to other approaches.

distribution system estimation↗

Population balance modeling of polyurethane foam formation with pressure‐dependent growth kernel

Abstract Polyurethane foams are widely used materials often chosen for their useful characteristics such as low thermal conductivity, ease of application, and high strength‐to‐weight ratios. Computational models are needed to predict the dynamics of the flow and expansion, and the resulting material properties, to improve manufacturing processes. In this paper, a model for PMDI, a water‐blown polyurethane foam, is presented. By extending a kinetics‐based approach by adding bubble‐scale information via a population balance equation (PBE) using the quadrature method of moments, we can track bubble size distributions during foaming. We present results from a three‐dimensional computational fluid dynamics model using arbitrary Lagrangian–Eulerian interface tracking implemented in finite element software. The model compares favorably with experimental data, including dynamics, bubble distributions measured by both camera and diffusion wave spectroscopy, and post‐test bubble size from scanning electron microscopy and density measurements from x‐ray computed tomography.

Ortiz, Weston↗

Modification and analysis of context-specific genome-scale metabolic models: methane-utilizing microbial chassis as a case study

ABSTRACT Context-specific genome-scale model (CS-GSM) reconstruction is becoming an efficient strategy for integrating and cross-comparing experimental multi-scale data to explore the relationship between cellular genotypes, facilitating fundamental or applied research discoveries. However, the application of CS modeling for non-conventional microbes is still challenging. Here, we present a graphical user interface that integrates COBRApy, EscherPy, and RIPTiDe, Python-based tools within the BioUML platform, and streamlines the reconstruction and interrogation of the CS genome-scale metabolic frameworks via Jupyter Notebook. The approach was tested using -omics data collected for Methylotuvimicrobium alcaliphilum 20Z R , a prominent microbial chassis for methane capturing and valorization. We optimized the previously reconstructed whole genome-scale metabolic network by adjusting the flux distribution using gene expression data. The outputs of the automatically reconstructed CS metabolic network were comparable to manually optimized i IA409 models for Ca-growth conditions. However, the CS model questions the reversibility of the phosphoketolase pathway and suggests higher flux via primary oxidation pathways. The model also highlighted unresolved carbon partitioning between assimilatory and catabolic pathways at the formaldehyde-formate node. Only a very few genes and only one enzyme with a predicted function in C1 metabolism, a homolog of the formaldehyde oxidation enzyme ( fae1-2 ), showed a significant change in expression in La-growth conditions. The CS-GSM predictions agreed with the experimental measurements under the assumption that the Fae1-2 is a part of the tetrahydrofolate-linked pathway. The cellular roles of the tungsten (W)-dependent formate dehydrogenase ( fdhAB ) and fae homologs ( fae1-2 and fae3 ) were investigated via mutagenesis. The phenotype of the f dhAB mutant followed the model prediction. Furthermore, a more significant reduction of the biomass yield was observed during growth in La-supplemented media, confirming a higher flux through formate. M. alcaliphilum 20Z R mutants lacking fae1-2 did not display any significant defects in methane or methanol-dependent growth. However, contrary to fae1, the fae1-2 homolog failed to restore the formaldehyde-activating enzyme function in complementation tests. Overall, the presented data suggest that the developed computational workflow supports the reconstruction and validation of CS-GSM networks of non-model microbes. IMPORTANCE The interrogation of various types of data is a routine strategy to explore the relationship between genotype and phenotype. An efficient approach for integrating and cross-comparing experimental multi-scale data in the context of whole-genome-based metabolic network reconstruction becomes a powerful tool that facilitates fundamental and applied research discoveries. The present study describes the reconstruction of a context-specific (CS) model for the methane-utilizing bacterium, Methylotuvimicrobium alcaliphilum 20Z R . M. alcaliphilum 20Z R is becoming an attractive microbial platform for the production of biofuels, chemicals, pharmaceuticals, and bio-sorbents for capturing atmospheric methane. We demonstrate that this pipeline can help reconstruct metabolic models that are similar to manually curated networks. Furthermore, the model is able to highlight previously overlooked pathways, thus advancing fundamental knowledge of non-model microbial systems or promoting their development toward biotechnological or environmental implementations.

Kulyashov, M. A.↗

An Investigation of Time Distributions for Task Primitives to Support the HUNTER Dynamic Human Reliability Analysis

As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.

99 GENERAL AND MISCELLANEOUS↗

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗