SEARCH · Engineering Papers

Results for “Data Variables”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Impact of a dynamic grid mix and climate on operational carbon emissions modeling for different building typologies and climate zones

Calculating operational carbon emissions through a building’s lifecycle is complex due to the dynamic nature of influencing factors such as climate and energy grid mix. This paper introduces a novel methodology for modeling 30-year operational carbon impacts of buildings and applies this method to mid-rise office and residential typologies across various US climate zones. The method accounts for these temporal variabilities using new and scarcely cited data sources. Key findings indicate that future changes in the climate, while impactful, play a relatively modest role in operational carbon emissions compared to significant reductions with modeling scenarios using the projected decarbonization of the electricity grid. Here, the study also finds that using annual, month-hourly, or hourly grid emission factors have a minimal impact on carbon accounting, except in certain climates and program types where emission patterns do not align with a building’s energy consumption. Warmer climates like Miami, Florida and Tucson, Arizona, which rely heavily on cooling, demonstrate larger variations in carbon emissions when using higher temporal resolution emission factors. Ultimately, this study underscores the critical role of grid decarbonization in reducing long-term emissions and the importance of incorporating this variable in life cycle assessment (LCA) modeling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Characterizing climate pathways using feature importance on echo state networks

The 2022 National Defense Strategy of the United States listed climate change as a serious threat to national security. Climate intervention methods, such as stratospheric aerosol injection, have been proposed as mitigation strategies, but the downstream effects of such actions on a complex climate system are not well understood. The development of algorithmic techniques for quantifying relationships between source and impact variables related to a climate event (i.e., a climate pathway) would help inform policy decisions. Data-driven deep learning models have become powerful tools for modeling highly nonlinear relationships and may provide a route to characterize climate variable relationships. In this paper, we explore the use of an echo state network (ESN) for characterizing climate pathways. ESNs are a computationally efficient neural network variation designed for temporal data, and recent work proposes ESNs as a useful tool for forecasting spatiotemporal climate data. However, ESNs are noninterpretable black-box models along with other neural networks. The lack of model transparency poses a hurdle for understanding variable relationships. We address this issue by developing feature importance methods for ESNs in the context of spatiotemporal data to quantify variable relationships captured by the model. We conduct a simulation study to assess and compare the feature importance techniques, and we demonstrate the approach on reanalysis climate data. In the climate application, we consider a time period that includes the 1991 volcanic eruption of Mount Pinatubo. This event was a significant stratospheric aerosol injection, which acts as a proxy for an anthropogenic stratospheric aerosol injection. Furthermore, we are able to use the proposed approach to characterize relationships between pathway variables associated with this event that agree with relationships previously identified by climate scientists.

black-box models↗

DOE OSTI2023

Importance of incorporating spatial and temporal variability of biomass yield and quality in bioenergy supply chain

Abstract Biofuels made from biomass and waste residues will largely contribute to United States’ 2050 decarbonization goal in the aviation sector. While cellulosic biofuels have the potential fuel performance equivalent to petroleum-based jet fuel, the biofuel industry needs to overcome the supply chain barrier caused by temporal and spatial variability of biomass yield and quality. This study highlights the importance of incorporating spatial and temporal variability during biomass supply chain planning via optimization modeling that incorporates 10 years of drought index data, a primary factor contributing to yield and quality variability. The results imply that the cost of delivering biomass to biorefinery may be significantly underestimated if the multi-year temporal and spatial variation in biomass yield and quality is not captured. For long term sustainable biorefinery operations, the industry should optimize supply chain strategy by studying the variability of yield and quality of biomass in their supply sheds.

09 BIOMASS FUELS↗

DOE OSTI2022

System and method for measuring sun-induced chlorophyll fluorescence

A chlorophyll fluorescence measuring system having at least one spectrometer coupled to a data logger. The data logger provides direct control of the spectrometer and includes on-board memory for storage of target and reference spectrum data obtained by the spectrometer. The data logger may be coupled to an external computer that receives and analyzes target and reference spectrum data to determine SIF using a spectral fitting algorithm. The system may include a spectrometer aiming system coupled to and controlled by the data logger. The system may also include one or more environmental sensors configured to measure environment variables. The environmental sensors may be coupled to the data logger for control and data storage. The environmental data may be communicated to the external computer for use in the spectral fitting algorithm. The data logger may be connected to a network for remote monitoring and control.

Gu, Lianhong↗

DOE OSTI2021

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

Large compilations of heterogeneous environmental observations are increasingly available as public databases, allowing researchers to test hypotheses across datasets. Statistical complexities arise when analyzing compiled data due to unbalanced spatial sampling, variable environmental context, mixed measurement techniques, and other reasons. Hierarchical Bayesian modeling is increasingly used in environmental science to describe these complexities, however few studies explicitly compare the utility of hierarchical Bayesian models to simpler and more commonly applied methods. Here we demonstrate the utility of the hierarchical Bayesian approach with application to a large compiled environmental dataset consisting of 5,741 marine vertical organic carbon flux observations from 407 sampling locations spanning eight biomes across the global ocean. We fit a global scale Bayesian hierarchical model that describes the vertical profile of organic carbon flux with depth. Profile parameters within a particular biome are assumed to share a common deviation from the global mean profile. Individual station-level parameters are then modeled as deviations from the common biome-level profile. The hierarchical approach is shown to have several benefits over simpler and more common data aggregation methods. First, the hierarchical approach avoids statistical complexities introduced due to unbalanced sampling and allows for flexible incorporation of spatial heterogeneitites in model parameters. Second, the hierarchical approach uses the whole dataset simultaneously to fit the model parameters which shares information across datasets and reduces the uncertainty up to 95% in individual profiles. Third, the Bayesian approach incorporates prior scientific information about model parameters; for example, the non-negativity of chemical concentrations or mass-balance, which we apply here. We explicitly quantify each of these properties in turn. We emphasize the generality of the hierarchical Bayesian approach for diverse environmental applications and its increasing feasibility for large datasets due to recent developments in Markov Chain Monte Carlo algorithms and easy-to-use high-level software implementations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Hydrogen uptake in graphite matrix at high temperature

Tritium management is a critical challenge for the next generation of nuclear reactors, such as Fluoride Salt Cooled High Temperature Reactors (FHRs) and High Temperature Gas-cooled Reactors (HTGRs), due to the higher production rate (up to 10,000 times) than conventional Light Water Reactors (LWRs). Graphitic materials employed as moderator, reflector, and fuel pebbles offer a potential pathway for tritium recovery by serving as a sink for tritium. Prediction of uptake capacity under reactor relevant conditions remains a challenge due to a lack of low partial pressure data and significant inter-grade variability of graphite. This study addresses these gaps by providing a comprehensive characterization of hydrogen (as a tritium surrogate) uptake and release behavior in the A3-3 graphite matrix (GM) used in fuel pebbles. Uptake measurements are performed at reactor relevant temperatures of 600- 800 °C, 1-200 Torr hydrogen pressure, and 15-120 min equilibration time, followed by thermal desorption spectroscopy up to 1100 °C. Uptake experiments at different equilibration times demonstrate the role of kinetics in hydrogen uptake, which can be modeled as a diffusion-with-trapping process. In the thermodynamics limit, the Sips adsorption model is shown to capture the uptake in A3-3 GM well. Our campaign provides a set of new results for hydrogen uptake in A3-3, including limiting uptake capacity at 600 °C, apparent diffusion coefficient at 600 °C, and the first estimates of the FHR/HTGR relevant (600 °C, 20 Pa partial pressure) equilibrium uptake capacity and time to saturation. Desorption data highlights a new site for hydrogen uptake, not observed in nuclear graphite, which we attribute to the non-graphitized binder. Using the Kissinger method, we estimate activation energy for release from the desorption peaks, confirming the activation energy for release from the basal planes and providing the first estimate for the activation energy of release from the binder.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Using feature importance as an exploratory data analysis tool on Earth system models

Abstract. Machine learning (ML) models are commonly used to generate predictions, but these models can also support the discovery of new science. Generating accurate predictions necessitates that a model captures the structure of the underlying data. If the structure is properly extracted, ML could be a useful exploratory and evidential tool. In this paper, we present a case study that demonstrates the use of ML for exploratory data analysis (EDA) in the climate space. We apply the ML explainability method of spatiotemporal zeroed feature importance (stZFI) to understand how climate-variable associations evolve over space and time. Our analyses focus on data from ensembles of Earth system models (ESMs) which provide data on different climate states and conditions. We elect to work with ESM ensembles since they allow us to compare feature importance across alternative scenarios not available with observed data. The ensembles also account for natural variability so that we can distinguish between signal and noise due to natural climate variability when computing feature importance. The use of perturbed initial condition ensembles introduces variability mimicking the natural variability in the atmosphere; thus the signals emerging using feature importance (FI) can be evaluated against the natural variability in the climate system. For our analyses, we consider the 1991 volcanic eruption of Mount Pinatubo, which was a large stratospheric aerosol injection. We explore the climate pathway associated with the eruption from aerosols to radiation to temperature at both the near-surface and stratospheric levels. In addition to applying the method to data generated from two different ESMs, we apply stZFI to reanalysis data to compare the associations identified by stZFI. We show how stZFI tracks the importance of aerosol optical depth over time on forecasting temperatures. This case study illustrates usefulness of an ML tool (stZFI) for EDA on a well-studied climate exemplar.

Ries, Daniel (ORCID:0000000250294647)↗

DOE OSTI2022

Predicting Rare Earth Element Potential in Produced and Geothermal Waters of the United States via Emergent Self-Organizing Maps

This work applies emergent self-organizing map (ESOM) techniques, a form of machine learning, in the multidimensional interpretation and prediction of rare earth element (REE) abundance in produced and geothermal waters in the United States. Visualization of the variables in the ESOM trained using the input data shows that each REE, with the exception of Eu, follows the same distribution patterns and that no single parameter appears to control their distribution. Cross-validation, using a random subsample of the starting data and only using major ions, shows that predictions are generally accurate to within an order of magnitude. Using the same approach, an abridged version of the U.S. Geological Survey Produced Waters Database, Version 2.3 (which includes both data from produced and geothermal waters) was mapped to the ESOM and predicted values were generated for samples that contained enough variables to be effectively mapped. Results show that in general, produced and geothermal waters are predicted to be enriched in REEs by an order of magnitude or more relative to seawater, with maximum predicted enrichments in excess of 1000-fold. Cartographic mapping of the resulting predictions indicates that maximum REE concentrations exceed values in seawater across the majority of geologic basins investigated and that REEs are typically spatially co-associated. The factors causing this co-association were not determined from ESOM analysis, but based on the information currently available, REE content in produced and geothermal waters is not directly controlled by lithology, reservoir temperature, or salinity.

Engle, Mark A. (ORCID:0000000152587374)↗

DOE OSTI2020

A Multiyear Gridded Data Ensemble of Surface Biogenic Carbon Fluxes for North America: Evaluation and Analysis of Results

Accurate and fine-scale estimates of biogenic carbon fluxes are critical for measuring and monitoring the biosphere's responses and feedback to the climate system. Currently available data products from flux towers and model-intercomparison projects struggle to adequately represent spatiotemporal dynamics of surface biogenic carbon fluxes, and to quantify their uncertainties, which also are crucial to atmospheric inversion systems. To address these gaps, we introduce a new perturbed-parameter model ensemble with the CASA model to estimate surface biogenic carbon fluxes at monthly and 3-hourly scales for North America at ~500-m and 5-km resolutions. We first use the Extended Fourier Amplitude Sensitivity Testing to choose the three most sensitive parameters to be perturbed, maximum light use efficiency (E max ), optimal temperature of photosynthesis (T opt ), and temperature response of respiration (Q 10 ). The initial range for each parameter is broadly sampled for the L1 ensemble, but then we pruned E max with site-level primary productivity to derive an L2 ensemble with narrower uncertainty ranges. Ensembles are strongly correlated with site-level results at both monthly and 3-hourly scales, and the spread across L1/L2 ensemble members encompasses the range of AmeriFlux observations. Monthly variability in the L2 ensemble mean is 85% of the observed variability. The L2 ensemble outperforms diverse data products with the highest Taylor skill scores at diurnal to annual scales. Finally, the ensemble's seasonality agrees well with other models for most biome types and in high and middle latitudes, but inconsistencies are found in subtropical and tropical ecoregions and for annual totals over North America.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Quasar Identification Using Multivariate Probability Density Estimated from Nonparametric Conditional Probabilities

Nonparametric estimation for a probability density function that describes multivariate data has typically been addressed by kernel density estimation (KDE). A novel density estimator recently developed by Farmer and Jacobs offers an alternative high-throughput automated approach to univariate nonparametric density estimation based on maximum entropy and order statistics, improving accuracy over univariate KDE. This article presents an extension of the single variable case to multiple variables. The univariate estimator is used to recursively calculate a product array of one-dimensional conditional probabilities. In combination with interpolation methods, a complete joint probability density estimate is generated for multiple variables. Good accuracy and speed performance in synthetic data are demonstrated by a numerical study using known distributions over a range of sample sizes from 100 to 10 6 for two to six variables. Performance in terms of speed and accuracy is compared to KDE. The multivariate density estimate developed here tends to perform better as the number of samples and/or variables increases. As an example application, measurements are analyzed over five filters of photometric data from the Sloan Digital Sky Survey Data Release 17. The multivariate estimation is used to form the basis for a binary classifier that distinguishes quasars from galaxies and stars with up to 94% accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Data driven discovery and quantification of hyperspectral leaf reflectance phenotypes across a maize diversity panel

Abstract Estimates of plant traits derived from hyperspectral reflectance data have the potential to efficiently substitute for traits, which are time or labor intensive to manually score. Typical workflows for estimating plant traits from hyperspectral reflectance data employ supervised classification models that can require substantial ground truth datasets for training. We explore the potential of an unsupervised approach, autoencoders, to extract meaningful traits from plant hyperspectral reflectance data using measurements of the reflectance of 2151 individual wavelengths of light from the leaves of maize ( Zea mays ) plants harvested from 1658 field plots in a replicated field trial. A subset of autoencoder‐derived variables exhibited significant repeatability, indicating that a substantial proportion of the total variance in these variables was explained by difference between maize genotypes, while other autoencoder variables appear to capture variation resulting from changes in leaf reflectance between different batches of data collection. Several of the repeatable latent variables were significantly correlated with other traits scored from the same maize field experiment, including one autoencoder‐derived latent variable (LV8) that predicted plant chlorophyll content modestly better than a supervised model trained on the same data. In at least one case, genome‐wide association study hits for variation in autoencoder‐derived variables were proximal to genes with known or plausible links to leaf phenotypes expected to alter hyperspectral reflectance. In aggregate, these results suggest that an unsupervised, autoencoder‐based approach can identify meaningful and genetically controlled variation in high‐dimensional, high‐throughput phenotyping data and link identified variables back to known plant traits of interest.

Tross, Michael C.↗

DOE OSTI2024

Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots

Most problems within and beyond the scientific domain can be framed into one of the following three levels of complexity of function approximation. Type 1: Approximate an unknown function given input/output data. Type 2: Consider a collection of variables and functions, some of which are unknown, indexed by the nodes and hyperedges of a hypergraph (a generalized graph where edges can connect more than two vertices). Given partial observations of the variables of the hypergraph (satisfying the functional dependencies imposed by its structure), approximate all the unobserved variables and unknown functions. Type 3: Expanding on Type 2, if the hypergraph structure itself is unknown, use partial observations of the variables of the hypergraph to discover its structure and approximate its unknown functions. These hypergraphs offer a natural platform for organizing, communicating, and processing computational knowledge. While most scientific problems can be framed as the data-driven discovery of unknown functions in a computational hypergraph whose structure is known (Type 2), many require the data-driven discovery of the structure (connectivity) of the hypergraph itself (Type 3). We introduce an interpretable Gaussian Process (GP) framework for such (Type 3) problems that does not require randomization of the data, access to or control over its sampling, or sparsity of the unknown functions in a known or learned basis. Its polynomial complexity, which contrasts sharply with the super-exponential complexity of causal inference methods, is enabled by the nonlinear ANOVA capabilities of GPs used as a sensing mechanism.

Science & Technology - Other Topics↗

DOE OSTI2025

Influence of simple terrain on the spatial variability of a low-level jet and wind farm performance in the AWAKEN field campaign

In wind energy research, scientific challenges are often associated with complex terrain sites, where orography, vegetation, and buildings disrupt flow uniformity. However, even sites characterized as simple terrain can exhibit significant spatial variability in wind speed, particularly during stable boundary layers (SBLs) and low-level jets (LLJs). This study investigates these terrain interactions using both simulations and observations from the American WAKe ExperimeNt (AWAKEN). We employ a multiscale Weather Research and Forecasting (WRF) model simulation, integrating mesoscale forcing in the coarse domains and representing three rows of turbines from the King Plains wind farm as generalized actuator disks (GAD) in the large-eddy simulation (LES) domains. During a nocturnal LLJ event on 3 April 2023, the downstream, wake-affected turbine rows outperformed the upstream, unwaked row by 25 %–51 %. This counterintuitive result arises from terrain-induced streamwise variations in hub-height wind speed of approximately 4 m s −1 over 5 km – equivalent to ∼50 % of the upstream reference speed. This enhancement outweighs the wake-induced reduction in mean wind speed (∼12 %) and global blockage effects reported in the literature (∼1 %–3.4 %). The multiscale simulations capture the intra-farm spatial variability in power performance observed in SCADA data. Terrain-induced vertical displacement of the LLJ, coupled with large wind shear below the jet maximum, drives the substantial streamwise acceleration within the wind farm. These findings underscore the importance of accounting for spatial variability related to terrain, even in simple landscapes, particularly during LLJ conditions. Incorporating such effects into reduced-order modeling frameworks for wind farm design and control could significantly enhance their effectiveness.

17 WIND ENERGY↗

DOE OSTI2025

Fast and Invertible Simplicial Approximation of Magnetic‐Following Interpolation for Visualizing Fusion Plasma Simulation Data

We introduce a fast and invertible approximation for fusion plasma simulation data represented as 2D planar meshes with connectivities approximating magnetic field lines along the toroidal dimension in deformed 3D toroidal spaces. Scientific variables (e.g., density and temperature) in these fusion data are interpolated following a complex magnetic-field-line-following scheme in the toroidal space represented by a cylindrical coordinate system. This deformation in the 3D space poses challenges for root-finding and interpolation. To this end, we propose a novel paradigm for visualizing and analyzing such data based on a newly developed algorithm for constructing a 3D simplicial mesh within the deformed 3D space. Our algorithm generates a tetrahedral mesh that connects the 2D meshes using tetrahedra while adhering to the constraints on node connectivities imposed by the magnetic field-line scheme. Specifically, we first divide the space into smaller partitions to reduce complexity based on the input geometries and constraints on connectivities. Then, we independently search for a feasible tetrahedralization of each partition, considering nonconvexity. We demonstrate our method with two X-Point Gyrokinetic Code (XGC) simulation datasets on the International Thermonuclear Experimental Reactor (ITER) and Wendelstein 7-X (W7-X), and use an ocean simulation dataset to substantiate broader applicability of our method. An open source implementation of our algorithm is available at https://github.com/rcrcarissa/DeformedSpaceTet.

Ren, Congrong [The Ohio State Univ., Columbus, OH ↗

DOE OSTI2021

Model-independent versus model-dependent interpretation of the SDSS-III BOSS power spectrum: Bridging the divide

The traditional clustering analyses of galaxy redshift surveys compress the clustering data into a set of late-time physical variables in a model-independent way. This approach has recently been extended by an additional shape variable encoding early-time physics information. Here we apply this new technique, ShapeFit, to SDSS-III BOSS data and show that it matches the constraining power of alternative, model-dependent approaches, which directly constrain the model’s parameters adopting a cosmological model ab initio. ShapeFit is ~30 times faster, model independent, naturally splits early- and late-time variables, and enables a better control of observational systematics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Scalability analysis of heavy-duty gas turbines using data-driven machine learning

With the increasing integration of variable renewable energy sources into power systems, the role of flexible power generation technologies like gas turbines (GT) in rapid grid balancing remains crucial. This sustained importance underscores the need for scaled and precise modeling of GT to ensure effective integration within evolving energy frameworks. While physics-driven GT models integrate thermodynamics, fluid dynamics, and combustion principles, they often rely on approximate mathematical representations to accommodate scaling that may not capture the actual complex dynamics for GTs and inertial effects associated to GTs with different ratings. In this study, a data-driven model is proposed using machine learning (ML) techniques to conduct GT scalability analysis and performance evaluation with high accuracy. The ML model, trained on data from various operating conditions and performance parameters, aims to uncover intricate relationships and patterns, resembling GT characteristics at different scales (ratings). The model is developed to capture complex system interaction and to adapt to changing operational scenarios at different capacities, providing valuable insights of power system dynamics. In this study, the real-time digital simulator platform was employed to generate training data for the ML model and assess its dynamic characteristics. The ultimate objective was to develop a detailed modeling framework based on governing equations and data-driven ML capable of predicting key performance indicators, in thermal systems such as GTs, including power output, speed, fuel consumption, and exhaust temperature under diverse operating conditions at different scales. The developed ML framework demonstrated high accuracy, with mean relative errors for GT power prediction, reference speed, exhaust temperature, and compressor pressure ratio (CPR) parameters consistently below 0.1% across typical load fluctuation scenarios. Maximum deviations were limited to approximately 0.5 K for exhaust temperature and 0.009 for CPR, underscoring the model’s ability to replicating dynamic GT behavior with high precision. The adaptability of the ML model enables its application across diverse operational conditions and its extension to other thermal systems. By leveraging advanced ML techniques, this study presents a robust and scalable modeling framework that enhances GT simulation precision, facilitating improved integration into evolving power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Machine learning for the identification of phase transitions in interacting agent-based systems: A Desai-Zwanzig example

Deriving closed-form analytical expressions for reduced-order models, and judiciously choosing the closures leading to them, has long been the strategy of choice for studying phase- and noise-induced transitions for agent-based models (ABMs). In this paper, we propose a data-driven framework that pinpoints phase transitions for an ABM—the Desai-Zwanzig model—in its mean-field limit, using a smaller number of variables than traditional closed-form models. To this end, we use the manifold learning algorithm Diffusion Maps to identify a parsimonious set of data-driven latent variables, and we show that they are in one-to-one correspondence with the expected theoretical order parameter of the ABM. We then utilize a deep learning framework to obtain a conformal reparametrization of the data-driven coordinates that facilitates, in our example, the identification of a single parameter-dependent ordinary differential equation (ODE) in these coordinates. Additionally, we identify this ODE through a residual neural network inspired by a numerical integration scheme (forward Euler). We then use the identified ODE—enabled through an odd symmetry transformation—to construct the bifurcation diagram exhibiting the phase transition.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Efficient loading of reduced data ensembles produced at ORNL SNS/HFIR neutron time-of-flight facilities

We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are required to cover a wide range of the phase space of a sample material of interest. They are stored using the standard NeXus schema on individual HDF5 files. This makes it a scalability challenge, as the number of experiments stored increases in a single ensemble file. The present work follows up on our previous efforts on data management algorithms, to address identified input output (I/O) bottlenecks in Mantid, an open-source data analysis framework used across several neutron science facilities around the world. We reuse an in-memory binary-tree metadata index that resembles data access patterns, to provide a scalable search and extraction mechanism. In addition, several memory operations are refactored and optimized for the current common use cases, ranging most frequently from 10 to 180, and up to 360 separate measurement configurations. Results from this work show consistent speed ups in wall-clock time on the Mantid LoadMD routine, ranging from 19% to 23% on average, on ORNL production computing systems. The latter depends on the complexity of the targeted instrument-specific data and the system I/O and compute variability for the shared computational resources available to users of ORNL’s Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) instruments. Nevertheless, we continue to highlight the need for more research to address reduction challenges as experimental data volumes, user time and processing costs increase.

Godoy, William↗