Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

The z ∼ 1.03 Merging Cluster SPT-CL J0356–5337: New Strong Lensing Analysis with HST and MUSE

We present a strong lensing analysis and reconstruct the mass distribution of SPT-CL J0356−5337, a galaxy cluster at redshift z = 1.034. Our model supersedes previous models by making use of new multiband Hubble Space Telescope data and Multi-Unit Spectroscopic Explorer (MUSE) spectroscopy. We identify two additional lensed galaxies to inform a more well-constrained model using 12 sets of multiple images in five separate lensed sources. The three previously known sources were spectroscopically confirmed by G. Mahler et al. at redshifts of z = 2.363, z = 2.364, and z = 3.048. We measured the spectroscopic redshifts of two of the newly discovered arcs using MUSE data, at z = 3.0205 and z = 5.3288. We increase the number of cluster member galaxies by a factor of 3 compared to previous work. We also report the detection of extended Lyα emission from several background galaxies. We measure the total projected mass density of the two major subcluster components, one dominated by the brightest cluster galaxy and the other by a compact group of luminous red galaxies. We find ${M}_{{\rm{B}}{\rm{C}}{\rm{G}}}(\lt 80\,\rm{kpc})=3.9{3}_{-0.14}^{+0.21}\times 1{0}^{13}$ M⊙ and ${M}_{{\rm{LRG}}}(\lt 80\,\rm{kpc})=2.9{2}_{-0.23}^{+0.16}\times 1{0}^{13}$ M⊙, yielding a mass ratio of $1.3{5}_{-0.08}^{+0.16}$ . The strong lensing constraints offer a robust estimate of the projected mass density regardless of modeling assumptions; allowing more substructure in this line of sight does not change the results or conclusions. Our results corroborate the conclusion that SPT-CL J0356−5337 is dominated by two mass components and is likely undergoing a major merger on the plane of the sky.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Architecture for Web-Based Visualization of Large-Scale Energy Domains: Preprint

With the growing penetration of inverter-based distributed energy resources and increased loads through electrification, power systems analyses are becoming more important and more complex. Moreover, these analyses increasingly involve the combination of interconnected energy domains with data that are spatially and temporally increasing in scale by orders of magnitude, surpassing the capabilities of many existing analysis and decision-support systems. We present the architectural design, development, and application of a high-resolution web-based visualization environment capable of cross-domain analysis of tens of millions of energy assets, focusing on scalability and performance. Our system supports the exploration, navigation, and analysis of large data from diverse domains such as electrical transmission and distribution systems, mobility and electric vehicle charging networks, communications networks, cyber assets, and other supporting infrastructure. We evaluate this system across multiple use cases, describing the capabilities and limitations of a web-based approach for high-resolution energy system visualizations.

grid modernization↗
DOE OSTI2021

Exploring origins for correlations between flow harmonics and transverse momentum in small collision systems

High statistics data sets from experiments at the Relativistic Heavy Ion Collider (RHIC) and the Large Hadron Collider (LHC) with small and large collision species have enabled a wealth of new flow measurements, including the event-by-event correlation between observables. One exciting such observable $ρ(v^2_n, [p_T])$ gauges the correlation between the mean transverse momentum of particles in an event and the various flow coefficients (v n ) in the same event [P. Bozek, Phys. Rev. C 93, 044908 (2016)]. Recently it has been proposed that very low multiplicity events may be sensitive to initial-state glasma correlations [G. Giacalone, B. Schenke, and C. Shen, Phys. Rev. Lett. 125, 192301 (2020)] rather than flow-related dynamics. We find utilizing the ip-jazma framework that the color domain explanation for the glasma results are incomplete. We then explore predictions from pythia8, and the version for including nuclear collisions called pythia-angantyr, which have only nonflow correlations, and from the ampt model which has both nonflow and flow-type correlations. We find that pythia-angantyr has nonflow contributions to $ρ(v^2_n, [p_T])$ in p + O, p + Pb, and O + O collisions that are positive at low multiplicity and comparable to the glasma correlations. It is striking that in pythia8 in p + p collisions there is actually a sign change from positive to negative $ρ(v^2_n, [p_T])$ as a function of multiplicity. The ampt results match the experimental data general trends in Pb+Pb collisions at the LHC, except at low multiplicity where ampt has the opposite sign. In p + Pb collisions, ampt has the opposite sign from experimental data and we explore this within the context of parton geometry. Predictions for p + O, O + O, and Xe + Xe are also presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Methodological challenges and new perspectives of shifting vegetation phenology in eddy covariance data

While numerous studies report shifts in vegetation phenology, in this regard eddy covariance (EC) data, despite its continuous high-frequency observations, still requires further exploration. Furthermore, there is no general consensus on optimal methodologies for data smoothing and extracting phenological transition dates (PTDs). Here, we revisit existing methodologies and present new prospects to investigate phenological changes in gross primary productivity (GPP) from EC measurements. First, we present a smoothing technique of GPP time series through the derivative of its smoothed annual cumulative sum. Second, we calculate PTDs and their trends from a commonly used threshold method that identifies days with a fixed percentage of the annual maximum GPP. A systematic analysis is performed for various thresholds ranging from 0.1 to 0.7. Lastly, we examine the relation of PTDs trends to trends in GPP across the years on a weekly basis. Results from 47 EC sites with long time series (> 10 years) show that advancing trends in start of season (SOS) are strongest at lower thresholds but for the end of season (EOS) at higher thresholds. Moreover, the trends are variable at different thresholds for individual vegetation types and individual sites, outlining reasonable concerns on using a single threshold value. Relationship of trends in PTDs and weekly GPP reveal association of advanced SOS and delayed EOS to increase in immediate primary productivity, but not to the trends in overall seasonal productivity. Drawing on these analyses, we emphasise on abstaining from subjective choices and investigating relationship of PTDs trend to finer temporal trends of GPP. Our study examines existing methodological challenges and presents approaches that optimize the use of EC data in identifying vegetation phenological changes and their relation to carbon uptake.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Vehicle Powertrain Simulation Accuracy for Various Drive Cycle Frequencies and Upsampling Techniques

As connected and automated vehicle technologies emerge and proliferate, lower frequency vehicle trajectory data is becoming more widely available. In some cases, entire fleets are streaming position, speed, and telemetry at sample rates of less than 10 seconds. This presents opportunities to apply powertrain simulators such as the National Renewable Energy Laboratory's Future Automotive Systems Technology Simulator to model how advanced powertrain technologies would perform in the real world. However, connected vehicle data tends to be available at lower temporal frequencies than the 1-10 Hz trajectories that have typically been used for powertrain simulation. Higher frequency data, typically used for simulation, is costly to collect and store and therefore is often limited in density and geography. This paper explores the suitability of lower frequency, high availability, connected vehicle data for detailed powertrain simulation. A large data set of 1 Hz trajectories is used to quantify the accuracy loss when simulating energy consumption for conventional, hybrid, and battery electric powertrains using less than 1 Hz data. Techniques to upsample lower frequency drive cycle data in order to increase accuracy are also explored. Median energy consumption errors when simulating energy consumption for a 1/10 Hz trajectory are found to be 3-6% when compared to 1 Hz trajectories. Applying upsampling and interpolation techniques are shown to reduce the simulation errors by roughly 50%. The findings in this work can guide connected vehicle data collection specifications and processing techniques applied when using collected data for powertrain simulation.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

BrickQA: Bridging the Semantic Gap in Building Operations with Dynamic Graph Exploration

While standardized ontologies like the Brick schema address data heterogeneity in Building Automation Systems (BAS), accessing this semantic data remains a challenge as domain experts often lack the expertise to formulate complex SPARQL queries. To bridge this gap, we present BrickQA, a Large Language Model (LLM)-based framework that translates natural language into executable SPARQL queries through structured query decomposition, dynamic schema exploration, and inline validation. BrickQA utilizes an iterative reasoning agent to actively navigate graph topology through dynamic exploration actions without requiring exhaustive context injection or model fine-tuning. This approach effectively mitigates hallucinations, particularly in large-scale building knowledge graphs. Empirical evaluation on BuildingQA, a standardized benchmark, demonstrates that BrickQA significantly outperforms ReAct baselines, delivering a 0.291–0.355 absolute F1 improvement while achieving 3 × –12.7 × higher token cost-efficiency. Beyond these metrics, the framework maintains structural fidelity across heterogeneous buildings and remains resilient to ambiguous queries without requiring site-specific fine-tuning. Furthermore, a case study on operational analytics validates the framework’s capability to handle temporal and aggregation constraints, effectively transforming abstract semantic models into actionable facility management insights.1

Ko, Yun-Dam↗
DOE OSTI2021

Exploring Social Dynamics of Hard-Disk Drives Circularity with an Agent-Based Approach: Preprint

By 2025, it is estimated that installed data storage in the US will be 2.2 Zettabytes, generating about 50 million units of end-of-life hard-disk drives (HDDs) per year. The circular economy tackles waste issues by maximizing value retention in the economy, for instance, through reuse and recycling. However, the reuse of hard disk drives is hindered by the lack of trust organizations have toward other means of data removal than physically destroying HDDs. Here, an agent-based approach explores how organizations’ decisions to adopt other data removal means affect HDDs circularity. The model applies the theory of planned behaviour to model the decisions of HDDs end-users. Results demonstrate that the attitude (which is affected by trust) of end-users toward data-wiping technologies acts as a barrier to reuse. Moreover, social pressure can play a significant role as organizations that adopt CE behaviours can set an example for others.

28 EE - Advanced Manufacturing Office (EE-5A)↗
DOE OSTI2020

Multi-Channel Entity Alignment via Name Uniqueness Estimation

When searching for adversarial activity within multiple networks, one of the greatest challenges is how to accurately align entities across different channels of information. This task becomes increasingly difficult when minimal additional information is known about each individual besides a name. Within this study, we analyze name rarity and how it can be used to align people on three distinct data channels: Venmo financial transactions, Reddit online discussions, and a bibliographic data source of academic writings. We explore how the uniqueness of a name can be used to decide if a person is likely the same as another across networks, in the absence of any additional ground truth. While 100 percent confidence cannot be gained, we can use this information to clarify when a possible alignment is more or less likely to be the same individual, increasing our confidence of accurately detecting adversarial behavioral patterns. From the data collected, we found that 0.1% of people had the same name across data sets, and 22.5% of those names are considered rare by our threshold. In our study, we also examine the accuracy of our method and show how real names can be extracted from account usernames, and compared in a similar manner.

Orren, Miquette J.↗
DOE OSTI2020

On Transfer Learning Of Neural Networks Using Bi-Fidelity Data For Uncertainty Propagation

Due to their high degree of expressiveness, neural networks have recently been used as surrogate models for mapping inputs of an engineering system to outputs of interest. Once trained, neural networks are computationally inexpensive to evaluate and remove the need for repeated evaluations of computationally expensive models in uncertainty quantification applications. However, given the highly parameterized construction of neural networks, especially deep neural networks, accurate training often requires large amounts of simulation data that may not be available in the case of computationally expensive systems. In this paper, to alleviate this issue for uncertainty propagation, we explore the application of transfer learning techniques using training data generated from both high- and low-fidelity models. We explore two strategies for coupling these two datasets during the training procedure, namely, the standard transfer learning and the bi-fidelity-weighted learning. In the former approach, a neural network model mapping the inputs to the outputs of interest is trained based on the low-fidelity data. The high-fidelity data are then used to adapt the parameters of the upper layer(s) of the low-fidelity network, or train a simpler neural network to map the output of the low-fidelity network to that of the high-fidelity model. In the latter approach, the entire low-fidelity network parameters are updated using data generated via a Gaussian process model trained with a small high-fidelity dataset. The parameter updates are performed via a variant of stochastic gradient descent with learning rates given by the Gaussian process model. Using three numerical examples, we illustrate the utility of these bi-fidelity transfer learning methods where we focus on accuracy improvement achieved by transfer learning over standard training approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Geothermal Play Fairway Analysis Best Practices

Play fairway analysis (PFA) is a methodology that can improve success rates for geothermal exploration drilling, thus reducing the costs of geothermal projects while facilitating development in new areas. It was originally developed for the oil and gas industry, but has been adapted for discovering geothermal resources over the last decade. The geothermal PFA methodology involves systematically screening a set geographic area for promising qualities typically related to the presence of heat, permeability, and fluid. Successful application of PFA can identify hidden hydrothermal systems. From 2014 to 2021 the U.S. Department of Energy (DOE) Geothermal Technologies Office (GTO) supported the development of PFA for geothermal resources through awards to 11 research teams across the country. The goal of these projects was to advance and adapt PFA for geothermal exploration to produce regional-scale maps that reduce exploration uncertainty. This report is an outcome of the NREL-led PFA Retrospective project, which compiled, synthesized, analyzed the results of GTO's geothermal PFA program. Ultimately, we find that these projects greatly advanced approaches to geothermal exploration and resulted in extensive new data and new discoveries of unrecognized geothermal systems. We used the results to distill best practices in this report and to provide guidance for future applications of geothermal PFA.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

On single-crystal total scattering data reduction and correction protocols for analysis in direct space

Data reduction and correction steps and processed data reproducibility in the emerging single-crystal total-scattering-based technique of three-dimensional differential atomic pair distribution function (3D-ΔPDF) analysis are explored. All steps from sample measurement to data processing are outlined using a crystal of CuIr 2 S 4 as an example, studied in a setup equipped with a high-energy X-ray beam and a flat-panel area detector. Computational overhead as pertains to data sampling and the associated data-processing steps is also discussed. Various aspects of the final 3D-ΔPDF reproducibility are explicitly tested by varying the data-processing order and included steps, and by carrying out a crystal-to-crystal data comparison. Situations in which the 3D-ΔPDF is robust are identified, and caution against a few particular cases which can lead to inconsistent 3D-ΔPDFs is noted. Although not all the approaches applied herein will be valid across all systems, and a more in-depth analysis of some of the effects of the data-processing steps may still needed, the methods collected herein represent the start of a more systematic discussion about data processing and corrections in this field.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Modular Autonomous Experimentation for Biological Applications (Full Report)

The Modular Autonomous Research System (MARS) was developed to address the pressing need for faster, more reliable, and more adaptable scientific discovery. Traditional experimentation is limited by manual labor, long cycle times, and fragmented data streams, which constrain the ability to explore complex chemical and materials design spaces. To overcome these limitations, we created an integrated, modular platform that combines laboratory robotics, diverse measurement instruments, and a central data infrastructure with artificial intelligence–driven decision-making. The system links liquid handling robots, robotic arms, and optical plate readers into a closed loop where experiments are executed automatically, data is analyzed in real time, and subsequent experimental conditions are adaptively chosen to maximize information gain. Over the course of the project, MARS was validated on two primary test cases—spectroscopic metal–ligand binding assays and peptide-directed mineralization—which highlighted the system’s ability to handle uncertainty and variability in experimental measurements. To further demonstrate modularity and extensibility, we also established additional testbeds in electrochemistry for catalyst discovery and electrolyte formulation for advanced batteries. The results show that MARS can reliably conduct autonomous campaigns with minimal human intervention, adapt to distinct scientific domains, and provide a scalable model for future self-driving laboratories. This work establishes new capabilities for modular, uncertainty-aware automation and directly supports the need for advanced, data-driven research platforms capable of accelerating discovery across a wide range of scientific and national security missions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Scaling carbon fluxes from eddy covariance sites to globe: synthesis and evaluation of the FLUXCOM approach

FLUXNET comprises globally distributed eddy-covariance-based estimates of carbon fluxes between the biosphere and the atmosphere. Since eddy covariance flux towers have a relatively small footprint and are distributed unevenly across the world, upscaling the observations is necessary to obtain global-scale estimates of biosphere–atmosphere exchange. Based on cross-consistency checks with atmospheric inversions, sun-induced fluorescence (SIF) and dynamic global vegetation models (DGVMs), here we provide a systematic assessment of the latest upscaling efforts for gross primary production (GPP) and net ecosystem exchange (NEE) of the FLUXCOM initiative, where different machine learning methods, forcing data sets and sets of predictor variables were employed. Spatial patterns of mean GPP are consistent across FLUXCOM and DGVM ensembles (R 2 >0.94 at 1° spatial resolution) while the majority of DGVMs show, for 70 % of the land surface, values outside the FLUXCOM range. Global mean GPP magnitudes for 2008–2010 from FLUXCOM members vary within 106 and 130 PgC yr -1 with the largest uncertainty in the tropics. Seasonal variations in independent SIF estimates agree better with FLUXCOM GPP (mean global pixel-wise R 2 ~0.75) than with GPP from DGVMs (mean global pixel-wise R 2 ~0.6). Seasonal variations in FLUXCOM NEE show good consistency with atmospheric inversion-based net land carbon fluxes, particularly for temperate and boreal regions (R 2 >0.92). Interannual variability of global NEE in FLUXCOM is underestimated compared to inversions and DGVMs. The FLUXCOM version which also uses meteorological inputs shows a strong co-variation in interannual patterns with inversions (R 2 =0.87 for 2001–2010). Mean regional NEE from FLUXCOM shows larger uptake than inversion and DGVM-based estimates, particularly in the tropics with discrepancies of up to several hundred grammes of carbon per square metre per year. These discrepancies can only partly be reconciled by carbon loss pathways that are implicit in inversions but not captured by the flux tower measurements such as carbon emissions from fires and water bodies. We hypothesize that a combination of systematic biases in the underlying eddy covariance data, in particular in tall tropical forests, and a lack of site history effects on NEE in FLUXCOM are likely responsible for the too strong tropical carbon sink estimated by FLUXCOM. Furthermore, as FLUXCOM does not account for CO 2 fertilization effects, carbon flux trends are not realistic. Overall, current FLUXCOM estimates of mean annual and seasonal cycles of GPP as well as seasonal NEE variations provide useful constraints of global carbon cycling, while interannual variability patterns from FLUXCOM are valuable but require cautious interpretation. Exploring the diversity of Earth observation data and of machine learning concepts along with improved quality and quantity of flux tower measurements will facilitate further improvements of the FLUXCOM approach overall.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Foam Fracturing Fluid Half-life Experimental Data

Foam thermal stability was studies at Temple University in collaboration with Oak Ridge National Lab (ORNL). The goal of this project is to explore thermally stable foams as hydrofracking fluid media for potential applications in enhanced geothermal system (EGS). Data generated from this project will allow researchers to explore foam as potential fracturing fluid. More than 800 data points on the half-life of foams are recorded in Excel files in the included archive resource (Half-life of Foams with Different Surfactants and Stabilizing Agents). The Excel file within each surfactant folder contains half-life data of the respective surfactant with different stabilizing agents, pressure, and temperature. The respective folders also contains Word files describing the details of the data included in the respective Excel sheet.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

rmap: An R package to plot and compare tabular data on customizable maps across scenarios and time

`rmap` is an R package that allows users to easily plot tabular data (CSV or R data frames) on maps without any Geographic Information Systems (GIS) knowledge. Maps produced by `rmap` are `ggplot` objects and thus capitalize on the flexibility and advancements of the `ggplot2` package and all elements of each map are thus fully customizable. Additionally `rmap` automatically detects and produces comparison maps if the data has multiple scenarios or time periods as well as animations for time series data. Advanced users can load their own shapefiles if desired. `rmap` comes with a range of pre-built color palettes but users can also provide any `R` color palette or create their own as needed. Four different legend types are available to highlight different kinds of data distributions. The input spatial data can be both gridded or polygon data. `rmap` is desgined in particular for comparing spatial data across scenarios and time periods and comes preloaded with standard country, state, and basin maps as well as custom maps compatible with the Global Change Analysis Model (GCAM) spatial boundaries. `rmap` has a growing number of users and its products have been used in multiple multisector dynamics publications as well as a required dependency in other R packages such as `rfasst` and `metis`. `rmap's` automatic processing of tabular data using pre-built map selection, difference map calculations, faceting, and animations offers unique functionality which makes it a powerful and yet simple tool for users looking to explore multi-sector, multi-scenario data across space and time.

58 GEOSCIENCES↗
DOE OSTI2021

Data Science Techniques, Assumptions, and Challenges in Alloy Clustering and Property Prediction

Data analytics methods have been increasingly applied to understanding materials chemistry, processing due to the manufacturing approach, and uni-axial and cyclic property relationships in the highly complex space of alloy design. There are several benefits to applying data analytics to this space, including the ability to manage non-linearities in the responses of the alloy attributes and the resulting mechanical properties. However, key difficulties in applying and understanding the results of data analytics include the often lack of reported assumptions and data processing steps necessary to improve interpretation and reproducibility in derived results. In this work, the methods used to generate clustering and correlation analyses for experimental 9% Cr ferritic-martensitic steel data were investigated and the resulting implications for mechanical property predictions were assessed. This work uses principal component analysis, partitioning around medoids, t-SNE, and k-means clustering to investigate trends in composition, processing and microstructure information with creep and tensile properties, building on work done previously using a smaller version of the same dataset. The initial assumptions, preprocessing steps and methods are investigated and outlined in order to depict the fine level of detail required to convey the steps taken to process data and produce analytical results. Here, the variations in the resulting analyses are explored due to the influence of new and more varied data.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Boosting RDataFrame performance with transparent bulk event processing

RDataFrame is ROOT’s high-level interface for Python and C++ data analysis. Since it first became available, RDataFrame adoption has grown steadily and it is now poised to be a major component of analysis software pipelines for LHC Run 3 and beyond. Thanks to its design inspired by declarative programming principles, RDataFrame enables the development of highperformance, highly parallel analyses without requiring expert knowledge of multi-threading and I/O: user logic is expressed in terms of self-contained, small computation kernels tied together by a high-level API. This design completely decouples analysis logic from its actual execution, and opens several interesting avenues for workflow optimization. In particular, in this work we explore the benefits of moving internal data processing from an event-by-event to a bulkby-bulk loop. This refactoring dramatically reduces the framework’s runtime overheads; in collaboration with the I/O layer it improves data access patterns; it exposes information that optimizing compilers might use to auto-vectorize the invocation of user-defined computations; finally, while existing user-facing interfaces remain unaffected, it becomes possible to additionally offer interfaces that explicitly expose bulks of events, useful e.g. for the injection of GPU kernels into the analysis workflow. In order to inform similar future R&D, design challenges will be presented, as well as an investigation of the relevant timememory trade-off backed by novel performance benchmarks.

Guiraud, Enrico↗
DOE OSTI2021

Low-rank Tensor Completion for PMU Data Recovery

This paper proposes a tensor completion method for the recovery of missing phasor measurement unit (PMU) measurements. Tensor completion as the general case of matrix completion has attracted increasing attention in recent years. The imputation accuracy for the existing matrix completion methods may be significantly reduced when there are consecutive data losses across multiple data channels. To tackle this issue, we explore the multi-way characteristics of PMU measurements by using a tensor model. We leverage the low-rank property of the PMU measurements and formulate the missing PMU data recovery problem as a low-rank tensor completion problem. An efficient algorithm based on alternating direction method of multipliers (ADMM) is developed to solve the tensor completion problem. The experiments using the real PMU dataset show that the proposed method exhibits better imputation accuracy compared with the conventional data recovery methods.

Ghasemkhani, Amir↗