Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Towards Redefining the Reproducibility in Quantum Computing: A Data Analysis Approach on NISQ Devices

Although the building of quantum computers has kept making rapid progress in recent years, noise is still the main challenge for any application to leverage the power of quantum computing. Existing works addressing noise in quantum devices proposed noise reduction when deploying a quantum algorithm to a specified quantum computer. The reproducibility issue of quantum algorithms has been raised since the noise levels vary on different quantum computers. Importantly, existing works largely ignore the fact that the noise of quantum devices varies as time goes by. Therefore, reproducing the results on the same hardware will even become a problem. We analyze the reproducibility of quantum machine learning (QML) algorithms based on daily model training and execution data collection. Our analysis shows a correlation between our QML models’ test accuracy and quantum computer hardware’s calibration features. We also demonstrate that noisy simulators for quantum computers are not a reliable tool for quantum machine learning applications.

Senapati, Priyabrata↗
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2021

Integrated, Interoperable Software Environment for Fusion Simulation and Data Analysis Tools SBIR Phase II

This SBIR effort was focused on developing a production ready system to address the integration and interoperability challenges with analysis and visualization in fusion simulations. Our overarching technical objective was to minimize the code development simulation scientists incur when coupling their simulation codes with different analysis frameworks. To this end, we developed an open-source software library to make data exchange between application easier and a Web application to manage and display analysis extracts from simulations. We have also augmented existing libraries funded by DOE such as ADIOS and VTK-m. When used together, these make it significantly easier to integrate simulation and analysis capability. We demonstrated the flexibility of our approach using two common simulation codes in the fusion community, XGC1 and GTC.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Using real-time data analysis to conduct next-generation synchrotron fatigue studies

Next-generation experimental techniques, like high energy X-ray diffraction microscopy (HEDM), usher in new opportunities to collect the grain-scale data necessary for understanding the evolving processes that drive fatigue failure. In this study, we present a framework for monitoring the evolution of a deforming polycrystal, in real-time, by applying principal component analysis (PCA) to raw X-ray diffraction image data. We applied this framework to inform in-situ HEDM measurements of a cyclically loaded Inconel-718 superalloy. Further, we discovered correlations between PCA of the diffraction data and the physical processes in the polycrystal. Lastly, we discuss extending this framework in future HEDM fatigue studies.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Data Analysis of Energy Code Compliance in Commercial Buildings

What percent of newly constructed commercial buildings comply with the energy code? How much energy and cost could be saved if the compliance increased? Which code requirements have both low compliance rates and high savings potential? These are the questions U.S. Department of Energy (DOE) is trying to answer through its Commercial Energy Code Field Study. Previous commercial studies have been very limited and did not result in a widely accepted and tested methodology. DOE’s goal is to create a standardized methodology that can produce actionable results at a reasonable study cost, that can be used by state and local governments and utilities and provides valuable information to policy makers. The field study team implemented the pilot methodology, compiling a data set of 230 office and retail buildings in two climate zones. The approach is based on identifying lost savings on a total energy cost basis rather than simply counting the quantity of measures that do not meet code. This report is focused on the analysis of the collected data. The primary goal was to analyze the data collected during the field study and determine the actual energy cost impact of each measure in a non-compliance situation. The energy impact results allowed for ranking the measures to identify which have the highest potential for lost savings. These results combined with the time required to verify each measure will allow future compliance verification to focus on measures that had a large impact on energy use over the life of the building and those that have the greatest savings recovery potential per verification hour.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Data Analysis of Energy Code Compliance in Commercial Buildings (Rev. 1)

What percent of newly constructed commercial buildings comply with the energy code? How much energy and cost could be saved if the compliance increased? Which code requirements have both low compliance rates and high savings potential? These are the questions U.S. Department of Energy (DOE) is trying to answer through its Commercial Energy Code Field Study. Previous commercial studies have been very limited and did not result in a widely accepted and tested methodology. DOE’s goal is to create a standardized methodology that can produce actionable results at a reasonable study cost, that can be used by state and local governments and utilities and provides valuable information to policy makers. The field study team implemented the pilot methodology, compiling a data set of 230 office and retail buildings in two climate zones. The approach is based on identifying lost savings on a total energy cost basis rather than simply counting the quantity of measures that do not meet code. This report is focused on the analysis of the collected data. The primary goal was to analyze the data collected during the field study and determine the actual energy cost impact of each measure in a non-compliance situation. The energy impact results allowed for ranking the measures to identify which have the highest potential for lost savings. These results combined with the time required to verify each measure will allow future compliance verification to focus on measures that had a large impact on energy use over the life of the building and those that have the greatest savings recovery potential per verification hour.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Hanford Site Composite Analysis Data Package: Exposure Scenarios and Radionuclide Specific Dose Conversion Factors.

This data package summarizes the exposure assumptions, equations, and methods used to calculate radionuclide-specific unit dose factors and the radiological doses for both groundwater and atmospheric pathways as a part of the revised Hanford Site Composite Analysis. An All-Pathways Representative Person exposure scenario is considered to evaluate exposure via both groundwater and atmospheric transport pathways. The radiological dose assessments for both groundwater and atmospheric pathways are included in the performance assessments for various Waste Management Areas at the Hanford Site. This data package calculates exposure route-specific and total unit dose factors for composite-analysis-specific radionuclides of concern based on the exposure assumptions used in the composite analysis and performance assessments. This data package presents the results and comparison of the radionuclide-specific unit dose factors based on the exposure assumptions used in the revised composite analysis and various performance assessments.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2024

Results from a multi-laboratory ocean metaproteomic intercomparison: effects of LC-MS acquisition and data analysis procedures

Metaproteomics is an increasingly popular methodology that provides information regarding the metabolic functions of specific microbial taxa and has potential for contributing to ocean ecology and biogeochemical studies. A blinded multi-laboratory intercomparison was conducted to assess comparability and reproducibility of taxonomic and functional results and their sensitivity to methodological variables. Euphotic zone samples from the Bermuda Atlantic Time-series Study (BATS) in the North Atlantic Ocean collected by in situ pumps and the autonomous underwater vehicle (AUV) Clio were distributed with a paired metagenome, and one-dimensional (1D) liquid chromatographic data-dependent acquisition mass spectrometry analysis was stipulated. Analysis of mass spectra from seven laboratories through a common bioinformatic pipeline identified a shared set of 1056 proteins from 1395 shared peptide constituents. Quantitative analyses showed good reproducibility: pairwise regressions of spectral counts between laboratories yielded R 2 values averaged 0.62±0.11, and a Sørensen similarity analysis of the top 1000 proteins revealed 70 %–80 % similarity between laboratory groups. Taxonomic and functional assignments showed good coherence between technical replicates and different laboratories. A bioinformatic intercomparison study, involving 10 laboratories using eight software packages, successfully identified thousands of peptides within the complex metaproteomic datasets, demonstrating the utility of these software tools for ocean metaproteomic research. Lessons learned and potential improvements in methods were described. Future efforts could examine reproducibility in deeper metaproteomes, examine accuracy in targeted absolute quantitation analyses, and develop standards for data output formats to improve data interoperability. Together, these results demonstrate the reproducibility of metaproteomic analyses and their suitability for microbial oceanography research, including integration into global-scale ocean surveys and ocean biogeochemical models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

AXEAP : a software package for X-ray emission data analysis using unsupervised machine learning

The Argonne X-ray Emission Analysis Package ( AXEAP ) has been developed to calibrate and process X-ray emission spectroscopy (XES) data collected with a two-dimensional (2D) position-sensitive detector. AXEAP is designed to convert a 2D XES image into an XES spectrum in real time using both calculations and unsupervised machine learning. AXEAP is capable of making this transformation at a rate similar to data collection, allowing real-time comparisons during data collection, reducing the amount of data stored from gigabyte-sized image files to kilobyte-sized text files. With a user-friendly interface, AXEAP includes data processing for non-resonant and resonant XES images from multiple edges and elements. AXEAP is written in MATLAB and can run on common operating systems, including Linux, Windows, and MacOS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Field Data Analysis and Modeling of Drillstring Vibrations to Identify Inefficiency in Deep Geothermal Drilling

One challenge that hinders efficient drilling and causes downhole tool failures is severe drillstring vibrations. The objective of this paper is to identify the root cause of drillstring vibrations in deep geothermal wells and investigate their effect on drilling performance using data analytics and vibration modeling. A near-bit sub was utilized to collect vibration data, where the burst data was used to obtain the drillstring torsional natural frequency. The data showed that the highest lateral acceleration and stick-slip severities (SSS) occur at the higher mechanical specific energy (MSE) range, while the low vibration levels were encountered in the optimum range of the MSE curve. The elevated SSS levels consistently occur at the low to mid-range of applied RPM and the highest sonic velocity. Additionally, the lateral acceleration levels are higher at the low to mid-range of the applied RPM. The effect of drillstring vibration on drilling performance was recognized by the presented MSE analysis.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗
DOE OSTI2020

Hanford Site Composite Analysis Data Package: Exposure Scenarios and Radionuclide Specific Dose Conversion Factors

This data package summarizes the exposure assumptions, equations, and methods used to calculate radionuclide-specific unit dose factors and the radiological doses for both groundwater and atmospheric pathways as a part of the updated Hanford Site Composite Analysis (CA). An All Pathways Representative Person exposure scenario is considered to evaluate exposure via both groundwater and atmospheric transport pathways. The radiological dose assessments for both groundwater and atmospheric pathways are included in the performance assessments (PAs) for various Waste Management Areas at the Hanford Site. This data package calculates exposure route-specific and total unit dose factors for CA-specific radionuclides of concern based on the exposure assumptions used in the CA and PAs. This data package also presents the results and comparison of the radionuclide-specific unit dose factors based on the exposure assumptions used in the revised Hanford Site Composite Analysis and Hanford Site performance assessments for low-level waste disposal facilities.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis to Support Risk Model Parameter Estimations

This set of slides has been prepared for a talk at the INL AI/ML Symposium held on September 8, 2022. Presentation outline: Background - Nuclear power plant operating experience data sources • Research focus and motivation - Analyzing free-text operating experience data: present and future • Research method - Input - Methodological steps - Output • Conclusions and next steps

99 GENERAL AND MISCELLANEOUS↗