Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

An Anisotropic Local Method for Boundary Detection

Plan to submit this to the Journal of Statistical Analysis and Data Mining for their special issue on CoDA (Conference on Data Analysis, a meeting of analysts and scientists from the national labs)

97 MATHEMATICS AND COMPUTING↗

DataSpaces: An Interaction and Coordination Framework for Coupled Simulation Workflows

Emerging high-performance distributed computing environments are enabling new end-to-end formulations in science and engineering that involve multiple interacting processes and data-intensive application workflows. For example, current fusion simulation efforts are exploring coupled models and codes that simultaneously simulate separate application processes, such as the core and the edge turbulence, and run on different high performance computing resources. These components need to interact, at runtime, with each other and with services for data monitoring, data analysis and visualization, and data archiving. As a result, they require efficient support for dynamic and flexible couplings and interactions, which remains a challenge. This paper presents Data-Spaces, a flexible interaction and coordination substrate that addresses this challenge. DataSpaces essentially implements a semantically specialized virtual shared space abstraction that can be associatively accessed by all components and services in the application workflow. It enables live data to be extracted from running simulation components, indexes this data online, and then allows it to be monitored, queried and accessed by other components and services via the space using semantically meaningful operators. The underlying data transport is asynchronous, low-overhead and largely memory-to-memory. The design, implementation, and experimental evaluation of DataSpaces using a coupled fusion simulation workflow is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

TU-FG-201-01: 18-Month Clinical Experience of a Linac Daily Quality Assurance (QA) Solution Using Only EPID and OBI

Purpose: To describe the clinical use of a Linear Accelerator (Linac) DailyQA system with only EPID and OBI. To assess the reliability over an 18-month period and improve the robustness of this system based on QA failure analysis. Methods: A DailyQA solution utilizing an in-house designed phantom, combined EPID and OBI image acquisitions, and a web-based data analysis and reporting system was commissioned and used in our clinic to measure geometric, dosimetry and imaging components of a Varian Truebeam Linac. During an 18-month period (335 working days), the Daily QA results, including the output constancy, beam flatness and symmetry, uniformity, TPR20/10, MV and KV imaging quality, were collected and analyzed. For output constancy measurement, an independent monthly QA system with an ionization chamber (IC) and annual/incidental TG51 measurements with ADCL IC were performed and cross-compared to Daily QA system. Thorough analyses were performed on the recorded QA failures to evaluate the machine performance, optimize the data analysis algorithm, adjust the tolerance setting and improve the training procedure to prevent future failures. Results: A clinical workflow including beam delivery, data analysis, QA report generation and physics approval was established and optimized to suit daily clinical operation. The output tests over the 335 working day period cross-correlated with the monthly QA system within 1.3% and TG51 results within 1%. QA passed with one attempt on 236 days out of 335 days. Based on the QA failures analysis, the Gamma criteria is revised from (1%, 1mm) to (2%, 1mm) considering both QA accuracy and efficiency. Data analysis algorithm is improved to handle multiple entries for a repeating test. Conclusion: We described our 18-month clinical experience on a novel DailyQA system using only EPID and OBI. The long term data presented demonstrated the system is suitable and reliable for Linac daily QA.

60 APPLIED LIFE SCIENCES↗

Integrated Data Collection Analysis (IDCA) Program - Final Review September 12, 2012 at DHS

The Integrated Data Collection Analysis (IDCA) program conducted a final program review at the Department of Homeland Security on September 12, 2012. The review was focused on the results of the program over the complete performance period. A summary presentation delineating the accomplished tasks started the meeting, followed by technical presentations on various issues that arose during the performance period. The presentations were completed with a statistical evaluation of the testing results from all the participants in the IDCA Proficiency Test study. The meeting closed with a discussion of potential sources of funding for continuing work to resolve some of these technical issues. This effort, funded by the Department of Homeland Security (DHS), put the issues of safe handling of these materials in perspective with standard military explosives. The study added Small-Scale Safety and Thermal (SSST) testing results for a broad suite of different HMEs to the literature, and suggested new guidelines and methods to develop safe handling practices for HMEs. Each participating testing laboratory used identical test materials and preparation methods wherever possible. Note, however, the test procedures differ among the laboratories. The results were compared among the laboratories and then compared to historical data from various sources. The testing performers involved were Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Naval Surface Warfare Center, Indian Head Division (NSWC IHD), Sandia National Laboratories (SNL), and Air Force Research Laboratory, Tyndall AFB (AFRL/RXQL). These tests were conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to compare results when these testing variables cannot be made consistent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program — KClO 3 /Icing Sugar (-100 mesh) Mixture

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small-Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and scanning calorimetry analysis of a mixture of KClO 3 sized through a 100-mesh sieve mixed with icing sugar, also sized through a 100-mesh sieve—KClO 3 /icing sugar (-100) mixture. This material was selected because of the challenge of performing SSST testing of a mixture of two solid materials. The mixture was found to be: 1) more sensitive to impact than RDX, with sensitivity similar to PETN, 2) the same or more sensitive to friction than PETN, and 3) less sensitive to spark than RDX. The analysis showed that the mixture has thermally stability similar to RDX and is perhaps more energetic upon decomposition but variable results indicate sampling issues.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Emerging Technologies for Privacy Preservation in Energy Systems

This study explores the intersection of digitalization and privacy within the energy sector, focusing on the emerging challenges and opportunities presented by integrating Distributed Energy Resources (DERs) and advanced metering infrastructure. The need for robust digital privacy measures has become crucial as the energy industry evolves towards a more decentralized, digitalized, and decarbonized future. This study delves into four cutting-edge privacy-preserving technologies—Homomorphic Encryption (HE), Secure Multiparty Computation (SMPC), Differential Privacy (DP), and Federated Learning (FL)—each offering unique solutions to safeguard consumer data by increasing digital connectivity and data exchange. Through a detailed examination of these methods, the study explains how each technology operates, its applications within the energy sector, and the specific privacy challenges it addresses. Homomorphic Encryption allows for secure computations on encrypted data, enabling data analysis without compromising privacy. Secure Multiparty Computation enables collaborative data analysis across different entities while protecting the confidentiality of the inputs. Differential Privacy introduces randomness into the assembled data set, preventing the identification of individual records in statistical databases. Lastly, Federated Learning offers a paradigm shift in data analysis, where machine learning models are trained at the edge, minimizing the centralization of sensitive data. The research underscores the significance of implementing these privacy-enhancing technologies to comply with strict data protection regulations, foster consumer trust, and enhance the security of the energy infrastructure. By providing a comprehensive overview of these methodologies and their practical implications for the energy sector, this study aims to contribute to the ongoing discourse on digital privacy, offering insights into how the energy industry can navigate the complexities of data privacy in the digital age.

Cali, Umit↗

STM/S Grid LDOS Data and Analysis Code for Deciphering Majorana Zero Modes in Topological Superconductor

This dataset provides raw millikelvin scanning tunneling microscopy/spectroscopy (STM/S) grid spectroscopy data and Python analysis scripts supporting the manuscript “Deciphering Majorana Zero Modes in Topological Superconductor FeTe0.55Se0.45 with Machine-Learning-Assisted Spectral Deconvolution.” The dataset includes a raw grid spectroscopy file acquired on FeTe0.55Se0.45 at 40 mK under magnetic field, together with Python/Jupytext analysis scripts used for STM/S data processing, visualization, spectral deconvolution, Lorentzian peak fitting, feature extraction, machine-learning-assisted clustering, and figure generation. These files support the analysis of vortex-core local density of states and the identification of zero-bias-peak-related spectral components from complex in-gap states. The dataset is intended to provide a citable archival record of the data and analysis code associated with the published manuscript and to support transparency and reproducibility of the reported STM/S and machine-learning workflow.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

KEPLER MISSION STELLAR AND INSTRUMENT NOISE PROPERTIES REVISITED

An earlier study of the Kepler Mission noise properties on timescales of primary relevance to detection of exoplanet transits found that higher than expected noise followed, to a large extent, from the stars rather than instrument or data analysis performance. The earlier study over the first six quarters of Kepler data is extended to the full four years ultimately comprising the mission. Efforts to improve the pipeline data analysis have been successful in reducing noise levels modestly as evidenced by smaller values derived from the current data products. The new analyses of noise properties on transit timescales show significant changes in the component attributed to instrument and data analysis, with essentially no change in the inferred stellar noise. We also extend the analyses to timescales of several days, instead of several hours to better sample stellar noise that follows from magnetic activity. On the longer timescale there is a shift in stellar noise for solar-type stars to smaller values in comparison to solar values.

79 ASTRONOMY AND ASTROPHYSICS↗

Chapter 14 - Reliability of Wind Turbines

The global wind energy industry has grown at a fast pace during the past half-decade. Advancements from design and manufacturing to operation and maintenance have led to reduced capital and maintenance costs, which make wind power an indispensable source for a comprehensive solution to global electricity needs. Once wind turbines are installed, the opportunity to lower wind power costs is mainly through improved operation and maintenance practices. Modern wind turbines are equipped with tens or hundreds of measurement channels and are generating an abundance of data, with lot of efforts being put into data analysis by both the research community and the industry. One type of analysis is through the exploration of reliability engineering methods based on readily available data or maintenance records collected at typical wind power plants. If adopted and conducted appropriately, these analyses can quickly save operation and maintenance costs in a potentially impactful manner. The wind industry has adopted this discipline more broadly in recent years. This chapter discusses wind turbine reliability by highlighting the methodology of reliability engineering life data analysis. It first briefly discusses the fundamentals of wind turbine reliability and the current industry status. Then, the reliability engineering method for life analysis, including data collection, model development, and forecasting, is presented in detail and illustrated through two case studies. The chapter concludes with some remarks on potential opportunities to improve wind turbine reliability. An owner and operator's perspective is taken and mechanical components are used to exemplify the potential benefits of reliability engineering analysis to improve wind turbine reliability and availability.

database↗

Improving the Effectiveness of Context-based Prefetching with Multi-order Analysis

Data prefetching is an effective way to accelerate data access in high-end computing systems and to bridge the increasing performance gap between processor and memory. In recent years, the context-based data prefetching has received intensive attention because of its general applicability. In this study, we provide a preliminary analysis of the impact of orders on the effectiveness of the context-based prefetching. Motivated by the observations from the analytical results, we propose a new context-based prefetching method named Multi-Order Context-based (MOC) prefetching to adopt multi-order context analysis to increase the context-based prefetching effectiveness. We have carried out simulation testing with the SPEC-CPU2006 benchmarks via an enhanced CMP$im simulator. The simulation results show that the proposed MOC prefetching method outperforms the existing single-order prefetching and reduces the data-access latency effectively.

99 GENERAL AND MISCELLANEOUS↗

A Novel Approach to Detect Accelerated Aged and Surface-Mediated Degradation in Explosives by UPLC-ESI-MS.

A new approach was created for studying energetic material degradation. This approach involved detecting and tentatively identifying non-volatile chemical species by liquid chromatography-mass spectrometry (LC-MS) with multivariate statistical data analysis that form as the CL-20 energetic material thermally degraded. Multivariate data analysis showed clear separation and clustering of samples based on sample group: either pristine or aged material. Further analysis showed counter-clockwise trends in the principal components analysis (PCA), a type of multivariate data analysis, Scores plots. These trends may indicate that there was a discrete shift in the chemical markers as the went from pristine to aged material, and then again when the aged CL-20 mixed with a potentially incompatible material was thermally aged for 4, 6, or 9 months. This new approach to studying energetic material degradation should provide greater knowledge of potential degradation markers in these materials.

36 MATERIALS SCIENCE↗

Xi-cam : a versatile interface for data visualization and analysis

Xi-cam is an extensible platform for data management, analysis and visualization. Xi-cam aims to provide a flexible and extensible approach to synchrotron data treatment as a solution to rising demands for high-volume/high-throughput processing pipelines. The core of Xi-cam is an extensible plugin-based graphical user interface platform which provides users with an interactive interface to processing algorithms. Plugins are available for SAXS/WAXS/GISAXS/GIWAXS, tomography and NEXAFS data. With Xi-cam 's `advanced' mode, data processing steps are designed as a graph-based workflow, which can be executed live, locally or remotely. Remote execution utilizes high-performance computing or de-localized resources, allowing for the effective reduction of high-throughput data. Xi-cam 's plugin-based architecture targets cross-facility and cross-technique collaborative development, in support of multi-modal analysis. Xi-cam is open-source and cross-platform, and available for download on GitHub.

Pandolfi, Ronald J. (ORCID:0000000308248548)↗

Hydrogen Permeation Analysis Tool

There is a rising need for the measurement and understanding of hydrogen transport properties in materials for the energy and transportation industries. The Hydrogen Permeation Analysis Tool (HyPAT) provides a user friendly interface for batch analysis of dynamic hydrogen permeation data to calculate the transport properties permeability, solubility, and diffusivity. A built in literature database provides an easy comparison to known values. A common method for measuring these hydrogen transport properties is dynamic pressure rise permeation experiments, for example, those done in the Static Gas Absorption and Permeation (SGAP) experiment at INL. Most laboratories develop individual, in-house codes for data analysis. HyPAT provides a platform that can be adopted by other user groups for such experimental analysis and significantly reduce personnel time spent performing data analysis.

Fuerst, ThomasF↗

Informing energy consumption uncertainty: an analysis of energy data revisions

Quality energy consumption data are important for many types of analysis, and global data sets estimate trends of county level energy consumption, derived from country reported data and regional reports. We present a novel basis for informing uncertainty in energy data by quantifying the changes in reported energy consumption as countries update their previously reported data. We use 17 editions of the British Petroleum World Energy Statistics (2001-2017) to evaluate how reported energy consumption is revised over time in aggregate coal, oil, and natural gas consumption data. We find that 70% of non-zero data points are adjusted by an average of 1.3% of a country’s total fossil fuel use in the year after their first publication. Earlier data points are revised less often, but almost half of historical trends contain some revisions in later years. The size and rate of data revisions vary over countries and fuels: coal data points have larger, less frequent revisions while oil data points have smaller more frequent revisions, with natural gas in between. A K-means cluster analysis was performed to group together countries with similar revision patterns. These groups span income, economy classification, OECD membership, and regions. Standard country groupings, therefore, do not predict the extent to which a country's energy data has undergone revisions in the past.

Hoesly, Rachel M. (ORCID:0000000309652729)↗

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management platform↗

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data: Preprint

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management↗

An Application for Near Real-time Analysis of XPS Data

Real-time analysis of x-ray photoelectron spectroscopy (XPS) data has significant potential advantages to scientists and analysts in that it has the potential to qualitatively alter the way an experiment is carried forward. As an example, immediate information about the magnitude of contamination and the layering of the surface could allow the scientist to immediately ask the next level of question and quickly re-direct the next experiment or test, even before the sample has been removed from the spectrometer. In addition to changing the nature of possible experiments, the immediate automated analysis of relatively simple procedures that an operator would normally conduct manually after the data files are saved, the report generation summarizing these analyses, and saving of this report to files with the critical metadata attached, has the potential to improve the turn-around time for data analysis, increase the sophistication of data analysis reportable to the scientist and reduce the labor involved in data analysis, resulting in significant time and cost savings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Singleton Sieving: Overcoming the Memory/Speed Trade-Off in Exascale k-mer Analysis

Traditional filter data structures, such as Bloom filters, do not offer necessary features that modern high-performance data analytics applications need in order to efficiently perform complex data analysis tasks. For example, MetaHipMer, a de novo metagenome assembler, can use filters to weed out singleton k-mers and reduce memory usage by 30%-70%. However, the filter needs the ability to associate values with k-mers in order to perform the analysis in a single communication pass. Bloom filters do not support value associations and cause the application to perform an extra communication pass, thereby increasing the run time. Therefore, MetaHipMer faces a trade off between memory and speed due to the limited capabilities of traditional filters. In this paper, we overcome the memory and speed trade off in MetaHipMer by integrating a GPU-based feature-rich filter, the Two-Choice filter (TCF), in the MetaHipMer pipeline. The TCF uses key-value association to approximately store k-mers with extensions. This allows MetaHipMer to perform k-mer analysis on the GPUs in a single communication pass. Our empirical analysis shows a 50% reduction in memory usage in k-mer analysis on each node in MetaHipMer without any effect on the overall run time or assembly quality. The memory reduction in turn results in a 43% reduction in the number of nodes required to assemble datasets and enables MetaHipMer to scale to much larger datasets.

McCoy, Hunter↗