Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Analysis of the KROTOS KFC test by coupling X-Ray image analysis and MC3D calculations

During a hypothetical severe accident sequence in a Pressurized Water Reactor (PWR), the hot molten materials (corium) issuing from the degraded reactor core may generate a steam explosion if they come in contact with water and may damage the structures and threaten the reactor integrity. The SERENA program is an international OECD project that aims at helping the understanding of this phenomenon also called Fuel Coolant Interaction (FCI) by providing data. CEA takes part in this program by performing tests in its KROTOS facility where steam explosions using prototypic corium can be triggered. Data about the different phases in the premixing are extracted from the KROTOS X-Ray radioscopy images by using KIWI software (KROTOS Image analysis of Water-corium Interaction) currently developed by CEA. The MC3D code, developed by IRSN, is a thermal-hydraulic multiphase code mainly dedicated to FCI studies. It is composed of two applications: premixing and explosion. An overall FCI calculation with MC3D requires a premixing calculation followed by an explosion calculation. The present paper proposes an alternative approach in which all the features of the premixing are extracted from the X-Ray pictures using the KIWI software and transferred to an MC3D dataset for a direct simulation of the explosion. The main hypothesis are discussed as well as the first explosion results obtained with MC3D for the KROTOS KFC test. These results are rather encouraging and are analyzed on the basis of comparisons with the experimental data. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A framework for graph-based synthesis, analysis, and visualization of HPC cluster job data.

The monitoring and system analysis of high performance computing (HPC) clusters is of increasing importance to the HPC community. Analysis of HPC job data can be used to characterize system usage and diagnose and examine failure modes and their effects. This analysis is not straightforward, however, due to the complex relationships that exist between jobs. These relationships are based on a number of factors, including shared compute nodes between jobs, proximity of jobs in time, etc. Graph-based techniques represent an approach that is particularly well suited to this problem, and provide an effective technique for discovering important relationships in job queuing and execution data. The efficacy of these techniques is rooted in the use of a semantic graph as a knowledge representation tool. In a semantic graph job data, represented in a combination of numerical and textual forms, can be flexibly processed into edges, with corresponding weights, expressing relationships between jobs, nodes, users, and other relevant entities. This graph-based representation permits formal manipulation by a number of analysis algorithms. This report presents a methodology and software implementation that leverages semantic graph-based techniques for the system-level monitoring and analysis of HPC clusters based on job queuing and execution data. Ontology development and graph synthesis is discussed with respect to the domain of HPC job data. The framework developed automates the synthesis of graphs from a database of job information. It also provides a front end, enabling visualization of the synthesized graphs. Additionally, an analysis engine is incorporated that provides performance analysis, graph-based clustering, and failure prediction capabilities for HPC systems.

97 MATHEMATICS AND COMPUTING↗

Use of Machine Learning on PMU Data for Transmission System Fault Analysis

Synchrophasor technology has been used for monitoring, control, and protection of bulk power system for over 10 years. Deployment of phasor measurement units (PMUs) in the USA power system has surpassed 3000 units installed in the transmission substations as stand-alone intelligent electronic devices (IEDs) or as a software add-on to other devices such as digital protective relays (DPRs) or digital fault recorders (DFRs). By now, thousands of terabytes of PMU data may have been captured and stored by various transmission system operators (TSOs) and independent system operators (ISOs). This creates an opportunity to deploy advanced machine learning (ML) techniques to detect and classify faults recorded by PMUs automatically to be used by the system operators for rapid, critical decision-making when manual analysis of the past or unfolding events is not feasible. In this paper we offer a brief background on how the automated fault analysis may be done using DPR and/or DFR data, and compare some of the legacy approaches to the new ML approaches in the context of the system-wide PMU recordings. We then offer insights from developing practical ML solutions that have been applied on field recordings captured by close to 450 PMUs from all three US interconnections (Western, Eastern and ERCOT) over two years (2016-2017). We identify and illustrate ML challenges we addressed: inaccurate data, data with scarce and temporally imprecise fault labels, data recorded by PMUs sparsely located at substations resulting in the fault records taken afar from the ends of the faulted lines, data containing only positive sequence values, and data taken at different voltage levels. We then illustrate the ML model results for fault analysis under different application scenarios. The novelty of this study is not only in the design, implementation, and performance analysis of the ML algorithms, but also in the use of advanced fault modelling and simulation approaches to improve the training results when developing supervised ML models for fault detection and classification. Extensive simulations of faults were conducted on a 14-bus power system to create a training dataset with over 1400 accurately labelled faults. This dataset was applied to enhance the accuracy of fault detection and classification of machine learning-based models trained with small number of labelled faults in large datasets recorded in the grid interconnections ranging from 5,000 to 70,000 buses.

Synchrophasors, Machine Learning, Fault Analysis, ↗

Model of gamma sky for the Fermi Gamma-ray Space Telescope (FGST)

A number of important parameters of cosmic-ray distribution, propagation, and interaction in the Milky Way can be predicted through the comparison of measured cosmic-ray and gamma-ray spectra to the spectra of simulated Galaxies. These predictions are made by altering the physical parameters governing Galaxy simulations until a best-fit set of parameters is found. Since the accuracy of this method is limited by the quality of available data, the exceptional precision of recent FGST gamma-ray measurements makes unprecedented galactic model refinement possible. Consequently, this data was used as a benchmark in optimizing galactic models derived by GALPROP. An in-depth investigation was performed on a wide range of galactic models, and improvement or degeneration in each was gauged through specialized analysis using novel GaDGET software. By analyzing individual galactic parameters and their effects on observed spectra, a new optimized set of parameters was found that better fits the Fermi data than previous GALPROP models. This result is especially important in refining previous estimates of galactic parameters that cannot be measured directly. It also provides an important check on known galactic parameters and enhances GALPROPs value as a high-level modeling tool.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Final Technical Report for "Collaborative Research: Regional climate-change projections through next-generation empirical and dynamical models"

This project was a continuation of previous work under DOE CCPP funding in which we developed a twin approach of non-homogeneous hidden Markov models (NHMMs) and coupled ocean-atmosphere (O-A) intermediate-complexity models (ICMs) to identify the potentially predictable modes of climate variability, and to investigate their impacts on the regional-scale. We have developed a family of latent-variable NHMMs to simulate historical records of daily rainfall, and used them to downscale seasonal predictions. We have also developed empirical mode reduction (EMR) models for gaining insight into the underlying dynamics in observational data and general circulation model (GCM) simulations. Using coupled O-A ICMs, we have identified a new mechanism of interdecadal climate variability, involving the midlatitude oceans mesoscale eddy field and nonlinear, persistent atmospheric response to the oceanic anomalies. A related decadal mode is also identified, associated with the oceans thermohaline circulation. The goal of the continuation was to build on these ICM results and NHMM/EMR model developments and software to strengthen two key pillars of support for the development and application of climate models for climate change projections on time scales of decades to centuries, namely: (a) dynamical and theoretical understanding of decadal-to-interdecadal oscillations and their predictability; and (b) an interface from climate models to applications, in order to inform societal adaptation strategies to climate change at the regional scale, including model calibration, correction, downscaling and, most importantly, assessment and interpretation of spread and uncertainties in multi-model ensembles. Our main results from the grant consist of extensive further development of the hidden Markov models for rainfall simulation and downscaling specifically within the non-stationary climate change context together with the development of parallelized software; application of NHMMs to downscaling of rainfall projections over India; identification and analysis of decadal climate signals in data and models; and, studies of climate variability in terms of the dynamics of atmospheric flow regimes. Each of these project components is elaborated on below, followed by a list of publications resulting from the grant.

54 ENVIRONMENTAL SCIENCES↗

Final Technical Report for "Collaborative Research. Regional climate-change projections through next-generation empirical and dynamical models"

This project was a continuation of previous work under DOE CCPP funding in which we developed a twin approach of non-homogeneous hidden Markov models (NHMMs) and coupled ocean-atmosphere (O-A) intermediate-complexity models (ICMs) to identify the potentially predictable modes of climate variability, and to investigate their impacts on the regional-scale. We have developed a family of latent-variable NHMMs to simulate historical records of daily rainfall, and used them to downscale seasonal predictions. We have also developed empirical mode reduction (EMR) models for gaining insight into the underlying dynamics in observational data and general circulation model (GCM) simulations. Using coupled O-A ICMs, we have identified a new mechanism of interdecadal climate variability, involving the midlatitude oceans mesoscale eddy field and nonlinear, persistent atmospheric response to the oceanic anomalies. A related decadal mode is also identified, associated with the oceans thermohaline circulation. The goal of the continuation was to build on these ICM results and NHMM/EMR model developments and software to strengthen two key pillars of support for the development and application of climate models for climate change projections on time scales of decades to centuries, namely: (a) dynamical and theoretical understanding of decadal-to-interdecadal oscillations and their predictability; and (b) an interface from climate models to applications, in order to inform societal adaptation strategies to climate change at the regional scale, including model calibration, correction, downscaling and, most importantly, assessment and interpretation of spread and uncertainties in multi-model ensembles. Our main results from the grant consist of extensive further development of the hidden Markov models for rainfall simulation and downscaling specifically within the non-stationary climate change context together with the development of parallelized software; application of NHMMs to downscaling of rainfall projections over India; identification and analysis of decadal climate signals in data and models; and, studies of climate variability in terms of the dynamics of atmospheric flow regimes. Each of these project components is elaborated on below, followed by a list of publications resulting from the grant.

54 ENVIRONMENTAL SCIENCES↗

Lithium-Ion Battery Design for Grid-Scale Energy Storage App

A software that delivers parameters from energy storage system (ESS) to container, rack, module and single cell design, as well as data analysis on arbitrage energy and frequency regulation of ESS in different regions, has been developed. The Lithium-ion Battery Design for Grid-scale Energy Storage App V1.0 has the capability to output the system, module and cell design with the energy, power, capacity, group method, cost of single cell, and single cell test protocol which break down from input energy storage system data in different regions. The default chemistry of the battery is LiFePO4 and graphite. The energy density of the graphite/LiFePO 4 pouch cell ranges from 100 Wh/kg to 200 Wh/Kg in the software. Graphite/LiFePO 4 pouch cell (up to 1Ah in lab) manufacturing line is also built and can be used to evaluate the test protocol, moreover, for electrolyte evaluation in other ESMI seedling projects. The software enables rapid prototyping to accelerate energy storage research, development, and manufacturing.

Liu, Dianying↗

Segmentation of Multi-Isotope Imaging Mass Spectrometry Data for Semi-Automatic Detection of Regions of Interest

Multi-isotope imaging mass spectrometry (MIMS) associates secondary ion mass spectrometry (SIMS) with detection of several atomic masses, the use of stable isotopes as labels, and affiliated quantitative image-analysis software. By associating image and measure, MIMS allows one to obtain quantitative information about biological processes in subcellular domains. MIMS can be applied to a wide range of biomedical problems, in particular metabolism and cell fate [1,2,3]. In order to obtain morphologically pertinent data from MIMS images, we have to define regions of interest (ROIs). ROIs are drawn by hand, a tedious and time-consuming process. We have developed and successfully applied a support vector machine (SVM) for segmentation of MIMS images that allows fast, semi-automatic boundary detection of regions of interests. Using the SVM, high-quality ROIs (as compared to an expert’s manual delineation) were obtained for 2 types of images derived from unrelated data sets. This automation simplifies, accelerates and improves the post-processing analysis of MIMS images. This approach has been integrated into ‘‘Open MIMS,’’ an ImageJ-plugin for comprehensive analysis of MIMS images that is available online at http://www.nrims.hms.harvard.edu/NRIMS_ImageJ.php.

59 BASIC BIOLOGICAL SCIENCES↗

Advanced functionality for radio analysis in the Offline software framework of the Pierre Auger Observatory

The advent of the Auger Engineering Radio Array (AERA) necessitates the development of a powerful framework for the analysis of radio measurements of cosmic ray air showers. As AERA performs 'radio-hybrid' measurements of air shower radio emission in coincidence with the surface particle detectors and fluorescence telescopes of the Pierre Auger Observatory, the radio analysis functionality had to be incorporated in the existing hybrid analysis solutions for fluorescence and surface detector data. This goal has been achieved in a natural way by extending the existing Auger Offline software framework with radio functionality. In this article, we lay out the design, highlights and features of the radio extension implemented in the Auger Offline framework. Its functionality has achieved a high degree of sophistication and offers advanced features such as vectorial reconstruction of the electric field, advanced signal processing algorithms, a transparent and efficient handling of FFTs, a very detailed simulation of detector effects, and the read-in of multiple data formats including data from various radio simulation codes. The source code of this radio functionality can be made available to interested parties on request.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Recent evolutions in the LTDP CDF project

In the latest years, CNAF (the national center of the Italian Institute for Nuclear Physics INFN dedicated to Research and Development on Information and Communication Technologies) has been working on the Long Term Data Preservation (LTDP) project for the CDF experiment, active at Fermilab from 1990 to 2011. The main aims of the project are to protect the most relevant part of the CDF RUN-2 data collected between 2001 and 2011 and already stored on tape at CNAF (4 PB), as well as to ensure the availability and the access to the analysis facility to those data over time. Lately, the CDF database, hosting information about CDF datasets such as their structure, file locations and metadata, has been imported from Fermilab to CNAF. Also, the Sequential Access via Metadata (SAM) station data handling tool for CDF data management, that allows to manage data transfers and to retrieve information from the CDF database, has been properly installed and configured at CNAF. This was a fundamental step in the perspective of a complete decommissioning of CDF services on Fermilab side. An access system has been designed and tested to submit CDF analysis jobs, using CDF software distributed via CERN Virtual Machine File System (CVMFS) and requesting delivery of CDF files stored on CNAF tapes, as well as data present only on Fermilab storage archive. Moreover, the availability and the correctness of all CDF data stored on CNAF tapes has been verified. This paper describes all these recent evolutions in detail, presenting the future plans for the LTDP project at CNAF.

Fornari, Federico↗

WSF B696R Calcs

This calculation is applied to the accident analysis scenario of a limited combustibles fire breaching eight SWBs in B696R R1010. For a fire in a building with no breaches, there is only a ground release. The source term (ST) of the deflagration is determined by the Waste Storage Facilities Documented Safety Analysis (Ref. 1). The doses from the release are calculated by using MACCS2 (Ref. 2). This software take hourly meteorological data for a year as input. There are 8760 hours in a year. MACCS2 calculates a dose for each of the 8760 hours, taking into account the associated source term from Reference 1, the wind speed, the stability class (i.e., A through F), the directional sector of the wind (with associated distance to the site boundary). For each directional sector (i.e., 1 through 16) a MACCS2 run was performed. From the total collection of MACCS2 output files, Microsoft Excel is used to extract the dose that correspond to the meteorological conditions of each hour in the year. Note: although MACCS2 inputs a single year of meteorological data, five years are used (2010 through 2014) by performing multiple runs. This is discussed in Section 2.2. Conclusions: The final 95th percentile dose at the collocated worker used for accident analysis of a limited combustibles fire breaching eight SWBs in B696R R1010 is 18.4 rem.

99 GENERAL AND MISCELLANEOUS↗

Performance Testing of an Integrated Magnetic Power Take-Off

A wave energy converter (WEC) and the power take-off (PTO) generator system can be represented by using a mass-spring-dampener model. By incorporating a negative stiffness spring within the PTO, the overall stiffness of the PTO can be lowered allowing the impedance of the PTO to be more closely matched with the WEC. By designing for impedance matching the WEC can greatly enhance its power generation capability. This project has involved the design, fabrication and testing of a new type of linear-stroke length and rotary stroke length adjustable negative stiffness magnetic springs for use within a wave energy converter (WEC). The magnetic springs were studied by using 3-D finite element analysis with the objective of creating high energy density and a long linear stroke length. After the construction and testing of both a proof-of-principle adjustable linear and rotary magnetic spring prototype the rotary (torsional) magnetic spring was selected for scaling up analysis. The selected scaled-up proof-of-principle magnetic spring had a peak torque of 850 Nm with a ±45 degree stroke length. By translating the inner rotor relative to the outer rotor, the stiffness could be adjusted to be either negative or positive stiffness. During this project a magnetic lead screw was also studied, and it was shown that by combining the magnetic lead screw with a linearly translating magnetic spring a very long rotary stroke length could be attained. However, as the magnetic lead screw increased complexity and reduced overall energy density relative to a rotary (torsional) spring, this design approach was not further pursed. Dynamometer testing of the variable stiffness magnetic springs was first completed by Portland State University and following this the magnetic spring performance was independently verified by Sandia National Laboratory (Sandia). A WEC analysis when using a variable stiffness magnetic spring was completed by using the WecOptTool. WecOptTool is an open-source WEC optimization software developed by Sandia that supports efficient power take-off (PTO) and control optimization. Wave condition data from the Oregon PacWave test-site was used in this study. The analysis showed that a WEC with a tunable stiffness value could consistently achieve about 80% of its maximum theoretical power production. The use of a tunable stiffness WEC, rather than zero-stiffness or a constant stiffness WEC was also shown to lead to a smaller maximum PTO force requirement. The variable stiffness magnetic spring was integrated into an experimental WEC developed by Sandia, called a Wave-Bot. Sandia successfully completed water-tank testing of the Wave-Bot at the Navy’s Carderock, Maryland, wave-basin test site. The wave-basin testing helped to experimentally demonstrate the operating capabilities and increased power generation capability of a WEC containing an integrated variable stiffness magnetic spring. A WEC capacity factor analysis was also completed. The capacity factor was defined as the ratio of annual average WEC generator power to the maximum (RMS) generated power. This capacity factor provided a means of identifying the ratio of potential revenue to cost. It was calculated that if a tunable variable stiffness magnetic spring has RMS constraints it could operate with a capacity factor above 30%. This is comparable to a wind turbine’s capacity factor.

16 TIDAL AND WAVE POWER↗

Algorithms and data structures to accelerate network analysis

As the sheer amount of computer generated data continues to grow exponentially, new bottlenecks are unveiled that require rethinking our traditional software and hardware architectures. Here in this paper we present five algorithms and data structures (long queue emulation, lockless bimodal queues, tail early dropping, LFN tables, and multiresolution priority queues) designed to optimize the process of analyzing network traffic. We integrated these optimizations on R-Scope, a high performance network appliance that runs the Bro network analyzer, and present benchmarks showcasing performance speed ups of 5X at traffic rates of 10 Gbps.

97 MATHEMATICS AND COMPUTING↗

CMS Space Monitoring

During the first LHC run, CMS stored about one hundred petabytes of data. Storage accounting and monitoring help to meet the challenges of storage management, such as efficient space utilization, fair share between users and groups and resource planning. We present a newly developed CMS space monitoring system based on the storage metadata dumps produced at the sites. The information extracted from the storage dumps is aggregated and uploaded to a central database. A web based data service is provided to retrieve the information for a given time interval and a range of sites, so it can be further aggregated and presented in the desired format. The system has been designed based on the analysis of CMS monitoring requirements and experiences of the other LHC experiments. In this paper, we demonstrate how the existing software components of the CMS data placement system, PhEDEx, have been re-used, dramatically reducing the development effort.

Ratnikova, N.↗

FORCE Output Data Visualization

The Framework for Optimization of ResourCes and Economics (FORCE) is a collection of software tools, models, and datasets acquired and developed under the Integrated Energy Systems (IES) program to enable analysis of technical and economic viability of myriad IES configurations. Idaho National Laboratory is hosting a training session for FORCE users and developers, which is "Integrated Energy Systems Tools FORCE Overview and Training 2023." We will present data output visualization results with FORCE scenarios as examples and show how does the new design improve existing automated visualization for analysis results.

25 ENERGY STORAGE↗

P-MartCancer–Interactive Online Software to Enable Analysis of Shotgun Cancer Proteomic Datasets

P-MartCancer is a new interactive web-based software environment that enables biomedical and biological scientists to perform in-depth analyses of global proteomics data without requiring direct interaction with the data or with statistical software. P-MartCancer offers a series of statistical modules associated with quality assessment, peptide and protein statistics, protein quantification and exploratory data analyses driven by the user via customized workflows and interactive visualization. Currently, P-MartCancer offers access to multiple cancer proteomic datasets generated through the Clinical Proteomics Tumor Analysis Consortium (CPTAC) at the peptide, gene and protein levels. P-MartCancer is deployed using Azure technologies (http://pmart.labworks.org/cptac.html), the web-service is alternatively available via Docker Hub (https://hub.docker.com/r/pnnl/pmart-web/) and many statistical functions can be utilized directly from an R package available on GitHub (https://github.com/pmartR).

Webb-Robertson, Bobbie-Jo M.↗

PlasmoData.jl — A Julia framework for modeling and analyzing complex data as graphs

Datasets encountered in scientific and engineering applications appear in complex formats (e.g., images, multivariate time series, molecules, video, text strings, networks). Graph theory provides a unifying framework to model such datasets and enables the use of powerful tools that can help analyze, visualize, and extract value from data. In this work, we present PlasmoData.jl, an open-source, Julia framework that uses concepts of graph theory to facilitate the modeling and analysis of complex datasets. The core of our framework is a general data modeling abstraction, which we call a DataGraph. We show how the abstraction and software implementation can be used to represent diverse data objects as graphs and to enable the use of tools from topology, graph theory, and machine learning (e.g., graph neural networks) to conduct a variety of tasks. We illustrate the versatility of the framework by using real datasets: (i) an image classification problem using topological data analysis to extract features from the graph model to train machine learning models; (ii) a disease outbreak problem where we model multivariate time series as graphs to detect abnormal events; and (iii) a technology pathway analysis problem where we highlight how we can use graphs to navigate connectivity. Further, our discussion also highlights how PlasmoData.jl leverages native Julia capabilities to enable compact syntax, scalable computations, and interfaces with diverse packages. Overall, we show that the DataGraph abstraction and PlasmoData.jl Julia package are able to model data within graphs and enable useful analysis.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

From smart homes to smart laboratories: connected instruments for materials science

The current focus on artificial intelligence and machine learning in the scientific community has the potential to greatly speed up discovery. In this article, we explore what a “smart facility” would mean for materials science. We propose to capture meta-data at every step of an experiment, including materials synthesis, sample production and characterization, simulation, and the analysis software used to extract information. Although most of this information is captured in various institutional systems and staff logbooks, more insight could be obtained by connecting this information through a system that allows automation. AI-enabled processes built on such a system would have the potential of making experiment planning easier and minimize the time between experiment and publication.

Doucet, Mathieu↗