Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Arecibo pulsar survey using ALFA. IV. Mock spectrometer data analysis, survey sensitivity, and the discovery of 40 pulsars

The on-going Arecibo Pulsar-ALFA (PALFA) survey began in 2004 and is searching for radio pulsars in the Galactic plane at 1.4 GHz. Here we present a comprehensive description of one of its main data reduction pipelines that is based on the PRESTO software and includes new interference-excision algorithms and candidate selection heuristics. This pipeline has been used to discover 40 pulsars, bringing the survey’s discovery total to 144 pulsars. Of the new discoveries, eight are millisecond pulsars (MSPs; P<10 ms) and one is a Fast Radio Burst (FRB). This pipeline has also re-detected 188 previously known pulsars, 60 of them previously discovered by the other PALFA pipelines. We present a novel method for determining the survey sensitivity that accurately takes into account the effects of interference and red noise: we inject synthetic pulsar signals with various parameters into real survey observations and then attempt to recover them with our pipeline. We find that the PALFA survey achieves the sensitivity to MSPs predicted by theoretical models but suffers a degradation for P≳100 ms that gradually becomes up to ∼10 times worse for P>4 s at DM<150 pc cm{sup −3}. We estimate 33 ± 3% of the slower pulsars are missed, largely due to red noise. A population synthesis analysis using the sensitivity limits we measured suggests the PALFA survey should have found 224 ± 16 un-recycled pulsars in the data set analyzed, in agreement with the 241 actually detected. The reduced sensitivity could have implications on estimates of the number of long-period pulsars in the Galaxy.

79 ASTRONOMY AND ASTROPHYSICS↗

In Situ Data Analysis Through Physics-informed Tensor Decompositions (LDRD Final Report)

We introduce a new low-dimensional model of high-dimensional numerical simulation data based on low-rank tensor decompositions. Our new model aims to minimize differences between the model data and simulation data as well as functions of the model data and functions of the simulation data. This novel approach to dimensionality reduction of simulation data provides a means of directly incorporating quantities of interests and invariants associated with conservation principles associated with the simulation data into the low-dimensional model, thus enabling more accurate analysis of the simulation without requiring access to the full set of high-dimensional data. Computational results of applying this approach to two standard low-rank tensor decompositions of data arising from simulation of combustion and plasma physics are presented.

97 MATHEMATICS AND COMPUTING↗

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Eastern North Atlantic (ENA) Aerosol Supplementary Site (S1) Data Analysis Report

We present strategies to identify time periods when local aerosol sources impact the data collected at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility in the Eastern North Atlantic (ENA). Data from the aerosol observing system (AOS) at the Central Facility and a temporary aerosol Supplementary Site (S1) were evaluated. S1 instrumentation was deployed within 0.75 km of the ENA Central Facility (C1) for approximately one year. Two time periods, one during the summer and one during the winter, were examined in support of the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) intensive operating periods (IOPs) in 2017 and 2018.

54 ENVIRONMENTAL SCIENCES↗

Eastern North Atlantic (ENA) Aerosol Supplementary Site (S1) Data Analysis Report

We present strategies to identify time periods when local aerosol sources impact the data collected at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility in the Eastern North Atlantic (ENA). Data from the aerosol observing system (AOS) at the Central Facility and a temporary aerosol Supplementary Site (S1) were evaluated. S1 instrumentation was deployed within 0.75 km of the ENA Central Facility (C1) for approximately one year. Two time periods, one during the summer and one during the winter, were examined in support of the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) intensive operating periods (IOPs) in 2017 and 2018. As the criteria for identifying regionally representative data varies based on the specific needs of the user, we present and discuss different strategies using measured aerosol properties and their associated meteorological parameters to isolate periods in AOS data that were impacted by local aerosol at ENA. We identify high-concentration aerosol events at ENA using submicron number concentrations, size distributions, high-time-resolution measurements, and diurnal profiles. An improved understanding of local aerosol to select the optimal aerosol mask was obtained with an understanding of local meteorology during the different seasons. We developed a mathematical algorithm that employs AOS data to mask high-concentration aerosol events at ENA. We validated the ENA Aerosol Mask with aerosol data from C1 and S1 and associated meteorological data. The Supplementary Site was ideal to understand and constrain local aerosol sources within the region. In its absence, collocated data from the ENA AOS could be used to select appropriate parameters to develop an aerosol mask that would limit over- or underestimating the regional baseline aerosol data. When available, associated metadata, such as airport flight logs and visual identification with AOS cameras should also be used to validate the application of an aerosol mask at a new site. Our results confirm the importance of optimizing an aerosol mask prior its application. In the future, the application of an aerosol mask at ARM observatories and during mobile deployments could be used to increase the data quality of continuous AOS data and to reduce uncertainties when parameterizing regional aerosol processes and impacts on clouds for incorporation in models.

54 ENVIRONMENTAL SCIENCES↗

Towards Redefining the Reproducibility in Quantum Computing: A Data Analysis Approach on NISQ Devices

Although the building of quantum computers has kept making rapid progress in recent years, noise is still the main challenge for any application to leverage the power of quantum computing. Existing works addressing noise in quantum devices proposed noise reduction when deploying a quantum algorithm to a specified quantum computer. The reproducibility issue of quantum algorithms has been raised since the noise levels vary on different quantum computers. Importantly, existing works largely ignore the fact that the noise of quantum devices varies as time goes by. Therefore, reproducing the results on the same hardware will even become a problem. We analyze the reproducibility of quantum machine learning (QML) algorithms based on daily model training and execution data collection. Our analysis shows a correlation between our QML models’ test accuracy and quantum computer hardware’s calibration features. We also demonstrate that noisy simulators for quantum computers are not a reliable tool for quantum machine learning applications.

Senapati, Priyabrata↗

Joint small-angle X-ray and neutron scattering data analysis of asymmetric lipid vesicles

Low- and high-resolution models describing the internal transbilayer structure of asymmetric lipid vesicles have been developed. These models can be used for the joint analysis of small-angle neutron and X-ray scattering data. The models describe the underlying scattering length density/electron density profiles either in terms of slabs or through the so-called scattering density profile, previously applied to symmetric lipid vesicles. Both models yield structural details of asymmetric membranes, such as the individual area per lipid, and the hydrocarbon thickness of the inner and outer bilayer leaflets. The scattering density profile model, however, comes at a cost of increased computational effort but results in greater structural resolution, showing a slightly lower packing of lipids in the outer bilayer leaflet of ~120 nm diameter palmitoyloleoyl phosphatidylcholine (POPC) vesicles, compared to the inner leaflet. Here, analysis of asymmetric dipalmitoyl phosphatidylcholine/POPC vesicles did not reveal evidence of transbilayer coupling between the inner and outer leaflets at 323 K, i.e. above the melting transition temperature of the two lipids.

59 BASIC BIOLOGICAL SCIENCES↗

A reconsideration of the noise equivalent power and the data analysis procedure for the infrared imaging video bolometers

The infrared imaging video bolometer (IRVB) used for measurement of the two-dimensional (2D) radiation profiles from the Large Helical Device has been significantly upgraded recently to improve its signal to noise ratio, sensitivity, and calibration, which ultimately provides quantitative measurements of the radiation from the plasma. The reliability of the quantified data needs to be established by various checks. The noise estimates also need to be revised and more realistic values need to be established. It is shown that the 2D heat diffusion equation can be used for estimating the power falling on the IRVB foil, even with a significant amount of spatial variation in the thermal diffusivity across the area of the platinum foil found experimentally during foil calibration. The equation for the noise equivalent power density (NEPD) is re-derived to include the errors in the measurement of the thermophysical and the optical properties of the IRVB foil. The theoretical value estimated using this newly derived equation matches closely, within 5.5%, with the mean experimental value. The change in the contribution of each error term of the NEPD equation with rising foil temperature is also studied and the blackbody term is found to dominate the other terms at elevated operating temperatures. The IRVB foil is also sensitive to the charge exchange (CX) neutrals escaping from the plasma. The CX neutral contribution is estimated to be marginally higher than the noise equivalent power (NEP) of the IRVB. It is also established that the radiation measured by the IRVB originates from the impurity line radiation from the plasma and not from the heated divertor tiles. The change in the power density due to noise reduction measures such as data smoothing and averaging is found to be comparable to the IRVB NEPD. The precautions that need to be considered during background subtraction are also discussed with experimental illustrations. Finally, the analysis algorithm with all the improvements is validated and found to reproduce the input power well within 10% accuracy. This article answers many fundamental questions relevant to the IRVB and illustrates the care to be exercised while processing the IRVB data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Comprehensive Platform for NGS Data Analysis

Saul Kravitz of CLC Bio discusses the company's Genomic Workbench and how it can be used with data from next generation sequencing platforms on June 3, 2010 at the "Sequencing, Finishing, Analysis in the Future" meeting in Santa Fe, NM.

59 BASIC BIOLOGICAL SCIENCES↗

Extracting physics through deep data analysis

In recent decades humankind has become very apt at generating and recording enormous amounts of data, ranging from tweets and selfies on social networks, to financial transactions in banks and stores. The scientific community has not shunned this popular trend and now routinely produces hundreds of petabytes of data per year [1]. This is because materials and phenomena in the world around us exist in an interweaved, entangled form, which gives rise to the complexity of the Universe and determines the size and complexity of the data that describes it. Science and technology endeavor to unravel this convolution and extract pure components from the mixtures, be it in ore mining and metal smelting or separation of thermal conductivity into the electronic and phononic contributions. Decomposition of complex behavior is the key to understanding manifestations of Nature. However, tools to carry out this task are not readily available, and therefore, intricate systems often remain well-characterized experimentally, but still not well understood due to intricacy of the collected data. Lastly, in materials science, understanding and ultimately designing new materials with complex properties will require the ability to integrate and analyze data from multiple instruments, including computational models, designed to probe complementary ranges of space, time, and energy.

36 MATERIALS SCIENCE↗

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗

Power Grid Data Analysis with R and Hadoop

This book chapter presents an approach to analysis of large-scale time-series sensor information based on our experience with power grid data. We use the R-Hadoop Integrated Programming Environment (RHIPE) to analyze a 2TB data set and present code and results for this analysis.

Hafen, Ryan P.↗

Integrated, Interoperable Software Environment for Fusion Simulation and Data Analysis Tools SBIR Phase II

This SBIR effort was focused on developing a production ready system to address the integration and interoperability challenges with analysis and visualization in fusion simulations. Our overarching technical objective was to minimize the code development simulation scientists incur when coupling their simulation codes with different analysis frameworks. To this end, we developed an open-source software library to make data exchange between application easier and a Web application to manage and display analysis extracts from simulations. We have also augmented existing libraries funded by DOE such as ADIOS and VTK-m. When used together, these make it significantly easier to integrate simulation and analysis capability. We demonstrated the flexibility of our approach using two common simulation codes in the fusion community, XGC1 and GTC.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Seismic energy data analysis of Merapi volcano to test the eruption time prediction using materials failure forecast method (FFM)

The test of eruption time prediction is an effort to prepare volcanic disaster mitigation, especially in the volcano’s inhabited slope area, such as Merapi Volcano. The test can be conducted by observing the increase of volcanic activity, such as seismicity degree, deformation and SO2 gas emission. One of methods that can be used to predict the time of eruption is Materials Failure Forecast Method (FFM). Materials Failure Forecast Method (FFM) is a predictive method to determine the time of volcanic eruption which was introduced by Voight (1988). This method requires an increase in the rate of change, or acceleration of the observed volcanic activity parameters. The parameter used in this study is the seismic energy value of Merapi Volcano from 1990 – 2012. The data was plotted in form of graphs of seismic energy rate inverse versus time with FFM graphical technique approach uses simple linear regression. The data quality control used to increase the time precision employs the data correlation coefficient value of the seismic energy rate inverse versus time. From the results of graph analysis, the precision of prediction time toward the real time of eruption vary between −2.86 up to 5.49 days.

42 ENGINEERING↗

A Global Data Analysis for Representing Sediment and Particulate Organic Carbon Yield in Earth System Models

Although sediment yield (SY) from water erosion is ubiquitous and its environmental consequences are well recognized, its impacts on the global carbon cycle remain largely uncertain. This knowledge gap is partly due to the lack of soil erosion modeling in Earth System Models (ESMs), which are important tools used to understand the global carbon cycle and explore its changes. As such, this study analyzed sediment and particulate organic carbon yield (CY) data from 1081 and 38 small catchments (0.1-200 km 2 ), respectively, in different environments across the globe. Using multiple statistical analysis techniques, we explored environmental factors and hydrological processes important for SY and CY modeling in ESMs. Our results show clear correlations of high SY with traditional agriculture, seismicity and heavy storms, as well as strong correlations between SY and annual peak runoff. These highlight the potential limitation of SY models that represent only interrill and rill erosion because shallow overland flow and rill flow have limited transport capacity due to their hydraulic geometry to produce high SY. Further, our results suggest that SY modeling in ESMs should be implemented at the event scale to produce the catastrophic mass transport during episodic events. Several environmental factors such as seismicity and land management that are often not considered in current catchment-scale SY models can be important in controlling global SY. Our analyses show that SY is likely the primary control on CY in small catchments and a statistically significant empirical relationship is established to calculate SY and CY jointly in ESMs.

54 ENVIRONMENTAL SCIENCES↗

APPROACHES TO GEOMETRIC DATA ANALYSIS ON BIG AREA ADDITIVELY MANUFACTURED (BAAM) PARTS

The promise of additive manufacturing is that a user can design and print complex geometries that are very difficult, if not impossible, to machine. The capabilities of 3D printing are restricted by a number of factors, including properties of the build material, time constraints, and geometric design restrictions. In this paper, a thorough accounting and study of the geometric restrictions that exist in the current iteration of additive manufacturing (AM) fused deposition modeling (FDM) technologies are discussed. Offline and online methodologies for collecting data sets for qualitative analysis of large scale AM, in particular Oak Ridge National Laboratory s (ORNL) big area additive manufacturing (BAAM) system, are summarized. In doing so, a survey of tools for designers and software developers is provided. In particular, strategies in which geometric data can be used as training sets for smarter AM technologies in the future are explained as well.

Dreifus, Gregory D↗

End-Member Mixing Analysis Data Package for the East River Watershed, CO USA

The data package consolidates water year 2016 stream, rain, snow and groundwater data used by Carroll et al. (2018) for end-member mixing analysis to isolate seasonal stream source within the East River, CO. Stream concentration and daily discharge are provided for the 11 sub-basins of the East River. The Inouye well defines deep groundwater. Weekly rain is collected at Bradley, Forest, LMWL and 403. Snow pits and snow melt chemistry are defined at multiple sites across the East River. Solutes provided include Mg, Ca, Sr, U, Cl, SO4, DIC, d2H and d18O. Carroll, R., Bearup, L., Brown, W., Dong, W., Bill, M., and K.H. Williams. 2018. Factors controlling groundwater and solute flux from snow-dominated basins. Hydrological Processes. Special Issue Water in the Critical Zone. 1-6. DOI:10.1002/hyp.13151.

Carroll, Rosemary↗

Bayesian tomography and integrated data analysis in fusion diagnostics

In this article, a Bayesian tomography method using non-stationary Gaussian process for a prior has been introduced. The Bayesian formalism allows quantities which bear uncertainty to be expressed in the probabilistic form so that the uncertainty of a final solution can be fully resolved from the confidence interval of a posterior probability. Moreover, a consistency check of that solution can be performed by checking whether the misfits between predicted and measured data are reasonably within an assumed data error. In particular, the accuracy of reconstructions is significantly improved by using the non-stationary Gaussian process that can adapt to the varying smoothness of emission distribution. The implementation of this method to a soft X-ray diagnostics on HL-2A has been used to explore relevant physics in equilibrium and MHD instability modes. This project is carried out within a large size inference framework, aiming at an integrated analysis of heterogeneous diagnostics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗