Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “value of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Multidimensional structured data visualization method and apparatus, text visualization method and apparatus, method and apparatus for visualizing and graphically navigating the world wide web, method and apparatus for visualizing hierarchies

A method of displaying correlations among information objects includes receiving a query against a database; obtaining a query result set; and generating a visualization representing the components of the result set, the visualization including one of a plane and line to represent a data field, nodes representing data values, and links showing correlations among fields and values. Other visualization methods and apparatus are disclosed.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Multidimensional structured data visualization method and apparatus, text visualization method and apparatus, method and apparatus for visualizing and graphically navigating the world wide web, method and apparatus for visualizing hierarchies

A method of displaying correlations among information objects includes receiving a query against a database; obtaining a query result set; and generating a visualization representing the components of the result set, the visualization including one of a plane and line to represent a data field, nodes representing data values, and links showing correlations among fields and values. Other visualization methods and apparatus are disclosed.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Nonlinear Analysis for Event Forewarning (NLAfEW)

The NLAfEW computer code analyses noisy, experimental data to forewarn of adverse events. The functionality of the analysis is a follows: It removes artifacts from the data, converts the continuous data value to discrete values, constructs time-delay embedding vectors, comparents the unique nodes and links in one graph, and determines event forewarning on the basis of several successive occurrences of one (or more) of the dissimilarity measures above a threshold.

Hively, Lee Mizener↗

The Sylvester Graphical Lasso (SyGlasso)

This paper introduces the Sylvester graphical lasso (SyGlasso) that captures multiway dependencies present in tensor-valued data. The model is based on the Sylvester equation that defines a generative model. The proposed model complements the tensor graphical lasso that imposes a Kronecker sum model for the inverse covariance matrix by providing an alternative Kronecker sum model that is generative and interpretable. A nodewise regression approach is adopted for estimating the conditional independence relationships among variables. The statistical convergence of the method is established, and empirical studies are provided to demonstrate the recovery of meaningful conditional dependency graphs. Here we apply the SyGlasso to an electroencephalography (EEG) study to compare the brain connectivity of alcoholic and nonalcoholic subjects. Here, we demonstrate that our model can simultaneously estimate both the brain connectivity and its temporal dependencies.

Wang, Yu↗

Tuple checkout with notify in coordination namespace system

A system and method for notifying a process about a creation or removal event of a named data element (NDE) in a coordination namespace distributed memory system. A controller runs methods to: generate a tuple corresponding to data generated by a requesting process, the tuple having a tuple name and data value; and generate a notification indicator in a pending notification list to indicate to one or more processes a notification of the creation or removal event associated with the corresponding tuple. Upon detecting the event performed on the tuple by a second process, the method further searches for NDEs in the distributed memory system having the same tuple name, and in response to determining an existence of an associated pending notification record in a pending notification list of records, notify each corresponding process of the one or more processes indicated in the list of the creation or removal event.

Jacob, Philip↗

Savannah River Site H-Canyon Collaborative Advanced Technology Demonstration (ATD) - 18313

In support of the Department of Energy's Environmental Management Office of Technology Development (DOE-EM TD) Robotics Technology thrust to pull innovative commercial off the shelf (COTS) and near ready technologies to the field to expedite remaining EM mission clean up and enhance worker safety, the required FY19 Savannah River Site (SRS) H-Canyon Air Exhaust (HCAEX) tunnel inspection task will be used to demonstrate and evaluate the benefit of pulling advanced technology solutions to EM facilities. Presently a biannual visual inspection of the SRS HCAEX tunnel is required to evaluate the structural integrity of the tunnel. While the ability to see inside the tunnel in recent years has been highly invaluable, it is desirable to have a better understanding of the tunnel environment to support a more thorough structural integrity analysis and for long term planning purposes. This higher order of understanding can be accomplished through state of the art COTS sensors and those currently in development and near ready. The ATD will identify and develop for deployment advanced technologies to be hosted on the FY19 inspection platform to acquire high value data desired by the stakeholder. This presentation will include an overview of the ATD mission, background on the tunnel and harsh remote environment in which the inspection robot will work and the high priority inspection needs identified by the H-Canyon facility stakeholders. Discussion will include previous and planned robotic platform modifications to facilitate work in the tunnel and a discussion on the advanced technologies identified to be implemented for the inspection. The ATD will be completed over approximately a 2-year period and has already begun in the form of planning, identification of stakeholder needs, specification of a robust platform and identification of the high priority sensor needs to be pursued. This presentation will be a status of the ATD at approximately the 7-month mark. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of the ARM Lagrangian Large-Scale Forcing Data (ARMLAGTRAJ) Value-Added Product Based on the lagtraj Framework

The Atmospheric Radiation Measurement (ARM) large-scale forcing data developed based on the constrained variational analysis (VARANAL) value-added product (VAP) (Zhang and Lin 1997, Zhang et al. 2001, Xie et al. 2004, Tang et al. 2019) has been widely used for single-column models (SCMs), cloud-resolving models (CRMs), and large-eddy simulation models (LESs) to understand and improve physical processes in models. Recently, the U.S. Department of Energy (DOE) ARM user facility conducted several major field campaigns using ship-based moving observational platforms. For example, the Marine ARM GPCI Investigation of Clouds (MAGIC) field campaign focused on the role of subtropical marine-boundary layer (MBL) clouds, and the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) field campaign aimed to improve understanding of the coupled climate systems in the Arctic. Observations from moving platforms are critical to provide a comprehensive characterization of coupled-system processes associated with all stages of the cloud and/or sea-ice life cycle. Traditional ARM large-scale forcing data have been developed at fixed locations. They need to be extended to include these moving platforms to address data needs for ship-based field campaigns or to support LES modeling in a Lagrangian framework. With these considerations in mind, we develop ARM-type Lagrangian large-scale forcing data sets based on the lagtraj framework (Boeing et al. 2020) with notable enhancements in generating forcings that are more suitable for ARM field campaigns. The lagtraj is a novel tool that generates forcings for LES and SCM simulation in both Lagrangian and Eulerian perspective. This technical report focuses on the major changes we performed on the lagtraj algorithm and provides an overview of the ARM Lagrangian Large-Scale Forcing Data (ARMLAGTRAJ) value-added products.

54 ENVIRONMENTAL SCIENCES↗

Incomplete Data in Smart Grid: Treatment of Values in Electric Vehicle Charging Data

In this paper, five imputation methods namely Constant (zero), Mean, Median, Maximum Likelihood, and Multiple Imputation methods have been applied to compensate for missing values in Electric Vehicle (EV) charging data. The outcome of each of these methods have been used as the input to a prediction algorithm to forecast the EV load in the next 24 hours at each individual outlet. The data is real world data at the outlet level from the UCLA campus parking lots. Given the sparsity of the data, both Median and Constant (=zero) imputations improved the prediction results. Since in most missing value cases in our database, all values of that instance are missing, the multivariate imputation methods did not improve the results significantly compared to univariate approaches.

Majipour, Mostafa↗

A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD inclue Principal Components Analysis (PCA) and regression. Usually these applications arise on data that has far more rows than columns, so-called "tall/skinny" matrices. In the big data analytics context, this may take the form of hundreds of millions to billions of rows with only a few hundred columns. There is a need, therefore, for fast, accurate, and scalable tall/skinny SVD implementations which can fully utilize modern computing resources. To that end, we present a survey of three different algorithms for computing the SVD for these kinds of tall/skinny data layouts using MPI for communication. We contextualize these with common big data analytics techniques. Finally, we present both CPU and GPU timing results from the Summit supercomputer, and discuss possible alternative approaches.

Schmidt, Drew↗

Convective Parameters Derived from Radiosonde Data (SONDEPARAM) Value-Added Product Report

Radiosondes provide fundamental observations of the vertical profile of atmospheric state (pressure, temperature, humidity, and winds), with important implications for subsequent studies on environmental controls on cloud conditions. Within convective cloud environments, there is an increasing demand for additional value-added products (VAPs) to facilitate the use of U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility radiosonde data sets. Such VAPs should provide quick and reliable estimates for several standard radiosonde parameters or quantities of interest using common assumptions, as well as open, flexible code for visualization and user interaction. The Convective Parameters Derived from Radiosonde Data (SONDEPARAM) VAP will apply several robust algorithms used in Wang et al. (2020) for the calculation of useful radiosonde convective cloud parameters, including the convective available potential energy (CAPE), convective inhibition (CIN), and other convective parameters, for several different assumptions regarding the initial parcel characteristics (i.e., surface-based, most unstable, mixed layer). These ARM VAP codes are developed in open, flexible Python formats, with the intention that these parameters/calculations will be incorporated into traditional ARM quick-look radiosonde plotting, yet associated with user-available codes for ease in user reproduction and assumption modification.

54 ENVIRONMENTAL SCIENCES↗

Estimation of missing values in solar radiation data using piecewise interpolation methods: Case study at Penang city

The solar radiation values have been composed by automatic weather station using the device that namely pyranometer. The device is functions to records all the radiation values that have been dispersed, and these data are very useful for it experimental works and solar device’s development. In addition, for modeling and designing on solar radiation system application is needed for complete data observation. Unfortunately, lack for obtained the complete solar radiation data frequently occur due to several technical problems, which mainly contributed by monitoring device. Into encountering this matter, estimation missing values in an effort to substitute absent values with imputed data. This paper aimed to evaluate several piecewise interpolation techniques likes linear, splines, cubic, and nearest neighbor into dealing missing values in hourly solar radiation data. Then, proposed an extendable work into investigating the potential used of cubic Bezier technique and cubic Said-ball method as estimator tools. As result, methods for cubic Bezier and Said-ball perform the best compare to another piecewise imputation technique.

14 SOLAR ENERGY↗

The value of human data annotation for machine learning based anomaly detection in environmental systems

Anomaly detection is the process of identifying unexpected data samples in datasets. Automated anomaly detection is either performed using supervised machine learning models, which require a labelled dataset for their calibration, or unsupervised models, which do not require labels. While academic research has produced a vast array of tools and machine learning models for automated anomaly detection, the research community focused on environmental systems still lacks a comparative analysis that is simultaneously comprehensive, objective, and systematic. This knowledge gap is addressed for the first time in this study, where 15 different supervised and unsupervised anomaly detection models are evaluated on 5 different environmental datasets from engineered and natural aquatic systems. To this end, anomaly detection performance, labelling efforts, as well as the impact of model and algorithm tuning are taken into account. As a result, our analysis reveals the relative strengths and weaknesses of the different approaches in an objective manner without bias for any particular paradigm in machine learning. Most importantly, our results show that expert-based data annotation is extremely valuable for anomaly detection based on machine learning.

54 ENVIRONMENTAL SCIENCES↗

The value of archived data

The rapid progress of atomic and nuclear physics in the twentieth century altered the way scientific results are documented, preserved and disseminated. Boris Pritychenko discusses how atomic and nuclear data tables have become a central resource for the community.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development and Test of a 1,000 Level 3C Fiber Optic Borehole Seismic Receiver Array Applied to Carbon Sequestration

To address the critical site characterization and monitoring needs for CCS programs, US Department of Energy (DOE) awarded Paulsson, Inc. in 2010 a contract to design, build and test a fiber optic based ultra-large bandwidth clamped borehole seismic vector array capable of deploying up to one thousand 3C sensor pods suitable for deployment into high temperature and high pressure boreholes. Paulsson, Inc. has completed a design or a unique borehole seismic system consisting of a novel drill pipe based deployment system that includes a hydraulic clamping mechanism for the sensor pods, a new sensor pod design and most important – a unique fiber optic seismic vector sensor with technical specifications and capabilities that far exceed the state of the art seismic sensor technologies. These novel technologies were all applied to the new borehole seismic system. In combination these technologies will allow for the deployment of up to 1,000 3C sensor pods in vertical, deviated or horizontal wells. Laboratory tests of the fiber optic seismic vector sensors developed during this project have shown that the new borehole seismic sensor technology is capable of generating outstanding high vector fidelity data with extremely large bandwidth: 0.01 – 6,000 Hz. Field tests have shown that the system can record events at magnitudes much smaller than M-2.3 at frequencies up to 2,000 Hz. The sensors have also proved to be about 100 times more sensitive than the regular coil geophones that are used in borehole seismic systems today. The fiber optic seismic sensors have furthermore been qualified to operate at temperatures over 300°C (572°F). The fibers used for the seismic sensors in the system are used to record Distributed Temperature Sensor (DTS) data allowing additional value added data to be recorded simultaneously with the seismic vector sensor data.

01 COAL, LIGNITE, AND PEAT↗

Development of a 300°C 3C Fiber Optic Downhole Seismic Receiver Array for Surveying and Monitoring of Geothermal Reservoirs

To address the critical site characterization and monitoring needs for Enhance Geothermal Systems (EGS) programs, US Department of Energy (DOE) awarded Paulsson, Inc. in 2011 a contract to design, build and test a high temperature fiber optic based ultra-large bandwidth clamped borehole seismic vector array capable of deploying a large number of 3C sensor pods suitable for deployment into high temperature and high pressure boreholes. Paulsson, Inc. has completed a design or a unique borehole seismic system consisting of a novel drill pipe based deployment system that includes a hydraulic clamping mechanism for the sensor pods, a new sensor pod design and most important – a unique fiber optic seismic vector sensor with technical specifications and capabilities that far exceed the state of the art seismic sensor technologies. These novel technologies were all applied to the new borehole seismic system. In combination these technologies will allow for the deployment of up to 1,000 3C sensor pods in vertical, deviated or horizontal wells. Laboratory tests of the fiber optic seismic vector sensors developed during this project have shown that the new borehole seismic sensor technology is capable of generating outstanding high vector fidelity data with extremely large bandwidth: 0.01 – 6,000 Hz. Field tests have shown that the system can record events at magnitudes much smaller than M-4.0 at frequencies over 2,000 Hz. The sensors have also proved to be about 100 times more sensitive than the regular coil geophones that are used in borehole seismic systems today. The fiber optic seismic sensors have furthermore been qualified to operate at temperatures over 300°C (572°F). The data telemetry fibers used for the seismic vector sensors in the system are also used to simultaneously record Distributed Temperature Sensor (DTS) and Distributed Acoustic Sensor (DAS) data allowing additional value added data to be recorded simultaneously with the seismic vector sensor data.

02 PETROLEUM↗