Engineering Papers⌕ Search

Engineering topics

Agarwal, Deborah

Publications and source records attributed to Agarwal, Deborah.

Long-term missing value imputation for time series data using deep neural networks

We present an approach that uses a deep learning model, in particular, a MultiLayer Perceptron, for estimating the missing values of a variable in multivariate time series data. We focus on filling a long continuous gap (e.g., multiple months of missing daily observations) rather than on individual randomly missing observations. Our proposed gap filling algorithm uses an automated method for determining the optimal MLP model architecture, thus allowing for optimal prediction performance for the given time series. We tested our approach by filling gaps of various lengths (three months to three years) in three environmental datasets with different time series characteristics, namely daily groundwater levels, daily soil moisture, and hourly Net Ecosystem Exchange. We compared the accuracy of the gap-filled values obtained with our approach to the widely used R-based time series gap filling methods ImputeTS and mtsdi. The results indicate that using an MLP for filling a large gap leads to better results, especially when the data behave nonlinearly. Thus, our approach enables the use of datasets that have a large gap in one variable, which is common in many long-term environmental monitoring observations.

97 MATHEMATICS AND COMPUTING↗

Tri-State/NETL/Sandia/LBNL IDAES CRADA (Final Report)

The primary goals of this work are to develop recommendations aimed at: (1) reducing the minimum load achievable by a partner plant, (2) improving reliability issues that may result from extended low-load operations, and (3) improving overall efficiency, especially at partial loads. Steady state and dynamic models will also be deployed to a partner plant.

20 FOSSIL-FUELED POWER PLANTS↗

National Alliance for Water Innovation (NAWI) Master Technology Roadmap

The National Alliance for Water Innovation (NAWI) is a research consortium formed to accelerate transformative research in desalination and treatment to lower the cost and energy required to produce clean water from nontraditional water sources and realize a circular water economy. Prior to developing this master roadmap, a team of NAWI researchers and water professionals engaged in a detailed process of evaluating water uses, state-of-the-art technologies, emerging technologies and existing uses of desalination and advanced water technologies within five major water user categories in the United States. The resulting Water User Sector Roadmaps were complemented by a Baseline Analysis of a suite of representative treatment systems conducted by NAWI researchers working in collaboration with the hub’s Industrial Partners. This Master Roadmap, which synthesizes the findings from these different efforts as well as feedback from members of NAWI’s Research Advisory Council, serves as the basis for identifying NAWI’s research Areas of Interest (AOIs).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Sample Identifiers and Metadata to Support Data Management and Reuse in Multidisciplinary Ecosystem Sciences

Physical samples are foundational entities for research across biological, Earth, and environmental sciences. Data generated from sample-based analyses are not only the basis of individual studies, but can also be integrated with other data to answer new and broader-scale questions. Ecosystem studies increasingly rely on multidisciplinary team-science to study climate and environmental changes. While there are widely adopted conventions within certain domains to describe sample data, these have gaps when applied in a multidisciplinary context. In this study, we reviewed existing practices for identifying, characterizing, and linking related environmental samples. We then tested practicalities of assigning persistent identifiers to samples, with standardized metadata, in a pilot field test involving eight United States Department of Energy projects. Participants collected a variety of sample types, with analyses conducted across multiple facilities. We address terminology gaps for multidisciplinary research and make recommendations for assigning identifiers and metadata that supports sample tracking, integration, and reuse. Furthermore, our goal is to provide a practical approach to sample management, geared towards ecosystem scientists who contribute and reuse sample data.

54 ENVIRONMENTAL SCIENCES↗

Assessing data change in scientific datasets

Summary Scientific datasets are growing rapidly and becoming critical to next‐generation scientific discoveries. The validity of scientific results relies on the quality of data used and data are often subject to change, for example, due to observation additions, quality assessments, or processing software updates. The effects of data change are not well understood and difficult to predict. Datasets are often repeatedly updated and recomputing derived data products quickly becomes time consuming and resource intensive and may in some cases not even be necessary, thus delaying scientific advance. Despite its importance, there is a lack of systematic approaches for best comparing data versions to quantify the changes, and ad‐hoc or manual processes are commonly used. In this article, we propose a novel hierarchical approach for analyzing data changes, including real‐time (online) and offline analyses. We employ a variety of fast‐to‐compute numerical analyses, graphical data change representations, and more resource‐intensive recomputations of a subset of the data product. We illustrate the application of our approach using three scientific diverse use cases, namely, satellite, cosmological, and x‐ray data. The results show that a variety of data change metrics should be employed to enable a comprehensive representation and qualitative evaluation of data changes.

97 MATHEMATICS AND COMPUTING↗

Calibration, measurement, and characterization of soil moisture dynamics in a central Amazonian tropical forest

Soil moisture plays a key role in hydrological, biogeochemical, and energy budgets of terrestrial ecosystems. Accurate soil moisture measurements in remote ecosystems such as the Amazon are difficult and limited because of logistical constraints. Time domain reflectometry (TDR) sensors are widely used to monitor soil moisture and require calibration to convert the TDR's dielectric permittivity measurement (K a ) to volumetric water content (θ v ). In this study, our objectives were to develop a field-based calibration of TDR sensors in an old-growth upland forest in the central Amazon, to evaluate the performance of the calibration, and then to apply the calibration to determine the dynamics of soil moisture content within a 14.2 -m-deep vertical soil profile. Depth-specific TDR calibration using local soils in a controlled laboratory setting yielded a novel K a –θ v third-degree polynomial calibration. The sensors were later installed to their specific calibration depth in a 14.2-m pit. The widely used K a –θ v relationship (Topp model) underestimated the site-specific θ v by 22–42%, indicating significant error in the model when applied to these well-structured, clay-rich tropical forest soils. The calibrated wet- and dry-season θ v data showed a variety of depth and temporal variations highlighting the importance of soil textural differentiation, root uptake depths, as well as event to seasonal precipitation effects. Data such as these are greatly needed for improving our understanding of ecohydrological processes within tropical forests and for improving models of these systems in the face of changing environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

A broad exploration of nonlinear dynamics in microbial systems motivated by chemostat experiments producing deterministic chaos.

The main objective of this report is to develop an exploratory mathematical analysis motivated by the Becks et al. (2005) experiments, which will be presented in Chapter 1. Related details of the resulting model will be presented in Chapter 2, and a detailed non-dimensionalization will follow in Chapter 3. During the research to be described, a potential relationship to Shannon information theory was realized, and this will be developed in Chapter 4. Several avenues for future research are suggested, and a more mathematically-oriented presentation of the non-linear dynamical properties of the equations developed in Chapter 1 may be found in Faybishenko et al. (2018).

59 BASIC BIOLOGICAL SCIENCES↗

International Soil Carbon Network (ISCN) Database v3-1

The ISCN is an international scientific community devoted to the advancement of soil carbon research. The ISCN manages an open-access, community-driven soil carbon database. This is version 3-1 of the ISCN Database, released in December 2015. It gathers 38 separate dataset contributions, totalling 67,112 sites with data from 71,198 soil profiles and 431,324 soil layers. For more information about the ISCN, its scientific community and resources, data policies and partner networks visit: http://iscn.fluxdata.org/.

Nave, Luke↗

DOE Advanced Scientific Computing Advisory Committee (ASCAC) Subcommittee Report on Scientific and Technical Information

The Advanced Scientific Computing Advisory Committee (ASCAC) was charged to form a standing subcommittee to review the Department of Energy’s Office of Scientific and Technical Information (OSTI) and to begin by assessing the quality and effectiveness of OSTI’s recent and current products and services and to comment on its mission and future directions in the rapidly changing environment for scientific publication and data. The Committee met with OSTI staff and reviewed available products, services and other materials. This report summaries their initial findings and recommendations.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

On-demand Overlay Networks for Large Scientific Data Transfers

Large scale scientific data transfers are central to scientific processes. Data from large experimental facilities have to be moved to local institutions for analysis or often data needs to be moved between local clusters and large supercomputing centers. In this paper, we propose and evaluate a network overlay architecture to enable highthroughput, on-demand, coordinated data transfers over wide-area networks. Our work leverages Phoebus and On-demand Secure Circuits and AdvanceReservation System (OSCARS) to provide high performance wide-area network connections. OSCARS enables dynamic provisioning of network paths with guaranteed bandwidth and Phoebus enables the coordination and effective utilization of the OSCARS network paths. Our evaluation shows that this approach leads to improved end-to-end data transfer throughput with minimal overheads. The achievedthroughput using our overlay was limited only by the ability of the end hosts to sink the data.

97 MATHEMATICS AND COMPUTING↗