Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “INGESTION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Greenhouse Gas Laser Imaging Tomography Experiment (GreenLITE): Evaluation of a new method to look at high resolution spatial/temporal distributions of carbon over key sub km sites

Recently a new laser based approach for measuring area with potential for producing 2D estimates of the concentration spatial distribution has been developed through a cooperative agreement with the National Energy and Technology Laboratory of the Department of Energy, Exelis Inc. and AER Inc. The new approach is based on a pair of continuous wave intensity modulated laser absorption spectrometer transceivers, combined with a series of retro reflectors located around the perimeter of the area being monitored. The main goal of this cooperative agreement is monitoring, reporting and verification for ground carbon capture and storage projects. The system was recently tested at the Zero Emission Research and Technology site in Bozeman, MT, with underground leak rates ranging from 0.1 – 0.3 metric ton per day (T/d), as well as a 0.8 T/d surface release. Over 200 hours of data were collected over a rectangular grid 180m x 200m between August 18th and September 9th. In addition, multiple days of in situ data were acquired for the same site, using a Licor gas analyzer systems. Initial comparisons between the laser-based system and the in situ agree very well. The system is designed to operate remotely and transmit the data via a 3G/4G connection along with weather data for the site. An all web-based system ingests the data, populates a database, performs the inversion to ppm CO2 using the Line-by-Line Radiative Transfer Model (LBLRTM), and displays plots and statistics for the retrieved data. We will present an overview of the GreenLITE measurement system, outline the retrieval and reconstruction approach, and discuss results from extensive field testing.

Dobler, Jeremy↗

Focused Belief Measures for Uncertainty Quantification in High Performance Semantic Analysis

In web-scale semantic data analytics there is a great need for methods which aggregate uncertainty claims, on the one hand respecting the information provided as accurately as possible, while on the other still being tractable. Traditional statistical methods are more robust, but only represent distributional, additive uncertainty. Generalized information theory methods, including fuzzy systems and Dempster-Shafer (DS) evidence theory, represent multiple forms of uncertainty, but are computationally and methodologically difficult. We require methods which provide an effective balance between the complete representation of the full complexity of uncertainty claims in their interaction, while satisfying the needs of both computational complexity and human cognition. Here we build on J{\o}sang's subjective logic to posit methods in focused belief measures (FBMs), where a full DS structure is focused to a single event. The resulting ternary logical structure is posited to be able to capture the minimal amount of generalized complexity needed at a maximum of computational efficiency. We demonstrate the efficacy of this approach in a web ingest experiment over the 2012 Billion Triple dataset from the Semantic Web Challenge.

belief↗

Visualizing Energy Resources Dynamically on Earth (VERDE)

VERDE is a software service that ingests data on real-time eneryg grid status and analyzes the data with models and algorithms presenting the output in a form that can be visualized by client spatio-temporal browsers

Source record↗

Slycat v 1.0 Beta

Slycat is a web-based system for analysis of large, high-dimensional data such as that produced by High Performance Computing (HPC) platforms. The Slycat server integrates data ingestion, scalable analysis, data management, and visualization with commodity web clients using a multi-tiered hierarchy of data and model storage. Analysis inputs are pushed into Slycat, where models are generated and analysis artifacts are stored in a project database. These artifacts are the basis for visualizations that are delivered to users' desktops through ordinary web browsers, eliminating the need to build and deploy platform-specific client applications. Slycat currently provides two types of analysis: canonical correlation analysis (CCA) to model relationships between inputs and output metrics, and time series analysis featuring clustering and comparative visualization of waveforms.

Source record↗

Python-ARM Radar Toolkit

The Python-ARM Radar Toolkit (Py-ART) is a collection of radar quality control and retrieval codes which all work on two unifying Python objects: the PyRadar and PyGrid objects. By building ingests to several popular radar formats and then abstracting the interface Py-ART greatly simplifies data processing over several other available utilities. In addition Py-ART makes use of Numpy arrays as its primary storage mechanism enabling use of existing and extensive community software tools.

Jonathan Helmus, Scott Collis↗

Script for Monitoring Infiniband Switch Links

This script ingests a configuration file and parses it to determine an Infiniband network topology, specifically the port information for switches. It then loops over the fabric to determine which, if any, ports do not meet their desired configuration.

Hanley, Jesse Alonzo↗

An Informatics Approach to Demand Response Optimization in Smart Grids

Power utilities are increasingly rolling out “smart” grids with the ability to track consumer power usage in near real-time using smart meters that enable bidirectional communication. However, the true value of smart grids is unlocked only when the veritable explosion of data that will become available is ingested, processed, analyzed and translated into meaningful decisions. These include the ability to forecast electricity demand, respond to peak load events, and improve sustainable use of energy by consumers, and are made possible by energy informatics. Information and software system techniques for a smarter power grid include pattern mining and machine learning over complex events and integrated semantic information, distributed stream processing for low latency response,Cloud platforms for scalable operations and privacy policies to mitigate information leakage in an information rich environment. Such an informatics approach is being used in the DoE sponsored Los Angeles Smart Grid Demonstration Project, and the resulting software architecture will lead to an agile and adaptive Los Angeles Smart Grid.

Simmhan, Yogesh↗

Plenario: An Open Data Discovery and Exploration Platform for Urban Science

The past decade has seen the widespread release of open data concerning city services, conditions, and activities by government bodies and public institutions of all sizes. Hundreds of open data portals now host thousands of datasets of many different types. These new data sources represent enormous po- tential for improved understanding of urban dynamics and processes—and, ultimately, for more livable, efficient, and prosperous communities. However, those who seek to realize this potential quickly discover that discovering and applying those data relevant to any particular question can be extraordinarily dif- ficult, due to decentralized storage, heterogeneous formats, and poor documentation. In this context, we introduce Plenario, a platform designed to automating time-consuming tasks associated with the discovery, exploration, and application of open city data—and, in so doing, reduce barriers to data use for researchers, policymakers, service providers, journalists, and members of the general public. Key innovations include a geospatial data warehouse that allows data from many sources to be registered into a common spatial and temporal frame; simple and intuitive interfaces that permit rapid discovery and exploration of data subsets pertaining to a particular area and time, regardless of type and source; easy export of such data subsets for further analysis; a user-configurable data ingest framework for automated importing and periodic updating of new datasets into the data warehouse; cloud hosting for elastic scaling and rapid creation of new Plenario instances; and an open source implementation to enable community contributions. We describe here the architecture and implementation of the Plenario platform, discuss lessons learned from its use by several communities, and outline plans for future work.

Catlett, Charlie↗

Rim seal arrangement having pumping feature

A rim seal arrangement for a gas turbine engine includes a first seal face on a rotor component, and a second seal face on a stationary annular rim centered about a rotation axis of the rotor component. The second seal face is spaced from the first seal face along an axial direction to define a seal gap. The seal gap is located between a radially outer hot gas path and a radially inner rotor cavity. The first seal face has a plurality of circumferentially spaced depressions, each having a depth in an axial direction and extending along a radial extent of the first seal face. The depressions influence flow in the seal gap such that during rotation of the rotor component, fluid in the seal gap is pumped in a radially outward direction to prevent ingestion of a gas path fluid from the hot gas path into the rotor cavity.

42 ENGINEERING↗

Soil Carbon Data: long tail recovery

The software is intended to be part of an open source effort regarding soils data. The software provides customized data ingestion scripts for soil carbon related data sets and scripts for output databases that conform to common templates.

Source record↗

Integration of Total-Sky Imager Data with a Physics-Based Smart Persistence Model for Intra-Hour Forecasting of Solar Radiation

Short-term solar forecasting models based solely on global horizontal irradiance (GHI) measurements are often unable to discriminate the forecasting of the factors affecting GHI from those that can be precisely computed by atmospheric models. Our previous study introduced a Physics-based Smart Persistence model for Intra-hour forecasting of solar radiation (PSPI) that decomposed the forecasting of GHI into the computation of extraterrestrial solar radiation and solar zenith angle and the forecasting of cloud albedo and cloud fraction. The extraterrestrial solar radiation and solar zenith angle were accurately computed by the Solar Position Algorithm (SPA) developed at the National Renewable Energy Laboratory (NREL). A cloud retrieval technique was used to estimate cloud albedo and cloud fraction from surface-based observations of GHI. With the assumption of persistent cloud structures, the cloud albedo and cloud fraction were predicted for future time steps using a two-stream approximation and a 5-minute exponential weighted moving average, respectively. The model evaluation indicated the estimation and forecast of cloud fraction mostly contributed to the uncertainty of the PSPI though it overcame the persistence and smart persistence models in all forecast time horizons between 5 and 60 minutes. This study aims to enhance the PSPI by ingesting surface-based observations of cloud fraction from a total sky imager (TSI). The estimation and forecast of cloud albedo is correspondingly improved by utilizing the cloud fraction observations and thus leads to more accurate GHI forecast. Various time-series analysis methods are also investigated on the forecasting of cloud fraction and cloud albedo for further improving the GHI forecast. These improvements are valuable for many applications, such as forecasting energy use for buildings, grid operations, and ultimately bringing down the cost of solar energy.

14 SOLAR ENERGY↗

Adapting DESGW Single Epoch Image Differencing to the LSST Software Stack

Optical follow-up for gravitational wave events remains an important factor in potentially unlocking the secrets of dark matter in the universe. The Dark Energy Survey Gravitational Wave (DESGW) Group currently processes optical data from Dark Energy Camera (DECam) using a custom software pipeline derived from existing DES Supernovae Processing pipelines. While effective, is difficult to maintain and develop a custom workflow as new processing strategies are discovered, and researchers are diverted to newer projects in dark energy investigations. By building a modified image ingestion script and implementing the open-source Legacy Survey of Space and Time (LSST) Processing Pipeline for DESGW data, the lifetime and efficiency of the DESGW difference imaging program can be extended.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of Automated Pipeline for Time-Resolved Link-Wise Vehicular Energy Consumption in the Chattanooga, TN Road Network

The Department of Energy (DOE) has shown strong interest in detecting energy inefficiencies in regional road networks, so as to derive energy consumed at a high spatial temporal resolution. We have developed a workflow to automate the estimation of time-resolved vehicular energy consumption over each link in a road network of interest. The road network used in the current work is centered around the city of Chattanooga, Tennessee and its bordering regions. Utilizing the most mature road network for the Chattanooga, TN region, vehicle speed & count data from TomTom in conjunction with machine learning methods, we have developed an automated pipeline to estimate energy consumption for every link in the network. The first step in the pipeline is ingesting vehicle probe counts and speed estimates from TomTom API. In the next step, the probe counts, speed profiles and other exogenous data (i.e. road types, weather data, ground-truth volume counts and more) were used as input to a supervised learning algorithm to estimate the number of vehicles throughout the entire region for each road segment. These volume estimates were then mapped to a unified road network that contained additional important information such as percentage change in gradient across a link, number of lanes and link lengths that are features in pre-trained single vehicle energy-consumption models available with the RouteE software developed at NREL. The per vehicle energy consumption on each road link predicted using appropriate RouteE vehicular models were multiplied by the volume estimate for the corresponding link over a given time period to predict energy consumed per link for the time interval of interest. Currently, work is underway to improve both the RouteE per vehicle energy estimate and the volume estimates derived from TomTom probe counts. We have also explored the correlation of the link-wise energy estimates with the features of the pre-trained RouteE machine learning model in order to gain insight into what factors contribute most to the link-wise energy consumption.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION,↗

The Marine and Hydrokinetic ToolKit for Data Quality Control and Analysis: Preprint

The ability to handle data is critical at all stages of marine energy (ME) development. The marine hydrokinetic toolkit (MHKiT) is an open-source marine energy software, which includes modules for ingesting, applying quality control, processing, visualizing, and managing data. MHKiT-Python and MHKiT-MATLAB provide robust and verified functions that are needed by the ME community to standardize data processing. Calculations and visualizations adhere to International Electrotechnical Commission (IEC) technical specifications and other guidelines. A resource assessment of NDBC buoy 46050 near PACWAVE is performed using MHKiT and discusses comparisons to the resource assessment provided performed by Dunkel et al.

marine energy↗

The Marine and Hydrokinetic Toolkit (Mhkit) for Data Quality Control and Analysis

The ability to handle data is critical at all stages of marine energy (ME) development. The marine hydrokinetic toolkit (MHKiT) is an open-source marine energy software, which includes modules for ingesting, applying quality control, processing, visualizing, and managing data. MHKiT-Python and MHKiT-MATLAB provide robust and verified functions that are needed by the ME community to standardize data processing. Calculations and visualizations adhere to International Electrotechnical Commission (IEC) technical specifications and other guidelines. A resource assessment of NDBC buoy 46050 near PACWAVE is performed using MHKiT and discusses comparisons to the resource assessment provided performed by Dunkel et al.

marine energy↗

Deep Dive Topic: Analysis

This section focuses on analysis of I/O behavior and the feedback resulting from that analysis. We define analysis of I/O behavior as interpreting and deriving meaning from I/O instrumentation data. We define feedback as the product of the analysis process. Feedback can be thought of as the link between analysis and the subsequent response to that analysis, such as I/O tuning or policy decisions (see Section 4.4).Analysis and feedback may be consumed by either human stakeholders or machine algorithms. If it is to be consumed by human stakeholders, then the analysis process will likely emphasize understandable language and visualization techniques. If it is to be consumed by machine algorithms, then it will likely emphasize the use of machine-parsable, consistent formats that are suitable for ingestion by policy engines and data-mining tools.

Snyder, Shane↗

Geologic Disposal Safety Assessment (GDSA) Biosphere Model Development

The Spent Fuel and Waste Science and Technology Campaign of the U.S. Department of Energy Office of Nuclear Energy, Office of Spent Fuel and Waste Disposition is conducting research and development on geologic disposal of spent nuclear fuel and high-level nuclear waste. This work includes the Geologic Disposal Safety Assessment (GDSA) program which is charged with development of generic deep geologic repository concepts and system performance assessment models. One part of the GDSA framework is the development of a biosphere model capable of assessing doses to potential receptors exposed to radionuclides released from geologic disposal sites. As part of the GDSA framework, a biosphere model compatible with the PFLOTRAN massively parallel subsurface flow and reactive transport code is under development. The PFLOTRAN model provides the radionuclide source term for the biosphere model. The GDSA Biosphere model then assesses the potential movement of radionuclides through the surface biosphere and the subsequent exposure to a human receptor living in the biosphere. The biosphere model includes pathways originating from the groundwater as well as pathways originating from surface water bodies that have a water exchange with a contaminated groundwater body. The pathways for human exposure include consumption of drinking water, irrigated crops, meat animals, aquatic vegetation, and animals, etc.; external exposure from irrigated ground surfaces, surface water bodies, recreational activities, etc.; and inadvertent exposures such as ingestion of contaminated soils or shower water, etc. The GDSA Biosphere model was designed to be flexible and generic in order to accommodate a variety of different sites and climate states. This presentation will present the on the purpose, design, and development progress of the GDSA Biosphere Model.

GDSA, biosphere, repository↗

Deep Learning for Modeling Enhanced Geothermal Systems

Enhanced Geothermal Systems (EGS) offer a vast potential to expand the use of geothermal energy. Heat is extracted from this engineered system by injecting cold water into a subsurface fractures, which are in contact with the hot dry rock, and pulled through the production wells. Creating EGS requires improving the natural permeability of hot crystalline rocks. To develop economically viable EGS reservoirs, significant technical barriers (e.g., better stimulation technologies without adequate water and/or permeability) and non-technical barriers (e.g., land access and permitting) must be overcome. In this short conference paper, we present a workflow to address a part of this challenge – “How to develop economically viable EGS using existing technologies?”. Our workflow called the GeoThermalCloud (GTC) for EGS, leverages recent advances in machine learning, deep learning, and cloud computing. This GTC framework is open-source and available at https://github.com/SmartTensors/GeoThermalCloud.jl. The GTC framework provides trained deep learning (DL) models to estimate the net present value of a given EGS design scenario. The Geothermal Design Tool (https://github.com/GeoDesignTool/GeoDT.git), a fast and simplified multi-physics solver, is used to develop a database for training DL models. The database consists of EGS design parameters (inputs to DL model) and their net present value (output of DL model) in uncertain geologic systems. The EGS design parameters for constructing this training database are based on Utah FORGE but include the options of more wells and deeper depths. The DL models are trained by ingesting the EGS design parameters and estimating the corresponding net present value. Such an emulation allows us to screen various EGS designs quickly and identify good development strategies by coupling them with optimization techniques. Our preliminary results show promise in DL emulation of net present value. However, a lot more work is needed to improve the predictive capability of DL models (i.e., extensive hyperparameter tuning is necessary). This will be the primary focus of our future work.

artificial neural networks, geothermal↗