Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Controls From Above and Below: Snow, Soil, and Steepness Drive Diverging Trends of Subsurface Water and Streamflow Dynamics

ABSTRACT The importance of subsurface water dynamics, such as water storage and flow partitioning, is well recognised. Yet, our understanding of their drivers and links to streamflow generation has remained elusive, especially in small headwater streams that are often data‐limited but crucial for downstream water quantity and quality. Large‐scale analyses have focused on streamflow characteristics across rivers with varying drainage areas, often overlooking the subsurface water dynamics that shape streamflow behaviour. Here we ask the question: What are the climate and landscape characteristics that regulate subsurface dynamic storage, flow path partitioning, and dynamics of streamflow generation in headwater streams? To answer this question, we used streamflow data and a widely‐used hydrological model (HBV) for 15 headwater catchments across the contiguous United States. Results show that climate characteristics such as aridity and precipitation phase (snow or rain) and land attributes such as topography and soil texture are key drivers of streamflow generation dynamics. In particular, steeper slopes generally promoted more streamflow, regardless of aridity. Streams in flat, rainy sites (< 30% precipitation as snow) with finer soils exhibited flashier regimes than those in snowy sites (> 30% precipitation as snow) or sites with coarse soils and deeper flow paths. In snowy sites, less weathered, thinner soils promoted shallower flow paths such that discharge was more sensitive to changes in storage, but snow dampened streamflow flashiness overall. Results here indicate that land characteristics such as steepness and soil texture modify subsurface water storage and shallow and deep flow partitioning, ultimately regulating streamflow response to climate forcing. As climate change increases uncertainty in water availability, understanding the interacting climate and landscape features that regulate streamflow will be essential to predict hydrological shifts in headwater catchments and improve water resources management.

Kerins, Devon [Department of Civil and Environment↗

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series

In this paper, we introduce Masked Anomaly Detection (MAD), a general self-supervised learning task for multivariate time series anomaly detection. With the increasing availability of sensor data from industrial systems, being able to detecting anomalies from streams of multivariate time series data is of significant importance. Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned normal representations can empower anomaly detection as the model has learned to capture certain key underlying data regularities. A typical formulation is to learn a predictive model, i.e., use a window of time series data to predict future data values. In this paper, we propose an alternative self-supervised learning task. By randomly masking a portion of the inputs and training a model to estimate them using the remaining ones, MAD is an improvement over the traditional left-to-right next step prediction (NSP) task. Our experimental results demonstrate that MAD can achieve better anomaly detection rates over traditional NSP approaches when using exactly the same neural network (NN) base models, and can be modified to run as fast as NSP models during test time on the same hardware, thus making it an ideal upgrade for many existing NSP-based NN anomaly detection models.

97 MATHEMATICS AND COMPUTING↗

NEWTS Database Dashboard

The NEWTS (National Energy Water Treatment and Speciation) database dashboard displays sites across the nation where energy-related wastewater stream samples and composition data have been collected. Using the dashboard, community leaders and the public will be able to quickly explore and obtain sample data from locations displayed on a map where various government agencies collect and analyze water samples from energy-related wastewater streams.

Aqueous Chemistry↗

Surface water data at Los Alamos National Laboratory: 2008 water year

The principal investigators collected and computed surface water discharge data from 69 stream-gage stations that cover most of Los Alamos National Laboratory and one at Bandelier National Monument. Also included are discharge data from three springs— two that flow into Cañon de Valle and one that flows into Water Canyon.

58 GEOSCIENCES↗

Surface water data at Los Alamos National Laboratory: 2009 water year

The principal investigators collected and computed surface water discharge data from 73 stream-gage stations that cover most of Los Alamos National Laboratory and one at Bandelier National Monument. Also included are discharge data from three springs— two that flow into Cañon de Valle and one that flows into Water Canyon.

54 ENVIRONMENTAL SCIENCES↗

RR Lyrae in XSTPS: The halo density profile in the north galactic cap

We present a catalog of RR Lyrae stars (RRLs) observed by the Xuyi Schmidt Telescope Photometric Survey (XSTPS). The area we consider is located in the north Galactic cap, covering ≈376.75 deg{sup 2} at α ≈ 150° and δ ≈ 27° down to a magnitude limit of i ≈ 19. Using the variability information afforded by the multi-epoch nature of our XSTPS data, combined with colors from the Sloan Digital Sky Survey, we are able to identify candidate RRLs. We find 318 candidates, derive distances to them, and estimate the detection efficiency. The majority of our candidates have more than 12 observations, and for these we are able to calculate periods. These also allow us to estimate our contamination level, which we predict is between 30% and 40%. Finally, we use the sample to probe the halo density profile in the 9-49 kpc range and find that it can be well fitted by a double power law. We find good agreement between this model and the models derived for the south Galactic cap using the Watkins et al. and Sesar et al. RRL data sets, after accounting for possible contamination in our data set from Sagittarius stream members. We consider non-spherical double power-law models of the halo density profile and again find agreement with literature data sets, although we have limited power to constrain the flattening due to our small survey area. Much tighter constraints will be placed by current and future wide-area surveys, most notably ESA's astrometric Gaia mission. Our analysis demonstrates that surveys with a limited number of epochs can effectively be mined for RRLs. Our complete sample is provided as accompanying online material; as an example the first few entries of each electronic table are shown in the text.

79 ASTRONOMY AND ASTROPHYSICS↗

Enabling real-time adaptation of machine learning models at x-ray Free Electron Laser facilities with high-speed training optimized computational hardware

The emergence of novel computational hardware is enabling a new paradigm for rapid machine learning model training. For the Department of Energy’s major research facilities, this developing technology will enable a highly adaptive approach to experimental sciences. In this manuscript we present the per-epoch and end-to-end training times for an example of a streaming diagnostic that is planned for the upcoming high-repetition rate x-ray Free Electron Laser, the Linac Coherent Light Source-II. We explore the parameter space of batch size and data parallel training across multiple Graphics Processing Units and Reconfigurable Dataflow Units. We show the landscape of training times with a goal of full model retraining in under 15 min. Although a full from scratch retraining of a model may not be required in all cases, we nevertheless present an example of the application of emerging computational hardware for adapting machine learning models to changing environments in real-time, during streaming data acquisition, at the rates expected for the data fire hoses of accelerator-based user facilities.

97 MATHEMATICS AND COMPUTING↗

DAISY: A Rapid Approach to Evaluating Marine Energy Converter Sound (Final Technical Report)

This project’s objective was to improve the quality of acoustic information about marine energy converters that could be collected from groups of drifting hydrophones, while reducing the costs of deployment and data analysis. This was achieved through technology development addressing four focus areas: (1) minimizing flow-noise and self-noise, (2) integrating metadata streams into a single data acquisition system, (3) developing post-processing routines to facilitate rapid data review, and (4) enabling objective identification of marine energy converter sound against a backdrop of ambient noise using time-delay-of-arrival localization.

16 TIDAL AND WAVE POWER↗

Slipstream pilot-scale demonstration of a novel amine-based post-combustion technology for carbon dioxide capture from coal-fired power plant flue gas

Post-combustion CO 2 capture (PCC) technology offers flexibility to treat the flue gas from both existing and new coal-fired power plants and can be applied to treat all or a portion of the flue gas. Solvent-based technologies are today the leading option for PCC from commercial coal-fired power plants as they have been applied in large-scale in other applications. Linde and BASF have been working together to develop and further improve a PCC process incorporating BASF’s novel aqueous amine-based solvent technology. This technology offers significant benefits compared to other solvent-based processes as it aims to reduce the regeneration energy requirements using novel solvents that are very stable under the coal-fired power plant feed gas conditions. BASF has developed the desired solvent based on the evaluation of a large number of candidates. In addition, long-term small pilot-scale testing of the BASF solvent has been performed on a lignite-fired flue gas. In coordination with BASF, Linde has evaluated a number of options for capital cost reduction in large engineered systems for solvent-based PCC technology. This report provides a summary of the work performed and results from a project supported by the US DOE (DE-FE0007453) for the pilot-scale demonstration of a Linde-BASF PCC technology using coal-fired power plant flue gas at a 1-1.5 MWe scale in Wilsonville, AL at the National Carbon Capture Center (NCCC). Following a project kick-off meeting in November 2011 and the conclusion of pilot plant design and engineering in February 2013, mechanical completion of the pilot plant was achieved in July 2014, and final commissioning activities were completed to enable start-up of operations in January 2015. Parametric tests were performed from January to December 2015 to determine optimal test conditions and evaluate process performance over a variety of operation parameters. A long-duration 1500-hour continuous test campaign was performed from May to August 2016 at a selected process condition to evaluate process performance and solvent stability over a longer period similar to how the process would operate as a continuously running large-scale PCC plant. The pilot plant integrated a number of unique features of the Linde-BASF technology aimed at lowering overall energy consumption and capital costs. During the overall test period including startup, parametric testing and long-duration testing, the pilot plant was operated for a total of 6,764 hours out of which testing with flue gas was performed for 4,109 hours. The pilot plant testing demonstrated all of the performance targets including CO 2 capture rate exceeding 90%, CO 2 purity exceeding 99.9 mol% (dry), flue gas processing capacity up to 15,500 lbs/hr (equivalent to 1.5 MWe capacity slipstream), regeneration energy as low as 2.7 GJ/tonne CO 2 , and regenerator operating pressure up to 3.4 bara. Excellent solvent stability performance data was measured and verified by Linde and BASF during both test campaigns. In addition to process data, significant operational learnings were gained from pilot tests that will contribute greatly to the commercial success of PCC. Based on a thorough techno-economic assessment (TEA) of the Linde-BASF PCC process integrated with a 550 MWe supercritical coal-fired power plant, the net efficiency of the integrated power plant with CO 2 capture is increased from 28.4% with the DOE/NETL Case 12 reference to 30.9% with the Linde-BASF PCC plant previously presented utilizing the BASF OASE® blue solvent [Ref. 4], and is further increased to 31.4% using a Linde-BASF PCC plant with BASF OASE® blue solvent and an advanced stripper interstage heater (SIH) configuration. The Linde-BASF PCC plant incorporating the BASF OASE® blue solvent also results in significantly lower overall capital costs, thereby reducing the cost of electricity (COE) and cost of CO 2 captured from $147.25/MWh and $56.49/MT CO 2 , respectively, for the reference DOE/NETL Case 12 plant, to $128.49/MWh and $41.85/MT CO2 for process case LB1, respectively, and $126.65/MWh and $40.66/MT CO 2 for process case SIH, respectively. With additional innovative Linde-BASF PCC process configuration improvements, the COE and cost of CO 2 captured can be further reduced to $125.51/MWh and $39.90/MT CO 2 for a further optimized PCC process defined as LB1-CREB. Most notably, the Linde-BASF process options assessed have already demonstrated the potential to lower the cost of CO 2 captured below the DOE target of $40/MT CO 2 at the 550 MWe scale for second generation PCC technologies. Project organization, structure, goals, tasks, accomplishments, process criteria and milestones will be presented in this report along with highlights and key results from parametric and long-duration testing of the Linde-BASF PCC pilot. The parametric and long-duration testing campaigns were aimed at validating the performance of the PCC technology against targets determined from a preliminary techno-economic assessment. The stability of the solvent with extended operation in a realistic power plant setting was measured with performance verified. Additionally, general solvent classification information, process operating conditions, normalized solvent performance data, solvent stability test results, flue gas conditions data, CO 2 purity data in the gaseous product stream, steam requirements and process flow diagrams, and updated process economic data for a scaled-up 550 MWe supercritical power plant with CO 2 capture are presented and discussed in this report.

20 FOSSIL-FUELED POWER PLANTS↗

An Information Theoretic Framework and Self-organizing Agent- based Sensor Network Architecture for Power Plant Condition Monitoring

A central goal of the work was to enable both the extraction of all relevant information from sensor data, and the application of information gained from appropriate processing and fusion at the system level to operational control and decision-making at various levels of the control hierarchy through: 1. Exploiting the deep connection between information theory and the thermodynamic formalism, 2. Deployment using distributed intelligent agents with testing and validation in a hardware-in-the loop simulation environment. Enterprise architectures are the organizing logic for key business processes and IT infrastructure and, while the generality of current definitions provides sufficient flexibility, the current architecture frameworks do not inherently provide the appropriate structure. Of particular concern is that existing architecture frameworks often do not make a distinction between ``data'' and ``information.'' This work defines an enterprise architecture for health and condition monitoring of power plant equipment and further provides the appropriate foundation for addressing shortcomings in current architecture definition frameworks through the discovery of the information connectivity between the elements of a power generation plant. That is, to identify the correlative structure between available observations streams using informational measures. The principle focus here is on the implementation and testing of an emergent, agent-based, algorithm based on the foraging behavior of ants for eliciting this structure and on measures for characterizing differences between communication topologies. The elicitation algorithms are applied to data streams produced by a detailed numerical simulation of Alstom’s 1000 MW ultra-super-critical boiler and steam plant. The elicitation algorithm and topology characterization can be based on different informational metrics for detecting connectivity, e.g. mutual information and linear correlation.

20 FOSSIL-FUELED POWER PLANTS↗

New spectroscopic technique based on coaddition of surface brightness fluctuations: NGC 4449 and its stellar tidal stream

We present a new spectroscopic technique based in part on targeting the upward fluctuations of the surface brightness for studying the internal stellar kinematics and metallicities of galaxies of low surface brightness effects both to galaxies and streams beyond the Local Group. The distance to these systems makes them unsuitable for targeting individual red giant branch (RGB) stars (tip of RGB at I≳24 mag) and their surface brightness is too low (μ{sub r}≳25 mag arcsec{sup −2}) for integrated light spectroscopic measurements. This technique overcomes these two problems by targeting individual objects that are brighter than the tip of the RGB. We apply this technique to the star-forming dwarf galaxy NGC 4449 and its stellar stream. We use Keck/DEIMOS data to measure the line-of-sight radial velocity out to ∼7 kpc in the east side of the galaxy and ∼8 kpc along the stream. We find that the two systems are likely gravitationally bound to each other and have heliocentric radial velocities of 227.3 ± 10.7 km s{sup −1} and 225.8 ± 16.0 km s{sup −1}, respectively. Neither the stream nor the near half of the galaxy shows a significant velocity gradient. We estimate the stellar metallicity of the stream based on the equivalent width of its calcium triplet lines and find [Fe/H] = −1.37±0.41, which is consistent with the metallicity–luminosity relation for dwarf galaxies in the Local Group. Whether the stream's progenitor was moderately or severely stripped cannot be constrained with this uncertainty in metallicity. We demonstrate that this new technique can be used to measure the kinematics and (possibly) the metallicity of the numerous faint satellites and stellar streams in the halos of nearby (∼4 Mpc) galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

MARCUS ARM CN and CCN data reprocessed to remove ship exhaust influence

The data presented in this collection are the cloud condensation nuclei (CCN) and condensation nuclei (CN) from the MARCUS (Measurements of Aerosols, Radiation and CloUds over the Southern Oceans) campaign. This campaign involved the deployment of the ARM Mobile Facility aboard the RSV Aurora Australis between October 2017 and March 2018 during its summer season resupplying Australia&rsquo;s Antarctic research stations from its port in Hobart, Australia. Routine processing undertaken by ARM does not remove platform exhaust associated with its deployment aboard ships. Consequently, the raw data were obtained and manually filtered to remove the influence of platform exhaust on the measurements by reviewing CCN, CN and BC data simultaneously and flagging all affected periods. Remaining data were then quality controlled for when instrument parameters were out of specification. CCN data are split into different streams for supersaturation settings before statistics for each hour being calculated. All data files contain NaN values for periods when data was removed for QC or exhaust reasons. Original raw data available at: Kulkarni, G. R., Flynn, C. and Koontz, A.: Atmospheric Radiation Measurement (ARM) user facility. 2017, updated hourly. Cloud Condensation Nuclei Particle Counter (AOSCCN100). 2017-10-29 to 2018-03-24, ARM Mobile Facility (MAR) Hobart, AUS to Antarctic Coast - resupply ship Aurora Australis; AMF2 (M1)., Atmospheric Radiation Measurement (ARM) user facility Data Center: Oak Ridge, Tennessee, USA [online] Available from: http://dx.doi.org/10.5439/1227964 (Accessed 9 November 2018), 2018. Kuang, C., Salwen, C., Boyer, M. and Singh, A.: Atmospheric Radiation Measurement (ARM) user facility. 2017, updated hourly. Condensation Particle Counter (AOSCPCF). 2017-10-29 to 2018-03-26, ARM Mobile Facility (MAR) Hobart, AUS to Antarctic Coast - resupply ship Aurora Australis; AMF2 (M1)., Atmospheric Radiation Measurement (ARM) user facility Data Center: Oak Ridge, Tennessee, USA [online] Available from: http://dx.doi.org/10.5439/1046184 (Accessed 9 November 2018), 2018.

54 ENVIRONMENTAL SCIENCES↗

An integrated manifold learning approach for high-dimensional data feature extractions and its applications to online process monitoring of additive manufacturing

As an effective dimension reduction and feature extraction technique, manifold learning has been successfully applied to high-dimensional data analysis. With the rapid development of sensor technology, a large amount of high-dimensional data such as image streams can be easily available. Thus, a promising application of manifold learning is in the field of sensor signal analysis, particular for the applications of online process monitoring and control using high-dimensional data. The objective of this study is to develop a manifold learning-based feature extraction method for process monitoring of Additive Manufacturing (AM) using online sensor data. Due to the non-parametric nature of most existing manifold learning methods, their performance in terms of computational efficiency, as well as noise resistance has yet to be improved. To address this issue, this study proposes an integrated manifold learning approach termed multi-kernel metric learning embedded isometric feature mapping (MKML-ISOMAP) for dimension reduction and feature extraction of online high-dimensional sensor data such as images. Based on the extracted features with the utilization of supervised classification and regression methods, an online process monitoring methodology for AM is implemented to identify the actual process quality status. Finally, in the numerical simulation and real-world case studies, the proposed method demonstrates excellent performance in both prediction accuracy and computational efficiency.

36 MATERIALS SCIENCE↗

20 Year Daily Average Modeled Velocity and Discharge for Openwater Season at Five Communities on Kuskokwim River, Alaska

This dataset includes modeled velocity and discharge at five communities in the middle Kuskokwim River region: Aniak, Chuathbaluk, Crooked Creek, Red Devil and Stony River. Modeled velocities and discharge represent daily averages calculated for the openwater season (OWS) from June 1 - October 18 over the 20 year period 2000-2019 using the raw data described below and included in this archive; full details of methodology are described in (Brown et al. submitted to Renewable Energy). Raw data inputs to inform the modeling process include in-situ measurements of 1) discharge with an acoustic Doppler current meter (ADCP, 600kHz Workhorse Rio Grande by Teledyne RD Instruments) and a global positioning receiver (GPS, Trimble 5700, 5800 and R8) utilizing Real Time Kinematic (RTK) GPS mode over 1-2 days at each site in 2009 or 2010 (Ravens 2014), and 2) river stage with a water level logger (HOBO U20-001-01 by Onset) over 2-9 weeks at each site (Ravens 2014), 3) in addition to a 20 year long-term discharge record collected at the USGS stream gage site in Crooked Creek (USGS 2016). Raw data (discharge and stage) are included in this archive for two additional communities: Lower Kalskag and Sleetmute, where modeled velocities were not calculated due to equipment failure or loss. The USGS stream gage data at Crooked Creek (USGS 2016) and stream gage methodology (Turnipseed and Sauer 2010) are publicly available online, so the data are not duplicated here.

16 TIDAL AND WAVE POWER↗

Streaming Analytics for Anomaly Detection in Large-Scale Data

Anomalous behavior poses serious risks to assured performance and reliability of complex, high-consequence systems. For spaceborne assets and their state-of-health (SOH) telemetry, the challenges of high-dimensional data of varying data types are compounded by computational limitations from size, weight, and power (SWaP) constraints as well as data availability. Automated anomaly detection methods tend to perform poorly under these constraints, while current operational approaches can introduce delays in response time due to the manual, retrospective processes for understanding system failures. As a result, presently deployed space systems, and those deployed in the near future, face situations where mission operations might be delayed or only be able to operate under degraded capabilities. Here, we examine a near-term lightweight solution that provides real-time detection capabilities for rare events and assess state-of-the-art anomaly detection techniques against real SOH telemetry from space platforms. This report describes our methodology and research, which could support more automated capabilities for comprehensive space operations as well as for other resource-constrained edge applications.

97 MATHEMATICS AND COMPUTING↗

DeepCare: Improving Patient Care using Deep Learning on Electronic Health Records

Coordinating patient care using electronic health records (EHR) data presents an exciting but formidable opportunity in data extraction, analysis and modeling. Traditional methods use a manual feature driven approach to model patients with age, family history and symptoms to predict disease outcomes. We propose a novel approach to model patients based on their streaming electronic health records data combined with information from medical knowledge bases, which has been gained over years of medical research. Using a combination of representation learning and long short term memory (LSTM) networks we plan to model patient evolution over time, leading to more accurate and individualized predictive models for patient’s diseases. Our approach will be transformative in providing critical decision support for patient care, enabling accurate understanding and evolution of diseases in patients.

60 APPLIED LIFE SCIENCES↗

The influence of burn severity on dissolved organic carbon concentrations across a stream network differs based on seasonal wetness conditions

Large, high-severity wildfires in many regions across the globe have increased concerns about their impacts on carbon cycling in watersheds. Altered sources of carbon and changes in catchment hydrology after wildfire can lead to shifts in dissolved organic carbon (DOC) concentrations in streams, which can have negative impacts on aquatic ecosystem health and downstream drinking-water treatment. Despite its importance, post-fire DOC responses remain relatively unconstrained in the literature, and we lack critical knowledge of how burn severity, landscape elements, and climate interact to affect DOC concentrations. To improve our understanding of the impact of burn severity on DOC concentrations, we measured DOC at 129 sites across a stream network extending upstream, within, and downstream of a large, high-severity wildfire in Oregon, USA. We collected samples across the study sub-basin during four distinct seasonal wetness conditions. We used our high-spatial-resolution data to develop spatial stream network (SSN) models to predict DOC across the stream network and to improve our understanding of the controls on DOC concentrations. Spatially, we found no obvious wildfire signal – instead, we observed a pattern of increasing DOC concentrations from the high-elevation headwaters to the sub-basin outlet, while the mainstem maintained consistently low DOC concentrations. This suggests that effects from large wildfires may be “averaged” out at higher stream orders and larger spatial scales. When we grouped DOC concentrations by burn severity group, we observed a significant decrease in the variability of DOC concentrations in the moderate and high burn severity sub-catchments. However, our SSN models were able to predict decreases in DOC concentrations with increases in burn severity across the stream network. Decreases in DOC concentrations were also highly variable across seasonal wetness conditions, with the greatest (–1.40 to –1.64 mg L –1 ) decrease occurring in the high-severity group during the wetting season. Additionally, our models indicated that in all seasons, baseflow index was more influential in predicting DOC concentrations than burn severity was, indicating that groundwater discharge can obscure the impacts of wildfire in a stream network. Overall, our results suggested that landscape characteristics can regulate the DOC response to wildfire. Moreover, our results also indicated that the seasonal timing of sampling can influence the observed response of DOC concentrations to wildfire.

54 ENVIRONMENTAL SCIENCES↗

Order Theoretical Semantic Recommendation

Mathematical concepts of order and ordering relations play multiple roles in semantic technologies. Discrete totally ordered data characterize both input streams and top-k rank-ordered recommendations and query output, while temporal attributes establish numerical total orders, either over time points or in the more complex case of startend temporal intervals. But also of note are the fully partially ordered data, including both lattices and non-lattices, which actually dominate the semantic strcuture of ontological systems. Scalar semantic similarities over partially-ordered semantic data are traditionally used to return rank-ordered recommendations, but these require complementation with true metrics available over partially ordered sets. In this paper we report on our work in the foundations of partial order measurement in ontologies, with application to top-k semantic recommendation in workflows.

Joslyn, Cliff A.↗