Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗

Text-based Analytics for Biosurveillance

The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when). The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when).

Biomedical NLP↗

Via Machinae 2.0 : Full-sky, model-agnostic search for stellar streams in Gaia DR2

ABSTRACT We present an update to Via Machinae, an automated stellar stream-finding algorithm based on the deep learning anomaly detector ANODE. Via Machinae identifies stellar streams within Gaia, using only angular positions, proper motions, and photometry, without reference to a model of the Milky Way potential for orbit integration or stellar distances. This new version, Via Machinae 2.0, includes many improvements and refinements to nearly every step of the algorithm, that altogether result in more robust and visually distinct stream candidates than our original formulation. In this work, we also provide a quantitative estimate of the false positive rate of Via Machinae 2.0 by applying it to a simulated Gaia-mock catalogue based on galaxia, a smooth model of the Milky Way that does not contain substructure or stellar streams. Finally, we perform the first full-sky search for stellar streams with Via Machinae 2.0, identifying 102 streams at high significance within the Gaia Data Release 2, of which only 10 have been previously identified. While follow-up observations for further confirmation are required, taking into account the false positive rate presented in this work, we expect approximately 90 of these stream candidates to correspond to real stellar structures.

Astronomy & Astrophysics↗

Quantifying the sensitivity of ephemeral streams to land disturbance activities in arid ecosystems at the watershed scale

Large areas of public lands administered by the Bureau of Land Management and located in arid regions of the southwestern United States are being considered for the development of utility-scale solar energy facilities. Land-disturbing activities in these desert, alluvium-filled valleys have the potential to adversely affect the hydrologic and ecologic functions of ephemeral streams. Regulation and management of ephemeral streams typically falls under a spectrum of federal, state, and local programs, but scientifically based guidelines for protecting ephemeral streams with respect to land-development activities are largely nonexistent. This study developed an assessment approach for quantifying the sensitivity to land disturbance of ephemeral stream reaches located in proposed solar energy zones (SEZs). The ephemeral stream assessment approach used publicly-available geospatial data on hydrology, topography, surficial geology, and soil characteristics, as well as highresolution aerial imagery. These datasets were used to inform a professional judgment-based score index of potential land disturbance impacts on selected critical functions of ephemeral streams, including flow and sediment conveyance, ecological habitat value, and groundwater recharge. The total sensitivity scores (sum of scores for the critical stream functions of flow and sediment conveyance, ecological habitats, and groundwater recharge) were used to identify highly sensitive stream reaches to inform decisions on developable areas in SEZs. Total sensitivity scores typically reflected the scores of the individual stream functions; some exceptions pertain to groundwater recharge and ecological habitats. The primary limitations of this assessment approach were the lack of high-resolution identification of ephemeral stream channels in the existing National Hydrography Dataset, and the lack of mechanistic processes describing potential impacts on ephemeral stream functions at the watershed scale.The primary strength of this assessment approach is that it allows watershed-scale planning for low-impact development in arid ecosystems; the qualitative scoring of potential impacts can also be adjusted to accommodate new geospatial data, and to allow for expert and stakeholder input into decisions regarding the identification and potential avoidance of highly sensitive stream reaches.

Arid ecosystems↗

Adsorption of iodine on hydrogen-reduced silver-exchanged mordenite: Experiments and modeling

The adsorption process of iodine, a major volatile radionuclide in the off-gas streams of spent nuclear fuel reprocessing, on hydrogen-reduced silver-exchanged mordenite (Ag 0 Z) was studied at the micro-scale. The gas-solid mass transfer and reaction involved in the adsorption process were investigated and evaluated with appropriate models. Optimal conditions for reducing the silver-exchanged mordenite (AgZ) in a hydrogen stream were determined. Kinetic and equilibrium data of iodine adsorption on Ag 0 Z were obtained by performing single-layer adsorption experiments with experimental systems of high precision at 373–473 K over various iodine concentrations. Results indicate approximately 91% to 97% of the iodine adsorption was through the silver-iodine reaction. The effect of temperature on the iodine loading capacity of Ag 0 Z was discussed. In conclusion, the Shrinking Core model describes the data well, and the primary rate controlling mechanisms were macro-pore diffusion and silver-iodine reaction. © 2016 American Institute of Chemical Engineers AIChE J, 2016

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

A joint probability approach for coincidental flood frequency analysis at ungauged basin confluences

A reliable and accurate flood frequency analysis at the confluence of streams is of importance. Given that long-term peak flow observations are often unavailable at tributary confluences, at a practical level, this paper presents a joint probability approach (JPA) to address the coincidental flood frequency analysis at the ungauged confluence of two streams based on the flow rate data from the upstream tributaries. One case study is performed for comparison against several traditional approaches, including the position-plotting formula, the univariate flood frequency analysis, and the National Flood Frequency Program developed by US Geological Survey. It shows that the results generated by the JPA approach agree well with the floods estimated by the plotting position and univariate flood frequency analysis based on the observation data.

confluence point↗

NSTX-U Control System Upgrades

The National Spherical Tokamak Experiment (NSTX) is undergoing a wealth of upgrades (NSTX-U). These upgrades, especially including an elongated pulse length, require broad changes to the control system that has served NSTX well. A new fiber serial Front Panel Data Port input and output (I/O) stream will supersede the aging copper parallel version. Driver support for the new I/O and cyber security concerns require updating the operating system from Redhat Enterprise Linux (RHEL) v4 to RedHawk (based on RHEL) v6. While the basic control system continues to use the General Atomics Plasma Control System (GA PCS), the effort to forward port the entire software package to run under 64-bit Linux instead of 32-bit Linux included PCS modifications subsequently shared with GA and other PCS users. Software updates focused on three key areas: (1) code modernization through coding standards (C99/C11), (2) code portability and maintainability through use of the GA PCS code generator, and (3) support of 64-bit platforms. Central to the control system upgrade is the use of a complete real time (RT) Linux platform provided by Concurrent Computer Corporation, consisting of a computer (iHawk), an operating system and drivers (RedHawk), and RT tools (NightStar). Strong vendor support coupled with an extensive RT toolset influenced this decision. The new real-time Linux platform, I/O, and software engineering will foster enhanced capability and performance for NSTX-U plasma control.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Trace Element Mass Flow Rates from U.S. Coal Fired Power Plants

Trace elements (TEs) exit coal-fired power plants (CFPPs) via solid, liquid, and gaseous waste streams. Estimating the TE concentrations of these waste streams is essential to selecting pollution controls and estimating emission reduction benefits. Our report presents a generalizable mass balance model for estimating TE mass flow rates in CFPP waste streams and evaluates model accuracy for the U.S. coal fleet given current data constraints. We stochastically estimate, using a bootstrapping approach, the 2015 plant-level mass flow rates of Hg, Se, As, and Cl to solid, liquid, and gas phase waste streams by combining publicly available data for combusted coal TE concentrations with estimates of TE partitioning within installed air pollution control processes. When compared with measured and reported data on TE mass flow rates, this model generally overestimates masses by 30–50%, with larger errors for Hg. The partitioning estimates are consistent for Se, As, and Cl removal from flue gas, but tend to underestimate Hg removal. While our model is suitable for first-order estimates of TE mass flows, future work to enhance model performance should focus on collecting and using new data on TE concentrations in the coal blend, where data quality is the weakest.

01 COAL, LIGNITE, AND PEAT↗

Long-Term Changes in Concentration and Yield of Riverine Dissolved Silicon From the Poles to the Tropics

Riverine exports of silicon (Si) influence global carbon cycling through the growth of marine diatoms, which account for ~25% of global primary production. Climate change will likely alter river Si exports in biome-specific ways due to interacting shifts in chemical weathering rates, hydrologic connectivity, and metabolic processes in aquatic and terrestrial systems. Nonetheless, factors driving long-term changes in Si exports remain unexplored at local, regional, and global scales. We evaluated how concentrations and yields of dissolved Si (DSi) changed over the last several decades of rapid climate warming using long-term data sets from 60 rivers and streams spanning the globe (e.g., Antarctic, tropical, temperate, boreal, alpine, Arctic systems). We show that widespread changes in river DSi concentration and yield have occurred, with the most substantial shifts occurring in alpine and polar regions. The magnitude and direction of trends varied within and among biomes, were most strongly associated with differences in land cover, and were often independent of changes in river discharge. These findings indicate that there are likely diverse mechanisms driving change in river Si biogeochemistry that span the land-water interface, which may include glacial melt, changes in terrestrial vegetation, and river productivity. Finally, trends were often stronger in months outside of the growing season, particularly in temperate and boreal systems, demonstrating a potentially important role of shifting seasonality for the flux of Si from rivers. Our results have implications for the timing and magnitude of silica processing in rivers and its delivery to global oceans.

54 ENVIRONMENTAL SCIENCES↗

STEREO interplanetary shocks and foreshocks

We use STEREO data to study shocks driven by stream interactions and the waves associated with them. During the years of the extended solar minimum 2007-2010, stream interaction shocks have Mach numbers between 1.1-3.8 and {theta}{sub Bn}{approx}20-86 Degree-Sign . We find a variety of waves, including whistlers and low frequency fluctuations. Upstream whistler waves may be generated at the shock and upstream ultra low frequency (ULF) waves can be driven locally by ion instabilities. The downstream wave spectra can be formed by both, locally generated perturbations, and shock transmitted waves. We find that many quasiperpendicular shocks can be accompanied by ULF wave and ion foreshocks, which is in contrast to Earth's bow shock. Fluctuations downstream of quasi-parallel shocks tend to have larger amplitudes than waves downstream of quasi-perpendicular shocks. Proton foreshocks of shocks driven by stream interactions have extensions dr {<=}0.05 AU. This is smaller than foreshock extensions for ICME driven shocks. The difference in foreshock extensions is related to the fact that ICME driven shocks are formed closer to the Sun and therefore begin to accelerate particles very early in their existence, while stream interaction shocks form at {approx}1 AU and have been producing suprathermal particles for a shorter time.

79 ASTRONOMY AND ASTROPHYSICS↗

HIDE AND SEEK BETWEEN ANDROMEDA'S HALO, DISK, AND GIANT STREAM

Photometry in B, V (down to V {approx} 26 mag) is presented for two 23' Multiplication-Sign 23' fields of the Andromeda galaxy (M31) that were observed with the blue channel camera of the Large Binocular Telescope during the Science Demonstration Time. Each field covers an area of about 5.1 Multiplication-Sign 5.1 kpc{sup 2} at the distance of M31 ({mu}{sub M31} {approx} 24.4 mag), sampling, respectively, a northeast region close to the M31 giant stream (field S2) and an eastern portion of the halo in the direction of the galaxy minor axis (field H1). The stream field spans a region that includes Andromeda's disk and giant stream, and this is reflected in the complexity of the color-magnitude diagram of the field. One corner of the halo field also includes a portion of the giant stream. Even though these demonstration time data were obtained under non-optimal observing conditions, the B photometry, which was acquired in time-series mode, allowed us to identify 274 variable stars (among which 96 are bona fide and 31 are candidate RR Lyrae stars, 71 are Cepheids, and 16 are binary systems) by applying the image subtraction technique to the selected portions of the observed fields. Differential flux light curves were obtained for the vast majority of these variables. Our sample mainly includes pulsating stars that populate the instability strip from the Classical Cepheids down to the RR Lyrae stars, thus tracing the different stellar generations in these regions of M31 down to the horizontal branch of the oldest (t {approx} 10 Gyr) component.

79 ASTRONOMY AND ASTROPHYSICS↗

EXploring the dust content of galactic winds with Herschel. I. NGC 4631

We present a detailed analysis of deep far-infrared observations of the nearby edge-on star-forming galaxy NGC 4631 obtained with the Herschel Space Observatory. Our Photodetector Array Camera and Spectrometer (PACS) images at 70 and 160 μm show a rich complex of filaments and chimney-like features that extends up to a projected distance of 6 kpc above the plane of the galaxy. The PACS features often match extraplanar Hα, radio-continuum, and soft X-ray features observed in this galaxy, pointing to a tight disk–halo connection regulated by star formation. On the other hand, the morphology of the colder dust component detected on a larger scale in the Spectral and Photometric Imaging Receiver 250, 350, and 500 μm data matches the extraplanar H I streams previously reported in NGC 4631 and suggests a tidal origin. The PACS 70/160 μm ratios are elevated in the central ∼3.0 kpc region above the nucleus of this galaxy (the “superbubble”). A pixel-by-pixel analysis shows that dust in this region has a higher temperature and/or an emissivity with a steeper spectral index (β>2) than the dust in the disk, possibly the result of the harsher environment in the superbubble. Star formation in the disk seems energetically insufficient to lift the material out of the disk, unless it was more active in the past or the dust-to-gas ratio in the superbubble region is higher than the Galactic value. Some of the dust in the halo may also have been tidally stripped from nearby companions or lifted from the disk by galaxy interactions.

79 ASTRONOMY AND ASTROPHYSICS↗

Modeling in Big Data Environments

Human-Centered Big Data Research (HCBDR) is an area of work that focuses on the methodologies and research areas focused on understanding how humans interact with “big data”. In the context of this paper, we refer to “big data” in a holistic sense, including most (if not all) the dimensions defining the term, such as complexity, variety, velocity, veracity, etc. Simply put, big data requires us as researchers of to question and reconsider existing approaches, with the opportunity to illuminate new kinds of insights that were traditionally out of reach to humans. The purpose of this article is to summarize the discussions and ideas about the role of models in HCBDR at a recent workshop. Models, within the context of this paper, include both computational and conceptual mental models. As such, the discussions summarized in this article seek to understand the connection between these two categories of models.

big data↗

nng_stream

This project uses the NanoMsg next-generation library to receive data, temporarily store in an in-memory buffer, and then send it out. The buffer handles a high-bandwidth stream from multiple producers (sources) to multiple consumers (sinks).

Rogers, DavidM [Oak Ridge National Laboratory (ORN↗

ESnet-JLab FPGA Accelerated Transport (control plane) [EJFAT (udplbd2)] v2.0

The ESnet-JLab FPGA Accelerated Transport system is a solution for streaming high-speed scientific measurement data from Data Acquisition Systems (DAQs) to high-performance computing facilties. It is generally compatible with many science workflows, and makes no assumptions about the specifics of any particular experiment. This program (udplbd version 2) implements the control plane for the system. It is responsible for programming network forwarding rules into the data plane (implemented by the hardware designed named udplb, described separately). It also implements the control loop necessary to match up offered workload with available capacity on high-performance compute nodes.

Howard, Derek [Lawrence Berkeley National Laborato↗

Enhancement of automotive exhaust heat recovery by thermoelectric devices

In an effort to improve automobile fuel economy, an experimental study is undertaken to explore practical aspects of implementing thermoelectric devices for exhaust gas energy recovery. A highly instrumented apparatus consisting of a hot (exhaust gas) and a cold (coolant liquid) side rectangular ducts enclosing the thermoelectric elements has been built. Measurements of thermoelectric voltage output and flow and surface temperatures were acquired and analyzed to investigate the power generation and heat transfer properties of the apparatus. Effects of inserting aluminum wool packing material inside the hot side duct on augmentation of heat transfer from the gas stream to duct walls were studied. Data were collected for both the unpacked and packed cases to allow for detection of packing influence on flow and surface temperatures. Effects of gas and coolant inlet temperatures as well as gas flow rate on the thermoelectric power output were examined. The results indicate that thermoelectric power production is increased at higher gas inlet temperature or flow rate. However, thermoelectric power generation decreases with a higher coolant temperature as a consequence of the reduced hot-cold side temperature differential. For the hot-side duct, a large temperature gradient exists between the gas and solid surface temperature due to poor heat transfer through the gaseous medium. Adding the packing material inside the exhaust duct enhanced heat transfer and hence raised hot-side duct surface temperatures and thermoelectric power compared to the unpacked duct, particularly where the gas-to-surface temperature differential is highest. Therefore it is recommended that packing of exhaust duct becomes common practice in thermoelectric waste energy harvesting applications.

30 DIRECT ENERGY CONVERSION↗

Theory of ultra-relativistic heavy-ion collisions (Final Report)

In the course of this project the Ohio State University group led by the PI, Professor Ulrich Heinz, developed a comprehensive theoretical picture of the dynamical evolution of ultra-relativistic heavy-ion collisions and of the numerous experimental observables that can be used to diagnose the evolving and short-lived hot and dense fireball created in such collisions. Starting from a qualitative understanding of the main features based on earlier research during the last decade of the twentieth century on collisions at lower energies, the group exploited newly developed theoretical tools and the stream of new high-quality data from the Relativistic Heavy Ion Collider at Brookhaven National Laboratory (which started operations in the summer of the year 2000) to arrive at an increasingly quantitative description of the experimentally observed phenomena.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Use Attainability Analysis Aquatic Life Uses for Perennial Reach of Sandia Canyon [Slides]

The following information will be presented during the February 23, 2022 Accord Pueblos Technical Meeting. The purpose of the study is to determine if natural thermal conditions are preventing the attainment of Coldwater Aquatic Life Use in the perennial reach of the upper Sandia Canyon Assessment Unit (Sandia AU). The New Mexico Water Quality Standards allow for a change in the designated use if a Use Attainability Analysis (UAA) demonstrates that the use is not attainable due to one or more of six factors listed in 40 CFR 131.10(g), including naturally occurring pollutant concentrations. The Sandia AU is located in a perennial reach of upper Sandia Canyon between Sigma Canyon and NPDES Outfall 001. The classified Segment 20.6.4.126 NMAC comprises perennial waters within Los Alamos National Laboratory boundaries and includes the Sandia AU. Persistent surface flows originate from NPDES permitted effluent releases. These releases have occurred since the early 1950’s and continue today. The UAA examines several lines of evidence. NMED’s Air-Water Temperature Correlation (AWTC) model is used for identifying appropriate stream classifications and attainable aquatic life use subcategories. The model correlates between July average air temperatures (ATEMP) and maximum weekly average stream temperatures. Air temperatures are obtained from PRISM and LANL Meteorological Towers and used to derive ATEMP. Thermographs were placed in the Sandia AU to obtain measured stream temperatures during summer months when stream temperatures are the highest. Measured data is used with AWTC modeled data to determine if the Sandia AU is meeting its natural air temperature driven thermal condition.

54 ENVIRONMENTAL SCIENCES↗