Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Space-to-Ground Interactions While Conducting Scientific Fieldwork Under Mars Mission Constraints

The Biologic Analog Science Associated with Lava Terrains (BASALT) project is a 4-year program dedicated to iteratively designing, implementing, and evaluating concepts of operations (ConOps) and supporting capabilities to enable and enhance scientific exploration for future human Mars missions. BASALT incorporates three field deployments during which real (non-simulated) biological and geochemical field science is conducted at two high-fidelity Mars analog locations under simulated Mars mission conditions, including communication de-lays and data transmission limitations. BASALT’s primary science objective is to investigate how the redox conditions of altered basaltic environments affect the development of microbial communities in these Mars-relevant settings. Field sites include the active East Rift Zone on the Big Island of Hawaii, reminiscent of early Mars when basaltic volcanism and interaction with water were widespread, and the dormant eastern Snake River Plain in Idaho, similar to present-day Mars where basaltic volcanism is rare and most evidence for volcano-driven hydrothermal activity is relict. BASALT’s primary science operations objective is to investigate exploration ConOps and capabilities that facilitate scientific return during human-robotic exploration under Mars mission constraints. Each field deployment consists of ten extravehicular activities (EVAs) on the volcanic flows in which two extravehicular and two intravehicular (IV) crew-members conduct the science while communicating across time delay and under bandwidth constraints with an Earth-based Mission Support Center (MSC) comprised of expert scientists and operators. Communication latencies of 5 and 15-minute one-way light time and low (0.512 Mb/s uplink, 1.54 Mb/s down-link) and high (5.0 Mb/s uplink, 10.0 Mb/s downlink) bandwidth conditions are being evaluated. EVA crewmembers communicate with the MSC via voice and text messaging and provide scientific instrument data, still imagery, video streams, and GPS tracking information. The MSC reviews this data across delay and provides recommendations for presampling and sampling tasks. The scientists used dynamic leaderboards (priority rank-ing lists), to track and rank candidate samples relative to one another and against the science objectives for the current EVA and the overall mission. Updates to the dynamic leaderboards are relayed regularly to the IV crewmembers to provide scientific feedback from Earth and to help minimize crew idle time (time spent waiting for Earth input during which no productive tasks are performed). EVA timelines are strategically designed to enable continuous (delayed) feedback from an Earth-based science team while simultaneously minimizing crew idle time. Such timelines are operationally advantageous, reducing transport costs by eliminating the need for crews to return to the same locations on multiple EVAs while still providing opportunities for recommendations from science experts on Earth, and scientifically advantageous by minimizing the potential for cross-contamination across sites. This paper will highlight the space-to-ground interaction results from the three BASALT field deployments, including planned versus actual EVA time-line data, ground assimilation times (the amount of time available to the MSC to provide input to the crew), and idle time. Furthermore, we describe how these results vary under the different communication latency and bandwidth conditions. Together, these data will provide a basis for guiding and prioritizing capability development for future human exploration missions.

Beaton, Kara H.↗

Analysis in Motion Initiative – Summarization Capability

Analysts are tasked with integrating information from multiple data sources for important and timely decision making. What if sense making and overall situation awareness could be improved through visualization techniques? The Analysis in Motion initiative is advancing the ability to summarize and abstract multiple streams and static data sources over time.

97 MATHEMATICS AND COMPUTING↗

Extreme Scale Visual Analytics

Given the scale and complexity of today s data, visual analytics is rapidly becoming a necessity rather than an option for comprehensive exploratory analysis. In this paper, we provide an overview of three applications of visual analytics for addressing the challenges of analyzing climate, text streams, and biosurveilance data. These systems feature varying levels of interaction and high performance computing technology integration to permit exploratory analysis of large and complex data of global significance.

Steed, Chad A↗

Quantification of Hydrogen Isotopes Utilizing Raman Spectroscopy Paired with Chemometric Analysis for Application across Multiple Systems

On-line and real-time analysis of a chemical process is a major analytical challenge that can drastically change the way the chemical industry or chemical research operates. With in situ analyses, new and powerful understanding of chemistry can be gained; however, building robust tools for long-term monitoring faces many challenges that include compensating for instrument drift, instrument replacement, and sensor or probe replacement. Accounting for these changes by recollecting calibration data and rebuilding quantification models can be costly and time consuming. Here, in this study, methods to overcome these challenges are demonstrated with an application of Raman spectroscopy to monitoring hydrogen isotopes with varied speciation within dynamic gas streams. Specifically, chemical data science tools such as chemometric modeling are leveraged along with several examples of calibration transfer approaches. Furthermore, the optimization of instrument and sensors cell parameters for targeted gas phase analyses is discussed. While the particular focus on hydrogen is highly beneficial within the nuclear energy sector, mechanisms built and demonstrated here are widely applicable to optical spectroscopy monitoring in numerous other chemical systems that can be leveraged in other hazardous processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Attaining and Maintaining a Continuity of Knowledge to Draw Safeguards Conclusions with Confidence.

As the 21st century progresses, new nuclear facilities and the expansion of nuclear activities into new countries will require the International Atomic Energy Agency (IAEA) to place a higher reliance on attaining and maintaining a Continuity of Knowledge (CoK) of its safeguards information than is currently practiced. Additionally, a conceptual view of where and how CoK can be applied will need to evolve to support improved efficiency and efficacy of drawing a safeguards conclusion for each Member State. The ability to draw a safeguards conclusion for a Member State will be predicated on the confidence that CoK has been attained and subsequently maintained with respect to the data and information streams used by the IAEA. This confidence can be described as a function of factors such as elapsed time since the measurement, surveillance of attributes, authentication of information, historic knowledge of potential system failures, and the number and type of data collections. A set of general scenarios are further described for determining what is required to attain CoK and whether CoK has been maintained. A high-level analysis of example scenarios is presented to identify failures or gaps that could cause a loss of CoK. Potential areas for technological research and development are discussed for the next generation of CoK tools.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems

The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.

DER integration↗

Gulf stream velocity structure through combined inversion of hydrographic and acoustic Doppler data

Near-surface velocities from an acoustic Doppler instrument are used in conjunction with CTD/O2 data to produce estimates of the absolute flow field off Cape Hatteras. The data set consists of two transects across the Gulf Stream made by the R/V Endeavor cruise EN88 in August 1982. An inverse procedure is applied which makes use of both the acoustic Doppler data and property conservation constraints. Velocity sections at approximately 73 deg. W and 71 deg. W are presented with formal errors of 1-2 cm/s. The net Gulf Stream transports are estimated to be 116 + or - 2 Sv across the south leg and 161 + or - 4 Sv across the north. A Deep Western Boundary Current transport of 4 + or - 1 Sv is also estimated. While these values do not necessarily represent the mean, they are accurate estimates of the synoptic flow field in the region.

Pierce, S. D.↗

On boundary layer transition in high-subsonic and transonic flow under the influence of acoustic disturbances and free-stream turbulence

The existing data base which quantifies the roles played by the Mach number, turbulence level, and acoustic noise in the flow quality of wind tunnels is reviewed. Attention is given to the effects on end (ET) and beginning (BT) transitions in flows over a 10 deg cone in transonic channels. The Re of both ET and BT flows were significantly affected by the Mach number, acoustic noise level and the noise frequency content. A unit increment in the Mach number increased the Re beyond 3,000,000, while noise below the 1 percent level in the rms pressure coefficient did not alter the transition phenomenon. More data are required on the effects of turbulence, which was a significant factor, and in the settling chamber, test section, plenum and diffuser to trace the locations and magnitudes of the acoustic sources.

Murthy, S. V.↗

Towards an Intelligent Data Delivery Service

The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.

97 MATHEMATICS AND COMPUTING↗

Complex Event Recognition Architecture

Complex Event Recognition Architecture (CERA) is the name of a computational architecture, and software that implements the architecture, for recognizing complex event patterns that may be spread across multiple streams of input data. One of the main components of CERA is an intuitive event pattern language that simplifies what would otherwise be the complex, difficult tasks of creating logical descriptions of combinations of temporal events and defining rules for combining information from different sources over time. In this language, recognition patterns are defined in simple, declarative statements that combine point events from given input streams with those from other streams, using conjunction, disjunction, and negation. Patterns can be built on one another recursively to describe very rich, temporally extended combinations of events. Thereafter, a run-time matching algorithm in CERA efficiently matches these patterns against input data and signals when patterns are recognized. CERA can be used to monitor complex systems and to signal operators or initiate corrective actions when anomalous conditions are recognized. CERA can be run as a stand-alone monitoring system, or it can be integrated into a larger system to automatically trigger responses to changing environments or problematic situations.

Fitzgerald, William A.↗

Applying Transfer Learning for Street-Scale Nuisance Flood Forecasting in Coastal-Urban Cities

An important challenge with Machine Learning (ML) is its transferability; that is, whether a ML model trained on one set of data can be applied to a second set of data without requiring a full re-training of the model. Transfer Learning (TL) addresses this challenge by transferring knowledge learned in the source domain (the data it was trained on) to the target domain (a second set of data that is statistically different but related, which the model was not trained on). This study investigates the use of TL for street-scale nuisance flood forecasting by exploring whether a ML model trained on data collected for one set of streets can effectively forecast flooding for another set of streets in the same city using TL. The envisioned use case is a city deploying a new flood depth monitoring sensor on a street and using TL to apply a ML model, trained on sensor data from an existing flood depth sensor network, to this new street. Eventually, the new flood depth sensor will have a sufficient dataset for training its own ML model, but TL can be used to fill the gap in time while this new dataset is being generated. This method is explored using a Long Short-Term Memory (LSTM) model trained on data for the flood-prone streets of Norfolk City, Virginia. The data used for training includes environmental time series (rainfall, tide), topographic features (Digital Elevation Model (DEM), Topographic Wetness Index (TWI), Depth To Water (DTW)), and street-scale flood depth time series obtained from a high-fidelity physics-based model, acting as a synthetic street-scale stream depth sensor dataset since actual stream depth sensor data is generally unavailable for most cities. A set of 180 flood-prone streets was used to train a base model, while another set of 180 flood-prone streets was used to re-train that model using different TL strategies. The results show that full-weight re-training proved most effective and minimal re-training of only the output layer was insufficient. The advantage of TL was most pronounced when target data was limited, meaning data collected at the new water depth sensor location included generally less than 18 flood events. As target data increased beyond 18 flood events, the benefit of TL diminished relative to training a ML model directly on the local flood events. These findings can assist cities as they implement street-scale flood sensing systems to create accurate forecasts for new sensing locations that do not yet have sufficient data records to train a local ML model.

Roy, Binata [Univ. of Virginia, Charlottesville, V↗

Experimental Investigation of Transition to Turbulence as Affected by Passing Wakes

Experimental results from a study of the effects of passing wakes upon laminar-to-turbulent transition in a low-pressure turbine passage are presented. The test section geometry is designed to simulate the effects of unsteady wakes resulting from rotor-stator interaction upon laminar-to-turbulent transition in turbine blade boundary layers and separated flow regions over suction surfaces. Single-wire, thermal anemometry techniques were used to measure time-resolved and phase-averaged, wall-normal profiles of velocity, turbulence intensity, and intermittency at multiple streamwise locations over the turbine airfoil suction surface. These data are compared to steady state, wake-free data collected in the same geometry to identify the effects of wakes upon laminar-to-turbulent transition. Results are presented for flows with a Reynolds number based on suction surface length and exit velocity of 50,000 and an approach flow turbulence intensity of 2.5 percent. From these data, the effects of passing wakes and associated increased turbulence levels and varying pressure gradients on transition and separation in the near-wall flow are presented. The results show that the wakes affect transition both by virtue of their difference in turbulence level from that of the free-stream but also by virtue of their velocity deficit relative to the freestream velocity, and the concomitant change in angle of attack and temporal pressure gradients. The results of this study seem to support the theory that bypass transition is a response of the near-wall viscous layer to pressure fluctuations imposed upon it from the free-stream flow. The data also show a significant lag between when the wake is present over the surface and when transition begins. The accompanying CD-ROM includes tabulated data, animations, higher resolution plots, and an electronic copy of this report.

Kaszeta, Richard W.↗

Experimental Investigation of Transition to Turbulence as Affected by Passing Wakes

Experimental results from a study of the effects of passing wakes upon laminar-to-turbulent transition in a low-pressure turbine passage are presented. The test section geometry is designed to simulate the effects of unsteady wakes resulting from rotor-stator interaction upon laminar-to-turbulent transition in turbine blade boundary layers and separated flow regions over suction surfaces. Single-wire, thermal anemometry techniques were used to measure time- resolved and phase-averaged, wall-normal profiles of velocity, turbulence intensity, and intermittency at multiple streamwise locations over the turbine airfoil suction surface. These data are compared to steady state, wake-free data collected in the same geometry to identify the effects of wakes upon laminar-to-turbulent transition. Results are presented for flows with a Reynolds number based on suction surface length and exit velocity of 50,000 and an approach flow turbulence intensity of 2.5 percent. From these data, the effects of passing wakes and associated increased turbulence levels and varying pressure gradients on transition and separation in the near-wall flow are presented. The results show that the wakes affect transition both by virtue of their difference in turbulence level from that of the free-stream but also by virtue of their velocity deficit relative to the freestream velocity, and the concomitant change in angle of attack and temporal pressure gradients. The results of this study seem to support the theory that bypass transition is a response of the near-wall viscous layer to pressure fluctuations imposed upon it from the free-stream flow. The data also show a significant lag between when the wake is present over the surface and when transition begins. The accompanying CD-ROM includes tabulated data, animations, higher resolution plots, and an electronic copy of this report.

Kaszeta, Richard W.↗

X-ray bright points and high-speed wind streams: A preliminary analysis from Yohkoh and Ulysses data

The following aspect of the solar wind mass flux, and of its variation, is examined: whether coronal plumes might be responsible for the long-term variability of the mass flux in high-speed streams emanating from coronal holes. The assumption that plumes are rooted in coronal bright points (BP's) is made. The behavior of X-ray BP's, imaged by the Yohkoh soft X-ray telescope (SXT), during a seven month period when Ulysses experiments observed a series of recurrent high-speed streams, is analyzed. If plumes/BP's are sources of the wind mass flux, changes in the coronal hole BP density to mimic changes of the mass flux in high-speed streams are expected. SOHO will have the capability of measuring the solar wind speed/density at small heliocentric distances while simultaneously observing coronal BP's and coronal plumes.

Poletto, Giannina↗