Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Use of satellite data in runoff forecasting in the heavily forested, cloud-covered Pacific Northwest

The author has identified the following significant results. Satellite-derived snow cover data improves forecasts of stream flow but not at a statistically significant amount and should not be used exclusively because of persistent cloud cover. Based upon reconstruction runs, satellite data can be used to augment snow-flight data in the Upper Snake, Boise, Dworshak, and Hungry Horse basins. Satellite data does not compare well with aerial snow-flight data in the Libby basin.

Dillard, J. P.↗

An Information Theoretic Framework and Self-organizing Agent- based Sensor Network Architecture for Power Plant Condition Monitoring

A central goal of the work was to enable both the extraction of all relevant information from sensor data, and the application of information gained from appropriate processing and fusion at the system level to operational control and decision-making at various levels of the control hierarchy through: 1. Exploiting the deep connection between information theory and the thermodynamic formalism, 2. Deployment using distributed intelligent agents with testing and validation in a hardware-in-the loop simulation environment. Enterprise architectures are the organizing logic for key business processes and IT infrastructure and, while the generality of current definitions provides sufficient flexibility, the current architecture frameworks do not inherently provide the appropriate structure. Of particular concern is that existing architecture frameworks often do not make a distinction between ``data'' and ``information.'' This work defines an enterprise architecture for health and condition monitoring of power plant equipment and further provides the appropriate foundation for addressing shortcomings in current architecture definition frameworks through the discovery of the information connectivity between the elements of a power generation plant. That is, to identify the correlative structure between available observations streams using informational measures. The principle focus here is on the implementation and testing of an emergent, agent-based, algorithm based on the foraging behavior of ants for eliciting this structure and on measures for characterizing differences between communication topologies. The elicitation algorithms are applied to data streams produced by a detailed numerical simulation of Alstom’s 1000 MW ultra-super-critical boiler and steam plant. The elicitation algorithm and topology characterization can be based on different informational metrics for detecting connectivity, e.g. mutual information and linear correlation.

20 FOSSIL-FUELED POWER PLANTS↗

New spectroscopic technique based on coaddition of surface brightness fluctuations: NGC 4449 and its stellar tidal stream

We present a new spectroscopic technique based in part on targeting the upward fluctuations of the surface brightness for studying the internal stellar kinematics and metallicities of galaxies of low surface brightness effects both to galaxies and streams beyond the Local Group. The distance to these systems makes them unsuitable for targeting individual red giant branch (RGB) stars (tip of RGB at I≳24 mag) and their surface brightness is too low (μ{sub r}≳25 mag arcsec{sup −2}) for integrated light spectroscopic measurements. This technique overcomes these two problems by targeting individual objects that are brighter than the tip of the RGB. We apply this technique to the star-forming dwarf galaxy NGC 4449 and its stellar stream. We use Keck/DEIMOS data to measure the line-of-sight radial velocity out to ∼7 kpc in the east side of the galaxy and ∼8 kpc along the stream. We find that the two systems are likely gravitationally bound to each other and have heliocentric radial velocities of 227.3 ± 10.7 km s{sup −1} and 225.8 ± 16.0 km s{sup −1}, respectively. Neither the stream nor the near half of the galaxy shows a significant velocity gradient. We estimate the stellar metallicity of the stream based on the equivalent width of its calcium triplet lines and find [Fe/H] = −1.37±0.41, which is consistent with the metallicity–luminosity relation for dwarf galaxies in the Local Group. Whether the stream's progenitor was moderately or severely stripped cannot be constrained with this uncertainty in metallicity. We demonstrate that this new technique can be used to measure the kinematics and (possibly) the metallicity of the numerous faint satellites and stellar streams in the halos of nearby (∼4 Mpc) galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Water survey of Canada: Application for use of ERTS-A for retransmission of water resources data

The author has identified the following significant results. Nine sites in isolated regions in Canada have been selected for installation of ERTS data collection platforms. Seven platforms were installed in 1972, one of which did not operate. The six operating platforms transmitted over 7000 water level readings from stream gauging stations. This data is available on a near real time basis through the Canada Center for Remote Sensing and is used for river flow forecasting. The practicability of using satellite retransmission as a means of obtaining data from remote areas has been demonstrated.

Halliday, R. A.↗

Synoptic Gulf Stream velocity profiles through simultaneous inversion of hydrographic and acoustic Doppler data

Data from a shipborne acoustic profiling device have been combined with conductivity, temperature, depth/O2 sections across the Gulf Stream to form estimates of the absolute flow fields. The procedure for the combination was a form of inverse method. The results suggest that at the time of the observations (June 1982) the net Gulf Stream transport off Hatteras was 107 + or - 11 Sv and that across a section near 72.5 W it had increased to 125 + or - 6 Sv. The transport of the deep western boundary current was 9 + or - 3 Sv. For comparison purposes an inversion was done using the hydrographic/O2 data alone as in previously published results and obtained qualitative agreement with the combined inversion. Inversion of the acoustic measurements alone, when corrected for instrument biases, leaves unacceptably large mass transport residuals in the deep water.

Joyce, T. M.↗

Velocity and temperature characteristics of two-stream, coplanar jet exhaust plumes

The subsonic jet exhaust velocity and temperature characteristics of model scale, two stream coplanar nozzles were obtained experimentally. The data obtained included the effects of fan to primary stream velocity and temperature ratios on the jet axial and radial flow characteristics. Empirical parameters were developed to correlate the measured data. The resultant equations were shown to be extensions of a previously published single stream jet velocity and temperature correlation.

Vonglahn, U. H.↗

Velocity and temperature characteristics of two-stream, coplanar jet exhaust plumes

The subsonic jet exhaust velocity and temperature characteristics of model scale, two stream coplanar nozzles were obtained experimentally. The data obtained included the effects of fan to primary stream velocity and temperature ratios on the jet axial and radial flow characteristics. Empirical parameters were developed to correlate the measured data. The resultant equations were shown to be extensions of a previously published single stream jet velocity and temperature correlation.

Von Glahn, U.↗

Boundary-layer Transition at High Reynolds Numbers as Obtained in Flight of a 20 Degree Cone-cylinder with Wall to Local Stream Temperature Ratios near 1.0

Boundary-layer transition data at low ratios of wall to local stream temperature have been obtained during the free flight of a highly polished cone-cylinder to a maximum Mach number of 5.02 A maximum transition Reynolds number of 32 x 10(exp 6) occurred at a distance of 25.84 inches from the cone apex. The temperature ratio at transition for a local Mach number of 4.0 was approximately 1.30 as compared with theoretical infinite stability solutions of 1.47 and 1.65 by Dunn and Lin (three-dimensional) and Van Driest (two-dimensional), respectively.

Rabb, Leaonard↗

MARCUS ARM CN and CCN data reprocessed to remove ship exhaust influence

The data presented in this collection are the cloud condensation nuclei (CCN) and condensation nuclei (CN) from the MARCUS (Measurements of Aerosols, Radiation and CloUds over the Southern Oceans) campaign. This campaign involved the deployment of the ARM Mobile Facility aboard the RSV Aurora Australis between October 2017 and March 2018 during its summer season resupplying Australia’s Antarctic research stations from its port in Hobart, Australia. Routine processing undertaken by ARM does not remove platform exhaust associated with its deployment aboard ships. Consequently, the raw data were obtained and manually filtered to remove the influence of platform exhaust on the measurements by reviewing CCN, CN and BC data simultaneously and flagging all affected periods. Remaining data were then quality controlled for when instrument parameters were out of specification. CCN data are split into different streams for supersaturation settings before statistics for each hour being calculated. All data files contain NaN values for periods when data was removed for QC or exhaust reasons. Original raw data available at: Kulkarni, G. R., Flynn, C. and Koontz, A.: Atmospheric Radiation Measurement (ARM) user facility. 2017, updated hourly. Cloud Condensation Nuclei Particle Counter (AOSCCN100). 2017-10-29 to 2018-03-24, ARM Mobile Facility (MAR) Hobart, AUS to Antarctic Coast - resupply ship Aurora Australis; AMF2 (M1)., Atmospheric Radiation Measurement (ARM) user facility Data Center: Oak Ridge, Tennessee, USA [online] Available from: http://dx.doi.org/10.5439/1227964 (Accessed 9 November 2018), 2018. Kuang, C., Salwen, C., Boyer, M. and Singh, A.: Atmospheric Radiation Measurement (ARM) user facility. 2017, updated hourly. Condensation Particle Counter (AOSCPCF). 2017-10-29 to 2018-03-26, ARM Mobile Facility (MAR) Hobart, AUS to Antarctic Coast - resupply ship Aurora Australis; AMF2 (M1)., Atmospheric Radiation Measurement (ARM) user facility Data Center: Oak Ridge, Tennessee, USA [online] Available from: http://dx.doi.org/10.5439/1046184 (Accessed 9 November 2018), 2018.

54 ENVIRONMENTAL SCIENCES↗

Vortex boundary-layer interactions

Parametric studies to identify a vortex generator were completed. Data acquisition in the first chosen configuration, in which a longitudinal vortex pair generated by an isolated delta wing starts to merge with a turbulent boundary layer on a flat plate fairly close to the leading edge is nearly completed. Work on a delta-wing/flat-plate combination, consisting of a flow visualization and hot wire measurements taken with a computer controlled traverse gear and data logging system were completed. Data taking and analysis have continued, and sample results for another cross stream plane are presented. Available data include all mean velocity components, second order mean products of turbulent fluctuations, and third order mean products. Implementation of a faster data logging system was accomplished.

Bradshaw, P.↗

Autonomous Byte Stream Randomizer

Net-centric networking environments are often faced with limited resources and must utilize bandwidth as efficiently as possible. In networking environments that span wide areas, the data transmission has to be efficient without any redundant or exuberant metadata. The Autonomous Byte Stream Randomizer software provides an extra level of security on top of existing data encryption methods. Randomizing the data s byte stream adds an extra layer to existing data protection methods, thus making it harder for an attacker to decrypt protected data. Based on a generated crypto-graphically secure random seed, a random sequence of numbers is used to intelligently and efficiently swap the organization of bytes in data using the unbiased and memory-efficient in-place Fisher-Yates shuffle method. Swapping bytes and reorganizing the crucial structure of the byte data renders the data file unreadable and leaves the data in a deconstructed state. This deconstruction adds an extra level of security requiring the byte stream to be reconstructed with the random seed in order to be readable. Once the data byte stream has been randomized, the software enables the data to be distributed to N nodes in an environment. Each piece of the data in randomized and distributed form is a separate entity unreadable on its own right, but when combined with all N pieces, is able to be reconstructed back to one. Reconstruction requires possession of the key used for randomizing the bytes, leading to the generation of the same cryptographically secure random sequence of numbers used to randomize the data. This software is a cornerstone capability possessing the ability to generate the same cryptographically secure sequence on different machines and time intervals, thus allowing this software to be used more heavily in net-centric environments where data transfer bandwidth is limited.

Paloulian, George K.↗

Evolution of a high-performance storage system based on magnetic tape instrumentation recorders

In order to provide transparent access to data in network computing environments, high performance storage systems are getting smarter as well as faster. Magnetic tape instrumentation recorders contain an increasing amount of intelligence in the form of software and firmware that manages the processes of capturing input signals and data, putting them on media and then reproducing or playing them back. Such intelligence makes them better recorders, ideally suited for applications requiring the high-speed capture and playback of large streams of signals or data. In order to make recorders better storage systems, intelligence is also being added to provide appropriate computer and network interfaces along with services that enable them to interoperate with host computers or network client and server entities. Thus, recorders are evolving into high-performance storage systems that become an integral part of a shared information system. Data tape has embarked on a program with the Caltech sponsored Concurrent Supercomputer Consortium to develop a smart mass storage system. Working within the framework of the emerging IEEE Mass Storage System Reference Model, a high-performance storage system that works with the STX File Server to provide storage services for the Intel Touchstone Delta Supercomputer is being built. Our objective is to provide the required high storage capacity and transfer rate to support grand challenge applications, such as global climate modeling.

Peters, Bruce↗

An integrated manifold learning approach for high-dimensional data feature extractions and its applications to online process monitoring of additive manufacturing

As an effective dimension reduction and feature extraction technique, manifold learning has been successfully applied to high-dimensional data analysis. With the rapid development of sensor technology, a large amount of high-dimensional data such as image streams can be easily available. Thus, a promising application of manifold learning is in the field of sensor signal analysis, particular for the applications of online process monitoring and control using high-dimensional data. The objective of this study is to develop a manifold learning-based feature extraction method for process monitoring of Additive Manufacturing (AM) using online sensor data. Due to the non-parametric nature of most existing manifold learning methods, their performance in terms of computational efficiency, as well as noise resistance has yet to be improved. To address this issue, this study proposes an integrated manifold learning approach termed multi-kernel metric learning embedded isometric feature mapping (MKML-ISOMAP) for dimension reduction and feature extraction of online high-dimensional sensor data such as images. Based on the extracted features with the utilization of supervised classification and regression methods, an online process monitoring methodology for AM is implemented to identify the actual process quality status. Finally, in the numerical simulation and real-world case studies, the proposed method demonstrates excellent performance in both prediction accuracy and computational efficiency.

36 MATERIALS SCIENCE↗

Automated Performance Characterization of DSN System Frequency Stability Using Spacecraft Tracking Data

This software provides an automated capability to measure and qualify the frequency stability performance of the Deep Space Network (DSN) ground system, using daily spacecraft tracking data. The results help to verify if the DSN performance is meeting its specification, therefore ensuring commitments to flight missions; in particular, the radio science investigations. The rich set of data also helps the DSN Operations and Maintenance team to identify the trends and patterns, allowing them to identify the antennas of lower performance and implement corrective action in a timely manner. Unlike the traditional approach where the performance can only be obtained from special calibration sessions that are both time-consuming and require manual setup, the new method taps into the daily spacecraft tracking data. This new approach significantly increases the amount of data available for analysis, roughly by two orders of magnitude, making it possible to conduct trend analysis with good confidence. The software is built with automation in mind for end-to-end processing. From the inputs gathering to computation analysis and later data visualization of the results, all steps are done automatically, making the data production at near zero cost. This allows the limited engineering resource to focus on high-level assessment and to follow up with the exceptions/deviations. To make it possible to process the continual stream of daily incoming data without much effort, and to understand the results quickly, the processing needs to be automated and the data summarized at a high level. Special attention needs to be given to data gathering, input validation, handling anomalous conditions, computation, and presenting the results in a visual form that makes it easy to spot items of exception/ deviation so that further analysis can be directed and corrective actions followed.

Pham, Timothy T.↗

Automated Performance Characterization of DSN System Frequency Stability Using Spacecraft Tracking Data

This software provides an automated capability to measure and qualify the frequency stability performance of the Deep Space Network (DSN) ground system, using daily spacecraft tracking data. The results help to verify if the DSN performance is meeting its specification, therefore ensuring commitments to flight missions; in particular, the radio science investigations. The rich set of data also helps the DSN Operations and Maintenance team to identify the trends and patterns, allowing them to identify the antennas of lower performance and implement corrective action in a timely manner. Unlike the traditional approach where the performance can only be obtained from special calibration sessions that are both time-consuming and require manual setup, the new method taps into the daily spacecraft tracking data. This new approach significantly increases the amount of data available for analysis, roughly by two orders of magnitude, making it possible to conduct trend analysis with good confidence. The software is built with automation in mind for end-to-end processing. From the inputs gathering to computation analysis and later data visualization of the results, all steps are done automatically, making the data production at near zero cost. This allows the limited engineering resource to focus on high-level assessment and to follow up with the exceptions/deviations. To make it possible to process the continual stream of daily incoming data without much effort, and to understand the results quickly, the processing needs to be automated and the data summarized at a high level. Special attention needs to be given to data gathering, input validation, handling anomalous conditions, computation, and presenting the results in a visual form that makes it easy to spot items of exception/deviation so that further analysis can be directed and corrective actions followed.

Pham, Timothy T.↗

High-Speed Data Recorder for Space, Geodesy, and Other High-Speed Recording Applications

A high-speed data recorder and replay equipment has been developed for reliable high-data-rate recording to disk media. It solves problems with slow or faulty disks, multiple disk insertions, high-altitude operation, reliable performance using COTS hardware, and long-term maintenance and upgrade path challenges. The current generation data recor - ders used within the VLBI community are aging, special-purpose machines that are both slow (do not meet today's requirements) and are very expensive to maintain and operate. Furthermore, they are not easily upgraded to take advantage of commercial technology development, and are not scalable to multiple 10s of Gbit/s data rates required by new applications. The innovation provides a softwaredefined, high-speed data recorder that is scalable with technology advances in the commercial space. It maximally utilizes current technologies without being locked to a particular hardware platform. The innovation also provides a cost-effective way of streaming large amounts of data from sensors to disk, enabling many applications to store raw sensor data and perform post and signal processing offline. This recording system will be applicable to many applications needing realworld, high-speed data collection, including electronic warfare, softwaredefined radar, signal history storage of multispectral sensors, development of autonomous vehicles, and more.

Taveniku, Mikael↗

20 Year Daily Average Modeled Velocity and Discharge for Openwater Season at Five Communities on Kuskokwim River, Alaska

This dataset includes modeled velocity and discharge at five communities in the middle Kuskokwim River region: Aniak, Chuathbaluk, Crooked Creek, Red Devil and Stony River. Modeled velocities and discharge represent daily averages calculated for the openwater season (OWS) from June 1 - October 18 over the 20 year period 2000-2019 using the raw data described below and included in this archive; full details of methodology are described in (Brown et al. submitted to Renewable Energy). Raw data inputs to inform the modeling process include in-situ measurements of 1) discharge with an acoustic Doppler current meter (ADCP, 600kHz Workhorse Rio Grande by Teledyne RD Instruments) and a global positioning receiver (GPS, Trimble 5700, 5800 and R8) utilizing Real Time Kinematic (RTK) GPS mode over 1-2 days at each site in 2009 or 2010 (Ravens 2014), and 2) river stage with a water level logger (HOBO U20-001-01 by Onset) over 2-9 weeks at each site (Ravens 2014), 3) in addition to a 20 year long-term discharge record collected at the USGS stream gage site in Crooked Creek (USGS 2016). Raw data (discharge and stage) are included in this archive for two additional communities: Lower Kalskag and Sleetmute, where modeled velocities were not calculated due to equipment failure or loss. The USGS stream gage data at Crooked Creek (USGS 2016) and stream gage methodology (Turnipseed and Sauer 2010) are publicly available online, so the data are not duplicated here.

16 TIDAL AND WAVE POWER↗

Streaming Analytics for Anomaly Detection in Large-Scale Data

Anomalous behavior poses serious risks to assured performance and reliability of complex, high-consequence systems. For spaceborne assets and their state-of-health (SOH) telemetry, the challenges of high-dimensional data of varying data types are compounded by computational limitations from size, weight, and power (SWaP) constraints as well as data availability. Automated anomaly detection methods tend to perform poorly under these constraints, while current operational approaches can introduce delays in response time due to the manual, retrospective processes for understanding system failures. As a result, presently deployed space systems, and those deployed in the near future, face situations where mission operations might be delayed or only be able to operate under degraded capabilities. Here, we examine a near-term lightweight solution that provides real-time detection capabilities for rare events and assess state-of-the-art anomaly detection techniques against real SOH telemetry from space platforms. This report describes our methodology and research, which could support more automated capabilities for comprehensive space operations as well as for other resource-constrained edge applications.

97 MATHEMATICS AND COMPUTING↗