Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Global Landslide Forecasting System for Hazard Assessment and Situational Awareness

Landslides triggered by extreme rainfall can be devastating, resulting in loss of life, property, and infrastructure. Landslide forecasting systems provide an opportunity to build awareness of potential hazards and ultimately take preemptive measures. There is currently a dearth of forecasting systems that provide regional or global coverage, but these systems can offer important situational awareness in data-sparse, ungauged, or large-scale catchments. A near global, primarily satellite-based system calledthe Landslide Hazard Assessment for Situational Awareness (LHASA) provides near real-time estimates of potential landslide hazard and exposure around the world. In this work, a precipitation forecast module is introduced into LHASA to complement the existing LHASA framework and provide an estimate of landslide hazard up to three days in advanceat 1km resolution. The model-based Goddard Earth Observing System-Forward Processing (GEOS-FP) precipitation forecast product is used as the forcing input for the model in place of the satellite-based Integrated Multi-satellitE Retrievals for Global Precipitation Mission product. Soil moisture and snow depth from the GEOS-FP assimilated product are also incorporated. The study period January 2020–January 2021 is usedto test the model performance against the LHASA near real-time estimates at multiple spatiotemporal scales. Validation of the model is carried out using a collection of rainfall-triggered landslide inventories from around the world as case studies to demonstrate the potential utility and limitations of this system.The rescaling of the GEOS-FP precipitation product is a critical step in incorporating the forecasted precipitation data within LHASA-Forecast (LHASA-F). Combining different streams of forecasted data within the LHASA-F framework shows promise, particularly for larger events at the 1-and 2-day lead time for events. Results indicate that for the case studies evaluated, the LHASA-F is generally able to resolve major landslide events triggered by extreme rainfall, such as from tropical cyclones. The analysis shows that landslide forecast outputs may be represented differently depending on the user’s needs. This framework serves as a first milestone in providing a global predictive view of landslide hazard.

Landslide forecasting system↗

Vis-SAGA: Visual Analytics for Situational Awareness of Grid Anomalies: Preprint

We describe supporting near real-time situational awareness of the electric distribution system by visualizing novel data from voltage sensors deployed on existing broadband cable television network equipment. Our scalable web-based visual analytics platform supports interactive geospatial exploration, time-series analysis, and summarization of grid behavior during potentially anomalous events. The broadband cable television sensor network provides observability of the electrical distribution system at a higher local spatial resolution than is typically available to most utilities, revealing the operational state of the network and aiding in the detection of abnormal behaviors or deviations from expected patterns, particularly across electric utility service areas. We outline the design and development of interactive geospatial and time-series visualization components and the scalable data services that supply metadata, historical, and real-time streams of sensor data across the network. We evaluate our platform during periods of extreme weather, demonstrating its ability to assist in detecting patterns of operation that affect power availability, quality, resiliency, and service restoration.

cable television↗

Pitot pressure measurements in flow fields behind circular-arc nozzles with exhaust jets at subsonic free-stream Mach numbers

The flow field behind a circular arc nozzle with exhaust jet was studied at subsonic free stream Mach numbers. A conical probe was used to measure the pitot pressure in the jet and free stream regions. Pressure data were recorded for two nozzle configurations at nozzle pressure ratios of 2.0, 2.9, and 5.0. At each set of test conditions, the probe was traversed from the jet center line into the free stream region at seven data acquisition stations. The survey began at the nozzle exit and extended downstream at intervals. The pitot pressure data may be applied to the evaluation of computational flow field models, as illustrated by a comparison of the flow field data with results of inviscid jet plume theory.

Mason, M. L.↗

The radial evolution of the bulk properties of the solar wind

Simultaneous solar-wind proton data obtained at several heliocentric distances during radial alignments are compared. The radial variations associated with two high-speed streams in the solar wind are studied as examples of the radial evolution of the solar-wind speed distribution and of high-speed streams in the solar wind as observed in the ecliptic plane in 1973. Pioneer 11 data on high-speed streams in the solar wind observed at about 1.5 and 3.7 AU are compared with the corresponding high-speed-stream data obtained at earth. These analyses indicate that as these high-speed streams propagated to these extended heliocentric distances, there was an erosion of the highest speeds and a general narrowing of the speed distribution. These observations are consistent with the exchange of momentum in the solar wind between high-speed streams and low-speed streams as they propagate outward from the sun.

Intriligator, D. S.↗

PlanetSense: A Real-time Streaming and Spatio-temporal Analytics Platform for Gathering Geo-spatial Intelligence from Open Source Data

Geospatial intelligence has traditionally relied on the use of archived and unvarying data for planning and exploration purposes. In consequence, the tools and methods that are architected to provide insight and generate projections only rely on such datasets. Albeit, if this approach has proven effective in several cases, such as land use identification and route mapping, it has severely restricted the ability of researchers to inculcate current information in their work. This approach is inadequate in scenarios requiring real-time information to act and to adjust in ever changing dynamic environments, such as evacuation and rescue missions. In this work, we propose PlanetSense, a platform for geospatial intelligence that is built to harness the existing power of archived data and add to that, the dynamics of real-time streams, seamlessly integrated with sophisticated data mining algorithms and analytics tools for generating operational intelligence on the fly. The platform has four main components – i) GeoData Cloud – a data architecture for storing and managing disparate datasets; ii) Mechanism to harvest real-time streaming data; iii) Data analytics framework; iv) Presentation and visualization through web interface and RESTful services. Using two case studies, we underpin the necessity of our platform in modeling ambient population and building occupancy at scale.

big data architecture↗

The nature and orbit of the Ophiuchus stream

The Ophiuchus stream is a recently discovered stellar tidal stream in the Milky Way. We present high-quality spectroscopic data for 14 stream member stars obtained using the Keck and MMT telescopes. We confirm the stream as a fast moving (v{sub los} ∼ 290 km s{sup −1}), kinematically cold group (σ{sub v{sub l{sub o{sub s}}}}≲1 km s{sup −1}) of α-enhanced and metal-poor stars ([α/Fe] ∼ 0.4 dex, [Fe/H] ∼ −2.0 dex). Using a probabilistic technique, we model the stream simultaneously in line-of-sight velocity, color–magnitude, coordinate, and proper motion space, and so determine its distribution in 6D phase-space. We find that the stream extends in distance from 7.5 to 9 kpc from the Sun; it is 50 times longer than wide, merely appearing highly foreshortened in projection. The analysis of the stellar population contained in the stream suggests that it is ∼12 Gyr old, and that its initial stellar mass was ∼2 × 10{sup 4} M{sub ⊙} (or at least ≳7 × 10{sup 3} M{sub ⊙}). Assuming a fiducial Milky Way potential, we fit an orbit to the stream that matches the observed phase-space distribution, except for some tension in the proper motions: the stream has an orbital period of ∼350 Myr, and is on a fairly eccentric orbit (e ∼ 0.66) with a pericenter of ∼3.5 kpc and an apocenter of ∼17 kpc. The phase-space structure and stellar population of the stream show that its progenitor must have been a globular cluster that was disrupted only ∼240 Myr ago. We do not detect any significant overdensity of stars along the stream that would indicate the presence of a progenitor, and conclude that the stream is all that is left of the progenitor.

79 ASTRONOMY AND ASTROPHYSICS↗

F3D Image Processing and Analysis for Many - and Multi-core Platforms

F3D is written in OpenCL, so it achieve[sic] platform-portable parallelism on modern mutli-core CPUs and many-core GPUs. The interface and mechanims to access F3D core are written in Java as a plugin for Fiji/ImageJ to deliver several key image-processing algorithms necessary to remove artifacts from micro-tomography data. The algorithms consist of data parallel aware filters that can efficiently utilizes[sic] resources and can work on out of core datasets and scale efficiently across multiple accelerators. Optimizing for data parallel filters, streaming out of core datasets, and efficient resource and memory and data managements over complex execution sequence of filters greatly expedites any scientific workflow with image processing requirements. F3D performs several different types of 3D image processing operations, such as non-linear filtering using bilateral filtering and/or median filtering and/or morphological operators (MM). F3D gray-level MM operators are one-pass constant time methods that can perform morphological transformations with a line-structuring element oriented in discrete directions. Additionally, MM operators can be applied to gray-scale images, and consist of two parts: (a) a reference shape or structuring element, which is translated over the image, and (b) a mechanism, or operation, that defines the comparisons to be performed between the image and the structuring element. This tool provides a critical component within many complex pipelines such as those for performing automated segmentation of image stacks. F3D is also called a "descendent" of Quant-CT, another software we developed in the past. These two modules are to be integrated in a next version. Further details were reported in: D.M. Ushizima, T. Perciano, H. Krishnan, B. Loring, H. Bale, D. Parkinson, and J. Sethian. Structure recognition from high-resolution images of ceramic composites. IEEE International Conference on Big Data, October 2014.

Source record↗

F3D Image Processing and Analysis for Many - and Multi-core Platforms

F3D is written in OpenCL, so it achieve[sic] platform-portable parallelism on modern mutli-core CPUs and many-core GPUs. The interface and mechanims to access F3D core are written in Java as a plugin for Fiji/ImageJ to deliver several key image-processing algorithms necessary to remove artifacts from micro-tomography data. The algorithms consist of data parallel aware filters that can efficiently utilizes[sic] resources and can work on out of core datasets and scale efficiently across multiple accelerators. Optimizing for data parallel filters, streaming out of core datasets, and efficient resource and memory and data managements over complex execution sequence of filters greatly expedites any scientific workflow with image processing requirements. F3D performs several different types of 3D image processing operations, such as non-linear filtering using bilateral filtering and/or median filtering and/or morphological operators (MM). F3D gray-level MM operators are one-pass constant time methods that can perform morphological transformations with a line-structuring element oriented in discrete directions. Additionally, MM operators can be applied to gray-scale images, and consist of two parts: (a) a reference shape or structuring element, which is translated over the image, and (b) a mechanism, or operation, that defines the comparisons to be performed between the image and the structuring element. This tool provides a critical component within many complex pipelines such as those for performing automated segmentation of image stacks. F3D is also called a "descendent" of Quant-CT, another software we developed in the past. These two modules are to be integrated in a next version. Further details were reported in: D.M. Ushizima, T. Perciano, H. Krishnan, B. Loring, H. Bale, D. Parkinson, and J. Sethian. Structure recognition from high-resolution images of ceramic composites. IEEE International Conference on Big Data, October 2014.

Source record↗

Ice Flow in the North East Greenland Ice Stream

Early observations with ERS-1 SAR image data revealed a large ice stream in North East Greenland (Fahnestock 1993). The ice stream has a number of the characteristics of the more closely studied ice streams in Antarctica, including its large size and gross geometry. The onset of rapid flow close to the ice divide and the evolution of its flow pattern, however, make this ice stream unique. These features can be seen in the balance velocities for the ice stream (Joughin 1997) and its outlets. The ice stream is identifiable for more than 700 km, making it much longer than any other flow feature in Greenland. Our research goals are to gain a greater understanding of the ice flow in the northeast Greenland ice stream and its outlet glaciers in order to assess their impact on the past, present, and future mass balance of the ice sheet. We will accomplish these goals using a combination of remotely sensed data and ice sheet models. We are using satellite radar interferometry data to produce a complete maps of velocity and topography over the entire ice stream. We are in the process of developing methods to use these data in conjunction with existing ice sheet models similar to those that have been used to improve understanding of the mechanics of flow in Antarctic ice streams.

Joughin, Ian↗

HPC ODA Commons [SWR-26-003]

HPC ODA Commons is a community-driven platform for standardizing HPC operational data analytics. HPC sites generate enormous volumes of operational data - scheduler logs, accounting records, monitoring streams - but turning that data into actionable insight is needlessly hard. Each site builds bespoke parsers, schemas, and evaluation pipelines. Results can't be compared across institutions. Promising analytics ideas stay siloed because there's no shared language for describing the data, the experiments, or the outcomes. HPC ODA Commons fixes this by establishing community-governed contracts - versioned schemas, canonical artifacts, and benchmark recipes - that make ODA workflows discoverable, reproducible, and comparable. It pairs these standards with a practical, CLI-first toolkit that lets operators and researchers go from raw logs to standardized results without sending data off-cluster.

Menear, Kevin [National Laboratory of the Rockies ↗

Experimental investigation of shock-cell noise reduction for single-stream nozzles in simulated flight, comprehensive data report. Volume 2: Laser velocimeter data

Mean velocity (axial component) and turbulent velocity (axial component) measurements for thirty one selected flow conditions of six models were performed employing the Laser Doppler Velocimeter Aerodynamic conditions which define the test points are given. Tabulations which explain the scope of mean velocity traverses and turbulence histogram measurements are also presented. The actual LV position, the type of traverse, and measured mean and turbulent velocities along copies of the LV mean velocity traces are contained.

Yamamoto, K.↗

Experimental investigation of shock-cell noise reduction for single-stream nozzles in simulated flight, comprehensive data report. Volume 3: Shadowgraph photos and facility description

A total of 142 shadowgraph photographs were taken on 43 different plumes that were distributed over the six nozzle configurations using the 9.5 inch diameter collimated light beam of the shadowgraph setup. Aerodynamic flow conditions of the shadowgraph test points, the location and identification of each of the photographs, and copies of the pictures are presented.

Yamamoto, K.↗

The crush of new earth science data knocking at our door

The reasons for collecting massive amounts of earth science data in the Earth Observing System (EOS) Project are discussed. A processing hierarchy for handling the data is described, and the prospects for adequate throughput and storage for operational data analysis in the EOS era are addressed. Needs for successful exploratory data analysis are examined, and the policy issues implicated by the large stream of EOS data are considered.

Kahn, Ralph↗