Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

A LiDAR–optical data fusion approach for identifying and measuring small stream impoundments and dams

This article outlines a semi-autonomous approach for using a fusion of light detection and ranging (LiDAR) and optical remote sensing data to identify and measure small impoundments (SIs) and their dams. Quantifying such water bodies as hydrologic network features is critical for ecosystem and species conservation, emergency management, and water resource planning; however, such features are incompletely mapped at national and state levels. By merging an airborne LiDAR-derived point cloud with a normalized water index using airborne optical imagery we demonstrate an improvement upon single-source methods for identifying these water bodies; classification accuracies increased over 10% by using this multi-source fusion method. Furthermore, the method presented here illustrates a cost-effective pathway to improve the National Inventory of Dams (NID) and includes a framework for estimating dam heights, with results showing strong correlations between derived dam heights and those recorded in the NID (r=.78). With the steady increase in available LiDAR coverage, the 87,000+ dams in the NID could be updated using this technique, a method which could also be expanded for global inventories of SIs and dams.

47 OTHER INSTRUMENTATION↗

Skyfall: Signal Fusion from a Smartphone Falling from the Stratosphere

A smartphone plummeted from a stratospheric height of 36 km, providing a near-real-time record of its rapid descent and ground impact. An app recorded and streamed useful internal multi-sensor data at high sample rates. Signal fusion with external and internal sensor systems permitted a more detailed reconstruction of the Skyfall chronology, including its descent speed, rotation rate, and impact deceleration. Our results reinforce the potential of smartphones as an agile and versatile geophysical data collection system for environmental and disaster monitoring IoT applications. We discuss mobile environmental sensing capabilities and present a flexible data model to record and stream signals of interest. The Skyfall case study can be used as a guide to smartphone signal processing methods that are transportable to other hardware platforms and operating systems.

47 OTHER INSTRUMENTATION↗

Overexpanded Performance of Conical Nozzles with Area Ratios of 6 and 9 With and Without Supersonic External Flow

An investigation of the thrust characteristics and internal pressure distributions of two convergent-divergent 15 deg. half-angle exhaust nozzles having area ratios of 6 and 9 was made in the NASA Lewis 10- by 10-foot supersonic wind tunnel. The tests were conducted at free-stream Mach numbers of 0, 2.0, 2.5, 3.0, and 3.5 over a range of nozzle pressure ratios from 3 to 105. Attempts were made to induce separation of the overexpanded nozzle flow using secondary airflow and a wedge. Nozzle flow expansion under all free-stream conditions followed one-dimensional theory until separation from the nozzle wall occurred. In quiescent air the nozzle flow expanded to a pressure approximately one-half the base pressure before separation. When the nozzles were tested with supersonic external flow at the same effective pressure ratios, the nozzle flow separated with negligible expansion below the base pressure. The effect of a supersonic stream on internal nozzle flow separation characteristics was well defined only at a free-stream Mach number of 2.0. Thrust data at supersonic free-stream conditions indicate that only a small percentage of the ideal nozzle thrust will be available at nozzle pressure ratios below design. However, the overexpanded primary nozzle thrust loss was decreased by injecting large quantities of secondary air near the nozzle exit. In most cases no net gain in thrust resulted from secondary-air injection when the nozzle thrust was compared with the ideal thrust of both the primary and secondary airflows.

Musial, Norman T.↗

Schneider Springs Fire Study 2023 for Ecosystem Respiration Rates: Surface Water Chemistry and Hydrologic Sensor Data across the Yakima River Basin, Washington, USA (v2)

This dataset supports a broader study examining the drivers of spatial variability in wildfire impacts across the Yakima River Basin. Data provided within this dataset were generated from sample collection across 17 total sites (8 sites affected by a recent wildfire, 9 sites unaffected by a recent wildfire) within multiple rivers throughout the Yakima River Basin in Washington, USA from May-July 2023. Fire affected sites are defined as those affected by the 2021 Schneider Springs Fire, based on the drainage area of the streams being within the 2021 Schneider Springs Fire burn perimeter or not (Figure 1, below). The contents include surface water geochemistry data (dissolved organic carbon; total dissolved nitrogen; total suspended solids); short-term sonde data (specific conductivity; turbidity; pH; chlorophyll A; temperature); stream depth data; stream velocity; manual chamber open channel respiration data; sensor time-series data (oxygen; water pressure; barometric pressure); field metadata (including qualitative information on in stream and river corridor characteristics); and environmental context photos taken in the field. The dataset also includes a summary file of the sensor data and plots of the sensor data. Sensors were only recovered at 15 out of the 17 sites, and not all sensors were recovered at all 15 sites (see Methods section for more details), therefore all data does not exist at all sites. Data from a 2022 study at the same sites, as well as additional sites, can be found at https://data.ess-dive.lbl.gov/view/doi:10.15485/1969566. The data package was originally published in November 2023. It was updated in June 2025 (v2; modified files). See the change history section in the readme for more details. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. This dataset is comprised of one folder with field photos and one main data folder with two subfolders. The main data folder consists of (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) field protocol; (5) readme; (6) international generic sample number (IGSN) mapping file; and (7) stream depth and averages. The sensor data subfolder consists of (1) sensor installation methods summary; (2) stream velocity; and (3) six subfolders. The BarotrollAtm (barometric pressure; temperature), DepthHOBO (water pressure; temperature), MantaRiver (specific conductivity; turbidity; pH; chlorophyll A; temperature), EXO (specific conductivity; pH; temperature), miniDOT (dissolved oxygen; temperature), and miniDOTManualChamber (dissolved oxygen; temperature) contain time-series data, plots, and summary files. The sample data subfolder consists of (1) total suspended solids (TSS) data; (2) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (3) total dissolved nitrogen (TN) data and averages; and (4) methods codes. All files are .csv, .pdf, .jpg, .jpeg, or .mov.

54 ENVIRONMENTAL SCIENCES↗

Detection and interpretation of ocean roughness variations across the Gulf Stream inferred from radar cross section observations

Radar cross section data shows that the Gulf Stream has a higher cross section per unit area (interpreted here as a greater roughness) than the water on the continental shelf. A steep gradient in cross section was often seen at the expected location of the western boundary. There were also longer-scale (10-20 km) gradual fluctuations within the stream of significant magnitude. These roughness variations are correlated with the surface shear stress that the local wind imposes on the sea. Using the available surface-truth information concerning the wind speed and direction, an assumed Gulf Stream velocity profile, and high-resolution ocean-surface temperature data obtained by the VHRR onboard a NOAA-NESS polar-orbiting satellite, the present study demonstrates that the computed surface stress variation bears a striking resemblance to the measured radar cross-section variations.

Weissman, D. E.↗

Autonomous Anomaly Detection For Continuous Streams

The code implements the Isolation Forest (IFML) algorithm within the digital twin (DT) of the AGN-201 nuclear reactor. The DT captures real-time operational data including control rod positions, reactor power, and temperature. The IFML model isolates anomalies by detecting patterns that deviate from expected operational behavior. The algorithm recursively partitions the data and assigns anomaly scores based on the isolation of rare and different events. By tuning parameters specific to the reactor’s operational data, the IFML identifies deviations such as unauthorized material insertions or reactor reactivity shifts. The system streams data using LabView and integrates with the DeepLynx data warehouse for anomaly processing.

Trevino, Eduardo↗

The Role of Snowmelt and Subsurface Heterogeneity in Headwater Hydrology of a Mountainous Catchment in Colorado: A Model‐Data Integration Approach

Mountainous headwater streams are sustained by both snowmelt‐driven streamflow and groundwater discharge in the Upper Colorado River Basin. However, predicting headwater stream discharge magnitude and peak flow timing is challenging in mountainous terrains, where snowmelt rates vary with vegetation type and elevation, and heterogeneous subsurface physical properties influence groundwater storage and its release. We used a model‐data integration approach to investigate the roles of snowmelt and subsurface structure in stream discharge and groundwater level. We ran an ensemble of 100 integrated surface‐subsurface hydrologic models for a mountainous headwater catchment near Crested Butte, Colorado, USA. We also evaluated and calibrated these models against observed data sets, including snow depth measurements using distributed temperature probes, stream discharge, and groundwater levels. Calibration with multiple data sources using neural density estimators has further constrained uncertainty in subsurface properties and snowmelt rates. Results indicated that observed slower snowmelt rates in evergreen forests delayed the peak flow and baseflow onset. In upstream areas with lower subsurface permeability, water was stored within the subsurface but was not released as interflow or shallow groundwater flow, and thereby not contributing to downstream streamflow during recession limb periods. Double peaks in groundwater occurred in areas with spatial subsurface heterogeneity, in our case due to the contrast between granodiorite and Mancos shale. These process‐based insights into groundwater and snowmelt dynamics in mountainous headwaters will help improve predictions of headwater hydrology.

Wang, Lijing [University of Connecticut, Storrs, C↗

Real-time streaming tomographic reconstruction with on-demand data capturing and 3D zooming to regions of interest

Complex dynamic tomographic experiments at brilliant X-ray light sources require real-time feedback on the sample changes with respect to environmental conditions, selecting representative regions of interest for high-resolution scanning, and on-demand data saving mechanisms for storing only relevant projections acquired by fast area detectors and reducing data volumes. Here the implementation details of a 3D real-time imaging monitoring instrument, with zooming to a volume of interest with easy-to-use visualization via ImageJ , a tool familiar to most beamline users, is presented. The instrument relies on optimized data flow between the detector and processing machines and is implemented on commodity computers. The instrument has been developed at beamline 2-BM of the Advanced Photon Source, where the automatic lens changing mechanism for zooming is implemented with an Optique Peter microscope. Performance tests demonstrate the ability to process more than 3 GB of projection data per second and generate real-time 3D zooming with different magnification. These new capabilities are essential for new APS Upgrade instruments such as the projection microscope under development at beamline 32-ID. The efficacy of the proposed instrument was demonstrated during an in situ tomographic experiment on ice and gas hydrate formation in porous samples.

3D zooming↗

Insights from Smart Meters: The Potential for Peak-Hour Savings from Behavior-Based Programs

The rollout of smart meters in the last several years has opened up new forms of previously unavailable energy data. Many utilities are now able in real-time to capture granular, household level interval usage data at very high-frequency levels for a large proportion of their residential and small commercial customer population. This can be linked to other time and locationspecific information, providing vast, constantly growing streams of rich data (sometimes referred to by the recently popular buzz word, “big data”). Within the energy industry there is increasing interest in tapping into the opportunities that these data can provide.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Relationship Between Satellite-Derived Snow Cover and Snowmelt-Runoff Timing and Stream Power in the Wind River Range, Wyoming

Earlier onset of springtime weather including earlier snowmelt has been documented in the western United States over at least the last 50 years. Because the majority (>70%) of the water supply in the western U.S. comes from snowmelt, analysis of the declining spring snowpack (and shrinking glaciers) has important implications for streamflow management. The amount of water in a snowpack influences stream discharge which can also influence erosion and sediment transport by changing stream power, or the rate at which a stream can do work such as move sediment and erode the stream bed. The focus of this work is the Wind River Range (WRR) in west-central Wyoming. Ten years of Moderate-Resolution Imaging Spectroradiometer (MODIS) snow-cover, cloud- gap-filled (CGF) map products and 30 years of discharge and meteorological station data are studied. Streamflow data from six streams in the WRR drainage basins show lower annual discharge and earlier snowmelt in the decade of the 2000s than in the previous three decades, though no trend of either lower streamflow or earlier snowmelt was observed using MODIS snow-cover maps within the decade of the 2000s. Results show a statistically-significant trend at the 95% confidence level (or higher) of increasing weekly maximum air temperature (for three out of the five meteorological stations studied) in the decade of the 1970s, and also for the 40-year study period. MODIS-derived snow cover (percent of basin covered) measured on 30 April explains over 89% of the variance in discharge for maximum monthly streamflow in the decade of the 2000s using Spearman rank correlation analysis. We also investigated stream power for Bull Lake Creek Above Bull Lake from 1970 to 2009; a statistically-significant end toward reduced stream power was found (significant at the 90% confidence level). Observed changes in streamflow and stream power may be related to increasing weekly maximum air temperature measured during the 40-year study period. The strong relationship between percent of basin covered and streamflow indicates that MODIS data is useful for predicting streamflow, leading to improved reservoir management

Hall, Dorothy K.↗

Wireless Sensor Network Handles Image Data

To relay data from remote locations for NASA s Earth sciences research, Goddard Space Flight Center contributed to the development of "microservers" (wireless sensor network nodes), which are now used commercially as a quick and affordable means to capture and distribute geographical information, including rich sets of aerial and street-level imagery. NASA began this work out of a necessity for real-time recovery of remote sensor data. These microservers work much like a wireless office network, relaying information between devices. The key difference, however, is that instead of linking workstations within one office, the interconnected microservers operate miles away from one another. This attribute traces back to the technology s original use: The microservers were originally designed for seismology on remote glaciers and ice streams in Alaska, Greenland, and Antarctica-acquiring, storing, and relaying data wirelessly between ground sensors. The microservers boast three key attributes. First, a researcher in the field can establish a "managed network" of microservers and rapidly see the data streams (recovered wirelessly) on a field computer. This rapid feedback permits the researcher to reconfigure the network for different purposes over the course of a field campaign. Second, through careful power management, the microservers can dwell unsupervised in the field for up to 2 years, collecting tremendous amounts of data at a research location. The third attribute is the exciting potential to deploy a microserver network that works in synchrony with robotic explorers (e.g., providing ground truth validation for satellites, supporting rovers as they traverse the local environment). Managed networks of remote microservers that relay data unsupervised for up to 2 years can drastically reduce the costs of field instrumentation and data rec

Source record↗

Insights from Smart Meters: The Potential for Peak-Hour Savings from Behavior-Based Programs

The rollout of smart meters in the last several years has opened up new forms of previously unavailable energy data. Many utilities are now able in real-time to capture granular, household-level interval usage data at very high-frequency levels for a large proportion of their residential and small commercial customer population. This can be linked to other time and location-specific information, providing vast, constantly growing streams of rich data (sometimes referred to by the recently popular buzz word, “big data”). Within the energy industry there is increasing interest in tapping into the opportunities that these data can provide.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Feature Acquisition with Imbalanced Training Data

This work considers cost-sensitive feature acquisition that attempts to classify a candidate datapoint from incomplete information. In this task, an agent acquires features of the datapoint using one or more costly diagnostic tests, and eventually ascribes a classification label. A cost function describes both the penalties for feature acquisition, as well as misclassification errors. A common solution is a Cost Sensitive Decision Tree (CSDT), a branching sequence of tests with features acquired at interior decision points and class assignment at the leaves. CSDT's can incorporate a wide range of diagnostic tests and can reflect arbitrary cost structures. They are particularly useful for online applications due to their low computational overhead. In this innovation, CSDT's are applied to cost-sensitive feature acquisition where the goal is to recognize very rare or unique phenomena in real time. Example applications from this domain include four areas. In stream processing, one seeks unique events in a real time data stream that is too large to store. In fault protection, a system must adapt quickly to react to anticipated errors by triggering repair activities or follow- up diagnostics. With real-time sensor networks, one seeks to classify unique, new events as they occur. With observational sciences, a new generation of instrumentation seeks unique events through online analysis of large observational datasets. This work presents a solution based on transfer learning principles that permits principled CSDT learning while exploiting any prior knowledge of the designer to correct both between-class and withinclass imbalance. Training examples are adaptively reweighted based on a decomposition of the data attributes. The result is a new, nonparametric representation that matches the anticipated attribute distribution for the target events.

Thompson, David R.↗

Relationship Between Satellite-Derived Snow Cover and Snowmelt-Runoff Timing and Stream Power in the Wind River Range, Wyoming

Earlier onset of springtime weather including earlier snowmelt has been documented in the western United States over at least the last 50 years. Because the majority (>70%) of the water supply in the western U.S. comes from snowmelt, analysis of the declining spring snowpack (and shrinking glaciers) has important implications for streamflow management. The amount of water in a snowpack influences stream discharge which can also influence erosion and sediment transport by changing stream power, or the rate at which a stream can do work such as move sediment and erode the stream bed. The focus of this work is the Wind River Range (WRR) in west-central Wyoming. Ten years of Moderate-Resolution Imaging Spectroradiometer (MODIS) snow-cover, cloud- gap-filled (CGF) map products and 30 years of discharge and meteorological station a are studied. Streamflow data from six streams in the WRR drainage basins show lower annual discharge and earlier snowmelt in the decade of the 2000s than in the previous three decades, though no trend of either lower streamflow or earlier snowmelt was observed using MODIS snow-cover maps within the decade of the 2000s. Results show a statistically-significant trend at the 95% confidence level (or higher) of increasing weekly maximum air temperature (for three out of the five meteorological stations studied) in the decade of the 1970s, and also for the 40-year study period. MODIS- derived snow cover (percent of basin covered) measured on 30 April explains over 89% of the variance in discharge for maximum monthly streamflow in the decade of the 2000s using Spearman rank correlation analysis. We also investigated stream power for Bull Lake Creek Above Bull Lake from 1970 to 2009; a statistically-significant trend toward reduced stream power was found (significant at the 90% confidence level). Observed changes in streamflow and stream power may be related to increasing weekly maximum air temperature measured during the 40-year study period. The strong relationship between percent of basin covered and streamflow indicates that MODIS data is useful for predicting streamflow, leading to improved reservoir management.

Hall, Dorothy K.↗

The acceleration of energetic particles in the interplanetary medium by transit-time damping

Transit time damping is examined as a possible means for accelerating low energy particles in co-rotating streams and interstellar ions. Data show that: the protons in co-rotating streams may be accelerated by transient-time damping the small-scale variations in the field magnitude that are observed at a low level in the inner solar system. The interstellar ions may be accelerated by transit time damping large-scale field variations in the outer solar system.

Fisk, L. A.↗

Improving Acoustic Models by Watching Television

Obtaining sufficient labelled training data is a persistent difficulty for speech recognition research. Although well transcribed data is expensive to produce, there is a constant stream of challenging speech data and poor transcription broadcast as closed-captioned television. We describe a reliable unsupervised method for identifying accurately transcribed sections of these broadcasts, and show how these segments can be used to train a recognition system. Starting from acoustic models trained on the Wall Street Journal database, a single iteration of our training method reduced the word error rate on an independent broadcast television news test set from 62.2% to 59.5%.

Witbrock, Michael J.↗

Possible Stick-Slip Mechanism for Whillans Ice Stream

Tidally-induced stick-slip motion in the mouth of Whillans Ice Stream provides a unique natural experiment in ice-stream response behavior and fiom which we might learn a great deal about subglacial till properties and sub-ice-stream conditions. At the IGS Symposium on Fast Glacier Flow (Yakutat, 2002), we reported our observations of stick- slip motion and demonstrated its synchronicity with tidal forcing. Recently, we have completed additional processing of our GPS data in differential mode. It reveals more details of the stick-slip events and illustrates that within 30 seconds, the temporal interval of our data, the ice stream accelerates to a speed corresponding to a completely lubricated bed. While details of individual events vary, there seems to be strong evidence of an elastic rebound on the time scale of one hour following most events. This suggests the event involves the release of stored elastic strain energy in the ice. The similar displacements of events suggest further that till or subglacial hydrologic properties limit the amount of elastic strain released in any single event. We follow a line of reasoning that dilatant strengthening limits the slip displacement and present model of the stick-slip process. To match the observed delay between the peak ocean tide and stick-slip events, our model includes a propagating pressure wave in the subglacial hydrologic system between the grounding line, where the rising tide first increases the subglacial water pressure and regions upstream where stored elastic strain increases the basal shear stress. This high-tide event is released when the increased water pressure reaches the region of increased shear stress. Dilatant strengthening stops the event by increasing pore volume and lowering the water pressure. Following this event, falling tide increases the normal forces, compresses the till and increases pore pressure again, leading to the second falling-tide event we observe every tidal cycle.

Bindschadler, Robert↗

Possible Stick-Slip Mechanism for Whillans Ice Stream

Tidally-induced stick-slip motion in the mouth of Whillans Ice Stream provides a unique natural experiment in ice-stream response behavior and from which we might learn a great deal about subglacial till properties and sub-ice-stream conditions. At the IGS Symposium on Fast Glacier Flow (Yakutat, 2002), we reported our observations of stick- slip motion and demonstrated its synchronicity with tidal forcing. Recently, we have completed additional processing of our GPS data in differential mode. It reveals more details of the stick-slip events and illustrates that within 30 seconds, the temporal interval of our data, the ice stream accelerates to a speed corresponding to a completely lubricated bed. While details of individual events vary, there seems to be strong evidence of an elastic rebound on the time scale of one hour following most events. This suggests the event involves the release of stored elastic strain energy in the ice. The similar displacements of events suggest further that till or subglacial hydrologic properties limit the amount of elastic strain released in any single event. We follow a line of reasoning that dilatant strengthening limits the slip displacement and present model of the stick-slip process. To match the observed delay between the peak ocean tide and stick-slip events, our model includes a propagating pressure wave in the subglacial hydrologic system between the grounding line, where the rising tide first increases the subglacial water pressure and regions upstream where stored elastic strain increases the basal shear stress. This high-tide event is released when the increased water pressure reaches the region of increased shear stress. Dilatant strengthening stops the event by increasing pore volume and lowering the water pressure. Following this event, falling tide increases the normal forces, compresses the till and increases pore pressure again, leading to the second falling-tide event we observe every tidal cycle.

Bindschadler, Robert↗