Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Search for HH → bbτ⁺τ⁻ Using Run 3 Scouting Data Analyze b-tagging and tau-tagging Performance with Unified Particle Transformer

B-tagging and tau-tagging performances play an important role in the search for the rare event HH → bbτ⁺τ⁻. A transformer-based neural network, Unified Particle Transformer, is applied for both tagging tasks, and Run 3 proton–proton collision scouting data at center-of-mass energy of 13.6 TeV is used. The scouting data stream accepts events at a much higher rate compared to traditional triggers, but stores only the objects reconstructed in the trigger, no low-level detector information. Therefore, existing taggers trained for the offline event reconstruction cannot be used. Analysis of the SoftMax plots, ROC/AUC curves, confusion matrix, accuracy and losses are used to evaluate model performance. Specifically, the tagging efficiency of the signal and misidentification probability across multiple background processes are compared for varying working points. Different training samples with distinct distributions of jet flavors are utilized and related model performances are analyzed. Interpretability methods, such as Integrated Gradients, may further be applied to study the input features’ influence on the model’s decisions, providing insights into potential improvements.

Chen, Blair [Purdue U., West Lafayette; Fermilab]↗

Cloud-Based Demonstration of the Eastern Interconnection Situational Awareness Monitoring System (ESAMS)

This report describes a cloud-based implementation and field demonstration of the Eastern Interconnection Situational Awareness and Monitoring System (ESAMS). ESAMS was developed to support the detection and source localization of forced oscillations using synchrophasor measurements from tie-lines connecting areas served by different reliability coordinators (RCs), so that RCs could better coordinate their response to wide-area events. A previous effort had identified deployment barriers associated with hosting shared situational awareness tools at a single RC. To address these barriers, ESAMS was migrated to Amazon Web Services and evaluated in a six-month field demonstration. ISO New England (ISO-NE) and PJM streamed data to the platform using AWS Direct Connect and a site-to-site VPN, respectively. The resulting multi-utility measurement footprint enabled regional source localization across major portions of the U.S. Eastern Interconnection and supported routine identification of oscillation events. During the final three months of the trial, 24 events above 2 MW/MVAR were detected. The largest detected oscillation approached a 25 MW peak-to-peak amplitude, and the longest persisted intermittently for more than 11 hours. The demonstration also assessed operational considerations—including data transfer volumes, end-to-end latency, and cloud computing costs—and found that network and compute requirements were modest relative to typical cloud capabilities while providing performance comparable to prior on-premises deployments. Overall, the results indicate that cloud hosting can provide a practical path to shared interconnection-wide oscillation monitoring. The cloud ESAMS demonstration establishes a foundation for broader utility participation and for building future wide-area analytics that leverage measurements across organizational boundaries.

Follum, James D.↗

Design and implementation of a real-time underwater acoustic telemetry system for fish behavior study and environmental sensing

Underwater acoustic telemetry is an important tool for studying the behavior of aquatic animals and assessing the environmental impact of man-made structures such as water power turbines. However, current design of the acoustic telemetry system lacks the ability to transmit collected data continuously in real-time and requires manual retrieval of the recorded measurements, leading to a long delay of data retrieval, high operational cost associated with manpower as well as safety risk for the operators. In addition, there is no efficient way to monitor the status of the acoustic telemetry system, including acoustic transmitters and receivers. For example, if multiple receivers in an array fail, the detection efficiency could be significantly reduced. Herein, we developed a cloud-based, real-time underwater acoustic telemetry system that can be used to estimate behavior or survival of tagged aquatic animals and monitor environmental parameters in near-real-time (< 2 hours). The system incorporates microcontrollers and integrated circuits to create real-time data communication and processing units with a cloud-based service that processes the transmitted data stream to derive behavior and survival information of the tagged animals.

Yang, Yang↗

SPRUCE S1 Bog Tree Basal Area and Understory Community Composition Assessed in the Southern and Northern Ends of the S1 Bog

The composition and cover of woody and understory species, along with the timing of stem growth, were characterized near minirhizotron installations at the south and north ends of the S1 bog in order to understand the relationship between root dynamics and the surrounding plant communities. There are three data streams: (1) Woody species basal area -- the number, basal area, and distance from the center point of all trees within a 5-m radius of each minirhizotron pair, which were quantified in 2011, (2) Understory cover -- the understory vascular plant community composition and percent cover, which were surveyed in 1 m2 areas at four cardinal directions adjacent to each pair of minirhizotrons in June 2011, and (3) Stem growth -- the basal area increment (stem growth) of nearby trees, which was quantified using automated or manual dendrobands in 2011 and 2012, respectively. The measurements were made in the S1-Bog of the Marcell Experimental Forest (MEF) near Grand Rapids, Minnesota.

54 ENVIRONMENTAL SCIENCES↗

Assessing the cumulative effects of nearshore habitat restoration actions for multiple populations of juvenile salmon in Whidbey Basin, Washington: foundation and approach for synthesis and evaluation

Ecosystem restoration is a common tool for re-establishing ecosystem processes, structures, and functions to improve biodiversity and services in coastal and estuarine ecosystems. In the Salish Sea, salmon habitats have been fragmented, reduced in size, and diminished in quality, and the ecosystem processes that form and sustain these habitats have been degraded and disrupted as well. This loss is especially prevalent in estuaries, where up to 90% of former salmon habitat has been lost or compromised. Salmon species are integral to the identities and cultures of people in the Pacific Northwest, yet salmon abundances remain at historic lows, especially in urbanized areas. Recent investments in restoration are creating rearing habitat and repairing lost ecosystem function. However, restoration efforts in this region have largely proceeded at the site scale, with less attention to big-picture thinking regarding how restoration will effectively recover degraded or lost habitats for target species. As a result, no landscape-scale evaluation program exists, and the cumulative benefits of multiple interventions are unknown. We describe innovative methods for science synthesis related to the evaluation of cumulative effects of ecosystem restoration for Pacific salmon, using years of existing, but disparate data. Building from previous work on cumulative effects evaluation and incorporating a hierarchy of hypotheses approach, we propose using causal inference across numerous hypotheses in a framework to assess the cumulative benefits to Pacific salmon from multiple estuarine restoration projects. We present the framework as a method that can be used to address many complex questions and provide examples from the Salish Sea where the approach is being implemented. The framework draws on science synthesis from numerous fields and uses a hierarchy of hypotheses, causal analysis at multiple scales, and a new hierarchy of synthesis for assessing multiple lines of evidence documenting restoration effects on Pacific salmon. We propose causal inference to synthesize dissimilar data streams, in our case, to identify various manifestations of cumulative effects of restoration and benefits to salmon, and to further inform restoration and recovery planning. A unifying framework would allow for the detection of thresholds at which restoration provides measurable improvement and would greatly advance understanding of the effects of restoration on ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗

Towards Quantitative Inference of Nanoscale Defects in Irradiated Metals and Alloys

Quantifying the population of nanoscale defects that are formed in metals and alloys exposed to extreme radiation environments remains a pressing challenge in materials science. These defects both fundamentally alter material properties and seed long-timescale performance degradation, which often limits the lifespan of engineering systems. Unlike ceramic and semiconducting materials, these defects in metals and alloys are not spectroscopically active, forcing characterization to rely on indirect measurements from which the distribution of nanoscale defects may be inferred. In this mini-review, different experimental methodologies which have been employed for defect inference are highlighted to capture the current state of the art. Future directions in this area are proposed, which, by combining data streams from multiple and complementary characterization methods in concert with multi-scale modeling and simulation, will enable the ultimate goal of quantifying the full spectrum of defects in irradiated metals and alloys.

Hirst, Charles A.↗

Advancing Industry 4.0: Multimodal Sensor Fusion for AI-Based Fault Detection in 3D Printing

Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle clogging, filament runout, and layer misalignment, which compromise print quality and reliability. Traditional inspection methods are costly, time-intensive, and often limited to post-process analysis, making them unsuitable for real-time intervention. In this current study, the authors developed a novel, low-cost, and portable faultdetection system that leverages multimodal sensor fusion and artificial intelligence for real-time monitoring in FDM-based 3D printing. The system integrates acoustic, vibration, and thermal sensing into a non-intrusive architecture, capturing complementary data streams that reflect both mechanical and process-related anomalies. Acoustic and thermal sensors operate in a fully contactless manner, while the vibration sensor requires minimal attachment such that it will not interfere with printer hardware, thereby preserving portability and ease of deployment. The multimodal signals are processed into spectrograms and time-frequency features, which are classified using convolutional neural networks for intelligent fault detection. The proposed system advances Industry 4.0 objectives by offering an affordable, scalable, and practical monitoring solution that improves faultdetection accuracy, reduces waste, and supports sustainable, adaptive manufacturing.

42 ENGINEERING↗

Leveraging 35 years of Pinus taeda research in the southeastern US to constrain forest carbon cycle predictions: regional data assimilation using ecosystem experiments

Predicting how forest carbon cycling will change in response to climate change and management depends on the collective knowledge from measurements across environmental gradients, ecosystem manipulations of global change factors, and mathematical models. Formally integrating these sources of knowledge through data assimilation, or model–data fusion, allows the use of past observations to constrain model parameters and estimate prediction uncertainty. Data assimilation (DA) focused on the regional scale has the opportunity to integrate data from both environmental gradients and experimental studies to constrain model parameters. Here, we introduce a hierarchical Bayesian DA approach (Data Assimilation to Predict Productivity for Ecosystems and Regions, DAPPER) that uses observations of carbon stocks, carbon fluxes, water fluxes, and vegetation dynamics from loblolly pine plantation ecosystems across the southeastern US to constrain parameters in a modified version of the Physiological Principles Predicting Growth (3-PG) forest growth model. The observations included major experiments that manipulated atmospheric carbon dioxide (CO 2 ) concentration, water, and nutrients, along with nonexperimental surveys that spanned environmental gradients across an 8.6 × 10 5 km 2 region. We optimized regionally representative posterior distributions for model parameters, which dependably predicted data from plots withheld from the data assimilation. While the mean bias in predictions of nutrient fertilization experiments, irrigation experiments, and CO 2 enrichment experiments was low, future work needs to focus modifications to model structures that decrease the bias in predictions of drought experiments. Predictions of how growth responded to elevated CO 2 strongly depended on whether ecosystem experiments were assimilated and whether the assimilated field plots in the CO 2 study were allowed to have different mortality parameters than the other field plots in the region. We present predictions of stem biomass productivity under elevated CO 2 , decreased precipitation, and increased nutrient availability that include estimates of uncertainty for the southeastern US. Overall, we (1) demonstrated how three decades of research in southeastern US planted pine forests can be used to develop DA techniques that use multiple locations, multiple data streams, and multiple ecosystem experiment types to optimize parameters and (2) developed a tool for the development of future predictions of forest productivity for natural resource managers that leverage a rich dataset of integrated ecosystem observations across a region.

54 ENVIRONMENTAL SCIENCES↗

Observational data from uncrewed systems over Southern Great Plains

Uncrewed Systems (UxS), including uncrewed aerial systems (UAS) and tethered balloon/kite systems (TBS), are significantly expanding observational capabilities in atmospheric science. Rapid adaptation of these platforms and the advancement of miniaturized instruments have resulted in an expanding number of data sets captured under various environmental conditions by the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility. In 2021, observational data collected using ARM UxS platforms, including seven TigerShark UAS flights and 133 tethered balloon system (TBS) flights, were archived by the ARM Data Center and made publicly available to the user community https://adc.arm.gov/discovery/#/results/s::sgp*U3 and https://adc.arm.gov/discovery/#/results/s::sgp*tbs. These data streams provide new perspectives on spatial variability of atmospheric and surface parameters, helping to address critical science questions in Earth system science research. This manuscript describes the DOE UAS/TBS datasets, including information on the acquisition, collection, and quality control processes, and highlights the potential scientific contributions using UAS and TBS platforms.

54 ENVIRONMENTAL SCIENCES↗

Over three decades, and counting, of near-surface turbulent flux measurements from the Atmospheric Radiation Measurement (ARM) user facility

Processes mediating the coupling of terrestrial, aquatic, biospheric, and atmospheric systems influence weather, climate, and ecosystem dynamics via transfer of energy, momentum, water, and carbon (or other species). These exchange processes are quantified by measurements of near-surface turbulent fluxes. Understanding processes at these interfaces provides insight toward understanding and predicting current and future states within the Earth system. The Atmospheric Radiation Measurement (ARM) user facility has been conducting measurements of near-surface turbulent fluxes since the early 1990s at long-term fixed locations and shorter-term mobile deployments across the Earth. ARM has utilized two established methods for conducting these measurements: energy balance Bowen ratio (EBBR) and eddy covariance (EC). Primary measurements from the former include sensible and latent heat flux, while the latter also measures fluxes of momentum and carbon (primarily carbon dioxide, with methane fluxes measured at two locations to date). The EBBR systems have been deployed at 22 locations, and, to date, the EC systems have been deployed at over 50 sites, with plans for additional novel site locations in the future. Herein, the history, evolution, and key aspects of these instrument systems are documented, along with information on data quality assurance and post-processing, as well as best use practices. Additionally, three data validation experiments were recently conducted, and their key findings are summarized. Finally, ancillary datasets acquired by ARM, which can contextualize and aid interpretation of the near-surface turbulent flux measurements, are discussed. The datasets described herein include the eddy correlation flux measurement system: 30ECOR (https://doi.org/10.5439/1879993, Sullivan et al., 1997), 30QCECOR (https://doi.org/10.5439/1097546, Gaustad, 2003), ECORSF (https://doi.org/10.5439/1494128, Sullivan et al., 2019a), and associated AmeriFlux and Methane Value-Added Product, AMCMETHANE (https://doi.org/10.5439/1508268, Billesbach, 2011); the energy balance Bowen ratio system: 30EBBR (https://doi.org/10.5439/1023895, Sullivan et al., 1993) and 30BAEBBR (https://doi.org/10.5439/1027268, Gaustad and Xie, 1993); and the carbon dioxide flux measurement system: CO2FLX (https://doi.org/10.5439/1287574, https://doi.org/10.5439/1287575, https://doi.org/10.5439/1287576, Koontz et al., 2015a, b, c; https://doi.org/10.5439/1989774, https://doi.org/10.5439/1989776, https://doi.org/10.5439/1992202, Biraud and Chan, 2002a, b, c). These data can be found by searching the above data stream names at https://adc.arm.gov/discovery/#/results/ (last access: 8 September 2025).

Sullivan, Ryan C. [Argonne National Laboratory (AN↗

sdt (Solar Data Tools) [SWR-25-130]

Solar Data Tools (sdt) is an open-source Python library for analyzing PV power (and irradiance) time-series data. It was developed to enable analysis of unlabeled PV data, i.e. with no model, no meteorological data, and no performance index required, by taking a statistical signal processing approach in the algorithms used in the package’s main data processing pipeline. Solar Data Tools empowers PV system fleet owners or operators to analyze system performance a hundred times faster even when they only have access to the most basic data stream—power output of the system.

Meyers-Im, Bennet [National Laboratory of the Rock↗

KAZRCORGE

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorge.c1 (ge=general sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity.

54 ENVIRONMENTAL SCIENCES↗

KAZRCORMD

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcormd.c1 (md=moderate sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity.

54 ENVIRONMENTAL SCIENCES↗

KAZRCORHI

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorhi.c1 (hi=high sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity.

54 ENVIRONMENTAL SCIENCES↗

KAZRCORGE-c0

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorge.c1 (ge=general sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.

54 ENVIRONMENTAL SCIENCES↗

KAZRCORHI-c0

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorhi.c1 (hi=high sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.

54 ENVIRONMENTAL SCIENCES↗

KAZRCORPR-c0

For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorpr.c1 (pr=precip), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.

54 ENVIRONMENTAL SCIENCES↗