SEARCH · Engineering Papers

Results for “Network monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Identifying preferential flow from soil moisture time series: Review of methodologies

Abstract Identifying and quantifying preferential flow (PF) through soil—the rapid movement of water through spatially distinct pathways in the subsurface—is vital to understanding how the hydrologic cycle responds to climate, land cover, and anthropogenic changes. In recent decades, methods have been developed that use measured soil moisture time series to identify PF. Because they allow for continuous monitoring and are relatively easy to implement, these methods have become an important tool for recognizing when, where, and under what conditions PF occurs. The methods seek to identify a pattern or quantification that indicates the occurrence of PF. Most commonly, the chosen signature is either (1) a nonsequential response to infiltrated water, in which soil moisture responses do not occur in order of shallowest to deepest, or (2) a velocity criterion, in which newly infiltrated water is detected at depth earlier than is possible by nonpreferential flow processes. Alternative signatures have also been developed that have certain advantages but are less commonly utilized. Choosing among these possible signatures requires attention to their pertinent characteristics, including susceptibility to errors, possible bias toward false negatives or false positives, reliance on subjective judgments, and possible requirements for additional types of data. We review 77 studies that have applied such methods to highlight important information for readers who want to identify PF from soil moisture data and to inform those who aim to develop new methods or improve existing ones. Core Ideas Soil moisture data can be used to identify the occurrence of preferential flow (PF) and its initiating conditions. Various data‐analysis methods to identify PF differ in susceptibility to error, bias, and subjectivity. These methods can utilize vast amounts of data from soil moisture monitoring networks to develop understanding of when, where, and under what conditions PF occurs. Newly developed methods may lead to better accuracy and reliability, and reduce the need for subjective judgments. Plain Language Summary Preferential flow through soil occurs when a large amount of water is suddenly available, as during an intense storm. This type of flow moves rapidly through the soil in distinct narrow pathways rather than moving evenly throughout the body of soil, with major consequences for groundwater resources, ecosystems, spreading of contaminants, and other vital concerns. Methods of detecting preferential flow have been developed that utilize measurements of soil water content made by sensors installed at various depths. This measurement technology has been widely implemented, many locations now having datasets years in length, and various methods have been developed for using these to identify preferential flow. The various methods are based on different features in the soil moisture records and vary in their advantages and shortcomings. In this review, we explain and evaluate these methods, highlighting important information for their implementation to identify preferential flow from soil moisture data and for efforts to develop new methods or improve existing ones.

Nimmo, John R↗

DOE OSTI2022

A Case Study of the Weather Research and Forecasting Model Applied to the Joint Urban 2003 Tracer Field Experiment. Part III: Boundary-Layer Parametrizations

Numerical weather prediction is often used to supply the mean wind and turbulence fields for atmospheric transport and dispersion plume models as they provide dense geographic coverage in comparison to typically sparse monitoring networks. Here, the Weather Research and Forecasting (WRF) model 4.0 was run over the month-long period of the Joint Urban 2003 field campaign conducted in Oklahoma City. We compare three different simulations in their ability to reproduce the observations, each using a different boundary-layer parametrization. Specifically, we examine the Mellor–Yamada–Janjic (MYJ), Yonsei University (YSU), and Mellor–Yamada–Nakanishi–Niino (MYNN) boundary-layer parametrizations. All three predict the wind speed well during the day but overpredict it at night. The MYNN parametrization is better than MYJ at predicting the daytime turbulence in the surface layer, but both underpredict the nocturnal turbulence. Additionally, the MYJ parametrization is best at predicting the reciprocal Obukhov length, while MYNN and YSU both significantly overpredict thermal stability. Reconstructing the reciprocal Obukhov length from other simulated parameters produces more accurate values for both parametrizations. All three models overpredict the boundary-layer height, particularly under convective conditions. The MYJ parametrization overestimates boundary-layer height the most, while YSU and MYNN have comparable performance with MYNN having an advantage in predicting the stable boundary-layer height. Several days were found where the WRF simulations predict significant deviations from the prevailing diurnal pattern in wind direction, which are not found in the observations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Evaluation and calibration of MERRA-2 and CAMS reanalysis for PM 2.5 in a semi-urbanized area in the south of the Amazon

Air pollution has significant implications for the climate and poses irreversible risks to human health. The Amazon region of Brazil is severely affected by biomass burning (BB) emissions, yet air quality monitoring remains highly inadequate. Given the scarcity of surface-based observations, reanalysis models have become essential tools for assessing air pollution. Although MERRA-2 and CAMS PM 2.5 products are widely utilized, their validation and comprehensive evaluation for the Amazon Basin remain limited. Here, this study assesses the performance of these products in a semi-urbanized region in the southern Amazon. The calibrated time series was employed to analyze PM 2.5 concentrations from 2003 to 2023. Our results showed satisfactory performance of both products for the 24-h averages of PM 2.5 , with linear correlations above 0.76. However, it was found that both products overestimate surface concentrations. MERRA-2 performed better, with approximately 30% lower bias than CAMS. Time series analysis showed that the study area is strongly impacted by emissions BB in the dry period, mainly in August and September. Furthermore, our findings indicate a positive trend in increasing PM 2.5 concentrations, with a notable rise observed since 2014. The average PM 2.5 levels frequently exceed the daily air quality guidelines established by the WHO in 2021. It has been estimated that the population of this region is exposed to concentrations above 15 μg.m -3 , on average, more than 30 days per year. Our results contribute to the evaluation of MERRA-2 and CAMS products for Amazon and provide a corrected estimate for surface PM 2.5 . Recent concerns about air quality and the implementation of new surface monitoring networks may improve the evaluation of reanalysis products. In the short term, the need for this information makes our assessments indispensable.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Improving the particle dry deposition scheme in the CMAQ photochemical modeling system

Dry deposition of atmospheric aerosols in large-scale models is a critical, but highly uncertain, sink process with a strong dependence on particle size, meteorological conditions, and land surface properties. This study investigates the particle dry deposition scheme implemented in the standard Community Multiscale Air Quality (CMAQ) model v5.2.1, characterizes its underlying parameterized components with comparison to a similar scheme in a contemporary regional-scale model, and proposes two updated schemes that are then evaluated with available ambient particle deposition velocity (V d ) measurements. Both updated schemes reduce the surprisingly strong dependence of deposition velocity on the aerosol mode width, with one scheme further introducing a dependence on vegetation coverage that is broadly consistent with variability in observations between vegetated and non-vegetated surfaces. Compared to the base scheme, the updated scheme with vegetation dependence increases V d for submicron particles and decreases it for larger particles by an average of 37% and –66%, respectively. This scheme performs statistically better than the base scheme, reducing fractional biases by 56%–97% for vegetated land-use types and has roughly equivalent performance over water. The base and updated schemes are tested with three annual CMAQ (v5.2.1) simulations for the year 2011; predicted ambient aerosol concentrations are evaluated with routine monitoring network observations and predicted dry deposition fluxes are evaluated with data from the Clean Air Status and Trends Network (CASTNET). The updated scheme with vegetation dependence reduces negative fractional biases for PM 10 by 41% and positive fractional biases for PM 2.5 organic carbon by 15%. This scheme has been incorporated into the most recent publicly accessible versions of CMAQ (v5.3 and beyond) to replace the scheme used in previous versions of CMAQ (v4.5 through v5.2.1).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

A Multiyear Constraint on Ammonia Emissions and Deposition Within the US Corn Belt

Abstract The US Corn Belt is a global hotspot of atmospheric ammonia (NH 3 ), a gas known to adversely impact the environment and human health. We combine hourly tall tower (100 m) measurements and bi‐weekly, spatially distributed, ground‐based observations from the Ammonia Monitoring Network with the US National Emissions Inventory (NEI) and WRF‐Chem simulations to constrain NH 3 emissions from April to September 2017–2019. We show that: (1) NH 3 emissions peaked from May to July and were 1.6–1.7 times the annual NEI average; (2) average growing season NH 3 emissions from agricultural lands were remarkably similar across years (3.27–3.64 nmol m −2 s −1 ), yet showed substantial episodic variability driven by meteorology and land management; (3) dry deposition was 40% of gross emissions from agricultural lands and exceeded 100% of gross emissions in natural lands. Our findings provide an important benchmark for evaluating future NH 3 emissions and mitigation efforts.

Hu, Cheng↗

DOE OSTI2021

Exploring Sources of Surface Bias in HRRR Using New York State Mesonet

In recent years, there has been increasing demand for applications of short-term forecasting of renewable energy potential and assessments of the likelihood of extreme weather events using the High-Resolution Rapid Refresh (HRRR) model. Examining the biases in the newest version of HRRR is necessary to promote further model development. Using data from one of the most comprehensive and dense monitoring networks, New York State Mesonet (NYSM), we evaluate the HRRR version 3 meteorological fields for an entire year. In this work, the land-atmosphere-cloud coupling system is evaluated as an integrated whole. We investigate the physical processes influencing the soil hydrological balance and the thermodynamic interactions, from surface fluxes up to the level of boundary layer convection from both temporal (seasonal and diurnal) and spatial perspectives. Results show that the model 2 m temperature and humidity biases are seasonally dependent, with warm and dry bias present during the warm season, and an extreme nocturnal cold bias in winter. The summer warm bias includes both a land-surface-induced bias and a cloud-induced bias. Inaccurate representation of energy partition and soil hydrological process across different land use types as well as a hydrological bias in describing spring snowmelt are identified as the main source of the land-surface-induced bias. A feedback loop linking cloud presence, flux changes, and temperature contributes to the cloud-induced bias. The positive solar radiation bias increases from clear sky to overcast sky conditions. The most significant bias occurs during overcast and thick cloud conditions associated with frontal passage and thunderstorms.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Floods and Heavy Precipitation at the Global Scale: 100‐Year Analysis and 180‐Year Reconstruction

Floods and heavy precipitation have disruptive impacts worldwide, but their historical variability remains only partially understood at the global scale. This article aims at reducing this knowledge gap by jointly analyzing seasonal maxima of streamflow and precipitation at more than 3,000 stations over a 100‐year period. The analysis is based on Hidden Climate Indices (HCIs). Like standard climate indices (e.g., Nino 3.4, NAO), HCIs are used as covariates explaining the temporal variability of data, but unlike them, HCIs are estimated from the data. In this work, a distinction is made between common HCIs, that affect both heavy precipitation and floods, and specific HCIs, that exclusively affect one or the other. Overall, HCIs do not show noticeable autocorrelation, but some are affected by noticeable trends. In particular, strong and wide‐ranging trends are identified in precipitation‐specific HCIs, while trends affecting flood‐specific HCIs are weaker and have more localized effects. A probabilistic model is then derived to link HCIs and large‐scale atmospheric variables (pressure, wind, temperature) and to reconstruct HCIs since 1836 using the 20CRv3 reanalysis. In turn this allows estimating the probability of occurrence of floods and heavy precipitation at the global scale. This 180‐year reconstruction highlights flood hot‐spots and hot‐moments in the distant past, well before the establishment of perennial monitoring networks. Finally, the approach presented in this study is generic and paves the way for an improved characterization of historical variability by making a better use of long but highly irregular station data sets.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Insights From Dayflow: A Historical Streamflow Reanalysis Dataset for the Conterminous United States

Abstract Reconstructed historical streamflow time series can supplement limited streamflow gauge observations. However, there are common challenges of typical modeling approaches: process‐based hydrologic models can be data/computation‐intensive, and statistics‐based models can be region/stream‐specific. Here we present a nationally scalable modeling framework integrating the simulated runoff from the Variable Infiltration Capacity (VIC) model with the Routing Application for Parallel computatIon of Discharge (RAPID) routing model leveraging high‐performance computing. We demonstrate an efficient method of assimilating streamflow at US Geological Survey (USGS) streamflow monitoring sites using a simple hierarchical approach in the VIC‐RAPID framework. The result is a reconstructed 36‐year (1980–2015) daily and monthly streamflow dataset (Dayflow) at ∼2.7 million NHDPlusV2 stream reaches in the conterminous US (CONUS). We perform a comprehensive evaluation at 7,526 USGS sites and characterize their error statistics. The results demonstrate that 49% of the USGS sites demonstrate Kling–Gupta Efficiency (KGE) > 0.5 and 58% of the sites show percentage bias within ±20% for the daily naturalized streamflow. Streamflow data assimilation across CONUS shows an overall improvement over naturalized streamflow, notably in the western semiarid‐to‐arid regions. Comparison to other national and global streamflow reanalysis datasets such as the National Water Model and Global Reach‐scale A priori Discharge Estimates for SWOT demonstrates improved KGE, reduced bias, and directions for Dayflow improvements. Investigations of error statistics with key hydrologic, hydroclimatic, and geomorphologic basin characteristics reveal region‐specific patterns which may help improve future framework applications. Overall, Dayflow may enable a better understanding of hydrologic conditions in a changing environment, especially in locations currently not represented by streamflow monitoring networks.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Man‐in‐the‐middle attacks and defence in a power system cyber‐physical testbed

Abstract Man‐in‐The‐Middle (MiTM) attacks present numerous threats to a smart grid. In a MiTM attack, an intruder embeds itself within a conversation between two devices to either eavesdrop or impersonate one of the devices, making it appear to be a normal exchange of information. Thus, the intruder can perform false data injection (FDI) and false command injection (FCI) attacks that can compromise power system operations, such as state estimation, economic dispatch, and automatic generation control (AGC). Very few researchers have focused on MiTM methods that are difficult to detect within a smart grid. To address this, we are designing and implementing multi‐stage MiTM intrusions in an emulation‐based cyber‐physical power system testbed against a large‐scale synthetic grid model to demonstrate how such attacks can cause physical contingencies such as misguided operation and false measurements. MiTM intrusions create FCI, FDI, and replay attacks in this synthetic power grid. This work enables stakeholders to defend against these stealthy attacks, and we present detection mechanisms that are developed using multiple alerts from intrusion detection systems and network monitoring tools. Our contribution will enable other smart grid security researchers and industry to develop further detection mechanisms for inconspicuous MiTM attacks.

Wlazlo, Patrick↗

DOE OSTI2026

Evaluation of a catalytically aided thermal regeneration method for quartz filter-based black carbon sensing

Black carbon (BC)–a strong indicator of diesel particulate matter and other sources of incomplete carbonaceous fuel combustion–is an important air pollutant that affects public health, yet low-cost sensors capable of long-term, autonomous BC monitoring remain underdeveloped. We report on the development and evaluation of a novel BC prototype sensor that integrates soot collection on a quartz filter, in-situ optical transmission measurement, and thermal filter regeneration. To enable regeneration at lower temperatures, we evaluated the catalytic effects of various alkali metal salts pre-applied to the filter. Among these, cesium carbonate (Cs 2 CO 3 ) exhibited the strongest catalytic activity, lowering the temperature required for complete BC removal by up to 190 °C and reducing energy consumption by more than 75% compared to that required for untreated filters. The catalytic effect persisted through 10 BC collection–regeneration cycles. These findings demonstrate the potential of catalytically aided thermal regeneration in BC sensors and suggest a pathway toward energy-efficient and reduced maintenance air quality monitoring suitable for distributed BC monitoring networks.

Tang, Xiaochen [Lawrence Berkeley National Laborat↗

DOE OSTI2024

Inertia Estimation and Trend Analysis of the United States Power Grid Interconnections

The transition from conventional to modern power systems is causing an increase in integration of inverter-based resources (IBRs). This generally leads to a decrease in total system inertia, which in-turn increases the system’s rate-of-change-of-frequency (RoCoF) during disturbances. This poses a threat to the frequency stability of the system and may falsely trigger protective devices. To monitor system status and plan for integrating renewable energy sources like photovoltaic, wind, and energy storage systems, a realistic study of inertia estimation and analysis in the United States (US) over the past decade is needed. This paper uses field-measured phasor measurement unit (PMU) data collected throughout the US from 2013 to 2023 via the Frequency Monitoring Network (FNET/GridEye) operated by the University of Tennessee, Knoxville (UTK) and Oak Ridge National Laboratory (ORNL). The collected PMU frequency data is utilized to estimate the system inertia of the three US interconnections: Eastern, Western, and Texas. Various RoCoF time windows are investigated for estimating the inertia of each interconnection by maximizing the correlation coefficient between the measured RoCoF and power mismatch. The resulting inertia trends over the past decade show approximately a 6% decline in inertia in the Eastern interconnection, a 15% decline in inertia in the Western interconnection, and a 16% increase in inertia in Texas. Key insights into how inertia is changing amidst the complex energy landscape are extracted using the fuel mix trend data. This provides valuable information for future energy strategies and planning.

30 DIRECT ENERGY CONVERSION↗

DOE OSTI2025

Comparative Analysis of Inter-Area Oscillations in the US Eastern and Western Interconnections

This paper presents a comparative analysis of interarea oscillations in the US Eastern and Western Interconnections using frequency disturbance data collected from the advanced wide-area Frequency Monitoring Network (FNET/GridEye), enabling us to investigate and compare the oscillation characteristics of both regions. The study analyzes the statistical data from the two interconnections, including total oscillation events, average dominant frequencies, damping ratios, and maximum amplitudes. We also explore the impact of seasonal and daily variations on oscillation occurrences and the influence of different grid topologies and operational practices. The results provide insights into both interconnections' stability and control characteristics, offering valuable information for power system operators to enhance grid stability and oscillation suppression measures.

Fu, Hao [University of Tennessee, Knoxville (UTK)]↗

DOE OSTI2020

Hylia: Time-Series Library for Network Operations (Hylia) v1

The ability to analyze time-series data in network operations is critical to ensure optimal operations and management in wide area networks, sensor networks, and cloud networks. Hylia is a collection of multiple time-series prediction algorithms designed specifically to work with network monitoring data sets such as SNMP, NETFLOW and other monitoring data. It is designed to recognize these features and perform the extrapolation of the data.

Kiran, Mariam↗

DOE OSTI2022

Master State Threat Identifier (masti)

The MSE cyber sensor offers a novel approach for scalable network monitoring using heterogeneous computing. Packet data is collected, analyzed, and stored by a stand alone cyber sensor. Machine learning algorithms are run to discover patterns in the communication without the need for deep packet inspection. Tuning of the detection algorithms happens automatically, without need for an engineer to manually create detection rules.

Russell, PierceL↗

DOE OSTI2024

Bayesian OED for Seismic Monitoring

SAND2024-13870O The Bayesian OED (Optimal Experiment Design) for Seismic Monitoring code provides the tools to analyze and optimize seismic monitoring networks using Bayesian OED. This method designs a utility function for experiments (network designs) using network analysis and network optimization. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Catanach, Thomas↗

DOE OSTI2020

Joint Focal Mechanism Inversion Using Downhole and Surface Monitoring at the Decatur, Illinois, CO2 Injection Site

ABSTRACT The three-year CO2 injection period at the Illinois Basin - Decatur Project site (Decatur, Illinois, United States) produced a number of microseismic events distributed in very distinct spatiotemporal clusters with different orientations. Further characterization of the microseismicity encompasses the determination of the event source mechanisms. Initially, the microseismic monitoring network consisted solely of borehole sensors, but has been extended with surface sensors, thereby significantly improving the data coverage over the focal sphere. This article focuses on 23 events from the northernmost microseismic cluster (about 2 km from the injection point) and takes advantage of both, surface and downhole, recordings. The resulting strike-slip east–west-oriented focal planes are all consistent with the east–west orientation of the cluster in map view. The injection-related increase of pore pressure is far below the formation fracture pressure; however, small stress-field changes associated with the pore-pressure increase may reach as far as to the investigated cluster location. Monte Carlo modeling of the slip reactivation potential within this cluster showed that the observed maximum stress-field orientation of N068° is the optimum orientation for fault reactivation of the east–west-oriented cluster. Our results suggest that the east–west orientation of the investigated cluster is the main reason for its activation, even though the cluster is about 2 km away from the low-pressure injection point.

Geochemistry & Geophysics↗

DOE OSTI2020

A Multi-Instance learning Framework for Seismic Detectors

In this report, we construct and test a framework for fusing the predictions of a ensemble of seismic wave detectors. The framework is drawn from multi-instance learning and is meant to improve the predictive skill of the ensemble beyond that of the individual detectors. We show how the framework allows the use of multiple features derived from the seismogram to detect seismic wave arrivals, as well as how it allows only the most informative features to be retained in the ensemble. The computational cost of the "ensembling" method is linear in the size of the ensemble, allowing a scalable method for monitoring multiple features/transformations of a seismogram. The framework is tested on teleseismic and regional p-wave arrivals at the IMS (International Monitoring System) station in Warramunga, NT, Australia and the PNSU station in University of Utah's monitoring network.

58 GEOSCIENCES↗

DOE OSTI2021

Baylor University Campus-Wide Deep Dive

In January 2020, staff members from the Engagement and Performance Operations Center (EPOC) and the Lonestar Education And Research Network (LEARN) met with researchers and staff at Baylor University for the purpose of a Campus-Wide Deep Dive into research drivers. The goal of this meeting was to help characterize the requirements for five campus research use cases and to enable cyberinfrastructure support staff to better understand the needs of the researchers they support. Profiled scientific use cases included: - Experimental High Energy Physics (HEP) - Proton Computed Tomography (pCT) - Nutrition and Relation to Digestive Microbiome - Baylor University Core Research Facilities - Molecular Quantum-dot Cellular Automata (QCA), and Material Science of Quantum Computing - Modeling and Simulation of Low-Dimensional and Nano-Structured Materials - Computational Fluid Dynamics Material for this event included the written documentation from each of the research areas at Baylor University, documentation about the current state of technology support, and a write-up of the discussion that took place in person. The Case Studies highlighted the ongoing challenges that Baylor University has in supporting a cross-section of established and emerging research use cases. Each Case Study mentioned unique challenges which were summarized into common needs. These included: - Tradeoffs for network/software security, and usability of the resulting infrastructure. Better communication to set expectations and understand realities is required. - Computation use on campus is widespread and healthy. While no major problems were uncovered, upgrades to maintain current usage patterns and encourage growth will be required. - Storage is a critical need for enterprise use cases and research. In particular, a campus wide ‘storage architecture’ to support research use cases (e.g. instruments, data sharing) is required in the 2-5 year time window. - Instrumentation on campus is healthy and expanding. Technology must scale with this in the form of computation and storage. - Working with LEARN to upgrade network capacity (in multiples of 10G, or upgrades to 100G) will be required in the 1-3 year time frame. - Network monitoring and visibility will help to establish external science use cases. - Data sharing via portal systems is not currently a critical need, but growing in scope. EPOC can assist Baylor with options.

99 GENERAL AND MISCELLANEOUS↗