Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

AI-Science for Performance Optimization and Diagnosis of Science Instrument Federations

Next generation of science workflows are expected to be executed over complex federations composed of supercomputers, science instruments, storage systems and networks, with new additions of the edge and cloud systems and services. The sheer complexity of these multi-domain federations makes it hard to manage them and optimize their performance, as small impedance mismatches (that can dynamically develop between systems) could drastically degrade the entire federation performance. Recent proliferation of Software Defined Everything (SDX) technologies combined with containerization frameworks provide custom instruments that can monitor and collect critical measurements at various levels to support diagnoses and performance optimization; but their data too enormous for human operators and analysts to process and generate decisions. Machine Learning (ML) methods that extract critical parameters, relationships and trends from the data offer general solutions. Artificial Intelligence (AI) and ML methods must be custom-developed for these problems based on solid, rigorous foundations, since black-box approaches are often ineffective and unsound.We propose to develop comprehensive AI-Science for the performance of science federations to (i) monitor and control storage, networks, experiments, and computing systems across multiple domains via softwarization layers, at speeds and scales orders of magnitude superior to current practice, (ii) optimally realize and orchestrate complex workflows with high performance by using dynamic state and performance estimation methods, and (iii) aggregate measurements across sites and time to develop infrastructure-level profiles, optimizations and diagnoses using AI-Science based on foundational principles from ML, game theory, and information fusion areas.

Rao, Nageswara↗
DOE OSTI2023

Runtime extension for neural network training with heterogeneous memory

Systems, apparatuses, and methods for managing buffers in a neural network implementation with heterogeneous memory are disclosed. A system includes a neural network coupled to a first memory and a second memory. The first memory is a relatively low-capacity, high-bandwidth memory while the second memory is a relatively high-capacity, low-bandwidth memory. During a forward propagation pass of the neural network, a run-time manager monitors the usage of the buffers for the various layers of the neural network. During a backward propagation pass of the neural network, the run-time manager determines how to move the buffers between the first and second memories based on the monitored buffer usage during the forward propagation pass. As a result, the run-time manager is able to reduce memory access latency for the layers of the neural network during the backward propagation pass.

Mappouras, Georgios↗
DOE OSTI2024

A Novel Authentication Management for the Data Security of Smart Grid

Bidirectional wireless communication is employed in various smart grid components such as smart meters and control and monitoring applications where security is vital. The Trusted Third Party (TTP) and wireless connectivity between the smart meter and the third party in the key management-based encryption techniques for the smart grid are expected to be totally trustworthy and dependable. In a wired/wireless medium, however, a man-in-the-middle may seek to disrupt, monitor and manipulate the network, or simply execute a replay attack, revealing its vulnerability. Recognizing this, this study presents a novel authentication management (model) comprised of two layer security schema. The first layer implements an efficient novel encryption method for secure data exchange between meters and control center with the help of two partially trusted simple servers (constitutes the TTP). In this setting, one server handles the data encryption between the meter and control center/central database, and the other server administers the random sequence of data transmission. The second layer monitors and verifies exchanged data packets among smart meters. It detects abnormal packets from suspicious sources. To implement this node-to-node authentication, One class support vector machine algorithm is proposed which takes advantages of the location information as well as the data transmission history (node identification, packet size, and data transmission frequency). This schema secures data communication, and imposes a comprehensive privacy throughout the system without considerably extending the complexity of the conventional key management scheme.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2002

Monitor and control software for ground systems in the Deep Space Network

Currently, the NMC is being utilized for 24/7 operations at the three main DSN complexes supporting all of the major spacecraft supported and managed by JPL. A portable version of NMC is being exercised in a Compatibility Test Trailer for off-site monitor and control. Remote monitoring of the three complexes at JPL is accomplished as part of the NMC infrastructure.

monitor and control infrastructure spacecraft oper↗
DOE OSTI2021

Multi-Area Distribution System State Estimation Using Decentralized Physics-Aware Neural Networks

The development of active distribution grids requires more accurate and lower computational cost state estimation. In this paper, the authors investigate a decentralized learning-based distribution system state estimation (DSSE) approach for large distribution grids. The proposed approach decomposes the feeder-level DSSE into subarea-level estimation problems that can be solved independently. The proposed method is decentralized pruned physics-aware neural network (D-P2N2). The physical grid topology is used to parsimoniously design the connections between different hidden layers of the D-P2N2. Monte Carlo simulations based on one-year of load consumption data collected from smart meters for a three-phase distribution system power flow are developed to generate the measurement and voltage state data. The IEEE 123-node system is selected as the test network to benchmark the proposed algorithm against the classic weighted least squares and state-of-the-art learning-based DSSE approaches. Numerical results show that the D-P2N2 outperforms the state-of-the-art methods in terms of estimation accuracy and computational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

TRACER-BC2-SP2 Field Campaign Report

The focus of this project was to assess black carbon and brown carbon aerosol in Houston, Texas during the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) user facility Tracking Aerosol Convection Interactions Experiment (TRACER) through the co-located deployment of a single-particle soot photometer (SP2) with the University of Houston/Baylor aerosol optical instrumentation in the Texas (BC)2 network in and around Houston. The deployment of the SP2 enables us to expand the spatial assessment of black carbon (BC) in Houston during TRACER by permitting a more thorough characterization of BC, including sources, transport, and potential processing. BC is well known to undergo physical and chemical changes during local and long-range transport that will impact its optical properties. By deploying multiple SP2s in the Houston area, the impacts of local and long-range transport can be assessed. The TRACER-BC2-SP2 campaign will expand spatial and temporal characterization of BC in the Houston area during TRACER and link the TRACER-carbon analysis to ongoing black and brown carbon monitoring (Texas [BC]2 network) in Houston.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Transforming microseismic clouds into near real-time visualization of the growing hydraulic fracture

SUMMARY Microseismic observations during unconventional reservoir stimulation are typically seen as a proxy for clusters of hydraulic fractures and the extent of the stimulated reservoir. Such straightforward interpretation is often misleading and fails to provide a physically reasonable image of the fracturing process. This paper demonstrates the application of a physics-based machine learning algorithm which enables a rapid and accurate fracture mapping from the microseismic data. Our training and validation data set relies on a history-matched geomechanical modelling workflow implemented in GEOS software for the Hydraulic Fracturing Test Site 1 (HFTS-1) project. For this study we augmented the simulated fracture growth through geostatistical modelling of induced seismicity, so that the synthetic microseismic catalogue matches the main statistical properties of the field observations. We formulated the problem of mapping the actual fracture in the clutter of events to parallel common video segmentation workflows: several past video frames (microseismic density snapshots) are passed through a deep convolutional network to classify whether a given voxel is associated with a fracture or intact rock. We found that for accurate fracture mapping, the network’s input and architecture must be augmented to incorporate the fluid injection parameters (pressure, rate, concentration of proppant, and location of the perforation within the cluster). The error rate for the network reached as little as 10 per cent of the fracture area, while a conventional microseismic interpretation approach yielded ∼300 per cent. Our approach also yields must faster predictions than conventional methods (minutes instead of weeks), and could enable engineers to make rapid decisions regarding engineering parameters (pumping rate, viscosity) in real time during stimulation.

58 GEOSCIENCES↗
NASA NTRS2013

Distributed Prognostics and Health Management with a Wireless Network Architecture

A heterogeneous set of system components monitored by a varied suite of sensors and a particle-filtering (PF) framework, with the power and the flexibility to adapt to the different diagnostic and prognostic needs, has been developed. Both the diagnostic and prognostic tasks are formulated as a particle-filtering problem in order to explicitly represent and manage uncertainties in state estimation and remaining life estimation. Current state-of-the-art prognostic health management (PHM) systems are mostly centralized in nature, where all the processing is reliant on a single processor. This can lead to a loss in functionality in case of a crash of the central processor or monitor. Furthermore, with increases in the volume of sensor data as well as the complexity of algorithms, traditional centralized systems become for a number of reasons somewhat ungainly for successful deployment, and efficient distributed architectures can be more beneficial. The distributed health management architecture is comprised of a network of smart sensor devices. These devices monitor the health of various subsystems or modules. They perform diagnostics operations and trigger prognostics operations based on user-defined thresholds and rules. The sensor devices, called computing elements (CEs), consist of a sensor, or set of sensors, and a communication device (i.e., a wireless transceiver beside an embedded processing element). The CE runs in either a diagnostic or prognostic operating mode. The diagnostic mode is the default mode where a CE monitors a given subsystem or component through a low-weight diagnostic algorithm. If a CE detects a critical condition during monitoring, it raises a flag. Depending on availability of resources, a networked local cluster of CEs is formed that then carries out prognostics and fault mitigation by efficient distribution of the tasks. It should be noted that the CEs are expected not to suspend their previous tasks in the prognostic mode. When the prognostics task is over, and after appropriate actions have been taken, all CEs return to their original default configuration. Wireless technology-based implementation would ensure more flexibility in terms of sensor placement. It would also allow more sensors to be deployed because the overhead related to weights of wired systems is not present. Distributed architectures are furthermore generally robust with regard to recovery from node failures.

Goebel, Kai↗
DOE OSTI2023

Local Weather Station Design and Development for Cost-Effective Environmental Monitoring and Real-Time Data Sharing

Current weather monitoring systems often remain out of reach for small-scale users and local communities due to their high costs and complexity. This paper addresses this significant issue by introducing a cost-effective, easy-to-use local weather station. Utilizing low-cost sensors, this weather station is a pivotal tool in making environmental monitoring more accessible and user-friendly, particularly for those with limited resources. It offers efficient in-site measurements of various environmental parameters, such as temperature, relative humidity, atmospheric pressure, carbon dioxide concentration, and particulate matter, including PM 1, PM 2.5, and PM 10. The findings demonstrate the station’s capability to monitor these variables remotely and provide forecasts with a high degree of accuracy, displaying an error margin of just 0.67%. Furthermore, the station’s use of the Autoregressive Integrated Moving Average (ARIMA) model enables short-term, reliable forecasts crucial for applications in agriculture, transportation, and air quality monitoring. Furthermore, the weather station’s open-source nature significantly enhances environmental monitoring accessibility for smaller users and encourages broader public data sharing. With this approach, crucial in addressing climate change challenges, the station empowers communities to make informed decisions based on real-time data. In designing and developing this low-cost, efficient monitoring system, this work provides a valuable blueprint for future advancements in environmental technologies, emphasizing sustainability. The proposed automatic weather station not only offers an economical solution for environmental monitoring but also features a user-friendly interface for seamless data communication between the sensor platform and end users. This system ensures the transmission of data through various web-based platforms, catering to users with diverse technical backgrounds. Furthermore, by leveraging historical data through the ARIMA model, the station enhances its utility in providing short-term forecasts and supporting critical decision-making processes across different sectors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Solving Optimal Power Flow for Distribution Networks with State Estimation Feedback

Conventional optimal power flow (OPF) solvers assume full observability of the involved system states. However in practice, there is a lack of reliable system monitoring devices in the distribution networks. To close the gap between the theoretic algorithm design and practical implementation, this work proposes to solve the OPF problems based on the state estimation (SE) feedback for the distribution networks where only a part of the involved system states are physically measured. The SE feedback increases the observability of the under-measured system and provides more accurate system states monitoring when the measurements are noisy. We analytically investigate the convergence of the proposed algorithm. The numerical results demonstrate that the proposed approach is more robust to large pseudo measurement variability and inherent sensor noise in comparison to the other frameworks without SE feedback.

distirbution systems↗
DOE OSTI2022

Data for Monitoring Fracture Saturation with Internal Transportable Seismic Sources and Twin Neural Networks

Seismic coda-wave analysis is a well-developed method for detecting subtle physical changes in complex media by measuring arrival times in the late-arriving energy from multiply-scattered or reflected waves. However, a challenge arises when multiply-scattered waves are not sufficiently separated in time from the direct arrivals to provide a clear coda wave train. Additional complications for monitoring changes in fracture systems arise when the signals originate from unsynchronized internal sources, such as natural induced seismicity, from acoustic emission, or from transportable intra-fracture sources (chattering dust), that generate uncontrolled signals that vary in arrival time, amplitude and frequency content. Here, we use a twin neural network (also known as a Siamese neural network) for dimensionality reduction to analyze signals from chattering dust to classify the fluid saturation state of a synthetic fracture system. The twin neural network with shared weights generates a low-dimensional representation of the data input by minimizing contrastive loss, serving as the input to a multiclass classifier that accurately classifies whether multiple fractures in a fracture system are fully saturated or partially saturated, or whether a change in saturation has occurred in different fractures in the system. These results show that information buried in unresolved codas from uncontrolled sources can be extracted using machine learning to monitor the evolution of fracture systems caused by physical and chemical processes even when the scattered and direct wave fields overlap.

58 GEOSCIENCES↗
NASA NTRS2021

Validation of SMAP L2 passive-only soil moisture products using upscaled in situ measurements collected in Twente, the Netherlands

The Twente region in the east of the Netherlands has a network with twenty soil monitoring stations that has been utilized for validation of the Soil Moisture Active/Passive (SMAP) passive-only soil moisture products. Over the period from April 2015 until December 2018, seven stations covered by the SMAP reference pixels 15 have fairly complete data records. Spatially distributed soil moisture simulations with the Dutch national hydrological model have been utilized for the development of upscaling functions to translate the spatial mean of point measurements to the domain of the SMAP reference pixels. The native and upscaled spatial soil moisture means computed using the in-situ measurements have been adopted as references to assess the performance of the SMAP i) Single Channel Algorithm at Horizontal Polarization (SCA-H), ii) Single Channel Algorithm at Vertical Polarization (SCA-V), and iii) Dual Channel Algorithm (DCA) soil moisture estimates. In the case of the Twente network it was found that the SCA-V soil moisture retrieved SMAP observations collected in the afternoon had the best agreement with the native spatial mean leading to an unbiased Root Mean Squared Error (uRMSE) of 0.059 m3 m-3, whereas for the upscaled in-situ references primarily larger biases were found. These error levels are larger than the mission’s target accuracy of 0.04 m3 m-3, which can be attributed to large over- and underestimation errors (>0.08 m3 m-3) in particular at the end of dry spells and during freezing, respectively. The strong vertical dielectric gradients associated with rapid soil freezing and wetting causes the disparity in soil depth characterized by SMAP and in situ that leads to the large mismatches. Once filtered for frozen conditions and antecedent rainfall the uRMSE improves to 0.043 m3 m-3.

Rogier van der Velde↗
NASA NTRS2010

Antenna Controller Replacement Software

The Antenna Controller Replacement (ACR) software accurately points and monitors the Deep Space Network (DSN) 70-m and 34-m high-efficiency (HEF) ground-based antennas that are used to track primarily spacecraft and, periodically, celestial targets. To track a spacecraft, or other targets, the antenna must be accurately pointed at the spacecraft, which can be very far away with very weak signals. ACR s conical scanning capability collects the signal in a circular pattern around the target, calculates the location of the strongest signal, and adjusts the antenna pointing to point directly at the spacecraft. A real-time, closed-loop servo control algorithm performed every 0.02 second allows accurate positioning of the antenna in order to track these distant spacecraft. Additionally, this advanced servo control algorithm provides better antenna pointing performance in windy conditions. The ACR software provides high-level commands that provide a very easy user interface for the DSN operator. The operator only needs to enter two commands to start the antenna and subreflector, and Master Equatorial tracking. The most accurate antenna pointing is accomplished by aligning the antenna to the Master Equatorial, which because of its small size and sheltered location, has the most stable pointing. The antenna has hundreds of digital and analog monitor points. The ACR software provides compact displays to summarize the status of the antenna, subreflector, and the Master Equatorial. The ACR software has two major functions. First, it performs all of the steps required to accurately point the antenna (and subreflector and Master Equatorial) at the spacecraft (or celestial target). This involves controlling the antenna/ subreflector/Master-Equatorial hardware, initiating and monitoring the correct sequence of operations, calculating the position of the spacecraft relative to the antenna, executing the real-time servo control algorithm to maintain the correct position, and monitoring tracking performance.

Chao, Roger Y.↗
DOE OSTI2023

Protection Against Graph-Based False Data Injection Attacks on Power Systems

Graph signal processing (GSP) has emerged as a powerful tool for practical network applications, including power system monitoring. By representing power system voltages as smooth graph signals, recent research has focused on developing GSP-based methods for state estimation, attack detection, and topology identification. Included, efficient methods have been developed for detecting false data injection (FDI) attacks, which until now were perceived as non-smooth with respect to the graph Laplacian matrix. Consequently, these methods may not be effective against smooth FDI attacks. In this paper, we propose a graph FDI (GFDI) attack that minimizes the Laplacian-based graph total variation (TV) under practical constraints. In addition, we develop a low-complexity algorithm that solves the non-convex GDFI attack optimization problem using ell_1-norm relaxation, the projected gradient descent (PGD) algorithm, and the alternating direction method of multipliers (ADMM). We then propose a protection scheme that identifies the minimal set of measurements necessary to constrain the GFDI output to high graph TV, thereby enabling its detection by existing GSP-based detectors. Our numerical simulations on the IEEE-57 bus test case reveal the potential threat posed by well-designed GSP-based FDI attacks. Moreover, we demonstrate that integrating the proposed protection design with GSP-based detection can lead to significant hardware cost savings compared to previous designs of protection methods against FDI attacks.

Morgenstern, Gal↗
DOE OSTI2025

rmon (Resource monitor) [SWR-24-128]

The resource monitor application provides monitoring, collection, and visualization of resource utilization in compute nodes. This package contains utilities to monitor system resource utilization (CPU, memory, disk, network). Here are the ways you can use it: -Monitor resource utilization for a compute node for a given set of resource types and process IDs. -Start a process and monitor its resource utilization. -Monitor resource utilization for a compute node asynchronously with the ability to dynamically change the resource types and process IDs being monitored. -Produce JSON reports of aggregated metrics. -Produce interactive HTML plots of the statistics.

Thom, Daniel [National Renewable Energy Laboratory↗
DOE OSTI2023

2022 LANL Radionuclide Air Emissions Report (Rev. 2)

This report describes the emissions of airborne radionuclides from operations at Los Alamos National Laboratory (LANL) for calendar year 2022 and the resulting off-site dose from these emissions. This document fulfills the requirements established by the National Emissions Standards for Hazardous Air Pollutants in 40 CFR 61, Subpart H – Emissions of Radionuclides other than Radon from Department of Energy Facilities, commonly referred to as the Radionuclide NESHAP or Rad-NESHAP. Compliance with this regulation and preparation of this document is the responsibility of LANL’s Rad NESHAP compliance program, which is part of the Environmental Protection and Compliance (EPC) Division. The information in this report is required under the Clean Air Act and is being submitted to the U.S. Environmental Protection Agency (EPA) Headquarters and EPA Region 6. The highest effective dose equivalent (EDE) to an off-site member of the public was calculated using procedures specified by the EPA and described in this report. LANL’s EDE was 0.45 for 2022. The annual limit is 10 millirem per year, established by the EPA in 40 CFR 61 Subpart H. All measured air emissions are modeled to a single location, known as the Maximally Exposed Individual (MEI). During calendar year 2022, LANL continuously monitored radionuclide emissions at 27 “major” release points, or stacks. The Laboratory estimates emissions from an additional 34 “minor” release points using radionuclide usage source terms in lieu of stack monitoring. Also, LANL uses an EPA approved network of air samplers around the Laboratory perimeter to monitor ambient airborne levels of radionuclides. To provide data for dispersion modeling and dose assessment, LANL maintains and operates several meteorological monitoring towers. From these various systems, a comprehensive evaluation is conducted to calculate the MEI dose for the Laboratory. The MEI can be any member of the public at any off-site location where there is a residence, school, business, or office. In 2022, this MEI location was a business at 95 Entrada Drive, located in the eastern end of Los Alamos town site. The primary contributors to the off-site dose at this location are the ambient air data at that location combined with radioactive gas emissions from the LANSCE facility and the collected potential emissions from unmonitored (minor) sources. Overall, the MEI dose in 2022 is similar to that which has been observed in recent years, and it remains well below the EPA’s 10 millirem per year limit. Doses reported to the EPA for the past 10 years are shown in Table E1.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Notice of Submittal – 2023 Radionuclide Air Emissions Report for Los Alamos National Laboratory

This report describes the emissions of airborne radionuclides from operations at Los Alamos National Laboratory (LANL) for calendar year 2023 and the resulting off-site dose from these emissions. This document fulfills the requirements established by the National Emissions Standards for Hazardous Air Pollutants in 40 CFR 61, Subpart H – Emissions of Radionuclides other than Radon from Department of Energy Facilities, commonly referred to as the Radionuclide NESHAP or Rad-NESHAP. Compliance with this regulation and preparation of this document is the responsibility of LANL’s Rad NESHAP compliance program, which is part of the Environmental Protection and Compliance (EPC) Division. The information in this report is required under the Clean Air Act and is being submitted to the U.S. Environmental Protection Agency (EPA) Headquarters and EPA Region 6. The highest effective dose equivalent (EDE) to an off-site member of the public was calculated using procedures specified by the EPA and described in this report. LANL’s EDE was 0.43 for 2023. The annual limit is 10 millirem per year, established by the EPA in 40 CFR 61 Subpart H. All measured air emissions are modeled to a single location, known as the Maximally Exposed Individual (MEI). During calendar year 2023, LANL continuously monitored radionuclide emissions at 28 “major” release points, or stacks. The Laboratory estimates emissions from an additional 59 “minor” release points using radionuclide usage source terms in lieu of stack monitoring. Also, LANL uses an EPA approved network of air samplers around the Laboratory perimeter to monitor ambient airborne levels of radionuclides. To provide data for dispersion modeling and dose assessment, LANL maintains and operates several meteorological monitoring towers. From these various systems, a comprehensive evaluation is conducted to calculate the MEI dose for the Laboratory. The MEI can be any member of the public at any off-site location where there is a residence, school, business, or office. In 2023, this MEI location was a business at 129 New Mexico State Road 4 (NM-4), located in the northern end of White Rock. The primary contributors to the off-site dose at this location are the ambient air data at that location combined with the collected potential emissions from unmonitored (minor) sources. Overall, the MEI dose in 2023 is similar to that which has been observed in recent years, and it remains well below the EPA’s 10 millirem per year limit. Doses reported to the EPA for the past 10 years are shown in Table E1.

54 ENVIRONMENTAL SCIENCES↗