Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Continuous Emulation and Multiscale Visualization of Traffic Flow Using Stationary Roadside Sensor Data

With the advent of the next-generation traffic monitoring systems, there has been a significant increase in the spatial-temporal resolution of vehicle mobility data in many cities. Effective analysis and visualization of such data can provide transportation planners with data-driven insights, which can facilitate the understanding of multiscale traffic dynamics. In this paper, we present a web-based traffic emulator for emulating and visualizing near-real-time and historical traffic flows on highways using data from road-side sensors. To construct a continuous traffic flow, the emulator adopts an analytical pipeline that can (a) integrate traffic data collected from discrete road-side radar detection sensors, (b) interpolate traffic conditions (vehicle speed and volume) on unmeasured road segments based on traffic flow theory, and (c) generate lane-specific vehicle trajectories and movements using a mathematically optimized representation of the road network. Our app also provides an integrated visual workflow that allows users to explore the interconnected traffic dynamics using an appropriate traffic flow visualization selected based on the level of detail. We devise two innovative geo-visualization techniques that utilize an animated strips-network representation and a lane usage matrix to visualize lane performances. To ensure a smooth emulation of large-scale traffic flow in an easy-to-access web environment, we implement the emulator using client-side GPU-accelerated techniques. Lastly, we close with a case study that visualizes traffic dynamics of two scenarios - an afternoon peak hour and a traffic accident - in Chattanooga, Tennessee. Our app visualizes the responses of traffic dynamics during different traffic conditions, and to the presence of the traffic accident at different spatial scales.

42 ENGINEERING↗
DOE OSTI2025

Predicting runtime and resource utilization of jobs on integrated cloud and HPC systems

Recent advances in virtualization technologies used in cloud computing offer performance that closely approaches bare-metal levels. Combined with specialized instance types and high-speed networking services for cluster computing, cloud platforms have become a compelling option for high-performance computing (HPC). However, most current batch job schedulers in HPC systems are designed for homogeneous clusters and make decisions based on limited information about jobs and system status. Scientists typically submit computational jobs to these schedulers with a requested runtime that is often over- or under-estimated. More accurate runtime predictions can help schedulers make better decisions and reduce job turnaround times. Here, they can also support decisions about migrating jobs to the cloud to avoid long queue wait times in HPC systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Cross-Layered Cyber-Physical Power System State Estimation towards a Secure Grid Operation

In the Smart Grid paradigm, this critical infrastructure operation is increasingly exposed to cyber-threats due to the increased dependency on communication networks. An adversary can launch an attack on a power grid operation through False Data Injection into system measurements and/or through attacks on the communication network, such as flooding the communication channels with unnecessary data or intercepting messages. A cross-layered strategy that combines power grid data, communication grid monitoring and Machine Learning based processing is a promising solution for detecting cyberthreats. In this paper, an implementation of an integrated solution of a cross-layer framework is presented. The advantage of such a framework is the augmentation of valuable data that enhances the detection of anomalies in the operation of power grid. IEEE 118-bus system is built in Simulink to provide a power grid testing environment and communication network data is emulated using SimComponents. The performance of the framework is investigated under various FDI and communication attacks.

cyber security, network security, cyber-physical s↗
NASA NTRS1980

A satellite communications system for electric utilities

This paper presents the results of a study into the feasibility of using satellite communications for a country-wide system of electric distribution system monitoring and control. The concept selected for study involves the use of a geostationary satellite with a large multi-beam antenna to provide a major part of the communications and control network between participating utilities and various elements of their power distribution networks, including customer loads. Electric utility communications requirements are projected through 1995 in order to size the required capacity of the system. Two basic systems are examined: a one-way system for load control, and a two-way system for distribution system monitoring and control, including customer meter reading. An operating protocol is proposed for each system. Preliminary cost estimates are identified element by element. Finally, expansion of the basic system to include a set of ancillary communications functions is briefly discussed.

Vaisnys, A.↗
NASA NTRS2011

Future Opportunities and Challenges in Remote Sensing of Drought

The value of satellite remote sensing for drought monitoring was first realized more than two decades ago with the application of Normalized Difference Index (NDVI) data from the Advanced Very High Resolution Radiometer (AVHRR) for assessing the effect of drought on vegetation. Other indices such as the Vegetation Health Index (VHI) were also developed during this time period, and applied to AVHRR NDVI and brightness temperature data for routine global monitoring of drought conditions. These early efforts demonstrated the unique perspective that global imagers such as AVHRR could provide for operational drought monitoring through their near-daily, global observations of Earth's land surface. However, the advancement of satellite remote sensing of drought was limited by the relatively few spectral bands of operational global sensors such as AVHRR, along with a relatively short period of observational record. Remote sensing advancements are of paramount importance given the increasing demand for tools that can provide accurate, timely, and integrated information on drought conditions to facilitate proactive decision making (NIDIS, 2007). Satellite-based approaches are key to addressing significant gaps in the spatial and temporal coverage of current surface station instrument networks providing key moisture observations (e.g., rainfall, snow, soil moisture, ground water, and ET) over the United States and globally (NIDIS, 2007). Improved monitoring capabilities will be particularly important given increases in spatial extent, intensity, and duration of drought events observed in some regions of the world, as reported in the International Panel on Climate Change (IPCC) report (IPCC, 2007). The risk of drought is anticipated to further increase in some regions in response to climatic changes in the hydrologic cycle related to evaporation, precipitation, air temperature, and snow cover (Burke et al., 2006; IPCC, 2007; USGCRP, 2009). Numerous national, regional, and global efforts such as the Famine and Early Warning System (FEWS), National Integrated Drought Information System (NIDIS), and Group on Earth Observations (GEO), as well as the establishment of regional drought centers (e.g., European Drought Observatory) and geospatial visualization and monitoring systems (e.g, NASA SERVIR) have been undertaken to improve drought monitoring and early warning systems throughout the world. The suite of innovative remote sensing tools that have recently emerged will be looked upon to fill important data and knowledge gaps (NIDIS, 2007; NRC, 2007) to address a wide range of drought-related issues including food security, water scarcity, and human health.

Wardlow, Brian D.↗
DOE OSTI2020

Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows (Final Report)

This proposal addresses a critical issue of performance prediction identified in the report from the ASCR \Computational Modeling of Big Networks (COMBINE)" workshop: "end-to-end performance is not predictable due to a variety of factors. Even when some performance forecasts or predictions can be made, they often cannot explain the reasons why some predictions fail." We will develop new analytical models to predict the end-to-end performance of scientific workflows on DOE computing infrastructures, and use simulations and experimentation to validate and refine these models, as well as to pinpoint the sources of model inaccuracy. We will also use these models to help diagnose application and infrastructure problems, and to adapt the system based on this diagnosis. This section provides background in the areas relevant to the proposed work. RPI’s specific tasks within the Panorama project are as follows: (1) Develop Aspen-Simulation interface for Workflow Model Driven Simulation. (2) Validate manual performance models of two target workflow scenarios with empirical measurement and simulation. (3) Extend ROSS-Aspen API to simulate workflow descriptions when required. (4) Validate Aspen performance models of two target workflow scenarios with automatic performance model empirical measurement and simulation. (5) Design and implement final system to automatically generate Aspen performance models from workflow descriptions (including methods to compensate for limitations of Aspen analytical models). (6) Validate improved Aspen performance models with target workflow on production infrastructure. To date, all the project milestones assigned to us where reached within the best of our abilities over the course of the project performance period. Below describes the key outcome from our collaborative research in a system named, Durango .

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Performance Monitoring of Distributed Data Processing Systems

Test and checkout systems are essential components in ensuring safety and reliability of aircraft and related systems for space missions. A variety of systems, developed over several years, are in use at the NASA/KSC. Many of these systems are configured as distributed data processing systems with the functionality spread over several multiprocessor nodes interconnected through networks. To be cost-effective, a system should take the least amount of resource and perform a given testing task in the least amount of time. There are two aspects of performance evaluation: monitoring and benchmarking. While monitoring is valuable to system administrators in operating and maintaining, benchmarking is important in designing and upgrading computer-based systems. These two aspects of performance evaluation are the foci of this project. This paper first discusses various issues related to software, hardware, and hybrid performance monitoring as applicable to distributed systems, and specifically to the TCMS (Test Control and Monitoring System). Next, a comparison of several probing instructions are made to show that the hybrid monitoring technique developed by the NIST (National Institutes for Standards and Technology) is the least intrusive and takes only one-fourth of the time taken by software monitoring probes. In the rest of the paper, issues related to benchmarking a distributed system have been discussed and finally a prescription for developing a micro-benchmark for the TCMS has been provided.

Ojha, Anand K.↗
DOE OSTI2025

15-minute Parker River gap-filled tide height and salinity data, PIE LTER, Plum Island Sound, MA (2014–2023), for ELM PFLOTRAN modeling

This dataset contains 15-minute tide height and salinity data from the Typha site along the Parker River, part of the Plum Island Ecosystems Long Term Ecological Research (PIE LTER) site in Plum Island Sound, Massachusetts (MA) 2014-2023. Tide height (in NAVD88) was compiled from measurements conducted at the mouth of Plum Island Sound and corrected for time lags. Gap-filling of missing periods were done by fitting tidal constituents to the time series. Salinity was measured (and is stored on ESS DIVE ) in 2022 and 2023 using HOBO U24-002 conductivity loggers. River discharge is the most important control on tidal river water salinity at the location (Vallino & Hopkinson, 1998). An artificial neural network was trained to predict river water salinity at the location using Parker River discharge (USGS station 01101000, Parker River at Byfield, MA) and gap-filled salinity observations from a long-term monitoring station ca. 3km downstream from the Typha site (LTER station ‘Middle Road’) as input variables to create continuous time series information. The data set was used in the spin up and simulations of a land surface model coupled to a biogeochemical reaction network (ELM PFLOTRAN) assessing impacts of hydrology and salinity input on methane fluxes in 2022 and 2023 (Sulman et al., 2024). Metadata files ELMPFLOTRAN_tide_salinity_dd.csv and ELMPFLOTRAN_tide_salinity_flmd.csv provide details on site location, data variables, and QA/QC methods .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Automatic Seismic Phase Picking Using Deep Learning for the EGS Collab project

Microseismic monitoring plays an important role in many energy-related and environmental industries.The microseismic event catalog and seismic structure of the subsurface are two of the primary outputsof the microseismic monitoring system. Though rough locations of microseismic events can be estimated automatically, obtaining high-resolution microseismic event locations requires a significant amount of human laborespecially on seismic phase picking. Unlike traditional automatic pickers that are usually less precise than human analysts, a fewrecently proposed algorithms based on deepneural networks(DNN)were able to match or surpass human performance for earthquake signals. Due to differences in the spatial scale of the study area, sensor sampling rate, and geometry of the monitoring system, it is not clear whether these deepneural networkmodels can be used to speed up microseismic data processing. In this paper, we adapted the DNN based technique for automatic phase picking of microseismic signals. We usedmicroseismic data recorded at the experiment 1 site of the enhancedgeothermal system (EGS) Collab project anddesigneda workflowthat we call transfer-learning aided double-difference tomography (TADT),thatcombines transfer learning and seismic tomography. We re-train an existing DNN with our data to obtain a newmodel using around 3500 seismogramsand associated manual phase picks. Thistransfer learnedmodel is able to reach human performance but muchfaster than human analysts. The transfer-learning-derived phase pickswereused to improve microseismic event locations and imagethesubsurface. The results are similar to or slightly better than those obtained with manual phase picks.

Chai, Chengping↗
DOE OSTI2022

Demonstrating Distribution System Resiliency through Grid-Edge Microgrids, on a Multi-Site Networked Hardware-in-Loop Platform

With the increasing penetration of Distributed Energy Resources (DERs) at the grid-edge, power systems include more energy storage, remote switches, relays, voltage regulators, and other intelligent electronic devices (IED). Effective control of these grid-edge devices by using Advanced Distribution Management Systems (ADMS) can yield substantial improvements to the resiliency and power quality of distribution systems. In this paper, improvements to the resiliency of a distribution system are demonstrated using a multi-site evaluation environment consisting of a real-time Hardware-in-Loop (HIL) setup in which DERs and other IEDs are modeled; and an ADMS which monitors and is able to control the distribution system assets. The HIL model and the ADMS are located 2400 km away, with communication between the sites enabled by a data manager using Distributed Network Protocol 3 (DNP3), demonstrating the system's capabilities even over long distances. After a simulated transmission system failure in the HIL demonstration setup, DERs and other devices are operated to restore critical loads and node voltage profile (to within the 'nominal +/-5%' band) in the distribution system.

ADMS↗
DOE OSTI2026

Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy

Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .

Engineering↗
DOE OSTI2024

Intelligent Hierarchical Resilient Operation of Distribution Systems: Implementation and Validation in a Power Hardware-in-the-Loop Simulation Testbed

This paper reports on the structure of a power hardware-in-the-loop (PHIL) simulation testbed that implements, tests, and validates a novel AI-based hierarchical resilient operation model for distribution systems. The testbed implements the central and distributed controllers of the hierarchical resilient operation model and integrates a Digital Real-Time Simulator (DRTS), protective relays, a Real-Time Automation Controller (RTAC), a Software Defined Network (SDN) switch, and a battery energy storage (BES) system. The testbed provides comprehensive real-time visualization and monitoring capability as an advanced situational awareness and operator interface solution. The IEEE 33-node system is used as a test case to test and validate the operation of the model in normal operation and recovery operation after major outages in a fully automated fashion.

Ganjkhani, Mehdi↗
DOE OSTI2025

Transformers and Long Short-Term Memory Transfer Learning for GenIV Reactor Temperature Time Series Forecasting

Automated monitoring of the coolant temperature can enable autonomous operation of generation IV reactors (GenIV), thus reducing their operating and maintenance costs. Automation can be accomplished with machine learning (ML) models trained on historical sensor data. However, the performance of ML usually depends on the availability of large amount of training data, which is difficult to obtain for GenIV, as this technology is still under development. We propose the use of transfer learning (TL), which involves utilizing knowledge across different domains, to compensate for this lack of training data. TL can be used to create pre-trained ML models with data from small-scale research facilities, which can then be fine-tuned to monitor GenIV reactors. In this work, we develop pre-trained Transformer and long short-term memory (LSTM) networks by training them on temperature measurements from thermal hydraulic flow loops operating with water and Galinstan fluids at room temperature at Argonne National Laboratory. The pre-trained models are then fine-tuned and re-trained with minimal additional data to perform predictions of the time series of high temperature measurements obtained from the Engineering Test Unit (ETU) at Kairos Power. The performance of the LSTM and Transformer networks is investigated by varying the size of the lookback window and forecast horizon. The results of this study show that LSTM networks have lower prediction errors than Transformers, but LSTM errors increase more rapidly with increasing lookback window size and forecast horizon compared to the Transformer errors.

LSTM↗
NASA NTRS1977

Battery peak-charge voltage monitor

Monitor was designed for use on dual air density satellite, utilizing standard integrated circuit components, thin-film resistors network, plus several passive components. Device measures unit charge and holds data for transmission at later time.

Shull, T. A.↗
NASA NTRS1978

Development of automated power system management techniques

The basic approach in the automated power system management (APSM) implementation is to use one central microprocessor for the overall power system supervision and several local microprocessors dedicated to one or more major subassemblies to perform simple monitoring and control functions. Communication between the central and each local processor is through a dedicated two-wire network employing serial data transfer. The block diagrams of the processors, the data bus characteristics, and the software functions and organization are presented.

Imamura, M. S.↗
NASA NTRS1982

Analysis of DSN PPM support during Voyager 2 Saturn encounter

The precision power monitor (PPM) is a precision radiometric instrument used to improve the efficiency of signal reception by the Deep Space Network. Real time estimates of the system operating temperature, the present (signal + noise)-to-noise ratio, and the signal power are utilized to increase the accuracy and resolution of the received spacecraft signal. Due to the critical nature of radio science data returning from Voyager 2 at Saturn Encounter, PPM support was required. The task was undertaken to validate the performance of equipment technically under research and development in time to meet the encounter deadline. Initial studies revealed PPM performance to be out of tolerance. Action was immediately taken to identify the system problems. Using data analysis as feedback, the system failures were identified and corrected in time to contribute to the encounter support efforts. As a result, the radio science data were collected successfully.

Bartok, C. D.↗
NASA NTRS1988

Meteorological aspects of cloud-to-ground lightning in the Kennedy Space Center region

This paper examines the meteorological environment in which cloud-to-ground lightning occurs at the Kennedy Space Center (KSC) region during summer. Using the lightning patterns of central Florida, flashes from individual thunderstorms were analyzed for five low-level wind regimes during three summers. The results showed large differences between the number, timing, and location of flashes for varying flow regimes, with southwest flow being the most prolific producer of flashes in the KSC area. In the second part of the study, short-term forecasts of lightning were investigated using the divergence measured by the KSC surface wind network. An interval of about 1 hour was found from the beginning of a convergence event to first lightning. Monitoring 5-min surface convergence, in combination with understanding the climatology of lightning related to the daily flow regime, made it possible to isolate the lightning. Results were used successfully in operations at KSC.

Holle, Ronald L.↗
NASA NTRS1990

A Solar Constant Model for Sun-climate Studies: 1600-2000AD

Discussed here is the solar constant model published recently (Schatten, 1988), but with a modified phasing and amplitude. This model enables the known solar constant variations to be calculated from known active region and quiet region solar parameters. The features which can be modelled are sunspots and faculae, the only two features which mark the photospheric continuum with their unusual contrast behavior. They include both the active region features (sunspots and faculae) and the quiet region features (global faculae). Although the direct influences of sunspots upon the solar constant leads to short term decreases, an opposite, nearly in phase, 11 year variation in the solar constant is modelled, thereby agreeing with the Active Cavity Radiometer Irradiance Monitor (ACRIM) and Earth Radiation Budget (ERB) secular trends observed. This opposite behavior results primarily from global faculae (polar, network, and active region). The main contributors to the global behavior are the network faculae. The model attributes the observed variations in the solar constant entirely to magnetic features in the solar atmosphere. The present model serves purely to model the secular (long term) trend in the solar constant. The model suggests a change of approx. 0.5 W/sq m for the differences between the late twentieth century solar constant and the 17th century solar constant. This supports Eddy's view that this difference could give rise to the glacial increase during the little ice age of the 17th century. Important for present day climate studies, is that it shows the recent peak activity (peaking in 1958) is associated with an atypically high value of the solar constant, with respect to the past few hundred years.

Schatten, Kenneth H.↗