Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Edge at the Pier: EPCAPE Software-Defined Sensing Field Campaign Report

The Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) was aimed to enhance the understanding of cloud and aerosol properties in the region surrounding La Jolla, California. To address challenges in data collection and processing from various instruments, an edge computing device known as Waggle Sage Node (WSN) was deployed at the Ellen Browning Scripps Memorial Pier. WSN is a distributed-sensing platform designed to collect and analyze environmental data at the edge. Sage is a multi-agency-supported project that designs and builds a new kind of national-scale reusable cyberinfrastructure to enable artificial intelligence (AI) at the edge based on the Waggle platform. Sponsors include the U.S. Department of Energy (DOE) Advanced Scientific Computing Research (ASCR), DOE National Nuclear Security Administration (NNSA), DOE Biological and Environmental Research (BER) through DOE Artificial Intelligence for Earth System Predictability (AI4ESP), Argonne Laboratory-Directed Research and Development (LDRD). Sage (https://sagecontinuum.org/) is funded as a National Science Foundation Mid-Scale Research Infrastructure (MSRI) project (https://www.nsf.gov/awardsearch/showAward?AWD_ID=1935984). This robust, multi-architecture edge computing platform facilitated environmental monitoring during the campaign. This report details the scientific objectives, deployment process, and key results of integrating Waggle into the EPCAPE field campaign.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Optimization-Based Resiliency Verification in Microgrids via Maximal Adversarial Set Characterization

Critical energy infrastructures are increasingly relying on advanced sensing and control technologies for efficient and optimal utilization of flexible energy resources. Algorithmic procedures are needed to ensure that such systems are designed to be resilient to a wide range of cyber-physical adversarial events. This paper provides a robust optimization framework to quantify the largest adversarial perturbation that a system can accommodate without violating pre-specified resiliency metrics. We formulate the maximal adversarial set characterization as a bi-level optimization problem which is solved via Lagrangian relaxations.We illustrate the proposed algorithm on an islanded microgrid example: a modified IEEE 123-node feeder with distributed energy resources. Simulations are carried out to characterize the tolerable adversarial perturbations for varying levels of available flexibility (energy reserves).

Nazir, Mohammad Nawaf↗
NASA NTRS2012

Alternative Fuels Research Laboratory

NASA Glenn has invested over $1.5 million in engineering, and infrastructure upgrades to renovate an existing test facility at the NASA Glenn Research Center (GRC), which is now being used as an Alternative Fuels Laboratory. Facility systems have demonstrated reliability and consistency for continuous and safe operations in Fischer-Tropsch (F-T) synthesis and thermal stability testing. This effort is supported by the NASA Fundamental Aeronautics Subsonic Fixed Wing project. The purpose of this test facility is to conduct bench scale F-T catalyst screening experiments. These experiments require the use of a synthesis gas feedstock, which will enable the investigation of F-T reaction kinetics, product yields and hydrocarbon distributions. Currently the facility has the capability of performing three simultaneous reactor screening tests, along with a fourth fixed-bed reactor for catalyst activation studies. Product gas composition and performance data can be continuously obtained with an automated gas sampling system, which directly connects the reactors to a micro-gas chromatograph (micro GC). Liquid and molten product samples are collected intermittently and are analyzed by injecting as a diluted sample into designated gas chromatograph units. The test facility also has the capability of performing thermal stability experiments of alternative aviation fuels with the use of a Hot Liquid Process Simulator (HLPS) (Ref. 1) in accordance to ASTM D 3241 "Thermal Oxidation Stability of Aviation Fuels" (JFTOT method) (Ref. 2). An Ellipsometer will be used to study fuel fouling thicknesses on heated tubes from the HLPS experiments. A detailed overview of the test facility systems and capabilities are described in this paper.

Surgenor, Angela D.↗
NASA NTRS2017

Automated Mapping of Flood Events in the Mississippi River Basin Utilizing NASA Earth Observations

The Mississippi River Basin is the fourth largest drainage basin in the world, and is susceptible to multi-level flood events caused by heavy precipitation, snow melt, and changes in water table levels. Conducting flood analysis during periods of disaster is a challenging endeavor for NASA's Short-term Prediction Research and Transition Center (SPoRT), Federal Emergency Management Agency (FEMA), and the U.S. Geological Survey's Hazards Data Distribution Systems (USGS HDDS) due to heavily-involved research and lack of manpower. During this project, an automated script was generated that performs high-level flood analysis to relieve the workload for end-users. The script incorporated Landsat 8 Operational Land Imager (OLI) tiles and utilized computer-learning techniques to generate accurate water extent maps. The script referenced the Moderate Resolution Imaging Spectroradiometer (MODIS) land-water mask to isolate areas of flood induced waters. These areas were overlaid onto the National Land Cover Database's (NLCD) land cover data, the Oak Ridge National Laboratory's LandScan data, and Homeland Infrastructure Foundation-Level Data (HIFLD) to determine the classification of areas impacted and the population density affected by flooding. The automated algorithm was initially tested on the September 2016 flood event that occurred in Upper Mississippi River Basin, and was then further tested on multiple flood events within the Mississippi River Basin. This script allows end users to create their own flood probability and impact maps for disaster mitigation and recovery efforts.

Bartkovich, Mercedes↗
NASA NTRSDate not supplied

Enabling Reliable, Fault-Tolerant Autonomous Lunar Habitats with High-Performance Spaceflight Computing

The lunar surface presents unfavorable constraints and harsh living conditions. To address these challenges, autonomous habitats will require complex integrated systems that combine advanced software, high-performance hardware, and cutting-edge sensors to ensure sustainability, safety, and operational efficiency. Consequently, maintaining a sustainable presence on the Moon requires reliable infrastructure and efficient development, precise monitoring, and utilization of resources within a lunar installation. These elements are essential not only to ensure that lunar settlement can be long-term, self-sustaining, and resource-efficient, but also to serve as a foundation for future missions and eventual human habitation on Mars. Humans are not native to the Moon; therefore, our survival and ability to thrive will depend on autonomous systems that can foster safety and resilience through high-availability architectures, graceful degradation, and highly fault-tolerant spaceflight hardware capable of continuing operation during failures. This requires advanced human-rated distributed systems architectures with specialized electronics, scalable capabilities, and an integrated design approach. Unlike current practices focused on short-term missions and regularly maintained components, permanent lunar compute systems must be designed for extended operations beyond mission durations. This paper explores the necessity of transitioning toward fault- tolerant, highly autonomous hardware systems designed for multi-year missions. It also identifies critical subsystems that require high levels of autonomy, supported by radiation-hardened processors and extreme thermal loads, which are essential to mitigate long-term degradation and ensure sustainable lunar habitation. Finally, the paper aligns with NASA’s identified Civil Space Shortfalls, particularly in high-performance onboard computing, advanced data acquisition, extreme-environment avionics, radiation monitoring and countermeasures, and autonomous health management. It proposes NASA’s new High-Performance Spaceflight Computing (HPSC) processor as a turnkey solution, delivering 100 times the performance-per-watt of legacy rad-hard CPUs and enabling onboard AI, edge computing, and fault-tolerant features essential for sustained lunar autonomy and beyond.

Sarkis S Mikaelian↗
NASA NTRSDate not supplied

Storm Chasing from Space: Detecting severe weather phenomena from satellite platforms

Severe weather is an awe-inspiring phenomenon that affects the entire globe. Lightning, hail, damaging wind and tornadoes pose threats to society and challenges to the scientific community. Severe weather is annually responsible for tens of billions of dollars in insured losses to property, infrastructure, and agriculture. Satellite platforms offer a globally uniform approach to observing weather phenomena in remote or data-sparse regions and over the oceans. Severe convection exhibits distinct signatures in spaceborne datasets that we use to analyze severe storms. We leverage these signatures create climatologies, improve prediction, and provide a method of detection around the globe where traditional ground-based data (such as ground-based radar or human-spotter reports) are inconsistent or unavailable. Satellites in low-earth, sun-synchronous, and geostationary orbit provide a consistent, global view of severe weather from which we can examine the current global distribution, frequency, and severity of severe storms and establish a baseline to assess their future trend in a changing Earth system.

Sarah D. Bang↗
NASA NTRSDate not supplied

Storm Chasing from Space: Detecting Severe Weather Phenomena from Satellite Platforms

Severe weather is an awe-inspiring phenomenon that affects the entire globe. Lightning, hail, damaging wind and tornadoes pose threats to society and challenges to the scientific community. Severe weather is annually responsible for tens of billions of dollars in insured losses to property, infrastructure, and agriculture. Satellite platforms offer a globally uniform approach to observing weather phenomena in remote or data-sparse regions and over the oceans. Severe convection exhibits distinct signatures in spaceborne datasets that we use to analyze severe storms. We leverage these signatures create climatologies, improve prediction, and provide a method of detection around the globe where traditional ground-based data (such as ground-based radar or human-spotter reports) are inconsistent or unavailable. Satellites in low-earth, sun-synchronous, and geostationary orbit provide a consistent, global view of severe weather from which we can examine the current global distribution, frequency, and severity of severe storms and establish a baseline to assess their future trend in a changing Earth system.

Sarah D Bang↗
NASA NTRS2007

Spatial Aspects of Multi-Sensor Data Fusion: Aerosol Optical Thickness

The Goddard Earth Sciences Data and Information Services Center (GES DISC) investigated the applicability and limitations of combining multi-sensor data through data fusion, to increase the usefulness of the multitude of NASA remote sensing data sets, and as part of a larger effort to integrate this capability in the GES-DISC Interactive Online Visualization and Analysis Infrastructure (Giovanni). This initial study focused on merging daily mean Aerosol Optical Thickness (AOT), as measured by the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the Terra and Aqua satellites, to increase spatial coverage and produce complete fields to facilitate comparison with models and station data. The fusion algorithm used the maximum likelihood technique to merge the pixel values where available. The algorithm was applied to two regional AOT subsets (with mostly regular and irregular gaps, respectively) and a set of AOT fields that differed only in the size and location of artificially created gaps. The Cumulative Semivariogram (CSV) was found to be sensitive to the spatial distribution of gap areas and, thus, useful for assessing the sensitivity of the fused data to spatial gaps.

Leptoukh, Gregory↗
DOE OSTI2022

Grid Edge Visibility: Gaps and a Road Map

Behind-The-Meter (BTM) resources at the grid edge are rapidly becoming an important component of the electric grid, requiring a substantial reconfiguration of traditional grid practices, such as policy changes, market redesign, and infrastructure upgrades. This adjustment is challenged by the fact that, by definition, grid edge elements are not easily observable by grid control entities. Increasing the visibility of these resources is therefore an important goal, one that is experiencing much research and discussion by various power system stakeholders. For example, policy makers are analyzing the tradeoffs of using grid edge meters to impose charges on grid edge electricity generation. System operators, such as the Midcontinent Independent System Operator (MISO) in the United States, can identify visibility information on the electrical location and the size of the grid edge resources as a critical consideration across the transmission-and-distribution (T&D) spectrum. This article summarizes the challenges and needs of grid entities resulting from the introduction of grid edge resources as well the gaps in the extant grid edge visibility frameworks.

behind-the-meter↗
DOE OSTI2021

Emerging Energy Market Analysis Initiative, Methodological Framework

Planning and operations of the electric power sector are undergoing radical changes. Climate change mitigation efforts have forced rapid changes to the technology mix. Technologies like wind and solar have experienced rapid growth, while investment in fossil sources has peaked or is declining. These foundational changes are forcing changes to energy systems. Demand-side adoption of electrified technologies, including electric vehicles, is changing load profiles and opening up new avenues for consumer participation in the power systems. The implications of an evolving power system pertain to more than environmental and technical dimensions. Changes to the generation mix and its consequent upstream and downstream impacts such as fuel production have significant and highly concentrated consequences on economies and employment. Shifts towards distributed (or decentralized) generating assets offer the potential to reshape economic and employment opportunities associated with the energy sector across space and socioeconomic groups. The Emerging Energy Market Analysis (EMA) initiative aims to identify sustainable, regionally acceptable, and high-value energy solutions that are secure and equitable. Unlike short-term, least-cost choices that can narrowly account for traditional options, EMA’s focus on emerging energy markets recognizes that new or adapted practices and technologies can alter the frontier of solutions and advance a community’s social, economic, and natural pathways. Such change requires a more comprehensive analysis of societal input, resources, capabilities, and infrastructure. These considerations lay the foundation for community decision-making models that are responsive to community values as well as the history and drivers. The result is a community-based decision and engagement model that will be valuable to decisionmakers and developers of advanced and emerging energy solutions, seeking a social license to operate prior to project development.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Large-scale Hydrogen Storage – Risk Assessment Seattle City Light and Port of Seattle [Abstract]

This CRADA presents the strategy that Pacific Northwest National Laboratory (PNNL) and Sandia National Laboratories (SNL) will take to support Seattle City Light (SCL), and the Port of Seattle (Port) in performing a risk assessment of large-scale hydrogen storage. Risk assessment is often used to ensure that adequate measures are taken to protect workers and the public, the environment, infrastructure, and assets. A detailed risk assessment can also be used to direct funding and upgrades, to specific components and sub-systems in order to mitigate risks to the larger system. In this way risk assessments are often employed as a part of a larger risk management strategy, with the goal of minimizing the occurrence of hazards and to identify means to limit their consequences. Risk assessment is often used to engage and inform regulators, and to communicate how specific regulations are being met. However, it is important to note that the proposed work is not intended for SCL and the Port to use in order to gain regulatory acceptance for their proposed activities. The work performed as a part of this effort will be a preliminary risk assessment for early-stage component and system designs and should be considered research and development (R&D). As such, the proposed work will be performed to a quality level and design maturity consistent with R&D and is not considered appropriate for final safety analysis and regulatory compliance purposes. Previous and on-going work at SCL and the Port demonstrated the utility of deploying hydrogen systems at the Port. The deployment of hydrogen at the Port is a part of a larger vision of using hydrogen to address a range of issues for SCL and the Port. These include large-scale fueling of MD/HD vehicles, cargo-handling equipment (CHE), and harbor vessels to reduce emissions; support of adjacent LD vehicles; support of critical port operations during extreme events (i.e., resiliency); deferral of more capital- and time-intensive electrical distribution system upgrades while still supporting evolving port operations and decarbonization efforts; facilitating electrification by establishing energy storage as a grid resource, starting at strategic port locations; creation of a flexible market resource that can be used by SCL to generate revenue via arbitrage; support of planned future maritime operations that involve heavy use of hydrogen for ocean-going vessels; and future end-use applications involving natural gas pipeline hydrogen injection. Ultimately, the success of these activities is underpinned by the deployed storage capacity. Large-scale deployment of hydrogen systems will require hydrogen storage at a scale that has not been demonstrated. In addition, the ideal location for such multi-use systems is near the end user which will often necessitate deploying into urban and/or industrial areas. A detailed risk assessment using the Port as a test case is necessary to ensure the deployment of large-scale hydrogen is successful. Many technologies have been proposed for hydrogen storage; however, these technologies need to be analyzed as they apply to an actual site. The physical infrastructure and hydrogen use cases for the Port will be analyzed, and a risk assessment for compressed hydrogen, liquified hydrogen, and Liquid Organic Hydrogen Carrier (LOHC) storage will be performed. These risk assessments will be useful for understanding how each of these technologies would perform in terms of facility and public safety. The operating states of the proposed hydrogen systems at the Port will be analyzed and incorporated into the storage risk assessment. Scalability will also be analyzed to understand how future port uses would affect the overall risk assessment. Finally, using the risk assessment as a tool to inform engagement and to gain stakeholder acceptance will be explored.

08 HYDROGEN↗
DOE OSTI2022

Bayesian model updating with finite element vs surrogate models: Application to a miter gate structural system

Bayesian finite element (FE) model updating using direct model evaluations of large-scale high-fidelity FE models is extremely computationally expensive. Surrogate models can be used as fast emulators of FE models to accelerate the model calibration process. The physics/mechanics-based FE models are still the underpinning behind the surrogate models. Here, this paper evaluates the loss in accuracy and the gain in computational time while performing Bayesian model updating by using surrogate model evaluations compared to using direct FE model evaluations. This evaluation is crucial before entirely relying on surrogate models in model updating for structural health monitoring (SHM) and damage prognosis (DP) purposes. This paper also demonstrates Bayesian updating and surrogate model construction of large-scale high-fidelity FE models of infrastructure systems. In this regard, the miter gate structural system is considered as the testbed structure. Three predominant damage modes (loss of contact between gate and wall, loss of thickness due to corrosion, and loss of tension in the diagonal rods) are considered for model updating purposes. Bayesian model updating is performed using direct FE evaluations by leveraging parallel computing. Two types of surrogates, namely polynomial chaos expansion (PCE) and Gaussian process regression (GPR), are developed for the miter gate. Model updating is performed again using the trained surrogate models, and the updating results are compared with their counterparts obtained using the direct FE evaluation results. The posterior distribution of the FE model parameters obtained using the trained surrogates are sufficiently accurate with respect to the posterior obtained utilizing the direct FE evaluations. In addition, an approximate 4-fold decrease in the computational time was observed when using surrogate model evaluations instead of direct FE evaluations for model updating.

42 ENGINEERING↗
DOE OSTI2021

Sensitivity of Infrastructure Sectors to the Disruption of Commercial Electric Power

Electric power is crucial to the function of other infrastructures, as well as to the stability of the economy and the social order. Disruption of commercial electric power service, even for brief periods of time, can create significant consequences to the function of other sectors, and make living in some environments untenable. This analysis, conducted in 2017 for the United States Department of Energy (DOE) as part of the Grid Modernization Laboratory Consortium (GMLC) Initiative, focuses on describing the function of each of the other infrastructure sectors and subsectors, with an eye towards those elements of these sectors that depend on primary electric power service through the commercial electric power grid. It leverages the experience of Sandia analysts in analyzing historical disruptive events, and from the development of capabilities designed to identify the physical, logical, and geographic connectivity between infrastructures. The analysis goes on to identify alternatives for the provision of primary electric power service, and the redundancy of said alternatives, to provide a picture of the sector’s ability to withstand an extended disruption.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Evaluation of a high-resolution regional climate simulation for surface and hub-height wind climatology over North America

Assessing the availability of key wind resources requires augmenting observations to support the implementation of wind energy infrastructure. However, observations are limited, necessitating the development of high-resolution, long-term gridded datasets. This study presents a robust, dynamically downscaled climatological dataset, offering 20 years of hourly wind data at a 4 km spatial resolution across North America, and evaluates its performance against observations, including meteorological towers and automated surface-observing system (ASOS) stations, as well as coarse-resolution reanalysis data (the European Centre for Medium-Range Weather Forecasts (ECMWF) reanalysis version 5 (ERA5)). Results demonstrate that the downscaled high-resolution wind data outperform ERA5 in regions of complex terrain and coastal areas, with improved overlap coefficients for wind data distributions and reduced root mean square errors (RMSEs) for hub-height and near-surface diurnal wind patterns. The downscaled simulation also captures the synoptic drivers of seasonal wind direction patterns reasonably well, indicated by high wind rose similarity indices. This study also provides an analysis of interannual variability, utilizing the dataset's full 20-year period, and model uncertainty, generated by varying model initial conditions and physics parameterizations across 1-year ensemble members, which are key considerations for wind resource assessment in wind farm development.

17 WIND ENERGY↗
NASA NTRS2011

Online Time Series Analysis of Land Products over Asia Monsoon Region via Giovanni

Time series analysis is critical to the study of land cover/land use changes and climate. Time series studies at local-to-regional scales require higher spatial resolution, such as 1km or less, data. MODIS land products of 250m to 1km resolution enable such studies. However, such MODIS land data files are distributed in 10ox10o tiles, due to large data volumes. Conducting a time series study requires downloading all tiles that include the study area for the time period of interest, and mosaicking the tiles spatially. This can be an extremely time-consuming process. In support of the Monsoon Asia Integrated Regional Study (MAIRS) program, NASA GES DISC (Goddard Earth Sciences Data and Information Services Center) has processed MODIS land products at 1 km resolution over the Asia monsoon region (0o-60oN, 60o-150oE) with a common data structure and format. The processed data have been integrated into the Giovanni system (Goddard Interactive Online Visualization ANd aNalysis Infrastructure) that enables users to explore, analyze, and download data over an area and time period of interest easily. Currently, the following regional MODIS land products are available in Giovanni: 8-day 1km land surface temperature and active fire, monthly 1km vegetation index, and yearly 0.05o, 500m land cover types. More data will be added in the near future. By combining atmospheric and oceanic data products in the Giovanni system, it is possible to do further analyses of environmental and climate changes associated with the land, ocean, and atmosphere. This presentation demonstrates exploring land products in the Giovanni system with sample case scenarios.

Shen, Suhung↗
NASA NTRS2017

Transforming Science Data for GIS: How to Find and Use NASA Earth Observation Data Without Being a Rocket Scientist

NASAs Earth Observing System Data Information System (EOSDIS) manages Earth Observation satellites and the Distributed Active Archive Centers (DAACs), where the data is stored and processed. The challenge is that Earth Observation data is complicated. There is plenty of data available, however, the science teams have had a top-down approach: define what it is you are trying to study -select a set of satellite(s) and sensor(s), and drill down for the data.Our alternative is to take a bottom-up approach using eight environmental fields of interest as defined by the Group on Earth Observations (GEO) called Societal Benefit Areas (SBAs): Disaster Resilience (DR) Public Health Surveillance (PHS) Energy and Mineral Resource Management (EMRM) Water Resources Management (WRM) Infrastructure and Transport Management (ITM) Sustainable Urban Development (SUD) Food Security and Sustainable Agriculture (FSSA) Biodiversity and Ecosystems Sustainability (BES).

DAAC↗
NASA NTRSDate not supplied

Tracing the Cosmic Energy Flow with Parker Solar Probe: Universal Processes

Heliophysics is inherently interdisciplinary, born from multiple subjects to understand how the Sun interacts with its surrounding environment. Heliophysicists and Astrophysicists seldom exchange ideas since the scientific infrastructure partitions research areas by spatial location in the cosmos. Parker Solar Probe (PSP) is sending back puzzling information in regions we have never been before, presenting an opportunity to search for answers in non-traditional ways that are inherently cross-disciplinary. The fundamental processes that govern the physics of the universe, such as wave-particle interactions, turbulence, magnetic reconnection, and shocks, are mechanisms to study cosmic energy flow. We present PSP observations that may enable us to assess the universality of these fundamental processes in – and across boundaries of –various space and astrophysical regimes. Specifically, we focus on the exotic shapes of proton velocity distribution functions and subsequent evolution leading to multi-scale wave generation and particle acceleration. We welcome ideas, tools, and methodologies from all disciplines to understand the systems of systems governing our universe.

J L Verniero↗
DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗