SEARCH · Engineering Papers

Results for “spatial analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

All sources NASA NTRS DOE OSTI

DOE OSTI2025

IM3 Phase 2 Official Simulations: GCAM-Demeter-SELECT Annualized Land Use and Land Cover, Wood Harvest and Fertilization Data with Dynamic Urbanization Harmonized to CLM Land Definitions at 0.125 Degrees

Annualized land use land cover data, including wood harvest and fertilizer use data from the Global Change Analysis Model (GCAM) downscaled to 0.125 degrees for couping with the Community Land Model (CLM). GCAM here refers to GCAM-USA v5.3.im3 which has an enhanced electricity sector and an updated data system needed to represent regional to local scale dynamics. Data is also harmonized with future urbanization projections from the Spatially-Explicit, Long-term, Empirical City developmenT (SELECT) model. Projections/Data are generated using the demeter land use and land cover downscaling model. Original projections were generated at 0.05 degrees before being aggregared to 0.125 degrees. Projections are available for 8 alternative scenarios. Two versions of final data are included- one with managed forests or harvested forest area per pixel broken out and one with the same aggregated into total forests. Following folders are included: demeter_78_PFT_output:This is the final output of dynamic land use land cover change for 78 PFTs as required by CLM raw_outputs_incl_managed_forest: This is the final output but with managed forests broken out as a different PFT. Essentially a 79th PFT is added. wood_harvest_outputs: Wood harvest output per pixel in gC/m2 fertilization_outputs: Fertilizer use per pixel in gN/m2 Each NetCDF file in each folder represents a projection for a separate year, scenario. Land use outputs are organized as PFT level data saved as subdata. Link to GCAM version used- https://data.msdlive.org/records/yb23g-44274 Link to SELECT documentation -https://www.sciencedirect.com/science/article/pii/S1364815219301707 Link to CLM documentation- - https://www.cesm.ucar.edu/models/clm In case of questions contact- kanishka.narayan@pnnl.gov

GCAM-USA↗

DOE OSTI2020

Smart-DS: Synthetic Models for Advanced, Realistic Testing: Distribution Systems and Scenarios

The explosion of new ideas for distributed energy resources and advanced distribution grid algorithms faces a critical challenge: how can one effectively develop and evaluate these breakthrough technologies without an adequate set of power systems network, load, and resource data to test against? Today's open test systems, particularly for distribution systems, are tiny and incomplete; and though with enough effort, obtaining utility data under NDA can overcome scale challenges, the results can't be openly shared, preventing fair comparison. The Smart-DS project-led by NREL in partnership with MIT, Universidad Pontificia Comillas, CYME, and EDD-is working to overcome this gap by generating multiple large-scale, open, synthetic, distribution systems that are realistic but not real. These datasets go beyond a single medium voltage feeder (~1000 customers) to cover entire metropolitan areas and their surrounds with up to hundreds of feeders and millions of customers, complete with low voltage customer connections and high voltage sub-transmission. This scale allows adequate testing and analysis of not just local controls and advanced DERs, but also multiple substation interactions, optimized switching, full-scale distribution-OPF, and more. To accompany these datasets, the project is also building a rich set of scenario generation tools that can be used for distribution and transmission systems alike. This includes automated, spatially aware access to world-class, high-resolution solar, wind, and weather data: forward looking generation mixes: and highly configurable DER, load, climate, outage, control-scheme, and other scenarios. We will also highlight DiTTo, an exciting open-source, multi-way distribution dataset transformation tool for many-to-many format translation with scenario, merge/split, and many other manipulation capabilities.

DERs↗

DOE OSTI2025

PhotonIDs: ML-Powered Photon Identification System for Dark Count Elimination

Reliable single photon detection is the foundation for practical quantum communication and networking. However, today's superconducting nanowire single photon detector(SNSPD) inherently fails to distinguish between genuine photon events and dark counts, leading to degraded fidelity in long-distance quantum communication. In this work, we introduce PhotonIDs, a machine learning-powered photon identification system that is the first end-to-end solution for real-time discrimination between photons and dark count based on full SNSPD readout signal waveform analysis. PhotonIDs ~demonstrates: 1) an FPGA-based high-speed data acquisition platform that selectively captures the full waveform of signal only while filtering out the background data in real time; 2) an efficient signal preprocessing pipeline, and a novel pseudo-position metric that is derived from the physical temporal-spatial features of each detected event; 3) a hybrid machine learning model with near 98% accuracy achieved on photon/dark count classification. Additionally, proposed PhotonIDs ~ is evaluated on the dark count elimination performance with two real-world case studies: (1) 20 km quantum link, and (2) Erbium ion-based photon emission system. Our result demonstrates that PhotonIDs ~could improve more than 31.2 times of signal-noise-ratio~(SNR) on dark count elimination. PhotonIDs ~ marks a step forward in noise-resilient quantum communication infrastructure.

Linne, Karl C. [Chicago U.] (ORCID:000900091870358↗

DOE OSTI2024

Techno-economic analysis and network design for CO 2 conversion to jet fuels in the United States

The conversion of carbon dioxide (CO 2 ) into jet fuel holds significant potential for reducing CO 2 emissions, providing an alternative to carbon-based resources, and offering a renewable means of energy storage. The objective of this study is to conduct a techno-economic analysis and optimize the supply chain network for converting CO 2 to jet fuel in the United States, aiming to minimize total costs while assessing the environmental and economic feasibility of two CO 2 conversion pathways. This first pathway is based on Fischer-Tropsch synthesis (FTS), and the other one is based on the valorization and upgrading of light methanol (MeOH). Incorporating spatial and techno-economic data, a mixed-integer linear programming model was developed to select source plants and conversion pathways, locations of conversion refinery sites, and the amount of captured CO 2 across the United States. The optimal results indicate that the FTS pathway is adopted at all selected refineries when the hydrogen price is 1000 dollars/t and the operating cost, mainly electricity used in conversion, is reduced to 5 % of its current level. Under this scenario, the total annual profit is 8 billion dollars, and the net carbon emissions are -88,783,284 tons. The sensitivity analyses reveal that the prices of electricity and hydrogen significantly contribute to total production costs. The CO 2 recycle percentage of the FTS pathway influences the choice of applied pathways at refineries. Additionally, a higher conversion rate holds a substantial promise for reducing the total production cost and can make the MeOH pathway a viable choice.

10 SYNTHETIC FUELS↗

DOE OSTI2022

Nanoscale Antiferromagnetic Domain Imaging using Full-Field Resonant X-ray Magnetic Diffraction Microscopy

The physical properties of magnetic materials frequently depend not only on the microscopic spin and electronic structures, but also on the structures of mesoscopic length scales that emerge, for instance, from domain formations, or chemical and/or electronic phase separations. However, experimental access to such mesoscopic structures is currently limited, especially for antiferromagnets with net zero magnetization. Here, full-field microscopy and resonant magnetic X-ray diffraction are combined to visualize antiferromagnetic (AF) domains of the spin–orbit Mott insulator Sr 2 IrO 4 with area over ≈0.1 mm 2 and with spatial resolution as high as ≈150 nm. With the unprecedented wide field of views and high spatial resolution, an intertwining of two AF domains on a length comparable to the measured average AF domain wall width of 545 nm is revealed. This mesoscopic structure comprises a substantial portion of the sample surface, and thus can result in a macroscopic response unexpected from its microscopic magnetic structure. In particular, the symmetry analysis presented in this work shows that the inversion symmetry, which is preserved by the microscopic AF order, becomes ill-defined at the mesoscopic length scale. We report this result underscores the importance of this novel technique for a thorough understanding of the physical properties of antiferromagnets.

36 MATERIALS SCIENCE↗

DOE OSTI2021

A Case for Electron-Astrophysics

Abstract The smallest characteristic scales, at which electron dynamics determines the plasma behaviour, are the next frontier in space and astrophysical plasma research. The analysis of astrophysical processes at these scales lies at the heart of the research theme of electron-astrophysics. Electron scales are the ultimate bottleneck for dissipation of plasma turbulence, which is a fundamental process not understood in the electron-kinetic regime. In addition, plasma electrons often play an important role for the spatial transfer of thermal energy due to the high heat flux associated with their velocity distribution. The regulation of this electron heat flux is likewise not understood. By focussing on these and other fundamental electron processes, the research theme of electron-astrophysics links outstanding science questions of great importance to the fields of space physics, astrophysics, and laboratory plasma physics. In this White Paper, submitted to ESA in response to the Voyage 2050 call, we review a selection of these outstanding questions, discuss their importance, and present a roadmap for answering them through novel space-mission concepts.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Benchmark microgravity experiments and computations for 3D dendritic-array stability in directional solidification

In this study, we present a comprehensive quantitative analysis of stability bands for dendritic arrays during directional solidification of a transparent succinonitrile-0.46 wt % camphor alloy, spanning a broad range of pulling velocities. Taking advantage of the microgravity environment aboard the International Space Station where most convection effects are suppressed, we obtain unique measurements that quantify the stable primary spacing range of spatially extended three-dimensional dendritic array structures under purely diffusive growth conditions. Through carefully designed velocity jump experiments and detailed examination of sub-grain boundary dynamics, we characterize key instabilities, including elimination and tertiary branching, shedding new light on the mechanisms governing dynamic dendritic spacing selection in extended 3D arrays. Phase field simulations are performed to characterize the stability limits of dendritic array structures for quantitative comparison with the flight experiments. Although the simulations capture general trends, significant deviations are noted at the upper stability boundary, indicating the influence of additional, unexplored factors. These findings contribute to a deeper understanding of dendritic growth dynamics and offer valuable benchmark data that could aid in refining predictive models and improving control of dendritic microstructures in metallurgical applications.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Multiscale investigation of thermomechanical and compositional developments in Ni alloy 718 under laser processing

Laser processing has been widely employed in various applications due to its exceptional spatial resolution. However, the rapid temperature gradients generated in localized areas present significant challenges for experimental characterization using conventional instruments. To characterize Ni alloy 718 during laser processing, we employed in-situ synchrotron X-ray diffraction with a high-speed detector, a method particularly well-suited for probing processes with high temporal and spatial resolution. Through a series of in-situ experiments, we investigated the local variations in the evolution of microstructures and thermomechanical behaviors within a keyhole mode melt pool. The in situ macroscopic thermomechanical behaviors were quantified using an empirical model derived from diffraction patterns, with experimental results showing reasonable agreement with finite element analysis. Various laser parameters were tested to assess their influences on the residual strains in the melt pools. The results revealed that the residual strain in the keyhole mode melt pool is relatively insensitive to variations in the parameters and is smaller than that in the melt pool created under conduction mode laser scanning. Additionally, we analyzed the shapes of individual diffraction spots, providing insights into the plastic behaviors and compositional developments in the resolidified alloy. The analysis confirmed that compositional variations in a dendritic microstructure manifest as asymmetric broadening of the diffraction spots.

Ni alloy 718↗

DOE OSTI2022

Evaluation of artificial neural network performance for classification of potato plants infected with potato virus Y using spectral data on multiple varieties and genotypes

Potato virus Y (Potyviridae, PVY) is a plant virus that poses a significant threat to potato producers on a global basis. The pathogen has disrupted seed potato supplies and negatively impacted yield and quality of commercial potato crops. The potato industry currently manages PVY infection levels via insecticide applications, regional seed certification programs that rely on field scouting to visually assess individual plants for infection status, and destructive and costly tissue sampling coupled with laboratory assays. Despite these efforts, PVY continues to confound potato industry stakeholders resulting in economic harm. Remote sensing and machine learning provide for the development of new tools to more accurately detect and spatially quantify PVY-infected plants versus the current state of the art. However, there is a need to understand how the occurrence of many different potato varieties impact the dynamics of developing models to detect potato plants impacted with PVY and their potential effectiveness. This study evaluates classification modelling outcomes using spectral datasets collected in different temporal and spatial environments (greenhouse and a production field) on multiple potato varieties consisting of labelled instances of plants infected with PVY and those not infected with the virus. A modelling framework was developed to support iterative modelling runs using artificial neural network (ANN) architectures configured as binary classifiers to develop sample populations to support statistical analysis on model performance using specific spectral subsets. When using spectral data to detect PVY-infected plants, ANN models achieved the highest mean accuracy of 0.894 on a single variety. Conversely, the same ANN model architecture only achieved a mean accuracy of 0.575 on a spectral data set representing 29 potato breeding lines. Additionally, statistical analysis indicates spectral regions including the red edge, near infrared and shortwave infrared contain more important spectral features for the ANN classifier introduced in this research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Myna: Connecting powder bed fusion build data to simulation tools for digital twin applications

Additive manufacturing (AM), as a digital process, can generate a detailed digital thread linking a part’s design and manufacturing to its operational performance. As AM systems advance, an increasing amount of process data is stored in manufacturing databases. In principle, this data can be utilized by simulation-based digital twin approaches, such as real-time process control and asynchronous post-processing guidance. However, few tools currently exist for systematically integrating digital thread data with computational tools. Here, in this study, we propose a software package, called Myna, for connecting data from powder bed fusion processes to simulation tools. The utility of such a platform is demonstrated using build data from the Oak Ridge National Laboratory Manufacturing Demonstration Facility “Peregrine v2023-10” public dataset to automatically configure and run 54 semi-analytical 3DThesis melt pool simulations, 78 numerical Additive FOAM melt pool simulations, and 3 ExaCA microstructure simulations. The simulated, spatially registered microstructures are then compared directly with electron backscatter diffraction characterization of the corresponding as-built part locations. The resulting simulated microstructure showed variation as a function of process parameters, particularly stripe width; however, the experimental data had little variation between the microstructure texture and grain size resulting from different processing conditions. Analysis of the discrepancies suggest that it is possible a two-phase ferritic-austenitic solidification model is needed to accurately predict grain size and texture for certain stainless steel 316L feedstock compositions under powder bed fusion conditions, providing direction for future research. As illustrated here, due to the number and complexity of the simulations involved in AM process-structure–property predictions, automated methods to connect process data and simulations will remain necessary tools for testing hypotheses and implementing digital twin applications.

Knapp, Gerald L. [Oak Ridge National Laboratory (O↗

DOE OSTI2022

Determining protein polarization proteome-wide using physical dissection of individual Stentor coeruleus cells

Cellular components are non-randomly arranged with respect to the shape and polarity of the whole cell. Patterning within cells can extend down to the level of individual proteins and mRNA. But how much of the proteome is actually localized with respect to cell polarity axes? Proteomics combined with cellular fractionation has shown that most proteins localize to one or more organelles but does not tell us how many proteins have a polarized localization with respect to the large-scale polarity axes of the intact cell. Genome-wide localization studies in yeast found that only a few percent of proteins have a localized position relative to the cell polarity axis defined by sites of polarized cell growth. Here, we describe an approach for analyzing protein distribution within a cell with a visibly obvious global patterning - the giant ciliate Stentor coeruleus. Ciliates, including Stentor, have highly polarized cell shapes with visible surface patterning. A Stentor cell is roughly 2mmlong, allowing a ‘‘proteomic dissection’’ in which microsurgery is used to separate cellular fragments along the anterior-posterior axis, followed by comparative proteomic analysis. In our analysis, 25% of the proteome, including signaling proteins, centrin/SFI proteins, and GAS2 orthologs, shows a polarized location along the cell’s anterior-posterior axis. We conclude that a large proportion of all proteins are polarized with respect to global cell polarity axes and that proteomic dissection provides a simple and effective approach for spatial proteomics.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Behavioral simulations and experimental evaluations of stress induced spatial nonuniformity of dynamic bulk modulus in additive friction stir deposited AA 6061

Additive friction stir deposition (AFSD) is a rapidly developing solid-state additive manufacturing (AM) technology that enables the fabrication of customized products on a relatively large scale. The unique forge-liked process offers high quality products with refined equiaxed microstructure and exceptional mechanical performance. However, in AFSD, the spatially distributed mechanical properties within a deposited layer have not been established so far, due to the lack of a suitable large-scale mapping method. In the present work, an ultrasonic dynamic-elasticity mapping method was employed to map the distribution of physical properties in a AFSD 6061 Al. Strong spatial asymmetries in elastographies were mainly due to the residual stresses. The origin of the asymmetries was investigated through thermo-mechanical simulations of the AFSD process. It was observed that majority of the asymmetries were associated with the mechanical residual stresses instead of the symmetric thermal residual stresses during linear deposition of the AFSD process. However, the thermal residual stresses can be manipulated to become asymmetric with a 90° turn in the linear deposition path, due to the difference between the levels of cooling along the edges of the inner and outer corners. Hence, the mechanical and thermo-mechanical residual stresses can be additive or subtractive depending on the direction of the turns. Here, such numerically predicted behaviors were also experimentally observed on the AFSD fabricated samples by ultrasonic elastography. Furthermore, additional preliminary studies on multi-layer AFSD fabrications show the asymmetric mechanical stresses generated during the deposition process on different layers generate constructive or destructive interference which results to spatially variable dynamic bulk modulus depending on the deposition orientations of layers.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Relaxor Ferroelectric-Like Spatiotemporal Memory in Field-Driven Lipid Bilayers

Lipid membranes are often regarded as passive barriers, yet their nonlinear dielectric response remains poorly understood. Using all-atom molecular dynamics, we show that fully hydrated dipalmitoylphosphatidylcholine bilayers exhibit relaxor ferroelectric-like behavior under time-dependent electric fields. Unlike crystalline relaxors, which are bipolar and display little remanent polarization, lipid bilayers exhibit a unipolar polarization response: even an alternating current field produces persistent, asymmetric polarization. Furthermore, the underlying free-energy landscape contains two distinct minima, a nonpolarized state and a unipolarly polarized state, between which stochastic thermally activated transitions occur. Directionally resolved Van Hove analysis reveals pronounced anisotropy arising from out-of-plane electric dipole alignment, interleaflet coupling, and lateral polarization domains. Each field cycle nucleates polarization at distinct sites and monitors their relaxation, marking a crossover from thermal fluctuations to field-sustained polarization. Remarkably, these polarized domains persist after field removal, generating long-lived, spatially coherent dipolar patterns that encode nanoscale polarization memory. Potassium chloride amplifies these effects via dielectric screening and a modified hydration structure, enhancing electric dipole flexibility and cooperativity. Together, these results establish protein-free bilayers as nonlinear, history-dependent dielectrics capable of sustaining field-tunable electromechanical coupling, providing an emergent physical foundation for nanoscale information storage and memory phenomena reminiscent of short- and long-term plasticity in soft neuromorphic systems.

Insulators↗

DOE OSTI2025

Nonlinearity of the post-spinel transition and its expression in slabs and plumes worldwide

Phase transitions in the mantle control its internal dynamics and structure. The post-spinel transition marks the upper–lower mantle boundary, where ringwoodite dissociates into bridgmanite plus ferropericlase, and its Clapeyron slope regulates mantle flow across it. This interaction has previously been assumed to have no lateral spatial variations, based on the assumption of a linear post-spinel boundary in pressure and temperature. Here we present laser-heated diamond anvil cell experiments with synchrotron X-ray diffraction to better constrain this boundary, especially at higher temperatures. Combining our data with results from the literature, and using a global analysis based on machine learning, we find a pronounced nonlinearity in the post-spinel boundary, with its slope ranging from –4 MPa/K at 2100 K, to –2 MPa/K at 1950 K, and to 0 MPa/K at 1600 K. Changes in temperature over time and space can therefore cause the post-spinel transition to have variable effects on mantle convection and the movement of subducting slabs and upwelling plumes.

58 GEOSCIENCES↗

DOE OSTI2022

EvaluateFlux, VARPOW, VARPEAK, and DIF3DtoVTK Utility Programs for DIF3D

The DIF3D-VARIANT solver is part of the DIF3D code which was developed at ANL for engineering level predictive analysis of nuclear reactor cores. Over the course of the last 20 years, the DIF3D-VARIANT option of DIF3D has become increasingly more used because of improvements in computer memory capabilities and performance. This is beneficial to the users of DIF3D as DIF3D-VARIANT is able to apply both p- and h- spatial mesh refinement strategies in diffusion and transport theory. Given its greater use, utility programs were created to assist in post-processing the DIF3D output. This document discusses the basic execution process of DIF3D and the output files it creates but is primarily focused on being the manual for the utility programs EvaluateFlux, VARPOW, VARPEAK, and DIF3DtoVTK.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Airfoil Computational Fluid Dynamics - 9k shapes, 2 AoA's

This dataset contains aerodynamic quantities - including flow field values (momentum, energy, and vorticity) and summary values (coefficients of lift, drag, and momentum) - for 8,996 airfoil shapes, computed using the HAM2D CFD (computational fluid dynamics) model. The airfoil shapes were designed using the separable shape tensor parameterization that encodes two-dimensional shapes as elements of the Grassmann manifold. This data-driven approach learns two independent spaces of parameter from a collection of sample airfoils. The first captures large-scale, linear perturbations, and the second defines small-scale, higher-order perturbations. For this data, we used the G2Aero database of over 19,000 airfoil shapes to learn a parameter space that captured a wide array of shape characteristics. We fixed the linear deformations to be the mean over the database and sampled new shapes over a four-dimensional parameter space of higher-order perturbation. This sampling approaches allows for isolated analysis of non-linear airfoil shape deformations while holding other aspects (e.g., airfoil thickness) approximately constant. The aerodynamic quantities for the generated airfoil were obtained using the HAM2D code, which is a finite-volume Reynolds-averaged Navier-Stokes (RANS) flow solver. We employ a fifth-order WENO scheme for spatial reconstruction with Roe's flux difference scheme for inviscid flux and second-order central differencing for viscous flux. A preconditioned GMRES method is applied for implicit integration. The Spalart-Allmaras 1-eq turbulence model is used for the turbulence closure, and the Medida-Baeder 2-eq transition model is applied to account for the effects of laminar turbulent transition. The airfoil grid is generated with a total of 400 points on the airfoil surface, the initial wall-normal spacing of y+ = 1, and an outer boundary located at 300 chord lengths away from the wall. The CFD simulations are performed at a freestream Mach number of 0.1, Reynolds number of 9M, and at two angles of attack, 4 deg. and 12 deg. The simulations were performed using the Bridges-2 system at the Pittsburgh Supercomputing Center in February 2023 as part of the INTEGRATE project funded by the Advanced Research Projects Agency - Energy in the U.S. Department of Energy. The data was collected, reformatted, and preprocessed for this OEDI submission in July 2023 under the Foundational AI for Wind Energy project funded by the U.S. Department of Energy Wind Energy Technologies Office. This dataset is intended to serve as a benchmark against which new artificial intelligence (AI) or machine learning (ML) tools may be tested. Baseline AI/ML methods for analyzing this dataset have been implemented, and a link to their repository containing those models has been provided. The .h5 data file structure can be found in the GitHub Repository resource under explore_airfoil_9k_data.ipynb.

9k↗

DOE OSTI2025

Aerosol impacts on isolated deep convection: findings from TRACER

This study focuses on quantifying the conditional relationship between aerosol and convective precipitation properties of isolated deep convective clouds (DCCs) in the Houston–Galveston region, after adjusting for confounding effects. We leverage comprehensive ground-based observations from the TRacking Aerosol Convection interactions ExpeRiment (TRACER) to estimate aerosol effects on convective echo top height (ETH), intensity, and area separately. Our results show that greater aerosol number concentrations generally have a limited impact on these convective properties, showing relationships consistent with the possibility of both invigoration and suppression effects. Under certain conditions, where ultrafine particles are abundant, aerosols exhibit a positive effect on ETH, increasing it by about 1 km. However, it is inevitable to consider measurement uncertainties and the limitations of temporal and spatial resolution in the data, as these factors can further contribute to uncertainties in our estimates. In DCCs associated with sea breezes, the estimated aerosol effects on DCCs are found to be more pronounced. However, this heightened effect could be attributed to the exclusion of key confounders such as boundary layer updrafts in the analysis.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗