Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Effectiveness and predictability of in-network storage cache for Scientific Workflows

Large scientific collaborations often have multiple scientists accessing the same set of files while doing different analyses, which create repeated accesses to the large amounts of shared data located far away. These data accesses have long latency due to distance and occupy the limited bandwidth available over the wide-area network. To reduce the wide-area network traffic and the data access latency, regional data storage caches have been installed as a new networking service. To study the effectiveness of such a cache system in scientific applications, we examine the Southern California Petabyte Scale Cache for a high-energy physics experiment. By examining about 3TB of operational logs, we show that this cache removed 67.6% of file requests from the wide-area network and reduced the traffic volume on wide-area network by 12. 3TB (or 35.4%) an average day. The reduction in the traffic volume (35.4%) is less than the reduction in file counts (67.6%) because the larger files are less likely to be reused. Due to this difference in data access patterns, the cache system has implemented a policy to avoid evicting smaller files when processing larger files. We also build a machine learning model to study the predictability of the cache behavior. Tests show that this model is able to accurately predict the cache accesses, cache misses, and network throughput, making the model useful for future studies on resource provisioning and planning.

Sim, Caitlin↗

The dark matter halo masses of elliptical galaxies as a function of observationally robust quantities

Context. The assembly history of the stellar component of a massive elliptical galaxy is closely related to that of its dark matter halo. Measuring how the properties of galaxies correlate with their halo mass can therefore help to understand their evolution. Aims. We investigate how the dark matter halo mass of elliptical galaxies varies as a function of their properties, using weak gravitational lensing observations. To minimise the chances of biases, we focus on the following galaxy properties that can be determined robustly: the surface brightness profile and the colour. Methods. We selected 2409 central massive elliptical galaxies (log M*/M ⊙ ≳ 11.4) from the Sloan Digital Sky Survey spectroscopic sample. We first measured their surface brightness profile and colours by fitting Sérsic models to photometric data from the Kilo-Degree Survey (KiDS). We fitted their halo mass distribution as a function of redshift, rest-frame r-band luminosity, half-light radius, and rest-frame u - g colour, using KiDS weak lensing measurements and a Bayesian hierarchical approach. For the sake of robustness with respect to assumptions on the large-radii behaviour of the surface brightness, we repeated the analysis replacing the total luminosity and half-light radius with the luminosity within a 10 kpc aperture, L r, 10 , and the light-weighted surface brightness slope, Γ 10 . Results. We did not detect any correlation between the halo mass and either the half-light radius or colour at fixed redshift and luminosity. Using the robust surface brightness parameterisation, we found that the halo mass correlates weakly with L r,10 and anti-correlates with Γ 10 . At fixed redshift, L r, 10 and Γ 10 , the difference in the average halo mass between galaxies at the 84th percentile and 16th percentile of the colour distribution is 0.00 ± 0.11 dex. Conclusion. Our results indicate that the average star formation efficiency of massive elliptical galaxies has little dependence on their final size or colour. This suggests that the origin of the diversity in the size and colour distribution of these objects lies with properties other than the halo mass.

79 ASTRONOMY AND ASTROPHYSICS↗

Cluster environment quenches the star formation of low-mass satellite galaxies from the inside-out

ABSTRACT Environment plays a critical role in the star formation history of galaxies. Tidal and hydrodynamical stripping, prominent in cluster environment, can remove the peripheral gas of galaxies and star formation may thus be environmentally suppressed from the outside-in. We revisit the environmental dependence of the radial gradient of specific star formation rate (sSFR) profile. We probe the radial gradient by using the archival spectral indices D4000n and HδA measured from SDSS fibre spectra, to indicate central sSFR and the total sSFR from fitting the spectral energy distribution. Despite the low spatial resolution, the wealth of SDSS data allows to disentangle the dependences on stellar mass, sSFR, and environment. We find that low-mass satellite galaxies in the mass range $9\lt \mathrm{log}\, \mathcal {M}_{\star }/\mathcal {M}_{\odot }\lt 9.8$ on average quench in more inside-out pattern compared to isolated galaxies matched in mass, sSFR, and fibre coverage. This environmental effect is particularly strong for galaxies below the star formation main sequence, and peaks for those in the core of massive clusters where the phase-space diagram reveals clear links between the inside-out quenching and orbital properties. Our results suggest that both tidal and hydrodynamical interactions in cluster environment suppress the star formation of satellites mainly from the inside-out. As accreted gas of low angular momentum from hot gas haloes is an important source for replenishing central gas reservoir, we discuss how gas stripping in clusters may lead to starvation and cause inside-out quenching when the outer star-forming discs are not significantly affected.

79 ASTRONOMY AND ASTROPHYSICS↗

Geothermal Play-Fairway Analysis of Washington State Prospects: Final Report

The Washington State Geothermal Play-Fairway Analysis overcomes the exploration challenges posed by dense vegetation, glacial deposits, and extreme precipitation. The geothermal play-fairways we target are locations where heat, permeability, and saturated porosity are present in sufficient volume to provide adequate heat exchange at depths accessible by modern drilling technology. The three study areas lie along the Cascade Range magmatic arc and are near Mount Baker, Mount St. Helens, and the Wind River Valley. The seven-year project is divided into three phases. In Phase 1 we build on a previous statewide assessment of geothermal resources and develop an initial modeling approach. The results are a series of favorability, uncertainty, and risk maps for three targeted study areas. Based on these initial results, we collect new geologic and geophysical data to further refine our modeling and reduce exploration uncertainty in Phase 2. We improve the modeling method to handle the new data and update the favorability, uncertainty, and risk maps. We also update the conceptual geothermal resource models. In Phase 3 we validate our modeling approach by drilling two temperature-gradient holes and collecting and analyzing core, image logs, and new geochemistry. Our modeling approach improves on an earlier statewide method through a more-rigorous and detailed assessment of heat and permeability. Permeability potential is assessed through geomechanical modeling of the deformation that can generate and maintain reservoir porosity and permeability. Metrics to inform heat potential include temperature-gradient wells, which are sparse in Washington; proximity of Quaternary volcanic vents and young intrusive rock; spring temperature; and reservoir temperature inferred from geothermometry. We weight the individual components using an expert-guided approach known as the Analytical Hierarchy Process. During Phase 2 we also develop a fluid-filled fracture model, and an infrastructure model that helps to delineate areas which are more favorable for geothermal development based on proximity to transmission lines, elevation, land ownership and use restrictions, and availability of process water. New geologic and geophysical data is collected during Phase 2 in each of our three main study areas. At Mount Baker and north of Mount St. Helens we conduct 1:24,000-scale geologic mapping and lidar analysis to better constrain the location and character of surface faults; detailed mapping in the Wind River Valley was completed just prior to the start of this project. Ages of intrusive rocks are determined with 40 Ar/ 39 Ar geochronology, though all of our samples are Miocene or older. We collect ground based gravity observations (a total of 1,580 new stations) in all of our study areas and ground-based magnetic lines (a total of 93 km) at Mount Baker. These data are combined with existing gravity and aeromagnetic data and used to constrain fault locations and geometry. Two to three cross sections are constructed at each study area using the mapped surface geology and forward-modeling of the gravity and magnetic data; these cross sections form the basis for our updated conceptual models. We collect magnetotelluric surveys at Mount Baker and Mount St. Helens and these data are inverted to form a resistivity model from the surface to about 10 km depth; each model shows conductive zones that can be interpreted as upwelling geothermal fluids. At Mount St. Helens we deploy a passive seismic array and use the newly detected events to refine the location of the Saint Helens seismic zone. We also employ ambient-noise tomography to develop a detailed seismic-velocity model for the study area and use this model to help constrain our cross sections and conceptual model. Based on the new data collected during Phase 2—and our updated models—we develop a campaign of temperature-gradient holes and core analysis to validate our modeling in Phase 3. Drill hole MB76-31 is located near Little Park Creek, 11 km west-southwest of the summit of Mount Baker, and is 1,471 ft deep. About 410 ft of core from the lower portion of the hole—and image logs from ~175 ft below ground surface to the bottom—are collected and analyzed. Water samples are collected and processed for geothermometry. Drill hole MSH17-24 is located along upper Schultz Creek, 16 km north-northeast of Mount St. Helens and has core from 470 ft to the bottom at 1,053 ft. We did not collect image logs due to borehole stability concerns, but water samples are collected and analyzed for geothermometry. Repeat temperature-gradient measurements are made at both sites and thermal conductivity is measured from core samples. At MB76-31, the equilibrated temperature gradient of 64°C/km and calculated heat flow of 141–159 mW/m 2 is more than twice the regional average. Detailed mapping and analysis of the core, coupled with correlation to the image logs, indicates a history of permeability generation consistent with our predictions of high permeability. Because the site has high favorability in the Phase 2 model, we consider the results a positive validation of the modeling. At site MSH17-24, the equilibrated temperature gradient of ~15°C/km and calculated heat flow of 41–43 mW/m 2 are similar to regional. Geochemical analysis of the water samples indicates a meteoric source without any geothermal component. Detailed outcrop-based mapping of fault exposures near the drill site and analysis of image logs from nearby boreholes indicates a history of permeability generation consistent with our predictions. Because the site has low favorability in the Phase 2 model, we consider the results a positive validation of the modeling. Together, the two sites provide a reasonably positive validation of the Phase 2 modeling and should encourage future use of this modeling approach.

15 GEOTHERMAL ENERGY↗

Fault-Tolerant Deep Learning Cache with Hash Ring for Load Balancing in HPC Systems

Large-scale DL on HPC systems like Frontier and Summit uses distributed node-local caching to address scalability and performance challenges. However, as these systems grow more complex, the risk of node failures increases, and current caching approaches lack fault tolerance, jeopardizing large-scale training jobs. We analyzed six months of SLURM job logs from Frontier and found that over 30% of jobs failed after an average of 75 minutes. To address this, we propose fault-tolerance strategies that recache data lost from failed nodes using a hash ring technique for balanced data recaching in the distributed node-local caching, reducing reliance on the PFS. Our extensive evaluations on Frontier showed that the hash ring-based recaching approach reduced training time by approximately 25% compared to the approach that redirects I/O to the PFS after node failures and demonstrated effective load balancing of training data across nodes.

Lee, Seoyeong↗

Litter Production and Foliar Nutrient Resorption in Pioneer and Non-Pioneer Species in a Selective Logging Experiment in the Central Amazon, BIONTE, ZF-2, Manaus, 2022-23

This dataset was collected near the city of Manaus, Brazil, at the Experimental Station of Tropical Forestry (EEST, aka “ZF2”), inside the BIONTE (BIOmass and NuTrient Experiment). The experiment included three levels of increasing selective logging intensity, along with control, with 1-hectare permanent plots (12 total) located at the center of 4-hectare treatment plots. The vegetation has a high floristic diversity, the soils of the region are poor in nutrients, and the topography is characterized by plateaus (where BIONTE is located), and also valley bottoms and slopes. Three treatments of differing logging intensities were applied in the BIONTE experiment (T1, T2 and T3). The study was conducted in Treatment 3 (Block I – permanent plot), which represents the most intensive logging treatment, with 69% of the basal area (m²∙ha⁻¹) removed in 1988. The present dataset spans the period from May 1, 2022, to May 1, 2023. The data package includes leaf_nutrient_data, litterfall_total_data, leaf_litterfall_species_specific_data, and species_info, all provided in .csv format. These formats allow users to process and analyze the data in various software applications and programming languages, such as Python and R. This dataset was collected to advance knowledge on nutrient cycling in Amazonian forests, specifically distinguishing between species with two distinct functional traits: fast-growing and slow-growing. It also aims to improve Earth System Models, such as the E3SM Functionally Assembled Terrestrial Ecosystem Simulator (FATES). Additionally, it was used in a paper currently in preparation (Carvalho et al., in prep.), which aims to quantify seasonal litter production and foliar nutrient resorption in pioneer (fast-growing) and non-pioneer (slow-growing) tree species in the central Amazon. Specifically, it seeks to answer two key questions: 1) Is there a difference in leaf litter production, leaf nutrient flux and leaf nutrient concentration between pioneers and non-pioneers species? Is there a difference in the efficiency of foliar nutrient resorption between pioneers and non-pioneers species?

54 ENVIRONMENTAL SCIENCES↗

Surface Energy Dynamics and Canopy Structural Properties in Intact and Disturbed Forests in the Southern Amazon

The Brazilian Amazon has been a focus of land development with large swaths of forests converted to agriculture. Forest degradation by selective logging and fires has accompanied the agricultural frontier and has resulted in significant impacts on Amazonian ecosystems. Changes in forest structure resulting from forest disturbances have large impacts on the surface energy balance, including on land surface temperature (LST) and evapotranspiration (ET). This study's objective is to assess the effects of forest disturbances on water fluxes and forest structure in a transitional forest site in the Southern Amazon. We used ET and LST products from MODIS and Landsat 8 and GEDI-derived forest structure data to address our research questions. We found that disturbances induced seasonal water stress, more pronounced in croplands/pastures than in forests (differences up to 20% in the dry season), and more pronounced in second-growth and recently burned areas than in logged and intact forests (differences up to 12% in the dry season). Moreover, ET and LST were negatively related, with more consistent relationships across disturbance classes in the dry season (R 2 : 0.41–0.87) than in the wet season (R 2 : 0.18–0.49). Forest and cropland or pasture classes showed contrasting relationships in the dry season. Finally, we found that forest structure exhibited stronger relationships with ET and LST in the most disturbed forests (R 2 : 0.01–0.43) than in the least disturbed forests (R 2 < 0.05). Our findings help to elucidate degraded forests functioning under a changing climate and to improve estimates of water and energy fluxes in Amazonian degraded forests.

54 ENVIRONMENTAL SCIENCES↗

RokBase - Beta

Web based tool and portal to explore and download data associated with Core Characterization Technical Report Series .

Core Characterization↗

Quantifying Dynamic Water Storage in Unsaturated Bedrock with Borehole Nuclear Magnetic Resonance

Quantifying the volume of water that is stored in the subsurface is critical to studies of water availability to ecosystems, slope stability, and water-rock interactions. In a variety of settings, water is stored in fractured and weathered bedrock as rock moisture. However, few techniques are available to measure rock moisture in unsaturated rock, making direct estimates of water storage dynamics difficult to obtain. Here, we use borehole nuclear magnetic resonance (NMR) at two sites in seasonally dry California to quantify dynamic rock moisture storage. Additionally, we show strong agreement between NMR estimates of dynamic storage and estimates derived from neutron logging and mass balance techniques. The depths of dynamic storage are up to 9 m and likely reflect the depth extent of root water uptake. To our knowledge, these data are the first to quantify the volume and depths of dynamic water storage in the bedrock vadose zone via NMR.

58 GEOSCIENCES↗

Prestack Waveform Inversion at GC 955: Trials and sensitivity of PWI to high-resolution seismic data (Data Report)

Understanding the spatial extent and variability of hydrate deposits has important implications for potential economic production, climate change, and assessing natural hazards risks. Seismic reflection techniques are capable of determining the extent of gas hydrate deposits and can shed light on hydrate concentrations and properties. Using high resolution prestack time migrated seismic data collected during a 2013 US Geological Survey expedition and prestack waveform inversion (PWI) techniques, we produce highly resolved velocity models and compare them to co-located well logs. Coupling our PWI results with velocity-porosity relationships and nearby well control, we compare hydrate properties at site 955 in the Green Canyon and site 313 at Walker Ridge.

03 NATURAL GAS↗

DOE ARM Future of LASSO Workshop Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility held a two-day workshop at the National Science Foundation National Center for Atmospheric Research in Boulder, Colorado in November 2023 to discuss the history and future of the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) activity. LASSO is a suite of data products focused on supplementing ARM observations with high-resolution modeling. The workshop used a hybrid format with 15 invited, in-person attendees and 36 virtual attendees logging in for portions of the workshop. Many topics were covered at the workshop, with this report reflecting the ensuing discussion. Some topics discussed had clear conclusions while others require further thought, given the breadth of topics included in a short workshop.

54 ENVIRONMENTAL SCIENCES↗

Calibrating the Galactic Cepheid Period–Luminosity Relation from the Maximum-likelihood Technique

We present a realization of the maximum-likelihood technique, which is one of the latest modifications of the Baade–Becker–Wesselink method. Our approach is based on nonlinear calibrations of the effective temperature and bolometric correction, which take into account metallicity and surface gravity. It allows one to estimate the key Cepheid parameters, the distance modulus, and the interstellar reddening, combining photometric and spectroscopic data (including the effective temperature data). This method is applied to a sample of 44 Galactic Cepheids for which multiphase temperature measurements are available. The additional data correction is performed to subtract the impact of the component in binary/multiple systems. We also study the effect of shock waves, whose presence in the stellar atmosphere distorts the observational data and leads to systematic errors in the obtained parameters. We determine the optimal restriction on the input data to eliminate this effect. This restriction provides accurate period–radius and period–luminosity relations that are consistent with the results in previous studies. We found the following relations: log R = (0.68 ± 0.03) · log P + (1.14 ± 0.03), M {sub v} = − (2.67 ± 0.16) · (log P − 1) − (4.14 ± 0.05).

79 ASTRONOMY AND ASTROPHYSICS↗

COol Companions ON Ultrawide orbiTS (COCONUTS). I. A High-gravity T4 Benchmark around an Old White Dwarf and a Re-examination of the Surface-gravity Dependence of the L/T Transition

We present the first discovery from the COol Companions ON Ultrawide orbiTS (COCONUTS) program, a large-scale survey for wide-orbit planetary and substellar companions. We have discovered a comoving system COCONUTS-1, composed of a hydrogen-dominated white dwarf (PSO J058.9855+45.4184; d = 31.5 pc) and a T4 companion (PSO J058.9869+45.4296) at a 40farcs6 (1280 au) projected separation. We derive physical properties for COCONUTS-1B from (1) its near-infrared spectrum using cloudless Sonora atmospheric models, and (2) its luminosity and the white dwarf's age (${7.3}_{-1.6}^{+2.8}$ Gyr) using Sonora evolutionary models. The two methods give consistent temperatures and radii, but atmospheric models infer a lower surface gravity and therefore an unphysically young age. Assuming evolutionary model parameters (${T}_{\mathrm{eff}}={1255}_{-8}^{+6}$ K, $\mathrm{log}\,g={5.44}_{-0.03}^{+0.02}$ dex, $R={0.789}_{-0.005}^{+0.011}$ ${R}_{\mathrm{Jup}}$), we find that cloudless model atmospheres have brighter Y- and J-band fluxes than the data, suggesting that condensate clouds have not fully dispersed around 1300 K. The W2 flux (4.6 μm) of COCONUTS-1B is fainter than models, suggesting non-equilibrium mixing of CO. To investigate the gravity dependence of the L/T transition, we compile all 60 known L6-T6 benchmarks and derive a homogeneous set of temperatures, surface gravities, and masses. As is well known, young, low-gravity late-L dwarfs have significantly fainter, redder near-infrared photometry and ≈200–300 K cooler temperatures than old, high-gravity objects. Our sample now reveals such gravity dependence becomes weaker for T dwarfs, with young objects having comparable near-infrared photometry and ≈100 K cooler temperatures compared to old objects. Finally, we find that young objects have a larger amplitude J-band brightening than old objects, and also brighten at H band as they cross the L/T transition.

79 ASTRONOMY AND ASTROPHYSICS↗

Ice Nucleating Particles (INP) Raw Data

The ice nucleation spectrometer (INS) is an offline analytical measurement system used to process filter samples for freezing temperature spectra of immersion-mode ice-nucleating particle (INP) number concentrations. It is almost identical to the Colorado State University (CSU) ice spectrometer design. Filter samples are collected at ARM facilities routinely and during intensive operational periods, and on the ARM tethered balloon system operated by Sandia National Laboratories, then processed on the INS at CSU. This filter log contains the detailed metadata at all ARM sites where INP filter sample collection has occurred or is currently ongoing. Metadata include start and end times, vacuum line pressures and temperatures, and flow rates; total accumulated flow through each filter; and notes on collection issues or weather conditions. Users can also keep up to date with the status of filter and data processing, even before data are available on ARM's Data Discovery. Users can contact INP mentors Jessie Creamean or Thomas Hill with any questions.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Streambed Grain Size, Uncertainty, and Hydrobiogeochemical Parameters Using Machine Learning Model YOLO

Abstract Streambed grain sizes control river hydro‐biogeochemical (HBGC) processes and functions. However, measuring their quantities, distributions, and uncertainties is challenging due to the diversity and heterogeneity of natural streams. This work presents a photo‐driven, artificial intelligence (AI)‐enabled, and theory‐based workflow for extracting the quantities, distributions, and uncertainties of streambed grain sizes from photos. Specifically, we first trained You Only Look Once, an object detection AI, using 11,977 grain labels from 36 photos collected from nine different stream environments. We demonstrated its accuracy with a coefficient of determination of 0.98, a Nash–Sutcliffe efficiency of 0.98, and a mean absolute relative error of 6.65% in predicting the median grain size of 20 ground‐truth photos representing nine typical stream environments. The AI is then used to extract the grain size distributions and determine their characteristic grain sizes, including the 10th, 50th, 60th, and 84th percentiles, for 1,999 photos taken at 66 sites within a watershed in the Northwest US. The results indicate that the 10th, median, 60th, and 84th percentiles of the grain sizes follow log‐normal distributions, with most likely values of 2.49, 6.62, 7.68, and 10.78 cm, respectively. The average uncertainties associated with these values are 9.70%, 7.33%, 9.27%, and 11.11%, respectively. These data allow for the computation of the quantities, distributions, and uncertainties of streambed HBGC parameters, including Manning's coefficient, Darcy‐Weisbach friction factor, top layer interstitial velocity magnitude, and nitrate uptake velocity. Additionally, major sources of uncertainty in grain sizes and their impact on HBGC parameters are examined.

58 GEOSCIENCES↗

The SOUX AGN sample: optical/UV/X-ray SEDs and the nature of the disc

We use the SOUX sample of ~700 active galactic nucleus (AGN) to form average optical-ultraviolet (UV)-X-rays spectral energy distributions (SEDs) on a two-dimensional (2D) grid of M BH and L 2500 . We compare these with the predictions of a new AGN SED model, qsosed, which includes prescriptions for both hot and warm Comptonization regions as well as an outer standard disc. This predicts the overall SED fairly well for 7.5 < log(M BH /M ⊙ ) < 9.0 over a wide range in L/L Edd , but at higher masses the outer disc spectra in the model are far too cool to match the data. We create optical-UV composites from the entire Sloan Digital Sky Survey sample and use these to show that the mismatch is due to there being no significant change in spectral shape of the optical-UV continuum across several decades of M BH at constant luminosity. We show for the first time that this cannot be matched by standard disc models with high black hole spin. These apparently fit, but are not self-consistent as they do not include the General Relativistic effects for the emission to reach the observer. At high spin, increased gravitational redshift compensates for almost all of the higher temperature emission from the smaller inner disc radii. The data do not match the predictions made by any current accretion flow model. Either the disc is completely covered by a warm Comptonization layer whose properties change systematically with L/L Edd , or the accretion flow structure is fundamentally different to that of the standard disc models.

79 ASTRONOMY AND ASTROPHYSICS↗

Facies Analysis and Depositional Environments of the Upper Cambrian Eau Claire Formation in Central and Northern Illinois

The Cambrian Eau Claire Formation is a confining unit for geologic carbon dioxide (CO2) storage, and potentially a confining unit for hydrogen storage, within the underlying Mount Simon Sandstone in the Central and Northern Illinois Basin. However, extensive regional studies on lateral continuity, environment of deposition, and depositional fabric of the Eau Claire Formation in the Illinois Basin are minimal compared to studies of the underlying Mount Simon Sandstone. This study presents an integrated facies analysis using sedimentological, stratigraphic, ichnological, and mineralogical data to interpret the depositional environments of the Eau Claire Formation, emphasizing the dynamic nature of sedimentary systems. By combining core analyses, thin-section analysis, facies interpretation from geophysical logs, and regional stratigraphic framework interpretation, this work provides insights into the integrated depositional framework across diverse depositional environments. These findings suggest that the Eau Claire Formation in the Central and Northern Illinois Basin was deposited in a shallow marine environment, ranging from tidal flats to offshore settings. Its mixed siliciclastic-carbonate succession was primarily controlled by relative sea-level change.

58 GEOSCIENCES↗

Flexible visualization of a 3rd party Intrusion Prevention (Security) tool: A use case with the ELK stack

A difficult aspect of cyber security is the ability to achieve automated real time intrusion prevention across various sets of systems. To this extent, several companies are offering comprehensive solutions that leverage an "accuracy of scale" and moving much of the intelligence and detection on the Cloud, relying on an ever-growing set of data and analytics to increase decision accuracy. Often, they provide tools to visualize the decision workflows in attack prevention (as well as tune the algorithm) but those solutions are not always practical as companies see the problem as "global" that is, from a unified Cyber-security standpoint. However, a key to a successful Cyber-security program is transparency and trust: from an experimental team viewpoint, this specifically means having the ability to immediately see what and from where, who has been blocked and being able to inform the community in case of a revoked access without the need for filing a "ticket" (that may eventually be answered) – in other words, rapid response to their user-base is essential but solutions targeting "sub-groups" in an organization are not often available. We have come up with a versatile solution leveraging the ELK stack (Elasticsearch, Logstash, & Kibana) and an IPS (Intrusion Prevention System) based WAF (Web Application Firewall) from Signal Sciences. Signal Science allows the streaming of detailed logs in a Logstash format suitable for custom solutions for visualization. By combining these two tools, we have strengthened our security posture and enabled individual experiments to monitor their own traffic. Specifically, the IPS WAF provides unique data such as country of origin, protocol, response code, source IP, and paths accessed. In this contribution, we will show how we engineered a visualization solution so experiment groups could access a dashboard with predefined graphs but also, where they can create individual customizable dashboards used to display blocked traffic and troubleshoot latency issues. We will discuss the details and procedures for developing and configuring these tools and how it benefits cyber security postures across our scientific based environment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗