Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Addressing Electric Aviation Infrastructure Cybersecurity Implementation

This technical report evaluates key considerations of cybersecurity systems in preparation for the electrification of both legacy and new aviation services. The objectives are to consider the landscape of components and interconnections, review sensitivities and the criticality of data and operations, and aim to understand the applicability of existing best practices or the need for new ones associated with the cybersecurity of electric charging systems for the aviation sector. Given the early stages of electric aviation deployment, developers have the opportunity to plan and integrate cybersecurity strategies into the complete electric aviation system during the initial stages of design and procurement and will benefit from employing a framework for continuous cybersecurity monitoring. This paper presents initial considerations of key cybersecurity strategies and their application to forthcoming electric aviation systems.

airports↗
DOE OSTI2026

Assessment of Energy Technology Options for the Island of Molokai, Hawaii: Analysis of Floating Solar, Pumped Storage Hydropower, and Backup Energy Systems

This report documents analysis done by researchers at the National Laboratory of the Rockies and Pacific Northwest National Laboratory to evaluate the potential for and explore project concepts of electricity generation and storage additions on the island of Molokai, Hawaii, as identified in the Community Energy Resilience Action Plan (CERAP) by the Molokai Clean Energy Hui (MCEH), Sustainable Molokai, and the Hawaii Natural Energy Institute (HNEI). These electricity generation and storage additions include distributed photovoltaics (PV), battery energy storage, and generators for critical facilities on the island that can provide backup energy to the facilities during grid disruptions and outages, a floating PV (FPV) system on Kualapuu Reservoir, and pumped storage hydropower (PSH) systems scaled to act as a significant or primary source of energy storage on the Molokai grid.

13 HYDRO ENERGY↗
DOE OSTI2026

Assessment of Energy Technology Options for the Island of Molokai, Hawaii: Analysis of Floating Solar, Pumped Storage Hydropower, and Backup Energy Systems [Slides]

This presentation summarizes analysis done by researchers at the National Laboratory of the Rockies and Pacific Northwest National Laboratory to evaluate the potential for and explore project concepts of electricity generation and storage additions on the island of Molokai, Hawaii, as identified in the Community Energy Resilience Action Plan (CERAP) by the Molokai Clean Energy Hui (MCEH), Sustainable Molokai, and the Hawaii Natural Energy Institute (HNEI). These electricity generation and storage additions include distributed photovoltaics (PV), battery energy storage, and generators for critical facilities on the island that can provide backup energy to the facilities during grid disruptions and outages, a floating PV (FPV) system on Kualapuu Reservoir, and pumped storage hydropower (PSH) systems scaled to act as a significant or primary source of energy storage on the Molokai grid. This presentation accompanies the full technical report published under the same title.

14 SOLAR ENERGY↗
DOE OSTI2022

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reaching new peaks for the future of the CMS HTCondor Global Pool

The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 350k CPU cores, is employed to successfully manage the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict a noticeable expansion in the amount of CPU that will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring and expanding the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high effciency in our workload scheduling and resource utilization.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Operational Analytics Studies for ATLAS Distributed Computing: Data Popularity Forecast and Utilization of the WLCG Centers

Operational analytics is the direction of research related to the analysis of the current state of computing processes and the prediction of future states in order to anticipate imbalances and take timely measures to stabilize a complex system. There are two relevant areas in ATLAS Distributed Computing that are currently the focus of studies: user physics analysis including the forecast of popularity of data samples among users, and evaluating WLCG centers for their readiness to process user analysis payloads. Studying these areas is challenging due to the complexity involved, as it requires a comprehensive understanding of numerous boundary conditions typically found in large-scale distributed computing infrastructures. Forecasts of data popularity are problematic without the categorization of user tasks by their types (data transformation or physics analysis), which do not always appear on the surface but may induce noise, which introduces significant distortions for predictive analysis. Evaluating the WLCG resources by their analysis workloads is also a challenging task as it is necessary to find a balance between the workload of the resource, its performance, the waiting time for jobs on it, as well as the volume of jobs that it processes. This is especially difficult in a heterogeneous computing environment, where legacy resources are used along with modern high-performance machines. We will look at these areas of research in detail and discuss what tools and methods are used in our work, demonstrating results already obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

The ATLAS Workflow Management System Evolution in the LHC Run3 and towards the High-Luminosity LHC era

The ATLAS experiment has 18+ years of experience using workload management systems to deploy and develop workflows to process and to simulate data on the distributed computing infrastructure. Simulation, processing and analysis of LHC experiment data require the coordinated work of heterogeneous computing resources. In particular, the ATLAS experiment utilizes the resources of 250 computing centers worldwide, the power of supercomputing centres, and national, academic and commercial cloud computing resources. In this contribution, we present new techniques for cost-effectively improving efficiency introduced in workflow management system software. The evolution from a mesh framework to new types of computing facilities such as cloud and HPCs is described, as well as new types of production and analysis workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Evolution of DUNE’s Production System

The DUNE experiment will start running in 2029 and record 30 PB/year of raw waveforms from Liquid Argon TPCs and photon detectors. The size of individual readouts can range from 100 MB to a typical 8 GB full readout of the detector, and even 100 TB for extended readouts from supernova candidates. These data then need to be cataloged, stored and distributed for processing worldwide. This massive amount of data and a heterogeneous computing environment necessitates a powerful and robust distributed computing infrastructure. In the process of building up that infrastructure, DUNE’s production system has recently undergone an overhaul, in which it has integrated 1) a new workflow management system (justIN) 2) a new data catalog (MetaCat) and 3) a state-of-the-art data management system (Rucio). Simulations of DUNE’s Far Detector and its prototypes ProtoDUNE Horizontal Drift (ProtoDUNE-HD) and ProtoDUNE Vertical Drift (ProtoDUNE-VD), as well as data from ProtoDUNE-HD serve as the first tests of this infrastructure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

STUDIES ON PIPELINE POLYETHYLENES IN HYDROGEN GAS ENVIRONMENTS USING IN-SITU AND EX-SITU CHARACTERIZATION METHODS

Polymeric materials are commonplace in the natural gas infrastructure as distribution pipes, coatings, seals, and gaskets. Under the auspices of the U.S. Department of Energy HyBlend program, one of the means to reduce greenhouse gas emissions is with replacing natural gas, either partially or completely, with hydrogen. This approach makes it imperative that we conduct near-term and long-term materials compatibility research in these relevant environments. Insights into the effects of hydrogen and hydrogen gas blends on polymer integrity can be gained through both ex-situ and in-situ analytical methods. Our work represented here highlights a study of the behavior of pipeline polyethylene (PE) materials, including HDPE (Dow 2490 and GDB50) and MDPE (Ineos and legacy Dupont Aldyl A), when exposed to hydrogen by means of in-situ X-ray scattering and ex-situ Raman spectroscopy techniques. Samples were tested in ex-situ hydrogen and argon gas environments and in-situ hydrogen environments to identify differences due to permeation and solubility of these gases. These methods complemented each other because Raman spectroscopy could capture permanent effects after materials were removed from gaseous environments, and in-situ X-ray scattering analysis collected real-time data to elucidate the impact of the gas environment on polymer microstructure. Data collected revealed that the aforementioned polymers did not show significant changes in crystallinity and microstructure under the exposure conditions tested. Our findings from these studies will help establish real-time effects caused by hydrogen gas transport through pipeline polyethylenes by way of its influence on polymer structure and chemistry, which is directly related to pipeline mechanical strength and longevity of service.

Hydrogen materials compatibility, Natural gas pipe↗
DOE OSTI2025

The environmental impact, carbon emissions and sustainability of computing in the ATLAS experiment

ATLAS, a general-purpose experiment at the Large Hadron Collider (LHC), makes use of a large internationally-distributed computing infrastructure, including over 10 6 TB of managed data on disk and tape and almost one million simultaneously running CPU cores. Upgrades for the High-Luminosity LHC (HL-LHC) will increase the required computing resources by a factor of 3–4 by the beginning of the 2030s, and by an order of magnitude before the conclusion of data taking at the beginning of the 2040s. These resources are spread over around 100 computing sites worldwide. Efforts are underway within the experiment to evaluate and mitigate various aspects of the environmental impact of the sites, with the additional long-term goal of making recommendations to the sites that will significantly reduce the total expected environmental impact in the HL-LHC era. These efforts take several forms: building awareness in the experiment community, adjusting aspects of the computing policy, and modifications of data center configurations, either in ways that take advantage of particular features of ATLAS workloads or in generic ways that reduce the environmental impact of the computing resources. This paper describes the ongoing investigations and approaches that have already provided useful and actionable outcomes.

Aad, G. [CNRS/IN2P3] (ORCID:0000000266654934)↗
DOE OSTI2024

Ground-motions site and event specificity: Insights from assessing a suite of simulated ground motions in the San Francisco Bay Area

This article presents the results of a research that is part of a larger collaborative effort between the Lawrence Berkeley National Laboratory and the Pacific Earthquake Engineering Research Center, funded by the US Department of Energy Office of Cybersecurity, Energy Security and Emergency Response. The main objective of this study is to assess a suite of near and far-field simulated ground motions obtained from 20 realizations of an M7 Hayward Fault earthquake in the San Francisco Bay Area, California USA, and inform the selection of rupture simulation parameters leading to strong motions. To this aim, comparisons are conducted with NGA-W2 and directivity ground-motion models and a selected population of records. An archetypal steel moment-resisting frame is utilized to assess infrastructure response distributions. The analyses carried out for each simulated event and subdomain with consistent properties in terms of shallow shear-wave velocity proved to be instrumental for better interpreting the differences between simulated motions and empirical models. The main reasons identified for variances between simulations and empirical relationships included (1) directivity effects fully captured by the simulations across the full breadth of rupture models; (2) site vicinity to ruptures that incorporate large-slip patches, particularly if these are in the forward-directivity direction; and (3) presence of geologic structures that can “trap” seismic waves and produce ground motions with large amplitude and long signal duration. The analyses carried out in this work provide a path for interpreting ground-motion site and event specificity obtained from a suite of physics-based simulations, differing only in the rupture model characterization, to inform the selection of simulation scenarios for site-specific engineering analyses under strong excitations. Evidence from this work points to the possibility that current hazard models may underestimate ground-motion intensities in areas where the combined effect of directivity and site conditions results in large ground-motion amplitudes.

58 GEOSCIENCES↗
NASA NTRS1999

New frontiers in design synthesis

The Intelligent Synthesis Environment (ISE), which is one of the major strategic technologies under development at NASA centers and the University of Virginia, is described. One of the major objectives of ISE is to significantly enhance the rapid creation of innovative affordable products and missions. ISE uses a synergistic combination of leading-edge technologies, including high performance computing, high capacity communications and networking, human-centered computing, knowledge-based engineering, computational intelligence, virtual product development, and product information management. The environment will link scientists, design teams, manufacturers, suppliers, and consultants who participate in the mission synthesis as well as in the creation and operation of the aerospace system. It will radically advance the process by which complex science missions are synthesized, and high-tech engineering Systems are designed, manufactured and operated. The five major components critical to ISE are human-centered computing, infrastructure for distributed collaboration, rapid synthesis and simulation tools, life cycle integration and validation, and cultural change in both the engineering and science creative process. The five components and their subelements are described. Related U.S. government programs are outlined and the future impact of ISE on engineering research and education is discussed.

User-Computer Interface↗
NASA NTRS2004

Packaging data products using data grid middleware for Deep Space Mission Systems

We are investigating a distributed computing infrastructure for releasing science products out of the mission pipeline. We are creating a DSMS Product Service and DSMS Data Packaging Service based on the OODT middleware, a Data Grid middleware technology that has proven successful in providing access to heterogeneous, disparate data, and federating that data using a common data model.

Deep Space Mission Systems↗
NASA NTRSDate not supplied

Framework for National Airspace System (NAS) Level Sustainability Assessment of New Aircraft

This paper introduces a framework for investigating the future sustainability benefits of conceptual vehicles. The framework considers the complex interactions between such vehicles and how it can be flown in the National Airspace System. Aggregate benefits for reduction in fuel use and emissions need to consider fleet wide operations, demand distributions, NAS Infrastructure, and differing business models. To extract true system level benefits multi-objective function optimization for operational energy use, acoustics, emissions and NAS Wide efficiency and interoperability incorporating physic-based system-wide flight simulations in the National Airspace system is required. The framework marries traditional vehicle synthesis processes with a NAS Simulation environment to simulate how a new synthesized vehicle will behave in the NAS.

Sustainability↗
DOE OSTI2020

Charging Infrastructure Technologies: Smart Electric Vehicle Charging for a Reliable and Resilient Grid (RECHARGE)

Annual Merit review of the Smart Electric Vehicle Charging for a Reliable and Resilient Grid (RECHARGE) project. This project will demonstrate the value of smart charge management to reduce the impact of Electric Vehicles at Scale. Assess management of Plug-in Electric Vehicle (PEV) charging at scale to avoid negative grid impacts, identify critical strategies and technologies, and enhance value for PEV / EVSE / grid stakeholders.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Integration of Rucio in Belle II

The Belle II experiment, which started taking physics data in April 2019, will multiply the volume of data currently stored on its nearly 30 storage elements worldwide by one order of magnitude to reach about 340 PB of data (raw and Monte Carlo simulation data) by the end of operations. To tackle this massive increase and to manage the data even after the end of the data taking, it was decided to move the Distributed Data Management software from a homegrown piece of software to a widely used Data Management solution in HEP and beyond : Rucio. This contribution describes the work done to integrate Rucio with Belle II distributed computing infrastructure as well as the migration strategy that was successfully performed to ensure a smooth transition.

97 MATHEMATICS AND COMPUTING↗