Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed workflows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

The Invasive Species Forecasting System

The Invasive Species Forecasting System (ISFS) provides computational support for the generic work processes found in many regional-scale ecosystem modeling applications. Decision support tools built using ISFS allow a user to load point occurrence field sample data for a plant species of interest and quickly generate habitat suitability maps for geographic regions of management concern, such as a national park, monument, forest, or refuge. This type of decision product helps resource managers plan invasive species protection, monitoring, and control strategies for the lands they manage. Until now, scientists and resource managers have lacked the data-assembly and computing capabilities to produce these maps quickly and cost efficiently. ISFS focuses on regional-scale habitat suitability modeling for invasive terrestrial plants. ISFS s component architecture emphasizes simplicity and adaptability. Its core services can be easily adapted to produce model-based decision support tools tailored to particular parks, monuments, forests, refuges, and related management units. ISFS can be used to build standalone run-time tools that require no connection to the Internet, as well as fully Internet-based decision support applications. ISFS provides the core data structures, operating system interfaces, network interfaces, and inter-component constraints comprising the canonical workflow for habitat suitability modeling. The predictors, analysis methods, and geographic extents involved in any particular model run are elements of the user space and arbitrarily configurable by the user. ISFS provides small, lightweight, readily hardened core components of general utility. These components can be adapted to unanticipated uses, are tailorable, and require at most a loosely coupled, nonproprietary connection to the Web. Users can invoke capabilities from a command line; programmers can integrate ISFS's core components into more complex systems and services. Taken together, these features enable a degree of decentralization and distributed ownership that have helped other types of scientific information services succeed in recent years.

Schnase, John↗

A Mobility-Driven Approach to Modeling Building Energy

Buildings are one of the primary energy consumers in any city's energy use [12]. Presence and absence of humans is a major contributing factor to the energy use in a building. In this paper, we present an approach to generating a realistic model of human building occupancy throughout a typical work week. We use the Toolbox for Urban Mobility Systems (TUMS) to generate a synthetic population based on population distribution estimates, we schedule the population's daily commute based on National Household Travel Survey (NHTS) survey data, and we simulate their daily travel patterns using an agent-based transportation simulation (TRANSIMS). We process and fuse the simulation output to produce a list of the first and last seen location of each agent in the simulation. Based on the arrival at the last destination, we map each agent to one of the nearby buildings. Using these agent arrivals, as well as NHTS data, we create an hourly occupancy schedule for each building. We successfully demonstrate this workflow at the example of the Chicago Loop, a major business district in Chicago, Illinois.

Berres, Andy↗

Design and Data Management System

The Design and Data Management System (DDMS) was developed to automate the NASA Engineering Order (EO) and Engineering Change Request (ECR) processes at the Propulsion Test Facilities at Stennis Space Center for efficient and effective Configuration Management (CM). Prior to the development of DDMS, the CM system was a manual, paper-based system that required an EO or ECR submitter to walk the changes through the acceptance process to obtain necessary approval signatures. This approval process could take up to two weeks, and was subject to a variety of human errors. The process also requires that the CM office make copies and distribute them to the Configuration Control Board members for review prior to meetings. At any point, there was a potential for an error or loss of the change records, meaning the configuration of record was not accurate. The new Web-based DDMS eliminates unnecessary copies, reduces the time needed to distribute the paperwork, reduces time to gain the necessary signatures, and prevents the variety of errors inherent in the previous manual system. After implementation of the DDMS, all EOs and ECRs can be automatically checked prior to submittal to ensure that the documentation is complete and accurate. Much of the configuration information can be documented in the DDMS through pull-down forms to ensure consistent entries by the engineers and technicians in the field. The software also can electronically route the documents through the signature process to obtain the necessary approvals needed for work authorization. The workflow of the system allows for backups and timestamps that determine the correct routing and completion of all required authorizations in a more timely manner, as well as assuring the quality and accuracy of the configuration documents.

Messer, Elizabeth↗

Legacy surface change analyses of the 1993 Rock Valley earthquake sequence for direct comparison to planned NA-22 underground conventional high-explosive experiments (Source Physics Experiment 3 (SPE3) - RV/DC Task 1.3 FY22 Final Report)

Recent work under two previous phases of the NNSA NA-22 Source Physics Experiment (SPE) have shown that underground chemical high-explosive experiments can produce detectable surface changes that differ in spatial extent and vertical magnitude depending on the geologic media at the site (Schultz-Fellenz et al., 2018; 2020; Crawford et al., 2021). Neither of these two prior phases of SPE identified natural earthquake-related surface effects in the same region that occurred at a similar depth as the explosive experiments for direct comparison. While earthquakes can also produce surface changes that are detectable using remote sensing data analyses, it is expected that the pattern and spatial extent of surface changes would vary between earthquakes and explosions. However, no direct-observed surface-change signature comparison between earthquakes and explosions has ever been performed. The SPE Phase 3 Rock Valley/Direct Comparison (RV/DC) program presents a unique opportunity to investigate and characterize co-occurrence of both earthquakes and explosions. In this project, we worked to address five tasks in a workflow, as follows: 1. Identify and obtain existing high-resolution legacy satellite and aerial imagery as close in time before and after the 1993 Rock Valley earthquake sequence to temporally constrain the analyses. 2. Transform these pre-earthquake and post-earthquake datasets into digital elevation models (DEMs) using geospatial analysis software packages (e.g., ArcGIS, Agisoft Metashape, and Google Earth Engine). 3. Perform DEM differencing analyses to assess and quantify earthquake-related changes from the 1993 sequence, and develop map products that visualize these analyses. 4. Use the analyses from (3) to: (a) assess spatial distribution and magnitude of surface changes due to the 1993 Rock Valley earthquake sequence, and (b) determine parameters of forthcoming, planned explosion-related surface change data collection from sensors mounted on unmanned aerial vehicles (UAVs) (e.g., spatial extent of collection, design and density of survey control, sensors to deploy, forward speed and line spacing of UAV flight lines, flight altitude). 5. Develop a summary report on the analyses, including how the analyses define parameters and identify focus areas for any future surface change analytical field campaigns related to the explosive experiment. Analyzing these legacy data and identifying whether they can detect any surface changes related to the earthquake sequence facilitates opportunities for direct signature comparison of surface change from explosions at one location, which has never previously been performed. Comparing the surface change signatures from a co-located and depth-equivalent earthquake and an explosion could help to advance remote sensing event discrimination techniques. This report summarizes the work completed toward this ambitious goal.

42 ENGINEERING↗

New U.S. Data Tools are Playing a Crucial Role in Decarbonizing Buildings at Speed, Scale, and Low Cost

Preparing buildings for retrofits traditionally requires expensive on-site audits or timeintensive simulation models. As a result, the majority of buildings fail to pursue cost-saving retrofits. To address these barriers, the U.S. Department of Energy (DOE) has introduced the Building Efficiency Targeting Tool for Energy Retrofits (BETTER)-a new, free, on-line tool that utilizes a data-driven analytical engine and user-friendly web interface to automatically analyze a building's monthly energy usage in response to weather conditions. The tool benchmarks a building's electric and fossil energy usage against peers; estimates energy, cost, and emissions reductions at the building and portfolio levels; recommends energy efficiency measures; and prioritizes buildings for net-zero energy retrofits. Thanks to interoperability with the DOE's Standard Energy Efficiency Data (SEED) platform, BETTER is supporting U.S. jurisdictions to prepare buildings for retrofit at speed, scale, and low cost to comply with energy policies. This paper discusses the use of BETTER and SEED by one of the branches of the California state government to streamline a retrofit program across 455 public non-residential buildings to align with state goals to reduce greenhouse gas emissions. It describes the organization's challenge to reduce energy consumption across a geographically diverse, aging portfolio; explores how BETTER and SEED improved workflow efficiency; presents preliminary results, including avoiding audit costs of $3.28 million and developing the groundwork for retrofit projects estimated to prevent emission of 2,271 t CO2e annually; and provides guidance for other jurisdictions seeking similar results.

BETTER↗

Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana

For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by CERN, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim to achieve a single, simpler, environment for all monitoring applications. This document describes these tools and the data flows for monitoring and accounting.

97 MATHEMATICS AND COMPUTING↗

Integrated edge-to-exascale workflow for real-time steering in neutron scattering experiments

We introduce a computational framework that integrates artificial intelligence (AI), machine learning, and high-performance computing to enable real-time steering of neutron scattering experiments using an edge-to-exascale workflow. Focusing on time-of-flight neutron event data at the Spallation Neutron Source, our approach combines temporal processing of four-dimensional neutron event data with predictive modeling for multidimensional crystallography. At the core of this workflow is the Temporal Fusion Transformer model, which provides voxel-level precision in predicting 3D neutron scattering patterns. The system incorporates edge computing for rapid data preprocessing and exascale computing via the Frontier supercomputer for large-scale AI model training, enabling adaptive, data-driven decisions during experiments. This framework optimizes neutron beam time, improves experimental accuracy, and lays the foundation for automation in neutron scattering. Although real-time experiment steering is still in the proof-of-concept stage, the demonstrated potential of this system offers a substantial reduction in data processing time from hours to minutes via distributed training, and significant improvements in model accuracy, setting the stage for widespread adoption across neutron scattering facilities and more efficient exploration of complex material systems.

97 MATHEMATICS AND COMPUTING↗

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗

SWAMP+: multiple subsequence alignment using associative massive parallelism

A new parallel algorithm SWAMP+ incorporates the Smith-Waterman sequence alignment on an associative parallel model known as ASC. It is a highly sensitive parallel approach that expands traditional pairwise sequence alignment. This is the first parallel algorithm to provide multiple non-overlapping, non-intersecting subsequence alignments with the accuracy of Smith-Waterman. The efficient algorithm provides multiple alignments similar to BLAST while creating a better workflow for the end users. The parallel portions of the code run in O(m+n) time using m processors. When m = n, the algorithmic analysis becomes O(n) with a coefficient of two, yielding a linear speedup. Implementation of the algorithm on the SIMD ClearSpeed CSX620 confirms this theoretical linear speedup with real timings.

99 GENERAL AND MISCELLANEOUS↗

Robust In-Situ Strain Measurements to Monitor CO 2 Storage

The goal of this project was to develop and demonstrate robust instrumentation to monitor the in-situ strain tensor in order to improve the reliability and security of CO 2 storage in geologic formations. We met the original goals of the project and the major overarching accomplishment is the advancement of strain tensor monitoring from an intriguing concept to a commercially available technology with a solid foundation of novel instruments supported by theoretical analyses and validation experiments. The main accomplishments of the project are summarized below. We designed, built and evaluated nine new optical fiber strainmeters and tiltmeters using Michelson interferometers to measure deformation with ultra-high resolution at both shallow and deep point locations in the subsurface. These are the robust strainmeters that motivated the title of the project. We designed, built and evaluated a novel method of measuring distributed strain in optical fibers with nanostrain resolution, and cm-scale location, and sampling into the seismic band. The new method is called Coherence-length-gated Microwave Photonics Interfereometry (CMPI). CMPI technology has advantages over existing commercial DAS and DSS methods. We developed and demonstrated capabilities to deploy instruments in the field and used them to measure strain caused by ambient signals like barometric pressure and tides, as well as induced signals like surface loading and pore pressure changes from pumping tests. We deployed a working strainmeter at 1,700 ft depth, slightly above an active reservoir. This is to our knowledge the greatest depth a strainmeter has been deployed and the techniques we used can readily be extended to greater depths. Optical fiber borehole tensor strainmeter techology was advanced from a TRL 4 at the start, to a TRL of 7 at the conclusion of the project. The project included advances in simulations and theoretical analyses. We developed and demonstrated a computational workflow that uses machine learning to reduce the computational requirements and make it practical to use Bayesian inversion to solve large numerical poroelastic analyses needed to interpret strain tensor field data. We evaluated the strain tensor fields and time series that would be caused by leaks of CO 2 or other fluids from reservoirs. These simulations demonstrated that signals from leaks could be measured with instruments developed for the project, opening a potentially new method for ensuring storage security. We showed that strains in caprock can be used to estimate pressure in a reservoir. This avoids the need to drill monitoring wells into the reservoir, and it expands the capabilities of monitoring in the caprock. The project includes a derivation and application of a novel analytical solution to the strains in the vicinity of a pressurized poroelastic inclusion. This solution explains field data measured during injeciton tests at the North Avant Field, and it will simplify future interpretation of strain tensor data. The project included a broad range of experiments, and of the most significant is the characterization of the strain tensor at an array three strainmeters during six injection tests at the North Avant Field, Oklahoma. This demonstrated repeatability of the strain signal measured by the new instruments developed for the project, and it showed similarities between the strain signal at shallow depths and pressure in the underlying reservoir. We also demonstrated that useful strain data can be measured at reservoir depths. This confirms that strain tensor data can be measured throughout the caprock over a reservoir. The project demonstrated the feasibility of using the strain tensor and distributed strain measured in caprock during a variety of different well tests where the pumping rate was constant, sinusoidal and positive, or a periodic square wave with zero net rate. This further strengthens the validity of using strain data to characterize reservoirs and aquifers. We also demonstrated that strain caused be fluctuations of air pressure and water pressure in the vadose zone can be measured and interpreted, suggesting that high resolution distributed strain measurements hold promise for monitoring the vadose zone. The project partially supported nine graduate students in the Environmental Engineering, Hydrogeology, Electrical Engineering programs at Clemson University. The research was described in nine journal papers, 23 talks and conference abstracts. Additional journal papers are in preparation. A new company called Tensora was started to provide strainmeter technology for commercial applications.

01 COAL, LIGNITE, AND PEAT↗

MPACT Verification and Validation Manual (rev 1)

The MPACT code provides the capability to calculate the steady-state and transient reactor core neutron distribution for operating nuclear power plant (PWR) conditions across multiple fuel cycles. As required in the CASL SQA plan, it is the responsibility of UM and ORNL as joint owners of MPACT to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be distributed for reference and distribution within VERA. This document provides the first revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the framework for future MPACT V&V activities. During FY16, MPACT V&V activities in the areas of code verification have continued to mature and work has progressed on code error evaluation using the Method of Manufactured Solutions (MMS). Several specific tasks have also been completed to improve MPACT code verification to include tasks to improve the unit and regression test coverage. A joint UM/ORNL task was completed to develop standardize coding standards and workflow for the continued collaborative development of MPACT. During the past year, MPACT validation work has continued in both the areas of measured data from critical experiments as well as measured data from operating nuclear power plants. Preliminary work was also performed in FY16 on the use of post-irradiation examinations for evaluation and validation of the isotopic depletion capability in MPACT. Based on the results of V&V efforts this past year, the confidence level has increased in the ability of MPACT to model an operational Pressurized Water Reactor. Areas were identified which require increased emphasis during FY17 to include updating all the V&V problems with the new 51-group library, the completion of cycle 2 of the BEAVRS benchmark, initial validation for BWR applications, the addition of Uncertainty Quantification results into the benchmark results, and the completion of specific validation tasks for the CASL Challenge problems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A phased workflow to define permit‐ready locations for large volume CO 2 injection and storage

Abstract To‐date, only two UIC Class VI permits have been issued by the US Environmental Protection Agency. We illustrate a four‐phase workflow to first identify regional storage resources and then down‐select sites to yield permit‐ready locations that can accept and store large volumes of CO 2 . Specific permit requirements should guide objectives and define deliverables of respective workflow phases. In the first phase we used available regional data and screened structure and injection zones to locate resources that match CO 2 volumes planned to be captured. Available data were also used to assess presence and depth of usable groundwater, the key resource being protected via permitting. We then used advanced, closed‐form, analytical solutions (EASiTool) to estimate CO 2 injectivity into each hydrologically connected injection compartment. In the second phase we acquired and conditioned additional wireline logs and leased available seismic datasets. We interpreted the depositional systems from wireline well‐log character and mapped sandbody geometry to interpolate injection and confining‐zone distribution. Using available data, we mapped faults and locations of freshwater and overpressure (or other capacity‐limiting geologic parameters) in more detail. In the third phase, we used the augmented geologic data to develop a static model for the selected area, extracted the areas of highest interest, and generated and ran dynamic (flow) models. In a fourth phase, we reduced major uncertainties identified in earlier phases. Our case study indicates that to complete preparation of a permit application requires (1) improved lithologic characterization information (thicknesses and horizontal and vertical connectivity) and (2) better definition of poorly defined local faults. © 2023 The Authors. Greenhouse Gases: Science and Technology published by Society of Chemical Industry and John Wiley & Sons Ltd.

58 GEOSCIENCES↗

HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation

Historically, high energy physics computing has been performed on large purpose-built computing systems. These began as single-site compute facilities, but have evolved into the distributed computing grids used today. Recently, there has been an exponential increase in the capacity and capability of commercial clouds. Cloud resources are highly virtualized and intended to be able to be flexibly deployed for a variety of computing tasks. There is a growing interest among the cloud providers to demonstrate the capability to perform large-scale scientific computing. In this paper, we discuss results from the CMS experiment using the Fermilab HEPCloud facility, which utilized both local Fermilab resources and virtual machines in the Amazon Web Services Elastic Compute Cloud. We discuss the planning, technical challenges, and lessons learned involved in performing physics workflows on a large-scale set of virtualized resources. Additionally, we will discuss the economics and operational efficiencies when executing workflows both in the cloud and on dedicated resources.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗

A low-cost centralized HVAC control system solution for energy savings, load shedding, and improved maintenance

University campuses rely on centralized controls for managing and optimizing complex HVAC systems in larger buildings. However, most campuses also have many smaller buildings with packaged HVAC systems controlled by a stand-alone thermostat. Even when these distributed and often overlooked systems have modern programmable thermostats, they cannot be centrally monitored or controlled, and they are typically not programmed adequately. This paper describes the implementation of a low-cost centralized control solution for these systems serving smaller campus buildings, mostly under 5,000 sf and representative of light commercial spaces. Thanks to advances in technology spurred by residential and commercial IoT developments, simple networked thermostat solutions exist that can easily replace original thermostats, and, connect these systems to a web-based portal for monitoring and control. We show that, with small customizations, these platforms can be integrated into facility management workflows. Beyond the energy savings potential from improved scheduling and closer management of these systems, there are significant advantages for maintenance crews since these systems can now be monitored on smart phones or tablets. A grid-responsive load-shedding program has also been implemented for additional cost savings. The networked thermostats can also be connected to additional systems such as economizer controls for improved ventilation management and energy savings. With data from these systems integrated centrally, it can also be used for improved analytics and fault detection. A toolkit has been developed to share the program with other campuses, whether for energy savings, improved management of ventilation, or a more proactive maintenance approach.

Fauchier-Magnan, Nicolas↗

Resilient, Rural, and Revolutionary: Salisbury Square's Direct-Current Affordable Microgrid Community: Preprint

The technology to interconnect buildings with a dedicated direct-current (DC) power distribution network is in place today; what is missing is a turnkey approach to designing a DC microgrid - and the business models allowing such systems to be deployed, owned, and operated at scale. To close this gap, the Salisbury Square Development Team, comprising clean-energy experts, has engineered a resilient community DC microgrid for an affordable housing community in Randolph, Vermont. Ten single-family, occupant-owned residences and 12 multifamily rental units will share locally generated and stored solar energy via a DC power distribution bus capable of operating during extended grid outages. With a DC power distribution network in place, each home will be equipped with high-efficiency DC lighting and appliances, operating alongside alternating current (AC) appliances, even during an islanded mode of operation. To obtain a comprehensive understanding of what is possible and achievable, the Team collaborated with the local utility, regulatory agencies, a national laboratory, energy-as-service providers, and vendors. The collaborators evaluated microgrid typologies, business models, and energy modeling, and analyzed electrification and resilience. Further, the Team applied the URBANoptTM (Urban Renewable Building and Neighborhood optimization, NREL 2022) software development kit (SDK) to Salisbury Square's single-family and multifamily buildings to validate workflows and identify needs for advanced capability. This paper addresses the barriers to entry, scalability, and impact on residents and system ownership. It also examines the analysis that informed the design and engineering of the DC microgrid and the opportunities to streamline the process.

DER↗

Pedestal particle balance studies in JET-ILW H-mode plasmas

JET-ILW type I ELMy H-modes at 2.5 MA/2.8 T with constant NBI heating (23 MW) and gas fuelling rate were performed, utilising edge localised mode (ELM) pacing by vertical kicks and plasma shaping (triangularity, δ) as tools to disentangle the effects of ELMs, inter-ELM transport and edge stability on the pedestal particle balance. In agreement with previous studies, the pedestal confinement improves with increasing δ, mostly due to a significant increase in pedestal density while the ELM frequency ($f_{\mathrm{ELM}}$) is decreased. Improved pedestal confinement with increasing δ was observed even when the pedestal MHD stability was degraded artificially by vertical kicks, implying that increased triangularity may favourably affect the inter-ELM pedestal recovery. The workflow developed to quantify the pedestal particle balance uses high time-resolution profile reflectometry to characterise the inter-ELM evolution of the plasma particle content ($\mathrm{d} N/\mathrm{d}t$), the NEO drift-kinetic solver to evaluate the neoclassical fluxes and interpretative EDGE2D-EIRENE simulations to estimate the edge particle source. The edge particle source is then constrained by deuterium Balmer-α line intensity measurements in the main chamber, which are, however, strongly affected by reflections from the metal walls. The reflections are accounted for by the CHERAB code taking the divertor emission (the brightest light source in the torus) distribution from imaging spectroscopy measurements as input. Our analysis shows that in the second half of the ELM cycle, the volume-integrated particle source is larger than $\mathrm{d} N/\mathrm{d}t$, indicating that transport plays a key role in the inter-ELM pedestal recovery.

fuelling↗

Current parallel I/O limitations to scalable data analysis.

This report describes the limitations to parallel scalability which we have encountered when applying our otherwise optimally scalable parallel statistical analysis tool kit to large data sets distributed across the parallel file system of the current premier DOE computational facility. This report describes our study to evaluate the effect of parallel I/O on the overall scalability of a parallel data analysis pipeline using our scalable parallel statistics tool kit [PTBM11]. In this goal, we tested it using the Jaguar-pf DOE/ORNL peta-scale platform on a large combustion simulation data under a variety of process counts and domain decompositions scenarios. In this report we have recalled the foundations of the parallel statistical analysis tool kit which we have designed and implemented, with the specific double intent of reproducing typical data analysis workflows, and achieving optimal design for scalable parallel implementations. We have briefly reviewed those earlier results and publications which allow us to conclude that we have achieved both goals. However, in this report we have further established that, when used in conjuction with a state-of-the-art parallel I/O system, as can be found on the premier DOE peta-scale platform, the scaling properties of the overall analysis pipeline comprising parallel data access routines degrade rapidly. This finding is problematic and must be addressed if peta-scale data analysis is to be made scalable, or even possible. In order to attempt to address these parallel I/O limitations, we will investigate the use the Adaptable IO System (ADIOS) [LZL+10] to improve I/O performance, while maintaining flexibility for a variety of IO options, such MPI IO, POSIX IO. This system is developed at ORNL and other collaborating institutions, and is being tested extensively on Jaguar-pf. Simulation code being developed on these systems will also use ADIOS to output the data thereby making it easier for other systems, such as ours, to process that data.

99 GENERAL AND MISCELLANEOUS↗