Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

INTEGRATION OF PANDA WORKLOAD MANAGEMENT SYSTEM WITH SUPERCOMPUTERS

Abstract The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the funda- mental nature of matter and the basic forces that shape our universe, and were recently credited for the dis- covery of a Higgs boson. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 140 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data cen- ters are physically scattered all over the world. While PanDA currently uses more than 250000 cores with a peak performance of 0.3+ petaFLOPS, next LHC data taking runs will require more resources than Grid computing can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, Europe and Russia (in particular with Titan supercomputer at Oak Ridge Leadership Com- puting Facility (OLCF), Supercomputer at the National Research Center Kurchatov Institute , IT4 in Ostrava, and others). The current approach utilizes a modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single- threaded workloads in parallel on Titan s multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms. We will present our current accom- plishments in running PanDA WMS at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facility s infrastructure for High Energy and Nuclear Physics, as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

De, K↗
DOE OSTI2016

PolyCheck: Dynamic Verification of Iteration Space Transformations on Affine Programs

High-level compiler transformations, especially loop transformations, are widely recognized as critical optimizations to restructure programs to improve data locality and expose parallelism. Guaranteeing the correctness of program transformations is essential, and to date three main approaches have been developed: proof of equivalence of affine programs, matching the execution traces of programs, and checking bit-by-bit equivalence of the outputs of the programs. Each technique suffers from limitations in either the kind of transformations supported, space complexity, or the sensitivity to the testing dataset. In this paper, we take a novel approach addressing all three limitations to provide an automatic bug checker to verify any iteration reordering transformations on affine programs, including non-affine transformations, with space consumption proportional to the original program data, and robust to arbitrary datasets of a given size. We achieve this by exploiting the structure of affine program control- and data-flow to generate at compile-time lightweight checker code to be executed within the transformed program. Experimental results assess the correctness and effectiveness of our method, and its increased coverage over previous approaches.

affine programs↗
DOE OSTI2016

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. While PanDA currently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, LHC data taking runs require more resources than Grid computing can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, Europe and Russia (in particular with Titan supercomputer at Oak Ridge Leadership Computing Facility (OLCF), MIRA supercomputer at Argonne Leadership Computing Facilities (ALCF), Supercomputer at the National Research Center Kurchatov Institute , IT4 in Ostrava and others). Current approach utilizes modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single threaded workloads in parallel on LCFs multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms for ALICE and ATLAS experiments and it is in full production for the ATLAS experiment since September 2015. We will present our current accomplishments with running PanDA WMS at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

Data-intensive science↗
NASA NTRS2016

On the Distance to the North Polar Spur and the Local CO-H2 Factor

Aims. Most models identify the X-ray bright North Polar Spur (NPS) with a hot interstellar (IS) bubble in the Sco-Cen star-forming region at approx. = to 130 pc. An opposite view considers the NPS as a distant structure associated with Galactic nuclear outflows. Constraints on the NPS distance can be obtained by comparing the foreground IS gas column inferred from X-ray absorption to the distribution of gas and dust along the line of sight. Absorbing columns towards shadowing molecular clouds simultaneously constrain the CO-H2 conversion factor. Methods. We derived the columns of X-ray absorbing matter N(sub Habs) from spectral fitting of dedicated XMM-Newton observations towards the NPS southern terminus (l(sup II) approx. = to 29 degrees, b(sup II) approx. = to +5 to +11 degrees). The distribution of the IS matter was obtained from absorption lines in stellar spectra, 3D dust maps and emission data, including high spatial resolution CO measurements recorded for this purpose. Results. N(sub Habs) varies from approx. = to 4.3 to approx. = to 1.3 x 10(exp 21) per sq cm along the 19 fields. Relationships between X-ray brightness, absorbing column and hardness ratio demonstrate a brightness decrease with latitude governed by increasing absorption. The comparison with absorption data, local and large-scale dust maps rules out a NPS near side closer than 300 pc. The correlation between N(sub Habs) and the reddening increases with the sightline length from 300 pc to 4 kpc and is the tightest with Planck tau(sub 353GHz) -based reddening, suggesting a much larger distance. N(H)/E(B-V)(sub tao) approx. = to 4.1 x 10(exp 21) per sq cm mag, close to Fermi-Planck determinations. N(sub Habs) absolute values are compatible with HI-CO clouds at -5 less than or equal to V(sub LSR) less than or equal to +25 to +45 km/s and a NPS potentially far beyond the Local Arm. A shadow cast by a b=+9 degree molecular cloud constrains X(sub CO) in that direction to less than or equal to 1.0 x 10(exp 20) sec/((sq cm)K km). The average X(sub CO) over the fields is less than or equal to 0.75 x 10(exp 20) sec/((sq cm)K km).

X-rays: ISM / radio lines: ISM / local insterstell↗
DOE OSTI2019

Pre-Project Planning for a Flameless Pressurized Oxy-Combustion Pilot Plant (Final Technical Report)

The team of Southwest Research Institute® (SwRI®), ITEA, Electric Power Research Institute, Inc. (EPRI), GE Global Research (GE), Jacobs Engineering (Jacobs), and Peter Reineck Associates (PRA) are advancing Flameless Pressurized Oxy-Combustion (FPO), a novel coal technology. This effort seeks to complete the preliminary engineering and planning of a 50-MWth Pilot Plant that produces electricity and steam for district heating. The technology, pioneered by ITEA at the 5-MWth scale, must be brought to a higher technology readiness level (TRL) to be viable at the commercial scale. This project builds upon extensive evaluation of the techno-economic performance of the FPO technology already performed by ITEA. This includes system improvements, such as the addition of a turbo-expander to the flue gas stream. Some of the performance-enhancing components are not as well defined as others. The primary goal of this project was to bring all of the core cycle components to the same level of design maturity. Extensive cycle modeling and evaluation explored various configurations of the process. Different coals, operating conditions, and heat recovery devices were considered and modeled using Aspen Plus. The results of the cycle modeling informed the pilot plant configuration and the planned configuration at the commercial scale. The system pressurization is maintained in the flue gas clean-up and water removal. This allows for efficient and cost-effective carbon dioxide compression and sequestration package. Once the cycle was optimized, preliminary drawings, layouts, and plans defined the pilot facility. Process flow diagrams (PFD) were used to describe the pilot configuration in greater detail. A heat and mass balance with stream data was created. A master equipment list specified the operating conditions for major pieces of equipment within the pilot using this heat and mass balance. A detailed cost estimate for the planned configuration was completed with an Association for the Advancement of Cost Engineering (AACE) Class IV level of cost analysis. A site selection effort evaluated a variety of potential candidate sites. The selection effort focused on three sites for an in-depth evaluation of the merits and viability of hosting a pilot demonstration. The ability of the host site to support the project with cost sharing was also assessed. The selection process chose the University of Wyoming (UW) as the host site, and cost estimates for the pilot capital estimate were made using local data. A preliminary test plan and operation plan, which creates figures of merit, control, and instrumentation was produced. An effort that outlines methods of pilot cost reduction was completed near the end of the project. A techno-economic assessment (TEA) evaluated the FPO technology at the commercial scale in comparison to the NETL baseline cases. The reference plants were used in combination with proprietary equipment estimates to build a plant capital cost and cost of electricity evaluation. FPO performed better than the sub-bituminous post-combustion capture cases. Further preliminary estimates of improvements to the FPO cycle show even further gains when compared to conventional carbon capture methods.

01 COAL, LIGNITE, AND PEAT↗
NASA NTRS2012

Global CO2 Distributions over Land from the Greenhouse Gases Observing Satellite (GOSAT)

January 2009 saw the successful launch of the first space-based mission specifically designed for measuring greenhouse gases, the Japanese Greenhouse gases Observing SATellite (GOSAT). We present global land maps (Level 3 data) of column-averaged CO2 concentrations (X(sub CO2)) derived using observations from the GOSAT ACOS retrieval algorithm, for July through December 2009. The applied geostatistical mapping approach makes it possible to generate maps at high spatial and temporal resolutions that include uncertainty measures and that are derived directly from the Level 2 observations, without invoking an atmospheric transport model or estimates of CO2 uptake and emissions. As such, they are particularly well suited for comparison studies. Results show that the Level 3 maps for July to December 2009 on a lO x 1.250 grid, at six-day resolution capture much of the synoptic scale and regional variability of X(sub CO2), in addition to its overall seasonality. The uncertainty estimates, which reflect local data coverage, X(sub CO2) variability, and retrieval errors, indicate that the Southern latitudes are relatively well-constrained, while the Sahara Desert and the high Northern latitudes are weakly-constrained. A probabilistic comparison to the PCTM/GEOS-5/CASA-GFED model reveals that the most statistically significant discrepancies occur in South America in July and August, and central Asia in September to December. While still preliminary, these results illustrate the usefulness of a high spatiotemporal resolution, data-driven Level 3 data product for direct interpretation and comparison of satellite observations of highly dynamic parameters such as atmospheric CO2.

Hammerling, Dorit M.↗
NASA NTRS2015

Real-Time Kennedy Space Center and Cape Canaveral Air Force Station High-Resolution Model Implementation and Verification

Customer: NASA's Launch Services Program (LSP), Ground Systems Development and Operations (GSDO), and Space Launch System (SLS) programs. NASA's LSP, GSDO, SLS and other programs at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) use the daily and weekly weather forecasts issued by the 45th Weather Squadron (45 WS) as decision tools for their day-to-day and launch operations on the Eastern Range (ER). For example, to determine if they need to limit activities such as vehicle transport to the launch pad, protect people, structures or exposed launch vehicles given a threat of severe weather, or reschedule other critical operations. The 45 WS uses numerical weather prediction models as a guide for these weather forecasts, particularly the Air Force Weather Agency (AFWA) 1.67 kilometer Weather Research and Forecasting (WRF) model. Considering the 45 WS forecasters' and Launch Weather Officers' (LWO) extensive use of the AFWA model, the 45 WS proposed a task at the September 2013 Applied Meteorology Unit (AMU) Tasking Meeting requesting the AMU verify this model. Due to the lack of archived model data available from AFWA, verification is not yet possible. Instead, the AMU proposed to implement and verify the performance of an ER version of the AMU high-resolution WRF Environmental Modeling System (EMS) model (Watson 2013) in real-time. The tasking group agreed to this proposal; therefore the AMU implemented the WRF-EMS model on the second of two NASA AMU modeling clusters. The model was set up with a triple-nested grid configuration over KSC/CCAFS based on previous AMU work (Watson 2013). The outer domain (D01) has 12-kilometer grid spacing, the middle domain (D02) has 4-kilometer grid spacing, and the inner domain (D03) has 1.33-kilometer grid spacing. The model runs a 12-hour forecast every hour, D01 and D02 domain outputs are available once an hour and D03 is every 15 minutes during the forecast period. The AMU assessed the WRF-EMS 1.33-kilometer domain model performance for the 2014 warm season (May-September). Verification statistics were computed using the Model Evaluation Tools, which compared the model forecasts to observations. The mean error values were close to 0 and the root mean square error values were less than 1.8 for mean sea-level pressure (millibars), temperature (degrees Kelvin), dewpoint temperature (degrees Kelvin), and wind speed (per millisecond), all very small differences between the forecast and observations considering the normal magnitudes of the parameters. The precipitation forecast verification results showed consistent under-forecasting of the precipitation object size. This could be an artifact of calculating the statistics for each hour rather than for the entire 12-hour period. The AMU will continue to generate verification statistics for the 1.33-kilometer WRF-EMS domain as data become available in future cool and warm seasons. More data will produce more robust statistics and reveal a more accurate assessment of model performance. Once the formal task was complete, the AMU conducted additional work to better understand the wind direction results. The results were stratified diurnally and by wind speed to determine what effects the stratifications would have on the model wind direction verification statistics. The results are summarized in the addendum at the end of this report. In addition to verifying the model's performance, the AMU also made the output available in the Advanced Weather Interactive Processing System II (AWIPS II). This allows the 45 WS and AMU staff to customize the model output display on the AMU and Range Weather Operations AWIPS II client computers and conduct real-time subjective analyses. In the future, the AMU will implement an updated version of the WRF-EMS model that incorporates local data assimilation. This model will also run in real-time and be made available in AWIPS II.

Numerical Weather Prediction↗
DOE OSTI2018

Laboratory Studies of Particle Cementation and PV Module Soiling

Monitoring of photovoltaic (PV) systems can maintain efficient operations. However, extensive monitoring of large quantities of data can be a cumbersome process. The present work introduces a simple, inexpensive, yet effective data monitoring strategy for detecting faults and determining lost revenues automatically. This was achieved through the deployment of Raspberry Pi (RPI) device at a PV system's combiner box. The RPI was programmed to collect PV data through Modbus communications, and store the data locally in a MySQL database. Then, using a Gaussian Process Regression algorithm the RPI device was able to accurately estimate string level current, voltage, and power values. The device could also detect system faults using a Support Vector Novelty Detection algorithm. Finally, the RPI was programmed to output the potential lost revenue caused by the abnormal condition. The system analytics information was then displayed on a user interface. The interface could be accessed by operations personal to direct maintenance activity so that critical issues can be solved quickly.

14 SOLAR ENERGY↗
NASA NTRS2011

30 WS North Base Wind Study

The 30 Weather Squadron (30 WS) is concerned about strong winds observed at their northern towers without advance warning. They state that terrain influences along the extreme northern fringes of Vandenberg Air Force Base (VAFB) make it difficult for forecasters to issue timely and accurate high wind warnings for northeasterly wind events. These events tend to occur during the winter or early spring when they are under the influence of the Great Basin high pressure weather regime. The Launch Weather Officers (LWOs) have seen these rapid wind increases in the current northern Towers 60, 70 and 71 in excess of their 35 kt operational warning threshold. For this task, the 30 WS requested the Applied Meteorology Unit (AMU) analyze data from days when these towers reported winds in excess of 35 kt and determine if there were any precursors in the observations that would allow the LWOs to better forecast and warn their operational customers for these wind events. The 30 WS provided wind tower data for the cool season (October - March) from the period January 2004-March 20 IO. The AMU decoded and evaluated the wind tower data for 66 days identified by the 30 WS as having high-wind events. Out of the 66 event days, only 30 had wind speed observations of > or =35 kt from at least one of the three northern towers. The AMU analyzed surface and upper air charts to determine the synoptic conditions for each event day along with tower peak wind speed and direction time series and wind rose charts for all 30 event days. The analysis revealed a trend on all event days in which the tower winds shifted to the northeast for a period of time before the first recorded > or =35 kt wind speed. The time periods for the 30 event days ranged from 20 minutes to several hours, with a median value of 110 minutes. This trend, if monitored, could give the 30 WS forecasters a precursor to assist in issuing an operational warning before a high wind event occurs. The AMU recommends developing a high-wind alert capability for VAFB using a local mesoscale model to forecast these wind events. The model should incorporate all of the VAFB local data sets and have a forecast capability of between 2 to 24 hours. Such a model would allow the meteorologists at VAFB to alert the operational customers of high wind events in a timely manner so protective action could be taken.

Wheeler, Mark↗
DOE OSTI2019

Data from: Evapotranspiration is resilient in the face of land cover and climate change in a humid temperate catchment

In temperate humid catchments, evapotranspiration returns more than half of the annual precipitation to the atmosphere, thereby determining the balance available to recharge groundwaters and support stream flow and lake levels. Changes in evapotranspiration rates and therefore catchment hydrology could be driven by changes in land use or climate. Here we examine the catchment water balance over the past 50 y for a catchment in southwest Michigan covered by cropland, grassland, forest, and wetlands. Over the study period about 27% of the catchment has been abandoned from row-crop agriculture to perennial vegetation and about 20% of the catchment has reverted to deciduous forest, and the climate has warmed by 1.14°C. Despite these changes in land use, precipitation and stream discharge, and by inference catchment-scale evapotranspiration, have been stable over the study period. The remarkably stable rates of evapotranspirative water loss from the catchment across a period of significant land cover change suggest that rainfed annual crops and perennial vegetation do not differ greatly in evapotranspiration rates, and this is supported by measurements of evapotranspiration from various vegetation types based on soil water monitoring in the same catchment. Compensating changes in the other meteorological drivers of evaporative water demand besides air temperature—wind speed, atmospheric humidity, and net radiation—are also possible, but cannot be evaluated due to insufficient local data across the 50-y period. Regardless of the explanation, this study shows that the water balance of this landscape has been resilient in the face of both land cover and climate change over the past 50 y.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2011

Network-Capable Application Process and Wireless Intelligent Sensors for ISHM

Intelligent sensor technology and systems are increasingly becoming attractive means to serve as frameworks for intelligent rocket test facilities with embedded intelligent sensor elements, distributed data acquisition elements, and onboard data acquisition elements. Networked intelligent processors enable users and systems integrators to automatically configure their measurement automation systems for analog sensors. NASA and leading sensor vendors are working together to apply the IEEE 1451 standard for adding plug-and-play capabilities for wireless analog transducers through the use of a Transducer Electronic Data Sheet (TEDS) in order to simplify sensor setup, use, and maintenance, to automatically obtain calibration data, and to eliminate manual data entry and error. A TEDS contains the critical information needed by an instrument or measurement system to identify, characterize, interface, and properly use the signal from an analog sensor. A TEDS is deployed for a sensor in one of two ways. First, the TEDS can reside in embedded, nonvolatile memory (typically flash memory) within the intelligent processor. Second, a virtual TEDS can exist as a separate file, downloadable from the Internet. This concept of virtual TEDS extends the benefits of the standardized TEDS to legacy sensors and applications where the embedded memory is not available. An HTML-based user interface provides a visual tool to interface with those distributed sensors that a TEDS is associated with, to automate the sensor management process. Implementing and deploying the IEEE 1451.1-based Network-Capable Application Process (NCAP) can achieve support for intelligent process in Integrated Systems Health Management (ISHM) for the purpose of monitoring, detection of anomalies, diagnosis of causes of anomalies, prediction of future anomalies, mitigation to maintain operability, and integrated awareness of system health by the operator. It can also support local data collection and storage. This invention enables wide-area sensing and employs numerous globally distributed sensing devices that observe the physical world through the existing sensor network. This innovation enables distributed storage, distributed processing, distributed intelligence, and the availability of DiaK (Data, Information, and Knowledge) to any element as needed. It also enables the simultaneous execution of multiple processes, and represents models that contribute to the determination of the condition and health of each element in the system. The NCAP (intelligent process) can configure data-collection and filtering processes in reaction to sensed data, allowing it to decide when and how to adapt collection and processing with regard to sophisticated analysis of data derived from multiple sensors. The user will be able to view the sensing device network as a single unit that supports a high-level query language. Each query would be able to operate over data collected from across the global sensor network just as a search query encompasses millions of Web pages. The sensor web can preserve ubiquitous information access between the querier and the queried data. Pervasive monitoring of the physical world raises significant data and privacy concerns. This innovation enables different authorities to control portions of the sensing infrastructure, and sensor service authors may wish to compose services across authority boundaries.

Figueroa, Fernando↗
DOE OSTI2021

Local prediction of Laser Powder Bed Fusion porosity by short-wave infrared imaging thermal feature porosity probability maps

We report that local thermal history can significantly vary in parts during metal Additive Manufacturing (AM), leading to local defects. However, the sequential layer-by-layer nature of AM facilitates in-situ part voxelmetric observations that can be used to detect and correct these defects for part qualification and quality control. The challenge is to relate this local radiometric data with local defect information to estimate process error likelihood in future builds. This paper uses a Short-Wave Infrared (SWIR) camera to record the temperature history for parts manufactured with Laser Powder Bed Fusion (LPBF) processes. The porosity from a cylindrical specimen is measured by ex-situ micro-computed tomography (μCT). Specimen data from the SWIR camera, combined with the μCT data, are used to generate thermal feature-based porosity probability maps. The porosity predictions made by various SWIR thermal feature-porosity probability maps of a specimen with a complex geometry are scored against the true porosity obtained via μCT. The receiver operating characteristic curves constructed from the predictions for the complex sample demonstrate the porosity probability mapping methodology’s potential for in-situ based porosity detection.

36 MATERIALS SCIENCE↗
DOE OSTI2016

PRIMA-X Final Report

The PRIMA-X (Performance Retargeting of Instrumentation, Measurement, and Analysis Technologies for Exascale Computing) project is the successor of the DOE PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing) project, which addressed the challenge of creating a core measurement infrastructure that would serve as a common platform for both integrating leading parallel performance systems (notably TAU and Scalasca) and developing next-generation scalable performance tools. The PRIMA-X project shifts the focus away from refactorization of robust performance tools towards a re-targeting of the parallel performance measurement and analysis architecture for extreme scales. The massive concurrency, asynchronous execution dynamics, hardware heterogeneity, and multi-objective prerequisites (performance, power, resilience) that identify exascale systems introduce fundamental constraints on the ability to carry forward existing performance methodologies. In particular, there must be a deemphasis of per-thread observation techniques to significantly reduce the otherwise unsustainable flood of redundant performance data. Instead, it will be necessary to assimilate multi-level resource observations into macroscopic performance views, from which resilient performance metrics can be attributed to the computational features of the application. This requires a scalable framework for node-level and system-wide monitoring and runtime analyses of dynamic performance information. Also, the interest in optimizing parallelism parameters with respect to performance and energy drives the integration of tool capabilities in the exascale environment further. Initially, PRIMA-X was a collaborative project between the University of Oregon (lead institution) and the German Research School for Simulation Sciences (GRS). Because Prof. Wolf, the PI at GRS, accepted a position as full professor at Technische Universität Darmstadt (TU Darmstadt) starting February 1st, 2015, the project ended at GRS on January 31st, 2015. This report reflects the work accomplished at GRS until then. The work of GRS is expected to be continued at TU Darmstadt. The first main accomplishment of GRS is the design of different thread-level aggregation techniques. We created a prototype capable of aggregating the thread-level information in performance profiles using these techniques. The next step will be the integration of the most promising techniques into the Score-P measurement system and their evaluation. The second main accomplishment is a substantial increase of Score-P’s scalability, achieved by improving the design of the system-tree representation in Score-P’s profile format. We developed a new representation and a distributed algorithm to create the scalable system tree representation. Finally, we developed a lightweight approach to MPI wait-state profiling. Former algorithms either needed piggy-backing, which can cause significant runtime overhead, or tracing, which comes with its own set of scaling challenges. Our approach works with local data only and, thus, is scalable and has very little overhead.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2021

A Mathematical Analysis of an Example Delay Tolerant Network using the Theory of Sheaves

NASA’s High-Data Rate Architecture (HiDRA) project is working towards a general yet practical toolkit and knowledge base to help usher in the era of new technologies for space systems communications, such as optical links. The High-Rate Delay Tolerant Networking (HDTN) implementation falls under the umbrellas of both the toolkit and the knowledge base, as its advancements illuminate more general areas of Delay Tolerant Networking (DTN) that need growth. The goal of this paper is to explore the usage of particular mathematical machineries, namely temporal flow networks and sheaves, to identify fundamental, underlying structures in DTN for space systems. Satellites, space assets, ground stations, etc. give rise to a disconnected network, and it is the goal of DTN to glue disparate links together into a cohesive system, that is, a network. Depending on a given link, the latencies might be beyond that which the Transmission Control Protocol (TCP) can handle, and contact times might have one-way light times in excess of minute (sometimes significantly longer). Some links might be periodic (say, due to orbital mechanics) or they might not be. This diversity has made it difficult to probe the underlying structure. An immediate consequence is that DTNs in practice today are controlled by globally distributed contact plans (schedules), which are the input to the contact graph routing (CGR) algorithm. While this is effective for smaller networks, it will be very difficult to scale for future networks. Deeper and more rigorous theory is needed to bring DTN to the next evolutionary step. To this end, this paper introduces and suggests a mathematical framework for DTN, and applies it to a space network that is simulated using an orbital analysis toolkit. The tag-line for the structure known as sheaves is that they are the mathematically precise way of gluing local data together into unique, global data. If we consider routing, we see that networking is a “sheafy” science. We then discuss a simplified sheaf model, known as the cellular sheaf. The sheaf-theoretic analysis is presented and discussed, as it is hoped that this and related papers will help form the primordial ooze of DTN theory. Finally there is a section of future work suggesting follow-on research.

Delay Tolerant Networking↗
DOE OSTI2017

Initial CEED API (CEED-MS10)

Key components of CEED software development involve fast finite element operator storage and evaluation, architecture optimizations, performant algorithms for all orders, global kernels for finite element operators, efficient use of the memory sub-system, optimal data locality and motion, enhanced scalability and parallelism, and fast tensor contractions. As ultimate goals of the project, CEED is exploring and identifying the best algorithms for the full range of discretizations and applying algorithmic and software development to support ECP applications’ needs. In this milestone, we initiated the development and implementation of a common CEED API consisting of two main components: low-level and high-level APIs. We accomplished the goal of having the low-level component ready for the release of CEED v1.0 in the next quarter, see CEED-MS13. In this report we also provide a highlight from CEED’s integration with the MARBL app and the corresponding Laghos miniapp. A main theme in this work has been the systematic transition of advanced algorithms, developed and tested in Laghos, to the large-scale multi-physics settings of the MARBL code. The low-level CEED API provides a set of FE kernels and components for writing new low-level kernels. Examples include: vector and sparse linear algebra, element matrix assembly over a batch of elements, partial assembly and action for efficient high-order operators like mass, diffusion, advection, etc. The main goal of the low-level API is to establish the basis for the high-level API. Also, identifying such low-level kernels and providing a reference implementation for them serves as the basis for collaboration with vendors and STs. Another goal for the low-level API is to make it easy for applications with their own discretization infrastructure, who do not want to switch directly to using the high-level CEED API, to still evaluate and use the core operations provided by the low-level API. One of the challenges with high-order methods is that a global sparse matrix is no longer a good representation of a high-order linear operator, both with respect to the FLOPs needed for its evaluation, as well as the memory transfer needed for a matvec. Thus, another important question we tried to address while developing the low-level API is: is it possible to abstract out in a natural and efficient way the different implementations and data structures that arise when dealing with various computational device types: CPUs, GPUs, etc. Fully answering this question is beyond the scope of this particular milestone, since that requires longer time as we develop and expand the devices we support. The future high-level API will be the frontend provided by CEED consisting of high-level abstractions such as meshes, finite element spaces and solutions, bilinear forms, solvers, etc. At this high-level, an important aspect of the API will be to provide a uniform abstraction layer for writing code in a portable manner. To achieve that, we plan to utilize the MPI programming model combined with a device abstraction layer (DAL) for finite element computations that we will develop. The DAL will serve as the bridge between the low- and the high-level APIs, allowing a variety of programming models to be used for the low-level kernel implementations. The software artifacts delivered as part of this milestone include an initial CEED API software implementation (libCEED) provided through the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q1 of FY18, including: the Nek5000 v17.0 MFEM v3.3.2 and PETSc v3.8 releases, collaborations with ECP/ST and SciDAC projects, the inaugural Nek5000 hackathon and various outreach activities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

CEED-MS8:Initial Integration of CEED Software in ECP Applications

Key components of CEED software development involve fast finite element operator storage and evaluation, architecture optimizations, performant algorithms for all orders, global kernels for finite element operators, efficient use of the memory sub-system, optimal data locality and motion, enhanced scalability and parallelism, and fast tensor contractions. As ultimate goals of the project, CEED is exploring and identifying the best algorithms for the full range of discretizations and applying algorithmic and software development to support ECP applications’ needs. In this milestone we report on the initial integration of CEED software in the selected first-wave ECP/CEED apps and the continued exploration of other ECP applications as second-wave (milestone CEED-MS23) and third-wave (milestone CEED-MS35) ECP/CEED application candidates. An extensive evaluation of various approaches for GPU acceleration of the CEED computational motives is also a major focus of the report, both in the settings of CEED’s Nekbone and Laghos miniapps, as well as versions of CEED’s bake-off problems (introduced in milestone CEED-MS6). The first-wave ECP applications targeted for coupling with CEED software include the ExaSMR and MARBL applications. We also report on near-term collaboration with the seed-funded Urban Systems project, as well as engagements with ACME, ExaAM, GEOS and the Application Assessment and Proxy App projects. The ExaSMR project involves coupled thermal-hydraulics/neutronics, with the latter based on Monte Carlo methods and the former based on high-order discretizations of the Navier-Stokes and energy equations for accurate simulation of turbulent transport. The project requires fast and efficient turbulence simulation capabilities that will scale to exascale platforms. Work within CEED will ensure that all aspects of the Nek5000 workflow scale to the target problem space, which involves > 10 10 degrees of freedom in typical production runs. CEED’s goal is to provide implementations that perform with maximum attainable efficiency and deliver low turn-around times. A deliverable for this milestone is beta-release of the GPU-based variant of Nek5000. MARBL is targeting high-energy-density physics problems, including single fluid multi-material hydrodynamics and radiation/magnetic diffusion simulation, with applications in inertial confined fusion, pulsed power experiments, and equation of state/material strength analysis. The code uses high-order methods based arbitrary Lagrangian-Eulerian, direct Eulerian, and unstructured adaptive mesh refinement. A deliverable for this milestone is collaboration with MARBL for improved performance based on partially-assembled operators. The Urban exascale project is planning to couple real-time data with high performance simulations to study particulate transport in cities. Nek5000 will be used for large eddy and RANS (Reynolds-averaged Navier-Stokes) simulations of turbulent transport in these domains. Areas where the CEED team is aiding the Urban Canyon group include creating high-order meshes for urban geometries and developing boundary conditions appropriate for simulations close to real-life urban conditions. The software artifacts delivered as part of this milestone include GPU-enabled versions of the Nekbone and Laghos miniapps, which are provided through the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q4 of FY17, including: the CEED first annual meeting and participation of CEED researchers in a variety of outreach activities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Spatially Resolved Performance Analysis for Perovskite Solar Cells

This review explores the current state of the art in spatially resolved characterization of mixed-halide perovskite solar cells. As the size of perovskite cells and modules continues to grow, quantification of the spatial distribution of key cell parameters will become increasingly valuable in predicting ultimate cell-level performance and tracking process homogeneity. Here, both high resolution microscopic approaches using scanning techniques and camera-based methods for full-area cell and/or module analysis are discussed. The value of this local data in predicting performance losses at the cell level is particularly emphasized. Measurable physical parameters sensitive to losses of voltage, current, fill factor, and efficiency are discussed together with selected experimental results. It is demonstrated that a combination of spatially resolved cell parameter mapping/imaging can be used to quantitatively discriminate various loss contributions at high resolution. The impact and control of inhomogeneities become particularly important when upscaling from small devices to large formats compatible with industrial mass production.

14 SOLAR ENERGY↗
DOE OSTI2018

Evapotranspiration is resilient in the face of land cover and climate change in a humid temperate catchment

In temperate humid catchments, evapotranspiration returns more than half of the annual precipitation to the atmosphere, thereby determining the balance available to recharge groundwaters and support stream flow and lake levels. Changes in evapotranspiration rates and, therefore, catchment hydrology could be driven by changes in land use or climate. Here, we examine the catchment water balance over the past 50 years for a catchment in southwest Michigan covered by cropland, grassland, forest, and wetlands. Over the study period, about 27% of the catchment has been abandoned from row-crop agriculture to perennial vegetation and about 20% of the catchment has reverted to deciduous forest, and the climate has warmed by 1.14 °C. Despite these changes in land use, the precipitation and stream discharge, and by inference catchment-scale evapotranspiration, have been stable over the study period. The remarkably stable rates of evapotranspirative water loss from the catchment across a period of significant land cover change suggest that rainfed annual crops and perennial vegetation do not differ greatly in evapotranspiration rates, and this is supported by measurements of evapotranspiration from various vegetation types based on soil water monitoring in the same catchment. Compensating changes in the other meteorological drivers of evaporative water demand besides air temperature—wind speed, atmospheric humidity, and net radiation—are also possible but cannot be evaluated due to insufficient local data across the 50-year period. In conclusion, regardless of the explanation, this study shows that the water balance of this landscape has been resilient in the face of both land cover and climate change over the past 50 years.

54 ENVIRONMENTAL SCIENCES↗