Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interactive visual analysis tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

A Parallel Computing Infrastructure for Building Energy Simulation

In order to study grid-interactive efficient buildings, Pacific Northwest National Laboratories (PNNL) needs an infrastructure for urban-scale building energy modeling. Such an infrastructure should be fast, scalable, and easy-to-use. Given a set of data from the Energy Information Administration’s Commercial Building Energy Consumption Survey (CBECS) and tool to translate survey data into simulation inputs, this project aimed to conduct the simulation of the entire dataset in parallel. Before running the simulations, the necessary software was bundled into a container for use on the PNNL supercomputing network. Then, the parallel simulation workflow was designed using GNU Make, a file creation software, and submitted to a supercomputing partition which could run hundreds of simulations simultaneously. The EnergyPlus simulations output hourly electric meter data for each CBECS sample, which represents the electricity consumption of similar commercial buildings across the United States. Analyzing and visualizing the meter data is important to the future of the work, and this project wrote code to make common analysis methods simple, fast, and accessible. Moving forwards, the model will need to be expanded to include data from other sources and its accuracy will need to be improved and eventually validated.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A common path forward for the immersive visualization community

Immersive visualization makes use of the medium of virtual reality (VR) - it is a subset of virtual reality focused on the application of VR technologies to scientific and information visualization. As the name implies, there is a particular focus on the physically immersive aspect of VR that more fully engages the perceptual and kinesthetic capabilities of the scientist with the goal of producing greater insight. The immersive visualization community is uniquely positioned to address the analysis needs of the wide spectrum of domain scientists who are becoming increasingly overwhelmed by data. The outputs of computational science simulations and high-resolution sensors are creating a data deluge. Data is coming in faster than it can be analyzed, and there are countless opportunities for discovery that are missed as the data speeds by. By more fully utilizing the scientists visual and other sensory systems, and by offering a more natural user interface with which to interact with computer-generated representations, immersive visualization offers great promise in taming this data torrent. However, increasing the adoption of immersive visualization in scientific research communities can only happen by simultaneously lowering the engagement threshold while raising the measurable benefits of adoption. Scientists time spent immersed with their data will thus be rewarded with higher productivity, deeper insight, and improved creativity. Immersive visualization ties together technologies and methodologies from a variety of related but frequently disjoint areas, including hardware, software and human-computer interaction (HCI) disciplines. In many ways, hardware is a solved problem. There are well established technologies including large walk-in systems such as the CAVE{trademark} and head-based systems such as the Wide-5{trademark}. The advent of new consumer-level technologies now enable an entirely new generation of immersive displays, with smaller footprints and costs, widening the potential consumer base. While one would be hard-pressed to call software a solved problem, we now understand considerably more about best practices for designing and developing sustainable, scalable software systems, and we have useful software examples that illuminate the way to even better implementations. As with any research endeavour, HCI will always be exploring new topics in interface design, but we now have a sizable knowledge base of the strengths and weaknesses of the human perceptual systems and we know how to design effective interfaces for immersive systems. So, in a research landscape with a clear need for better visualization and analysis tools, a methodology in immersive visualization that has been shown to effectively address some of those needs, and vastly improved supporting technologies and knowledge of hardware, software, and HCI, why hasn't immersive visualization 'caught on' more with scientists? What can we do as a community of immersive visualization researchers and practitioners to facilitate greater adoption by scientific communities so as to make the transition from 'the promise of virtual reality' to 'the reality of virtual reality'.

97 MATHEMATICS AND COMPUTING↗

Sustain: An experimental test bed for building energy simulation

Current building energy simulation technology requires extensive labor, time and expertise to create building energy models, substantial computational time for accurate simulations, and generates data in formats that make results difficult to interpret. These deficiencies can be ameliorated using modern graphical user interfaces and algorithms which take advantage of modern computer architectures and display capabilities. This paper describes a novel test bed environment which offers an interactive graphical interface, provides access to simulation modules that run at accelerated computational speeds, and presents new graphic visualization methods for the interpretation of simulation results. Its modular structure makes it suitable for use in early stage building design, for use as a research platform for the investigation of new simulation methods, and for use as a tool for teaching concepts of sustainable design. Improvements in the accuracy and execution speed of many of the simulation modules are based on the modification of advanced computer graphics rendering algorithms. Significant performance improvements are illustrated in several computationally expensive energy simulation modules.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Tutorial on Chemical Pressure Analysis: How Atomic Packing Drives Laves/Zintl Intergrowth in K3Au5Tl

The tight atomic packing generally exhibited by alloys and intermetallics can create the impression of their being composed of hard spheres arranged to maximize their density. As such, the atomic size factor has historically been central to explanations of the structural chemistry of these systems. However, the role atomic size plays structurally has traditionally been inferred from empirical considerations. The recently developed DFT-Chemical Pressure (CP) analysis has opened a path to investigating these effects with theory. In this article, we provide a step-by-step tutorial on the DFT-CP method for non-specialists, along with advances in the approach that broaden its applicability. A new version of the CP software package is introduced, which features an interactive system that guides the user in preparing the necessary electronic structure data and generating the CP scheme, with the results being readily visualized with a web browser (and easily incorporated into websites). For demonstration purposes, we investigate the origins of the crystal structure of K3Au5Tl, which represents an intergrowth of Laves and Zintl phase domains. Here, CP analysis reveals that the intergrowth is supported by complementary CP features of NaTl-type KTl and MgCu2-type KAu2 phases. In this way, K3Au5Tl exemplifies how CP effects can drive the merging for geometrical motifs derived from different families of intermetallics through a mechanism referred to as epitaxial stabilization.

36 MATERIALS SCIENCE↗

Cosmic Ray Muon Radiography of Spent Fuel in Dry Storage Casks

In the absence of a permanent repository or reprocessing facilities, highly radioactive spent nuclear fuel bundles are typically placed in long-term storage in above ground casks. These dry storage casks are heavily shielded to prevent the escape of radiation from the contents to the environment. Casks under international safeguards are monitored to detect diversion of spent fuel. The heavy shielding of the cask walls also precludes inspection of cask contents with typical radiographic probes. When international safeguards inspectors need to verify cask contents (which may be necessary to recover from a loss of continuity of knowledge), the casks must be moved back into a cooling pool to be safely opened and visually inspected. This time-consuming procedure is invasive and potentially dangerous. A non-destructive radiographic method to verify a cask's contents in situ would therefore be a useful safeguards tool. Highly energetic cosmic ray muons are an alternative tomographic probe. Since muons are colorless leptons, they do not participate in strong interactions with nucleons, and their large mass suppresses radiative energy loss while passing through materials. These properties allow muons to penetrate dense shielding that defeats more typical probes like photons and neutrons. Measurements of the scattering of muons that pass through objects provide information on the object's internal structure. This summary describes the first measurements using cosmic ray muons to inspect the contents of a partially loaded dry storage cask. We show that partial defects in the cask loading can be identified with this technique. This data shows that cosmic ray muons are an effective radiographic probe of dry storage casks. This technique may be useful for international safeguards inspectors wishing to verify a cask's contents without opening it. The analysis techniques described here allow the column of missing fuel bundles to be determined, but not the row. Recording data from several positions around the cask would allow ambiguities in x-y position to be resolved. Alternatively, a detector could be designed such that it surrounds the cask and provides a full image of the casks interior. Improved measurements and the design of optimized cask imaging instruments are being explored. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Influence of Lake Ice Biases in Reanalysis Data on Downscaled Climate Simulations over the Great Lakes Region

This data package contains observation-based and model-simulated datasets (all provided in NetCDF format) for evaluating how wintertime lake-ice representation affects regional weather and climate over the Laurentian Great Lakes (freshwater lake ecosystem) during the high–ice-cover winter of 2009. The observational component includes: (1) Stage IV gridded precipitation at 4 km, hourly resolution for January–February 2009 over the Great Lakes region (radar–gauge multisensor precipitation analyses); (2) Great Lakes Surface Environmental Analysis (GLSEA) satellite-derived lake-ice coverage at 1.3 km, daily resolution for the 2009 winter months, providing ice coverage over Lakes Superior, Michigan, Huron, Erie, and Ontario; and (3) in situ measurements at the Standard Rock site on Lake Superior from the Great Lakes Evaporation Network (GLEN) at hourly resolution, including near-surface atmospheric variables and sensible and latent heat fluxes (air–lake exchange) at a fixed point location. The modeling component provides corresponding fields from two simulations, both archived at 4 km, hourly resolution: a standalone Weather Research Forecasting model (WRF) run driven by the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5 (ERA5), and a two-way coupled model using WRF and the Finite Volume Community Ocean Model (WRF-FVCOM, a 3-D hydrodynamic lake model). These outputs include variables relevant to air–lake interaction and lake-effect processes (e.g., near-surface temperature, humidity, wind, precipitation, and surface turbulent fluxes), enabling direct comparison with the observational datasets. Users can analyze and visualize these NetCDF files with common tools such as Python (e.g., xarray, netCDF4, numpy, pandas), NCO/CDO, Panoply, or ncview; NetCDF variables can also be converted to other formats (e.g., CSV, GeoTIFF) using these utilities.

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗

State of the Art of Molecular Visualization in Immersive Virtual Environments

Abstract Visualization plays a crucial role in molecular and structural biology. It has been successfully applied to a variety of tasks, including structural analysis and interactive drug design. While some of the challenges in this area can be overcome with more advanced visualization and interaction techniques, others are challenging primarily due to the limitations of the hardware devices used to interact with the visualized content. Consequently, visualization researchers are increasingly trying to take advantage of new technologies to facilitate the work of domain scientists. Some typical problems associated with classic 2D interfaces, such as regular desktop computers, are a lack of natural spatial understanding and interaction, and a limited field of view. These problems could be solved by immersive virtual environments and corresponding hardware, such as virtual reality head‐mounted displays. Thus, researchers are investigating the potential of immersive virtual environments in the field of molecular visualization. There is already a body of work ranging from educational approaches to protein visualization to applications for collaborative drug design. This review focuses on molecular visualization in immersive virtual environments as a whole, aiming to cover this area comprehensively. We divide the existing papers into different groups based on their application areas, and types of tasks performed. Furthermore, we also include a list of available software tools. We conclude the report with a discussion of potential future research on molecular visualization in immersive environments.

97 MATHEMATICS AND COMPUTING↗

Virtual Design Studio (VDS) - Development of an Integrated Computer Simulation Environment for Performance Based Design of Very-Low Energy and High IEQ Buildings

Executive Summary The objective of this study was to develop a “Virtual Design Studio (VDS)”: a software platform for integrated, coordinated and optimized design of green building systems with low energy consumption, high indoor environmental quality (IEQ), and high level of sustainability. This VDS is intended to assist collaborating architects, engineers and project management team members throughout from the early phases to the detailed building design stages. It can be used to plan design tasks and workflow, and evaluate the potential impacts of various green building strategies on the building performance by using the state of the art simulation tools as well as industrial/professional standards and guidelines for green building system design. Engaged in the development of VDS was a multi-disciplinary research team that included architects, engineers, and software developers. Based on the review and analysis of how existing professional practices in building systems design operate, particularly those used in the U.S., Germany and UK, a generic process for performance-based building design, construction and operation was proposed. It distinguishes the whole process into five distinct stages: Assess, Define, Design, Apply, and Monitoring (ADDAM). The current VDS is focused on the first three stages. The VDS considers building design as a multi-dimensional process, involving multiple design teams, design factors, and design stages. The intersection among these three dimensions defines a specific design task in terms of “who”, “what” and “when”. It also considers building design as a multi-objective process that aims to enhance the five aspects of performance for green building systems: site sustainability, materials and resource efficiency, water utilization efficiency, energy efficiency and impacts to the atmospheric environment, and IEQ. The current VDS development has been limited to energy efficiency and IEQ performance, with particular focus on evaluating thermal performance, air quality and lighting environmental quality because of their strong interaction with the energy performance of buildings. The VDS software framework contains four major functions: 1) Design coordination: It enables users to define tasks using the Input-Process-Output flow approach, which specifies the anticipated activities (i.e., the process), required input and output information, and anticipated interactions with other tasks. It also allows task scheduling to define the work flow, and sharing of the design data and information via the internet. 2) Modeling and simulation: It enables users to perform building simulations to predict the energy consumption and IEQ conditions at any of the design stages by using EnergyPlus and a combined heat, air, moisture and pollutant simulation (CHAMPS) model. A method for co-simulation was developed to allow the use of both models at the same time step for the combined energy and indoor air quality analysis. 3) Results visualization: It enables users to display a 3-D geometric design of the building by reading BIM (building information model) file generated by design software such as SketchUp, and the predicted results of heat, air, moisture, pollutant and light distributions in the building. 4) Performance evaluation: It enables the users to compare the performance of a proposed building design against a reference building that is defined for the same type of buildings under the same climate condition, and predicts the percent of improvements over the minimum requirements specified in ASHRAE Standard 55-2010, 62.1-2010 and 90.1-2010. An approach was developed to estimate the potential impact of a design factor on the whole building performance, and hence can assist the user to identify areas that have most pay back for investment. The VDS software was developed by using C++ with the conventional Model, View and Control (MVC) software architecture. The software has been verified by using a simple 3-zone case building. The application of the VDS concepts and framework for building design and performance analysis has been illustrated by using a medium-sized, five story office building that received LEED Platinum Certification from USGBC.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Effect of Laser Cutting Heuristic Presentation Modality on Design Learning

Abstract The goal of this work is to study the way student designers use heuristics to effectively design for laser-cut manufacturing methods. With the recent advent of academic makerspaces, digital fabrication tools like laser cutters are relatively new additions to the classroom. Therefore, there is a gap in formal education or training on these tools, and students can find it challenging to design effectively for them. A study was performed to investigate the way students apply heuristics to redesign laser-cut assemblies when received in different modalities. All participants were given an identical lecture on laser cutting heuristics. Then, a redesign problem was presented to students, and three different experimental groups were given the heuristics in different modalities: Text-Only, text with Visual aids, and text with Tactile aids. The novelty and quality of each of the resulting redesigns were evaluated. It was hypothesized that participants would have more difficulty interpreting and applying the Text-Only heuristics, lowering the quality of their redesigned solutions relative to the other two conditions. It was also hypothesized that participants would experience fixation caused by interacting with the tactile aids, leading to the lower novelty of their redesigned solutions relative to the other two conditions. Results showed that modality played a significant role in participants’ feelings of self-efficacy after the intervention, as well as in their understanding of laser cutter design skills when responding to quiz-style questions. However, analysis of novelty and quality showed little significant impact of the intervention and varying modalities on participants’ designs.

Engineering↗

Label-free functional analysis of root-associated microbes with dynamic quantitative oblique back-illumination microscopy

The increasing global demand for food, coupled with concerns about the environmental impact of synthetic fertilizers, underscores the urgency of developing sustainable agricultural practices. Nitrogen-fixing bacteria, known as diazotrophs, offer a potential solution by converting atmospheric nitrogen into bioavailable forms, reducing the reliance on synthetic fertilizers. However, a deeper understanding of their interactions with plants and other microbes is needed. In this study, we introduce a recently developed label-free 3D quantitative phase imaging technology called dynamic quantitative oblique back-illumination microscopy (DqOBM) to assess the functional dynamic activity of diazotrophs in vitro and in situ. Our experiments involved three different diazotrophs (Sinorhizobium meliloti, Azotobacter vinelandii, and Rahnella aquatilis) cultured on media with amendments of carbon and nitrogen sources. Over 5 days, we observed increased dynamics in nutrient-amended media. These results suggest that the observed bacterial dynamics correlate with their metabolic activity. Furthermore, we applied qOBM to visualize microbial dynamics within the root cap and elongation zone of Arabidopsis thaliana primary roots. This allowed us to identify distinct areas of microbial infiltration in plant roots without the need for fluorescent markers. Our findings demonstrate that DqOBM can effectively characterize microbial dynamics and provide insights into plant-microbe interactions in situ, offering a valuable tool for advancing our understanding of sustainable agriculture.

59 BASIC BIOLOGICAL SCIENCES↗

The GammaSpec Package for Automated Gamma-ray Analysis (V.1.0)

This report describes the GammaSpec package, a tool developed to automate the analysis and comparison of gamma-ray spectra. The goal of this tool is to drastically reduce, or even eliminate, currently time consuming processes for comparing large sets of gamma-ray measurements. There are a number of potential applications for this work throughout the laboratory, but particularly within Global Security. Current work flows where large numbers of measured spectra must be compared for anomolies and outliers often consist of loading and visually inspecting individual spectra, or utilizing small-batch tools. One such example is the PeakEasy tool also developed at LANL. PeakEasy has a robust and tested feature set for calibrating, identifying, and fitting gamma-ray spectra. However it’s intention was not for batch processing and automated comparison of large numbers of spectra. This tool is not intended to replace PeakEasy in an analyzers arsenal, but to instead augment it. The intention here is to automate the isolation of spectra of particular interest, which can then be studied in further detail. This report is arranged as follows. Section 2 lays out the design goals and desired functionality of the package. Section 3 describes the algorithms developed and chosen to accomplish those goals. Section 4 describes the primary interaction with the tool, as well as it’s resulting output. Following these sections, results are presented from a set of example datasets from High Purity Germanium (HPGe) detectors in Sec. 5. Finally, the current status is summarized in Sec. 6.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

PathTrace and MPVEASI: A Path Analysis Comparative Validation Study

Developed in 2018, PathTrace is a software package built with the intention of making path analysis simple and intuitive. PathTrace is a top-down pathway analysis software where a user is able to explore vulnerable pathways into a facility. The intention of utilizing a software tool like PathTrace is to characterize an existing physical protection system (PPS) and to upgrade the system to achieve a high level of response interruption, or probability of interruption (P I ) of the adversary. There are four steps for conducting path analysis using PathTrace. The first step is to identify an image to use to build the model and scale the model within PathTrace using a section of known distance (wall or fence perimeter, for example). The scaling process will produce a grid of cells through which the user is able to build a model. The second step is to fill out the grid of cells with four categories of materials: Barriers, Detection Areas, Jumps, and Targets. These materials apply associated delay and detection values to the cells in which they are applied. The third step is to represent the adversary and response forces. The adversaries are represented by their capabilities in interacting with the materials identified in step two, and the response is represented by how quickly they will be able to respond to an adversary attack. Finally, the user is able to take all of the information from the previous three steps and perform a Most Vulnerable Path (MVP) analysis. In this stage, the user is able to visualize vulnerable adversary pathways and reason about how to upgrade these pathways to provide a high level of P I .

97 MATHEMATICS AND COMPUTING↗

Demonstrating SolarPILOT's Python API Through Heliostat Optimal Aimpoint Strategy Use Case: Preprint

SolarPILOT is a software package that generates heliostat field layouts and characterizes the optical performance of concentrating solar power (CSP) tower systems. SolarPILOT was developed by the National Renewable Energy Laboratory (NREL) as a stand-alone desktop application but has also been incorporated into NREL's System Advisor Model (SAM) in a simplified format. Prior means for user interaction with SolarPILOT have included the application's graphical interface, the SAM routines with limited configurability, and through a built-in scripting language called "LK." This paper presents a new, full-featured Python-based application programmable interface (API) for SolarPILOT, which we hereafter refer to as CoPylot. CoPylot provides access to all SolarPILOT's capabilities to generate and characterize power tower CSP systems seamlessly through Python. Supported capabilities include (i) creating and destroying a model instances with message reporting tools; (ii) accessing and setting any SolarPILOT variable including custom land boundaries for field layout; (iii) programmatically managing receiver and heliostat objects with varied attributes for systems with multiple receiver or heliostat types; (iv) generating, assigning, and modifying heliostat field layouts including the ability to set individual heliostat locations, aimpoints, soiling rates, and reflectivity levels; (v) simulating heliostat field performance; (vi) returning detailed results describing performance of individual heliostats, the aggregate field, and receiver flux; and, (vii) exporting Python-based model instances to multiple file formats. CoPylot enables Python users to perform detailed tower CSP analysis utilizing either the Hermite expansion technique (analytical) or the SolTrace ray-tracing engine. In addition to CoPylot's functionality, Python users have access to the over 100,000 open-source libraries to develop, analyze, optimize, and visualize CSP tower research.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Demonstrating SolarPILOT’s Python API Through Heliostat Optimal Aimpoint Strategy Use Case

SolarPILOT is a software package that generates solar field layouts and characterizes the optical performance of concentrating solar power (CSP) tower systems. SolarPILOT was developed by the National Renewable Energy Laboratory (NREL) as a stand-alone desktop application but has also been incorporated into NREL’s1 System Advisor Model (SAM) in a simplified format. Prior means for user interaction with SolarPILOT have included the application’s graphical interface, the SAM routines with limited configurability, and through a built-in scripting language called “LK.” This paper presents a new, full-featured, Python-based application programmable interface (API) for SolarPILOT, which we hereafter refer to as CoPylot. CoPylot provides access to all SolarPILOT’s capabilities to generate and characterize power tower CSP systems seamlessly through Python. Supported capabilities include (i) creating and destroying a model instance with message reporting tools; (ii) accessing and setting any SolarPILOT variable including custom land boundaries for field layouts; (iii) programmatically managing receiver and heliostat objects with varied attributes for systems with multiple receiver or heliostat types; (iv) generating, assigning, and modifying solar field layouts including the ability to set individual heliostat locations, aimpoints, soiling rates, and reflectivity levels; (v) simulating solar field performance; (vi) returning detailed results describing performance of individual heliostats, the aggregate field, and receiver flux distribution; and, (vii) exporting Python-based model instances to multiple file formats. CoPylot enables Python users to perform detailed CSP tower analysis utilizing either the Hermite expansion technique (analytical) or the SolTrace ray-tracing engine. In addition to CoPylot’s functionality, Python users have access to the over 100,000 open-source libraries to develop, analyze, optimize, and visualize power tower CSP research. This enables CSP researchers to perform analysis that was previously not possible through SolarPILOT’s existing interfaces. This paper discusses the capabilities of CoPylot and presents a use case wherein we demonstrate optimal solar field aiming strategies.

41 EE - Solar Energy Technologies Office (EE-4S)↗

MILK : a Python scripting interface to MAUD for automation of Rietveld analysis

Modern diffraction experiments ( e.g. in situ parametric studies) present scientists with many diffraction patterns to analyze. Interactive analyses via graphical user interfaces tend to slow down obtaining quantitative results such as lattice parameters and phase fractions. Furthermore, Rietveld refinement strategies ( i.e. the parameter turn-on-off sequences) tend to be instrument specific or even specific to a given dataset, such that selection of strategies can become a bottleneck for efficient data analysis. Managing multi-histogram datasets such as from multi-bank neutron diffractometers or caked 2D synchrotron data presents additional challenges due to the large number of histogram-specific parameters. To overcome these challenges in the Rietveld software Material Analysis Using Diffraction ( MAUD ), the MAUD Interface Language Kit ( MILK ) is developed along with an updated text batch interface for MAUD . The open-source software MILK is computer-platform independent and is packaged as a Python library that interfaces with MAUD . Using MILK , model selection ( e.g. various texture or peak-broadening models), Rietveld parameter manipulation and distributed parallel batch computing can be performed through a high-level Python interface. A high-level interface enables analysis workflows to be easily programmed, shared and applied to large datasets, and external tools to be integrated with MAUD . Through modification to the MAUD batch interface, plot and data exports have been improved. The resulting hierarchical folders from Rietveld refinements with MILK are compatible with Cinema: Debye–Scherrer , a tool for visualizing and inspecting the results of multi-parameter analyses of large quantities of diffraction data. In this manuscript, the combined Python scripting and visualization capability of MILK is demonstrated with a quantitative texture and phase analysis of data collected at the HIPPO neutron diffractometer.

97 MATHEMATICS AND COMPUTING↗

The Integrated Basin-Scale Opportunity Assessment Initiative: Pilot Assessment for the Deschutes River Basin

In 2010, the U.S. Department of Energy’s (DOE’s) Wind and Water Power Technologies Office provided funding to Pacific Northwest National Laboratory, Oak Ridge National Laboratory (ORNL), and Argonne National Laboratory to develop an approach for assessing a river basin as an integrated system within the context of existing uses and environmental conditions to identify opportunities for sustainable hydropower development and environmental improvements. Called the Integrated Basin-Scale Opportunity Assessment Initiative (BSOA Initiative), the project is one of seven action items of the March 24, 2010 Memorandum of Understanding (MOU) for Sustainable Hydropower. Early efforts of the BSOA Initiative focused on forming a National Steering Committee, identifying potential basins for opportunity assessments, methodologies for stakeholder engagement, existing and needed analytical tools, barriers to the opportunity assessment process, and significant data gaps. One of the key outcomes was identifying a need for better collaborative decision-making tools that can be used by stakeholders. In response to this need, the Basin-Scale Project Team chose a scenario-based modeling approach for assessing hydropower, environmental, and other water-use opportunities. The approach involved the development of a daily hydrologic model for the Upper Deschutes River and Lower Crooked River subbasins to simulate alternative water management scenarios. Two example scenarios were constructed to demonstrate the use of the hydrologic model to explore three management goals in the Deschutes Basin: 1) increasing hydropower assets by adding new generation at existing dams or diversions and in existing irrigation canals or conduits, 2) increasing instream flows to benefit fish and aquatic ecosystems, and 3) maintaining existing water uses (primarily irrigation). Actions to achieve these goals were simulated by incrementally increasing minimum flow requirements during the storage season and reducing water demands during the irrigation season, while simulating hydropower generation at non-powered dams and in irrigation canals. As part of the effort to demonstrate scenario-based modeling, the project team also developed a web-based data-visualization interface for synthesizing modeling results. The interface allows users to view model results in raw form (daily flow) or in the form of value-based metrics that are based on specific information needs expressed by stakeholders (e.g., how often flow exceeds a conservation flow target at a certain location). In addition to the modeling efforts, 29 potential hydropower sites (14 non-powered dams, 15 canal/conduit sites) were evaluated for their technical and economic feasibility using ORNL’s Hydropower Energy and Economic Assessment tool. Results of the feasibility assessment indicated that eight of the sites (four non-powered dams, four canals/conduits) may be feasible and could add approximately 19 megawatts (MW) of hydroelectric capacity in the basin and generate over 78 gigawatt-hours (GWh) of energy per year. The approach presented here is intended to encourage consideration of methods that emphasize exploration of a range of potential management actions that may achieve a better balance among multiple, and often conflicting, management goals. It is important to consider the approach as an iterative and collaborative process focused on moving debates beyond agreement about an exact target that is acceptable to all parties to a discussion of how stakeholders can better understand how achieving their goals interacts with the achievement of goals by other stakeholder groups. By exploring the results of the model in this way, stakeholders are more likely to narrow the bounds of interest so that more in-depth analysis can be completed.

13 HYDRO ENERGY↗

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗