Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “big data visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

152 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Pass-efficient methods for compression of high-dimensional turbulent flow data

The future of high-performance computing, specifically on future Exascale computers, will presumably see memory capacity and bandwidth fail to keep pace with data generated, for instance, from massively parallel partial differential equation (PDE) systems. Current strategies proposed to address this bottleneck entail the omission of large fractions of data, as well as the incorporation of in situ compression algorithms to avoid overuse of memory. To ensure that post-processing operations are successful, this must be done in a way that a sufficiently accurate representation of the solution is stored. Moreover, in situations where the input/output system becomes a bottleneck in analysis, visualization, etc., or the execution of the PDE solver is expensive, the number of passes made over the data must be minimized. In the interest of addressing this problem, this work focuses on the utility of pass-efficient, parallelizable, low-rank, matrix decomposition methods in compressing high-dimensional simulation data from turbulent flows. Additionally, a particular emphasis is placed on using coarse representation of the data – compatible with the PDE discretization grid – to accelerate the construction of the low-rank factorization. This includes the presentation of a novel single-pass matrix decomposition algorithm for computing the so-called interpolative decomposition. The methods are described extensively and numerical experiments on two turbulent channel flow data are performed. In the first (unladen) channel flow case, compression factors exceeding 400 are achieved while maintaining accuracy with respect to first- and second-order flow statistics. In the particle-laden case, compression factors of 100 are achieved and the compressed data is used to recover particle velocities. These results show that these compression methods can enable efficient computation of various quantities of interest in both the carrier and disperse phases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2012

Clinical evaluation of a commercial orthopedic metal artifact reduction tool for CT simulations in radiation therapy

Purpose: Severe artifacts in kilovoltage-CT simulation images caused by large metallic implants can significantly degrade the conspicuity and apparent CT Hounsfield number of targets and anatomic structures, jeopardize the confidence of anatomical segmentation, and introduce inaccuracies into the radiation therapy treatment planning process. This study evaluated the performance of the first commercial orthopedic metal artifact reduction function (O-MAR) for radiation therapy, and investigated its clinical applications in treatment planning. Methods: Both phantom and clinical data were used for the evaluation. The CIRS electron density phantom with known physical (and electron) density plugs and removable titanium implants was scanned on a Philips Brilliance Big Bore 16-slice CT simulator. The CT Hounsfield numbers of density plugs on both uncorrected and O-MAR corrected images were compared. Treatment planning accuracy was evaluated by comparing simulated dose distributions computed using the true density images, uncorrected images, and O-MAR corrected images. Ten CT image sets of patients with large hip implants were processed with the O-MAR function and evaluated by two radiation oncologists using a five-point score for overall image quality, anatomical conspicuity, and CT Hounsfield number accuracy. By utilizing the same structure contours delineated from the O-MAR corrected images, clinical IMRT treatment plans for five patients were computed on the uncorrected and O-MAR corrected images, respectively, and compared. Results: Results of the phantom study indicated that CT Hounsfield number accuracy and noise were improved on the O-MAR corrected images, especially for images with bilateral metal implants. The {gamma} pass rates of the simulated dose distributions computed on the uncorrected and O-MAR corrected images referenced to those of the true densities were higher than 99.9% (even when using 1% and 3 mm distance-to-agreement criterion), suggesting that dose distributions were clinically identical. In all patient cases, radiation oncologists rated O-MAR corrected images as higher quality. Formerly obscured critical structures were able to be visualized. The overall image quality and the conspicuity in critical organs were significantly improved compared with the uncorrected images: overall quality score (1.35 vs 3.25, P= 0.0022); bladder (2.15 vs 3.7, P= 0.0023); prostate and seminal vesicles/vagina (1.3 vs 3.275, P= 0.0020); rectum (2.8 vs 3.9, P= 0.0021). The noise levels of the selected ROIs were reduced from 93.7 to 38.2 HU. On most cases (8/10), the average CT Hounsfield numbers of the prostate/vagina on the O-MAR corrected images were closer to the referenced value (41.2 HU, an average measured from patients without metal implants) than those on the uncorrected images. High {gamma} pass rates of the five IMRT dose distribution pairs indicated that the dose distributions were not significantly affected by the CT image improvements. Conclusions: Overall, this study indicated that the O-MAR function can remarkably reduce metal artifacts and improve both CT Hounsfield number accuracy and target and critical structure visualization. Although there was no significant impact of the O-MAR algorithm on the calculated dose distributions, we suggest that O-MAR corrected images are more suitable for the entire treatment planning process by offering better anatomical structure visualization, improving radiation oncologists' confidence in target delineation, and by avoiding subjective density overrides of artifact regions on uncorrected images.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Evaluating the Effectiveness of an Ultrasonic Acoustic Deterrent in Reducing Bat Fatalities at Wind Energy Facilities

This project was designed to use thermal video cameras and fatality monitoring to evaluate the effectiveness of an ultrasonic acoustic deterrent (UAD) on bat activity and mortality, respectively. Our goals were to redesign the UAD device and installation infrastructure, determine the placement on wind turbines to optimize safety, compatibility and functionality, and to compare the mortality among the following conditions: Control (deterrents off and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Deterrent (deterrents on and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Curtailment (deterrents off and turbines feathered up to 5/ m/s), and combination (deterrents on and turbines feathered up to 5 m/s). The project was divided into a Feasibility Study and Comparative Study. The objectives for the Feasibility Study were to develop an installation strategy, redesign a previous iteration of a UAD to improve performance and weatherization, and test the effectiveness of the deterrents on bat activity. The Feasibility Study was intended to work out potential issues using a relatively small number of devices prior to manufacturing and installing numerous devices for a larger-scale comparative study. The division of the project into these separate studies was based on previous experience and the challenges of assessing the capabilities of an untested UAD. During the initial development and manufacturing of the UAD, NRG Systems decided to use a piezoelectric transducer rather than an electrostatic transducer, which was used by a previous device (i.e. Deaton UAD). NRG Systems conducted lab testing (i.e., IP67 or Ingress Protection) to ensure no water or dust ingress. In addition, shock/drop trials and variations in temperature exposure were conducted as part of the reliability testing. NRG Systems also developed a communications system to allow for continuous performance monitoring of the UADs. For the Feasibility Study, we installed 6 UADs on each of 2 Gamesa G90 2-MW wind turbines (Turbine 14 and 8) at the South Chestnut Wind Energy Facility, Pennsylvania and monitored activity under control and treatment (i.e. Deterrent) conditions using thermal video monitoring. There are two major sources of variation in bat activity (beyond the anticipated treatment effect): 1) environment around the turbines might inherently favor more activity at one than the other; 2) weather conditions on any given night or within season difference (e.g., migration later during the study period) might favor more activity on some nights than on other nights. Because we could only monitor two turbines on any night, we sought to control the potential influences of these two sources by alternating the turbine on which deterrents were activated each night. If there were no loss of data due to technical failures, this design would result in an equal number of deterrent and control nights at each turbine through the monitoring period, balancing the effects of both sources of variation. We compared the time bats spent and the number of events that occurred in overlapping cameras FOV as an indicator of risk, since 80% of the overlapping FOV of the cameras was in the RSA. Equipment failures, majority due to lightning, resulted in only 17 nights with useable data, with unbalanced treatment assignment within turbines and uneven distribution of treatment assignment throughout the observational period. This resulted in a confounding of treatment assignment and seasonal change. Deterrent treatment was measured at Turbine 14 on only 2 of the first 8 usable nights (spanning the period from 8/18-9/17), whereas 6 times on Turbine 8. From 9/18-927, deterrent was on at Turbine 14 on 6 of the remaining 10 nights, and 4 on Turbine 8. We recorded a total of 1,057 bats and observed a reduction in number of events and duration of events at the UAD-activated turbine when it was Turbine 14. When Turbine 8 had the UAD activated, we observed no difference in number or duration of events. Variation between turbines is not unusual and can cause issues when study designs have no true replication, i.e., multiple turbines per treatment. Within-turbine differences suggested a trend for reduced activity when UADs were activated, particularly for Turbine 14. These results may be caused by the overall higher bat activity at Turbine 8 and confounding of treatment assignment and seasonal trends. We mapped 58 bat events in 3-dimensional space (3D), 30 and 28 events during control and treatment conditions, respectively. We observed bats crossing the rotor plane under both control and treatment conditions and observed a total of 40 confirmed or near-collisions (i.e., target close to blade but no visual confirmation of a strike) out of a total of 1,491 medium and high confidence bat observations (880 control, 611 at treatment). Twice as many collisions/possible collisions were observed during control conditions. Given the challenges with the equipment and potential confounding of the data (i.e., different activity levels at the two wind turbines), we were unable to determine whether this initial turbine placement and orientation was optimal. Given no new information on how best to install the devices, we elected to use the same placement and orientation for the comparative study. For the Comparative Study, the objectives were to investigate the relative mortality rates among 4 treatments. We searched the area within 90 m of each turbine daily to recover the highest number of fresh fatalities possible. We were unable to detect a clear reduction in mortality from deterrents alone for any individual species. Surprisingly, mortality rate of the eastern red bat (Lasiurus borealis) was estimated to be 1.3–4.2 times as much when turbines were operating normally and UADs were on than when UADs were off. Reduction in mortality of all bat species combined due to curtailment of turbines was estimated to be between 0%–38%. This effect was nullified when, in addition to curtailment, UADs were on, with 95% confidence interval ranging from a 45% reduction to a 36% increase in mortality. This was likely due to the large proportion of eastern red bats in the total carcass population. Mortality of all low-frequency echolocating bats combined (i.e. hoary bat [L. cinereus], big brown bat [Eptesicus fuscus], silver-haired bat [Lasionycteris noctivagans]) relative to control was lower when curtailed (95% CI: 0%–74%), but the addition of UADs had no detectable effect (95%CI: 13%–79%). The combined treatment reduced mortality in silver-haired bats relative to control by 11%–99%, compared to curtailment (81% reduction–67% increase) or deterrent (82% reduction–67% increase) alone. Because silver-haired bats comprised a large proportion of low-frequency calling bats found during this study, a similar effect was seen for that group. The higher mortality observed for eastern red bats at UAD compared to control could have been caused by several factors, such as the effective range of the UAD, particularly at higher frequencies, behavior, positioning of the devices on the nacelle, or a combination of these. We used 3D thermal videography to compare control and UAD bat behavior from two turbines using a total of 203 3D bat-tracks across 34 nights. We recorded a similar number of bat-tracks between treatment groups, with 51% and 49% for control and UAD, respectively. Due to potential differences in bat behavior around spinning vs stationary turbine blades, we examined UAD effectiveness separately for non-operating turbines (feathered below cut-in speed of 3.5 m/s) and operating (normal operation above wind speed of 3.5 m/s). We found a higher proportion of bat-tracks at operating turbines (82%) compared to non-operating turbines (18%), although this does not account for overall time turbines were operating versus not. At non-operating turbines the UAD appears to be effective at reducing the amount of time, flight length, and number of passes through the rotor plane, compared to control. In addition, we found bats approached turbines similarly between control and treatment turbines, with 61% of control and 63% of UAD bat-tracks originating leeward of the hub. In contrast, at operating turbines, we saw little change in bat behavior in response to UADs. For example, we found an increase in the average duration of bat-tracks between non-operating and operating turbines for UAD but at control turbines we found average duration decreased once turbines became operational. Both control and UAD had a high proportion of bat-tracks that crossed the rotor plane (i.e., collision risk) originate from the windward side when turbines were operational 65% to 92%, respectively. Given that the UAD devices closest to the blades were orientated parallel to the blades, its possible bats were not exposed to the signal until they were close to the turbine blades, as suggested by the slightly higher mean duration within 5 meters of the blades for UAD turbines. Future research should consider concentrating UAD intensity on the areas of risk (i.e. blades) with enough buffer to allow bats to react to the sound before entering the rotor-swept area (RSA). In addition, investigating the potential of installing UAD units windward of the turbine blades (e.g. a hub-mounted UAD), particularly since even under control conditions, a relatively high proportion (65%) of crosses through the blade plane originated windward. 3D thermal videography provided valuable information on future testing strategies (e.g. device placement, UAD orientation) to improve UAD effectiveness when bats are at risk (i.e., operating wind turbines). Across the entire project we experienced issues with the operation and communication with the UADs. Most of the issues occurred during the Feasibility Study and were resolved prior to the Comparability Study. Additional challenges surfaced during the Comparability Study but were remedied immediately and are thought to have little impact on the results. We had logistical constraints at the project that limited our ability use traditional methods in our camera calibration. Several calibrations showed inaccurate scales, which may have been related to inadequate spatial coverage of “points” in the camera calibration volume. Because we were using actual video recordings of bats at a wind turbine, the behavior of bats could have concentrated “points” in specific areas of the turbine (i.e. leeward of nacelle), and limited “points” in other areas, resulting in camera calibration issues. We have plans to address these inconsistencies and improving the software and related methodologies by early 2020.

17 WIND ENERGY↗
DOE OSTI2024

Improving the Concrete Crack Detection Process via a Hybrid Visual Transformer Algorithm

Inspections of concrete bridges across the United States represent a significant commitment of resources, given their biannual mandate for many structures. With a notable number of aging bridges, there is an imperative need to enhance the efficiency of these inspections. This study harnessed the power of computer vision to streamline the inspection process. Our experiment examined the efficacy of a state-of-the-art Visual Transformer (ViT) model combined with distinct image enhancement detector algorithms. We benchmarked against a deep learning Convolutional Neural Network (CNN) model. These models were applied to over 20,000 high-quality images from the Concrete Images for Classification dataset. Traditional crack detection methods often fall short due to their heavy reliance on time and resources. This research pioneers bridge inspection by integrating ViT with diverse image enhancement detectors, significantly improving concrete crack detection accuracy. Notably, a custom-built CNN achieves over 99% accuracy with substantially lower training time than ViT, making it an efficient solution for enhancing safety and resource conservation in infrastructure management. These advancements enhance safety by enabling reliable detection and timely maintenance, but they also align with Industry 4.0 objectives, automating manual inspections, reducing costs, and advancing technological integration in public infrastructure management.

42 ENGINEERING↗
NASA NTRSDate not supplied

Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery

The next era in human space exploration is rapidly approaching and will require the use of countermeasures to deep space health hazards. The development of countermeasures (or, there-purposing of existing agents) will be highly dependent on our understanding of basic biological responses to space stressors (e.g. ionizing radiation, altered gravitational fields, altered day-night cycles, confinement, isolation, hostile-closed environments, distance-duration from Earth, exposure to celestial regolith, etc.). The fast-growing array of space biological data, which in the past was simply archived after minimal analysis, holds great potential if it can be reorganized and formatted for Open Science. Organizing the data for such analysis is a challenge because of its diverse nature (molecular, cellular, tissue, imaging, whole organism and behavior). We will discuss here several strategies that NASA's Biological and Physical Science Division has put in place to maximize the return on investment for spaceflight bioscience data. Open Science, as a scientific philosophy, is the concept that the more people who have access to the data, the more knowledge will be gained from it. This guiding principle led NASA to develop GeneLab in 2015. GeneLab houses spaceflight and relevant ground-based multi-omics data, and has grown to ~400 transcriptomatic, proteomic, metabolomic and epigenomic datasets from plant, rodent, small animal, and microbial space experiments. GeneLab provides users with various tools for data analysis and a visualization portal that allows users to interact with gene expression data from space-related 'omics experiments. Open Science is also about building scientific communities, and with this spirit in mind, GeneLab has spawned several Analysis Working Groups (AWGs), comprised of more than 200 volunteer scientists. The AWGs initially provided feedback on the processing pipeline and metadata 'omics standards for GeneLab. Over the last few years, they have become a community-driven science enterprise, engaging in large meta-analysis of GeneLab datasets, resulting in 10 publications (beyond the originally submitted research). Overall, the Open Science nature of GeneLab has resulted in a high degree of data-use, resulting in 40 enabled publications by open data. The enormous success and knowledge gained from GeneLab has led to a collection of sister NASA "Open Science Data Repositories (OSDR)" and research support groups. These include the NASA Ames Life Sciences Data Archive (ALSDA), the NASA Biological Institutional Scientific Collection (NBISC), and the Biospecimen Sharing Program (BSP). All are adopting the GeneLab data architecture system to maximize open-access, find-ability, accessibility, interoperability, and reusability (FAIR). ALSDA collects and curates phenotypic-physiological bioimaging-behavioral data from space and space-relevant non-human experiments, oftentimes coming from the same omics-associated experimental datasets found in GeneLab. Since 2021, a community of ~100 researchers have rallied around ALSDA, to provide feedback in a new ALSDA AWG focused on phenotypic-physiological investigation-sample-assay metadata standards (e.g., Micro-Computed Tomography, Light/Flourescence Microscopy, Western Blot, Flow Cytometry, Novel Object Recognition, Elevated Plus Maze, etc. of ~50 assays collected). These standards are part of a new single point-of-entry data submission portal for all non-human Space Biology and Human Research Program principal investigators, to submit, curate, and share their research data. With open-access space biological data now collected and curated together with rich metadata, and with the potential for linkage to "big data" from the international biological and medical communities (NIH, EBI, etc.), the artificial intelligence and machine learning (AI/ML) era has started for Space Biology.

omics↗
NASA NTRSDate not supplied

Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery

The next era in human space exploration is rapidly approaching and will require the use of countermeasures to deep space health hazards. The development of countermeasures (or, the re-purposing of existing agents) will be highly dependent on our understanding of basic biological responses to space stressors (e.g. ionizing radiation, altered gravitational fields, altered day-night cycles, confinement, isolation, hostile-closed environments, distance-duration from Earth, exposure to celestial regolith, etc.). The fast-growing array of space biological data, which in the past was simply archived after minimal analysis, holds great potential if it can be reorganized and formatted for Open Science. Organizing the data for such analysis is a challenge because of its diverse nature (molecular, cellular, tissue, imaging, whole organism and behavior). We will discuss here several strategies that NASA’s Biological and Physical Science Division has put in place to maximize the return on investment for spaceflight bioscience data. Open Science, as a scientific philosophy, is the concept that the more people who have access to the data, the more knowledge will be gained from it. This guiding principle led NASA to develop GeneLab in 2015. GeneLab houses spaceflight and relevant ground-based multi-omics data, and has grown to ~400 transcriptomic, proteomic, metabolomic and epigenomic datasets from plant, rodent, small animal, and microbial space experiments. GeneLab provides users with various tools for data analysis and a visualization portal that allows users to interact with gene expression data from space-related ‘omics experiments. Open Science is also about building scientific communities, and with this spirit in mind, GeneLab has spawned several Analysis Working Groups (AWGs), comprised of more than 200 volunteer scientists. The AWGs initially provided feedback on the processing pipeline and metadata ‘omics standards for GeneLab. Over the last few years, they have become a community-driven science enterprise, engaging in large meta-analysis of GeneLab datasets, resulting in 10 publications (beyond the originally submitted research). Overall, the Open Science nature of GeneLab has resulted in a high degree of data re-use, resulting in 38 additional publications derived from the original 67 publication over the past four years. The enormous success and knowledge gained from GeneLab has led to a collection of sister NASA “Open Science Data Repositories (OSDR)” and research support groups. These include the NASA Ames Life Sciences Data Archive (ALSDA), the NASA Biological Institutional Scientific Collection (NBISC), and the Biospecimen Sharing Program (BSP). All are adopting the GeneLab data architecture system to maximize open-access, find-ability, accessibility, interoperability, and reusability (FAIR). ALSDA collects and curates phenotypic-physiological bioimaging-behavioral data from space and space-relevant non-human experiments, oftentimes coming from the same omics-associated experimental datasets found in GeneLab. Since 2021, a community of ~100 researchers have rallied around ALSDA, to provide feedback in a new ALSDA AWG focused on phenotypic-physiological investigation-sample-assay metadata standards (e.g., Micro-Computed Tomography, Light/Fluorescence Microscopy, Western Blot, Flow Cytometry, Novel Object Recognition, Elevated Plus Maze, etc. of ~50 assays collected). These standards are part of a new single point-of-entry data submission portal for all non-human Space Biology and Human Research Program principal investigators, to submit, curate, and share their research data. With open-access space biological data now collected and curated together with rich metadata, and with the potential for linkage to “big data” from the international biological and medical communities (NIH, EBI, etc.), the artificial intelligence and machine learning (AI/ML) era has started for Space Biology. Several other talks will cover these topics in this conference.

life sciences↗
DOE OSTI2017

(Project 14-6770) An Investigation to Establish Multiphysical Property Dataset of Nuclear Materials Based on in-situ Observations and Measurements

In-core nuclear materials including fuel pins and cladding materials fail due to issues including corrosion, mechanical wear, and pellet cladding interaction. In most such scenario microstructure dependent and corrosioninduced chemistry dependent property changes significantly affect performance of cladding, pellet, and housing. Emphasis of this work was on replace conventional pellet-cladding material models with a new straingradient viscoplasticity model that is informed by transmission electron microscopy (TEM) based measurements and by nanomechanical Raman spectroscopy (NMRS) based measurements. The TEM measurements are quantitative in nature and therefore reveal stress-strain relations with simultaneous insights into mechanisms of deformation at nanoscale. The NMRS measurements reveal the similar information at mesoscale along with additional information on relating local microstructural stresses with applied stresses. The resulting information is used to fit constants in the strain gradient viscoplasticity model as well as to validate one. During TEM measurements, a micro-electro-mechanical system based setup was developed with mechanical actuation, sensing, heating, and electrical loading. Contrary to post-mortem analysis or qualitative visualization, this setup combines direct visualization of the mechanisms behind deformation with measurement of stress, strain, thermal and electrical properties. The unique research philosophy of visualizing the microstructure at high resolution while measuring the properties led to fundamental understanding in grain size and temperature effects on measured mechanical properties such as fracture toughness. A key contribution is the role of mechanical loading boundary conditions to deconvolute the insitu TEM based nanoscale and NMRS based mesoscale data to bulk behavior. First the literature based pellet cladding mechanical interaction model based on the work of Retel’s and Williamson’s in literature work to predict tempurature and stress distribution in cladding and pellet at normal operating condition was analyzed. Later the data was fitted to find constants for a viscoplastic strain gradient model. The developed model still needs to be refined and calibrated using various experimental results. That remains the focus of future work. Overall, a major thrust of the work was therefore on active control of the microstructure (grain size, defect density and types) exploiting the multi-physics coupling in materials. In particular, using experiments the synergy of current density, mechanical stress and temperature were studied to annihilate defects and recrystallize grains. The developed model is being examined for implementation in BISON. Multiple invited talks, international journal publications, and conference publications were performed by students supported on this work. Another output is support multiple PhD and masters thesis students who will be an important asset for future basic nuclear research. Future Work Recommendations: A nuclear reactor operates under significant variations of thermal loads due to energy cycling and mechanical loads due to constraint effects. Significant thermal and chemical diffusion takes place at the pallet-cladding level. While the proposed work established new experimental approach and new dataset for Zircaloy-4, the irradiation level was in the range of 1-2 dpa. Samples with higher dpa need to be examined. Therefore, a continual of support of the performed work is essential. Currently, these are the only experiments that can measure the produced data. The work also needs to be extended to different fuel types and cladding types such as SiC and FeCrAl based claddings. A combination of datasets for these materials can then be used to analyze accurately predict behavior of critical pellet cladding systems in accident scenario with high heat flux and high thermal loads. This is a BIG unknown as if now.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2016

Composition and Realization of Source-to-Sink High-Performance Flows: File Systems, Storage, Hosts, LAN and WAN

A number of Department of Energy (DOE) science applications, involving exascale computing systems and large experimental facilities, are expected to generate large volumes of data, in the range of petabytes to exabytes, which will be transported over wide-area networks for the purpose of storage, visualization, and analysis. To support such capabilities, significant progress has been made in various components including the deployment of 100 Gbps networks with future 1 Tbps bandwidth, increases in end-host capabilities with multiple cores and buses, capacity improvements in large disk arrays, and deployment of parallel file systems such as Lustre and GPFS. High-performance source-to-sink data flows must be composed of these component systems, which requires significant optimizations of the storage-to-host data and execution paths to match the edge and long-haul network connections. In particular, end systems are currently supported by 10-40 Gbps Network Interface Cards (NIC) and 8-32 Gbps storage Host Channel Adapters (HCAs), which carry the individual flows that collectively must reach network speeds of 100 Gbps and higher. Indeed, such data flows must be synthesized using multicore, multibus hosts connected to high-performance storage systems on one side and to the network on the other side. Current experimental results show that the constituent flows must be optimally composed and preserved from storage systems, across the hosts and the networks with minimal interference. Furthermore, such a capability must be made available transparently to the science users without placing undue demands on them to account for the details of underlying systems and networks. And, this task is expected to become even more complex in the future due to the increasing sophistication of hosts, storage systems, and networks that constitute the high-performance flows. The objectives of this proposal are to (1) develop and test the component technologies and their synthesis methods to achieve source-to-sink high-performance flows, and (2) develop tools that provide these capabilities through simple interfaces to users and applications. In terms of the former, we propose to develop (1) optimization methods that align and transition multiple storage flows to multiple network flows on multicore, multibus hosts; and (2) edge and long-haul network path realization and maintenance using advanced provisioning methods including OSCARS and OpenFlow. We also propose synthesis methods that combine these individual technologies to compose high-performance flows using a collection of constituent storage-network flows, and realize them across the storage and local network connections as well as long-haul connections. We propose to develop automated user tools that profile the hosts, storage systems, and network connections; compose the source-to-sink complex flows; and set up and maintain the needed network connections. These solutions will be tested using (1) 100 Gbps connection(s) between Oak Ridge National Laboratory (ORNL) and Argonne National Laboratory (ANL) with storage systems supported by Lustre and GPFS file systems with an asymmetric connection to University of Memphis (UM); (2) ORNL testbed with multicore and multibus hosts, switches with OpenFlow capabilities, and network emulators; and (3) 100 Gbps connections from ESnet and their Openflow testbed, and other experimental connections. This proposal brings together the expertise and facilities of the two national laboratories, ORNL and ANL, and UM. It also represents a collaboration between DOE and the Department of Defense (DOD) projects at ORNL by sharing technical expertise and personnel costs, and leveraging the existing DOD Extreme Scale Systems Center (ESSC) facilities at ORNL.

97 MATHEMATICS AND COMPUTING↗