Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCIENTIST”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2013

NREL Produces Ethylene via Photosynthesis; Breakthrough Offers Cleaner Alternative for Transportation Fuels [Fact Sheet]

NREL scientists have demonstrated a way to produce ethylene through photosynthesis, a breakthrough that could lead to more environmentally friendly ways to produce a variety of materials, chemicals, and transportation fuels. The scientists introduced a gene into a cyanobacterium and demonstrated that the organism remains stable through at least four generations, producing ethylene gas that can be easily captured. In the laboratory, the organism, Synechocystis sp. PCC 6803, produced 720 milligrams of ethylene per liter each day.

09 BIOMASS FUELS↗
DOE OSTI2013

Kshort Production in ALICE at the LHC

The European Organization for Nuclear Research (CERN) was created in 1954 as international entity for the benefit of advancing the scope of knowledge in particle physics. The designation of CERN refers simply to an organization, which hosts the world’s largest particle physics laboratory. CERN employs close to 2,400 full-time employees, 1,500 part-time employees and hosts 10,000 visiting engineers and scientists, affiliated with 608 universities and research facilities ranging from over 113 nationalities. (Wikipedia, CERN) The European Organization for Nuclear Research houses various colliders, which on a daily basis makes attempts at defining the initial anatomy of the universe. CERN utilizes the world’s largest and most sophisticated scientific tools, which aid in the analysis of clarifying the fundamental components of matter – Elementary Particles. These particles are forced into collisions that are near the speed of light or rather “relativistic”. These collisions aid scientists and engineers who work at CERN in the endeavor of illustrating the process of how the fundamental forces of nature affect the interactions of particles/matter at various energy levels.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2013

CTBTO Contractor Laboratory Test Sample Production Report

In October 2012 scientists from both Idaho National Laboratory (INL) and the CTBTO contact laboratory at Seibersdorf, Austria designed a system and capability test to determine if the INL could produce and deliver a short lived radio xenon standard in time for the standard to be measured at the CTBTO contact laboratory at Seibersdorf, Austria. The test included sample standard transportation duration and potential country entrance delays at customs. On October 23, 2012 scientists at the Idaho National Laboratory (INL) prepared and shipped a Seibersdorf contract laboratory supplied cylinder. The canister contained 1.0 scc of gas that consisted of 70% xenon and 30% nitrogen by volume. The t0 was October 24, 2012, 1200 ZULU. The xenon content was 0.70 +/ 0.01 scc at 0 degrees C. The 133mXe content was 4200 +/ 155 dpm per scc of stable xenon on t0 (1 sigma uncertainty). The 133Xe content was 19000 +/ 800 dpm per scc of stable xenon on t0 (1 sigma uncertainty).

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2014

Polarized 3 He in Neutron Scattering (Final Report)

We propose to extend the technique of polarized neutron scattering into new domains by continued development and application of polarized 3 He spin-filters. These devices are particularly relevant to the Spallation Neutron Source, as the polarizing monochromators historically used at reactor sources will usually not be suitable polarizers, and wide-angle polarization analysis will be essential. With prior support from the Office of Science, we have developed neutron spin-filters based on the large spin dependence of the cross section for neutron capture by 3 He, and applied these devices to a small angle neutron scattering spectrometer (SANS), polarized neutron reflectometers, a thermal energy single crystal diffractometer (SCD), and a thermal energy triple-axis instrument. Our developments have been adopted for application on the magnetism reflectometer at the SNS and for the NIST Center for Neutron Research (NCNR) 3He user capability. Results from both these programs are emerging. We have made significant progress in the past grant period on wide-angle polarization analysis. We have also performed several studies relevant to continuous optical pumping, including collaboration on experiments that have revealed neutron beam effects on spin filters that are continuously pumped by spin-exchange optical pumping. We contributed to an experiment on a neutron interferometer, in which the successful results obtained are directly related to both 3He cell technology and high accuracy 3 He-based neutron polarimetry. Implementation of wide-angle polarization analysis will continue to be key thrust for our work in this new proposal. We will also focus on continuous optical pumping and the fundamental issues that determine the achievable 3 He polarization. This project will be carried out by a collaboration involving scientists at NIST, Indiana University, Hamilton College, and the Univ. of Wisconsin who are experts in 3 He polarization techniques, and materials scientists from the NCNR, SNS, and LENS who are neutron scattering experts. We will collaborate with the staff in the new programs at the NCNR and SNS. In addition, we will welcome the opportunity to interact with other laboratories.

36 MATERIALS SCIENCE↗
DOE OSTI2013

Proceedings of RIKEN BNL Research Center Workshop: The Physics of p ↑ +A Collisions at RHIC

The RIKEN BNL Research Center (RBRC) was established in April 1997 at Brookhaven National Laboratory. It is funded by the "Rikagaku Kenkyusho" (RIKEN, The Institute of Physical and Chemical Research) of Japan. The Memorandum of Understanding between RIKEN and BNL, initiated in 1997, has been renewed in 2002, 2007 and again in 2012. The Center is dedicated to the study of strong interactions, including spin physics, lattice QCD, and RHIC physics through the nurturing of a new generation of young physicists. The RBRC has both a theory and experimental component. The RBRC Theory Group and the RBRC Experimental Group consists of a total of 25-30 researchers. Positions include the following: full time RBRC Fellow, half-time RHIC Physics Fellow, and full-time postdoctoral Research Associate. The RHIC Physics Fellows hold joint appointments with RBRC and other institutions and have tenure track positions at their respective universities or BNL. To date, RBRC has over 95 graduates (Fellows and Post- docs) of which approximately 40 theorists and 20 experimenters have already attained tenure positions at major institutions worldwide. Beginning in 2001 a new RIKEN Spin Program (RSP) category was implemented at RBRC. These appointments are joint positions of RBRC and RIKEN and include the following positions in theory and experiment: RSP Researchers, RSP Research Associates, and Young Researchers, who are mentored by senior RBRC Scientists. A number of RIKEN Jr. Research Associates and Visiting Scientists also contribute to the physics program at the Center. RBRC has an active workshop program on strong interaction physics with each workshop focused on a specific physics problem. In most cases all the talks are made available on the RBRC website. In addition, highlights to each speaker’s presentation are collected to form proceedings which can therefore be made available within a short time after the workshop. To date there are over one hundred proceeding volumes available. A 10 teraflops RBRC QCDOC computer funded by RIKEN, Japan, was unveiled at a dedication ceremony at BNL on May 26, 2005. This supercomputer was designed and built by individuals from Columbia University, IBM, BNL, RBRC, and the University of Edinburgh, with the U.S. D.O.E. Office of Science providing infrastructure support at BNL. Physics results were reported at the RBRC QCDOC Symposium following the dedication. QCDSP, a 0.6 teraflops parallel processor, dedicated to lattice QCD, was begun at the Center on February 19, 1998, was completed on August 28, 1998, and was decommissioned in 2006. It was awarded the Gordon Bell Prize for price performance in 1998. QCDOC was decommissioned in May 2012. The next generation computer in this sequence, QCDCQ (600 Teraflops), is currently operational and is expected to produce many more interesting discoveries in the future.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2014

Request for Travel Funds for Systems Radiation Biology Workshop

The 3rd International Systems Radiation Biology Workshop brought together the major European, US and Japanese research programs on radiation risk as well as selected experts representing systems biological approaches to discuss how the new methodologies could be best exploited for low dose research. A significant part of the workshop was devoted to discussions organised as breakout group sessions. To facilitate discussions number of participants was limited to 60 persons. To achieve the goals of this symposium in this international conference, support from DOE is vital. Hence, this proposal requested support in the amount of $15,000 to cover the travel expenses of international experts and radiation biology scientists from the United States. This supporting mechanism was clearly identified to the selected US participants as a conference support award from the DOE (See attached PDF). The workshop was an outstanding opportunity to strengthen interactions between leading experts in the emerging areas of radiation sciences, and will also provide opportunities for younger scientists to meet with experts and discuss their results. This workshop was designed to endorse active engagement in international collaboration. A major objective of this conference was to effectively communicate research results, in order to ensure that current thinking reflects sound science of radiation biology. Further, this international event addressed the use and success of scientific initiatives in radiation biology for policymakers, standard-setters, and the general public.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2012

Report on DOE support for GSC13 travel award

Consortium. The 3-day conference was held at the Kingkey Palace Hotel, Shenzhen, China, on March 5-7th, 2012, and was hosted by the Beijing Genomics Institute (BGI). The meeting was entitled ‘From Genomes to Interactions to Communities to Models’ and aimed to be a scientific meeting that highlighted the role of data standards associated with genomic, metagenomic and amplicon sequence data, and the contextual information associated with the sample that data was generated from. To this end the meeting focused on genomic projects for animals, plants, fungi and viruses, metagenomic studies in host-microbe interactions, and community dynamics in microbial communities. In addition the meeting hosted a Genomic Observatories Network session, a GSC biodiversity working group session, and a Microbiology of the Built Environment session sponsored by the Alfred P. Sloan Foundation. The meeting was very well organized by the local hosts at BGI, and all attendees reported that they were very happy with the outcome, service and quality of the science presented. Highlights were keynotes by Rita Colwell, Mitch Sogin and Jim Tiedje. The 5 attendees paid for by the DOE award were Daniel Smith and Jared Wilkening (University of Chicago); Patrick Chain (Los Alamos National Laboratory), Austin Davis-Richardson (University of Florida) and Greg Caporoaso (University of Northern Arizona). Each attendee was able to either present or become involved with the attending scientists, and each reported that they had got something significant out of the meeting. Here are detailed their personal accounts of the GSC13 meeting. We thank DOE for the helping to fund this valuable outreach initiative, and for supporting the attendance of these bright young scientists at this important meeting.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

IMPACTS OF INTERACTING ELEVATED ATMOSPHERIC CO2 AND O3 ON THE STRUCTURE AND FUNCTIONING OF A NORTHERN FOREST ECOSYSTEM: OPERATING AND DECOMMISSIONING THE ASPEN FACE PROJECT

Two of the most important and pervasive greenhouse gases driving global change and impacting forests in the U.S. and around the world are atmospheric CO2 and tropospheric O3. As the only free air, large-scale manipulative experiment studying the interaction of elevated CO2 and O3 on forests, the Aspen FACE experiment was uniquely designed to address the long-term ecosystem level impacts of these two greenhouse gases on aspen-birch-maple forests, which dominate the richly forested Lake States region. The project was established in 1997 to address the overarching scientific question: “What are the effects of elevated [CO2] and [O3], alone and in combination, on the structure and functioning of northern hardwood forest ecosystems?” From 1998 through the middle of the 2009 growing season, we examined the interacting effects of elevated CO2 and O3 on ecosystem processes in an aggrading northern forest ecosystem to compare the responses of early-successional, rapid-growing shade intolerant trembling aspen and paper birch to those of a late successional, slower growing shade tolerant sugar maple. Fumigations with elevated CO2 (560 ppm during daylight hours) and O3 (approximately 1.5 x ambient) were conducted during the growing season from 1998 to 2008, and in 2009 through harvest date. Response variables quantified during the experiment included growth, competitive interactions and stand dynamics, physiological processes, plant nutrient status and uptake, tissue biochemistry, litter quality and decomposition rates, hydrology, soil respiration, microbial community composition and respiration, VOC production, treatment-pest interactions, and treatment-phenology interactions. In 2009, we conducted a detailed harvest of the site. The harvest included detailed sampling of a subset of trees by component (leaves and buds, fine branches, coarse branches and stem, coarse roots, fine roots) and excavation of soil to a depth of 1 m. Throughout the experiment, aspen and birch photosynthesis increased with elevated CO2 and tended to decrease with elevated O3, compared to the control. In contrast to aspen and birch, maple photosynthesis was not enhanced by elevated CO2. Elevated O3 did not cause significant reductions in maximum photosynthesis in birch or maple. In addition, photosynthesis in ozone sensitive clones was affected to a much greater degree than that in ozone tolerant aspen clones. Treatment effects on photosynthesis contributed to CO2 stimulation of aboveground and belowground growth that was species and genotype dependent, with birch and aspen being most responsive and maple being least responsive. The positive effects of elevated CO2 on net primary productivity NPP were sustained through the end of the experiment, but negative effects of elevated O3 on NPP had dissipated during the final three years of treatments. The declining response to O3 over time resulted from the compensatory growth of O3-tolerant genotypes and species as the growth of O3-sensitive individuals declined over time. Cumulative NPP over the entire experiment was 39% greater under elevated CO2 and 10% lower under elevated O3. Enhanced NPP under elevated CO2 was sustained by greater root exploration of soil for growth-limiting N, as well as more rapid rates of litter decomposition and microbial N release during decay. Results from Aspen FACE clearly indicate that plants growing under elevated carbon dioxide, regardless of community type or ozone level, obtained significantly greater amounts of soil N. These results indicate that greater plant growth under elevated carbon dioxide has not led to “progressive N limitation”. If similar forests growing throughout northeastern North America respond in the same manner, then enhanced forest NPP under elevated CO2 may be sustained for a longer duration than previously thought, and the negative effect of elevated O3 may be diminished by compensatory growth of O3-tolerant plants as they begin to dominate forest communities. By the end of the experiment, elevated CO2 increased ecosystem C content by 11%, whereas elevated O3 decreased ecosystem C content by 9%. Total ecosystem C content in the interaction treatment (elevated CO2 and O3) did not significantly differ from that of the control. Total ecosystem C content responded similarly to the treatments across the three forest communities. The treatment effects on ecosystem C content resulted from differences in tree biomass, particularly woody tissues (branches, stem, and coarse roots), and lower C content in the near-surface mineral soil. During its duration, the Aspen FACE project involved collaboration between scientists from 9 countries, and over the course of the experiment there were over 120 Aspen FACE scientific users. These scientists helped produce 75 publications during the most recent funding period (2008-2014) and 207 peer-reviewed publications (169 in refereed journals) since the beginning of the project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Exascale Co-design for Modeling Materials in Extreme Environments

Computational materials science has provided great insight into the response of materials under extreme conditions that are difficult to probe experimentally. For example, shock-induced plasticity and phase transformation processes in single-crystal and nanocrystalline metals have been widely studied via large-scale molecular dynamics simulations, and many of these predictions are beginning to be tested at advanced 4th generation light sources such as the Advanced Photon Source (APS) and Linac Coherent Light Source (LCLS). I will describe our simulation predictions and their recent verification at LCLS, outstanding challenges in modeling the response of materials to extreme mechanical and radiation environments, and our efforts to tackle these as part of the multi-institutional, multi-disciplinary Exascale Co-design Center for Materials in Extreme Environments (ExMatEx). ExMatEx has initiated an early and deep collaboration between domain (computational materials) scientists, applied mathematicians, computer scientists, and hardware architects, in order to establish the relationships between algorithms, software stacks, and architectures needed to enable exascale-ready materials science application codes within the next decade. We anticipate that we will be able to exploit hierarchical, heterogeneous architectures to achieve more realistic large-scale simulations with adaptive physics refinement, and are using tractable application scale-bridging proxy application testbeds to assess new approaches and requirements. Such current scale-bridging strategies accumulate (or recompute) a distributed response database from fine-scale calculations, in a top-down rather than bottom-up multiscale approach.

36 MATERIALS SCIENCE↗
DOE OSTI2014

Performance Engineering Research Institute SciDAC-2 Enabling Technologies Institute Final Report

Enhancing the performance of SciDAC applications on petascale systems has high priority within DOE SC. As we look to the future, achieving expected levels of performance on high-end com-puting (HEC) systems is growing ever more challenging due to enormous scale, increasing archi-tectural complexity, and increasing application complexity. To address these challenges, PERI has implemented a unified, tripartite research plan encompassing: (1) performance modeling and prediction; (2) automatic performance tuning; and (3) performance engineering of high profile applications. The PERI performance modeling and prediction activity is developing and refining performance models, significantly reducing the cost of collecting the data upon which the models are based, and increasing model fidelity, speed and generality. Our primary research activity is automatic tuning (autotuning) of scientific software. This activity is spurred by the strong user preference for automatic tools and is based on previous successful activities such as ATLAS, which has automatically tuned components of the LAPACK linear algebra library, and other re-cent work on autotuning domain-specific libraries. Our third major component is application en-gagement, to which we are devoting approximately 30% of our effort to work directly with Sci-DAC-2 applications. This last activity not only helps DOE scientists meet their near-term per-formance goals, but also helps keep PERI research focused on the real challenges facing DOE computational scientists as they enter the Petascale Era.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Center for Scalable Application Development Software (Final Report)

The Center for Scalable Application Development Software (CScADS) was established as a part- nership between Rice University, Argonne National Laboratory, University of California Berkeley, University of Tennessee – Knoxville, and University of Wisconsin – Madison. CScADS pursued an integrated set of activities with the aim of increasing the productivity of DOE computational scientists by catalyzing the development of systems software, libraries, compilers, and tools for leadership computing platforms. Principal Center activities were workshops to engage the research community in the challenges of leadership computing, research and development of open-source software, and work with computational scientists to help them develop codes for leadership computing platforms. This final report summarizes CScADS activities at Rice University in these areas.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Runtime System for I/O Staging in Support of In-Situ Processing of Extreme Scale Data

Our research in this project focused on creating and evaluating an I/O infrastructure and tools for extreme-scale applications and machines so that scientists can reduce their time to discovery at small cost in machine resources and consequent power consumption. We wanted to provide tools that are highly scalable, portable, and easy-to-use, so that scientists can gain control of their science, and concentrate on producing important scientific discovery in their own domain. Accelerating the rate of insight and scientific productivity, therefore, demands new solutions to managing the avalanche of data expected at extreme scale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Combinatorial Algorithms to Enable Computational Science and Engineering: Work from the CSCAPES Institute

This final progress report summarizes the work accomplished at the Combinatorial Scientific Computing and Petascale Simulations Institute. We developed Zoltan, a parallel mesh partitioning library that made use of accurate hypergraph models to provide load balancing in mesh-based computations. We developed several graph coloring algorithms for computing Jacobian and Hessian matrices and organized them into a software package called ColPack. We developed parallel algorithms for graph coloring and graph matching problems, and also designed multi-scale graph algorithms. Three PhD students graduated, six more are continuing their PhD studies, and four postdoctoral scholars were advised. Six of these students and Fellows have joined DOE Labs (Sandia, Berkeley), as staff scientists or as postdoctoral scientists. We also organized the SIAM Workshop on Combinatorial Scientific Computing (CSC) in 2007, 2009, and 2011 to continue to foster the CSC community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

A Proposal submitted to Biological Systems Science Division of DOE requesting Participant Support Costs for the Fifth International Conference on Polar and Alpine Microbiology

The 5th International Conference on Polar and Alpine Microbiology (PAM5) was held in Big Sky, Montana (USA) from 8-12 September 2013. This meeting is a continuation of the highly successful meetings previously held in Rovaniemi, Finland (2004), Innsbruck, Austria (2006), Banff, Canada (2008) and Ljubljana, Slovenia (2011), which brought together leading international researchers and students in this field. The objectives of the Big Sky meeting were to bring together scientists, students and professionals to discuss all aspects of cold-adapted microorganisms and the roles they play in polar and alpine environments, to understand the role of these organisms in our search for life on other icy worlds, to address recent developments, and to exchange ideas and experiences on an international scale. The conference provided a multi-disciplinary forum to explore emerging areas in the field and as always, will have a wealth of opportunities for the exchange of ideas and building of collaborations. Funds were requested to help defray registration fees and travel costs of 13 early career scientists. Distribution of the funds were based on the quality of the abstracts submitted.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Theoretical and Computational Modeling of Magnetically Ordered Molecules & Electronic Nano-Transport of Spins: State of Art and Unanswered Questions : Workshop

As a culmination of a five-year Nordforsk Network project entitled “Nanospintronics: Theory and Simulations”, Professor Carlo Canali (Linneaus University, Sweden) and members of the network, and Vincenza Benza (Local Organizer Milan) organized a summer workshop in conjunction with the A. Volta Scientific Cultural Exchange program. This workshop took place 24-30 August 2013. Several Basic Energy Scientists from the US conducted lectures and also provided hands-on tutorials to developing materials and chemicals scientists. We have received a total of $10,000 of support to offset the travel expenses of US-based participants for this workshop.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Sustaining and Extending the Open Science Grid: Science Innovation on a PetaScale Nationwide Facility (DE-FC02-06ER41436) SciDAC-2 Closeout Report

Under this SciDAC-2 grant the project’s goal w a s t o stimulate new discoveries by providing scientists with effective and dependable access to an unprecedented national distributed computational facility: the Open Science Grid (OSG). We proposed to achieve this through the work of the Open Science Grid Consortium: a unique hands-on multi-disciplinary collaboration of scientists, software developers and providers of computing resources. Together the stakeholders in this consortium sustain and use a shared distributed computing environment that transforms simulation and experimental science in the US. The OSG consortium is an open collaboration that actively engages new research communities. We operate an open facility that brings together a broad spectrum of compute, storage, and networking resources and interfaces to other cyberinfrastructures, including the US XSEDE (previously TeraGrid), the European Grids for ESciencE (EGEE), as well as campus and regional grids. We leverage middleware provided by computer science groups, facility IT support organizations, and computing programs of application communities for the benefit of consortium members and the US national CI.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2015

Dynamic Non-Hierarchical File Systems for Exascale Storage

This constitutes the final report for “Dynamic Non-Hierarchical File Systems for Exascale Storage”. The ultimate goal of this project was to improve data management in scientific computing and high-end computing (HEC) applications, and to achieve this goal we proposed: to develop the first, HEC-targeted, file system featuring rich metadata and provenance collection, extreme scalability, and future storage hardware integration as core design goals, and to evaluate and develop a flexible non-hierarchical file system interface suitable for providing more powerful and intuitive data management interfaces to HEC and scientific computing users. Data management is swiftly becoming a serious problem in the scientific community – while copious amounts of data are good for obtaining results, finding the right data is often daunting and sometimes impossible. Scientists participating in a Department of Energy workshop noted that most of their time was spent “...finding, processing, organizing, and moving data and it’s going to get much worse”. Scientists should not be forced to become data mining experts in order to retrieve the data they want, nor should they be expected to remember the naming convention they used several years ago for a set of experiments they now wish to revisit. Ideally, locating the data you need would be as easy as browsing the web. Unfortunately, existing data management approaches are usually based on hierarchical naming, a 40 year-old technology designed to manage thousands of files, not exabytes of data. Today’s systems do not take advantage of the rich array of metadata that current high-end computing (HEC) file systems can gather, including content-based metadata and provenance1 information. As a result, current metadata search approaches are typically ad hoc and often work by providing a parallel management system to the “main” file system, as is done in Linux (the locate utility), personal computers, and enterprise search appliances. These search applications are often optimized for a single file system, making it difficult to move files and their metadata between file systems. Users have tried to solve this problem in several ways, including the use of separate databases to index file properties, the encoding of file properties into file names, and separately gathering and managing provenance data, but none of these approaches has worked well, either due to limited usefulness or scalability, or both. Our research addressed several key issues: High-performance, real-time metadata harvesting: extracting important attributes from files dynamically and immediately updating indexes used to improve search; Transparent, automatic, and secure provenance capture: recording the data inputs and processing steps used in the production of each file in the system; Scalable indexing: indexes that are optimized for integration with the file system; Dynamic file system structure: our approach provides dynamic directories similar to those in semantic file systems, but these are the native organization rather than a feature grafted onto a conventional system. In addition to these goals, our research effort will include evaluating the impact of new storage technologies on the file system design and performance. In particular, the indexing and metadata harvesting functions can potentially benefit from the performance improvements promised by new storage class memories.

42 ENGINEERING↗
DOE OSTI2015

Adding Data Management Services to Parallel File Systems

The objective of this project, called DAMASC for “Data Management in Scientific Computing”, is to coalesce data management with parallel file system management to present a declarative interface to scientists for managing, querying, and analyzing extremely large data sets efficiently and predictably. Managing extremely large data sets is a key challenge of exascale computing. The overhead, energy, and cost of moving massive volumes of data demand designs where computation is close to storage. In current architectures, compute/analysis clusters access data in a physically separate parallel file system and largely leave it scientist to reduce data movement. Over the past decades the high-end computing community has adopted middleware with multiple layers of abstractions and specialized file formats such as NetCDF-4 and HDF5. These abstractions provide a limited set of high-level data processing functions, but have inherent functionality and performance limitations: middleware that provides access to the highly structured contents of scientific data files stored in the (unstructured) file systems can only optimize to the extent that file system interfaces permit; the highly structured formats of these files often impedes native file system performance optimizations. We are developing Damasc, an enhanced high-performance file system with native rich data management services. Damasc will enable efficient queries and updates over files stored in their native byte-stream format while retaining the inherent performance of file system data storage via declarative queries and updates over views of underlying files. Damasc has four key benefits for the development of data-intensive scientific code: (1) applications can use important data-management services, such as declarative queries, views, and provenance tracking, that are currently available only within database systems; (2) the use of these services becomes easier, as they are provided within a familiar file-based ecosystem; (3) common optimizations, e.g., indexing and caching, are readily supported across several file formats, avoiding effort duplication; and (4) performance improves significantly, as data processing is integrated more tightly with data storage. Our key contributions are: SciHadoop which explores changes to MapReduce assumption by taking advantage of semantics of structured data while preserving MapReduce’s failure and resource management; DataMods which extends common abstractions of parallel file systems so they become programmable such that they can be extended to natively support a variety of data models and can be hooked into emerging distributed runtimes such as Stanford’s Legion; and Miso which combines Hadoop and relational data warehousing to minimize time to insight, taking into account the overhead of ingesting data into data warehousing.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗