Computing Node Scanning Tool for Collaborative Science [Poster]
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
In scientific simulation, scientists use measured data to create numerical models, execute simulations and analyze results from advanced simulators executing on high performance computing platforms. This process usually requires a team of scientists collaborating on data collection, model creation and analysis, and on authorship of publications and data. This paper shows that scientific teams can benefit from a user environment called Akuna that permits subsurface scientists in disparate locations to collaborate on numerical modeling and analysis projects. The Akuna user environment is built on the Velo framework that provides both a rich client environment for conducting and analyzing simulations and a Web environment for data sharing and annotation. Akuna is an extensible toolset that integrates with Velo, and is designed to support any type of simulator. This is achieved through data-driven user interface generation, use of a customizable knowledge management platform, and an extensible framework for simulation execution, monitoring and analysis. This paper describes how the customized Velo content management system and the Akuna toolset are used to integrate and enhance an effective collaborative research and application environment. The extensible architecture of Akuna is also described and demonstrates its usage for creation and execution of a 3D subsurface simulation.
Changes to the LANL / BNL photocathode programs are a strategic response to evolving needs and opportunities within NNSA. The Materials by Design strategy engages the broader material science communities at both LANL and BNL. Progress has been non-linear with time and investment. Techniques honed for one application can be rapidly applied to many others. For example, Cs 2 Te following successes of smooth K 2 CsSb. We enter a cycle of using accelerator-based tools to improve accelerators. Providers of advanced tools of material science (accelerator based x-ray light sources) are now availing themselves of the same capabilities to improve the next-generation machines. We are looking to define future collaborations.
The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) has begun its ten-year survey of the entire visible southern hemisphere. To ensure robust cosmological measurements, computationally inexpensive investigations of modeling choices must be made to gauge the performance of proposed cosmological analyses. In this paper, we introduce the $\texttt{Augur}$ tool of the Dark Energy Science Collaboration (DESC), which provides Fisher forecasts for cosmological inference for the LSST using software frameworks designed for DESC science. We test the pipeline by comparing it to forecasts produced by external code and direct sampling of the posterior via nested sampling methods, finding good agreement between all methods. We additionally investigate a range of modeling and hyperparameter choices for a 3$\times$2pt investigation in harmonic space, providing users with diagnostics to obtain reliable forecasts. $\texttt{Augur}$ will be continually updated to be compatible with the other tools in the DESC software ecosystem as additional probes and functionality become available.
Carbon-climate, like other environmental sciences, has been changing. Large-scalesynthesis studies are becoming more common. These synthesis studies are often conducted by science teams that are geographically distributed and on datasets that are global in scale. A broad array of collaboration and data analytics tools are now available that could support these science teams. However, building tools that scientists actually use is hard. Also, moving scientists from an informal collaboration structure to one mediated by technology often exposes inconsistencies in the understanding of the rules of engagement between collaborators. We have developed a scientific collaboration portal, called fluxdata.org, which serves the community of scientists providing and analyzing the global FLUXNET carbon-flux synthesis dataset. Key things we learned or re-learned during our portal development include: minimize the barrier to entry, provide features on a just-in-time basis, development of requirements is an on-going process, provide incentives to change leaders and leverage the opportunity they represent, automate as much as possible, and you can only learn how to make it better if people depend on it enough to give you feedback. In addition, we also learned that splitting the portal roles between scientists and computer scientists improved user adoption and trust. The fluxdata.org portal has now been in operation for ~;;1.5 years and has become central to the FLUXNET synthesis efforts.
Investigators from the University of Utah, University of Wyoming and Marshall University pursued a program to study the conversion of raw coal to high-value products of carbon fiber and silicon carbide. Team members also developed an initial framework for a data portal that can incorporate laboratory data on coal processing and product quality, and also work with tools for machine learning for data analysis, data visualization and economic assessment. Experimental R&D efforts focused on the conversion of raw coal to coal tar and other byproducts, and the resulting tar intermediates were upgraded to form anisotropic and isotropic pitch materials. These pitch materials were produced from coal using both thermal (pyrolysis) and chemical (mild solvolysis liquefaction) decomposition of raw coal. Four different coals were studied: Utah bituminous coal (Sufco), Wyoming PRB coal (Black Thunder), Illinois bituminous coal (Illinois #6), and West Virginia bituminous coal (Flying Eagle). Both metallurgical-grade coking coals and lower-grade steam coals were investigated, and controlled secondary gas-phase reactions were used during a two-stage pyrolysis process to induce cracking and condensation reactions among the pyrolytic tar species. This approach successfully improved the performance of the lower grade coals for yielding pitch materials, with properties more consistent with a commercial-grade pitch that had previously demonstrated success for quality carbon fiber production. The use of waste plastic materials was also studied, to help improve physical and chemical characteristics of the intermediate tars and final pitch product; in particular, for lowering the pitch softening point to an acceptable level for melt spinning carbon fiber. Mild solvolysis liquefaction was also used as a method for producing pitch for carbon fiber production. As expected, significantly higher pitch yields were obtained using this approach, and waste plastic materials were also successfully used to reduce pitch softening point to an acceptable level. The plastic materials were also utilized to create a solvent for the mild solvolysis process, and this plastic-derived solvent was shown to provide results consistent with more expensive commercial chemical solvents, and could thus avoid the need for costly recovery and recycle of a liquefaction solvent. Additional experimental R&D focused on the production of silicon carbide (β-SiC) from the residual char byproduct from pitch production, and also on the production of carbon fiber from the anisotropic pitch. SiC was successfully synthesized using a mixture of residual char and sandstone at a ratio of 1:1. Reaction temperature and residence time were optimized and yielded a product purity of 81%. For carbon fiber production, the most successful pitch samples were obtained from the mild solvolysis liquefaction approach, combined with the use of a plastic (HDPE)-derived solvent. Fiber properties improved over time as laboratory fiber production methodologies improved, and final yields of carbon fiber were obtained with a diameter of 12.14 ± 1.10 um, Modulus of 173.73 ± 15.25 GPa, and Tensile Strength of 1.04 ± 0.10 GPa. A proof-of-concept Modern Community Research Data Portal (MCRDP) was developed and deployed for coal and coal-derived pitch characterization, with the full support of (i) remote web-based access, (ii) distributed analysis, (iii) interactive visualization and exploration, (iv) shared and long-term data access, (v) advanced query capabilities and (vi) real-time collaboration. The Coal to Products Data Portal “coaltoproducts.org” provides researchers with space to store and share data within a project, tools for analyzing and understanding data for scientific investigation, and the ability to publish data to the broader community for reproducibility. The portal leverages the Material Commons 2.0 (MC) platform developed by the Center for PRedictive Integrated Structural Materials Science (PRISMS) of the University of Michigan, to achieve long-term longevity of data collections and, more importantly, collaborative science. A number of data visualization tools were also assessed and implemented for interrogating the experimental and modeling data. The machine learning portion of this project analyzed datasets from two different coal conversion processes performed on a diverse set of coal samples from both the coal pyrolysis experiments and the solvent liquefaction experiments. The work was initiated by exploring standard regression models on the pyrolysis data, aiming to understand the impact of sample characteristics and processing conditions on key product metrics. Over the course of the project, the focus expanded to include a variety of machine learning tools, delving into both supervised and unsupervised learning methods. Models tested on the pyrolysis data included linear, ridge, lasso, elastic-net, Gaussian process, random forest regression, and AutoSklearn, and the approach was continually refined to enhance predictive accuracy and model interpretability. Similar techniques were applied to the liquefaction data with an additional focus on feature engineering. Along with mesophase content, additional outputs of interest were the pitch yield, softening point, and QI content. Insights derived from these analyses are crucial in determining the factors influencing the quality and yield of coal-derived products. As the work progressed, the research evolved from foundational model comparisons to analyses of random forests, decision paths, and feature importance scores. A thorough market analysis was performed to examine the prospects of coal-based carbon fibers. The best opportunities for coal come from its lower and more stable price relative to petroleum, particularly for subbituminous coals, which is the primary advantage that a coal refinery may have over a petroleum refinery. Before a commercial CTP production facility can be modeled, however, several things need to be understood regarding the nature of the would-be coal refinery. These include the technology to be deployed, the size of facility, the volume(s) of co-product(s), and the waste and emissions profile of the plant. The volume of co-products and waste may be substantial and will require separate market analysis to ensure viability. In the near-term, the importance of coal tar pitch, in the form of carbon pitch, to the aluminum and steel industries is likely to overshadow the alternative use of this material as an input for carbon fiber. The importance of steel and aluminum in building materials, and the need for carbon materials in their manufacturing, will ensure that demand for these products remains for the long run. In addition, carbon fiber may also be the best substitute for steel and aluminum well into the future. While society will eventually be able to shift production of much of its electricity needs to renewables, it will not be able to shift away from fossil fuels for production of high-strength construction and vehicular materials. Demand for carbon fiber is expected to increase quickly, but the volume of carbon fiber and the amount of coal that would be needed to produce even a sizeable share of this market may still be relatively small compared to current coal production. Thus, other coal-based products like graphene, graphite, carbon foams, resins, and carbon-based building products will play important roles in sustaining coal production as coal-fired power generation continues to decline.
The prompt emission from gamma-ray bursts (GRBs) still requires a physical explanation. Studies of time-resolved GRB spectra, observed in the keV-MeV range, show that a hybrid model consisting of two components, a photospheric and a non-thermal component, in many cases fits bright, single-pulsed bursts as well as, and in some instances even better than, the Band function. With an energy coverage from 8 keV up to 300 GeV, GLAST will give us an unprecedented opportunity to further investigate the nature of the prompt emission. In particular, it will give us the possibility to determine whether a photospheric component is the determining feature of the spectrum or not. Here we present a short study of the ability of GLAST to detect such a photospheric component in the sub-MeV range for typical bursts, using simulation tools developed within the GLAST science collaboration.
Background: We are focusing specifically on fast data analysis and retrieval in bioinformatics that will have a direct impact on the quality of human health and the environment. The exponential growth of data generated in biology research, from small atoms to big ecosystems, necessitates an increasingly large computational component to perform analyses. Novel DNA sequencing technologies and complementary high-throughput approaches–such as proteomics, genomics, metabolomics, and meta-genomics–drive data-intensive bioinformatics. While individual research centers or universities could once provide for these applications, this is no longer the case. Today, only specialized national centers can deliver the level of computing resources required to meet the challenges posed by rapid data growth and the resulting computational demand. Consequently, we are developing massively parallel applications to analyze the growing flood of biological data and contribute to the rapid discovery of novel knowledge. Methods: The efforts of previous National Science Foundation (NSF) projects provided for the generation of parallel modules for widely used bioinformatics applications on the Kraken supercomputer. We have profiled and optimized the code of some of the scientific community’s most widely used desktop and small-cluster-based applications, including BLAST from the National Center for Biotechnology Information (NCBI), HMMER, and MUSCLE; scaled them to tens of thousands of cores on high-performance computing (HPC) architectures; made them robust and portable to next-generation architectures; and incorporated these parallel applications in science gateways with a web-based portal. Results: This paper will discuss the various developmental stages, challenges, and solutions involved in taking bioinformatics applications from the desktop to petascale with a front-end portal for very-large-scale data analysis in the life sciences. Conclusions: This research will help to bridge the gap between the rate of data generation and the speed at which scientists can study this data. The ability to rapidly analyze data at such a large scale is having a significant, direct impact on science achieved by collaborators who are currently using these tools on supercomputers.
Structured Scientific Data Management - the management of storage, access, usage, lifecycle, content and meaning for scientific data - is not as commonly employed in computational science as it is in other fields of scientific endeavor. However, where it has been co-developed and integrated with the computational science research it has had a transformational influence on the scientific work. These infrastructures enabled not only new research previously impossible, but also helped to speed up the research process and improved the quality of the research output. Good data management systems are capable of facilitating effective scientific collaborations on a group, institutional, national or international level, through the easy sharing of resources and results. Today as computational science is becoming more data rich and collaborative, integrated scientific data management is becoming an essential tool for every computational science research and production environment. This chapter will describe the fundamental principles and components of a good data management system, provide real world examples of successful implementations and provides an outlook on future developments. We conclude with a short section on how to get started for those whose interest has been peaked by this chapter
The Department of Energy's National Atmospheric Release Advisory Center (NARAC) provides critical information during hazardous airborne releases as part of an integrated national preparedness and response strategy. Located at Lawrence Livermore National Laboratory, NARAC provides 24/7 tools and expert services to map the spread of hazardous material accidentally or intentionally released into the atmosphere. NARAC graphical products show affected areas and populations, potential casualties, and health effect or protective action guideline levels. LLNL experts produce quality-assured analyses based on field data to assist decision makers and responders. NARAC staff and collaborators conduct research and development into new science, tools, capabilities, and technologies in strategically important areas related to airborne transport and fate modeling and emergency response. This paper provides a brief overview of some of NARAC's activities, capabilities, and research and development.
The Department of Energy (DOE) is currently investing millions of dollars annually into various modeling and simulation tools for all aspects of nuclear energy. An important part of this effort includes developing applications based on the open-source Multiphysics Object Oriented Simulation Environment (MOOSE; mooseframework.org) from Idaho National Laboratory (INL). Through the DOE and outside collaborators, MOOSE includes a large set of physics modules, including phase field, level set, heat conduction, tensor mechanics, Navier-Stokes, and porous media, among others. The phase-field module, in particular, is well-suited for micro-structure evolution simulations, including solidification, as shown in the figure. It was also used, in conjunction with the heat conduction module, to build a multiscale snow model (Pika) as presented at the 2014 International Snow Science Workshop (Slaughter et al., 2014). The snow science community should learn from the nuclear industry, and harness the enormous effort underway to build simulation tools that are open, modular, and share a common framework. In particular, MOOSE-based multi-physics solvers are inherently parallel, dimension agnostic, adaptive in time and space, fully-coupled, and capable of interacting with other applications. The snow science community must build on existing tools to enable collaboration between researchers and practitioners throughout the world, and advance the state-of-the-art in line with other scientific research efforts.
Despite their centrality to life on Earth, we know little about how microbes interact with each other, their hosts, or their environment. Although DNA sequencing technologies have enabled a new view of the ubiquity and diversity of microorganisms, this has mainly yielded snapshots that shed limited light on microbial functions or community dynamics. Given that nearly every habitat and organism hosts a diverse constellation of microorganisms—its “microbiome”—such knowledge could transform our understanding of the world and launch innovations in agriculture, energy, health, the environment, and more (see the photo). Here, we propose an interdisciplinary Unified Microbiome Initiative (UMI) to discover and advance tools to understand and harness the capabilities of Earth's microbial ecosystems. The impacts of oceans and soil microbes on atmospheric CO 2 are critical for understanding climate change. By manipulating interactions at the root-soil-microbe interface, we may reduce agricultural pesticide, fertilizer, and water use enrich marginal land and rehabilitate degraded soils. Microbes can degrade plant cell walls (for biofuels), and synthesize myriad small molecules for new bioproducts, including antibiotics. Restoring normal human microbial ecosystems can save lives [e.g., fecal microbiome transplantation for Clostridium difficile infections]. Rational management of microbial communities in and around us has implications for asthma, diabetes, obesity, infectious diseases, psychiatric illnesses, and other afflictions. The human microbiome is a target and a source for new drugs and an essential tool for precision medicine. The National Science Foundation's Microbial Observatories, the U.S. Department of Energy's Genomic Sciences program, the National Institutes of Health's Human Microbiome Project, and other efforts in the United States and abroad have served as critical first steps in revealing the diversity of microbes and their communities. However, we lack many tools required to advance beyond descriptive approaches to studies that enable a mechanistic, predictive, and actionable understanding of global microbiome processes. Developing these tools requires new collaborations between physical, life, and biomedical sciences; engineering; and other disciplines.
As part of the AAPM’s Scope of Practice, medical physicists are expected to collaborate effectively with practioners and allied health care providers. Interpersonal skills such as communication, negotiation and persuasion are vital for successful collaboration to achieve shared goals. This session will provide some theoretical background of these interpersonal skills as well as specific techniques and practical tools to influence others. Applications of these interpersonal skills for administrative and human resource management purposes vital to medical physicists will be shared. Session attendees will gain knowledge and tools to help them effectively collaborate with administrative and physician leaders in areas such as capital and human resource selection, prioritization, and implementation. Participants will hear methods of how to articulate their goals and to understand the goals of administration, helping ensure alignment of purpose. Session speakers will present one of the topics: equipment selection, budget creation, contracts, and program-related policy development. Specifics may include designing a business case in language that administrators understand, calculating the prioritization of budget requests, and influencing policies for safe and effective care. Human resource topics may include staffing justification, recruitment for fit, employment contracts, and benefits. Speakers will provide examples in both radiation therapy and diagnostic imaging departments and will share experiences and outcomes of their approaches for better results. Learning Objectives: After this course attendees will be better able to Understand the shared goal between administrative and physicist leadership. Articulate the “why” of the technical or human resource need. Utilize communication, negotiation and persuasion tools to improve collaboration.
The Energy Sciences Network (ESnet) is the primary provider of network connectivity for the US Department of Energy Office of Science, the single largest supporter of basic research in the physical sciences in the United States of America. In support of the Office of Science programs, ESnet regularly updates and refreshes its understanding of the networking requirements of the instruments, facilities, scientists, and science programs that it serves. This focus has helped ESnet to be a highly successful enabler of scientific discovery for over 20 years. In May 2008, ESnet and the Nuclear Physics (NP) Program Office of the DOE Office of Science organized a workshop to characterize the networking requirements of the science programs funded by the NP Program Office. Most of the key DOE sites for NP related work will require significant increases in network bandwidth in the 5 year time frame. This includes roughly 40 Gbps for BNL, and 20 Gbps for NERSC. Total transatlantic requirements are on the order of 40 Gbps, and transpacific requirements are on the order of 30 Gbps. Other key sites are Vanderbilt University and MIT, which will need on the order of 20 Gbps bandwidth to support data transfers for the CMS Heavy Ion program. In addition to bandwidth requirements, the workshop emphasized several points in regard to science process and collaboration. One key point is the heavy reliance on Grid tools and infrastructure (both PKI and tools such as GridFTP) by the NP community. The reliance on Grid software is expected to increase in the future. Therefore, continued development and support of Grid software is very important to the NP science community. Another key finding is that scientific productivity is greatly enhanced by easy researcher-local access to instrument data. This is driving the creation of distributed repositories for instrument data at collaborating institutions, along with a corresponding increase in demand for network-based data transfers and the tools to manage those transfers effectively. Network reliability is also becoming more important as there is often a narrow window between data collection and data archiving when transfer and analysis can be done. The instruments do not stop producing data, so extended network outages can result in data loss due to analysis pipeline stalls. Finally, as the scope of collaboration continues to increase, collaboration tools such as audio and video conferencing are becoming ever more critical to the productivity of scientific collaborations.
Open science, where researchers share and publish every element of their research process in addition to the final results, can foster novel ways of collaboration among researchers and has the potential to spontaneously create new virtual research collaborations. Based on scientific interest, these new virtual research collaborations can cut across traditional boundaries such as institutions and organizations. Advances in technology allow for software tools that can be used by different research groups and institutions to build and support virtual collaborations and infuse open science. This paper describes Talkoot, a software toolkit designed and developed by the authors to provide Earth Science researchers a ready-to-use knowledge management environment and an online platform for collaboration. Talkoot allows Earth Science researchers a means to systematically gather, tag and share their data, analysis workflows and research notes. These Talkoot features are designed to foster rapid knowledge sharing within a virtual community. Talkoot can be utilized by small to medium sized groups and research centers, as well as large enterprises such a national laboratories and federal agencies.
The growing demand for robust computational and workflow environments for scientific applications and user communities at the Oak Ridge Leadership Computing Facility (OLCF) has prompted collaboration with ensemble tools development teams and facility users to produce this technical paper. We connect science applications to the RADICAL-Pilot (RP) workflow tool to execute ensemble instantiations using the Frontier supercomputer. The documented installation, usage, and execution demonstrates how RP streamlines scientific workflows at OLCF. We outline the specific steps OLCF users can follow to integrate this tool with their applications and advance their research. This document stands as a comprehensive guide to OLCF users of ensemble workflow tools with examples on real applications using the Frontier supercomputer.
Early stage experimental data in structural biology is generally unmaintained and inaccessible to the public. It is increasingly believed that this data, which forms the basis for each macromolecular structure discovered by this field, must be archived and, in due course, published. Furthermore, the widespread use of shared scientific facilities such as synchrotron beamlines complicates the issue of data storage, access and movement, as does the increase of remote users. This work describes a prototype system that adapts existing federated cyberinfrastructure technology and techniques to significantly improve the operational environment for users and administrators of synchrotron data collection facilities used in structural biology. This is achieved through software from the Virtual Data Toolkit and Globus, bringing together federated users and facilities from the Stanford Synchrotron Radiation Lightsource, the Advanced Photon Source, the Open Science Grid, the SBGrid Consortium and Harvard Medical School. The performance and experience with the prototype provide a model for data management at shared scientific facilities.
Island and remote coastal communities face some of the most challenging environments for building, operating, and maintaining energy infrastructure, as well as the highest costs for electricity, fuels, and other essential energy sources. As sea-levels rise and storms become more intense and frequent, these communities and the energy infrastructure that supports coastal lives and livelihoods are also at increasing risk from natural hazards. To address these challenges, many coastal communities are envisioning energy solutions that will support the triple bottom line goals of the blue economy: economic growth, environmental sustainability, and social equity. Yet, island and remote coastal communities often face limited resources and capacity to tackle complex energy and coastal resilience issues. To support community-driven energy transitions in island and remote communities, and to better understand relationships between energy, community, and ecosystem resilience, the Department of Energy’s Water Power Technologies Office (WPTO) has initiated the development of a Deployment Readiness Framework (DRF). The objective of the work is to co-produce and test practical tools and approaches that assess the readiness of coastal communities for marine energy demonstration, deployment, and operation. The DRF aims to build on and support the Energy Transitions Initiative Partnership Program (ETIPP) and other community-oriented energy transition programs. This project is jointly led by Pacific Northwest National Laboratory (PNNL) and the National Renewable Energy Laboratory (NREL). The development of the DRF includes three main phases: 1) a learning phase involving stakeholder engagement and literature review to synthesize metrics of community readiness to advance through an energy transition and to understand the state of the research and practice of participatory science-policy processes in various sectors, 2) a design phase to define readiness approaches and tools that will be developed as part of the DRF, and 3) an implementation phase to create the applications and interfaces for WPTO and the national laboratories to interact with the DRF. All three phases include close collaboration with communities and end-users of the framework, first to identify gaps in the science and tools needed to achieve community-driven energy transition goals and second, to test and improve the framework iteratively. Through technical assistance programs like ETIPP and utilizing the completed DRF to understand the influencing factors which motivate or deter energy transitions, WPTO hopes to engage a number of near-term marine energy demonstration opportunities. Here we report on the results from the literature review (Subtask 1.1) to inform the stakeholder engagement (Subtask 1.2) and design phase (Task 2) of the project.