y0-causal-inference/y0
❓y0 (pronounced "why not?") is for causal inference in Python: a software library intended to support the scientific discovery process.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
❓y0 (pronounced "why not?") is for causal inference in Python: a software library intended to support the scientific discovery process.
We develop a generalizable AI-driven workflow that leverages heterogeneous HPC resources to explore the time-dependent dynamics of molecular systems. We use this workflow to investigate the mechanisms of infectivity of the SARS-CoV-2 spike protein, the main viral infection machinery. Our workflow enables more efficient investigation of spike dynamics in a variety of complex environments, including within a complete SARS-CoV-2 viral envelope simulation, which contains 305 million atoms and shows strong scaling on ORNL Summit using NAMD. We present several novel scientific discoveries, including the elucidation of the spike’s full glycan shield, the role of spike glycans in modulating the infectivity of the virus, and the characterization of the flexible interactions between the spike and the human ACE2 receptor. We also demonstrate how AI can accelerate conformational sampling across different systems and pave the way for the future application of such methods to additional studies in SARS-CoV-2 and other molecular systems.
Combinatorial algorithms in general and graph algorithms in particular play a critical enabling role in numerous scientific applications. However, the irregular memory access nature of these algorithms makes them one of the hardest algorithmic kernels to implement on parallel systems. With tens of billions of hardware threads and deep memory hierarchies, the exascale computing systems in particular pose extreme challenges in scaling graph algorithms. The codesign center on combinatorial algorithms, ExaGraph, was established to design and develop methods and techniques for efficient implementation of key combinatorial (graph) algorithms chosen from a diverse set of exascale applications. Algebraic and combinatorial methods have a complementary role in the advancement of computational science and engineering, including playing an enabling role on each other. In this paper, we survey the algorithmic and software development activities performed under the auspices of ExaGraph from both a combinatorial and an algebraic perspective. In particular, we detail our recent efforts in porting the algorithms to manycore accelerator (GPU) architectures. We also provide a brief survey of the applications that have benefited from the scalable implementations of different combinatorial algorithms to enable scientific discovery at scale. We believe that several applications will benefit from the algorithmic and software tools developed by the ExaGraph team.
We report rapid growth in data, computational methods, and computing power is driving a remarkable revolution in what variously is termed machine learning (ML), statistical learning, computational learning, and artificial intelligence. In addition to highly visible successes in machine-based natural language translation, playing the game Go, and self-driving cars, these new technologies also have profound implications for computational and experimental science and engineering, as well as for the exascale computing systems that the Department of Energy (DOE) is developing to support those disciplines. Not only do these learning technologies open up exciting opportunities for scientific discovery on exascale systems, they also appear poised to have important implications for the design and use of exascale computers themselves, including high-performance computing (HPC) for ML and ML for HPC. The overarching goal of the ExaLearn co-design project is to provide exascale ML software for use by Exascale Computing Project (ECP) applications, other ECP co-design centers, and DOE experimental facilities and leadership class computing facilities.
The VTK-m software library enables scientific visualization on exascale-class supercomputers. Exascale machines are particularly challenging for software development in part because they use GPU accelerators to provide the vast majority of their computational throughput. Algorithmic designs for GPUs and GPU-centric computing often deviate from those that worked well on previous generations of high-performance computers that relied on traditional CPUs. Fortunately, VTK-m provides scientific visualization algorithms for GPUs and other accelerators. VTK-m also provides a framework that simplifies the implementation of new algorithms and adds a porting layer to work across multiple processor types. This paper describes the main challenges encountered when making scientific visualization available at exascale. Here, we document the surprises and obstacles faced when moving from pre-exascale platforms to the final exascale designs and the performance on those systems including scaling studies on Frontier, an exascale machine with over 37,000 AMD GPUs. We also report on the integration of VTK-m with other exascale software technologies. Finally, we show how VTK-m helps scientific discovery for applications such as fusion and particle acceleration that leverage an exascale supercomputer.
The advent of exascale supercomputers heralds a new era of scientific discovery, yet it introduces significant architectural challenges that must be overcome for MPI applications to fully exploit its potential. Among these challenges is the adoption of heterogeneous architectures, particularly the integration of GPUs to accelerate computation. Additionally, the complexity of multithreaded programming models has also become a critical factor in achieving performance at scale. The efficient utilization of hardware acceleration for communication, provided by modern NICs, is also essential for achieving low latency and high throughput communication in such complex systems. In response to these challenges, the MPICH library, a high-performance and widely used Message Passing Interface (MPI) implementation, has undergone significant enhancements. Here, this paper presents four major contributions that prepare MPICH for the exascale transition. First, we describe a lightweight communication stack that leverages the advanced features of modern NICs to maximize hardware acceleration. Second, our work showcases a highly scalable multithreaded communication model that addresses the complexities of concurrent environments. Third, we introduce GPU-aware communication capabilities that optimize data movement in GPU-integrated systems. Finally, we present a new datatype engine aimed at accelerating the use of MPI derived datatypes on GPUs. These improvements in the MPICH library not only address the immediate needs of exascale computing architectures but also set a foundation for exploiting future innovations in high-performance computing. By embracing these new designs and approaches, MPICH-derived libraries from HPE Cray and Intel were able to achieve real exascale performance on OLCF Frontier and ALCF Aurora respectively.
Exascale computers offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. However, these software combinations and integrations are difficult to achieve due to the challenges of coordinating and deploying heterogeneous software components on diverse and massive platforms. Here, we present the ExaWorks project, which addresses many of these challenges. We developed a workflow Software Development Toolkit (SDK), a curated collection of workflow technologies that can be composed and interoperated through a common interface, engineered following current best practices, and specifically designed to work on HPC platforms. ExaWorks also developed PSI/J, a job management abstraction API, to simplify the construction of portable software components and applications that can be used over various HPC schedulers. The PSI/J API is a minimal interface for submitting and monitoring jobs and their execution state across multiple and commonly used HPC schedulers. We also describe several leading and innovative workflow examples of ExaWorks tools used on DOE leadership platforms. Furthermore, we discuss how our project is working with the workflow community, large computing facilities, and HPC platform vendors to address the requirements of workflows sustainably at the exascale.
During the past few years, distributed acoustic sensing (DAS) has become an invaluable tool for recording high-fidelity seismic wavefields with great spatiotemporal resolutions. However, the considerable amount of data generated during DAS experiments limits their distribution with the broader scientific community. Such a bottleneck inherently slows down the pursuit of new scientific discoveries in geosciences. Here, we introduce PubDAS—the first large-scale open-source repository where several DAS datasets from multiple experiments are publicly shared. PubDAS currently hosts eight datasets covering a variety of geological settings (e.g., urban centers, underground mines, and seafloor), spanning from several days to several years, offering both continuous and triggered active source recordings, and totaling up to ~90 TB of data. Here this article describes these datasets, their metadata, and how to access and download them. Some of these datasets have only been shallowly explored, leaving the door open for new discoveries in Earth sciences and beyond.
The new generation of low beam intensity superconducting linacs will require high accelerating gradients for new scientific discoveries. The high accelerating gradient cavities in pulsed SRF linacs will experience large (~1000’s of Hz) detuning caused by Lorentz force detuning (LFD). The piezo actuators that will be used to compensate large LFD must operate at a nominal voltage of 120V to 150V to deliver the required stroke to the cavity. In this high voltage range, the piezo is expected to warm up drastically due to its location in an insulating vacuum environment. Overheating of the piezo will significantly decrease the longevity of the actuator. A collaboration between FNAL and Physik Instrumente (PI) developed a novel piezo actuator design that mitigates piezo overheating. The design consists of using a metal foam in contact with the piezoelectric ceramic stack for heat removal. The second solution used lithium niobite as an alternative material. A comparison of the temperature stability will be presented and discussed. This study characterizes the dielectric properties for both materials. The results obtained are in the temperature range of 10 K to 300 K.
As simulations generate ever-increasing amounts of data, there are correspondingly richer opportunities for analysis and scientific discovery - discoveries that will be missed if most of the data must be discarded before it is analyzed. Because future exascale architectures will be increasingly storage-limited, it will not be possible to save the vast majority of simulation data for later analysis, requiring analysis to occur “in-situ” within the simulation. However, existing in-situ data analysis frameworks provide little or no support for one of the most sophisticated forms of data science: probabilistic statistical modeling or uncertainty quantification (UQ), and the accompanying challenge of inference - fitting those statistical models to massive simulation output. Our goal is to develop the fundamental statistical algorithms and computer science needed to perform statistical inference in-situ (in HPC simulations) to the full stream of data those simulations generate.
Future high energy physics accelerators depend on a number of advanced technologies to open the many doors of scientific discovery. Among these advanced technologies, superconducting magnets and superconducting radio frequency (SRF) cavities are the backbone of the accelerator and detector systems. But all these low temperature systems depend critically on successful and reliable operation of their supporting technologies, among which the liquid helium cooling system is of the utmost importance. To improve the quality of these systems both in terms of efficiency and reliability, a robust helium cryogenics research and development (R&D) effort is required. The proposed research to be conducted by the FSU cryogenics group aims to produce fundamental knowledge that meets this R&D need. The projects that we have completed over the past grant period at Florida State University consist of experimental research on liquid helium fluid dynamics and heat transfer problems relevant to the development of future superconducting particle physics accelerators. Liquid helium is the coolant used in all such facilities and in many of these facilities He II (the low temperature phase of liquid helium also known as superfluid helium) is preferred due to its outstanding heat transfer characteristics. The work consists of two main experimental studies that probe both fundamental as well as practical aspects of liquid helium cooling. The first is a broad and fundamental study of the heat and mass transfer processes that can occur during a sudden catastrophic loss of vacuum (SCLV) incident in a superconducting accelerator. SCLV refers to the remote but extremely critical accident scenario where atmospheric pressure air is allowed to flood into the insulating vacuum system and impinge on the liquid helium cooled surfaces in the accelerator. Safe performance and recovery from such accidents is essential to the reliable operation of superconducting accelerators. The dynamics of this process is quite complex and so our approach is to conduct a series of well-orchestrated experiments that probe the various physical phenomena that can occur during an SCLV event. The experiments are coupled with analytic and numerical analysis in an effort to develop a general understanding of the process and to assist with future accelerator design and development. The second activity is directed toward fundamental understanding of heat and mass transfer in He II, which is essential to the design of superconducting magnets and radio frequency cavities in accelerators. The work consists of flow visualization of the dynamics of He II using laser assisted techniques. Two complementary techniques are used to study the fundamentals of the turbulent state. The first technique uses neutrally buoyant solid hydrogen particles to probe the flow fields of the superfluid and normal fluid components. The other technique uses laser excited He2* molecules as tracers of the normal fluid motion within the He II. The activities also included an effort to use visualization techniques to locate transient hot spots in radio frequency superconducting cavities. Such work provides valuable information about the heat transfer process in He II and its impact on the performance of superconducting devices. The research effort at Florida State University is not directly in support of a specific high energy physics experiment or facility. Rather, the work is general and coordinated with HEP accelerator laboratories to provide valuable insight that can assist with future accelerator development.
4D scanning transmission electron microscopy (STEM) is experiencing a revolution both in terms of data size, and data veracity, as are many other areas of experimental data acquisition. This presents enormous opportunities to make new scientific discoveries, but is also hamstrung by aging software that is no longer fit for purpose. Experimental data acquisition platforms must make the same investments in software infrastructure that the simulation community made decades ago to take advantage of high-performance computing (HPC) if they hope to realize the full potential of the latest advances made in detector technology. This requires rethinking the design and deployment of hardware, moving away from small, fixed commodity computing capabilities with closed interfaces to open, modular, scalable systems designed for parallelism and throughput. The technical approach will leverage best-in-class open source technologies, and develop new approaches strategically to build an open source platform for experimental data acquisition targeting high data rate electron microscopy. The project will develop a software platform that uses the power and performance of modern HPC resources to ingest the large volume of data produced by electron microscopes using direct electron detectors. A set of configurable pipelines will be used to enable the processing to be tailored to the problem being investigated with builtin visualization of data at interactive rates. This project will leverage investments made by the DOE and other agencies to provide a powerful software platform for the experimental data community working with most powerful electron microscopes, such as 4D STEM detectors. It will create a platform that serves as a reference for the community. Permissive open source licensing will make the platform available to all, with a simple deployment strategy offering the ability to keep data close to where it is generated. This advanced software platform will require customization for each deployment, creating opportunities for software services that are typically offered to extend open source software platforms.
This is the Final Technical Report for the cooperative agreement DE-FC02-05ER54814 titled “Reversed Field Pinch Research in MST” spanning the funding period 4/1/2005 to 12/14/2019. It summarizes key results from MST research, major publications and presentations, and the mentoring of graduate students and postdocs. The Madison Symmetric Torus (MST) is unique within the U.S. and world fusion plasma program. As one of just five operating reversed field pinch (RFP) experiments, and the only one in the U.S., MST has had an important role in advancing the fundamental understanding of the RFP plasma configuration. The MST research program targets topics that intersect with all three goals. While MST provides a unique opportunity to advance the science and fusion potential of the RFP, as a cousin to the tokamak and stellarator plasma configurations the RFP is a valuable partner in establishing validated predictive capability for fusion science more generally. Specific combinations of the major variables in toroidal confinement, like magnetic field strength, plasma current, and shaping, define the different configurations. By exploring adjacent regions in this major variable parameter space, the RFP exposes dependencies not otherwise accessible in the tokamak and stellarator. This diversity enlarges the arena for scientific discovery, both for fusion and plasma physics. The basic science emphasis for MST research has been the self-organizing behavior of RFP plasmas. This inspired MST’s participation in the NSF Physics Frontier Center for Magnetic Self-Organization in Laboratory and Astrophysical Plasmas (CMSO), which ran from 2004-2016 and motivated a substantial fraction of MST’s research goals and capabilities. By all measures the MST Program has been remarkably successful in publications, community engagement, and mentoring of young scientists. While the DOE-FES’s proof-of-principle program for the RFP now languishes through the cessation of this cooperative agreement, operation of MST continues as one of two devices included in the new Wisconsin Plasma Physics Laboratory (WiPPL) basic science user facility. The scope of present research for MST in WiPPL is narrowed to the basic science associated with the RFP magnetic configuration and the advancement of specific fusion topics, which now includes studies of disruptions in tokamak plasmas. The world’s effort in RFP fusion research continues, despite a lack of U.S. federal support to investigate the RFP configuration for fusion application, most notably through a major upgrade to the RFX-mod2 facility in Italy [1] and the recent construction of the KTX facility at USTC in China. First plasmas for RFX-mod2 are anticipated in 2021.
The US Department of Energy’s Oak Ridge National Laboratory (ORNL) is a leading institution in advanced materials, supercomputing, neutrons, and nuclear science. As a research laboratory managed by UT-Battelle, LLC for DOE, ORNL has national priorities in energy, security, and scientific discovery that necessitate facility improvements and expansions. DOE is also committed to environmental stewardship. The laboratory is located on the ~32,000-acre Oak Ridge Reservation (ORR), much of which is categorized as a National Environmental Research Park and a state Wildlife Management Area. DOE works with the Tennessee Wildlife Resources Agency (TWRA), Tennessee Department of Environment and Conservation (TDEC), US Fish and Wildlife Service (USFWS), US Department of Agriculture, and other agencies to serve as an effective steward of the ORR. Accordingly, project managers must conform to environmental regulations, agreements, and policies at the federal, state, and institutional levels. Per 40 CFR (Code of Federal Regulations) 1508.14, potential effects on research and science education on the National Environmental Research Park represent potential impacts of federal actions. Moreover, federal actions that affect the quantity and quality of hunting opportunities and deer reduction harvest on the Oak Ridge Wildlife Management Area must be considered whenever other aspects of the human environment (as defined by NEPA) are affected. The Spallation Neutron Source (SNS) is a premiere facility at ORNL that provides advanced capabilities in neutron scattering to promote new discoveries and research opportunities in material sciences, physics, chemistry, biological sciences, and others. A conceptual design for a Second Target Station (STS) has been in consideration for several years. The STS is intended to complement and enhance existing ORNL capabilities, notably research and exploration of complex materials. The proposed STS will involve development of existing natural areas on the ORR, which might contain sensitive resources that require mitigation or avoidance in accordance with existing policies and regulation. This report summarizes current knowledge of natural and cultural resources within the STS project area. At the time of this report, the proposed STS project consisted of an operations area comprising 55.4 acres (22.4 ha) and a total review area for potential construction comprising ~224 acres (90.6 ha). The review area is located primarily within forested natural areas of the ORR with minor development in the form of power-line rights-of-way and secondary/graveled roads (Figure 1). The primary goal was to evaluate potential effects on sensitive resources that might result from development of the STS. In addition to onthe-ground surveys during summer 2009 and fall 2019 to summer 2020 by ORNL Natural Resources Management Program and Aquatic Ecology Group staff, this report makes use of historical (pre-1995) and contemporary (1995 to present) data from additional confirmed sources (e.g., TDEC). Likewise, forest conditions were compiled primarily from a 2013 forest inventory effort for Forest Management Compartment 17 and supplemented with limited ground observations in 2019. The individuals who obtained and compiled the data that are presented here are familiar with and routinely assess sensitive resources on the ORR.
Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work presented here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end- to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.
Convective storms vertically transport water vapor and condensate from Earth’s surface to the upper troposphere. Life on Earth is fundamentally linked to this transport which determines the hydrological cycle, and the intensity of severe weather responsible for the destruction of life and property. Despite advances in high-resolution modeling and better observational capabilities, the scientific community continues to be confronted with knowledge gaps about convective storms that limit our predictive capabilities. The ongoing developments in the high-resolution Energy Exascale Earth System Model (E3SM), large eddy simulations, and AI-based analytics to evaluate uncertainties are expected to provide a comprehensive framework for new scientific discovery. The model-experiment (MODEX) approach suggests that the aforementioned advancements in model development and AI-based inference techniques should be complemented by similar advancements in the experimental (observational) side so that the former does not outstrip the ability of the latter to provide meaningful constraints. What are the recent advancements in observations that will provide the necessary leap forward in improving our predictive capabilities? To address this question, we propose a new experimental paradigm called Multisensor Agile Adaptive Sampling (MAAS) that capitalizes on advancements in communications (5G), computational resources (edge/fog computing), sensor capabilities, and machine learning (ML) and AI techniques (Kollias et al., 2020). The MAAS framework allows for the collection of higher spatiotemporal resolution and quality observations of convective storms than is traditionally possible. The MAAS framework is scalable and applicable to atmospheric observatories such as those operated by the Department of Energy (DoE) Atmospheric Radiation Measurement (ARM) facility.
EPOC uses the Deep Dive process to discuss and analyze current and planned science use cases and anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Questions crafted to explore this space include the following: 1) How, and where, will new data be analyzed and used? 2) How will the process of doing science change over the next 5–10 years? and 3) How will changes to the underlying hardware and software technologies influence scientific discovery? Deep Dives help ensure that key stakeholders have a common understanding of the issues and the actions that a campus or regional network may need to undertake to offer solutions. The EPOC team leads the effort and relies on collaboration with the hosting site or network, and other affiliated entities that participate in the process. EPOC organizes, convenes, executes, and shares the outcomes of the review with all stakeholders
Plants are important sources of energy and materials, and they collectively represent a critical component of Earth’s ecosystem. With increasing environmental stresses due to climate change and intensive agricultural practices, the need for resilient plants is greater than ever before. To secure plant resources for bioenergy, biomaterials, food, and ecosystem adaptation, a deeper understanding of the fundamental biology of plants at a cellular level is urgently needed. Plants contain a multitude of specialized cell types that compose tissues and organs. Pathogens often target specific cell types within plants, and the response of one cell to a particular stimulus is likely to be distinct from its neighbor because of underlying molecular and contextual differences. Understanding how these responses are distributed among cells, the main goal of single-cell approaches, will substantially enhance our ability to use targeted engineering for improving plant productivity and resilience. Furthermore, single-cell approaches are necessary to understand the interactions between plants and other ecosystem members such as fungi, bacteria, and archaea. Unlocking these gene-response mechanisms at a cellular level can improve our ability to adapt plants to environmental stresses, increasing their utility as feedstocks for biomaterials and bioenergy. Recent advances in high-throughput sequencing, mass spectrometry, microfluidics and miniaturization, artificial intelligence and machine learning, and bioinformatics have greatly improved our ability to detect and understand processes at a cellular level. In mammalian systems, single-cell transcriptomics has already led to many advances, such as newly identified cell types and cell-targeted treatment of diseases, and mass spectrometry-based single-cell proteomics has recently been demonstrated as a promising emerging technology. However, plant single-cell omics has lagged behind mammalian approaches due to the high cost of the technologies relative to available resources and to the innate biological features of plants, including the complexity of the cell wall and polyploidy. To better understand how single-cell methods could enable plant science, Lawrence Berkeley National Laboratory (Berkeley Lab) hosted a workshop on April 29, 2021, that brought together a diverse group of leaders in plant and/or single-cell biology. Attendees represented federal research programs and domestic and international academic institutions. During the workshop, three presenters described the current state of research in both experimental and computational approaches. While the focus of the workshop was on factors preventing plant biology researchers from fully adopting single-cell methodologies, workshop participants agreed that most barriers could be overcome with focused, strategic investment and coordinated efforts among institutions leading to significant scientific discoveries that would be difficult to obtain using more conventional technologies.