An Intro to HPC @ LANL [Slides]
The presentation describes High Performance Computing (HPC) at Los Alamos National Laboratory.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “High performance Computing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Surface 3D Electrical Resistivity Tomography Inversion of 2005 BC Cribs and Trenches Datasets
Hydrogeophysics, Inc. (HGI) conducted an electrical resistivity tomography (ERT) dataset at the BC Cribs and Trenches site, located in the Central Plateau of the Hanford Site. The 20 trenches and 6 cribs received large volumes of liquid inorganic waste in the 1950s, resulting in a large inventory of contaminants in the vadose zone. The objective of the ERT survey was to map plume extents resulting from the legacy discharges. The HGI interpretation of the resistivity data was performed using geometric inversion to interpolate 2D lines into a 3D image. To demonstrate a newly developed geophysical code capability (E4D), the resistivity data were re-processed to fit a full 3D model of the bulk electrical conductivity. This proof-of-concept model inversion was executed in calendar year 2011, as the large dataset was well-suited for the use of high-performance computing. The 3D re-processing of the BC Cribs and Trenches ERT data conducted in 2011 resolved the true bulk electrical conductivity. This means that all of the resistivity data were fit to a single model of the bulk electrical conductivity, with true horizontal and vertical dimensions. This differed from the HGI data interpretation approach that used geometric inversion to process 2D lines independently, which were then interpolated into a 3D image. Both the full 3D re-processing and the 2D interpolation to a 3D image demonstrated a higher electrical conductivity observed immediately beneath the trenches and cribs. The electrical conductivity is strongly correlated with nitrate concentrations, indicating the presence of nitrate and other co-located contaminants.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Open Reproducible Electron Microscopy Data Analysis
Electron microscopy (EM) is a cornerstone technique in the materials and biological sciences capable of imaging structures at nano- to atomic-scale resolution. Advances in technologies mean that one acquires datasets at increasing data rates and sizes. These advancements present enormous opportunities for researchers to understand complex systems. However, processing the resulting large-scale, complex data in a reproducible and shareable way is a real challenge for researchers. The building, managing, and maintaining complex workflows in a reproducible manner requires extensive knowledge in several areas outside the researchers’ core skill sets, such as software engineering, data science, and high-performance computing (HPC). Our work demonstrates an innovative approach to solving these problems, enabling reproducible EM data analysis through container encapsulated pipelines. Using modern container technologies, we encapsulate processing elements and connect them using shared memory. We expose user-friendly, advanced algorithms and tools to allow end users to utilize without expert programming skills. The platform enables reproducible, scalable, shareable pipelines for the analysis and visualization of EM data. Focusing on interoperability, we leverage the DOE and other agencies’ existing investments to provide a powerful software platform for EM data analysis.
Harris, Christopher↗
ERAS: Enabling the Integration of Real-World Intellectual Properties (IPs) in Architectural Simulators
Sandia National Laboratories is investigating scalable architectural simulation capabilities with a focus on simulating and evaluating highly scalable supercomputers for high performance computing applications. There is a growing demand for RTL model integration to provide the capability to simulate customized node architectures and heterogeneous systems. This report describes the first steps integrating the ESSENTial Signal Simulation Enabled by Netlist Transforms (ESSENT) tool with the Structural Simulation Toolkit (SST). ESSENT can emit C++ models from models written in FIRRTL to automatically generate components. The integration workflow will automatically generate the SST component and necessary interfaces to ’plug’ the ESSENT model into the SST framework.
97 MATHEMATICS AND COMPUTING↗
Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) for Transportation Hubs (Final Report)
This report summarizes the work performed under the award number EE0008524. The project develops the Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) platform as the next-generation transportation solution based on autonomous electric vehicles (AEV) serving passenger trips from and to urban transportation hubs, to substantially reduce transportation energy consumption. Extensive data collection and analyses were first conducted to understand the demand patterns and energy consumption of hub-based on-road trips. Then, a data-driven framework that consists of an analytical module and a simulation module was proposed. For the analytical module, five planning + operation tools were developed to support the planning and energy-efficient operations of urban AEV services: the charging station planning that robotically allocates charging supplies based on the stationary charging demand distribution; the transit planning and demand adaptive scheduling model that efficiently generates\ candidate transit routes from hubs to other places and dynamically adjusts the transit time table to fit the current demand; the online energy-efficient routing that learns the energy-optimal paths from observations of link-level energy consumption in real-time; the hub-based ridesharing that matches trip requests together with account for the uncertainty of future trip demand and vehicle supply; and finally, the integrated demand prediction and anomaly detection pipeline that leverages the flight/train time table and support other planning/operation tools. To demonstrate the performance of these tools, a scalable high-performance agent-based simulator was built. We divided the urban space into multiple service zones where each zone was considered as an agent for passenger generation and vehicle charging. Two types of AEV agents were coded to model two types of mobility services: AEV taxi and AEV transit. For the AEV taxi, the team implemented the functions of pickup/drop-off passengers, energy-efficient routing, ridesharing, fleet rebalancing, and recharging. For the AEV bus, the team implemented the functions of demand-adaptive route scheduling, passenger boarding, and recharging. A high-performance computing framework was introduced to receive various profiling information (such as link energy updates, vehicle speed) from the simulator instances and communicate the operational commands back to the instances. The numerical experiments show that each of the proposed operational algorithms can reduce energy consumption and improve system efficiency. Furthermore, there exists the need to collectively consider multiple planning + operational strategies as multiple strategies can influence each other in terms of performance impacts. Recommendations for future work related to AEV planning and simulation are discussed.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Exotanium DOE SBIR Phase I Results Summary
Exotanium demonstrated this technology with the Idaho National Laboratory’s MASTODON application, a Multiphysics environment designed to run typical high-performance computing (HPC) simulations for structural dynamics, seismic analysis, and risk assessment. The MASTODON application was packaged into a container using Docker, Deployed on Amazon ECS, and managed through a custom Scale-Out Compute on AWS (SOCA) implementation.
97 MATHEMATICS AND COMPUTING↗
Associate Laboratory Directorate for Weapon Physics (ALDX) [Slides]
ALDX is one of seven technical Directorates at the Laboratory and resides within the Weapons Program. The Weapons Physics Directorate stewards a number of critical capabilities to meet its mission. Our mission is to sustain the resilience of the US nuclear stockpile and help shape a globalized nuclear world. Sustaining the aging stockpile poses scientific challenges to assess and certify the stockpile without testing. We are helping to solve major technical challenges in the nuclear global security regime. Geopolitical realities demand the Laboratory’s excellence in providing solutions to national security problems. High Performance Computing at Los Alamos opens the doors to many sophisticated modeling techniques. We use many experimental facilities to probe weapons physics. The diverse skill set required to execute ALDX’s mission has benefited greatly from the Postdoc program.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
Userspace Squash Filesystem for Launching Linux Containers on HPC Systems [Thesis]
The demand for user defined software stacks (UDSS) has been increasing in the high-performance computing (HPC) community. Container technology has become popular due to the flexibility and isolation it provides to HPC users. Container images must be available to all nodes involved for use in HPC and can be distributed to compute nodes in a variety of ways. A common method for container image distribution is to simply copy the container image to memory on each compute node, which can be time consuming at scale, and uses valuable memory on each node. The kernel mounted squash filesystem (squashfs) has proven fast and efficient for this task but requires root-level access. This paper will show a user space mounted squashfs is an efficient and secure solution for container image distribution.
97 MATHEMATICS AND COMPUTING↗
Modeling Astrophysical Explosions and Nucleosynthesis (Final Technical Report)
The goal of this project was to further our theoretical understanding of the extreme physics and heavy element nucleosynthesis occurring in stellar explosions, in particular supernovae and neutron star mergers. To study these systems, we further developed and applied numerical simulations (radiation hydrodynamical models and nuclear reaction networks) run on high performance computers. The numerical calculations and companion theoretical analysis helped to better define the sites of astrophysical nucleosynthesis, and make predictions of the associated observables (nucleosynthetic yields and electromagnetic signals) that can be used to anticipate and interpret experimental data. This project enhances the scientific value of the nuclear data obtained from current and future experimental facilities (e.g., rare isotope beams) by improving our understanding of the astrophysical context and specific physical conditions under which we expect such reactions to take place in Nature.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Predictive Tools for Customizing Heat Treatment of Additively Manufactured Aerospace Components
Laser-bed powder fusion (LBPF) additive manufacturing is increasingly being used to produce components of complex geometries using the Ni-base superalloy Inconel 718. The composition and the microstructure of the alloy are currently well optimized for wrought components made using conventional manufacturing processes such as rolling, forging, extrusion, etc. The attractive mechanical properties of the alloy result from the underlying austenitic matrix with fine equiaxed grains, and a high density and uniform distribution of the precipitation hardening phase, γ". Heat treatment steps such as homogenization, solutioning and aging are well documented for the wrought alloy. However, when the same wrought alloy compositions are used for the additive manufacturing (AM) processes, the asprocessed microstructure is significantly different, because of the different thermal history associated with LBPF, including rapid solidification and multiple temperature excursions that lead to multiple re-melting and reheating in the solid state. Rapid solidification introduces potential non-equilibrium effects at the moving solid-liquid interfaces that impact the extent of solute segregation, as well as the morphology of the dendritic grains that form. In order to recover the target mechanical properties, AM components have to undergo post-process heat treatments. However, such heat treatments have to be custom designed for the AM process and the component geometry because of the expected vast differences in the microstructure at various locations of a component with complex geometry. The homogenization and precipitation steps should be optimized for the component so that target mechanical properties can be obtained throughout the part. The objective of this research is to utilize High Performance Computing in phase field simulations of microstructure evolution during post-processing of AM components. The physics-based modeling will be beneficial in reducing the experimental effort required for heat treatment process selection, optimization, and certification, thus leading to a significant reduction in energy consumption for AM and post-processing heat treatment. The optimization study will help identify heat treatments steps that are critical for development of a final desired microstructure with the minimum energy input. This combined with shortening of the production cycle (time-to-market) by reducing the number of failed parts (property targets), and reduction in the number of iterations for process optimization, will enable 30-40% savings in the energy costs. Phase field simulations of the degree of homogenization and the effect of local matrix composition on the nucleation and growth of competing precipitating phases were performed using the Microstructure Evolution Using Massively Parallel Phase Field Simulations code developed in-house at the Oak Ridge National Laboratory. The simulations were able to successfully capture the kinetics of nucleation and growth, and morphologies of various precipitating phases as a function of local matrix compositions and composition gradients characteristic of local microstructures arising from location-dependent variations in the thermal conditions. Future work will involve extending the simulations to a length scale consisting of multiple dendrites, so that the effect of homogenization on the coarsening of the dendrites can be simulated and used as an additional input to the optimization of the heat treatment process.
36 MATERIALS SCIENCE↗
2021 GeoAI Workshop Report: The Trillion Pixel Challenge
The convergence of geospatial big data with advancements from artificial intelligence, cloud infrastructure, and high-performance computing continues to revolutionize mapping and analysis of Earth's surface in unprecedented detail. Rapid innovations in sensing technologies will soon collect geospatial data in even higher resolution and throughput. These developments offer the potential for breakthroughs in science, policy, and national security via end-to-end GeoAI systems that can provide fresh insights into how humans occupy and alter their environment over time. At the 2021 GeoAI Trillion Pixel workshop, international subject matter experts from government, academia, industry, and nonprofit organizations gathered virtually to discuss the Trillion Pixel GeoAI Challenge. The event focused on six major themes currently influencing scientific innovation and breakthroughs. Particular focus was paid to societal impacts. As an additional takeaway message, the gathering identified remaining application gaps and challenges that are in need of stronger community partnerships and collaborations.
58 GEOSCIENCES↗
Finding Electronic Structure Machine Learning Surrogates without Training
A myriad of phenomena in materials science and chemistry rely on quantum-level simulations of the electronic structure in matter. While moving to larger length and time scales has been a pressing issue for decades, such large-scale electronic structure calculations are still challenging despite modern software approaches and advances in high-performance computing. The silver lining in this regard is the use of machine learning to accelerate electronic structure calculations – this line of research has recently gained growing attention. The grand challenge therein is finding a suitable machine-learning model during a process called hyperparameter optimization. This, however, causes a massive computational overhead in addition to that of data generation. We accelerate the construction of machine-learning surrogate models by roughly two orders of magnitude by circumventing excessive training during the hyperparameter optimization phase. We demonstrate our workflow for Kohn-Sham density functional theory, the most popular computational method in materials science and chemistry.
36 MATERIALS SCIENCE↗
Coupled TD Simulation project (Final Report)
This project implements coupled simulation of electric power grid transmission and distribution (T&D) by instantiating the co-simulation platform HELICS using a commercial distribution planning software CYMDIST1 by Eaton Inc., a power management company, and by leveraging the open-source transmission grid simulator GridDyn and LLNL’s High Performance Computing (HPC). The project is funded by DOE’s Technology Commercialization Funding (TCF) and supported by DOE Office of Technology Transitions (OTT).
14 SOLAR ENERGY↗
The Status and Ambitions of the US Heavy Element Program
The aim of this whitepaper is to highlight the current capabilities and priorities of the US Heavy Element community and to provide the framework for a coordinated advancement of nuclear science from these studies. This is an organized effort to reflect on what has been achieved in the field given the recommendations and initiatives of the 2015 NSAC Long Range Plan, and on what can be realized in the next decade given current and possibly expanded investments. Current investments have positioned the US community to be among the world leaders in studies of the nuclear and chemical properties of the heaviest elements. These include studies of reaction mechanisms, moving us ever closer to the “island of stability”, in spectroscopy, allowing us to better understand nuclear structure at these extreme proton numbers, in chemical behavior, looking to determine how these elements should be placed on the Periodic Table, in performing the first measurements where isotopes are directly identified by their mass numbers, and in laying the foundation for a potential US-led new element discovery experiment. At present, the highest priority of the US Heavy Element community is to capitalize on the current investments by supporting the operations of US facilities at optimal values. These facilities include the Argonne Tandem Linac Accelerator System at Argonne National Laboratory and other Department of Energy facilities such as the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory, which has a dedicated superheavy element program, as well as university laboratories, including Texas A&M University. The High Flux Isotope Reactor at Oak Ridge National Laboratory is crucial to providing the radioactive isotopes required for heavy element science targets. This facility should be supported to provide the actinide materials that are essential for US-based science. Production of stable, rare isotopes for beam material, including 48 Ca, 50 Ti, 54 Cr and 58 Fe, at the Stable Isotope Production and Research Center is critical to continued research in heavy element science and should be a priority. The continued development of targets for heavy element science and retaining US-based expertise is critical for the heavy element community. This is an area that is currently under pressure. For example, the target laboratory at Argonne National Laboratory serves a broad community and is currently under threat due to loss of critical personnel. The skills needed to make targets for nuclear science and develop new targetry methods need to be supported long term at Argonne, Oak Ridge and Lawrence Livermore National Laboratories as well as maintaining the programs at Oregon State University and San José State University as vital pipelines for training students. Advances in theory are the foundation to understand how nuclei behave and to predict those behaviors in new circumstances. Progress in these studies will necessitate continued and new investment and access to high-performance computing. The future health of the heavy element field is dependent on the continuous support of talented early-career professionals at all levels. It is critical that opportunities continue to be created for the next generation to become established in heavy element research so that we can ensure the field is attracting and retaining the best minds for continued success. It is also clear that to ensure diversity of ideas, perspectives and techniques, we need to recruit diverse personnel that are trained at the best facilities. The heavy element community is in support of continued investment to programs with initiatives in diversity, equity, and inclusion. Looking to the next decade of research, support needs to maintain and grow US leadership in heavy element science. Specifically, new investments in state-of-the-art instrumentation will be essential to scientific development of the field and in expanding scientific knowledge. Advances in the next generation of electron cyclotron resonance ion sources, multi-reflection time-of-flight devices, laser spectroscopy, trapping methods and next generation alpha and gamma spectroscopy systems should be prioritized.
38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
CALORIE: A Constraint Language and Optimizing Runtime for Exascale Power Management (Final Report)
This final technical report summarizes the key accomplishments on the CALORIE project, a DOE Early Career award received by PI Henry Hoffmann at the University of Chicago. CALORIE’s main goal was to create principled methodologies, tools, and practices to help scientists and high-performance computing (HPC) operators maximize the performance and insights obtained from scientific computing applications in the face of exascale power constraints. The project accomplished these goals by completing the following objectives: • Designing a language for describing application goals (including constraints and objectives) and system capabilities. The application goals will include things like which simulations or simulations plus in situ analysis will be run together, what the power constraints are, and what requirements there are for in situ analysis (for example, a desired frame rate for visualization). The system capabilities include all components that can be adjusted to tradeoff power and performance. • Designing a runtime system that takes specified goals and capabilities and dynamically determines what capabilities to use to meet the goals. This runtime adapts to changes in goals, application behavior, or available capabilities to automatically maintain the goals despite unexpected disturbances. • Developing a foundational understanding of how power constraints affect the problem of scheduling applications in large-scale systems. This report provides an overview of the accomplishments related to each of these key objectives.
97 MATHEMATICS AND COMPUTING↗
HPC for Fission Modeling in Support of Nuclear Data [Slides]
The presentation discusses the background of the High-Performance Computing (HPC) division at the Los Alamos National Laboratory (LANL), with emphasis on its computational needs and computational techniques. It also discusses the highlights of the HPC and the results of calculations, including energy sharing parameterized from DFT calculations, parameterization used in CGMF calculations, angular momentum from microscopic calculations, and correlations between FF angular momenta. The presentation concludes with an outlook including what remains to be done in the HPC division and how it will benefit nuclear data, specifically how it will provide a better understanding of the fission process.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Fluoride-Cooled High-Temperature Pebble-Bed Reactor Reference Plant Model
In this report we present work performed in Fiscal Year 2022 that demonstrates the modeling and simulation of a fully coupled neutronics thermal hydraulics reference plant model for a fluoride-cooled high-temperature pebble-bed reactor. The multiphysics model is developed on the Nuclear Regulatory Commission’s Comprehensive Reactor Analysis Bundle (BlueCRAB) available on the Idaho National Laboratory’s high-performance computer, which natively and seamlessly couples Griffin, Pronghorn, and the BISON Multiphysics Object-Oriented Simulation Environment based applications. Griffin provides reactor physics capabilities, including depletion to the equilibrium core, k-eigenvalue, adjoint, and transient. The unique direct equilibrium core capability in Griffin is based on a streamline methodology to spatially deplete the pebbles into burnup groups. Pronghorn solves the porous medium equations for the fluid regions and conduction in the solid regions and incorporates a fluidic diode model to simulate the transition from forced to natural convection during accident scenarios. MOOSE modules solves thermal conduction problems for the pebbles and tristructural isotropic in the pebble-bed core, thus providing the fuel and moderator spatial fields for each pebble burnup group. The neutronics feedback relies primarily on fuel, moderator, and reflector temperatures as as well as the FLiBe salt density. Here, we present results for the uncoupled equilibrium core and perform comparisons to equivalent Monte Carlo models. The power distributions and kinetic parameters obtained with Griffin are consistent with those computed with Griffin. We demonstrate a noticeable improvement with the use of discrete ordinates method (SN) transport. The coupled steady-state equilibrium core provides the initial condition for two time-dependent problems: a control rod withdrawal event and an unprotected loss of flow event. In both cases, the reactor design is self-stabilizing and the solutions are consistent with the expected physics. Although this model is prototypical regarding BlueCRAB’s capabilities, its results are consistent with published work by Kairos Power and other research entities. Significant improvements to the model are planned in future work.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
A Hardware and Software Co-design Framework for Energy Efficient Neuromorphic Systems
Neuromorphic systems can be realized by a variety of algorithms and architectures. A common understanding is that spiking neuromorphic designs, which encode information into spatio-temporal spiking events, are both a biologically-accurate and efficient way of processing information. However, representing the information through timing relationships induces sophisticated circuit designs in traditional CMOS-based implementations. In recent years, high-capacity resistive memory (RRAM, aka, memristor) has demonstrated great potential in mimicking synaptic behaviors. Several RRAM-based spiking neuromorphic designs exist, most of which focus on rate coding schemes. These designs simplify circuit implementations of neuron models and explore challenges such as unsatisfactory speed, resolution, and performance. As an alternative, we will explore temporal coding spiking neuromorphic systems that encode information as the relative timing of neuron activations (spikes), which have been proven to be more adaptive and energy-efficient. Developing a neuromorphic system for spiking neural network (SNN) inference and online training, however, faces some major technical challenges: (1) It lacks circuit implementation support for temporal-coding SNN to achieve satisfying power efficiency and accuracy; (2) Although existing research works have investigated memristive synapse and neuron designs for spike-timing-dependent plasticity, the non-ideal conditions in implementation, such as device variations and signal degradation, degrade online learning accuracy of large scale systems; and (3) Non-optimized, inter-layer data traffic in SNNs, leads to unnecessary data communication costs. In this project, we plan to address these challenges by a hardware and software co-design framework that incorporates solutions at the circuit, architecture, and algorithm levels. At the circuit-level, we will elaborate on the in-situ SNN processing element designs for supporting both inference and online training modes. Variation-aware schemes will be studied to improve reliability. At the architecture level, we propose a pipelined, asynchronous architecture to retain the timing resolution of spikes. At the algorithm level, we will investigate an innovative SNN training algorithm for enabling activation sparsification and reducing unnecessary data communication costs. This neuromorphic system will provide an effective solution to real-life energy-constrained applications and significantly contribute to the exploration of next-generation high-performance computing systems under the DOE context.
97 MATHEMATICS AND COMPUTING↗