Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EXASCALE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Collective input/output under memory constraints

Compared with current high-performance computing (HPC) systems, exascale systems are expected to have much less memory per node, which can significantly reduce necessary collective input/output (I/O) performance. In this study, we introduce a memory-conscious collective I/O strategy that takes into account memory capacity and bandwidth constraints. The new strategy restricts aggregation data traffic within disjointed subgroups, coordinates I/O accesses in intranode and internode layers, and determines I/O aggregators at run time considering memory consumption among processes. We have prototyped the design and evaluated it with commonly used benchmarks to verify its potential. The evaluation results demonstrate that this strategy holds promise in mitigating the memory pressure, alleviating the contention for memory bandwidth, and improving the I/O performance for projected extreme-scale systems. Given the importance of supporting increasingly data-intensive workloads and projected memory constraints on increasingly larger scale HPC systems, this new memory-conscious collective I/O can have a significant positive impact on scientific discovery productivity.

collective input/output↗

Exploring versioned distributed arrays for resilience in scientific applications: Global view resilience

Exascale studies project reliability challenges for future HPC systems. We present the Global View Resilience (GVR) system, a library for portable resilience. GVR begins with a subset of the Global Arrays interface, and adds new capabilities to create versions, name versions, and compute on version data. Applications can focus versioning where and when it is most productive, and customize for each application structure independently. This control is portable, and its embedding in application source makes it natural to express and easy to maintain. The ability to name multiple versions and “partially materialize” them efficiently makes ambitious forward-recovery based on “data slices” across versions or data structures both easy to express and efficient. Using several large applications (OpenMC, preconditioned conjugate gradient (PCG) solver, ddcMD, and Chombo), we evaluate the programming effort to add resilience. The required changes are small (< 2% lines of code (LOC)), localized and machine-independent, and perhaps most important, require no software architecture changes. We also measure the overhead of adding GVR versioning and show that overheads < 2% are generally achieved. This overhead suggests that GVR can be implemented in large-scale codes and support portable error recovery with modest investment and runtime impact. Our results are drawn from both IBM BG/Q and Cray XC30 experiments, demonstrating portability. We also present two case studies of flexible error recovery, illustrating how GVR can be used for multi-version rollback recovery, and several different forward-recovery schemes. GVR’s multi-version enables applications to survive latent errors (silent data corruption) with significant detection latency, and forward recovery can make that recovery extremely efficient. Lastly, our results suggest that GVR is scalable, portable, and efficient. GVR interfaces are flexible, supporting a variety of recovery schemes, and altogether GVR embodies a gentle-slope path to tolerate growing error rates in future extreme-scale systems.

97 MATHEMATICS AND COMPUTING↗

ELM-Wet: Inclusion of a wetland landunit with sub-grid representation of eco-hydrological patches and hydrological forcing in E3SM Land Model (ELM)

Wetlands emit the most biogenic methane (CH4) and present the greatest uncertainty in the global CH4 budget. Modeling these emissions is challenging due to the temporal and spatial variability in wetland structure and CH4 flux rates, along with complex interactions among hydrological, ecological, meteorological, and microbial processes that govern CH4 dynamics. To address these issues, we aim to enhance the accuracy of wetland representation in the U.S. Department of Energy’s Exascale Earth System Model (E3SM) Land Model, ELM. This effort led to the development of ELM-Wet, which incorporates a dedicated wetland landunit with subgrid representation of eco-hydrological patch types. We implement wetland-specific hydrology by imposing site-specific constraints on surface water levels, thereby allowing different patches to sustain varying depths of inundation. Additionally, we refined the calculation of aerenchyma transport diffusivity based on observed conductance across different vegetation types. We validated these enhancements through site-specific simulations of a coastal freshwater wetland, the Salvador WMA Freshwater Marsh (Ameriflux, site ID US-LA2), located in the coast of Louisiana (29.85N,90.29W) at an elevation of 0 m. The site was simulated with ELM-Wet and the default version ELMv1. We use Bayesian Optimization to parameterize CO2 and CH4 fluxes. Eddy covariance observations of CO2 and CH4 fluxes from 2012-2013 were used to train the model and data from 2021 were used for validation. In this repository, we include all the output of all the simulations performed using different versions of ELMv1 and ELM-Wet, all input required to the model, and the Matlab scripts we used to processed the output data. ELM-Wet_flmd.csv includes a detailed description of the datasets files.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with a manuscript analyzing ELM-FATES parameter sensitivity under pre-fire and postfire scenarios using machine learning

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “Fire Severity-Dependent Shifts in Vegetation Parameter Sensitivity: A Pre- and Post-Fire Analysis Using ELM-FATES and Explainable AI” submitted to Journal of Advances in Modeling Earth Systems (Zahura et al. 2026). The study examines vegetation physiological parameters controlling pre-fire and post-fire vegetation dynamics. To support this analysis, 73 vegetation parameters in Functionally Assembled Terrestrial Ecosystem Simulator (FATES) (Fisher et al., 2018) , which is coupled with E3SM (Energy Exascale Earth System Model) land model (ELM, ELM-FATES), were perturbed using a Sobol sequence to generate 1,024 ensemble members for two plant functional types: needleleaf evergreen extratropical trees (NEET) and C3 grass. Simulations were conducted for the pre-fire period (2016) and post-fire period (2018–2023). Burn severity was represented by modifying the Nesterov index in FATES to 75,000, 150,000, and 300,000 for low, moderate, and high severity, respectively. A no-fire scenario was also included. Simulations were performed for 16 grid cells in the American River Watershed across different burn severities and plant functional types. XGBoost (eXtreme Gradient Boosting) models were trained using the parameter ensembles and ELM-FATES-simulated outputs, including leaf area index (LAI), gross primary productivity (GPP), aboveground biomass, vegetation evaporation, transpiration, and soil evaporation. Models were trained separately for each year and burn severity, followed by SHAP (SHapley Additive exPlanations) analysis to identify changes in dominant parameters after fire disturbance. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. The data package contains the ELM-FATES simulation data. The scripts and data related to the analysis will be added later. The inputs and outputs from ELM-FATES are inside the “FATES” folder. “FATES_domain_surface” contains the domain and surface netcdfs that were used to run ELM-FATES in the study area. “FATES_parameters” contains the 1024 ensembles that were generated using Sobol sequence. “FATES_outputs” folder contains ELM-FATES simulated variables. All files are .csv and .nc (NetCDF).

Aboveground biomass↗

Traileka Glacier X-Stack. Final Scientific/Technical Report

The XStack Traleika Glacier (XSTG) project was a three-year research award for exploring a revolutionary exascale-class machine software framework. The XSTG program, including Intel, UC San Diego, Pacific Northwest National Lab, UIUC, Rice University, Reservoir Labs, ET International, and U. Delaware, had major accomplishments, insights, and products resulting from this three-year effort.

42 ENGINEERING↗

Profiling and Improving I/O Performance of a Large-Scale Climate Scientific Application

Exascale computing systems are soon to emerge, which will pose great challenges on the huge gap between computing and I/O performance. Many large-scale scientific applications play an important role in our daily life. The huge amounts of data generated by such applications require highly parallel and efficient I/O management policies. In this paper, we adopt a mission-critical scientific application, GEOS-5, as a case to profile and analyze the communication and I/O issues that are preventing applications from fully utilizing the underlying parallel storage systems. Through in-detail architectural and experimental characterization, we observe that current legacy I/O schemes incur significant network communication overheads and are unable to fully parallelize the data access, thus degrading applications' I/O performance and scalability. To address these inefficiencies, we redesign its I/O framework along with a set of parallel I/O techniques to achieve high scalability and performance. Evaluation results on the NASA discover cluster show that our optimization of GEOS-5 with ADIOS has led to significant performance improvements compared to the original GEOS-5 implementation.

Exascale↗

Havens: Explicit Reliable Memory Regions for HPC Applications

Supporting error resilience in future exascale-class supercomputing systems is a critical challenge. Due to transistor scaling trends and increasing memory density, scientific simulations are expected to experience more interruptions caused by transient errors in the system memory. Existing hardware-based detection and recovery techniques will be inadequate to manage the presence of high memory fault rates. In this paper we propose a partial memory protection scheme based on region-based memory management. We define the concept of regions called havens that provide fault protection for program objects. We provide reliability for the regions through a software-based parity protection mechanism. Our approach enables critical program objects to be placed in these havens. The fault coverage provided by our approach is application agnostic, unlike algorithm-based fault tolerance techniques.

exascale computing↗

Large-Scale Simulation of Nuclear Reactors: Issues and Perspectives

Numerical simulation has been an intrinsic part of nuclear engineering research since its inception. In recent years a transition is occurring toward predictive, first-principle-based tools such as computational fluid dynamics. Even with the advent of petascale computing, however, such tools still have significant limitations. In the present work some of these issues, and in particular the presence of massive multiscale separation, are discussed, as well as some of the research conducted to mitigate them. Petascale simulations at high fidelity (large eddy simulation/direct numerical simulation) were conducted with the massively parallel spectral element code Nek5000 on a series of representative problems. These simulations shed light on the requirements of several types of simulation: (1) axial flow around fuel rods, with particular attention to wall effects; (2) natural convection in the primary vessel; and (3) flow in a rod bundle in the presence of spacing devices. The focus of the work presented here is on the lessons learned and the requirements to perform these simulations at exascale. Additional physical insight gained from these simulations is also emphasized.

CFD↗

Explore: An Advanced Computing Agenda for Competitiveness

Over the course of this three-year grant, the Council on Competitiveness (Council) hosted six meetings of its Advanced Computing Roundtable made up of experts from a broad cross section of advanced computing users and manufacturers, and four Advanced Computing for Competitiveness Regional Forums to explore issues related to advanced computing in regions, states and localities. More than two hundred experts, stakeholders and policymakers from the federal and state levels participated in this work and provided their time and expertise to help define the opportunity in advanced computing and the barriers to it reaching its full potential as a game-changing competitive advantage for the United States economy and national security. Building on the insights of the Council’s Advanced Computing Roundtable and findings and recommendations from the four U.S. Department of Energy-supported Forums, the Council has identified several broad policy objectives for the United States related to advanced computing leadership and implementation. The United States must: Compete at the high end of advanced computing. Continue investing to be a technology leader as the world moves toward exascale computing, including in hardware, software and applications. America also must lead in strategic areas like extending Moore’s Law and quantum computing. Improve the ability of HPC-using firms to leverage advanced computing. The Council recommends steps to improve computational skills, increase industry partnerships with laboratories and academia, and expand and strengthen software partnerships. Regulatory agencies also should accelerate efforts to use modeling and simulation within the regulatory process. Expand the number of HPC-using companies in America. Too few firms are able to leverage advanced computing to innovate and compete. Federal, state and local economic development efforts should be utilized to lower barriers and teach small and medium-sized firms, particularly manufacturers, to use advanced modeling, simulation and analytics. Coordinate federal action. Federal agencies should continue to act in a coordinated fashion on advanced computing challenges through the Joint Program Office for Strategic Computing. Leverage HPC to compete in strategic technologies and applications. Leadership in advanced computing is tightly linked to leadership in artificial intelligence, the Internet of Things, cybersecurity, additive manufacturing and other emerging technologies. Public and private sector leaders should collaborate on research and partnership efforts that ensure world-class computing environments for strategic technology leadership.

advanced computing↗

Novel Solver Algorithms for Nearly Singular Linear Systems Arising in Combustion Modelling

Direct Numerical Simulations of realistic combustion devices are extremely challenging due to the wide separation of scales in the simulation, for example an internal combustion (IC) engine chamber, and the flame thickness of a high-pressure flame. The PeleLMeX solver uses adaptive mesh refinement (AMR) to evolve multi-species reacting flows in the low Mach number limit at the Exascale and relies on an embedded boundary (EB) approach to represent complex geometries. In that framework, the EB geometries often give rise to very small cut-cells along the boundary, which translate into extreme ill-conditioning of the pressure-projection, with eigenvalues that span 15-16 orders of magnitude. In this talk, we focus on the case of a typical IC piston bowl geometry for which we present on a novel approach towards solving these nearly singular linear systems with ILU-based, C-AMG smoothers on massively parallel architectures. In particular, we use scaling and equilibration algorithms to handle the non-normality of the upper triangular factors. This enables us to approximate the highly sequential triangular solve algorithm, embedded in the AMG smoothing-solve phase, with Jacobi iterations. This approximation can be written as a convergent Neumann series whose terms are composed of highly parallel sparse matrix vector multiplications. The result is an algorithm that substantially decreases setup and solve time, compared to state-of-the-art, for these challenging linear systems.

combustion modelling↗

Data and Multistage Optimization for the New Grid

Three essential capabilities for using exascale computing resources on next generation power grid applications are: generating large renewable energy datasets, modeling damage and operations during and after extreme events, and employing multi-stage optimization for infrastructure planning. Powerscenarios, developed as part of the ExaSGD project, addresses these capabilities by enabling users to build synthetic wind farms for large test systems using numerical weather prediction-based data sources. We share examples of using Powerscenarios to build out wind farms on the ACTIVSg2000 test system, to enable simulated operations and emergency asset allocation during a hurricane strike, and to compute multi-stage infrastructure buildouts.

economic dispatch↗

Examination of a Methane/Diesel RCCI Engine Using Pele: Preprint

Multi-fuel, advanced injection strategies have become increasingly promising as a strategy to mitigate the emissions generated from internal combustion engines. By carefully controlling the combustion phasing in-cylinder, these new multi-pulse, multi-fuel injection strategies are able to burn in the low-temperature combustion regime where both NOx and soot are not readily produced, reducing the need for extensive exhaust gas recirculation systems. In this study, we examine a reactivity-controlled compression ignition (RCCI) strategy that uses an early pre-filled methane-air mixture with low turbulence background as the low-reactivity fuel and a direct injection of four discrete dodecane jets as a surrogate for the high-reactivity diesel fuel. We use the Pele software suite, a highly optimized, exascale-ready, adaptive mesh refinement codebase to perform high-resolution numerical simulations of a scaled down, single cylinder from the RCCI engine. Here, we resolve the ignition kernels down to micrometer scales and present several statistical quantities evaluating the development of the flow and detailing the onset of ignition and subsequent flame development. Particular attention is paid to the conditions surrounding the onset of the first ignition kernels and discussing what led to the development of those conditions.

CFD↗

Evolution of Scenario Generation Capabilities in the ExaSGD Project

High-fidelity renewable energy scenarios and rare-event high-impact contingencies are essential for modeling operations and infrastructure expansion of the next generation power grids using exascale computing resources. As the ExaSGD project progressed, our capabilities for generating scenarios for modeling wind power output at multiple wind farms significantly improved, evolving from the use of independent random perturbations to importance sampling-based techniques capturing representative spatial-temporal relations. Contingency generation also improved, evolving from standard N-1 techniques to probabilistic models of infrastructure damage resulting from extreme weather events. We review the developments in the realistic intermittent-energy scenario forecasting and extreme-event contingency creation as the ExaSGD project progressed and discuss the future work in these areas.

economic dispatch↗

ExaWind at NREL: Upping the Ante

The objective of the ExaWind component of the Exascale Computing Project is to deliver many-turbine blade-resolved simulations in complex terrain. These simulations bring new challenges to both compute and analysis of the resulting data. In this paper/video, we visually explore the impact of ExaWind on wind simulations through two studies of a small wind farm under two atmospheric conditions. We then turn to analysis and review tools that visualization researchers at NREL use to answer the challenges that ExaWind brings.

collaborative visualization↗

Toward low‐cloud‐permitting cloud superparameterization with explicit boundary layer turbulence

Abstract Systematic biases in the representation of boundary layer (BL) clouds are a leading source of uncertainty in climate projections. A variation on superparameterization (SP) called “ultraparameterization” (UP) is developed, in which the grid spacing of the cloud‐resolving models (CRMs) is fine enough (250 × 20 m) to explicitly capture the BL turbulence, associated clouds, and entrainment in a global climate model capable of multiyear simulations. UP is implemented within the Community Atmosphere Model using 2° resolution (∼14,000 embedded CRMs) with one‐moment microphysics. By using a small domain and mean‐state acceleration, UP is computationally feasible today and promising for exascale computers. Short‐duration global UP hindcasts are compared with SP and satellite observations of top‐of‐atmosphere radiation and cloud vertical structure. The most encouraging improvement is a deeper BL and more realistic vertical structure of subtropical stratocumulus (Sc) clouds, due to stronger vertical eddy motions that promote entrainment. Results from 90 day integrations show climatological errors that are competitive with SP, with a significant improvement in the diurnal cycle of offshore Sc liquid water. Ongoing concerns with the current UP implementation include a dim bias for near‐coastal Sc that also occurs less prominently in SP and a bright bias over tropical continental deep convection zones. Nevertheless, UP makes global eddy‐permitting simulation a feasible and interesting alternative to conventionally parameterized GCMs or SP‐GCMs with turbulence parameterizations for studying BL cloud‐climate and cloud‐aerosol feedback.

54 ENVIRONMENTAL SCIENCES↗

Impact of Physics Parameterization Ordering in a Global Atmosphere Model

Abstract Because weather and climate models must capture a wide variety of spatial and temporal scales, they rely heavily on parameterizations of subgrid‐scale processes. The goal of this study is to demonstrate that the assumptions used to couple these parameterizations have an important effect on the climate of version 0 of the Energy Exascale Earth System Model (E3SM) General Circulation Model (GCM), a close relative of version 1 of the Community Earth System Model (CESM1). Like most GCMs, parameterizations in E3SM are sequentially split in the sense that parameterizations are called one after another with each subsequent process feeling the effect of the preceding processes. This coupling strategy is noncommutative in the sense that the order in which processes are called impacts the solution. By examining a suite of 24 simulations with deep convection, shallow convection, macrophysics/microphysics, and radiation parameterizations reordered, process order is shown to have a big impact on predicted climate. In particular, reordering of processes induces differences in net climate feedback that are as big as the intermodel spread in phase 5 of the Coupled Model Intercomparison Project. One reason why process ordering has such a large impact is that the effect of each process is influenced by the processes preceding it. Where output is written is therefore an important control on apparent model behavior. Application of k ‐means clustering demonstrates that the positioning of macro/microphysics and shallow convection plays a critical role on the model solution.

54 ENVIRONMENTAL SCIENCES↗