SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Tensor algebra is a powerful tool for computing, but writing optimized codes that operate on sparse tensors can be very complex. This project enables a Tensor Algebra Compiler (TACO) that simplifies this task from man-years to man-days and extends TACO to support complex and large distributed systems. This report details the hypotheses, approaches used, and findings in this project.
Abstract. While global hydrological models (GHMs) are very useful in exploring water resources and interactions between the Earth and human systems, their use often requires numerous model inputs, complex model calibration, and high computation costs. To overcome these challenges, we construct an efficient open-source and ready-to-use hydrological emulator (HE) that can mimic complex GHMs at a range of spatial scales (e.g., basin, region, globe). More specifically, we construct both a lumped and a distributed scheme of the HE based on the monthly abcd model to explore the tradeoff between computational cost and model fidelity. Model predictability and computational efficiency are evaluated in simulating global runoff from 1971 to 2010 with both the lumped and distributed schemes. The results are compared against the runoff product from the widely used Variable Infiltration Capacity (VIC) model. Our evaluation indicates that the lumped and distributed schemes present comparable results regarding annual total quantity, spatial pattern, and temporal variation of the major water fluxes (e.g., total runoff, evapotranspiration) across the global 235 basins (e.g., correlation coefficient r between the annual total runoff from either of these two schemes and the VIC is >0.96), except for several cold (e.g., Arctic, interior Tibet), dry (e.g., North Africa) and mountainous (e.g., Argentina) regions. Compared against the monthly total runoff product from the VIC (aggregated from daily runoff), the global mean Kling–Gupta efficiencies are 0.75 and 0.79 for the lumped and distributed schemes, respectively, with the distributed scheme better capturing spatial heterogeneity. Notably, the computation efficiency of the lumped scheme is 2 orders of magnitude higher than the distributed one and 7 orders more efficient than the VIC model. A case study of uncertainty analysis for the world's 16 basins with top annual streamflow is conducted using 100 000 model simulations, and it demonstrates the lumped scheme's extraordinary advantage in computational efficiency. Our results suggest that the revised lumped abcd model can serve as an efficient and reasonable HE for complex GHMs and is suitable for broad practical use, and the distributed scheme is also an efficient alternative if spatial heterogeneity is of more interest.
In this paper, a new version of the FLOw Redirection and Induction Dynamics (FLORIDyn) model is presented. The new model uses the three-dimensional parametric Gaussian FLORIS model and can provide dynamic wind farm simulations at a low computational cost under heterogeneous and changing wind conditions. Both FLORIS and FLORIDyn are parametric models which can be used to simulate wind farms, evaluate controller performance and can serve as a control-oriented model. One central element in which they differ is in their representation of flow dynamics: FLORIS neglects these and provides a computationally very cheap approximation of the mean wind farm flow. FLORIDyn defines a framework which utilizes this low computational cost of FLORIS to simulate basic wake dynamics. This is achieved by creating so-called observation points (OPs) at each time step at the rotor plane which inherit the turbine state. In this work, we develop the initial FLORIDyn framework further considering multiple aspects. The underlying FLORIS wake model is replaced by a Gaussian wake model. The distribution and characteristics of the OPs are adapted to account for the new parametric model but also to take complex flow conditions into account. To achieve this, a mathematical approach is developed to combine the parametric model and the changing, heterogeneous world conditions and link them with each OP. We also present a computationally lightweight wind field model to allow for a simulation environment in which heterogeneous flow conditions are possible. FLORIDyn is compared to Simulator for Offshore Wind Farm Applications (SOWFA) simulations in three- and nine-turbine cases under static and changing environmental conditions. The results show a good agreement with the timing of the impact of upstream state changes on downstream turbines. They also show a good agreement in terms of how wakes are displaced by wind direction changes and when the resulting velocity deficit is experienced by downstream turbines. A good fit of the mean generated power is ensured by the underlying FLORIS model. In the three-turbine case, FLORIDyn simulates 4 s simulation time in 24.49 ms computational time. The resulting new FLORIDyn model proves to be a computationally attractive and capable tool for model-based dynamic wind farm control.
The Production and Distributed Analysis (PanDA) system is a data-driven workload management system engineered to operate at the LHC data processing scale. The PanDA system provides a solution for scientific experiments to fully leverage their distributed heterogeneous resources, showcasing scalability, usability, flexibility, and robustness. The system has successfully proven itself through nearly two decades of steady operation in the ATLAS experiment, addressing the intricate requirements such as diverse resources distributed worldwide at about 200 sites, thousands of scientists analyzing the data remotely, the volume of processed data beyond the exabyte scale, dozens of scientific applications to support, and data processing over several billion hours of computing usage per year. PanDA’s flexibility and scalability make it suitable for the High Energy Physics community and wider science domains at the Exascale. Beyond High Energy Physics, PanDA’s relevance extends to other big data sciences, as evidenced by its adoption in the Vera C. Rubin Observatory and the sPHENIX experiment. As the significance of advanced workflows continues to grow, PanDA has transformed into a comprehensive ecosystem, effectively tackling challenges associated with emerging workflows and evolving computing technologies. The paper discusses PanDA’s prominent role in the scientific landscape, detailing its architecture, functionality, deployment strategies, project management approaches, results, and evolution into an ecosystem.
Purpose: To consider nonuniform tumor motion within the internal target volume (ITV) by defining time-adjusted ITV (TTV), a volume designed to include heterogeneity of tumor existence on the basis of 4-dimensional computed tomography (4D-CT). Methods and Materials: We evaluated 30 lung cancer patients. Breath-hold CT (BH-CT) and free-breathing 4D-CT scans were acquired for each patient. The tumors were manually delineated using a lung CT window setting (window, 1600 HU; level, −300 HU). Tumor in BH-CT images was defined as gross tumor volume (GTV), and the sum of tumors in 4D-CT images was defined as ITV-4D. The TTV images were generated from the 4D-CT datasets, and the tumor existence probability within ITV-4D was calculated. We calculated the TTV{sub 80} value, which is the percentage of the volume with a tumor existence probability that exceeded 80% on ITV-4D. Several factors that affected the TTV{sub 80} value, such as the ITV-4D/GTV ratio or tumor centroid deviation, were evaluated. Results: Time-adjusted ITV images were acquired for all patients, and tumor respiratory motion heterogeneity was visualized. The median (range) ITV-4D/GTV ratio and median tumor centroid deviation were 1.6 (1.0-4.1) and 6.3 mm (0.1-30.3 mm), respectively. The median TTV{sub 80} value was 43.3% (2.9-98.7%). Strong correlations were observed between the TTV{sub 80} value and the ITV-4D/GTV ratio (R=−0.71) and tumor centroid deviation (R=−0.72). The TTV images revealed the tumor motion pattern features within ITV. Conclusions: The TTV images reflected nonuniform tumor motion, and they revealed the tumor motion pattern features, suggesting that the TTV concept may facilitate various aspects of radiation therapy planning of lung cancer while incorporating respiratory motion in the future.
Performance portability is becoming crucial as high-performance computing systems become increasingly heterogeneous. We have many options for CPUs and accelerators (e.g., GPUs) but also for non-Von Neumann architectures such as field-programmable gate arrays. This paper presents the CHARM-SYCL unified programming environment for multiple accelerator types as a performance-portable programming environment. It uses the IRIS library developed at Oak Ridge National Laboratory as the back end accelerator runtime. IRIS has a high-performance scheduler to distribute tasks across accelerators. This design allows us to run an application from the same source on multiple systems with multiple configurations. We provide three types of portability with CHARM-SYCL: Portable Workflow, Compiler and Runtime Portability, and Application and Performance Portability. We implement a Monte Carlo simulation benchmark code on the CHARM-SYCL execution environment and demonstrate that our programming environment can accommodate extremely heterogeneous systems.
Quantum circuit simulations are applied in more and more circum- stances as the quantum computing community becomes broader. It helps researchers to evaluate quantum algorithms and relieve the burden of limited quantum computing resources. However, most of the state-of-the-art quantum simulators utilize either CPU or GPU to store and calculate the state vector, which results in resource starvation. Moreover, the maximum number of qubits supported by the simulator is bounded by the memory, since the memory utilization increases exponentially with the number of qubits. In this study, we leverage Heterogeneous computing to utilize both CPU and GPU to store and update state vectors. We also integrate lossy data compression to reduce memory requirements. Specifically, we develop a heterogeneous framework that has a dynamic scheduler to fully utilize the computing resources. We apply lossy compression to chunked state vector to make the maximum number of qubits higher than the regular simulators, the compression also benefits the data movement between CPU and GPU.
OpenMP was not well recognized at the beginning of the project, around year 2003, because of its limited use in DoE production applications and the inmature hardware support for an efficient implementation. Yet in the recent years, it has been graduately adopted both in HPC applications, mostly in the form of MPI+OpenMP hybrid code, and in mid-scale desktop applications for scientific and experimental studies. We have observed this trend and worked deligiently to improve our OpenMP compiler and runtimes, as well as to work with the OpenMP standard organization to make sure OpenMP are evolved in the direction close to DoE missions. In the Center for Programming Models for Scalable Parallel Computing project, the HPCTools team at the University of Houston (UH), directed by Dr. Barbara Chapman, has been working with project partners, external collaborators and hardware vendors to increase the scalability and applicability of OpenMP for multi-core (and future manycore) platforms and for distributed memory systems by exploring different programming models, language extensions, compiler optimizations, as well as runtime library support.
BioSig3D is a computational platform for high-content screening of three-dimensional (3D) cell culture models that are imaged in full 3D volume. It provides an end-to-end solution for designing high content screening assays, based on colony organization that is derived from segmentation of nuclei in each colony. BioSig3D also enables visualization of raw and processed 3D volumetric data for quality control, and integrates advanced bioinformatics analysis. The system consists of multiple computational and annotation modules that are coupled together with a strong use of controlled vocabularies to reduce ambiguities between different users. It is a web-based system that allows users to: design an experiment by defining experimental variables, upload a large set of volumetric images into the system, analyze and visualize the dataset, and either display computed indices as a heatmap, or phenotypic subtypes for heterogeneity analysis, or download computed indices for statistical analysis or integrative biology. BioSig3D has been used to profile baseline colony formations with two experiments: (i) morphogenesis of a panel of human mammary epithelial cell lines (HMEC), and (ii) heterogeneity in colony formation using an immortalized non-transformed cell line. These experiments reveal intrinsic growth properties of well-characterized cell lines that are routinely used for biological studies. BioSig3D is being released with seed datasets and video-based documentation.
The electrodes in solid oxide fuel cells (SOFCs) consist of three phases interconnected in three dimensions. The volume needed to describe quantitatively such microstructures depends on several lengths scales, which are functions of materials properties and fabrication methods. This work focuses on quantifying the volume needed to represent “intermediate frequency” heterogeneities in electrodes of a commercial SOFC using X-ray computed tomography (CT) over two different length scales. Electrode volumes of 150 x 150 x 9 μm 3 were extracted from a synchrotron-based micro-CT data set, with 13 μm 3 voxels. 13.6 x 19.8 x 19.4 μm 3 of the cathode and 26.3 x 24.8 x 15.7 μm 3 of the anode were extracted from laboratory nano-CT data sets, both with 65 3 nm 3 voxels. After comparing the variation across sub-regions for the greyscale values from the micro-CT, and for the phase fractions and triple phase boundary densities from the nano-CT, it was found that the sub-region length scales needed to yield statistically similar average values were an order of magnitude larger than those expected to capture the “high frequency” heterogeneity related to the discrete nature of the three phases in electrodes. In conclusion, the challenge of quantifying such electrodes using available experimental methods is discussed.
The execution of agent-based simulations (ABSs) on hardware accelerator devices such as graphics processing units (GPUs) has been shown to offer great performance potentials. However, in heterogeneous hardware environments, it can become increasingly difficult to find viable partitions of the simulation and provide implementations for different hardware devices. To automate this process, we present OpenABLext, an extension to OpenABL, a model specification language for ABSs. By providing a device-aware OpenCL backend, OpenABLext enables the co-execution of ABS on heterogeneous hardware platforms consisting of central processing units, GPUs, and field programmable gate arrays (FPGAs).We present a novel online dispatching method that efficiently profiles partitions of the simulation during run-time to optimize the hardware assignment while using the profiling results to advance the simulation itself. In addition, OpenABLext features automated conflict resolution based on user-specified rules, supports graph-based simulation spaces, and utilizes an efficient neighbor search algorithm. We show the improved performance of OpenABLext and demonstrate the potential of FPGAs in the context of ABS. We illustrate how co-execution can be used to further lower execution times. OpenABLext can be seen as an enabler to tap the computing power of heterogeneous hardware platforms for ABS.
Electromagnetic stimulation of energetic materials provides a noninvasive and nondestructive tool for detecting and identifying explosives. We combine structural information based on x-ray computed tomography, experimental dielectric data, and electromagnetic full-wave simulations to study microscale electromagnetic heating of realistic three-dimensional heterogeneous explosives. In conclusion, we analyze the formation of electromagnetic hot spots and thermal gradients in the explosive-binder mesostructures and compare the heating rate for various binder systems.
Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.
The mechanisms of tensile deformation and fracture of carbon fibers are investigated in large-scale molecular dynamics simulations. The simulations performed for computational samples with different structural characteristics enable analysis of the structural sensitivity of the mechanical properties. It is found that the carbon fiber nanostructure can be represented by a fine (nanoscale) mixture of stiff and soft regions. Despite the nanoscale structural heterogeneity of the computational fibers, their fracture strain and tensile strength exceed the experimental values by almost an order of magnitude. Here, this observation is explained by the ability of the carbon fiber nanostructure, largely consisting of curved and folded layers of turbostratic carbon, to exhibit continuous nanoscale load redistribution during the deformation. The transient, fluid nature of a percolating cluster of stress-holding structural elements prevents stress localization at the early stage of the deformation and enables the fiber nanostructure to adapt to the increasing load. Overall, the results of the simulations suggest that the design of advanced carbon fiber manufacturing and post-processing methods focused on the elimination of critical mesoscopic structural defects (internal voids, foreign inclusions, and surface flaws) can yield a substantial increase in the strength and fracture strain of carbon fibers.
Abstract The chemistry of trivalent transplutonium ions (Am 3+ , Cm 3+ , Bk 3+ , Cf 3+ , Es 3+ …) is usually perceived as monotonic and paralleling that of the trivalent lanthanide series. Herein, we present the first extended X‐ray absorption fine structure (EXAFS) study performed on a series of aqueous heavy actinide chelates, extending past Cm. The results obtained on diethylenetriaminepentaacetic acid (DTPA) complexes of trivalent Am, Cm, Bk, and Cf show a break to much shorter metal–oxygen nearest‐neighbor bond lengths in the case of Cf 3+ . Corroborating those results, density functional theory calculations, extended to Es 3+ , suggest that the shorter Cf−O and Es−O bonds could arise from the departure of the coordinated water molecule and contraction of the ligand around the metal relative to the other [M III DTPA(H 2 O)] 2− (M=Am, Cm, Bk) complexes. Taken together, these experimental and theoretical results demonstrate inhomogeneity within the trivalent transplutonium series that has been insinuated and debated in recent years, and that may also be leveraged for future nuclear waste reprocessing technologies.
The chemistry of trivalent transplutonium ions (Am 3+ , Cm 3+ , Bk 3+ , Cf 3+ , Es 3+ …) is usually perceived as monotonic and paralleling that of the trivalent lanthanide series. We present the first extended X-ray absorption fine structure (EXAFS) study performed on a series of aqueous heavy actinide chelates, extending past Cm. The results obtained on diethylenetriaminepentaacetic acid (DTPA) complexes of trivalent Am, Cm, Bk, and Cf show a break to much shorter metal–oxygen nearest-neighbor bond lengths in the case of Cf 3+ . Corroborating those results, density functional theory calculations, extended to Es 3+ , suggest that the shorter Cf-O and Es-O bonds could arise from the departure of the coordinated water molecule and contraction of the ligand around the metal relative to the other [M III DTPA(H 2 O)] 2- (M=Am, Cm, Bk) complexes. Taken together, these experimental and theoretical results demonstrate inhomogeneity within the trivalent transplutonium series that has been insinuated and debated in recent years, and that may also be leveraged for future nuclear waste reprocessing technologies.
Rotating algal biofilm reactors (RABRs) are innovative systems designed to cultivate microalgae biofilms efficiently. In this paper, we have developed a novel mathematical model to accurately capture the growth dynamics of algae biofilms within RABR. By considering the spatial heterogeneity of the RABR, we introduce a PDE-based model that addresses the spatial variations across the substratum, enabling a more accurate simulation of biofilm growth in RABRs. The photosynthesis process is modeled through reactive kinetics, driving the growth of the algae biofilm. To analyze the system's behavior, we employ finite difference numerical methods to solve the complex PDE model. We then conduct extensive numerical simulations to understand algae biofilm growth in the RABR environment under various operational factors and environmental conditions. One primary focus in these simulations is to investigate the impact of various harvesting strategies, harvesting frequencies, light intensity, and light exposure on the overall biomass productivity of the algae biofilm. The numerical results provide valuable insights into optimizing algae biofilm growth and designing harvesting techniques in RABR systems. Our proposed novel mathematical model provides an effective platform for the theoretical investigation and design of RABRs for wastewater treatment.
Abstract Offline computation is an essential component in most multiscale model reduction techniques. However, there are multiscale problems in which offline procedure is insufficient to give accurate representations of solutions, due to the fact that offline computations are typically performed locally and global information is missing in these offline information. To tackle this difficulty, we develop an online local adaptivity technique for local multiscale model reduction problems. We design new online basis functions within Discontinuous Galerkin method based on local residuals and some optimally estimates. The resulting basis functions are able to capture the solution efficiently and accurately, and are added to the approximation iteratively. Moreover, we show that the iterative procedure is convergent with a rate independent of physical scales if the initial space is chosen carefully. Our analysis also gives a guideline on how to choose the initial space. We present some numerical examples to show the performance of the proposed method.