Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parallel optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Impurity screening behavior of the high-field side scrape-off layer in near-double-null configurations: prospect for mitigating plasma-material interactions on RF actuators and first-wall components

The impurity screening response of the high-field side (HFS) scrape-off layer (SOL) to localized nitrogen injection is investigated on Alcator C-Mod for magnetic equilibria spanning lower-single null, double-null and upper single null configurations under otherwise identical plasma conditions. L-mode, EDA H-mode and I-mode discharges are investigated. HFS impurity screening is found to depend on magnetic flux balance and the direction of B×?B relative to the most active divertor. Impurity ‘plume’ emission patterns indicate that both parallel and perpendicular (E×B) flows in the SOL contribute to the ‘flushing’ of impurities towards the active divertor, thereby affecting the overall impurity screening behavior. Despite the fact that the HFS scrape-off layer is extremely narrow in near-double-null configurations, this SOL is able to screen locally injected nitrogen at least as effectively as the low-field side (LFS) SOL – up to a factor of 10 more effective, depending on specific plasma conditions and whether the magnetic geometry produces parallel flows that work with or against E×B flows. For situations in which the E×B drift of the impurity ions opposes parallel flow toward the primary divertor, HFS impurity screening is found to be least effective. When E×B drifts assist parallel flow toward the primary divertor, HFS impurity screening is found to be very effective. These data support the idea of placing RF actuators and close-fitting wall components on the high-field side of the tokamak. With this configuration, near-double-null magnetic topologies may be used for active control of plasma parameters at the antenna/plasma interface for optimal RF coupling, mitigate the generation of local impurities from plasma-material interactions and, taking advantage of favorable plasma flows and good screening properties of the HFS SOL, further minimize the impact of wall-born impurity sources on the plasma core.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Enabling Recycling of Composites: Understanding the Impacts of Multiple Thermal Processing Cycles

When considering the utilization of recycled short carbon fiber feedstock materials for advanced manufacturing, understanding the material degradation behavior is essential in determining how many times a composite material can be effectively reprocessed and remanufactured. This study characterizes the degradation behavior of short carbon fiber acrylonitrile butadiene (CF-ABS) that has been reprocessed five times with twin screw extrusion. Parallel plate rheology was completed to observe the degradation in complex viscosity of the recycled feedstock materials. Gel permeation chromatography (GPC) was utilized to characterize the changes in molecular weight distribution of the recycled materials as a result of thermal and mechanical degradation during the re-processing steps. Rheological characterization, GPC, and twin-screw processing data help inform the process optimizations required to process the recycled feedstock material. Successful characterization of the degradation behavior of short fiber composite feedstock materials aids in increased understanding of the lifespan of high value carbon fiber composite materials and aids in process optimization of recycled composite materials.

Walker, Roo↗

Utilizing ensemble learning for performance and power modeling and improvement of parallel cancer deep learning CANDLE benchmarks

Abstract Machine learning (ML) continues to grow in importance across nearly all domains in modeling to learn from data. Often a tradeoff exists between a model's ability to minimize bias and variance. In this article, we utilize ensemble learning to combine linear, nonlinear, and tree‐/rule‐based ML methods to cope with the bias‐variance tradeoff and result in more accurate models. We use the datasets collected for two parallel cancer deep learning CANDLE benchmarks, NT3 and P1B2, to build performance and power models based on hardware performance counters using single‐object and multiple‐objects ensemble learning to identify the most important counters for improvement on the Cray XC40 Theta at Argonne National Laboratory. Based on the insights from these models, we improve the performance and energy of P1B2 and NT3 by optimizing the deep learning environments TensorFlow, Keras, Horovod, and Python under the huge page size of 8 MB. Experimental results show that ensemble learning not only produces more accurate models but also provides more robust performance counter ranking. We achieve up to 61.15% performance improvement and up to 62.58% energy saving for P1B2 and up to 55.81% performance improvement and up to 52.60% energy saving for NT3 on up to 24,576 cores.

Wu, Xingfu↗

New opportunities in produced water management: A market-based approach to produced water trading

Produced water (PW) is a byproduct of oil and gas (O&G) production. Obtained alongside the more valuable energy products, PW is usually characterized by high levels of salinity and often contains many contaminants (chemicals, soluble and insoluble oil, organics, etc.) making it unsuitable for release without substantial treatment. Couple this with the fact that PW is typically obtained at multiple times the rate of oil or gas, and the added transport, treatment, and disposal costs become a serious challenge for operators. These realities have led to ad-hoc practices including cooperation between industry competitors to recycle, share, or otherwise mitigate PW costs. The National Energy Technology Laboratory (NETL) in partnership with the Ground Water Protection Council (GWPC) is pursuing novel technology solutions to address PW issues that complement or improve ad-hoc practices adopted by operators. In this paper, we observe that well-established market management practices used in electrical power generation have natural analogues in the PW supply chain. These parallels open up a new line of research where we view PW management as a market equilibrium problem, and explore solutions that foster active and data-based collaboration among operators through market structures similar to power markets, with the ultimate objective of improving PW management costs and recycling rates. Here, we make a case for our observations, present a PW market clearing optimization model that shows how such a market system could operate in the O&G space, and provide an illustrative case study for demonstration.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

KokkACC: Enhancing Kokkos with OpenACC

Template metaprogramming is gaining popularity as a high-level solution for achieving performance portability on heterogeneous computing resources. Kokkos is a representative approach that offers programmers high-level abstractions for generic programming while most of the device-specific code generation and optimizations are delegated to the compiler through template specializations. For this, Kokkos provides a set of device-specific code specializations in multiple back ends, such as CUDA and HIP. Unlike CUDA or HIP, OpenACC is a high-level and directive-based programming model. This descriptive model allows developers to insert hints (pragmas) into their code that help the compiler to parallelize the code. The compiler is responsible for the transformation of the code, which is completely transparent to the programmer. This paper presents an OpenACC back end for Kokkos: KokkACC. As an alternative to Kokkos’s existing device-specific back ends, KokkACC is a multi-architecture back end providing a high-productivity programming environment enabled by OpenACC’s high-level and descriptive programming model. Moreover, we have observed competitive performance; in some cases, KokkACC is faster (up to 9×) than NVIDIA’s CUDA back end and much faster than OpenMP’s GPU offloading back end. This work also includes implementation details and a detailed performance study conducted with a set of mini-benchmarks (AXPY and DOT product) and three mini-apps (LULESH, miniFE and SNAP, a LAMMPS proxy mini-app).

Valero Lara, Pedro↗

Development of Passive HC/NOx Trap Catalysts for Low Temperature Gasoline Applications

This project aimed to develop fundamental understanding of the chemistry of NO adsorption and reaction in Pd/zeolites so as to facilitate the rational design of passive NOx adsorber catalysts. The approach adopted combined both experimental and computational methods, which together allow a deeper understanding of the governing chemistry than the use of either method alone. The workflow began with Pd/H-CHA and Pd/H-BEA catalyst synthesis and characterization, in which the Si/Al ratio and Al siting were systematically varied. This was followed by catalyst evaluation using temperature-programed adsorption/desorption methods, as well as in situ spectroscopic measurements to probe the chemistry of NO adsorption. In parallel, the adsorption of NO and other relevant species (H 2 O, CO, HCs) was studied by means of quantum chemical calculations in order to rationalize the experimental data and provide additional insights. Catalyst aging studies were also performed with the aim of elucidating the mechanism of catalyst degradation. Finally, the insights gained in this project were applied to the preparation of an optimized HC/NOx adsorber catalyst, the performance of which was studied using exhaust gas from an engine dynamometer.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Additively manufactured multiplexed inertial coalescence filters

Multiphase flows often pose a significant challenge to the efficient and reliable design of thermofluidic systems. This paper describes multiplexed inertial coalescence filters composed of parallel helical pathways, designed to capture fine droplets (<40 µm) through inertial separation while maintaining a low pressure drop (<400 Pa). Filtration efficiencies for 7 µm and 30 µm droplets were characterized for varying flow conditions, with complete capture observed above a threshold flow rate. Models for filtration efficiency and pressure drop were developed and validated against experimental results to allow system design and optimization, enabled by the tunable additive manufacturing approach used to fabricate the filters. Filter quality factor was computed for varying droplet sizes, showcasing exceptional quality factor when compared to state-of-the-art filters documented in the literature. In conclusion, this multiplexed inertial coalescence filtration approach could find use in dehumidification systems, fog harvesting, chemical reactors, and microgravity droplet capture.

3D Printing↗

Optimization of quasi-symmetric stellarators with self-consistent bootstrap current and energetic particle confinement

Quasi-symmetry can greatly improve the confinement of energetic particles and thermal plasma in a stellarator. The magnetic field of a quasi-symmetric stellarator at high plasma pressure is significantly affected by the bootstrap current, but the computational cost of accurate stellarator bootstrap calculations has precluded use inside optimization. Here, a new efficient method is demonstrated for optimization of quasi-symmetric stellarator configurations such that the bootstrap current profile is consistent with the geometry. The approach is based on the fact that all neoclassical phenomena in quasi-symmetry are isomorphic to those in axisymmetry. Therefore, accurate formulas for the bootstrap current in tokamaks, which can be evaluated rapidly, can be applied also in stellarators. The deviation between this predicted parallel current and the actual parallel current in the magnetohydrodynamic equilibrium is penalized in the objective function, and the current profile of the equilibrium is included in the parameter space. Quasi-symmetric configurations with significant pressure are thereby obtained with self-consistent bootstrap current and excellent confinement. In a comparison of fusion-produced alpha particle confinement across many stellarators, the new configurations have significantly lower alpha energy losses than many previous designs.

Landreman, M. (ORCID:000000027233577X)↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Exact signed distance fields using parallel Fast Sweeping Method

Signed distance fields are often used in multiphysics simulations to track material interfaces. We present a simple methodology based on the fast sweeping method to generate the exact signed distance from triangular meshes and linear paths on Cartesian grids. The methodology propagates the closest primitive to the boundary to the rest of the domain following the characteristics. A local upwind criterion is used to decide between the new and existing closest primitive at each grid point while capturing the correct sign of the global function. The methodology has optimal computational complexity and runs efficiently in distributed-memory architectures. We include 2D and 3D test cases along with a resolution study up to 0.512 trillion zones and 1,000 computer cores. The solution strategy can also be applied to other types of meshes or collections of primitives.

97 MATHEMATICS AND COMPUTING↗

Scaling Out a Combinatorial Algorithm for Discovering Carcinogenic Gene Combinations to Thousands of GPUs

Cancer is a leading cause of death in the US, second only to heart disease. It is primarily a result of a combination of an estimated two-nine genetic mutations (multi-hit combinations). Although a body of research has identified hundreds of cancer-causing genetic mutations, we don’t know the specific combination of mutations responsible for specific instances of cancer for most cancer types. An approximate algorithm for solving the weighted set cover problem was previously adapted to identify combinations of genes with mutations that may be responsible for individual instances of cancer. However, the algorithm’s computational requirement scales exponentially with the number of genes, making it impractical for identifying more than three-hit combinations, even after the algorithm was parallelized and scaled up to a V100 GPU. Since most cancers have been estimated to require more than three hits, we scaled out the algorithm to identify combinations of four or more hits using 1000 nodes (6000 V100 GPUs with ≈48×106 processing cores) on the Summit supercomputer at Oak Ridge National Laboratory. Efficiently scaling out the algorithm required a series of algorithmic innovations and optimizations for balancing an exponentially divergent workload across processors and for minimizing memory latency and inter-node communication. We achieved an average strong scaling efficiency of 90.14% (80.96%–97.96% for 200 to 1000 nodes), compared to a 100 node run, with 84.18% scaling efficiency for 1000 nodes. With experimental validation, the multi-hit combinations identified here could provide further insight into the etiology of different cancer subtypes and provide a rational basis for targeted combination therapy.

Dash, Sajal↗

Design of High-Power Polyphase PCB Coil Systems for Wireless Power Transfer

Printed circuit board (PCB) coils have been proposed prior for implementation as inductive wireless charging coils to minimize size and cost. Utilization of PCBs can allow for a reduced cost, improved manufacturability, and a wide range of geometric customization options. To circumvent material limitations on insulation and thermal performance, parallel paths can be implemented to divide the current per path accordingly. Within this paper, an unconventional high-power PCB coil is designed employing all possible techniques for wiring with axial and radial parallel paths with equivalent transposition to minimize circulating currents. Design studies are simulated in 3D finite element analysis (FEA) to evaluate imbalance between phases with and without transposition. Two experimental prototype coils were fabricated with measurements for self-inductance and mutual inductance between phases. These measurements were validated to be sufficiently consistent with FEA results. Additionally, a method is proposed for a two-step optimization of coupling coefficient and coil losses.

Lewis, Donovin D.↗

Scalable Deep-Learning-Accelerated Topology Optimization for Additively Manufactured Materials

Topology optimization (TO) is a popular and powerful computational approach for designing novel structures, materials, and devices. Two computational challenges have limited the applicability of TO to a variety of industrial applications. First, a TO problem often involves a large number of design variables to guarantee sufficient expressive power. Second, many TO problems require a large number of expensive physical model simulations, and those simulations cannot be parallelized. To address these issues, we propose a general scalable deep-learning (DL) based TO framework, referred to as SDL-TO, which utilizes parallel schemes in high performance computing (HPC) to accelerate the TO process for designing additively manufactured (AM) materials. Unlike the existing studies of DL for TO, our framework accelerates TO by learning the iterative history data and simultaneously training on the mapping between the given design and its gradient. The surrogate gradient is learned by utilizing parallel computing on multiple CPUs incorporated with a distributed DL training on multiple GPUs. The learned TO gradient enables a fast online update scheme instead of an expensive update based on the physical simulator or solver. Using a local sampling strategy, we achieve to reduce the intrinsic high dimensionality of the design space and improve the training accuracy and the scalability of the SDL-TO framework. The method is demonstrated by benchmark examples and AM materials design for heat conduction. The proposed SDL-TO framework shows competitive performance compared to the baseline methods but significantly reduces the computational cost by a speed up of around 8.6x over the standard TO implementation.

Bi, Sirui↗

Zero-Carbon Biofuels: An Optimized Two-Stage System for High Productivity Conversion of CO2 to Liquid Fuels

In MIT’s Zero-Carbon Biofuels work, under ARPAe’s EcoSynBio funding, we capitalized on our previously developed technology of the oleaginous yeast, Yarrowia lipolytica, engineered to produce high titer biodiesel-like lipids and alkanes, and set out to reduce or eliminate CO 2 generation during lipid production. We set out to do this by both engineering Y. lipolytica with the necessary enzymes to allow the generation of reducing equivalents from H 2 , formic acid, or methanol, and, in parallel, installing the non-oxidative glycolysis (NOG) pathway. The goal was that combination of these two would enable stoichiometric conversion of glucose and acetate to biodiesel products. Furthermore, our ARPAe Electrofuels funded research, yielded a very innovative two-stage system where gases comprising CO 2 and H 2 are used for the production of liquid fuels. Acetate is produced from CO 2 and H 2 , via acetogenic fermentation, in the first stage as the intermediary product, then fed to Y. lipolytica in the second stage, for conversion to lipids and alkanes. To increase the commercial competitiveness of the two-stage system, by improvement to the overall productivity, we recently showed that synergistic substrate co-feeding drastically enhances CO 2 fixation rates and set out to explore additional co-substrate pairs, including methanol and formic acid, in order to maximize acetate productivity. Finally, given the attractiveness as a biofuel, we also set out to attempt an important increase in the production of alkanes over lipids in Yarrowia.

10 SYNTHETIC FUELS↗

Direct numerical simulations for hybrid rocket boundary layers: Performance modeling and scaling

This paper presents a comprehensive performance and scaling analysis of direct numerical simulations for reacting boundary layers, focusing on slab burner configurations. Using a PETSc-based finite volume CFD framework, the study evaluates the scalability and computational cost of flow, chemistry, and radiation evaluations across 2D and 3D simulations. Polymethyl methacrylate (PMMA) is the fuel with pure O 2 as the oxidizer, modeled using a detailed chemical kinetics mechanism with 113 species and 660 reactions. A ray-tracing-based radiation solver, designed for distributed memory applications, is implemented to model radiation heat transfer. Parallel scalability is analyzed for the coupled flow, chemistry, and radiation heat transfer processes. Weak and strong scaling studies are conducted on up to 15,000 computational ranks, revealing robust performance when flow cells exceed 200 per rank. Chemistry evaluations dominate the computational cost in large 3D simulations, accounting for approximately 40% of the total runtime, while flow processes contribute around 35%, and radiation solver contributions remain below 10% due to reduced evaluation frequencies. GPU accelerated chemistry evaluation, implemented with Zero-RK, demonstrates significant promise, achieving up to a 4x speedup for workloads exceeding 30,000 cells per GPU. However, diminishing returns are observed for smaller workloads due to CPU-GPU communication overhead. This study identifies key challenges, including memory bottlenecks and the effects of domain partitioning on flow scalability, while highlighting the potential of GPU-accelerated chemistry to reduce computational costs. In conclusion, these findings provide realizable run configurations for 2D, 3D, and GPU-accelerated cases, offering insights for optimizing reactive flow solvers.

CFD Scalability↗

Dynamic analysis of fully constrained Cable-Driven Parallel Robots for automated prefabricated component installation

This paper presents a dynamic analysis and validation framework to assess a fully constrained six-anchor Cable-Driven Parallel Robot (CDPR) for automated installation of prefabricated facade components. Compared with conventional eight-anchor systems, the six-anchor configuration simplifies setup and reduces cost, but it also reduces control authority, shrinks the wrench-feasible workspace, and tightens orientation limits. Consequently, it is unclear a priori whether dynamically feasible trajectories exist to move the end effector from pickup to the facade. A constrained trajectory optimization is formulated to enforce the system dynamics, cable-tension bounds, and pose/velocity limits, and the framework is evaluated in simulation at three levels: (i) an idealized reference model, (ii) a lab-scale prototype model incorporating measured anchor misalignments and identified damping, and (iii) a full-scale three-story building model with load decomposition for structural feasibility checks. Across these scenarios, the analysis shows that optimal, constraint-satisfying trajectories exist that move the end effector from pickup to installation while maintaining a near-plumb, level orientation at the final pose. Collectively, this multi-scale dynamic analysis and validation framework supports the deployment readiness of the six-anchor CDPR and provides a prototype-based sensitivity case study of how measured anchor placement deviations affect feasibility.

CDPR↗

Training data selection for accuracy and transferability of interatomic potentials

Abstract Advances in machine learning (ML) have enabled the development of interatomic potentials that promise the accuracy of first principles methods and the low-cost, parallel efficiency of empirical potentials. However, ML-based potentials struggle to achieve transferability, i.e., provide consistent accuracy across configurations that differ from those used during training. In order to realize the promise of ML-based potentials, systematic and scalable approaches to generate diverse training sets need to be developed. This work creates a diverse training set for tungsten in an automated manner using an entropy optimization approach. Subsequently, multiple polynomial and neural network potentials are trained on the entropy-optimized dataset. A corresponding set of potentials are trained on an expert-curated dataset for tungsten for comparison. The models trained to the entropy-optimized data exhibited superior transferability compared to the expert-curated models. Furthermore, the models trained to the expert-curated set exhibited a significant decrease in performance when evaluated on out-of-sample configurations.

36 MATERIALS SCIENCE↗

When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?

Physics-informed neural networks (PINNs) have become a popular choice for solving high-dimensional partial differential equations (PDEs) due to their excellent approximation power and generalization ability. Recently, extended PINNs (XPINNs) based on domain decomposition methods have attracted considerable attention due to their effectiveness in modeling multiscale and multiphysics problems and their parallelization. However, theoretical understanding of their convergence and generalization properties remains unexplored. In this study, we take an initial step towards understanding how and when XPINNs outperform PINNs. Specifically, for general multilayer PINNs and XPINNs, we first provide a prior generalization bound via the complexity of the target functions in the PDE problem and a posterior generalization bound via the posterior matrix norms of the networks after optimization. Moreover, based on our bounds, we analyze the conditions under which XPINNs improve generalization. Concretely, our theory shows that the key building block of XPINN, namely, the domain decomposition, introduces a tradeoff for generalization. On the one hand, XPINNs decompose the complex PDE solution into several simple parts, which decreases the complexity needed to learn each part and boosts generalization. On the other hand, decomposition leads to less training data being available in each subdomain, and hence such a model is typically prone to overfitting and may become less generalizable. Empirically, we choose five PDEs to show when XPINNs perform better than, similar to, or worse than PINNs, hence demonstrating and justifying our new theory.

97 MATHEMATICS AND COMPUTING↗