Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “convergence rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Simulated Evaluation of Powder Flowability Through a Partially Obstructed Consumable in Blown Powder Directed Energy Deposition Systems

Abstract In the interest of continued industrialization of metal additive manufacturing in modern production environments, cost is often referenced as a primary deterrent to new adopters. Conventional economic models for additive systems, processes, and supply chains often focus on specific process applications with little generalizability, or they neglect significant costs associated with production such as machine maintenance and consumable part replacement. Compounding the latter issue are substantial knowledge gaps in consumable part wear characterization for additive and other convergent manufacturing systems. In coaxial blown powder directed energy deposition systems, gas atomized metal powder is wasted during material deposition at a rate that is partly dependent on present wear phenomena in a consumable nozzle housed in the cladding head assembly. The price and lead time required to replace the nozzle incentivizes its reuse even when visibly worn. Often this initiates a process quality decline in the form of underbuilt geometry and internal defects due to losses in powder catchment efficiency. While depositing H13 steel using a hybrid manufacturing machine tool equipped with such a deposition system, a unique partial clog with a bridge-like structure formed at the consumable nozzle exit when supporting argon gas flows failed mid-process. To further understand coaxial multi-phase powder flow in the event of support gas failure, a computational fluid dynamics simulation is tailored to relevant process parameters, H13 powder material profile, and machine operator observations collected after the incident. The resulting differences in powder flow compared to control gas flow parameters is presented and discussed. The powder flowability and performance of the clogged nozzle is then assessed by using an optical profilometer to extract the profile of the clog and recreate the clog geometry within the simulation environment. In past work this simulation has been experimentally validated for a 316L steel powder material profile and used specifically for analyzing powder stream geometry and catchment efficiency. After the initial powder flow characterization, the clog is removed, and the nozzle is reprofiled. After removing the obstructing clog, the newly unobstructed nozzle geometry, the original off the shelf nozzle geometry, and additional nozzle profiles exploring different consumable refurbishment strategies are reevaluated in the simulation. Powder catchment efficiency for all variant nozzle geometries and relevant flow variables are compared and discussed, along with potential mitigation strategies for optimizing powder flowability with worn consumables. This work expands on the known morphology of blown powder obstructions and wear defects present in consumable coaxial nozzles while discussing pragmatic simulation driven responses to unanticipated subsystem failure in hybrid manufacturing machining platforms.

DeWitte, Lisa↗
DOE OSTI2024

Geometry-aware training of factorized layers in tensor Tucker format

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during train and inference of large networks. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes it as the product of two rank-r matrices. However, this family of approaches often requires an initial full-model warm-up phase, prior knowledge of a feasible rank, and it is sensitive to parameter initialization.In this work, we introduce a novel approach to train the factors of a Tucker decomposition of the weight tensors. Our training proposal proves to be optimal in locally approximating the original unfactorized dynamics and stable for the initialization. Furthermore, the rank of each mode is dynamically updated during training.We provide a theoretical analysis of the algorithm, showing convergence, approximation and local descent guarantees. The method's performance is further illustrated through a variety of experiments, showing remarkable training compression rates and comparable or even better performance than the full baseline and alternative layer factorization strategies.

Zangrando, Emanuele [Gran Sasso Science Institute ↗
DOE OSTI2026

Distributed Quantum-Enhanced Optimization: A Topographical Preconditioning Approach for High-Dimensional Search

Optimization problems become fundamentally challenging as the number of variables increases. Because the volume of the search space grows exponentially, classical algorithms frequently fail to locate the global minimum of non-convex functions. While quantum optimization offers a potential alternative, mapping continuous problems onto near-term quantum hardware introduces severe scaling limits and barren plateaus. To bridge this gap, we propose the Distributed Quantum-Enhanced Optimization (D-QEO) framework. Instead of forcing the quantum processor to find the exact minimum, we use it simply as a topographical preconditioner. The QPU maps the landscape to locate the most promising basin of attraction, generating high-quality seed points for a classical GPU-accelerated solver to refine. To make this approach viable for utility-scale problems, we exploit the mathematical structure of separable functions. This allows us to cut a 50-qubit (i.e., $2^{50}$) global search space into independent and manageable sub-spaces using 5-qubit subcircuits. By executing these fragments concurrently with CUDA-Q, we completely bypass the overhead of cross-register entanglement and classical tensor knitting for separable functions. Benchmarks on the 10-dimensional Rastrigin and Ackley functions show that D-QEO prevents the exponential failure rates observed in purely classical algorithms. Furthermore, this quantum warm-start significantly reduces the number of classical BFGS iterations required to converge, providing a highly practical blueprint for utilizing near-term quantum resources in complex global search.

Soos, Dominik [Old Dominion U.]↗
DOE OSTI2023

Demonstration of neutron-yield enhancement by laser preheating and magnetization of laser-driven cylindrical implosions

Magnetized liner inertial fusion (MagLIF) is a fusion concept that uses magnetized, preheated fuel to reduce the implosion velocities and convergence ratios required for ignition. A scaled, laser-driven experimental platform to study MagLIF has been demonstrated on the OMEGA laser system, providing comprehensive experimental data on MagLIF scaling, utilizing the higher shot rate on OMEGA compared to the Z machine. Using this platform, a broader experimental space for MagLIF has been studied. Presented in this article are experimental results that demonstrate that the combination of preheat and magnetization enhances the neutron yield by 470% compared to a reference implosion, significantly more than the yield enhancement by the field or preheat alone. These results are achieved while maintaining a relatively low convergence ratio (<20). Here, the experiments were supported by one-, two-, and three-dimensional radiation-hydrodynamics simulations, all of which suggest that multiple sources of mix play different key roles depending on the scale of the MagLIF experiment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Extremely Metal-poor Galaxies in DESI DR1: Connections to Galaxies in the Early Universe

Extremely metal-poor galaxies (XMPGs), defined as having metallicities below 10% of the solar value, are considered possible local analogs to primordial systems and offer a unique window into early galaxy evolution. This study presents a large-scale search for XMPGs using data from the Dark Energy Spectroscopic Instrument Data Release 1, systematically evaluating their resemblance to high-redshift galaxies. From a parent sample of more than 14 million galaxies, we identify 662 (556 new) confirmed XMPGs and 763 (666 new) high-quality candidates via the direct T$_{e}$ method. Our results reveal that XMPGs follow a distinct star-forming main sequence (SFMS) that is elevated and shallower than that of the comparing star-forming galaxies. Notably, at higher stellar masses (M$_{⋆}$ > 10$^{7.5}$M$_{⊙}$), the XMPG SFMS converges with the sequence observed in high-redshift galaxies by the James Webb Space Telescope, indicating that mature XMPGs sustain star formation rates comparable to their primordial counterparts. Furthermore, XMPGs consistently deviate below the local fundamental metallicity relation, mirroring high-redshift galaxy behavior. These findings demonstrate that XMPGs not only exhibit low metallicities but also preserve scaling relations characteristic of the early Universe, confirming their potential value as local laboratories for studying early galaxy formation processes.

Sui, Jipeng [Beijing Observ.; Beijing, GUCAS] (ORC↗
DOE OSTI2020

Analytical solution for partial heating on the exterior of the pipe with application to measuring fluid flow rate

An analytical model using Green’s functions for partial external heating of a pipe is developed, which results in an exact mathematical solution for the radial and axial temperature distribution in the pipe wall. Partial heating consists of a constant heat flux function imposed over a small section of the exterior of a pipe and for a limited time duration. The solution comprises steady-state and transient parts, and an algebraic identity is used to decrease the number of summation terms in the slowly-converging steady- state part. Intrinsic verification principles are used to verify the solution. As an example application, this transient solution is applied toward the development of a simple, noninvasive method for in-field measurement of the flow rate in pipes. Furthermore, to simulate this application, a pulse of energy is imposed to the wall of the pipe, and the developed mathematical solution is used to find the flow rate of the fluid inside the pipe. An optimal experiment is designed to find the best measurement location and time.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Initial Testing of an In Situ Load Retention Aging Vessel

A thermal aging vessel instrumented with load cells was fabricated. The primary function of the vessel is to continuously monitor the in situ load retention of up to three compressed polymer coupons undergoing thermally accelerated aging under nitrogen. A secondary function is to enable gas sampling of the vessel headspace during thermal aging. Heating of the vessel is achieved using a custom heater jacket. To improve upon our conventional aging study methods which require periodic interruption of aging to perform load testing in an Instron machine at room temperature, this technology aims to automate/facilitate data acquisition/analysis, improve data quality, and enable uninterrupted compression of the polymer which represents the service condition. As an example case to assess functionality of the in situ vessel, the load retention of a siloxane elastomer material additively manufactured by direct-ink-writing (DIW) was measured at three different isothermal aging temperatures for ~1 month. Initial compression of the coupons while near the aging temperature was achieved by temporarily opening the heated vessel to access the interior chamber and manually tightening four nuts to drive the heated compression plate down onto the heated coupons. Initial testing demonstrated achievement of the primary load retention monitoring function. Unfortunately, the vessel leaked which prevented gas sampling; an active purge was used to maintain a nitrogen atmosphere. Welded or otherwise sealed joints, which could be implemented in a future design, would likely eliminate leak paths. To apply time-temperature superposition (TTS), a technique used to provide long-term prediction of the load retention from short-term isothermal data, the load retention needed to be calculated relative to the load at an estimated “equilibrium” time, after most of the transient viscoelastic physical relaxation occurred. The peak load immediately after compression could not be used as the load retention basis for two reasons: (1) age-related changes must be isolated from non-age-related physical relaxation before applying TTS and (2) the manual mechanism used to compress the specimens at the aging temperature was neither smooth nor repeatable which affected the peak load value. To better understand the effect of the mode of initial compression on the measured load, and possibly better estimate “equilibrium” physical relaxation times, systematic stress relaxation experiments were performed using an Instron machine with a thermal chamber. At a given temperature, the DIW polymer was compressed to a fixed strain in either a stepped or continuous manner at two different rates, then held at that strain for 24 hrs. The results indicated that, at a given temperature, the different stress relaxation curves appeared to converge to the same curve at some “equilibrium” time when the non-age-related physical relaxation was mostly complete. Though this observation suggests that the discontinuous manual compression employed by the vessel is feasible, a compression mechanism that is rapid, smooth, and repeatable would enhance its use.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Generalizable Evaluated Approach, Applying Advanced Geospatial Statistical Methods, to Identify High Lead Exposure Locations at Census Tract Scale: Michigan Case Study

BACKGROUND: Despite great progress in reducing environmental lead (Pb) levels, many children in the United States are still being exposed. OBJECTIVE: Our aim was to develop a generalizable approach for systematically identifying, verifying, and analyzing locations with high prevalence of children’s elevated blood Pb levels (EBLLs) and to assess available Pb models/indices as surrogates, using a Michigan case study. METHODS: We obtained ~1:9 million BLL test results of children <6 years of age in Michigan from 2006–2016; we then evaluated them for data representativeness by comparing two percentage EBLL (%EBLL) rates (number of children tested with EBLL divided by both number of children tested and total population). We analyzed %EBLLs across census tracts over three time periods and between two EBLL reference values (≥5 vs. ≥10 μg/dL) to evaluate consistency. Locations with high %EBLLs were identified by a top 20 percentile method and a Getis-Ord Gi* geospatial cluster “hotspot” analysis. For the locations identified, we analyzed convergences with three available Pb exposure models/indices based on old housing and sociodemographics. RESULTS: Analyses of 2014–2016 %EBLL data identified 11 Michigan locations via cluster analysis and 80 additional locations via the top 20 percentile method and their associated census tracts. Data representativeness and consistency were supported by a 0.93 correlation coefficient between the two EBLL rates over 11 y, and a Kappa score of ~0:8 of %EBLL hotspots across the time periods (2014–2016) and reference values. Many EBLL hotspot locations converge with current Pb exposure models/indices; others diverge, suggesting additional Pb sources for targeted interventions. DISCUSSION: This analysis confirmed known Pb hotspot locations and revealed new ones at a finer geographic resolution than previously available, using advanced geospatial statistical methods and mapping/visualization. It also assessed the utility of surrogates in the absence of blood Pb data. This approach could be applied to other states to inform Pb mitigation and prevention efforts. https://doi.org/10.1289/EHP9705

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Memory in aging colloidal gels with time-varying attraction

Here, we report a combined rheology, x-ray photon correlation spectroscopy, and modeling study of gel formation and aging in suspensions of nanocolloidal spheres with volume fractions of 0.20 and 0.43 and with a short-range attraction whose strength is tuned by changing temperature. Following a quench from high temperature, where the colloids are essentially hard spheres, to a temperature below the gel point, the suspensions form gels that undergo aging characterized by a steadily increasing elastic shear modulus and slowing, increasingly constrained microscopic dynamics. The aging proceeds at a faster rate for stronger attraction strength. When the attraction strength is suddenly lowered during aging, the gel properties evolve non-monotonically in a manner resembling the Kovacs effect in glasses, in which the modulus decreases and the microscopic dynamics become less constrained for a period before more conventional aging resumes. Eventually, the properties of the gel following the decrease in attraction strength converge to those of a gel that has undergone aging at the lower attraction strength throughout. The time scale of this convergence increases as a power law with the age at which the attraction strength is decreased and decreases exponentially with the magnitude of the change in attraction. A model for gel aging in which particles attach and detach from the gel at rates that depend on their contact number reproduces these trends and reveals that the non-monotonic behavior results from the dispersion in the rates that the populations of particles with different contact number adjust to the new attraction strength.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

An Eulerian multimaterial framework for simulating high-explosive aquarium tests

Aquarium tests of cylindrical high-explosive charges provide optical data of the detonation front velocity and shape, propagation of the shock wave in the surrounding water, and expansion rates of the detonation products behind the front. Data from aquarium experiments is often used for calibration of reactive burn models based on phenomenological equations of state (EOS) and reaction rate laws. This paper presents a multimaterial numerical modeling framework to solve the 2D axisymmetric reactive Euler equations for high-explosive aquarium tests, in particular for ammonium nitrate - fuel oil (ANFO) explosives. An extension of the Ghost Fluid Method (GFM) is used to handle the dynamic material interfaces for the ANFO explosion products, the charge-confining material (polymethyl methacrylate PMMA), and the surrounding water. This study analyzes the sensitivity of calculations (both computational efficiency and numerical accuracy) to different algorithms for the material interface models including the original GFM versus Riemann solver-based strategies. A novel method for defining the left and right states in the interfacial Riemann problem eliminates the need for sorting or nodal interpolation during the projection along the material interface. Numerical tests indicate that populating the interface node values using the Riemann solution mitigate the overheating error observed in steady-state calculations. Solution convergence and computational efficiency are explored as a function of the spatial and temporal order of the schemes. Results from the computational model with analytical equations of state and fitted reaction rate parameters show very good quantitative agreement with experimentally observed detonation front velocity, reaction products expansion, and shock wave propagation in the surrounding water for a cylindrical ANFO charge encased in PMMA. Finally, the proposed modeling framework, in conjunction with experimental tests, provides a reliable tool to assess equations of state and reaction rate expressions for reactive burn models of confined high explosives.

42 ENGINEERING↗
DOE OSTI2023

Flow friction in a wide rectangular duct with a beveled inlet: Informal Notes of Fundamental Fluid Physics Studies

Fundamental streamwise pressure distributions were measured at Idaho State University to address a primary objective of obtaining insight into the apparent evolution of air flow regimes at moderate Reynolds numbers in thin, wide rectangular ducts with converging inlets. Ducts of 3.030 and 4.077 mm spacings s (called three and four mm), having non-dimensional lengths of (L/s) ≈ 500.8 and 372.2 and widths (W/s) ≈ 114.6 and 83.2, respectively, were compared. Flow rates ranged from Reynolds numbers based on hydraulic diameter (Re Dh ) of about 980 to 10,000 and corresponding non-dimensional downstream pressure gradient parameters (-K p ) covered the range 0.038 to 0.0061, respectively.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2020

Transferable Reinforcement Learning for Smart Homes: Preprint

To harness the great amount of untapped resources at the demand side, smart home technology plays a vital role in solving the "last mile" problem in smart grid. Reinforcement learning (RL), which has demonstrated an outstanding performance in solving many sequential decision-making problems, can be a great candidate to be used in smart home control. For instance, many studies have started investigating the load scheduling problem under dynamic pricing scheme. Based on those, this study aims at providing an affordable solution to encourage a higher smart home adoption rate. Specifically, we investigate combining transfer learning (TL) with RL to reduce the training cost of an optimal RL control policy. Given an optimal policy for a benchmark home, TL can jump-start the RL training of a policy for a new home, which has different appliances and user preferences. Simulation results show that by leveraging TL, RL training converges faster and requires much less computing time for new homes that are similar to the benchmark home. In all, this study proposes a cost-effective approach for training RL control policies for homes at scale, which ultimately reduces the controller's implementation costs, increases the adoption rate of RL controllers, and makes more homes grid-interactive.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION,↗
DOE OSTI2023

A conservative, interface-resolved, compressible framework for the modeling and simulation of liquid/gas phase change

This paper presents a method for simulating evaporation in a compressible, interface-resolved framework appropriate for modeling problems of engineering interest. In order to achieve robustness and broad applicability, the method has been designed to discretely enforce consistent mass and thermal energy transport at the phase interface, to globally conserve mass, momentum, and energy, and to be capable of modeling compressible and incompressible systems. Verification is performed via the Sod-shock test, one-dimensional heat conduction, evaporation from a planar interface, and evaporation of three-dimensional droplets. Convergence with increasing mesh resolution is demonstrated in all tested configurations, and conservation is maintained near machine precision for a translating droplet. Conservation and accurate phase change rates are preserved at the low numerical resolutions commonly encountered in engineering calculations. Following verification, the method is validated by comparison to an empirical correlation for evaporating droplets in high temperature crossflow, and the presentation concludes with the simulation of an iso-octane spray at conditions representative of gasoline direct injection. In conclusion, successful verification, validation, and demonstrated practical utility suggest the method to be an accurate, efficient, and robust approach for the study of phase change in engineering systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Cloud based tool for analysis of chemical kinetic mechanisms

The size and complexity of chemical kinetic models used to simulate combustion of hydrocarbon fuels continue to increase with our improved understanding of the underlying physical mechanisms, along with the improved ability to utilize such models as the result of increased computational power and efficiency. As mechanisms grow beyond thousands of species and tens of thousands of reactions, it becomes increasingly difficult to manually check for errors and physical inconsistencies. In this work, we present several automated methods to check for such issues in the specification of chemical reaction models. First, we demonstrate how discontinuities in thermodynamic data can cause simulation difficulties manifested as long wall-clock times and convergence failures. To correct this type of problem, we describe an automated method for refitting thermodynamic parameters. We also outline several methods to check the timescales of reaction rate coefficients to ensure physical consistency. All the methods are made available through a web-based tool (https://combustiontools.llnl.gov) intended to aid mechanism developers and users to improve the accuracy and performance of fuel models used by the combustion community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Performance Characteristics of a Rotating Detonation Combustor Exiting Into a Pressurized Plenum to Simulate Gas Turbine Inlet

Abstract The present study aims to experimentally characterize the performance of a rotating detonation combustion (RDC) system integrated with a pressurized downstream plenum to simulate the high-pressure inlet conditions of power-generating gas turbines. A thorough understanding of the operational behavior including wave mode behavior, static pressure profile along the combustor length, and dynamic features of pressure fluctuations is crucial for successful integration of RDC with the turbine. In this study, two RDC configurations are investigated, RDC with a constant area annulus and RDC with a converging nozzle. In both cases, the RDC flow exited into a plenum chamber kept at pressures varying from 155 kPa to 330 kPa. RDC was operated on methane and oxygen-enriched air to represent reactants used in land-based power generation. Experiments were conducted for the two RDCs configurations operated at three reactant mass flow rates (0.23, 0.32, and 0.46 kg/s). The RDC performance is characterized by time-averaged static pressure measurements, and wave velocity determined by ionization probes. In addition, dynamic pressure measurements were recorded both inside and near the exit of RDC channel to investigate wave interactions between RDC and downstream plenum. Results show that the RDC with the converging nozzle achieved superior performance while minimizing detrimental interactions with the reflected shock and/or acoustic waves from the downstream plenum.

Engineering↗
DOE OSTI2024

Modeling plasticity-mediated void growth at the single crystal scale: A physics-informed machine learning approach

Modeling the evolution of voids during plastic flow as well as their effects on plastic dissipation is critical for both component manufacturing and lifetime estimation purposes. To this end, we propose a rate-dependent constitutive model to homogenize the effects of semi-randomly distributed voids on single crystal plasticity whilst capturing void interaction and plastic anisotropy. Here, this present work focuses on the case of face centered cubic crystals to introduce an anisotropic gauge function applicable within the crystal plasticity formalism. The approach combines analytical methods to describe the micromechanics of the system in combination with symbolic regression to capture analytically intractable mechanisms from data. The hybrid framework uses a physics-informed genetic programming-based symbolic regression algorithm to solve a multiform optimization problem simultaneously producing a new gauge function and a new strain rate equation. This is also a multi-objective optimization problem with many competing objectives. A new search and selection step is introduced to the genetic algorithm that promotes convergence toward a global solution that better satisfies all the objectives. Overall, the symbolic equations produced leverage data-driven methods to achieve greater accuracy than comparable alternatives on an analytically intractable problem while maintaining model transparency.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Multiresolution GPC-Structured Control of a Single-Loop Cold-Flow Chemical Looping Testbed

Chemical looping is a near-zero emission process for generating power from coal. It is based on a multi-phase gas-solid flow and has extremely challenging nonlinear, multi-scale dynamics with jumps, producing large dynamic model uncertainty, which renders traditional robust control techniques, such as linear parameter varying H ∞ design, largely inapplicable. This process complexity is addressed in the present work through the temporal and the spatiotemporal multiresolution modeling along with the corresponding model-based control laws. Namely, the nonlinear autoregressive with exogenous input model structure, nonlinear in the wavelet basis, but linear in parameters, is used to identify the dominant temporal chemical looping process dynamics. The control inputs and the wavelet model parameters are calculated by optimizing a quadratic cost function using a gradient descent method. The respective identification and tracking error convergence of the proposed self-tuning identification and control schemes, the latter using the unconstrained generalized predictive control structure, is separately ascertained through the Lyapunov stability theorem. The rate constraint on the control signal in the temporal control law is then imposed and the control topology is augmented by an additional control loop with self-tuning deadbeat controller which uses the spatiotemporal wavelet riser dynamics representation. The novelty of this work is three-fold: (1) developing the self-tuning controller design methodology that consists in embedding the real-time tunable temporal highly nonlinear, but linearly parametrizable, multiresolution system representations into the classical rate-constrained generalized predictive quadratic optimal control structure, (2) augmenting the temporal multiresolution loop by a more complex spatiotemporal multiresolution self-tuning deadbeat control loop, and (3) demonstrating the effectiveness of the proposed methodology in producing fast recursive real-time algorithms for controlling highly uncertain nonlinear multiscale processes. The latter is shown through the data from the implemented temporal and augmented spatiotemporal solutions of a difficult chemical looping cold flow tracking control problem.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Adaptive elasticity policies for staging-based in situ visualization

In situ processing aims to alleviate the growing gap between computation and I/O capabilities by performing data processing close to the data source. In situ processing is widely used to process data generated by multiple data sources, including observation data from edge devices or scientific observational facilities and the simulation data generated by scientific computation on a high-performance computing (HPC) platform. For a scientific workflow that is run on an HPC platform and composed of a simulation program and an in situ data analytics or visualization (abbreviated as ana/vis) task, there is an implicit assumption that the computing resources assigned to the workflow keep static during the workflow execution. However, with the converging trend between the HPC and cloud computing platform, running the in situ ana/vis task in an elastic way is promising to decrease its overhead and improve its resource utilization rate. Resource elasticity represents the ability to change resource configurations such as the number of computing nodes/processes during workflow execution. An elastic job may dynamically adjust resource configurations; it may use a few resources at the beginning and more resources toward the end of the job when interesting data appear. However, it is hard to predict a priori how many computing nodes/processes need to be added/removed during the workflow execution to adapt to changing workflow needs. How to efficiently guide elasticity operations, such as growing or shrinking the number of processes used for in situ analysis during workflow execution, is an open-ended research question. In this article, we present adaptive elasticity policies that adopt workflow runtime information collected during workflow execution to predict how to trigger the addition/removal of processes in order to minimize in situ processing overhead. Taking in situ visualization tasks as an example, we integrate the presented elasticity policies into a staging-based elastic workflow and evaluate its efficiency in multiple elasticity scenarios. Compared with the situation without elasticity or with a static elasticity policy that uses a fixed number of processes for each rescaling operation, the adaptive elasticity policy can save overhead in finding a proper resource configuration and improve resource utilization efficiency. Furthermore, one experiment illustrates that the adaptive elasticity policy saves 41% of core-hours compared with the situation without the resource elasticity.

97 MATHEMATICS AND COMPUTING↗