Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Concurrent Function Evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Asynchronously parallel optimization solver for finding multiple minima

This paper proposes and analyzes an asynchronously parallel optimization algorithm for finding multiple, high-quality minima of nonlinear optimization problems. Our multistart algorithm considers all previously evaluated points when determining where to start or continue a local optimization run. Theoretical results show that, under certain assumptions, the algorithm almost surely starts a finite number of local optimization runs and identifies, or has a single local optimization run converging to, every minimum. The algorithm is applicable to general optimization settings, but our numerical results focus on the case when derivatives are unavailable. In numerical tests, a PYTHON implementation of the algorithm is shown to yield good approximations of many minima (including a global minimum), and this ability scales well with additional resources. Our implementation’s time to solution is shown also to scale well even when the time to evaluate the function evaluation is highly variable.

97 MATHEMATICS AND COMPUTING↗

Optimization and supervised machine learning methods for fitting numerical physics models without derivatives

Here, we address the calibration of a computationally expensive nuclear physics model for which derivative information with respect to the fit parameters is not readily available. Of particular interest is the performance of optimization-based training algorithms when dozens, rather than millions or more, of training data are available and when the expense of the model places limitations on the number of concurrent model evaluations that can be performed. As a case study, we consider the Fayans energy density functional model, which has characteristics similar to many model fitting and calibration problems in nuclear physics. We analyze hyperparameter tuning considerations and variability associated with stochastic optimization algorithms and illustrate considerations for tuning in different computational settings.

97 MATHEMATICS AND COMPUTING↗

libEnsemble: A Library to Coordinate the Concurrent Evaluation of Dynamic Ensembles of Calculations

Almost all applications stop scaling at some point; those that don't are seldom performant when considering time to solution on anything but aspirational/unicorn resources. Recognizing these tradeoffs as well as greater user functionality in a near-term exascale computing era, we present libEnsemble, a library aimed at particular scalability- and capability-stretching uses. libEnsemble enables running concurrent instances of an application in dynamically allocated ensembles through an extensible Python library. Here, we highlight the structure, execution, and capabilities of the library on leading pre-exascale environments as well as advanced capabilities for exascale environments and beyond.

97 MATHEMATICS AND COMPUTING↗

ICDARTS: Improving the Stability of Cyclic DARTS

Cyclic DARTS (CDARTS) is a Differentiable Architecture Search (DARTS)-based approach to neural architecture search (NAS) that uses a cyclic feedback mechanism to train search and evaluation networks concurrently. This training protocol aims to optimize the search process and evaluate the deep evaluation network comprised of discretized candidate operations. However, this approach introduces a loss function for the evaluation network dependent on the search network. The dissimilarity between the evaluation network’s loss function used during the search and retraining phases results in a search network that is a sub-optimal proxy for the final evaluation network accessed during retraining. We present a revised approach that removes the dependency of the evaluation network weights upon those of the search network. In addition, we introduce a modified process for relaxing the search network’s zero operations that allows these operations to be retained in the final evaluation networks.

Herron, Emily↗

Evaluating Optimization Strategies for Engine Simulations Using Machine Learning Emulators

This work evaluates different optimization algorithms for computational fluid dynamics (CFD) simulations of engine combustion. Due to the computational expense of CFD simulations, emulators built with machine learning algorithms were used as surrogates for the optimizers. Two types of emulators were used: a Gaussian process (GP) and a weighted variety of machine learning methods called SuperLearner (SL). The emulators were trained using a dataset of 2048 CFD simulations that were run concurrently on a supercomputer. The design of experiments (DOE) for the CFD runs was obtained by perturbing nine input parameters using a Monte-Carlo method. The CFD simulations were of a heavy duty engine running with a low octane gasoline-like fuel at a partially premixed compression ignition mode. Ten optimization algorithms were tested, including types typically used in research applications. Each optimizer was allowed 800 function evaluations and was randomly tested 100 times. The optimizers were evaluated for the median, minimum, and maximum merits obtained in the 100 attempts. Some optimizers required more sequential evaluations, thereby resulting in longer wall clock times to reach an optimum. The best performing optimization methods were particle swarm optimization (PSO), differential evolution (DE), GENOUD (an evolutionary algorithm), and micro-genetic algorithm (GA). These methods found a high median optimum as well as a reasonable minimum optimum of the 100 trials. Moreover, all of these methods were able to operate with less than 100 successive iterations, which reduced the wall clock time required in practice. Two methods were found to be effective but required a much larger number of successive iterations: the DIRECT and MALSCHAINS algorithms. A random search method that completed in a single iteration performed poorly in finding optimum designs but was included to illustrate the limitation of highly concurrent search methods. The last three methods, Nelder–Mead, bound optimization by quadratic approximation (BOBYQA), and constrained optimization by linear approximation (COBYLA), did not perform as well.

Probst, Daniel M.↗

LibERI—A portable and performant multi-GPU accelerated library for electron repulsion integrals via OpenMP offloading and standard language parallelism

A portable and performant graphics processing unit (GPU)-accelerated library for electron repulsion integral (ERI) evaluation, named LibERI, has been developed and implemented via directive-based (e.g., OpenMP and OpenACC) and standard language parallelism (e.g., Fortran DO CONCURRENT). Offloaded ERIs consist of integrals over low and high contraction s, p, and d functions using the rotated-axis and Rys quadrature methods. GPU codes are factorized based on previous developments with two layers of integral screening and quartet presorting. In this work, the density screening is moved to the GPU to enhance the computational efficacy for large molecular systems. Here, the L-shells in the Pople basis set are also separated into pure S and P shells to increase the ERI homogeneity and reduce atomic operations and the memory footprint. LibERI is compatible with any quantum chemistry drivers supporting the MolSSI Driver Interface. Benchmark calculations of LibERI interfaced with the GAMESS software package were carried out on various GPU architectures and molecular systems. The results show that the LibERI performance is comparable to other state-of-the-art GPU-accelerated codes (e.g., TeraChem and GMSHPC) and, in some cases, outperforms conventionally developed ERI CUDA kernels (e.g., QUICK) while fully maintaining portability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Disturbance triggers non-linear microbe–environment feedbacks

Abstract. Conceptual frameworks linking microbial community membership, properties, and processes with the environment and emergent function have been proposed but remain untested. Here we refine and test a recent conceptual framework using hyporheic zone sediments exposed to wetting–drying transitions. Our refined framework includes relationships between cumulative properties of a microbial community (e.g., microbial membership, community assembly properties, and biogeochemical rates), environmental features (e.g., organic matter thermodynamics), and emergent ecosystem function. Our primary aim was to evaluate the hypothesized relationships that comprise the conceptual framework and contrast outcomes from the whole and putatively active bacterial and archaeal communities. Throughout the system we found threshold-like responses to the duration of desiccation. Membership of the putatively active community – but not the whole bacterial and archaeal community – responded due to enhanced deterministic selection (an emergent community property). Concurrently, the thermodynamic properties of organic matter (OM) became less favorable for oxidation (an environmental component), and respiration decreased (a microbial process). While these responses were step functions of desiccation, we found that in deterministically assembled active communities, respiration was lower and thermodynamic properties of OM were less favorable. Placing the results in context of our conceptual framework points to previously unrecognized internal feedbacks that are initiated by disturbance and mediated by thermodynamics and that cause the impacts of disturbance to be dependent on the history of disturbance.

59 BASIC BIOLOGICAL SCIENCES↗

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗

Dynamic development of geochemical reaction fronts during hydraulic stimulation of shale

Injection of acidic hydraulic fracture fluid (HFF) into shale formations for unconventional oil/gas production results in chemical reactions in the shale matrix that can alter fluid transport. Here, we report the results of set of experiments designed to evaluate the impact of calcite dissolution as a function of carbonate mineral content on matrix chemical reactivity and pore-space modification concomitant with imbibition. In this study, we tracked acidic HFF transport in four samples of Wolfcamp shale with calcite contents varying from 4% to 59% by monitoring the rate and spatial extent of bromide tracer transport using synchrotron-based X-ray fluorescence microprobe (XFM) imaging. Concurrently, we also carried out XFM imaging of the spatial distribution of Ca in the Wolfcamp shale cores (as a proxy of calcite distribution). Our approach thus yields a direct record of time-resolved selective ion transport resulting from the penetration of acidic HFF and the associated mineral transformations in the shale cores. We show that the variability in calcite content of Wolfcamp shale samples can directly affect the rate and spatial extent of imbibition. Although reaction of the acidic HFF with carbonates in shales enhances calcite dissolution and increases porosity, the spatial extent of calcite dissolution in the shale matrix is limited due to a rapid neutralization of pH. The relative abundance and spatial distribution of calcite control the chemical saturation state of the HFF progressing into the matrix. As a result, calcite has a major impact on the spatial extent and rate of matrix alteration and thus on HFF transport during subsurface reservoir stimulation. Consequently, increased calcite content in the shale matrix inhibits the spatial extent of the pore-volume increase and, by extension, the spatial extent and rate of imbibition. Our results thus show that the overall rates of calcite dissolution approach the rates of acidic HFF transport (i.e., Damköhler number ~1), which could contribute to the efficiency of subsurface reservoir stimulation. A better understanding of HFF-calcite reaction rates is crucial for improving the prediction and optimization of fluid transport across HFF-shale interfaces during hydraulic fracturing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 512 cores demonstrate that AMRIC improves the compression ratio by 81X and the I/O performance by 39X over AMReX's original compression solution.

Wang, Daoce↗

Fire and Drought Affect Multiple Aspects of Diversity in a Migratory Bird Stopover Community

Drought and high-severity, stand-replacing wildfires can have substantial impacts on the composition of avian communities, including stop-over communities during migration. An inextricable link exists between drought and wildfire, each operating and impacting across different timescales. Many studies have found nonlinear avian abundance trends in breeding community time series data that include pre- and post-fire observations, describing an initial decrease in abundance followed by rapid increases that can attenuate over time. Here, we use a fall bird-banding dataset to evaluate shifts in a drought-impacted avian community following wildfire from taxonomic, functional, and phylogenetic perspectives. We looked at the community as a whole and also categorized birds as residents, migrants, and breeders to assess potential varying responses at the study site. We observed post-fire shifts in functional and phylogenetic diversity that corresponded to changes in vegetation. An influx of migratory insectivores post-fire drove much of the variation between pre- and post-fire avian communities and toward a more related, less phylogenetically dispersed community. A concurrent monsoon season drought was also associated with functional and phylogenetic diversity, highlighting the intertwined pulse press effects on avian communities. Overall, our results suggest that, although bird communities are immediately impacted by fire-driven resource changes, they can rebound over time, it is unclear how long-term drought may continue to shape the composition of these avian communities.

59 BASIC BIOLOGICAL SCIENCES↗

RANGERS: Methodology Report on Design and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

Salt formations are one of the potential host rocks for the final disposal of high-level radioactive waste (HLW) in deep geological repositories, both in Germany and the United States. The safe isolation of radioactive waste in these repositories relies on a multi-barrier system, combining engineered and natural barriers. The natural barrier is provided by the salt rock itself, known for its self-sealing properties and long-term stability. The engineered barrier, on the other hand, comprises sealing components strategically placed within the repository to enhance its containment capabilities. In both Germany and the United States, long-term safety assessments require demonstrating the integrity of the natural barrier for a period of up to 1 million years. Concurrently, the engineered barrier system (EBS) must maintain its structural and functional integrity until the long-term sealing, such as the granular salt backfill material, has re-consolidated to its final low porosity and permeability. Based on extensive expertise and experience with engineered barriers in salt formations, BGE TECHNOLOGY GmbH and Sandia National Laboratories have partnered to develop a robust methodology for the integrity and performance assessment of EBS in HLW repositories through the RANGERS project. This collaborative effort aims to establish a unified approach to geotechnical engineering, repository design, integrity and performance evaluation of EBS in salt repositories.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Enriched immersed finite element and isogeometric analysis: algorithms and data structures

Immersed finite element methods provide a convenient analysis framework for problems involving geometrically complex domains, such as those found in topology optimization and microstructures for engineered materials. However, their implementation remains a major challenge due to, among other things, the need to apply nontrivial stabilization schemes and generate custom quadrature rules. This article introduces the robust and computationally efficient algorithms and data structures comprising an immersed finite element preprocessing framework. The input to the preprocessor consists of a background mesh and one or more geometries defined on its domain. The output is structured into groups of elements with custom quadrature rules formatted such that common finite element assembly routines may be used without or with only minimal modifications. The key to the preprocessing framework is the construction of material topology information, concurrently with the generation of a quadrature rule, which is then used to perform enrichment and generate stabilization rules. While the algorithmic framework applies to a wide range of immersed finite element methods using different types of meshes, integration, and stabilization schemes, the preprocessor is presented within the context of the extended isogeometric analysis. This method utilizes a structured B-spline mesh, a generalized Heaviside enrichment strategy considering the material layout within individual basis functions’ supports, and face-oriented ghost stabilization. Using a set of examples, the effectiveness of the enrichment and stabilization strategies is demonstrated alongside the preprocessor’s robustness in geometric edge cases. Additionally, the performance and parallel scalability of the implementation are evaluated.

Computer implementation↗