Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evolutionary algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Exploring stellar evolution models of sdB stars using MESA

Stellar evolution calculations have had great success reproducing the observed atmospheric properties of different classes of stars. Recent detections of g-mode pulsations in evolved He burning stars allow a rare comparison of their internal structure with stellar models. Asteroseismology of subdwarf B (sdB) stars suggests convective cores of 0.22–0.28 M{sub ⊙}, ≳45% of the total stellar mass. Previous studies found significantly smaller convective core masses (≲0.19 M{sub ⊙}) at a comparable evolutionary stage. We evolved stellar models with Modules for Experiments in Stellar Astrophysics (MESA) to explore how well the interior structures inferred from asteroseismology can be reproduced by standard algorithms. Our qualitative evolutionary paths, position in the logg−T{sub eff} diagram, and model timescales are consistent with previous results. The sdB masses from our full evolutionary sequences fall within the range of the empirical sdB mass distribution, but are nearly always lower than the median. Using standard MLT with atomic diffusion we find convective core masses of ∼0.17–0.18 M{sub ⊙}, averaged over the entire sdB lifetime. We can increase the convective core sizes to be as large as those inferred from asteroseismology, but only for extreme values of the overshoot parameter (overshoot gives numerically unstable and physically unrealistic behavior at the boundary). High resolution three-dimensional simulations of turbulent convection in stars suggest that the Schwarzschild criterion for convective mixing systematically underestimates the actual extent of mixing because a boundary layer forms. Accounting for this would decrease the errors in both sdB total and convective core masses.

79 ASTRONOMY AND ASTROPHYSICS↗

MCNP6 Monte Carlo Code Optimization [Slides]

The MCNP6.1 Monte Carlo code, released in 2013, offers many features not available in previous versions, but runs 20-30% slower for most problems and 2-5x slower for some problems. The MCNP 2020 initiative was established in mid-2013 to address code performance and other issues, with 3 basic components: (1) Improve MCNP performance, with the specific goal of achieving a 2x performance gain within 2 years; (2) Upgrade the core MCNP software and algorithms in an evolutionary fashion, with the goal of achieving more agile and sustainable code; (3) Prepare for future exascale systems that will include massive parallelism and limited memory per core, with the goal of providing flexible and adaptable coding for possible exascale systems. This talk reviews the initial performance improvements to MCNP6.1 that have been incorporated into the 2014 update, MCNP6.1.1. The performance improvements to date have included both classic code optimizations and algorithm improvements. Testing on a variety of problems has demonstrated that the performance improvements were effective, yielding speedups by factors of 1.2x - 4x compared to MCNP6.1, depending on the type of problem. For criticality problems, MCNP6.1.1 runs 1.5x - 1.7x faster than MCNP6.1. Much more work is planned for improving MCNP6 performance, structure, and algorithms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Ethane and methane at high pressures: Structure and stability

We have performed a combined experimental and theoretical study of ethane and methane at high pressures of up to 120 GPa at 300 K using x-ray diffraction and Raman spectroscopies and the USPEX ab initio evolutionary structural search algorithm, respectively. For ethane, we have determined the crystallization point, for room temperature, at 2.7 GPa and also the low pressure crystal structure (phase A). This crystal structure is orientationally disordered (plastic phase) and deviates from the known crystal structures for ethane at low temperatures. Moreover, a pressure induced phase transition has been identified, for the first time, at 13.6 GPa to a monoclinic phase B, the structure of which is solved based on good agreement with the experimental results and theoretical predictions. For methane, our x-ray diffraction measurements are in agreement with the previously reported high-pressure structures and equation of state (EOS). Finally, we have determined the EOSs of ethane and methane, which provides a solid basis for the discussion of their relative stability at high pressures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Tools for Accurate and Efficient Analysis of Complex Evolutionary Mechanisms in Microbial Genomes (Final Report)

I proposed to develop computationally efficient tools for accurate detection and reconstruction of microbes' complex evolutionary mechanisms, thus enabling rapid and accurate annotation, analysis and understanding of their genomes. To achieve this goal, I proposed to address three aspects. (1) Mathematical modeling. A major challenge facing the accurate detection of HGT is that of distinguishing between these two events on the one hand and other events that have similar "effects." I proposed to develop a novel mathematical approach for distinguishing among these events. Further, I proposed to develop a set of novel optimization criteria for the evolutionary analysis of microbial genomes in the presence of these complex evolutionary events. (2) Algorithm design. In this aspect of the project, I proposed to develop an array of efficient and accurate algorithms for analyzing microbial genomes based on the formulated optimization criteria. Further, I proposed to test the viability of the criteria and the accuracy of the algorithms in an experimental setting using both synthetic as well as biological data. (3) Software development. I proposed the final outcome to be a suite of software tools which implements the mathematical models as well as the algorithms developed.

59 BASIC BIOLOGICAL SCIENCES↗

Theoretical Investigation of Delafossite-Cu 2 ZnSnO 4 as a Promising Photovoltaic Absorber

In the quest for efficient and cost-effective photovoltaic absorber materials beyond silicon, considerable attention has been directed toward exploring alternatives. One such material, zincblende-derived Cu2ZnSnS4 (CZTS), has shown promise due to its ideal band gap size and high absorption coefficient. However, challenges such as structural defects and secondary phase formation have hindered its development. In this study, we examine the potential of another compound, Cu2ZnSnO4 (CZTO), with a similar composition to CZTS as a promising alternative. Employing ab initio density function theory (DFT) calculations in combination with an evolutionary structure prediction algorithm, we identify that the crystalline phase of delafossite structure is the most stable among the 900 (meta)stable CZTO. Its thermodynamic stability at room temperature is also confirmed by the molecular dynamics study. Excitingly, this new phase of CZTO displays a direct band gap where the dipole-allowed transition occurs, making it a strong candidate for efficient light absorptions. Furthermore, the estimation of spectroscopic limited maximum efficiency (SLME) directly demonstrates the high potential of delafossite-CZTO as a photovoltaic absorber. Our numerical results suggest that delafossite-CZTO holds promise for future photovoltaic applications.

14 SOLAR ENERGY↗

ECNet is an evolutionary context-integrated deep learning framework for protein engineering

Abstract Machine learning has been increasingly used for protein engineering. However, because the general sequence contexts they capture are not specific to the protein being engineered, the accuracy of existing machine learning algorithms is rather limited. Here, we report ECNet (evolutionary context-integrated neural network), a deep-learning algorithm that exploits evolutionary contexts to predict functional fitness for protein engineering. This algorithm integrates local evolutionary context from homologous sequences that explicitly model residue-residue epistasis for the protein of interest with the global evolutionary context that encodes rich semantic and structural features from the enormous protein sequence universe. As such, it enables accurate mapping from sequence to function and provides generalization from low-order mutants to higher-order mutants. We show that ECNet predicts the sequence-function relationship more accurately as compared to existing machine learning algorithms by using ~50 deep mutational scanning and random mutagenesis datasets. Moreover, we used ECNet to guide the engineering of TEM-1 β-lactamase and identified variants with improved ampicillin resistance with high success rates.

59 BASIC BIOLOGICAL SCIENCES↗

An adaptive granular representative volume element model with an evolutionary periodic boundary for hierarchical multiscale analysis

The hierarchical multiscale analysis normally utilizes a microscopic representative volume element (RVE) model to capture path/history-dependent macroscopic responses instead of using phenomenological constitutive models. However, for problems involving large deformation, the current RVE model used in geomechanics may lose representative properties due to the progressive distortion of the RVE box, unless a proper reinitialization is applied. This work develops an adaptive RVE model in conjunction with an evolutionary periodic boundary (EPB) algorithm for hierarchical multiscale analysis of granular materials undergoing large deformation based on a recent RVE model proposed for coupling molecular dynamics and the material point method. The proposed adaptive RVE model avoids the reinitialization of the RVE box that even undergoes extremely large shear deformation; meanwhile, it accounts for the deformation history of the RVE model and treats the interaction between boundary particles and other image particles in a more efficient way. Numerical examples with extremely large deformation are used to illustrate the adaptive granular RVE model enhanced by the proposed EPB algorithm. Furthermore, some key features of this new methodology are further discussed for clarification.

42 ENGINEERING↗

Deep Reinforcement Learning Based Control of Wind Turbines for Fast Frequency Response

In order to fulfill vital auxiliary grid services, such as load regulation, spin and non-spin reserve provision, and frequency support during emergencies, there is often a requirement for certain wind farms to operate in de-loaded modes. Leveraging the swift response capabilities of wind farms, this study demonstrates that reserving power in de-loaded modes can significantly enhance power grid stability and reliability during system contingencies. Controlling wind farms optimally for frequency support is intricate due to the nonlinearity of models and controllers and the complexity of wind farm interactions with power systems. Here, to address this challenge, this paper introduces a novel approach that integrates wind turbines into reinforcement learning-based solutions for frequency response. This innovative methodology utilizes the state-of-the-art reinforcement learning algorithm known as the surrogate-gradient-based evolutionary strategy. The proposed learning-based algorithm provides continuous control of wind farm output to rapidly stabilize system frequency and prevent unnecessary trips of under-frequency load shedding relays. To facilitate efficient training, parallel computing techniques are employed. The proposed methodology is evaluated on a modified IEEE-39 bus system, and simulation results reveal its efficacy in reliably supporting power system frequency and preventing the need for unnecessary load shedding.

Gao, Wei [Argonne National Laboratory (ANL), Argon↗

Reinforcement learning in discrete action space applied to inverse defect design

Abstract Reinforcement learning (RL) algorithms that include Monte Carlo Tree Search (MCTS) have found tremendous success in computer games such as Go, Shiga and Chess. Such learning algorithms have demonstrated super-human capabilities in navigating through an exhaustive discrete action search space. Motivated by their success in computer games, we demonstrate that RL can be applied to inverse materials design problems. We deploy RL for a representative case of the optimal atomic scale inverse design of extended defects via rearrangement of chalcogen (e.g. S) vacancies in 2D transition metal dichalcogenides (e.g. MoS 2 ). These defect rearrangements and their dynamics are important from the perspective of tunable phase transition in 2D materials i.e. 2H (semi-conducting) to 1T (metallic) in MoS 2 . We demonstrate the ability of MCTS interfaced with a reactive molecular dynamics simulator to efficiently sample the defect phase space and perform inverse design—starting from randomly distributed S vacancies, the optimal defect rearrangement of defects corresponds a line defect of S vacancies. We compare MCTS performance with evolutionary optimization i.e. genetic algorithms and show that MCTS converges to a better optimal solution (lower objective) and in fewer evaluations compared to GA. We also comprehensively evaluate and discuss the effect of MCTS hyperparameters on the convergence to solution. Overall, our study demonstrates the effectives of using RL approaches that operate in discrete action space for inverse defect design problems.

42 ENGINEERING↗

Parallel time integration software

This package implements an optimal-scaling multigrid solver for the (non) linear systems that arise from the discretization of problems with evolutionary behavior. Typically, solution algorithms for evolution equations are based on a time-marching approach, solving sequentially for one time step after the other. Parallelism in these traditional time-integrarion techniques is limited to spatial parallelism. However, current trends in computer architectures are leading twards system with more, but not faster. processors. Therefore, faster compute speeds must come from greater parallelism. One approach to achieve parallelism in time is with multigrid, but extending classical multigrid methods for elliptic poerators to this setting is a significant achievement. In this software, we implement a non-intrusive, optimal-scaling time-parallel method based on multigrid reduction techniques. The examples in the package demonstrate optimality of our multigrid-reduction-in-time algorithm (MGRIT) for solving a variety of parabolic equations in two and three sparial dimensions. These examples can also be used to show that MGRIT can achieve significant speedup in comparison to sequential time marching on modern architectures.

Source record↗

Density-driven ionization potential depression and its effects on material properties

Changes in ionization potential at high density drive changes in material transport properties and often in crystal structure and equation of state. Current models used to describe and predict these effects have not been tested in regimes much beyond ~200 GPa, because of limitations in experimental techniques. Now, however, high-energy laser facilities with flexible pulse-shaping capabilities have made it possible to reach pressures in the 1000 GPa range, while maintaining temperatures below 1 eV. We have used these new methods to ramp-compress cobalt and magnesium and have measured shifts in the k-shell emission lines to infer changes in ionization stage, and x-ray diffraction to measure changes in crystal structure. In the case of cobalt, commonly-used detailed models for effective ionization based on isolated-atom electronic structure are shown to give the wrong answer, while self-consistent density-functional-theory-based models reproduce the data well. In the case of magnesium, zero-kelvin density functional theory predictions of density-driven electron localization in lattice interstitials (so-called electride phases) at high pressure are found to be too simple to describe material evolution along a laser ramp-compression pathway. Instead, by a combination of experiment, first-principles theory and evolutionary structure-searching algorithms, we have discovered several unexpected lower-symmetry metastable structures. First principles results find that the density of localized interstitial charge in the high-pressure magnesium phases is too low to be measurable with x-ray diffraction, and the body of theory work which has predicted high pressure electride phases for many systems, based on analysis of electron localization function, needs to be re-examined.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Parallel time integration software

This package implements an optimal-scaling multigrid solver for the (non) linear systems that arise from the discretization of problems with evolutionary behavior. Typically, solution algorithms for evolution equations are based on a time-marching approach, solving sequentially for one time step after the other. Parallelism in these traditional time-integrarion techniques is limited to spatial parallelism. However, current trends in computer architectures are leading twards system with more, but not faster. processors. Therefore, faster compute speeds must come from greater parallelism. One approach to achieve parallelism in time is with multigrid, but extending classical multigrid methods for elliptic poerators to this setting is a significant achievement. In this software, we implement a non-intrusive, optimal-scaling time-parallel method based on multigrid reduction techniques. The examples in the package demonstrate optimality of our multigrid-reduction-in-time algorithm (MGRIT) for solving a variety of parabolic equations in two and three sparial dimensions. These examples can also be used to show that MGRIT can achieve significant speedup in comparison to sequential time marching on modern architectures.

Source record↗

DEVELOPMENT AND APPLICATION OF RISK ANALYSIS TOOLKIT FOR PLANT RESOURCE OPTIMIZATION

This paper presents the development of methods and tools that are being designed to optimize plant operations (e.g., maintenance/replacement schedules and optimal maintenance postures for plant components) in a manner that is more cost effective than current approaches and makes better use of available component health and cost data. These methods include both data- and model-based optimization methods. Model-based optimization methods directly include reliability and cost models to determine an optimal plant operational strategy. We consider gradient-based and evolutionary (based on genetic algorithms) optimization methods. The second class of methods target more specific use cases (e.g., project schedule optimization) and are not based on reliability models directly, but they require specific component reliability and cost data. This class of methods is based on variants of the knapsack problem with an aim to determine an optimal project schedule that maximizes the overall NPV. This paper also presents multi-objective methods designed to identify an optimal maintenance posture based on a Pareto frontier analysis. Rather than dictating the “right” tradeoff (i.e., identify the absolute best posture), we show how it is possible to perform a trade space exploration approach (i.e., identify value and costs of several postures and let the analysis account for desired value and cost metrics). This is performed by identifying maintenance postures that maximize value (e.g., system availability) and minimize operational costs, i.e., the Pareto frontier in a value-cost trade space. For all these methods we present detailed applicative examples that show their validity from a decision-making perspective.

97 - MATHEMATICS AND COMPUTING↗

Utilizing Genetic Programming to Identify Failures in ICS Networks

Previously, researchers have attempted to apply machine learning techniques to network anomaly detection problems. Due to the staggering amount of variety that can occur in normal networks, the results have often been underwhelming. These challenges are far less pronounced when considering industrial control system (ICS) networks. The recurrent nature of these networks results in less noise and more consistent patterns for a machine learning algorithm to recognize. Here, we propose a method of evolving decision trees through genetic programming (GP) in order to detect network anomalies, such as device outages. Our approach extracts over a dozen features from network packet captures and netflows, normalizes them, and relates them in decision trees using fuzzy logic operators. Furthermore, the trees were used to detect three specific network events from three different points on the network across a statistically significant number of runs and achieved 100% accuracy on five of the nine experiments. When the trees attempted to detect more challenging events at points of presence further from the occurrence, the accuracy averaged to above 98%. Finally, using our method, all of the evolutionary cycles of the GP algorithm are computed a-priori, allowing the best resultant trees to be deployed as semi-real-time sensors with little overhead.

97 MATHEMATICS AND COMPUTING↗

Island model for parallel evolutionary optimization of spiking neuromorphic computing

Parallel genetic algorithms (PGAs) can be used to accelerate optimization by exploiting large-scale computational resources. In this work, we describe a PGA framework for evolving spiking neural networks (SNNs) for neuromorphic hardware implementation. The PGA framework is based on an islands model with migration. We show that using this framework, better SNNs for neuromorphic systems can be evolved faster.

Schuman, Catherine↗

Determining best practices for using genetic algorithms in molecular discovery

Genetic algorithms (GAs) are a powerful tool to search large chemical spaces for inverse molecular design. However, GAs have multiple hyperparameters that have not been thoroughly investigated for chemical space searches. In this tutorial, we examine the general effects of a number of hyperparameters, such as population size, elitism rate, selection method, mutation rate, and convergence criteria, on key GA performance metrics. Here, we show that using a self-termination method with a minimum Spearman’s rank correlation coefficient of 0.8 between generations maintained for 50 consecutive generations along with a population size of 32, a 50% elitism rate, three-way tournament selection, and a 40% mutation rate provides the best balance of finding the overall champion, maintaining good coverage of elite targets, and improving relative speedup for general use in molecular design GAs.

36 MATERIALS SCIENCE↗

NeoN: Neuromorphic Control for Autonomous Robotic Navigation

In this paper we describe the use of a new neuromorphic computing framework to implement the navigation system for a roaming, obstacle avoidance robot. Using a Dynamic Adaptive Neural Network Array (DANNA) structure, our TENNLab (Laboratory of Tennesseans Exploring Neural Networks) hardware/software co-design framework and evolutionary optimization (EO) as the training algorithm, we create, train, implement, and test a spiking neural network autonomous robot control system using an array of neuromorphic computing elements built on an FPGA. The simplicity and flexibility of the DANNA neuromorphic computing elements allow for sufficient scale and connectivity on a Xilinx Kintex-7 FPGA to support sensory input and motor control for a mobile robot to navigate a dynamically changing environment. We further describe how more complex capabilities can be added using the same platform, e.g. object identification and tracking.

Mitchell, J. Parker↗