Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evolutionary optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Variational quantum reinforcement learning via evolutionary optimization

Abstract Recent advances in classical reinforcement learning (RL) and quantum computation point to a promising direction for performing RL on a quantum computer. However, potential applications in quantum RL are limited by the number of qubits available in modern quantum devices. Here, we present two frameworks for deep quantum RL tasks using gradient-free evolutionary optimization. First, we apply the amplitude encoding scheme to the Cart-Pole problem, where we demonstrate the quantum advantage of parameter saving using amplitude encoding. Second, we propose a hybrid framework where the quantum RL agents are equipped with a hybrid tensor network-variational quantum circuit (TN-VQC) architecture to handle inputs of dimensions exceeding the number of qubits. This allows us to perform quantum RL in the MiniGrid environment with 147-dimensional inputs. The hybrid TN-VQC architecture provides a natural way to perform efficient compression of the input dimension, enabling further quantum RL applications on noisy intermediate-scale quantum devices.

97 MATHEMATICS AND COMPUTING↗

Eco-evolutionary optimality as a means to improve vegetation and land-surface models

Global vegetation and land-surface models embody interdisciplinary scientific understanding of the behaviour of plants and ecosystems, and are indispensable to project the impacts of environmental change on vegetation and the interactions between vegetation and climate. Furthermore, systematic errors and persistently large differences among carbon and water cycle projections by different models highlight the limitations of current process formulations. In this review, focusing on core plant functions in the terrestrial carbon and water cycles, we show how unifying hypotheses derived from eco-evolutionary optimality (EEO) principles can provide novel, parameter-sparse representations of plant and vegetation processes. We present case studies that demonstrate how EEO generates parsimonious representations of core, leaf-level processes that are individually testable and supported by evidence. EEO approaches to photosynthesis and primary production, dark respiration and stomatal behaviour are ripe for implementation in global models. EEO approaches to other important traits, including the leaf economics spectrum and applications of EEO at the community level are active research areas. Independently tested modules emerging from EEO studies could profitably be integrated into modelling frameworks that account for the multiple time scales on which plants and plant communities adjust to environmental change.

59 BASIC BIOLOGICAL SCIENCES↗

SNNVis: Visualizing Graph Embedding of Evolutionary Optimization for Spiking Neural Networks

While Spiking Neural Networks (SNNs) show a lot of promise, it is difficult to optimize them because applying traditional gradient-based optimization techniques is difficult. Even though evolutionary algorithms (EAs) have been shown to promise to optimize SNNs, understanding the relationship between evolving the characteristics of SNNs and their performance to improve the optimization algorithm is challenging because of the complex characteristics and huge population size. We propose visual analytics with novel graph embedding for evolutionary SNNs to address the challenges. While existing graph embedding techniques have limitations in preserving the specific features of the nodes and edges, our approach maintains them. Also, we develop visual analytics for understanding the relationship between the network performance and the features of nodes and edges and exploring and analyzing the evolving SNNs to build insights into improving the EA.

Chae, Junghoon [ORNL] (ORCID:0000000206016746)↗

MOOSE ProbML: Parallelized probabilistic machine learning and uncertainty quantification for computational energy applications

Here, this paper presents the development and demonstration of massively parallel probabilistic machine learning (ML) and uncertainty quantification (UQ) capabilities within the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open-source computational platform for parallel finite element and finite volume analyses. In addressing the computational expense and uncertainties inherent in complex multiphysics simulations, this paper integrates Gaussian process (GP) variants, active learning, Bayesian inverse UQ, adaptive forward UQ, Bayesian optimization, evolutionary optimization, and Markov chain Monte Carlo (MCMC) within MOOSE. It also elaborates on the interaction among key MOOSE systems — Sampler, MultiApp, Reporter, and Surrogate — in enabling these capabilities. The modularity offered by these systems enables development of a multitude of probabilistic ML and UQ algorithms in MOOSE. Example code demonstrations include parallel active learning and parallel Bayesian inference via active learning. The impact of these developments is illustrated through five applications relevant to computational energy applications: UQ of nuclear fuel fission product release, using parallel active learning Bayesian inference; very rare events analysis in nuclear microreactors using active learning; advanced manufacturing process modeling using multi-output GPs (MOGPs) and dimensionality reduction; fluid flow using deep GPs (DGPs); and tritium transport model parameter optimization for fusion energy, using batch Bayesian optimization. These capabilities are part of the MOOSE framework.

97 - MATHEMATICS AND COMPUTING↗

Multi-objective optimization of root phenotypes for nutrient capture using evolutionary algorithms

Root phenotypes are avenues to the development of crop cultivars with improved nutrient capture, which is an important goal for global agriculture. The fitness landscape of root phenotypes is highly complex and multidimensional. It is difficult to predict which combinations of traits (phene states) will create the best performing integrated phenotypes in various environments. Brute force methods to map the fitness landscape by simulating millions of phenotypes in multiple environments are computationally challenging. Evolutionary optimization algorithms may provide more efficient avenues to explore high dimensional domains such as the root phenotypic space. We coupled the three-dimensional functional–structural plant model, SimRoot, to the Borg Multi-Objective Evolutionary Algorithm (MOEA) and the evolutionary search over several generations facilitated the identification of optimal root phenotypes balancing trade-offs across nutrient uptake, biomass accumulation, and root carbon costs in environments varying in nutrient availability. Our results show that several combinations of root phenes generate optimal integrated phenotypes where performance in one objective comes at the cost of reduced performance in one or more of the remaining objectives, and such combinations differed for mobile and non-mobile nutrients and for maize (a monocot) and bean (a dicot). Functional–structural plant models can be used with multi-objective optimization to identify optimal root phenotypes under various environments, including future climate scenarios, which will be useful in developing the more resilient, efficient crops urgently needed in global agriculture.

59 BASIC BIOLOGICAL SCIENCES↗

Is the exquisite specificity of lymphocytes generated by thymic selection or due to evolution?

We have previously argued that the antigen receptors of T and B lymphocytes evolved to be sufficiently specific to avoid massive deletion of clonotypes by negative selection. Their optimal ‘specificity’ level, i.e., probability of binding any particular epitope, was shown to be inversely related to the number of self-antigens that the cells have to be tolerant to. Experiments have demonstrated that T lymphocytes also become more specific during negative selection in the thymus, because cells expressing the most crossreactive receptors have the highest likelihood of binding a self-antigen, and hence to be tolerized (i.e., deleted, anergized, or diverted into a regulatory T cell phenotype). Thus, there are two —not mutually exclusive— explanations for the exquisite specificity of T cells, one involving evolution and the other thymic selection. To better understand the impact of both, we extend a previously developed mathematical model by allowing for T cells with very different binding probabilities in the pre-selection repertoire. We confirm that negative selection tends to tolerize the most crossreactive clonotypes. As a result, the average level of specificity in the functional post-selection repertoire depends on the number of self-antigens, even if there is no evolutionary optimization of binding probabilities. However, the evolutionary optimal range of binding probabilities in the pre-selection repertoire also depends on the number of self-antigens. Species with more self antigens need more specific pre-selection repertoires to avoid excessive loss of T cells during thymic selection, and hence mount protective immune responses. We conclude that both evolution and negative selection are responsible for the high level of specificity of lymphocytes.

59 BASIC BIOLOGICAL SCIENCES↗

Plant Reload Optimization (prlo)

The PRLO framework is built on a modular and extensible architecture that tightly couples advanced evolutionary optimization algorithms with nuclear fuel depletion solvers (i.e., nuclear physics neutronics code). It supports exploring complex, high-dimensional design spaces constrained by user-specified operational, safety, and economic constraints. Objectives such as minimizing fresh fuel enrichment, flattening radial and axial power distributions, and maximizing discharge burnup are evaluated. PRLO’s equilibrium cycle optimization capability enables the identification of core configurations that maintain fuel cycle sustainability over extended planning horizons. Its integration with the RAVEN platform facilitates optimization of loading patterns or fuel shuffling schemes across multiple cycles. The interface with SIMULATE, a licensed industry-standard nodal code developed by Studsvik, ensures accurate neutronic and thermal-hydraulic feedback for reactor core design. PRLO’s automated workflow engine supports iterative design refinement, enabling utilities to streamline core design processes and meet evolving performance and regulatory targets.

Kim, Junyung [Idaho National Laboratory] (00090005↗

Evolutionary vs imitation learning for neuromorphic control at the edge*

Abstract Neuromorphic computing offers the opportunity to implement extremely low power artificial intelligence at the edge. Control applications, such as autonomous vehicles and robotics, are also of great interest for neuromorphic systems at the edge. It is not clear, however, what the best neuromorphic training approaches are for control applications at the edge. In this work, we implement and compare the performance of evolutionary optimization and imitation learning approaches on an autonomous race car control task using an edge neuromorphic implementation. We show that the evolutionary approaches tend to achieve better performing smaller network sizes that are well-suited to edge deployment, but they also take significantly longer to train. We also describe a workflow to allow for future algorithmic comparisons for neuromorphic hardware on control applications at the edge.

Schuman, Catherine↗

Multiobjective Hyperparameter Optimization for Deep Learning Interatomic Potential Training Using NSGA-II

Deep neural network (DNN) potentials are an emerging tool for simulation of dynamical atomistic systems, with the promise of quantum mechanical accuracy at speedups of 10000$\times$. As with other DNN methods, hyperparameters used during training can make a substantial difference in model accuracy, and optimal settings vary with dataset. To enable rapid tuning of hyperparameters for DNN potential training, we developed a scalable multiobjective optimization evolutionary algorithm for supercomputers and tested it on the Summit system at the Oak Ridge Leadership Computing Facility (OLCF). The multiobjective approach is required due to the coupling of two learned values defining the potential: the energy and force. Using a large-scale implementation of the NSGA-II algorithm adapted for training DNN potentials, we discovered several optimal multiobjective combinations, including best choices of activation functions, learning rate scaling scheme, and pairing of the two radial cutoffs used in the three dimensional descriptor function.

Coletti, Mark↗

Liquid-Cooled Heat Sink Optimization for Thermal Imbalance Mitigation in Wide-Bandgap Power Modules

Power semiconductor die placement on substrates used in high-power modules is generally optimized to minimize electrical parasitic (e.g., stray inductance, common-mode capacitance), taking into account the minimum spacing between semiconductor dies for thermal decoupling. The layout assumes sufficient heat spreading and transfer from dies to the cooling structure. Insulated metal substrate-based power module designs may lead to asymmetrical thermal resistance across the dies, which may cause significant temperature differences among the devices. Such unintentional thermal asymmetries can lead to oversizing the cooling system design or underusing the semiconductor power processing capability. This article proposes a thermal imbalance mitigation method that uses evolutionary optimized liquid-cooled heat sinks to improve the thermal loading among devices.

42 ENGINEERING↗

Inverse design of pore wall chemistry and topology through active learning of surface group interactions

Design of next-generation membranes requires a nanoscopic understanding of the effect of biologically inspired heterogeneous surface chemistries and topologies (roughness) on local water and solute behavior. In particular, the rejection of small, neutral solutes, such as boric acid, poses a heretofore unsolved challenge. In prior work, a computational inverse design technique using an evolutionary optimization successfully uncovered new surface design strategies for optimized transport of water over solutes in smooth, model pores consisting of two surface chemistries. However, extending such an approach to more complex (and realistic) scenarios involving many surface chemistries as well as surface roughness is challenging due to the expanded design space. In this work, we develop a new approach that uses active learning to optimize in a reduced feature space of surface group interactions, finding parameters that lead to their assembly into ordered, optimal patterns. This approach rapidly identifies novel surface functionalizations that maximize the difference in water and boric acid transport through the nanopore. Moreover, we find that the roughness of the nanopore wall, independent of its chemistry, can be leveraged to enhance transport selectivity: oscillations in the pore wall diameter optimally inhibit boric acid transport by creating energetic wells from which the solute must escape to transport down the pore. Furthermore, this proof-of-concept demonstrates the potential for active learning strategies, in concert with molecular simulations, to rapidly navigate complex design spaces of aqueous interfaces and is promising as a tool for engineering water-mediated surface interactions for a broad range of applications.

36 MATERIALS SCIENCE↗

Incorporating the Acclimation of Photosynthesis and Leaf Respiration in the Noah‐MP Land Surface Model: Model Development and Evaluation

Abstract Realistic simulation of leaf photosynthetic and respiratory processes is needed for accurate prediction of the global carbon cycle. These two processes systematically acclimate to long‐term environmental changes by adjusting photosynthetic and respiratory traits (e.g., the maximum photosynthetic capacity at 25°C ( V cmax,25 ) and the leaf respiration rate at 25°C ( R 25 )) following increasingly well‐understood principles. While some land surface models (LSMs) now account for thermal acclimation, they do so by assigning empirical parameterizations for individual plant functional types (PFTs). Here, we have implemented an Eco‐Evolutionary Optimality (EEO)‐based scheme to represent the universal acclimation of photosynthesis and leaf respiration to multiple environmental effects, and that therefore requires no PFT‐specific parameterizations, in a standard version of the widely used LSM, Noah MP. We evaluated model performance with plant trait data from a 5‐year experiment and extensive global field measurements, and carbon flux measurements from FLUXNET2015. We show that observed R 25 and V cmax,25 vary substantially both temporally and spatially within the same PFT ( C.V. >20%). Our EEO‐based scheme captures 62% of the temporal and 70% of the spatial variations in V cmax,25 (73% and 54% of the variations in R 25 ). The standard scheme underestimates gross primary production by 10% versus 2% for the EEO‐based scheme and generates a larger spread in r (correlation coefficient) across flux sites (0.79 ± 0.16 vs. 0.84 ± 0.1, mean ± S.D.). The standard scheme greatly overestimates canopy respiration (bias: ∼200% vs. 8% for the EEO scheme), resulting in less CO 2 uptake by terrestrial ecosystems. Our approach thus simulates climate‐carbon coupling more realistically, with fewer parameters.

Ren, Yanghang [Department of Earth System Science ↗

CO 2 fertilization of terrestrial photosynthesis inferred from site to global scales

Significance The magnitude of the CO 2 fertilization effect on terrestrial photosynthesis is uncertain because it is not directly observed and is subject to confounding effects of climatic variability. We apply three well-established eco-evolutionary optimality theories of gas exchange and photosynthesis, constraining the main processes of CO 2 fertilization using measurable variables. Using this framework, we provide robust observationally inferred evidence that a strong CO 2 fertilization effect is detectable in globally distributed eddy covariance networks. Applying our method to upscale photosynthesis globally, we find that the magnitude of the CO 2 fertilization effect is comparable to its in situ counterpart but highlight the potential for substantial underestimation of this effect in tropical forests for many reflectance-based satellite photosynthesis products.

59 BASIC BIOLOGICAL SCIENCES↗

Neuro-Spark: A Submicrosecond Spiking Neural Networks Architecture for In-Sensor Filtering

Neuro-Spark, which is a new neuromorphic architecture with a field-programmable gate array (FPGA) implementation for ultrafast spiking neural network (SNN) inference at the edge, facilitates smart-pixel in-sensor filtering for high-energy physics experiments at the Large Hadron Collider (LHC). Utilizing the evolutionary optimization for neuromorphic systems (EONS) training method, we generate compact SNN models with 91% signal efficiency, akin to convolutional neural networks but with half the parameters. However, deploying near the detector poses a challenge because the SNN must handle a sustained input data rate exceeding 1013 GB/s. To overcome this, we propose a novel hardware architecture that uses high-level synthesis to construct a tuned architecture for the EONS-trained SNN. In addition to the analysis and validation with an AMD Xilinx Artix-A7 FPGA, our solution consumes only ç24% of FPGA LUT and flipflops. We also introduce an innovative quantization method that reduces FPGA resource utilization by ç15% without compromising accuracy. Our FPGA implementation achieves computing latency of ç10 ns for smart-pixel application inference on an edge FPGA.

Miniskar, Narasinga Rao↗

Real-Time Evolution and Deployment of Neuromorphic Computing at The Edge

Extremely low power neuromorphic systems are well-suited for deployment to the edge for many applications. In many use cases of neuromorphic computing for control, a spiking neural network is trained off-line using a simulation and then deployed to a neuromorphic system at the edge, where it will operate without ongoing training or learning. However, it may be desirable to continue training or learning at the edge to refine or adapt to the real-world system. In this work, we propose an approach for performing real-time evolutionary optimization for spiking neural networks for neuromorphic deployment at the edge. In particular, we propose a combination of simulation and real-world evaluations, along with feedback from the real-world environment, to train spiking neural networks for continuous deployment to the edge. We show that the real-time evolution at the edge approach achieves comparable performance to an evolution approach that requires constant evaluation in the realworld environment.

Schuman, Catherine↗