Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “active distribution networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Infrared spectroscopy data- and physics-driven machine learning for characterizing surface microstructure of complex materials

There is a need to characterize complex materials and their dynamics under reaction conditions to accelerate materials design. Adsorbate vibrational excitations are selective to adsorbate/surface interactions and infrared (IR) spectra associated with activating adsorbate vibrational modes are accurate, capture details of most modes, and can be obtained operando. Current interpretation depends on heuristic peak assignments for simple spectra, precluding the possibility of obtaining detailed structural information. Here, we combine data-based approaches with chemistry-dependent problem formulation to develop physics-driven surrogate models that generate synthetic IR spectra from first-principles calculations. Using synthetic IR spectra of carbon monoxide on platinum, we implement multinomial regression via neural network ensembles to learn probability distributions functions (pdfs) that describe adsorption sites and quantify uncertainty. We use these pdfs to infer detailed surface microstructure from experimental spectra and extend this methodology to other systems as a first step towards characterizing complex interfaces and closing the materials gap.

Science & Technology - Other Topics↗
DOE OSTI2020

Application of an Embedded Fracture and Borehole Modeling Approach to the Understanding of EGS Collab Experiment 1

EGS Collab is a series of meso-scale experiments and associated numerical simulation activities being funded by the United States Department of Energy, Geothermal Technologies Office (GTO) to investigate enhanced geothermal system processes under in-situ stress and slightly elevated temperature conditions. This project is designed to provide scientists and engineers with immediate access to impermeable rock at scales larger than possible in the laboratory, but generally smaller than those for commercial production. Immediate access to rock is provided via the existing drifts of the former Homestake Gold Mine, now operated as the Sanford Underground Research Facility in Lead, South Dakota. The objectives of the EGS Collab project are to develop well controlled fracture networks between injector and producer boreholes using normal and shear stimulation for permeability enhancement. The first experimental site was located off the West Access drift on the 4850 Level (4850 feet below ground surface) in phyllite of the Precambrian Poorman formation, and involved the creation of a fracture network comprising a combination of hydraulic and natural fractures. A second experimental site is now being considered near the battery alcove on the 4100 Level in amphibolite and rhyolite of the Yates Unit. Data generated during these experiments will be compared against predictions of a suite of computer codes specifically designed to solve problems involving coupled thermal, hydrological, geomechanical, and geochemical processes. Comparisons between experimental and numerical simulation results will provide code developers with direction for improvements and verification of process models, build confidence in the suite of available numerical tools, and ultimately identify critical future development needs for the geothermal modeling community. Moreover, conducting thorough comparisons of models, modelling approaches, measurement approaches and measured data, via the EGS Collab project, will serve to identify techniques that are most likely to succeed at the Frontier Observatory for Research in Geothermal Energy (FORGE), the GTO’s flagship EGS research effort. Experiment 1 has comprised a series of successful tests, including a long-term chilled-water circulation test, but the testbed has two atypical EGS elements. Active ventilation in the adjacent drift over a 50-year period cooled the testbed rock mass and hydraulic fracturing intersected monitoring boreholes making them conduits for fluid flow. Numerical simulations executed in support of the design of the EGS Collab Experiment 1, computed a radial temperature distribution and stress gradient orthogonal to the drift axis, resulting in the forecast of an oblong hydraulic fracture geometry, extended in the direction of the drift from the stimulation borehole. This paper describes the numerical simulation of long-term chilled-water circulation test with an embedded fracture and borehole modeling approach. The principal objective of the simulation work is show agreement between experimental observations in terms of production fluid temperatures, monitoring borehole temperatures, injection and production pressures, and tracer recoveries using a single conceptual model for the fracture network, using characterization and monitoring data generally available for EGS. A secondary objective is to improve the numerical simulation result comparisons with additional data available from the broader monitoring equipment within the testbed versus deeper, hotter, and more remote EGS. One complicating factor for comparisons between the numerical simulation results and experimental observations, is the Joule-Thomson heating associated with large pressure drops across the fracture network.

numerical simulation, embedded fractures and boreh↗
DOE OSTI2021

Mafic explosive volcanism at Llaima Volcano: 3D x-ray microtomography reconstruction of pyroclasts to constrain shallow conduit processes

Abstract Mafic volcanic activity is dominated by effusive to mildly explosive eruptions. Plinian and ignimbrite-forming mafic eruptions, while rare, are also possible; however, the conditions that promote such explosivity are still being explored. Eruption style is determined by the ability of gas to escape as magma ascends, which tends to be easier in low-viscosity, mafic magmas. If magma permeability is sufficiently high to reduce bubble overpressure during ascent, volatiles may escape from the magma, inhibiting violent explosive activity. In contrast, if the permeability is sufficiently low to retain the gas phase within the magma during ascent, bubble overpressure may drive magma fragmentation. Rapid ascent may induce disequilibrium crystallization, increasing viscosity and affecting the bubble network with consequences for permeability, and hence, explosivity. To explore the conditions that promote strongly explosive mafic volcanism, we combine microlite textural analyses with synchrotron x-ray computed microtomography of 10 pyroclasts from the 12.6 ka mafic Curacautín Ignimbrite (Llaima Volcano, Chile). We quantify microlite crystal size distributions (CSD), microlite number densities, porosity, bubble interconnectivity, bubble number density, and geometrical properties of the porous media to investigate the role of magma degassing processes at mafic explosive eruptions. We use an analytical technique to estimate permeability and tortuosity by combing the Kozeny-Carman relationship, tortuosity factor, and pyroclast vesicle textures. The groundmass of our samples is composed of up to 44% plagioclase microlites, > 85% of which are < 10 µm in length. In addition, we identify two populations of vesicles in our samples: (1) a convoluted interconnected vesicle network produced by extensive coalescence of smaller vesicles (> 99% of pore volume), and (2) a population of very small and completely isolated vesicles (< 1% of porosity). Computed permeability ranges from 3.0 × 10 −13 to 6.3 × 10 −12 m 2 , which are lower than the similarly explosive mafic eruptions of Tarawera (1886; New Zealand) and Etna (112 BC; Italy). The combination of our CSDs, microlite number densities, and 3D vesicle textures evidence rapid ascent that induced high disequilibrium conditions, promoting rapid syn-eruptive crystallization of microlites within the shallow conduit. We interpret that microlite crystallization increased viscosity while simultaneously forcing bubbles to deform as they grew together, resulting in the permeable by highly tortuous network of vesicles. Using the bubble number densities for the isolated vesicles (0.1-3 −3 × 10 4 bubbles per mm 3 ), we obtain a minimum average decompression rate of 1.4 MPa/s. Despite the textural evidence that the Curacautín magma reached the percolation threshold, we propose that rapid ascent suppressed outgassing and increased bubble overpressures, leading to explosive fragmentation. Further, using the porosity and permeability of our samples, we estimated that a bubble overpressure > 5 MPa could have been sufficient to fragment the Curacautín magma. Other mafic explosive eruptions report similar disequilibrium conditions induced by rapid ascent rate, implying that syn-eruptive disequilibrium conditions may control the explosivity of mafic eruptions more generally.

Valdivia, Pedro↗
DOE OSTI2024

Real Time-Optimal Power Flow-Based Distributed Energy Resource Management System (DERMS)

This project aims to promote lab-proven clean energy technology to commercially scalable versions of the technology, integrate the technology with broader systems, provide extended performance data, and validate the manufacturability and reliability of the technology. The lab-proven technology, RT-OPF DERMS, was developed and validated through previous U.S. Department of Energy-funded efforts, including Advanced Research Projects Agency-Energy funding under the Network Optimized Distributed Energy Systems program and Holy-Cross Energy High Impact Project. In the Advanced Research Projects Agency-Energy Network Optimized Distributed Energy Systems project, the RT-OPF DERMS was developed and implemented in multiple hardware platforms, demonstrating its performance and capabilities in the lab and field environments. The technology was also evaluated and matured via a participation in the U.S. Department of Energy I-Corps program, whose goal is to pair teams of researchers with industry mentors for an intensive 2-month training in which the researchers define technology value propositions, conduct customer discovery interviews, and develop viable market pathways for their technologies. These activities indicate the high technology maturity and Technology Readiness Level of the RT-OPF DERMS.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Recurrent Convolutional Deep Neural Networks for Modeling Time-Resolved Wildfire Spread Behavior

The increasing incidence and severity of wildfires underscores the necessity of accurately predicting their behavior. While high-fidelity models derived from first principles offer physical accuracy, they are too computationally expensive for use in real-time fire response. Low-fidelity models sacrifice some physical accuracy and generalizability via the integration of empirical measurements, but enable real-time simulations for operational use in fire response. Machine learning techniques have demonstrated the ability to bridge these objectives by learning first-principles physics while achieving computational speedups. While deep learning approaches have demonstrated the ability to predict wildfire propagation over large time periods, time-resolved fire-spread predictions are needed for active fire management. Here, in this work, we evaluate the ability of deep learning approaches in accurately modeling the time-resolved dynamics of wildfires. We use an autoregressive process in which a convolutional recurrent deep learning model makes predictions that propagate a wildfire over 15 min increments. We apply the model to four simulated datasets of increasing complexity, containing both field fires with homogeneous fuel distribution as well as real-world topologies sampled from the California region of the United States. We show that even after 100 autoregressive predictions representing more than 24 h of simulated fire spread, the resulting models generate stable and realistic propagation dynamics, achieving a Jaccard score between 0.89 and 0.94 when predicting the resulting fire scar. The inference time of the deep learning models are examined and compared, and directions for future work are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

How initial conditions-, structural-, and parameter-based model uncertainty interact and influence predictions in permafrost ecosystems: Modeling Archive

This dataset contains model output and input data, as well as source code examples for the Terrestrial Ecosystem Model with the Dynamic Vegetation Model and Dynamic Organic Soil (DVM-DOS-TEM) for the field sites Imnavait creek and the Bonanza creek Long Term Ecological Research Network (LTER). The data covers simulations from the last glacial maximum (LGM) until 2100 for a selection of paleo scenarios, setting the mean temperature of the LGM up to 10°C lower than pre-industrial conditions. The model structure was modulated to represent various model versions, and this dataset contains the relevant changes in the source code. The raw output data, the processed statistical data, the setup and processing scripts as well as parameter value distribution files from a parameter sensitivity analysis are included as well. Model outputs include active layer depth, organic soil carbon, soil layer depths, gross primary productivity (GPP) with and without nitrogen limitation, net primary productivity (NPP), soil liquid water content, heterotrophic, maintenance, and growth respiration, soil temperature, and vegetation carbon (*.nc files). The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research.Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Deep Reinforcement Learning-based Reserve Optimization in Active Distribution Systems for Tertiary Frequency Regulation

Federal Energy Regulatory Commission (FERC)Orders 841 and 2222 have recommended that distributed energy resources (DERs) should participate in energy and reserve markets; therefore, a mechanism needs to be developed to facilitate DERs’ participation at the distribution level. Although the available reserve from a single distribution system may not be sufficient for tertiary frequency regulation, stacked and coordinated contributions from several distribution systems can enable them participate in tertiary frequency regulation at scale. This paper proposes a deep reinforcement learning (DRL)-based approach for optimization of requested aggregated reserves by system operators among the clusters of DERs. The co-optimization of cost of reserve, distribution network loss, and voltage regulation of the feeders are considered while optimizing the reserves among participating DERs. The proposed framework adopts deep deterministic policy gradient (DDPG), which is an algorithm based on an actor-critic method. The effectiveness of the proposed method for allocating reserves among DERs is demonstrated through case studies on a modified IEEE 34-node distribution system.

deep reinforcement learning, distributed energy re↗
DOE OSTI2020

Microsimulation of Energy and Flow Effects from Optimal Automated Driving in Mixed Traffic

In this paper we study the energy and traffic impact of a proposed Anticipative Cruise Controller in a PTV VISSIM microsimulation environment. We dissect our controller into two parts: 1. the unconnected mode, active when following a human-driven vehicle, and 2. the connected mode, active when following another automated vehicle equipped with connectivity. Probabilistic constraints balance safety considerations with inter-vehicle compactness, and vehicle constraints for acceleration capabilities are expressed through the use of powertrain maps. Emergent highway traffic scenarios are then modeled using time headway distributions from empirical traffic data. To study the impact of automation over a range of demands of free-flow to stop-and-go, we vary vehicle flux from low to high and vary automated vehicle penetration from low to high. When examining all-human driving scenarios, network capacity failed to meet demand in high-volume scenarios, such as rush-hour traffic. We further find that with connected automated vehicles introduced, network capacity was improved to support the high-volume scenarios. Finally, we examine energy efficiencies of the fleet for conventional, electric, and hybrid vehicles. We find that automated vehicles perform at a 10%-20% higher energy efficiency over human drivers when considering conventional powertrains, and find that automated vehicles perform at a 3%-9% higher energy efficiency over human drivers when considering electric and hybrid powertrains. Due to secondary effects of smoothing traffic flow and reducing unnecessary braking, energy benefits also apply to human-driven vehicles that interact with automated ones. Such simulated humans were found to drive up to 10% more energy-efficiently than they did in the baseline all-human scenario.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Improving photovoltaic hosting capacity of distribution networks with coordinated inverter control: A case study of the EPRI J1 feeder

Abstract Adding photovoltaic (PV) systems in distribution networks, while desirable for reducing the carbon footprint, can lead to voltage violations under high solar‐low load conditions. The inability of traditional volt‐VAr control in eliminating all the violations is also well‐known. This article presents a novel coordinated inverter control methodology that leverages system‐wide situational awareness to significantly improve hosting capacity (HC). The methodology employs a real‐time voltage‐reactive power (VQ) sensitivity matrix in an iterative linear optimizer to calculate the minimum reactive power intervention from PV inverters needed for mitigating over‐voltage without resorting to active power curtailing or requiring step voltage regulator setting changes. The algorithm is validated using the EPRI J1 feeder under an extensive set of realistic use cases and is shown to provide 3x improvement in HC under all scenarios.

Dalal, Dhaval [School of Electrical, Computer, and↗
DOE OSTI2021

Cycling-Induced Microstructural Changes in Alloy Anodes for Lithium-Ion Batteries

Abstract High-capacity electrochemical alloying materials, such as tin and tin-based alloys, present an opportunity for the advancement of lithium-ion batteries. However, the destructive effects of volumetric expansion must be mitigated in order to sustain this high capacity during extended cycling. One way to mitigate these effects is by alloying Sn with more malleable metals to accommodate the strain related to severe volumetric expansion. Ex situ X-ray microtomography data of cycled Cu6Sn5 pellets were used to quantify the microstructural changes that occur during lithiation and delithiation. The microtomography data were segmented into three distinct phases to evaluate phase size distributions, specific surface area, and tortuosity. Electrodes lithiated and then delithiated showed the most substantial reduction in overall phase sizes. This suggests that full lithiation of the Sn followed by partial delithiation of the Li4.4Sn to Li2CuSn can cause substantial microstructural changes related to volume expansion on lithiation and structural collapse upon delithiation. When considering other microstructural characteristics, this subset of the electrodes analyzed showed the highest tortuosity values. These results show that in addition to the mechanical degradation of the electrodes, excessive volume expansion can also influence transport networks in the active material and supporting phases of the electrode. While based on studies of the active–inactive alloy Cu6Sn5 for lithium-ion battery applications, the insights obtained are expected to be applicable to other alloy electrodes and battery chemistries.

Electrochemistry↗
DOE OSTI2022

Digital Twin of an ANPC inverter with integrated Design-For-Trust

Reducing costs and increasing manufacturing output while creating reliable products are three essential components needed to keep a business competitive. In the past, having an asset that could address these three challenges at the same time would be challenging. However, recent advances in computer processing capabilities coupled with increases to network speeds allowed such a system to become possible; and this is known as a Digital Twin (DT), which represents a virtual copy of a production system or a product. Here, this work exhibits a DT application of an Active Neutral Point Clamped (ANPC) inverter using a controller. The controller emulates the ANPC responses of a new Digital Signal Processing (DSP) firmware and validates this new firmware by using Design-For-Trust (DFTr) characteristics. If the new firmware is malicious, then it should be rejected, thus adding preemptive protection measures for inverter based distributed energy resources.

cybersecurity↗
DOE OSTI2024

A post-merger enhancement only in star-forming Type 2 Seyfert galaxies: the deep learning view

ABSTRACT Supermassive black holes require a reservoir of cold gas at the centre of their host galaxy in order to accrete and shine as active galactic nuclei (AGN). Major mergers have the ability to drive gas rapidly inwards, but observations trying to link mergers with AGN have found mixed results due to the difficulty of consistently identifying galaxy mergers in surveys. This study applies deep learning to this problem, using convolutional neural networks trained to identify simulated post-merger galaxies from survey-realistic imaging. This provides a fast and repeatable alternative to human visual inspection. Using this tool, we examine a sample of ∼8500 Seyfert 2 galaxies ($L[\mathrm{O\, {\small III}}] \sim 10^{38.5 - 42}$ erg s−1) at z < 0.3 in the Sloan Digital Sky Survey and find a merger fraction of $2.19_{-0.17}^{+0.21}$ per cent compared with inactive control galaxies, in which we find a merger fraction of $2.96_{-0.20}^{+0.26}$ per cent, indicating an overall lack of mergers among AGN hosts compared with controls. However, matching the controls to the AGN hosts in stellar mass and star formation rate reveals that AGN hosts in the star-forming blue cloud exhibit a ∼2 × merger enhancement over controls, while those in the quiescent red sequence have significantly lower relative merger fractions, leading to the observed overall deficit due to the differing M*–SFR distributions. We conclude that while mergers are not the dominant trigger of all low-luminosity, obscured AGN activity in the nearby Universe, they are more important to AGN fuelling in galaxies with higher cold gas mass fractions as traced through star formation.

Avirett-Mackenzie, M. S.↗
DOE OSTI2021

TBAA20: Task-Based Algorithms and Applications

The new challenges posed by Exascale system architectures have resulted in difficulty achieving a desired scalability using traditional distributed ­memory runtimes. Task­-based programming models show promise in addressing these challenges, providing application developers with a productive and performant approach to programming on next generation systems. Empirical studies show that task-based models can overcome load ­balancing issues that are inherent to traditional distributed ­memory runtimes, and that task-­based runtimes perform comparably to those systems when balanced. This panel is designed to explore the advantages of task-­based programming models on modern and future HPC systems from an industry, university, and national lab perspective. It aims at gathering application experts and proponents of these models to present concrete and practical examples of using task­-based runtimes to overcome the challenges posed by Exascale system architectures. This report describes the objectives, activities, and outcomes of the panel TBAA: Task­-Based Algorithms and Applications which was held at the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 20) on November 18, 2020.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

CIRCLEZ : Reliable photometric redshifts for active galactic nuclei computed solely using photometry from Legacy Survey Imaging for DESI

Photometric redshifts for galaxies hosting an accreting supermassive black hole in their center, known as active galactic nuclei (AGNs), are notoriously challenging. At present, they are most optimally computed via spectral energy distribution (SED) fittings, assuming that deep photometry for many wavelengths is available. However, for AGNs detected from all-sky surveys, the photometry is limited and provided by a range of instruments and studies. This makes the task of homogenizing the data challenging, presenting a dramatic drawback for the millions of AGNs that wide surveys such as SRG/eROSITA are poised to detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGNs using only one dataset that covers a large area: the tenth data release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures over the footprint of the eROSITA-DE survey, which avoids issues related to the cross-calibration of surveys. We present the results from CIRCLEZ, a machine-learning algorithm based on a fully connected neural network. CIRCLEZ is built on a training sample of 14 000 X-ray-detected AGNs and utilizes multi-aperture photometry, mapping the light distribution of the sources. The accuracy (σNMAD) and the fraction of outliers (η) reached in a test sample of 2913 AGNs are equal to 0.067 and 11.6%, respectively. The results are comparable to (or even better than) what was previously obtained for the same field, but with much less effort in this instance. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching a comparable accuracy as in eFEDS when limiting the magnitude of the counterparts to the depth of LS10. The method can be applied to fainter samples of AGNs using deeper optical data from future surveys (for example, LSST, Euclid), granting LS10-like information on the light distribution beyond the morphological type. Along with this paper, we have released an updated version of the photometric redshifts (including errors and probability distribution functions) for eROSITA/eFEDS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

CANA v1.0.0: efficient quantification of canalization in automata networks

The biomolecular networks underpinning cell function exhibit canalization, or the buffering of fluctuations required to function in a noisy environment. We present a new major release of $\tt{CANA}$, v1.0.0, an open-source Python package for understanding canalization in automata network models, discrete dynamical systems in which activation of biomolecular entities (e.g. transcription of genes) is modeled as the activity of coupled automata. One understudied putative mechanism for canalization is the functional equivalence of biomolecular regulators (e.g. among the transcription factors for a gene). We study this mechanism using the theory of symmetry in discrete functions. We present a new exact method, $\tt{schematodes}$, for finding maximal symmetry groups among the inputs to discrete functions, and integrate it into $\tt{CANA}$. The $\tt{schematodes}$ method substantially outperforms the inexact method of previous $\tt{CANA}$ versions both in speed and accuracy. We apply $\tt{CANA}$ v1.0.0 to study symmetry in 74 experimentally supported automata network models from the Cell Collective (CC) repository. The symmetry distribution is significantly different in the CC than in random automata with the same in-degree (connectivity) and bias (average output) (Kolmogorov–Smirnov test, P ≪ .001). Its spread is much wider than in a null model (IQR 0.31 versus IQR 0.20 with equal medians), demonstrating that the CC is enriched in functions with extreme symmetry or asymmetry.

Boolean networks↗
DOE OSTI2022

Objective Phenotyping of Root System Architecture Using Image Augmentation and Machine Learning in Alfalfa (Medicago sativa L.)

Active breeding programs specifically for root system architecture (RSA) phenotypes remain rare; however, breeding for branch and taproot types in the perennial crop alfalfa is ongoing. Phenotyping in this and other crops for active RSA breeding has mostly used visual scoring of specific traits or subjective classification into different root types. While image-based methods have been developed, translation to applied breeding is limited. This research is aimed at developing and comparing image-based RSA phenotyping methods using machine and deep learning algorithms for objective classification of 617 root images from mature alfalfa plants collected from the field to support the ongoing breeding efforts. Our results show that unsupervised machine learning tends to incorrectly classify roots into a normal distribution with most lines predicted as the intermediate root type. Encouragingly, random forest and TensorFlow-based neural networks can classify the root types into branch-type, taproot-type, and an intermediate taproot-branch type with 86% accuracy. With image augmentation, the prediction accuracy was improved to 97%. Coupling the predicted root type with its prediction probability will give breeders a confidence level for better decisions to advance the best and exclude the worst lines from their breeding program. This machine and deep learning approach enables accurate classification of the RSA phenotypes for genomic breeding of climate-resilient alfalfa.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Multi-fidelity Bayesian neural networks: Algorithms and applications

Here we propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential equations (PDEs). These multi-fidelity BNNs consist of three neural networks: The first is a fully connected neural network, which is trained following the maximum a posteriori probability (MAP) method to fit the low-fidelity data; the second is a Bayesian neural network employed to capture the cross-correlation with uncertainty quantification between the low- and high-fidelity data; and the last one is the physics-informed neural network, which encodes the physical laws described by PDEs. For the training of the last two neural networks, we first employ the mean-field variational inference (VI) to maximize the evidence lower bound (ELBO) to obtain informative prior distributions for the hyperparameters in the BNNs, and subsequently we use the Hamiltonian Monte Carlo (HMC) method to estimate accurately the posterior distributions for the corresponding hyperparameters. We demonstrate the accuracy of the present method using synthetic data as well as real measurements. Specifically, we first approximate a one- and four-dimensional function, and then infer the reaction rates in one- and two-dimensional diffusion-reaction systems. Moreover, we infer the sea surface temperature (SST) in the Massachusetts and Cape Cod Bays using satellite images and in-situ measurements. Taken together, our results demonstrate that the present method can capture both linear and nonlinear correlation between the low- and high-fidelity data adaptively, identify unknown parameters in PDEs, and quantify uncertainties in predictions, given a few scattered noisy high-fidelity data. Finally, we demonstrate that we can effectively and efficiently reduce the uncertainties and hence enhance the prediction accuracy with an active learning approach, using as examples a specific one-dimensional function approximation and an inverse PDE problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Exploring Gradient-Based Multi-directional Controls in GANs

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its controllable generation an open problem, especially when spurious correlations between different semantic attributes exist in the image distributions. To address this problem, previous methods typically learn linear directions or individual channels that control semantic attributes in the image space. However, they often suffer from imperfect disentanglement, or are unable to obtain multi-directional controls. Furthermore, in this work, in light of the above challenges, we propose a novel approach that discovers nonlinear controls, which enables multi-directional manipulation as well as effective disentanglement, based on gradient information in the learned GAN latent space. More specifically, we first learn interpolation directions by following the gradients from classification networks trained separately on the attributes, and then navigate the latent space by exclusively controlling channels activated for the target attribute in the learned directions. Empirically, with small training data, our approach is able to gain fine-grained controls over a diverse set of bi-directional and multi-directional attributes, and we showcase its ability to achieve disentanglement significantly better than state-of-the-art methods both qualitatively and quantitatively.

97 MATHEMATICS AND COMPUTING↗