Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

CEGANN: Crystal Edge Graph Attention Neural Network for multiscale classification of materials environment

Abstract We introduce Crystal Edge Graph Attention Neural Network (CEGANN) workflow that uses graph attention-based architecture to learn unique feature representations and perform classification of materials across multiple scales (from atomic to mesoscale) and diverse classes ranging from metals, oxides, non-metals to hierarchical materials such as zeolites and semi-ordered mesophases. CEGANN can classify based on a global, structure-level representation such as space group and dimensionality (e.g., bulk, 2D, clusters, etc.). Using representative materials such as polycrystals and zeolites, we demonstrate its transferability in performing local atom-level classification tasks, such as grain boundary identification and other heterointerfaces. CEGANN classifies in (thermal) noisy dynamical environments as demonstrated for representative zeolite nucleation and growth from an amorphous mixture. Finally, we use CEGANN to classify multicomponent systems with thermal noise and compositional diversity. Overall, our approach is material agnostic and allows for multiscale feature classification ranging from atomic-scale crystals to heterointerfaces to microscale grain boundaries.

36 MATERIALS SCIENCE↗

Attention-based functional-group coarse-graining: a deep learning framework for molecular prediction and design

Machine learning (ML) offers considerable promise for the design of new molecules and materials. In real-world applications, the design problem is often domain-specific, and suffers from insufficient data, particularly labeled data, for ML training. In this study, we report a data-efficient, deep-learning framework for molecular discovery that integrates a coarse-grained functional-group representation with a self-attention mechanism to capture intricate chemical interactions. Our approach exploits group-contribution concepts to create a graph-based intermediate representation of molecules, serving as a low-dimensional embedding that substantially reduces the data demands typically required for training. Using a self-attention mechanism to learn the subtle but highly relevant chemical context of functional groups, the method proposed here consistently outperforms existing approaches for predictions of multiple thermophysical properties. In a case study focused on adhesive polymer monomers, we train on a limited dataset comprising only 6,000 unlabeled and 600 labeled monomers. The resulting chemistry prediction model achieves over 92% accuracy in forecasting properties directly from SMILES strings, exceeding the performance of current state-of-the-art techniques. Furthermore, the latent molecular embedding is invertible, enabling the design pipeline to automatically generate new monomers from the learned chemical subspace. We illustrate this functionality by targeting several properties, including high and low glass transition temperatures (Tg), and demonstrate that our model can identify new candidates with values that surpass those in the training set. The ease with which the proposed framework navigates both chemical diversity and data scarcity offers a promising route to accelerate and broaden the search for functional materials.

Han, Ming [Univ. of Chicago, IL (United States)]↗

Potential-pH diagrams considering complex oxide solution phases for understanding aqueous corrosion of multi-principal element alloys

The potential-pH diagram, a graphical representation of the thermodynamically predominant reaction products in aqueous corrosion, is originally proposed for the corrosion of pure metals. The original approach only leads to stoichiometric oxides and hydroxides as the oxidation products. However, numerous experiments show that non-stoichiometric oxide scales are prevalent in the aqueous corrosion of alloys. In the present study, a room temperature potential-pH diagram considering oxide solid solutions, as a generalization of the traditional potential-pH diagram with stoichiometric oxides, is constructed for an FCC single-phase multi-principal element alloy (MPEA) based on the CALculation of PHAse Diagram method. The predominant reaction products, the ions in aqueous solution, and the cation distribution in oxides are predicted. The oxide solid solution is stabilized by the mixing free energy (or mixing entropy) and the stabilizing effect becomes more significant as the temperature increases. Consequently, solid solution oxides are stable in large regions of the potential-pH diagram and the mixing free energy mostly affects the equilibrium composition of the stable oxides, while the shape of stable regions for oxides is mostly determined by the structure of the stable oxides. Agreements are found for Ni 2+ , Fe 2+ , and Mn 2+ between the atomic emission spectroelectrochemistry measurements and thermodynamic calculations, while deviations exist for Cr 3+ and Co 2+ possibly due to surface complexation with species such as Cl - and the oxide dissolution. By incorporating the solution models of oxides, the current work presents a general and more accurate way to analyze the reaction products during aqueous corrosion of MPEAs.

Materials Science↗

Energy storage solutions to decarbonize electricity through enhanced capacity expansion modelling

To meet ambitious global decarbonization goals, electricity system planning and operations will change fundamentally. With increasing reliance on variable renewable energy resources, energy storage is likely to play a critical accompanying role to help balance generation and consumption patterns. As grid planners, non-profit organizations, non-governmental organizations, policy makers, regulators and other key stakeholders commonly use capacity expansion modelling to inform energy policy and investment decisions, it is crucial that these processes capture the value of energy storage in energy-system decarbonization. Here we conduct an extensive review of literature on the representation of energy storage in capacity expansion modelling. We identify challenges related to enhancing modelling capabilities to inform decarbonization policies and electricity system investments, and to improve societal outcomes throughout the clean energy transition. Additionally, we further identify corresponding research activities that can help overcome these challenges and conclude by highlighting tangible real-world outcomes that will result from pursuing these research activities. Capacity expansion modelling (CEM) approaches need to account for the value of energy storage in energy-system decarbonization. A new Review considers the representation of energy storage in the CEM literature and identifies approaches to overcome the challenges such approaches face when it comes to better informing policy and investment decisions.

25 ENERGY STORAGE↗

Predictions of rhizosphere microbiome dynamics with a genome-informed and trait-based energy budget model

Abstract Soil microbiomes are highly diverse, and to improve their representation in biogeochemical models, microbial genome data can be leveraged to infer key functional traits. By integrating genome-inferred traits into a theory-based hierarchical framework, emergent behaviour arising from interactions of individual traits can be predicted. Here we combine theory-driven predictions of substrate uptake kinetics with a genome-informed trait-based dynamic energy budget model to predict emergent life-history traits and trade-offs in soil bacteria. When applied to a plant microbiome system, the model accurately predicted distinct substrate-acquisition strategies that aligned with observations, uncovering resource-dependent trade-offs between microbial growth rate and efficiency. For instance, inherently slower-growing microorganisms, favoured by organic acid exudation at later plant growth stages, exhibited enhanced carbon use efficiency (yield) without sacrificing growth rate (power). This insight has implications for retaining plant root-derived carbon in soils and highlights the power of data-driven, trait-based approaches for improving microbial representation in biogeochemical models.

59 BASIC BIOLOGICAL SCIENCES↗

Certifying almost all quantum states with few single-qubit measurements

Certifying that an n -qubit state synthesized in the laboratory is close to a given target state is a fundamental task in quantum information science. However, existing rigorous protocols applicable to general target states have potentially prohibitive resource requirements in the form of either deep quantum circuits or exponentially many single-qubit measurements. Here we prove that almost all n -qubit target states, including those with exponential circuit complexity, can be certified from only O ( n 2 ) single-qubit measurements. Given access to the target state’s amplitudes, our protocol requires only O ( n 3 ) classical computation. This result is established by a technique that relates certification to the mixing time of a random walk. Our protocol has applications for benchmarking quantum systems, for optimizing quantum circuits to generate a desired target state and for learning and verifying neural networks, tensor networks and various other representations of quantum states using only single-qubit measurements. We show that such verified representations can be used to efficiently predict highly non-local properties of a synthesized state that would otherwise require an exponential number of measurements on the state. We demonstrate these applications in numerical experiments with up to 120 qubits and observe an advantage over existing methods such as cross-entropy benchmarking.

information theory and computation↗

The complex polyploid genome architecture of sugarcane

Sugarcane, the world’s most harvested crop by tonnage, has shaped global history, trade and geopolitics, and is currently responsible for 80% of sugar production worldwide. While traditional sugarcane breeding methods have effectively generated cultivars adapted to new environments and pathogens, sugar yield improvements have recently plateaued. The cessation of yield gains may be due to limited genetic diversity within breeding populations, long breeding cycles and the complexity of its genome, the latter preventing breeders from taking advantage of the recent explosion of whole-genome sequencing that has benefited many other crops. Thus, modern sugarcane hybrids are the last remaining major crop without a reference-quality genome. Here we take a major step towards advancing sugarcane biotechnology by generating a polyploid reference genome for R570, a typical modern cultivar derived from interspecific hybridization between the domesticated species (Saccharum officinarum) and the wild species (Saccharum spontaneum). In contrast to the existing single haplotype (‘monoploid’) representation of R570, our 8.7 billion base assembly contains a complete representation of unique DNA sequences across the approximately 12 chromosome copies in this polyploid genome. Using this highly contiguous genome assembly, we filled a previously unsized gap within an R570 physical genetic map to describe the likely causal genes underlying the single-copy Bru1 brown rust resistance locus. This polyploid genome assembly with fine-grain descriptions of genome architecture and molecular targets for biotechnology will help accelerate molecular and transgenic breeding and adaptation of sugarcane to future environmental conditions.

59 BASIC BIOLOGICAL SCIENCES↗

A compendium of human gene functions derived from evolutionary modelling

A comprehensive, computable representation of the functional repertoire of all macromolecules encoded within the human genome is a foundational resource for biology and biomedical research. The Gene Ontology Consortium has been working towards this goal by generating a structured body of information about gene functions, which now includes experimental findings reported in more than 175,000 publications for human genes and genes in experimentally tractable model organisms 1,2 . Here, we describe the results of a large, international effort to integrate all of these findings to create a representation of human gene functions that is as complete and accurate as possible. Specifically, we apply an expert-curated, explicit evolutionary modelling approach to all human protein-coding genes. This approach integrates available experimental information across families of related genes into models that reconstruct the gain and loss of functional characteristics over evolutionary time. The models and the resulting set of 68,667 integrated gene functions cover approximately 82% of human protein-coding genes. The functional repertoire reveals a marked preponderance of molecular regulatory functions, and the models provide insights into the evolutionary origins of human gene functions. We show that our set of descriptions of functions can improve the widely used genomic technique of Gene Ontology enrichment analysis. The experimental evidence for each functional characteristic is recorded, thereby enabling the scientific community to help review and improve the resource, which we have made publicly available.

59 BASIC BIOLOGICAL SCIENCES↗

A biomass map of the Brazilian Amazon from multisource remote sensing

The Amazon Forest, the largest contiguous tropical forest in the world, stores a significant fraction of the carbon on land. Changes in climate and land use affect total carbon stocks, making it critical to continuously update and revise the best estimates for the region, particularly considering changes in forest dynamics. Forest inventory data cover only a tiny fraction of the Amazon region, and the coverage is not sufficient to ensure reliable data interpolation and validation. This paper presents a new forest above-ground biomass map for the Brazilian Amazon and the associated uncertainty both with a resolution of 250 meters and baseline for the satellite dataset the year of 2016 (i.e., the year of the satellite observation). A significant increase in data availability from forest inventories and remote sensing has enabled progress towards high-resolution biomass estimates. This work uses the largest airborne LiDAR database ever collected in the Amazon, mapping 360,000 km 2 through transects distributed in all vegetation categories in the region. The map uses airborne laser scanning (ALS) data calibrated by field forest inventories that are extrapolated to the region using a machine learning approach with inputs from Synthetic Aperture Radar (PALSAR), vegetation indices obtained from the Moderate-Resolution Imaging Spectroradiometer (MODIS) satellite, and precipitation information from the Tropical Rainfall Measuring Mission (TRMM). A total of 174 field inventories geolocated using a Differential Global Positioning System (DGPS) were used to validate the biomass estimations. The experimental design allowed for a comprehensive representation of several vegetation types, producing an above-ground biomass map varying from a maximum value of 518 Mg ha -1 , a mean of 174 Mg ha -1 , and a standard deviation of 102 Mg ha -1 . This unique dataset enabled a better representation of the regional distribution of the forest biomass and structure, providing further studies and critical information for decision-making concerning forest conservation, planning, carbon emissions estimate, and mechanisms for supporting carbon emissions reductions.

54 ENVIRONMENTAL SCIENCES↗

The High-resolution Urban Meteorology for Impacts Dataset (HUMID) daily for the Conterminous United States

Many current gridded surface meteorological datasets are inadequate for quantifying near surface spatiotemporal variability because they do not fully represent the impacts of land surface heterogeneity. Of note, explicit representation of the spatial structure and magnitude of local urban warming are usually lacking. Here we enhance the representation of spatial meteorological variability over urban areas in the conterminous United States (CONUS) by employing the High-Resolution Land Data Assimilation System (HRLDAS), which accounts for the fine-scale impacts of spatiotemporally varying land surfaces on weather. We also synthesize in situ meteorological data including local mesonets to create a 1 km grid spacing model-observation fusion product spanning 1981-2018 over the CONUS. Daily maximum, minimum, and mean values for a variety of temperature estimates, humidity, and surface energy budget terms, among others, are included. This High-resolution Urban Meteorology for Impacts Dataset (HUMID) will be useful for studies examining spatial variability of near surface meteorology and the impacts of urban heat islands across many disciplines including epidemiology, ecology, and climatology.

54 ENVIRONMENTAL SCIENCES↗

Machine learning with persistent homology and chemical word embeddings improves prediction accuracy and interpretability in metal-organic frameworks

Machine learning has emerged as a powerful approach in materials discovery. Its major challenge is selecting features that create interpretable representations of materials, useful across multiple prediction tasks. We introduce an end-to-end machine learning model that automatically generates descriptors that capture a complex representation of a material’s structure and chemistry. This approach builds on computational topology techniques (namely, persistent homology) and word embeddings from natural language processing. It automatically encapsulates geometric and chemical information directly from the material system. We demonstrate our approach on multiple nanoporous metal–organic framework datasets by predicting methane and carbon dioxide adsorption across different conditions. Our results show considerable improvement in both accuracy and transferability across targets compared to models constructed from the commonly-used, manually-curated features, consistently achieving an average 25–30% decrease in root-mean-squared-deviation and an average increase of 40–50% in R 2 scores. A key advantage of our approach is interpretability: Our model identifies the pores that correlate best to adsorption at different pressures, which contributes to understanding atomic-level structure–property relationships for materials design.

97 MATHEMATICS AND COMPUTING↗

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗

GAHLS: an optimized graph analytics based high level synthesis framework

The urgent need for low latency, high-compute and low power on-board intelligence in autonomous systems, cyber-physical systems, robotics, edge computing, evolvable computing, and complex data science calls for determining the optimal amount and type of specialized hardware together with reconfigurability capabilities. With these goals in mind, we propose a novel comprehensive graph analytics based high level synthesis (GAHLS) framework that efficiently analyzes complex high level programs through a combined compiler-based approach and graph theoretic optimization and synthesizes them into message passing domain-specific accelerators. This GAHLS framework first constructs a compiler-assisted dependency graph (CaDG) from low level virtual machine (LLVM) intermediate representation (IR) of high level programs and converts it into a hardware friendly description representation. Next, the GAHLS framework performs a memory design space exploration while account for the identified computational properties from the CaDG and optimizing the system performance for higher bandwidth. The GAHLS framework also performs a robust optimization to identify the CaDG subgraphs with similar computational structures and aggregate them into intelligent processing clusters in order to optimize the usage of underlying hardware resources. Finally, the GAHLS framework synthesizes this compressed specialized CaDG into processing elements while optimizing the system performance and area metrics. Evaluations of the GAHLS framework on several real-life applications (e.g., deep learning, brain machine interfaces) demonstrate that it provides 14.27× performance improvements compared to state-of-the-art approaches such as LegUp 6.2.

97 MATHEMATICS AND COMPUTING↗

Comparing storm resolving models and climates via unsupervised machine learning

Global storm-resolving models (GSRMs) have gained widespread interest because of the unprecedented detail with which they resolve the global climate. However, it remains difficult to quantify objective differences in how GSRMs resolve complex atmospheric formations. This lack of comprehensive tools for comparing model similarities is a problem in many disparate fields that involve simulation tools for complex data. To address this challenge we develop methods to estimate distributional distances based on both nonlinear dimensionality reduction and vector quantization. Our approach automatically learns physically meaningful notions of similarity from low-dimensional latent data representations that the different models produce. This enables an intercomparison of nine GSRMs based on their high-dimensional simulation data (2D vertical velocity snapshots) and reveals that only six are similar in their representation of atmospheric dynamics. Furthermore, we uncover signatures of the convective response to global warming in a fully unsupervised way. Our study provides a path toward evaluating future high-resolution simulation data more objectively.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of precipitation across the contiguous United States, Alaska, and Puerto Rico in multi-decadal convection-permitting simulations

Abstract This study is an early effort to generate a multi-decadal convection-permitting regional climate dataset that covers nearly the entire North American continent. We assessed a 20 year dynamically downscaled regional climate simulation at a 4 km spatial resolution with explicit convection across the contiguous United States (CONUS), Alaska, and Puerto Rico. Specifically, we evaluated the model’s performance in representing mean, 95th percentile, and extreme precipitation across regions. Our findings indicate that when compared with ERA5 reanalysis, the forcing data, convection-permitting simulation improves representations of seasonal, 95th percentile, and extreme precipitation over a large portion of the CONUS, Alaska, and Puerto Rico, particularly in areas where precipitation is heaviest. The simulation adds value over its forcing data (ERA5) in up to 53% of all grid cells in the CONUS, 68.8% in Alaska, and 84.0% in Puerto Rico. It is important to note that, however, despite improvements, model errors in Puerto Rico remain large. Similar improvements are observed in extreme indices, including consecutive dry days, maximum 5 days precipitation, and extreme precipitation. Analysis of the diurnal cycle of mean hourly precipitation suggests that representations of convective processes—including onset, dissipation, suppression, downstream propagation, and local circulation—improved overall.

54 ENVIRONMENTAL SCIENCES↗

Quantum-parallel vectorized data encodings and computations on trapped-ion and transmon QPUs

Compact data representations in quantum systems are crucial for the development of quantum algorithms for data analysis. In this study, we present two innovative data encoding techniques, known as QCrank and QBArt, which exhibit significant quantum parallelism via uniformly controlled rotation gates. The QCrank method encodes a series of real-valued data as rotations on data qubits, resulting in increased storage capacity. On the other hand, QBArt directly incorporates a binary representation of the data within the computational basis, requiring fewer quantum measurements and enabling well-established arithmetic operations on binary data. We showcase various applications of the proposed encoding methods for various data types. Notably, we demonstrate quantum algorithms for tasks such as DNA pattern matching, Hamming weight computation, complex value conjugation, and the retrieval of a binary image with 384 pixels, all executed on the Quantinuum trapped-ion QPU. Furthermore, we employ several cloud-accessible QPUs, including those from IBMQ and IonQ, to conduct supplementary benchmarking experiments.

97 MATHEMATICS AND COMPUTING↗

VpROM: a novel variational autoencoder-boosted reduced order model for the treatment of parametric dependencies in nonlinear systems

Reduced Order Models (ROMs) are of considerable importance in many areas of engineering in which computational time presents difficulties. Established approaches employ projection-based reduction, such as Proper Orthogonal Decomposition. The limitation of the linear nature of such operators is typically tackled via a library of local reduction subspaces, which requires the assembly of numerous local ROMs to address parametric dependencies. Our work attempts to define a more generalisable mapping between parametric inputs and reduced bases for the purpose of generative modeling. We propose the use of Variational Autoencoders (VAEs) in place of the typically utilised clustering or interpolation operations, for inferring the fundamental vectors, termed as modes, which approximate the manifold of the model response for any and each parametric input state. The derived ROM still relies on projection bases, built on the basis of full-order model simulations, thus retaining the imprinted physical connotation. However, it additionally exploits a matrix of coefficients that relates each local sample response and dynamics to the global phenomena across the parametric input domain. The VAE scheme is utilised for approximating these coefficients for any input state. This coupling leads to a high-precision low-order representation, which is particularly suited for problems where model dependencies or excitation traits cause the dynamic behavior to span multiple response regimes. Moreover, the probabilistic treatment of the VAE representation allows for uncertainty quantification on the reduction bases, which may then be propagated to the ROM response. The performance of the proposed approach is validated on an open-source simulation benchmark featuring hysteresis and multi-parametric dependencies, and on a large-scale wind turbine tower characterised by nonlinear material behavior and model uncertainty.

Conditional VAEs↗

Towards AI-assisted neutrino flavor theory design

Particle physics theories, such as those which explain neutrino flavor mixing, arise from a vast landscape of model-building possibilities. A model’s construction typically relies on the intuition of theorists. It also requires considerable effort to identify appropriate symmetry groups, assign field representations, and extract predictions for comparison with experimental data. We develop Autonomous Model Builder (AMBer), a framework in which a reinforcement learning agent interacts with a streamlined physics software pipeline to search these spaces efficiently. AMBer selects symmetry groups, particle content, and group representation assignments to construct models while minimizing the number of free parameters introduced. We validate our approach in well-studied regions of theory space and extend the exploration to a previously unexamined symmetry group. While demonstrated in the context of neutrino flavor theories, this approach of reinforcement learning with physics software feedback may be extended to other theoretical model-building problems in the future.

Baretz, Jason Benjamin↗