Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “separated representations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Recombination smooths the time-signal disrupted by latency in within-host HIV phylogenies

Within-host HIV evolution involves several features that may disrupt standard phylogenetic reconstruction. One important feature is re-activation of latently integrated provirus, which has the potential to disrupt the temporal signal, leading to variation in the branch lengths and apparent evolutionary rates in a tree. Yet, real within-host HIV phylogenies tend to show clear, ladder-like trees structured by the time of sampling. Another important feature is recombination, which violates the fundamental assumption that evolutionary history can be represented by a single bifurcating tree. Thus, recombination complicates the within-host HIV dynamic by mixing genomes and creating evolutionary loop structures that cannot be represented in bifurcating trees. In this paper, we develop a coalescent-based simulator of within-host HIV evolution that includes latency, recombination, and effective population size dynamics that allows us to study the relationship between the true, complex genealogy of within-host HIV evolution, encoded as an Ancestral Recombination Graph (ARG), and the observed phylogenetic tree. To compare our ARG results to the familiar phylogeny format, we calculate the expected bifurcating tree after decomposing the ARG into all unique site trees, their combined distance matrix, and the overall corresponding bifurcating tree. While latency and recombination separately disrupt the phylogenetic signal, remarkably, we find that recombination recovers the temporal signal of within-host HIV evolution caused by latency by mixing fragments of old, latent genomes into the contemporary population. In effect, recombination averages over extant heterogeneity, whether it stems from mixed time-signals or population bottlenecks. Further, we establish that the signals of latency and recombination can be observed in phylogenetic trees despite being an incorrect representation of the true evolutionary history. Using an Approximate Bayesian Computation method, we develop a set of statistical probes to tune our simulation model to nine longitudinally-sampled within-host HIV phylogenies. Because ARGs are exceedingly difficult to infer from real HIV data, our simulation system allows investigating effects of latency, recombination, and population size bottlenecks by matching decomposed ARGs to real data as observed in standard phylogenies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Understanding Generative AI Content with Embedding Models

The construction of high-quality numerical features is critical to any quantitative data analysis. Feature engineering has been historically addressed by carefully hand-crafting data representations based on domain expertise. This work views the internal representations of modern deep neural networks (DNNs), called embeddings, as an implicit form of traditional feature engineering. For trained DNNs, we show that these embeddings can reveal interpretable, high-level concepts in unstructured sample data. We use these embeddings in natural language and computer vision tasks to uncover both inherent heterogeneity in the underlying data and human-understandable explanations for it. In particular, we find empirical evidence that there is inherent separability between real data and those generated from AI models.

Vargas, Max↗
DOE OSTI2020

Implementation of a Quasi-3D Multiscale Modeling Framework to ACME

Representation of unresolved cloud processes has been one of the most challenging problems in numerical modeling of the atmosphere. During the last decades, considerable efforts have been spent to better represent the collective effects of those processes in terms of resolved scales (see Arakawa 2004 for a review). Still, the progress on this problem has been unacceptably slow as pointed out by Randall et al. (2003). The large part of the difficulty is inherent in the artificial separation of atmospheric processes into the explicitly simulated resolved scales and the highly parameterized subgrid scales. Arakawa (2004) and Arakawa et al. (2011) suggested two plausible approaches to eliminate the problem of artificial separation ofatmospheric processes: “parameterize everything” and “resolve everything”.

58 GEOSCIENCES↗
DOE OSTI2020

Use of Remote Sensing and In-situ Observations to Develop and Evaluate Improved Representations of Convection and Clouds for the Accelerated Climate Model for Energy. Final report

Representation of unresolved cloud processes has been one of the most challenging problems in numerical modeling of the atmosphere. During the last decades, considerable efforts have been spent to better represent the collective effects of those processes in terms of resolved scales (see Arakawa 2004 for a review). Still, the progress on this problem has been unacceptably slow as pointed out by Randall et al. (2003). The large part of the difficulty is inherent in the artificial separation of atmospheric processes into the explicitly simulated resolved scales and the highly parameterized subgrid scales. Arakawa (2004) and Arakawa et al. (2011) suggested two plausible approaches to eliminate the problem of artificial separation of atmospheric processes: “parameterize everything” and “resolve everything”.

58 GEOSCIENCES↗
DOE OSTI2020

Load Composition Analysis in Support of the NERC Load Modeling Task Force. 2019-2020 Field Test of the Composite Load Model

In 2015, NERC’s reliability standards were revised to require the use of dynamic load models in transmission planning studies. To comply with the standards, planners must use load models that explicitly represent the dynamic behavior of the different constituents of load at each load bus within their transmission planning models. The most important of these constituents are motor-driven and power electronics-based loads. Collectively, these representations are known as composite load models. In anticipation of the compliance date for the new standards, NERC’s Load Modeling Task Force (LMTF), in 2019, initiated a field test of composite load models involving the regional reliability planning entities. In support of the field test, DOE and BPA researchers developed region-specific composite load models that could be assigned to each non-industrial load bus in the planning models for each of the North American interconnections. Separate models were developed for each hour of a summer peak day, a winter peak day, and a spring light-load day. This report is the technical documentation for the load composition analysis that was conducted to develop these non-industrial composite load models.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Combining variational autoencoders and physical bias for improved microscopy data analysis *

Electron and scanning probe microscopy produce vast amounts of data in the form of images or hyperspectral data, such as electron energy loss spectroscopy or 4D scanning transmission electron microscope, that contain information on a wide range of structural, physical, and chemical properties of materials. To extract valuable insights from these data, it is crucial to identify physically separate regions in the data, such as phases, ferroic variants, and boundaries between them. In order to derive an easily interpretable feature analysis, combining with well-defined boundaries in a principled and unsupervised manner, here we present a physics augmented machine learning method which combines the capability of variational autoencoders to disentangle factors of variability within the data and the physics driven loss function that seeks to minimize the total length of the discontinuities in images corresponding to latent representations. Our method is applied to various materials, including NiO-LSMO, BiFeO 3 , and graphene. The results demonstrate the effectiveness of our approach in extracting meaningful information from large volumes of imaging data. The customized codes of the required functions and classes to develop phyVAE is available at https://github.com/arpanbiswas52/phy-VAE.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Optimized low-depth quantum circuits for molecular electronic structure using a separable-pair approximation

We present a classically tractable model that leads to optimized low-depth quantum circuits leveraging separable-pair approximations. The obtained circuits are well suited as a baseline circuit for emerging quantum hardware and can, in the long term, provide significantly improved initial states for quantum algorithms. The associated wave functions can be represented with linear memory requirement, which allows classical optimization of the circuits and naturally defines a minimum benchmark for quantum algorithms. In this work we employ directly determined pair-natural orbitals within a basis-set-free approach. This leads to accurate representation of the one- and many-body parts for weakly correlated systems and we explicitly illustrate how the model can be integrated into other quantum algorithms for stronger correlated systems.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

CLDERA-E3SM

SAND2025-03846O CLDERA-E3SM enhances the E3SMv2 model by adding new options such as complete stratospheric volcanic aerosol representation and idealized physics model configuration for the atmosphere component. CLDERA-E3SM also allows for aerosol source emission specification, which is a powerful method for tracking aerosol and its climate impacts in E3SMv2. This new code better represents stratospheric sulfate aerosol and includes modifications such as changes to the default aerosol size distributions and to stratospheric aerosol microphysical treatment, which allows stratospheric sulfate aerosol to grow larger than in the default E3SMv2. New aerosol source tagging can be customized to separate the global emission of select aerosol tracers—such as sulfate, black carbon, and organic carbon aerosol—into a new, user specified list of sources. It also includes idealized simulations of the atmosphere and volcanic aerosol tracers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hillman, Benjamin↗
DOE OSTI2021

Efficient Four-Component Dirac–Coulomb–Gaunt Hartree–Fock in the Pauli Spinor Representation

Four-component Dirac Hartree--Fock is an accurate mean-field method for treating molecular systems where relativistic effects are important. However, the computational cost and complexity of the two-electron interaction makes this method less common, even though we can consider the Dirac Hartree--Fock Hamiltonian the ``ground truth" of electronic structure, barring explicit quantum-electrodynamical effects. Being able to calculate these effects is then vital to the design of lower scaling methods for accurate predictions in computational spectroscopy and properties of heavy element complexes that must include relativistic effects for even qualitative accuracy. In this work, we present a Pauli quaternion formalism of maximal component- and spin-separation for computing the Dirac-Coulomb-Gaunt Hartree-Fock ground state, with a minimal floating-point-operation count algorithm. Furthermore, this approach also allows one to explicitly separate different spin physics from the two-body interactions, such as spin-free, spin-orbit, and the spin-spin contributions. Additionally, we use this formalism to examine relativistic trends in the periodic table, and analyze the basis set dependence of atomic gold and gold dimer systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Filling-enforced obstructed atomic insulators

Topological band theory has achieved great success in the high-throughput search for topological band structures both in paramagnetic and magnetic crystal materials. However, a significant proportion of materials are topologically trivial insulators at the Fermi level. In this paper, we show that, remarkably, for a subset of the topologically trivial insulators, knowing only their electron number and the Wyckoff positions of the atoms we can separate them into two groups: the obstructed atomic insulator (OAI) and the atomic insulator (AI). The interesting group, the OAI, have a center of charge not localized on the atoms. Using the theory of topological quantum chemistry, in this work we first derive the necessary and sufficient conditions for a topologically trivial insulator to be a filling enforced obstructed atomic insulator (feOAI) in the 1651 Shubnikov space groups. Remarkably, the filling enforced criteria enable the identification of obstructed atomic bands without knowing the representations of the band structures. Hence, no calculations are needed for the filling enforced criteria, although they are needed to obtain the band gaps. With the help of the Topological Quantum Chemistry website, we have performed a high-throughput search for feOAIs and have found that 957 ICSD entries (638 unique materials) are paramagnetic feOAIs, among which 738 (475) materials have an indirect gap. The metallic obstructed surface states of feOAIs are also showcased by several material examples. Published by the American Physical Society 2024

Materials Science↗
DOE OSTI2025

Physics-informed latent neural operator for real-time predictions of time-dependent parametric PDEs

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied to systems with high-dimensional input-output mappings arising from large numbers of spatial and temporal collocation points, these models often require heavily overparameterized networks, leading to long training times. Latent DeepONet addresses some of these challenges by introducing a two-step approach: first learning a reduced latent space using a separate model, followed by operator learning within this latent space. While efficient, this method is inherently data-driven and lacks mechanisms for incorporating physical laws, limiting its robustness and generalizability in data-scarce settings. Here, in this work, we propose PI-Latent-NO, a physics-informed latent neural operator framework that integrates governing physics directly into the learning process. Our architecture features two coupled DeepONets trained end-to-end: a Latent-DeepONet that learns a low-dimensional representation of the solution, and a Reconstruction-DeepONet that maps this latent representation back to the physical space. By embedding PDE constraints into the training via automatic differentiation, our method eliminates the need for labeled training data and ensures physics-consistent predictions. The proposed framework is both memory and compute-efficient, exhibiting near-constant scaling with problem size and demonstrating significant speedups over traditional physics-informed operator models. We validate our approach on a range of parametric PDEs, showcasing its accuracy, scalability, and suitability for real-time prediction in complex physical systems.

Latent representations↗
DOE OSTI2026

Identifying Anomalous DESI Galaxy Spectra with a Variational Autoencoder

The tens of millions of spectra being captured by the Dark Energy Spectroscopic Instrument (DESI) provide tremendous discovery potential. In this work we show how Machine Learning, in particular Variational Autoencoders (VAE), can detect anomalies in a sample of approximately 200,000 DESI spectra comprising galaxies, quasars and stars. We demonstrate that the VAE can compress the dimensionality of a spectrum by a factor of 100, while still retaining enough information to accurately reconstruct spectral features. We then detect anomalous spectra as those with high reconstruction error and those which are isolated in the VAE latent representation. The anomalies identified fall into two categories: spectra with artefacts and spectra with unique physical features. Awareness of the former can help to improve the DESI spectroscopic pipeline; whilst the latter can lead to the identification of new and unusual objects. To further curate the list of outliers, we use the Astronomaly package which employs Active Learning to provide personalised outlier recommendations for visual inspection. In this work we also explore the VAE latent space, finding that different object classes and subclasses are separated despite being unlabelled. We demonstrate the interpretability of this latent space by identifying tracks within it that correspond to various spectral characteristics. For example, we find tracks that correspond to increasing star formation and increase in broad emission lines along the Balmer series. In upcoming work we hope to apply the methods presented here to search for both systematics and astrophysically interesting objects in much larger datasets of DESI spectra.

Nicolaou, C. [University Coll. London] (ORCID:0000↗
DOE OSTI2025

Representing Soil Microbial Dynamics and Organo‐Mineral Interactions in the E3SM Land Model (ELM‐ReSOM)

Explicit representation of soil microbial processes and interactions with biotic and abiotic processes in Earth System Models (ESMs) remains limited, despite their importance in biogeochemical cycles. To address this gap, which hinders prediction of global biogeochemial cycling and responses to atmospheric conditions, we integrated a microbe- and mineral-surface-explicit model, the Reaction-network-based model of soil organic matter and Microbes (ReSOM), into the Energy Exascale ESM (E3SM) land model (ELM). Here, we describe ELM-ReSOM and show a case study at a conifer forest in California. ELM-ReSOM accurately simulated surface CO 2 fluxes and SOM stocks, demonstrating improved representations of microbial and mineral interactions compared to the default ELM. We examined ELM-ReSOM sensitivity to microbial traits, enzyme properties, and organo-mineral interactions. Microbial traits such as the maximum mortality rate, transporter-density scaling factor, and maximum monomer assimilation rate were strong controllers of heterotrophic respiration, while these microbial traits and enzyme-related properties collectively influenced SOM stocks. Mineral surfaces primarily affected SOM stocks by adsorbing enzymes, thereby limiting depolymerization. Synergies among processes led to stronger impacts of parameters when evaluated together versus separately (i.e., most parameters had greater indirect than direct effects). For example, due to interactions of microbial necromass with mineral surface adsorption, the indirect effect of the maximum microbial mortality rate was 33% larger than its direct effect on SOM stock. Thus, microbial and enzyme dynamics and their interactions with mineral surfaces play critical roles in SOM cycling. Tackling the challenges of microbe-explicit models will advance understanding and modeling of SOM dynamics.

Tao, Jing [Lawrence Berkeley National Laboratory (↗
DOE OSTI2025

Data and Code for Understanding Generative AI Content with Embedding Models

This repository contains code for the experiments in the paper "Understanding Generative AI Content with Embedding Models". Constructing high-quality features is critical to any quantitative data analysis. While feature engineering was historically addressed by carefully hand-crafting data representations based on domain expertise, deep neural networks (DNNs) now offer a radically different approach. DNNs implicitly engineer features by transforming their input data into hidden feature vectors called embeddings. For embedding vectors produced by foundation models -- which are trained to be useful across many contexts -- we demonstrate that simple and well-studied dimensionality-reduction techniques such as Principal Component Analysis uncover inherent heterogeneity in input data concordant with human-understandable explanations. Of the many applications for this framework, we find empirical evidence that there is intrinsic separability between real samples and those generated by artificial intelligence (AI).

Vargas, Max [Pacific Northwest National Laboratory↗
DOE OSTI2025

Deep Learning Approaches for Predicting the Surface Tension of Ionic Liquids

Ionic liquids (ILs) are a novel class of solvents that have attracted significant attention due to their unique and tunable properties. Among their physiochemical characteristics, surface tension plays a critical role in various industrial applications including electrolytes, heat transfer fluids, and separation processes. However, because of the exploratory nature of IL design and the vast combinatorial space of possible anion–cation pairs, the experimental determination of these properties is often impractical, being both time-consuming and costly. To overcome these challenges, computational approaches are increasingly employed to develop accurate predictive models that can accelerate IL discovery and design. In this study, we present two deep learning (DL) models for predicting the surface tension of ILs across a broad temperature range at a constant pressure. The models use simplified molecular input line entry system, SMILES, representations of ILs to extract molecular features as inputs. Both DL models demonstrate excellent agreement with experimental data, achieving an R 2 value of 0.990 and a root-mean-square error of 0.792 mN/m. In conclusion, these results offer valuable insights for the rapid screening and rational design of ILs with tailored surface tension values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Environmental controls on the light use efficiency of terrestrial gross primary production

Abstract Gross primary production (GPP) by terrestrial ecosystems is a key quantity in the global carbon cycle. The instantaneous controls of leaf‐level photosynthesis are well established, but there is still no consensus on the mechanisms by which canopy‐level GPP depends on spatial and temporal variation in the environment. The standard model of photosynthesis provides a robust mechanistic representation for C 3 species; however, additional assumptions are required to “scale up” from leaf to canopy. As a consequence, competing models make inconsistent predictions about how GPP will respond to continuing environmental change. This problem is addressed here by means of an empirical analysis of the light use efficiency (LUE) of GPP inferred from eddy covariance carbon dioxide flux measurements, in situ measurements of photosynthetically active radiation (PAR), and remotely sensed estimates of the fraction of PAR (fAPAR) absorbed by the vegetation canopy. Focusing on LUE allows potential drivers of GPP to be separated from its overriding dependence on light. GPP data from over 100 sites, collated over 20 years and located in a range of biomes and climate zones, were extracted from the FLUXNET2015 database and combined with remotely sensed fAPAR data to estimate daily LUE. Daytime air temperature, vapor pressure deficit, diffuse fraction of solar radiation, and soil moisture were shown to be salient predictors of LUE in a generalized linear mixed‐effects model. The same model design was fitted to site‐based LUE estimates generated by 16 terrestrial ecosystem models. The published models showed wide variation in the shape, the strength, and even the sign of the environmental effects on modeled LUE. These findings highlight important model deficiencies and suggest a need to progress beyond simple “goodness of fit” comparisons of inferred and predicted carbon fluxes toward an approach focused on the functional responses of the underlying dependencies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Adaptive Methods for Radial Basis Functions

Radial basis functions (RBFs) are a powerful tool for constructing high-order accurate reduced representations of scattered data in arbitrary dimension and on manifolds. We present a method of constructing data approximations in which we utilize a functional tail to capture a global background profile and a RBF neural network (NN) to capture the smaller-scale features. In the RBF NN the RBF centers, matrix shape parameters were selected adaptively for each RBF. We also utilized a geodesic notion of distance on the manifold on which the data lies, e.g., the spherical geodesic for data on the sphere. Although each of these ideas have been been investigated separately in previous works, their combination into a single algorithm is novel. We defined a machine learning problem in which these properties are learned to minimize the data reduction error. We demonstrate the algorithm for applications of scattered data reduction in the plane and on the sphere.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Computational design of metamaterials with self contact

Inverse homogenization in combination with contact modeling, topology optimization and shape optimization is used to design metamaterials with optimized macroscopic response. The homogenization assumes length scale separation which allows the non-linear macroscopic behavior to be obtained by analyzing a single unit cell in a lattice structure. Self contact in the unit cell, which is modeled using a third medium contact method, is leveraged to obtain a complex homogenized response. The inverse homogenization problem is initially formulated as a topology optimization problem, where the macroscopic stress–strain behavior is tuned to our liking. However, it is well known that boundary phenomena are difficult to model in topology optimization and that interface modeling is crucial to accurately analyze contact. For that reason, the boundary representation of the topology optimized design is extracted and used as initial design in a subsequent shape optimization. The behaviors of our designs are verified by performing rigorous post-processing analyzes using conforming meshes and conventional contact formulations.

42 ENGINEERING↗