SEARCH · Engineering Papers

Results for “separated representations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A data-driven linear formulation of the optimal demand response scheduling problem for an industrial air separation unit

Demand response (DR) has become a key element in balancing the power grid as the contribution of time-varying renewable power generation increases. Chemical plants are appealing candidates for DR programs as they offer large, concentrated and flexible loads. DR participation calls for frequent production rate changes over time scales that overlap with the dominant dynamics of the plant. Production scheduling should therefore consider the process dynamics explicitly. Here we present a data-driven approach for modelling the scheduling-relevant dynamics based on historical closed-loop operating data using autoregressive with extra inputs (ARX) models. We introduce a new, linear scheduling problem formulation based on the ARX representation, and demonstrate its implementation on an industrial air separation unit.

42 ENGINEERING↗

DOE OSTI2023

Aerodynamic Sensitivity of a Novel Data-Driven Airfoil Shape Representation Framework

We explore the aerodynamic implications of a novel data-driven separable shape tensor framework used to represent discrete airfoil shapes. In this study, we construct a data-driven parameter space defined by separable shape tensors and informed by tens of thousands of distinct airfoils. We use this design space to generate new airfoil designs to study parametric sensitivities with respect to various aerodynamic responses. We use a HAM2D RANS solver to approximate the lift, drag, and moment coefficients for the generated airfoils at two different angles-of-attack. We analyze the robustness and sensitivities of using the separable shape tensor design space by examining the coverage of the aerodynamic response space, uncovering low-dimensional polynomial ridge approximations, and computing various sensitivity metrics. The results show that the data-driven design space produce significant variation in target aerodynamic quantities and facilitate highly accurate approximations (R^2 > 0.96) of one- and two-dimensional structures in each aerodynamic response. This further reduces the effective dimension to enable simplified design and optimization tasks.

aerodynamics↗

DOE OSTI2026

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗

DOE OSTI2021

Transfer Learning using Denoising Auto-Encoders for Cellular-Level Annotation of Tumor in Pathology Slides

Adversarial examples can produce altered classifications using only seemingly innocuous, imperceptible perturbations to the original image. The imperceptibility of adversarial perturbations suggests that the corresponding classifiers use decision criteria different than those of a human. In a medical setting, inexplicable decision criteria confound a pathologist’s willingness to trust machine-generated annotations. Here, we analyze denoising tumor detection models to see if they are robust to imperceptible adversarial perturbations. Moreover, to be more fully trusted by pathologists, we require tumor detectors that generate interpretable annotations which segment pathology slides into tumorous and normal regions at the cellular level. We therefore compare transfer learning based on two different autoencoder architectures, one derived from a deep denoising bottleneck autoencoder and one from an over-complete sparse autoencoder. Both autoencoders were first trained in an unsupervised manner on a set of pathology slides drawn from the Camelyon16 dataset. The latent representations produced by each autoencoder were then passed to separate neural networks that were trained in a supervised manner on binary tumor-normal masks generated by pathologists at cellular resolution. Both tumor detectors supported better than 90% AUC PR as measured by the area under the precision/recall curve on a held-out pathology slide. To assess the underlying decision criteria used by both tumor detectors, we constructed imperceptible adversarial examples which reduced the AUC PR of both models to less than 70%. Random noise of the same amplitude had almost no effect on the AUC PR of either model. Additionally, each tumor detector was resistant to adversarial “transfer” attacks targeting the other. The adversarial perturbations showed strong characteristic differences: the deep denoising models perturbations were a very diffuse, seemingly unrecognizable pattern while the sparse coding models perturbations showed traces of tissue cells.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Core Model Proposal #377: Breaking out food processing sector in GCAM

Purpose: This Core Model Proposal (CMP) expands the representation of detailed industry (CMP-326) in GCAM by separating the food processing sector from the aggregate “other industry sector”. Historical energy use is calibrated to IEA data for food processing, with some infilling for regions with limited IEA data. Food processing is linked to the GCAM food demand module, setting the energy demand for food processing in future periods based on food demand. While the direct price feedback is currently muted and the linkage is represented at the aggregated regional level, this CMP establishes the groundwork for a more detailed connection between the agrifood sectors and energy sectors in future work.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Parallel Embeddings: a Visualization Technique for Contrasting Learned Representations

We introduce ``Parallel Embeddings'', a new technique that generalizes the classical Parallel Coordinates visualization technique from a sequence of features within a single matrix to a sequence of multiple feature matrices. This is accomplished by separately embedding each matrix in the sequence into a 2-D frame, juxtaposing these 2-D representations, then connecting points between frames. We outline how this visualization can be used for several ``model comparison'' tasks in machine learning. We compare user performance with Parallel Embeddings to a baseline using the TensorFlow Embedding Projector for estimating model accuracy and understanding conceptual model differences. We found that users were more accurate with Parallel Embeddings for model comparison and that users learned how to use Parallel Embeddings more quickly than TensorFlow Embedding Projector. Furthermore, users' analytical process using Embedding Projector was positively affected by using Parallel Embeddings beforehand.

Model comparison, machine learing, machine learnin↗

DOE OSTI2020

Symmetry-breaking polymorphous descriptions for correlated materials without interelectronic U

Correlated materials with open-shell d- and f-ions having degenerate band edge states show a rich variety of interesting properties ranging from metal-insulator transition to unconventional superconductivity. The textbook view for the electronic structure of these materials is that mean-field approaches are inappropriate, as the interelectronic interaction U is required to open a band gap between the occupied and unoccupied degenerate states while retaining symmetry. We show that the latter scenario often defining what Mott insulators are, is in fact not needed for the 3d binary oxides MnO, FeO, CoO, and NiO. The mean-field-like band theory can indeed lift such degeneracies in the binaries when nontrivial unit cell representations (polymorphous networks) are allowed to break symmetries, in conjunction with a recently developed non-empirical exchange and correlation density-functional without an on-site interelectronic interaction U. We explain how density-functional theory (DFT) in the polymorphous representation achieves band gap opening in correlated materials through a separate mechanism to the Mott-Hubbard approach. Here, we show the method predicts magnetic moments and gaps for the four binary monoxides in both the antiferromagnetic and paramagnetic phases, offering an effective alternative to symmetry-conserving approaches for studying a range of functionalities in open d- and f-shell complex materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2021

Transient cycling of nitrogen, organic carbon and oxygen within the free-flowing Columbia River corridor: Linking exposure time dependent biogeochemical reactions to river stage fluctuations (Final project report)

The objective of this project was to develop next-generation techniques for representing the transformations of complex reaction networks like those impacting transient river-corridors, then apply them to develop upscaling tools. The project contributed significantly to the development of Lagrangian “mass transfer particle tracking” (MTPT) tools that are the first numerical framework that explicitly separates mixing and spreading processes; a crucial distinction for accurate representations of reaction rates across scales. The MTPT approach uses an operator splitting scheme where physical transport processes are simulated using classical random walk methods and each particle is treated as a “container” that carries with it any number of chemical species. Mixing between particles is simulated using a colocation-probability based mass transfer kernel and reactions are evaluated on each particle after mixing. The method is stable, accurate, and also allows the explicit modeling of residence time distributions of the individual containers of mass. The MTPT scheme allowed us to explore several research questions related to reactive transport in river corridors and complex reaction networks. We found that it is possible to quantify the exposure time distributions (ETDs) of reactants and that this does suggest some pathways to upscaling. However, comparable approximations can be obtained using simplified (reduced dimensionality) MTPT simulations in less time with similar uncertainty, so development of extensive ETD-based methods was not productive. The major findings are that i) the MTPT schemes are robust and highly accurate across a range of arbitrarily complex reactions, ii) the methods can be efficiently parallelized and the parallel performance characteristics of MTPT are predictable, and iii) the MTPT tools allow simultaneous tracking of residence time. The development of these research tools into efficient software packages continues. The methods are already available to the community because open-source, working examples have been included with all publications.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Uncertainty Propagation within Chained Models for Machine Learning Reconstruction of Neutrino-LAr Interactions

Sequential or chained models are increasingly prevalent in machine learning for scientific applications, due to their flexibility and ease of development. Chained models are particularly useful when a task is separable into distinct steps with a hierarchy of meaningful intermediate representations. In reliability-critical tasks, it is important to quantify the confidence of model inferences. However, chained models pose an additional challenge for uncertainty quantification, especially when input uncertainties need to be propagated. In such cases, a fully uncertainty-aware chain of models is required, where each step accepts a probability distribution over the input space, and produces a probability distribution over the output space. In this work, we present a case study for adapting a single model within an existing chain, designed for reconstruction within neutrino-Argon interactions, developed for neutrino oscillation experiments such as MicroBooNE, ICARUS, and the future DUNE experiment. We test the performance of an input uncertainty-enabled model against an uncertainty-blinded model using a method for generating synthetic noise. By comparing these two, we assess the increase in inference quality achieved by exposing models to upstream uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Fracture-based shape optimization built upon the topological derivative

In Silva et al. (2011) and Alidoost et al. (2020), the authors developed an approximation of the energy release rate field associated with a small edge or surface crack at any boundary location and with any orientation using the topological derivative. The approximation is computationally attractive because it requires only a single analysis on the non-cracked domain in contrast with conventional boundary-element and finite-element-based methods, which require a separate and costlier analysis for each crack length-location-orientation combination. Here, a shape optimization scheme for fracture-resistant structures is developed using the energy release rate approximation. In the gradient-based optimization scheme, the domain and its boundary are defined implicitly using level-set functions. The level-set functions of arbitrary geometries are constructed using Boolean operations from the level-set functions of simple primitives. This geometrical representation has the dual advantage of (i) allowing shapes to intersect and/or separate during the optimization and (ii) simplifying the computation of the shape sensitivities.

42 ENGINEERING↗

DOE OSTI2020

Matrix ensembles with global symmetries and ’t Hooft anomalies from 2d gauge theory

The Hilbert space of a quantum system with internal global symmetry $\textit{G}$ decomposes into sectors labelled by irreducible representations of $\textit{G}$. If the system is chaotic, the energies in each sector should separately resemble ordinary random matrix theory. We show that such “sector-wise” random matrix ensembles arise as the boundary dual of two- dimensional gravity with a $\textit{G}$ gauge field in the bulk. Within each sector, the eigenvalue density is enhanced by a nontrivial factor of the dimension of the representation, and the ground state energy is determined by the quadratic Casimir. We study the consequences of ’t Hooft anomalies in the matrix ensembles, which are incorporated by adding specific topological terms to the gauge theory action. The effect is to introduce projective representations into the decomposition of the Hilbert space. Finally, we consider ensembles with $\textit{G}$ symmetry and time reversal symmetry, and analyze a simple case of a mixed anomaly between time reversal and an internal $\mathbb{Z}$ 2 symmetry.

2D Gravity↗

DOE OSTI2022

Natural switches in behaviour rapidly modulate hippocampal coding

Throughout their daily lives, animals and humans often switch between different behaviours. However, neuroscience research typically studies the brain while the animal is performing one behavioural task at a time, and little is known about how brain circuits represent switches between different behaviours. Here we tested this question using an ethological setting: two bats flew together in a long 135 m tunnel, and switched between navigation when flying alone (solo) and collision avoidance as they flew past each other (cross-over). Bats increased their echolocation click rate before each cross-over, indicating attention to the other bat. Hippocampal CA1 neurons represented the bat’s own position when flying alone (place coding). Notably, during cross-overs, neurons switched rapidly to jointly represent the interbat distance by self-position. This neuronal switch was very fast—as fast as 100 ms—which could be revealed owing to the very rapid natural behavioural switch. The neuronal switch correlated with the attention signal, as indexed by echolocation. Interestingly, the different place fields of the same neuron often exhibited very different tuning to interbat distance, creating a complex non-separable coding of position by distance. Theoretical analysis showed that this complex representation yields more efficient coding. Overall, our results suggest that during dynamic natural behaviour, hippocampal neurons can rapidly switch their core computation to represent the relevant behavioural variables, supporting behavioural flexibility.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Computer-aided process intensification of natural gas to methanol process

The recent revolution in shale gas has presented opportunities for distributed manufacturing of key commodity chemicals, such as methanol, from methane. However, the conventional methane-to-methanol process is energy intensive which negatively affects the profitability and sustainability. Here an intensified process configuration that is both economically attractive and environmentally sustainable. This flowsheet is systematically discovered using the building block-based representation and optimization methodology. The new process configuration utilizes membrane-assisted reactive separations and can have as much as 190% higher total annual profit compared to a conventional configuration. Additionally, it has 57% less CO 2 -equivalent greenhouse gas emission. Such drastic improvement highlights the advantages of building block-based computer-aided process intensification method.

42 ENGINEERING↗

DOE OSTI2025

A knowledge-informed large language model framework for U.S. nuclear power plant shutdown initiating event classification for probabilistic risk assessment

Identifying and classifying shutdown initiating events (SDIEs) is critical for developing shutdown probabilistic risk assessment for nuclear power plants. Existing computational approaches cannot achieve satisfactory performance due to the challenges of unavailable large, labeled datasets, imbalanced event types, and label noise. To address these challenges, we propose a hybrid pipeline that integrates a knowledge-informed machine learning model to prescreen non-SDIEs and a large language model (LLM) to classify SDIEs into four types. In the prescreening stage, we proposed a set of 44 SDIE text patterns that consist of the most salient keywords and phrases from six SDIE types. Text vectorization based on the SDIE patterns generates feature vectors that are highly separable by using a simple binary classifier. The second stage builds Bidirectional Encoder Representations from Transformers (BERT)-based LLM, which learns generic English language representations from self-supervised pretraining on a large dataset and adapts to SDIE classification by fine-tuning it on an SDIE dataset. The proposed approaches are evaluated on a dataset with 10,928 events using precision, recall ratio, F 1 score, and average accuracy. In conclusion, the results demonstrate that the prescreening stage can exclude more than 97% non-SDIEs, and the LLM achieves an average accuracy of 95.1% for SDIE classification.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

String-based parametrization of nucleon GPDs at any skewness: A comparison to lattice QCD

We introduce a string-based parametrization for nucleon quark and gluon generalized parton distributions (GPDs) valid at all skewness values. The conformal moments of the GPDs are expressed as sums of the spin-j nucleon A-form factor and the skewness-dependent spin-j nucleon D-form factor. This representation, which fulfills the polynomiality condition (due to Lorentz invariance) and does not rely on model-specific assumptions, is derived from t-channel string exchanges in anti-de Sitter spaces. The spin-j nucleon D-form factor is closely related to the spin-j nucleon A-form factor. We use the Mellin moments from empirical parton distributions to model the spin-j nucleon A-form factors. Using only five Regge slope parameters, fixed from the electromagnetic and gravitational form factors, our string-based parametrization generates accurate singlet, nonsinglet, isovector, and flavor-separated nucleon quark GPDs, along with symmetric nucleon gluon GPDs from their Mellin-Barnes integral representations. Our isovector nucleon quark GPD is in agreement with existing lattice data. Our string-based parametrization should facilitate the empirical extraction and global analysis of nucleon GPDs in exclusive processes, bypassing the deconvolution challenge.

Electron-ion collisions↗

DOE OSTI2023

Systematically derived thermodynamic properties for alkane oxidation

Key combustion properties, such as ignition delay time, show strong sensitivity to the thermochemistry of the main species in the standard radical oxidation pathway at low temperatures (600-1000K). Significant uncertainties persist in current estimates of thermodynamic properties, particularly for the larger species of relevance to common practical fuels. In this article, we use advanced computational schemes to evaluate thermodynamic properties for the fuel, fuel radical, peroxy, hydroperoxy-alkyl radical, and hydroperoxide species for a set of 17 fuels containing up to 9 carbon atoms, and with various degrees of branching in the alkane backbone. The procedure, termed STAR-1D, combines conformer sampling to find the minimum geometry, B2PLYP-D3/cc-pVTZ harmonic frequency evaluations, and omega B97X-D/cc-pVTZ one-dimensional torsional mapping. It includes two physically-based scaling routines: a frequency-dependent scaling to B2PLYP-D3/cc-pVTZ anharmonic frequencies and a scaling of one-dimensional omega B97X-D/ccpVTZ torsional profiles to reproduce the product of the B2PLYP-D3/cc-pVTZ frequencies in the harmonic limit. Substantive comparisons with existing experimental databases, together with careful examinations of key theoretical assumptions, are used to explore the accuracy of the predictions. These computationally intensive explorations of 195 species were facilitated by automated thermochemistry software. Further, high accuracy 0 K heats of formation from a separate study are used with the STAR-1D computations to generate NASA polynomial representations. In addition to their intrinsic value, the present results also provide a reliable database for the optimization of group additivity or machine learning schemes for scaling to larger combustion systems. Towards this end a complementary extensive conformational analysis is carried out for the medium sized species and the thermodynamic properties of the lowest energy hydrogen-bonded and non-hydrogen bonded conformers are contrasted for larger hydroperoxy-alkyl radical species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

A Model for Turbulence Spectra in the Equilibrium Range of the Stable Atmospheric Boundary Layer

Stratification can cause turbulence spectra to deviate from Kolmogorov's isotropic -5/3 power law scaling in the universal equilibrium range at high Reynolds numbers. However, a consensus has not been reached with regard to the exact shape of the spectra. Here we propose a shape of the turbulent kinetic energy and temperature spectra in horizontal wavenumber for the equilibrium range that consists of three regimes at small Froude number: the buoyancy subrange, a transition region, and the isotropic inertial subrange through dimensional analysis and substantial revision of previous theoretical approximation. These spectral regimes are confirmed by various observations in the atmospheric boundary layer. The representation of the transition region in direct numerical simulations will require large-scale separation between the Dougherty-Ozmidov scale and the Kolmogorov scale for strongly stratified turbulence at high Reynolds numbers, which is still challenging computationally. In addition, we suggest that the failure of Monin-Obukhov similarity theory in the very stable atmospheric boundary layer is due to the fact that it does not consider the buoyancy scale that characterizes the transition region.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗