Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Forest regeneration within Earth system models: current process representations and ways forward

Earth system models must predict forest responses to global change in order to simulate future global climate, hydrology, and ecosystem dynamics. These models are increasingly adopting vegetation demographic approaches that explicitly represent tree growth, mortality, and recruitment, enabling advances in the projection of forest vulnerability and resilience, as well as evaluation with field data. To date, simulation of regeneration processes has received far less attention than simulation of processes that affect growth and mortality, in spite of their critical role maintaining forest structure, facilitating turnover in forest composition over space and time, enabling recovery from disturbance, and regulating climate-driven range shifts. Here, our critical review of regeneration process representations within current Earth system vegetation demographic models reveals the need to improve parameter values and algorithms for reproductive allocation, dispersal, seed survival and germination, environmental filtering in the seedling layer, and tree regeneration strategies adapted to wind, fire, and anthropogenic disturbance regimes. These improvements require synthesis of existing data, specific field data-collection protocols, and novel model algorithms compatible with global-scale simulations. Vegetation demographic models offer the opportunity to more fully integrate ecological understanding into Earth system prediction; regeneration processes need to be a critical part of the effort.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A Variational Autoencoder Model Toward Molecular Structure Representation Learning of Fuels

Here, in this work, a Variational Autoencoder (VAE)-based data-driven modeling framework is developed with the overarching goal of enabling fuel design. The VAE model is trained on a large dataset with several chemical species to learn a compressed latent space molecular representation. Chemical structure in the form of Simplified Molecular Input Line Entry System (SMILES) string is fed as input, encoded into the VAE latent space, and decoded back to the SMILES string using Long Short-Term Memory (LSTM) networks. Complexities of the VAE training loss function are thoroughly examined by varying the weightage (beta (𝜷) parameter) of the latent space regularization term, thereby assessing the balance between reconstruction accuracy and validity, and focusing on both accurate molecular structure reconstruction and latent space consistency. Two different strategies for 𝜷 variation are evaluated: linear annealing and cyclic annealing. In addition, the impact of total correlation adjustment and hierarchical priors is also studied with regard to the balance between reconstruction fidelity and latent space regularization, and potential issues such as posterior collapse, over-regularization, and poor disentanglement of latent variables. Overall, the best performance of the model is achieved with hierarchical priors and incrementally increasing 𝜷 from 0 to a threshold value of 0.25 over 75 epochs. The generative VAE model can be readily coupled with Quantitative Structure–Property Relationship (QSPR) analysis to develop an integrated end-to-end framework for fuel-property prediction and molecular design of novel promising fuels.

fuel design↗
DOE OSTI2020

Parallel Embeddings: a Visualization Technique for Contrasting Learned Representations

We introduce ``Parallel Embeddings'', a new technique that generalizes the classical Parallel Coordinates visualization technique from a sequence of features within a single matrix to a sequence of multiple feature matrices. This is accomplished by separately embedding each matrix in the sequence into a 2-D frame, juxtaposing these 2-D representations, then connecting points between frames. We outline how this visualization can be used for several ``model comparison'' tasks in machine learning. We compare user performance with Parallel Embeddings to a baseline using the TensorFlow Embedding Projector for estimating model accuracy and understanding conceptual model differences. We found that users were more accurate with Parallel Embeddings for model comparison and that users learned how to use Parallel Embeddings more quickly than TensorFlow Embedding Projector. Furthermore, users' analytical process using Embedding Projector was positively affected by using Parallel Embeddings beforehand.

Model comparison, machine learing, machine learnin↗
DOE OSTI2025

Microstructure Scale Lithium-Ion Battery Modeling: Part I. On Through-Plane Heterogeneity, Impact of Mesh Representation, and Differences between Macro- and Microscale Models

Li-ion battery performance and degradation are strongly correlated with the electrode microstructures and can be modeled at different scales, each with their own limitations. Herein, we compare predictions achieved with a macro- and a micro-scale model, that is, respectively, neglecting or considering the microstructural heterogeneity of the composite electrodes, on virtual numerically generated and real microstructures. While both models are in relative agreement at the low charge rates, differences arise for fast charging scenarios and especially for the real, highly heterogenous, microstructures. The microscale model predicts that electrolyte concentration saturation and depletion, respectively, at the back of the cathode and of the anode are exacerbated, and that lithium plating occurs earlier for real microstructures. The present work also indicates that the mesh representation significantly impacts the microscale model predictions, and consequently that microscale models should add surface area as a parameter to consider explicitly surface roughness. This article is the first of a series, with subsequent entries further investigating in-plane heterogeneities, lithium plating, and the impact of microstructure representativity on model predictions.

25 ENERGY STORAGE↗
DOE OSTI2022

A Novel Fault Diagnosis Approach for Rolling Bearing Based on CWT and Adaptive Sparse Representation

Extraction and enhancement of weak impulse signature is the key of rolling bearing fault prognostics in which case the features are often weak and covered by noise. Tunable Q-factor wavelet transform (TQWT), as an emerging wavelet construction theory developed in a frequency domain explicitly, has the advantages of matching with the specific oscillation behavior of signal components. In this article, an adaptive sparse representation (ASR) method is proposed, which integrates the sparse code shrinkage (SCS) and parameter optimization into TQWT. However, direct application of ASR is difficult to extract fault signatures at the early stage or low-speed operation due to weak fault symptoms and background noise. A novel fault diagnosis strategy based on continuous wavelet transform (CWT) and ASR is investigated. CWT owns significant advantages on multiscale subdivision and weak signal detection. The results of simulated and experimental vibration signal analyses verify the effectiveness of the proposed method in accurately extracting weak impulse features from the noise environment.

Yuan, Xing↗
DOE OSTI2022

Concentric Spherical GNN for 3D Representation Learning

SAND2022-1325 O This codebase implements a new deep learning model for 3D representation learning. It includes experiments on open-source point cloud and 3D mesh datasets, namely ModelNet40 and ShapeNet. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fox, James↗
DOE OSTI2021

Multiscale characterization and representation of variability in ceramic matrix composites

Low density, high strength, and high creep and oxidation resistance properties of ceramic matrix composites (CMCs) make them an ideal choice for use in extreme environments in space and military applications. This paper presents a detailed characterization study of structural and manufacturing flaws in Carbon fiber Silicon-Carbide-Nitride matrix (C/SiNC) CMCs at different length-scales. Energy-dispersive spectroscopy (EDS) is used for the chemical characterization of the material’s elemental constituents. High-resolution multiscale graphs obtained from scanning electron microscope (SEM) and confocal laser scanning microscope (LSM) are used to characterize the distribution and morphology of defects at different length scales. This is followed by the classification and quantification of the common manufacturing defects. An image processing algorithm based on the image segmentation process is developed to quantify the variability of various scale-dependent architectural parameters. Finally, a three-dimensional stochastic representative volume element (SRVE) generation algorithm is developed to provide precise representations of material textures at multiple length scales. The developed algorithm accurately accounts for material features and flaws based on a range of multiscale structural and defects characterization results.

36 MATERIALS SCIENCE↗
DOE OSTI2026

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space

Background Protein language models (PLMs) have revolutionized protein fitness prediction, yet their application to rapidly evolving viral pathogens is often confounded by extreme sequence homology. This homology leads to “data leakage” in standard random validation splits, yielding inflated performance metrics that fail to translate into real-world biosurveillance utility. Results We present Protein Representation Inference for Mutation Evaluation (PRIME), a framework that integrates domain-specific fine-tuning with a rigorous position-stratified validation protocol to evaluate viral threats. Using a dataset of 347,432 SARS-CoV-2 receptor binding domain (RBD) sequences, we demonstrate that while random training data split yields deceptive R 2 values (> 0.90), they fail to generalize to novel mutational sites. By benchmarking models up to 650 M parameters, we show that domain-specific fine-tuning of the ESM-C 600 M model with correctly stratified data provides an initial demonstration of predictive signal for binding affinity and expression at unseen mutational sites of binding affinity and expression on unseen sites (R 2 ~0.23), a significant advancement over base foundation models which exhibit no predictive power (R 2 <0). PRIME’s embedding-based clustering identified 3.03% of bat coronavirus sequences as candidates for further experimental prioritization based on their functional similarity to human-infective strains in embedding space, offering a perspective complementary to traditional phylogenetic methods. Conclusion PRIME establishes a new benchmark for the application of PLMs in pathogen surveillance. Our findings demonstrate that state-of-the-art models and fine-tuning, when paired with stratified validation, provide biologically meaningful insights into pathogen evolution and zoonotic risk.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Sempervirens: A Fast Reconstruction Algorithm for Noisy and Incomplete Binary Matrix Representations of Trees

Applications such as reconstructing cell lineage trees (represented as phylogenetic trees) from single-cell sequencing data require reconstructing a {0,1}-matrix that has many errors and missing entries. We introduce Sempervirens, a very fast matrix reconstruction algorithm for noisy and incomplete matrix representations of phylogenetic trees. Sempervirens uses an iterative maximum-likelihood approach to determine the topology tree represented by the corrupted data. We show that Sempervirens is at least three orders of magnitude faster than other methods on thousand by thousand matrices, with the speed gap widening with larger matrices. We also show that Sempervirens matches state-of-the-art methods in reconstruction accuracy. The speed of Sempervirens enables it to be tractably applied to reconstructing much larger matrices than those that other methods can reconstruct. In addition to experimental results, we justify the algorithm with a mathematical treatment of its subprocedures.

algorithms↗
DOE OSTI2021

Fully Convolutional Spatio-Temporal Models for Representation Learning in Plasma Science

We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science issue that must be resolved for advanced tokamak plasmas such as the $25B burning plasma international thermonuclear experimental reactor (ITER) experiment. While a variety of statistical methods have been used to address the problem of tokamak disruption prediction and control, recent approaches based on deep learning have proven particularly compelling. In the present paper, we introduce further improvements to the fusion recurrent neural network (FRNN) software suite, which delivered cross-machine disruption predictions with unprecedented accuracy using a large database of experimental signals from two major tokamaks. Up to now, FRNN was based on the long short-term memory (LSTM) variant of recurrent neural networks to leverage the temporal information in the data. Here, we implement and apply the "temporal convolutional neural network (TCN)" architecture to the time-dependent input signals. Furthermore, this allows highly optimized convolution operations to carry the majority of the computational load of training, thus enabling a reduction in training time, and the effective use of high-performance computing resources for hyperparameter tuning. At the same time, the TCN-based architecture achieves better predictive performance when compared with the LSTM architecture for various tasks for a representative fusion database.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

A representation-independent electronic charge density database for crystalline materials

In addition to being the core quantity in density functional theory, the charge density can be used in many tertiary analyses in materials sciences from bonding to assigning charge to specific atoms. The charge density is data-rich since it contains information about all the electrons in the system. With increasing utilization of machine-learning tools in materials sciences, a data-rich object like the charge density can be utilized in a wide range of applications. The database presented here provides a modern and user-friendly interface for a large and continuously updated collection of charge densities as part of the Materials Project. In addition to the charge density data, we provide the theory and code for changing the representation of the charge density which should enable more advanced machine-learning studies for the broader community.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Application of Lorentzian CFT Principal Series Representation to Near Forward Scattering

We present a discussion on recent progress in high energy diffraction from the perspective of AdS/CFT, through which a unified treatment for both perturbative and non-perturbative Pomeron emerges. By working with Unitary Irreducible Representation of Conformal group, a frame is provided in extending AdS/CFT to both forward and near-forward scattering. We present an analysis involving an exact solution to conformal blocks in Minkowski CFT and discuss possible applications. Phenomenological applications can range from forward scattering to DIS/DVCS/TMD at LHC energies and beyond.

Agarwal, Pulkit↗
DOE OSTI2020

Distributed Wind Representation in Modeling and Simulation Tools: An Assessment of Existing Tools

PNNL evaluated the inclusion of wind in distributed energy resource modeling and simulation tools. Tools were assessed based on a survey of publicly available and readily accessible information. While the authors have made a good faith effort to understand these tools, PNNL does not know the intentions of the developers and acknowledges that some tool capabilities or features may not have been accurately captured in this assessment. This evaluation informs an ongoing effort by PNNL to modernize existing tools both directly by working with developers of some tools and indirectly by providing best practices on how different types of tools could enhance certain modeling features to improve distributed wind’s representation and valuation.

17 WIND ENERGY↗
DOE OSTI2020

Use of Remote Sensing and In-situ Observations to Develop and Evaluate Improved Representations of Convection and Clouds for the Accelerated Climate Model for Energy. Final report

Representation of unresolved cloud processes has been one of the most challenging problems in numerical modeling of the atmosphere. During the last decades, considerable efforts have been spent to better represent the collective effects of those processes in terms of resolved scales (see Arakawa 2004 for a review). Still, the progress on this problem has been unacceptably slow as pointed out by Randall et al. (2003). The large part of the difficulty is inherent in the artificial separation of atmospheric processes into the explicitly simulated resolved scales and the highly parameterized subgrid scales. Arakawa (2004) and Arakawa et al. (2011) suggested two plausible approaches to eliminate the problem of artificial separation of atmospheric processes: “parameterize everything” and “resolve everything”.

58 GEOSCIENCES↗
DOE OSTI2020

Improving Hydropower Representation in Power System Models (Summary of Technical Workshop)

In March 2019, Pacific Northwest National Laboratory (PNNL) and National Renewable Energy Laboratory (NREL) held a workshop to discuss the characterization of hydropower resources within electric power system models. The workshop took place at the Western Electricity Coordinating Council in Salt Lake City, Utah, and was sponsored by the Water Power Technologies Office of the US Department of Energy. The intention of the workshop is to support the federal energy research initiative HydroWIRES. The Initiative has a specific technical objective to advance the representation of hydropower resources in relevant water and power models and to address the seams between the two. This report describes the workshop, contributions from attendees, a summary of the findings of the event and proposed next steps. The themes and recommendations from this workshop have provided foundational guidance for future research and program strategy.

13 HYDRO ENERGY↗
DOE OSTI2021

Improving GCM Representation of Convective Cloud Microphysics by Using ARM Raman Lidar and Cloud Radar Observations

The overall objective of this Department of Energy (DOE) Atmospheric System Research (ASR) funded project is to improve the representation of convective cloud microphysics in global climate models (GCMs) and check it by comparing the model simulations with observations. We have derived the cloud ice water content by synthesizing ARM Raman lidar (RL) and cloud radar observations at the Atmospheric Radiation Measurement (ARM) sites. Noting that the simulated anvil clouds in terms of their macro- and micro-physical properties are sensitive to the parameterization of convective microphysical processes, observed ice water content in anvil clouds provides a useful constraint on these parameterizations. We have improved the convective microphysics parameterization scheme by (1) considering sedimentation for cloud ice crystals that do not fall in the original scheme, (2) applying a new terminal velocity parameterization that depends on the environmental conditions for convective snow, (3) adding a new hydrometeor category, “rimed ice,” to the original four-class (cloud liquid, cloud ice, rain, and snow) scheme, and (4) allowing convective clouds to detrain snow particles into stratiform clouds. We have examined the impact of improved convective cloud microphysics parameterization on the simulated global climate from GCM simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

TEMPI: An Interposed MPI Library with Canonical Representation of MPI Datatypes [Slides]

These points are covered in this presentation: Distributed GPU stencil, non-contiguous data; Equivalence of strided datatypes and minimal representation; GPU communication methods; Deploying on managed systems; Large messages and MPI datatypes; Translation and canonicalization; Automatic model-driven transfer method selection; and Interposed library implementation.

97 MATHEMATICS AND COMPUTING↗