Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Efficient and interpretable graph network representation for angle-dependent properties applied to optical spectroscopy

Abstract Graph neural networks are attractive for learning properties of atomic structures thanks to their intuitive graph encoding of atoms and bonds. However, conventional encoding does not include angular information, which is critical for describing atomic arrangements in disordered systems. In this work, we extend the recently proposed ALIGNN (Atomistic Line Graph Neural Network) encoding, which incorporates bond angles, to also include dihedral angles (ALIGNN-d). This simple extension leads to a memory-efficient graph representation that captures the complete geometry of atomic structures. ALIGNN-d is applied to predict the infrared optical response of dynamically disordered Cu(II) aqua complexes, leveraging the intrinsic interpretability to elucidate the relative contributions of individual structural components. Bond and dihedral angles are found to be critical contributors to the fine structure of the absorption response, with distortions that represent transitions between more common geometries exhibiting the strongest absorption intensity. Future directions for further development of ALIGNN-d are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Rapid design of top-performing metal-organic frameworks with qualitative representations of building blocks

Abstract Data-driven materials design often encounters challenges where systems possess qualitative (categorical) information. Specifically, representing Metal-organic frameworks (MOFs) through different building blocks poses a challenge for designers to incorporate qualitative information into design optimization, and leads to a combinatorial challenge, with large number of MOFs that could be explored. In this work, we integrated Latent Variable Gaussian Process (LVGP) and Multi-Objective Batch-Bayesian Optimization (MOBBO) to identify top-performing MOFs adaptively, autonomously, and efficiently. We showcased that our method (i) requires no specific physical descriptors and only uses building blocks that construct the MOFs for global optimization through qualitative representations, (ii) is application and property independent, and (iii) provides an interpretable model of building blocks with physical justification. By searching only ~1% of the design space, LVGP-MOBBO identified all MOFs on the Pareto front and 97% of the 50 top-performing designs for the CO 2 working capacity and CO 2 /N 2 selectivity properties.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Physics and chemistry from parsimonious representations: image analysis via invariant variational autoencoders

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine learning methods for discovery of physical and chemical phenomena from the data, such as manifestations of symmetry breaking phenomena in electron and scanning tunneling microscopy images, or variability of the nanoparticles. Variational autoencoders (VAEs) are emerging as a powerful paradigm for the unsupervised data analysis, allowing to disentangle the factors of variability and discover optimal parsimonious representation. Here, we summarize recent developments in VAEs, covering the basic principles and intuition behind the VAEs. The invariant VAEs are introduced as an approach to accommodate scale and translation invariances present in imaging data and separate known factors of variations from the ones to be discovered. We further describe the opportunities enabled by the control over VAE architecture, including conditional, semi-supervised, and joint VAEs. Several case studies of VAE applications for toy models and experimental datasets in Scanning Transmission Electron Microscopy are discussed, emphasizing the deep connection between VAE and basic physical principles. Python codes and datasets discussed in this article are available at https://github.com/saimani5/VAE-tutorials and can be used by researchers as an application guide when applying these to their own datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A representation-independent electronic charge density database for crystalline materials

Abstract In addition to being the core quantity in density-functional theory, the charge density can be used in many tertiary analyses in materials sciences from bonding to assigning charge to specific atoms. The charge density is data-rich since it contains information about all the electrons in the system. With the increasing prevalence of machine-learning tools in materials sciences, a data-rich object like the charge density can be utilized in a wide range of applications. The database presented here provides a modern and user-friendly interface for a large and continuously updated collection of charge densities as part of the Materials Project. In addition to the charge density data, we provide the theory and code for changing the representation of the charge density which should enable more advanced machine-learning studies for the broader community.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Subnetwork representation learning for discovering network biomarkers in predicting lymph node metastasis in early oral cancer

Cervical lymph node metastasis is the leading cause of poor prognosis in oral tongue squamous cell carcinoma and also occurs in the early stages. The current clinical diagnosis depends on a physical examination that is not enough to determine whether micrometastasis remains. The transcriptome profiling technique has shown great potential for predicting micrometastasis by capturing the dynamic activation state of genes. However, there are several technical challenges in using transcriptome data to model patient conditions: (1) An Insufficient number of samples compared to the number of genes, (2) Complex dependence between genes that govern the cancer phenotype, and (3) Heterogeneity between patients between cohorts that differ geographically and racially. We developed a computational framework to learn the subnetwork representation of the transcriptome to discover network biomarkers and determine the potential of metastasis in early oral tongue squamous cell carcinoma. Our method achieved high accuracy in predicting the potential of metastasis in two geographically and racially different groups of patients. The robustness of the model and the reproducibility of the discovered network biomarkers show great potential as a tool to diagnose lymph node metastasis in early oral cancer.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Winter precipitation predictability in Central Southwest Asia and its representation in seasonal forecast systems

In Central Southwest Asia (CSWA; 22°N to 40°N and 30°E to 70°E), winter (November to February) precipitation contributes up to 70% of the annual mean, but substantial interannual variations exist. Dynamical models exhibit subpar predictability in this region, but the limits of their skills are not well established. Here, we identify the tropical and extratropical forcings that explain ~75% of area-averaged seasonal variability in CSWA winter precipitation. Tropical forcing comes from the indirect El Niño-Southern Oscillation (ENSO) pathway, the leading mode of tropical Indian Ocean precipitation variability. This mode is coupled with ENSO-related Pacific Ocean sea surface temperature variability. A direct ENSO influence on CSWA does not extend beyond its Indian Ocean connection. Extratropical forcing comes from a large-scale mode of internal atmospheric variability. The spatial structure, variability of tropical forcing, and teleconnection with CSWA winter precipitation are skillfully depicted in two seasonal forecasting systems: the fifth-generation seasonal forecasting system (SEAS5) and Seamless System for Prediction and Earth System Research (SPEAR). Extratropical forcing’s spatial structure is also produced skillfully in the two modelling systems; however, the representation of its interannual variability and teleconnection requires improvement. While SEAS5 displays skill in representing extratropical forcing influence on CSWA winter precipitation and marginal skill in reproducing interannual variability, SPEAR has negligible ability in both areas. Consequently, these models have limited predictive skills over CSWA in winter. While improvements in representing extratropical forcing may be inherently limited as it arises from internal atmospheric variability, further research is needed to establish its predictability limits fully.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Physical inconsistencies in the representation of the ocean heat-carbon nexus in simple climate models

The Ocean Heat-Carbon Nexus, linking ocean heat and carbon uptake, is crucial for understanding climate responses to cumulative carbon dioxide (CO 2 ) emissions and to net zero CO 2 emissions. It results from a suite of processes involving the exchange of heat and carbon across the sea-air interface as well as their storage below the mixed layer and redistribution by the ocean large-scale circulation. The Ocean Heat and Carbon Nexus is assumed to be consistently represented across two modelling platforms used in the latest IPCC assessments: the Earth System Models (ESMs) and the Simple Climate Models (SCMs). However, our research shows significant deficiencies in state-of-the-art SCMs in replicating the ocean heat-carbon nexus of ESMs due to a crude treatment of the ocean thermal and carbon cycle coupling. With one SCM, we show that a more realistic heat-to-carbon uptake ratio exacerbates the projected warming by 0.1 °C in low overshoot scenarios and up to 0.2 °C in high overshoot scenarios. It is therefore critical to explore how SCMs’ physical inconsistencies, such as the representation of the ocean heat-carbon nexus, can affect future warming projections used in climate assessments, not just by SCMs in Working Group 3 but also by ESMs in Working Group 1 via SCM-driven emission-to-concentration translation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A discretized representation for Monte Carlo simulation of deformed semiflexible chains

In this study, we present a novel orientation discretization approach based on the rhombic triacontahedron for Monte Carlo simulations of semiflexible polymer chains, aiming at enhancing structural analysis through rheo-small-angle scattering (rheo-SAS). Our approach provides a more accurate representation of the geometric features of semiflexible chains under deformation, surpassing the capabilities of traditional lattice structures. Validation against the Kratky–Porod chain system demonstrated superior consistency, underscoring its potential to significantly improve the precision of uncovering geometric details from rheo-SAS data. Further, this approach opens new avenues for investigating the conformations of semiflexible polymers and mechanically induced phase transitions in more complex polymer structures, offering deeper insights into their behavior under various conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Unsupervised discovery of extreme weather events using universal representations of emergent organization

Spontaneous self-organization is ubiquitous in systems far from thermodynamic equilibrium. While organized structures that emerge dominate transport properties, universal representations that identify and describe these key objects remain elusive. Here, we introduce a theoretically grounded framework for describing emergent organization that, via data-driven algorithms, is constructive in practice. Its building blocks are spacetime lightcones that embody how information propagates across a system through local interactions. We show that predictive equivalence classes of lightcones—local causal states—capture organized behaviors in complex spatiotemporal systems. Employing an unsupervised physics-informed machine learning algorithm and a high-performance computing implementation, we demonstrate automatically discovering organized structures in two real-world domain science problems. We show that local causal states identify vortices and track their power-law decay behavior in two-dimensional fluid turbulence. We then show how to detect and track familiar extreme weather events—hurricanes and atmospheric rivers—and discover other novel structures associated with precipitation extremes in high-resolution climate data at the grid-cell level.

Rupe, Adam [Pacific Northwest National Laboratory ↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Modelling and assessing the near-wake representation and turbulence behaviour of control-oriented wake models

Due to the interaction between the wake of an upstream turbine on a downstream turbine, power losses and increased fatigue loads occur. By yawing the upstream turbine with regard to the wind direction, one can potentially reduce the power losses of the downstream turbine and reduce the fatigue loads. The evolution of the wake depends on the pressure gradient within the near-wake region and the turbulent kinetic energy and must be incorporated in existing wake steering algorithms to provide an accurate estimation of the wake flow. This paper will show a first approach to implement a near-wake model and a turbulence model in the curled wake model within the controls-oriented framework FLORIS. The near-wake model is based on an analytical expression of the velocity profile to model the pressure gradient. Furthermore, two turbulence models are incorporated within the curled wake model based on a Gaussian-distribution and a mixing length formulation. The adapted curled wake model is then assessed with the measurement data acquired in the wind tunnel at ForWind – University of Oldenburg. The evaluation of the models show good agreement for the velocity deficit and representation of the near-wake region. Furthermore, the turbulent kinetic energy behaved as expected in comparison to other work, showing a ring of high turbulent kinetic energy at non-yawed condition which is deflected to a curled shape at large yaw angles with the turbulence model based on a mixing length formulation.

FLORIS↗
DOE OSTI2020

Seasonal representation of extreme precipitation indices over the United States in CMIP6 present-day simulations

Realistically representing the present-day characteristics of extreme precipitation has been a challenge for global climate models, which is due in part to deficiencies in model resolution and physics, but is also due to a lack of consistency in gridded observations. In this study, we use three observation datasets, including gridded rain gauge and satellite data, to assess historical simulations from sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models. We separately evaluate summer and winter precipitation over the United States (US) with a comprehensive set of extreme precipitation indices, including an assessment of precipitation frequency, intensity and spatial structure. The observations exhibit significant differences in their estimates of area-average intensity distributions and spatial patterns of the mean and extremes of precipitation over the US. In general, the CMIP6 multi-model mean performs better than most individual models at capturing daily precipitation distributions and extreme precipitation indices, particularly in comparison to gauge-based data. Also, the representation of the extreme precipitation indices by the CMIP6 models is better in the summer than winter. Although the ‘standard’ horizontal-resolution can vary significantly across CMIP6 models, from ~0.7° to ~2.8°, we find that resolution is not a good indicator of model performance. Overall, our results highlight common biases in CMIP6 models and demonstrate that no single model is consistently the most reliable across all indices.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Deep graph representations embed network information for robust disease marker identification

We report that the accurate disease diagnosis and prognosis based on omics data rely on the effective identification of robust prognostic and diagnostic markers that reflect the states of the biological processes underlying the disease pathogenesis and progression. In this article, we present GCNCC, a Graph Convolutional Network-based approach for Clustering and Classification, that can identify highly effective and robust network-based disease markers. Based on a geometric deep learning framework, GCNCC learns deep network representations by integrating gene expression data with protein interaction data to identify highly reproducible markers with consistently accurate prediction performance across independent datasets possibly from different platforms. GCNCC identifies these markers by clustering the nodes in the protein interaction network based on latent similarity measures learned by the deep architecture of a graph convolutional network, followed by a supervised feature selection procedure that extracts clusters that are highly predictive of the disease state. By benchmarking GCNCC based on independent datasets from different diseases (psychiatric disorder and cancer) and different platforms (microarray and RNA-seq), we show that GCNCC outperforms other state-of-the-art methods in terms of accuracy and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Unified Medical Language System resources improve sieve-based generation and Bidirectional Encoder Representations from Transformers (BERT)–based ranking for concept normalization

Concept normalization, the task of linking phrases in text to concepts in an ontology, is useful for many downstream tasks including relation extraction, information retrieval, etc. We present a generate-and-rank concept normalization system based on our participation in the 2019 National NLP Clinical Challenges Shared Task Track 3 Concept Normalization. The shared task provided 13 609 concept mentions drawn from 100 discharge summaries. We first design a sieve-based system that uses Lucene indices over the training data, Unified Medical Language System (UMLS) preferred terms, and UMLS synonyms to generate a list of possible concepts for each mention. We then design a listwise classifier based on the BERT (Bidirectional Encoder Representations from Transformers) neural network to rank the candidate concepts, integrating UMLS semantic types through a regularizer. Our generate-and-rank system was third of 33 in the competition, outperforming the candidate generator alone (81.66% vs 79.44%) and the previous state of the art (76.35%). During postevaluation, the model’s accuracy was increased to 83.56% via improvements to how training data are generated from UMLS and incorporation of our UMLS semantic type regularizer. Analysis of the model shows that prioritizing UMLS preferred terms yields better performance, that the UMLS semantic type regularizer results in qualitatively better concept predictions, and that the model performs well even on concepts not seen during training. Our generate-and-rank framework for UMLS concept normalization integrates key UMLS features like preferred terms and semantic types with a neural network–based ranking model to accurately link phrases in text to UMLS concepts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2026

Correlated purification for restoring 𝑁-representability in quantum simulation

Experimentally measured reduced density matrices (RDMs) often violate constraints that ensure they represent N-electron states—known as N-representability conditions—because of statistical and hardware noise. In this work, we present a correlated purification framework based on semidefinite programming to restore the accuracy of a noisy, unphysical two-electron RDM (2-RDM). The method performs a bi-objective optimization that minimizes both the many-electron energy and the nuclear norm of the correction to the measured 2-RDM. The nuclear norm, often employed in matrix completion, promotes low-rank corrections, while the energy term acts as a regularization term that can improve the purity of the ground state. While the method is particularly effective for ground states, it can also be applied to excited and nonstationary states by decreasing the weight of the energy relative to the error norm. In an application to fermionic shadow tomography of large hydrogen chains, correlated purification yields substantial reductions in both energy and 2-RDM error, achieving chemical accuracy across dissociation curves. This framework provides a robust strategy for tomography in many-body quantum simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Relativistic Exact Two-Component Theory in the Generalized Pseudospectral Representation

We present a formulation and implementation of exact two-component (X2C) relativistic theory in the generalized pseudospectral representation. When combined with the Hartree-Fock-Slater framework, this approach enables efficient and accurate treatments of scalar-relativistic and spin-orbit effects in atomic electronic structures without the computational overhead of four-component methods. Benchmark calculations across light and heavy elements demonstrate that the our X2C scheme yields substantially more accurate relativistic corrections to core-electron binding energies than perturbational Breit-Pauli treatments while converging more rapidly with respect to basis size. The method provides an improved computational framework for modeling ultrafast x-ray-induced processes in heavy-element systems.

Wang, Xubo↗
DOE OSTI2025

All-electron molecular tunnel ionization based on the weak-field asymptotic theory in the integral representation

Tunnel ionization (TI) underlies many important ultrafast processes, such as high-harmonic generation andstrong-field ionization. Among the existing theories for TI, many-electron weak-field asymptotic theory (ME-WFAT) is by design capable of accurately treating many-electron effects in TI. An earlier version of ME-WFATrelied on an accurate representation of the asymptotic tail of the orbitals, which hindered its implementation inGaussian-basis-set-based quantum chemistry programs. In this work, we reformulate ME-WFAT in the integralrepresentation, which makes the quality of the asymptotic tail much less critical, hence greatly facilitating itsimplementation in standard quantum chemistry packages. The integral reformulation introduced here is thereforemuch more robust when applied to molecules with arbitrary geometry. Here, we present several case studies, amongwhich is the CO molecule where some earlier theories disagree with experiments. Here we find that ME-WFATproduces the largest ionization probability when the field points from C to O, as experiments suggest. Anattractive feature of ME-WFAT is that it can be used with various types of multielectron methods whether ofdensity functional or multiconfiguration types, this inturn facilitates tunnel ionization calculation in systems exhibiting a strong multireference character.

74 ATOMIC AND MOLECULAR PHYSICS↗