SEARCH · Engineering Papers

Results for “representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Multimodal representation learning for predicting molecule–disease relations

Motivation: Predicting molecule–disease indications and side effects is important for drug development and pharmacovigilance. Comprehensively mining molecule–molecule, molecule–disease and disease–disease semantic dependencies can potentially improve prediction performance. Methods: We introduce a Multi-Modal REpresentation Mapping Approach to Predicting molecular-disease relations (M2REMAP) by incorporating clinical semantics learned from electronic health records (EHR) of 12.6 million patients. Specifically, M2REMAP first learns a multimodal molecule representation that synthesizes chemical property and clinical semantic information by mapping molecule chemicals via a deep neural network onto the clinical semantic embedding space shared by drugs, diseases and other common clinical concepts. To infer molecule–disease relations, M2REMAP combines multimodal molecule representation and disease semantic embedding to jointly infer indications and side effects. Results: We extensively evaluate M2REMAP on molecule indications, side effects and interactions. Results show that incorporating EHR embeddings improves performance significantly, for example, attaining an improvement over the baseline models by 23.6% in PRC-AUC on indications and 23.9% on side effects. Further, M2REMAP overcomes the limitation of existing methods and effectively predicts drugs for novel diseases and emerging pathogens. Availability and implementation: The code is available at https://github.com/celehs/M2REMAP, and prediction results are provided at https://shiny.parse-health.org/drugs-diseases-dev/.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Pairwise connected tensor network representation of path integrals

It has been recently shown how the tensorial nature of real-time path integrals (PIs) involving the Feynman-Vernon influence functional can be utilized with matrix product states, taking advantage of the finite length of the bath-induced memory. Tensor networks (TNs) promise to provide a unified language to express the structure of a PI. A generalized TN specifically incorporating the pairwise interaction structure of the influence functional and its invariance with respect to the average forward-backward position or the sojourn value in the form of the blip representation is derived and implemented. This pairwise connected TNPI (PC-TNPI) is illustrated through applications to typical spin-boson problems and explorations of the differences caused by the exact form of the spectral density. The storage and performance scalings are reported, showing the compactness of the representation and the efficiency of the contraction process. Finally, taking advantage of the compressed representation, the viability of using PC-TNPI for simulating multistate problems is demonstrated. The PC-TNPI structure can be shown to yield other TN algorithms currently in use. Consequently, it should be possible to use it as a starting point for deriving other optimized procedures.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Compressive Neural Representations of Volumetric Scalar Fields

Here, we present an approach for compressing volumetric scalar fields using implicit neural representations. Our approach represents a scalar field as a learned function, wherein a neural network maps a point in the domain to an output scalar value. By setting the number of weights of the neural network to be smaller than the input size, we achieve compressed representations of scalar fields, thus framing compression as a type of function approximation. Combined with carefully quantizing network weights, we show that this approach yields highly compact representations that outperform state-of-the-art volume compression approaches. The conceptual simplicity of our approach enables a number of benefits, such as support for time-varying scalar fields, optimizing to preserve spatial gradients, and random-access field evaluation. We study the impact of network design choices on compression performance, highlighting how simple network architectures are effective for a broad range of volumes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Session Introduction: Graph Representations and Algorithms in Biomedicine

Connectivity is a fundamental property of biological systems: on the cellular level, proteins interact with each other to form protein-protein interaction networks (PPIs); on the organism level, neurons are arranged in a network; and on a community-level, species can have complex relationships with one another that drive the development and balance of an ecosystem. Graphs, representations of systems consisting of entities as vertices and their connections as edges, are a useful structure to characterize many such systems. Such models can be used to understand biological systems that naturally have a network structure, including PPIs, biological neurons, and ecosystems. In today’s information age, graph representations and algorithms (often in combination with machine learning techniques) are used to organize massive amounts of related data, much of which may be heterogeneous or unstructured, and identify patterns that represent novel biological insights. PSB’s 2023 session “Graph Representations and algorithms in Biomedicine,” encompasses modern developments in graph theory and its applications to various fields of biomedicine. This session includes a wide range of research - knowledge graphs built from text-mined health data, heterogeneous networks using multi-omic databases, and graphs refined to represent uncertainty or improve memory usage.

Chrisman, Brianna S.↗

DOE OSTI2021

Effects of raster terrain representation on GIS shortest path analysis

Spatial analysis extracts meaning and insights from spatially referenced data, where the results are highly dependent on the quality of the data used and the manipulations on the data when preparing it for analysis. Users should understand the impacts that data representations may have on their results in order to prevent distortions in their outcomes. We study the consequences of two common data preparations when locating a linear feature performing shortest path analysis on raster terrain data: 1) the connectivity of the network generated by connecting raster cells to their neighbors, and 2) the range of the attribute scale for assigning costs. Such analysis is commonly used to locate transmission lines, where the results could have major implications on project cost and its environmental impact. Experiments in solving biobjective shortest paths show that results are highly dependent on the parameters of the data representations, with exceedingly variable results based on the choices made in reclassifying attributes and generating networks from the raster. Based on these outcomes, we outline recommendations for ensuring geographic information system (GIS) data representations maintain analysis results that are accurate and unbiased.

Medrano, F. Antonio (ORCID:000000025913632X)↗

DOE OSTI2023

Understanding the Inner-Workings of Language Models Through Representation Dissimilarity

We use model stitching to understand the internal representations of language models. Similar to vision models, we find that "more is better," and representations learned with more data and larger width can improve the performance of weaker models via stitching. We likewise find that certain architecture choices, using GeLU vs SoLU activation functions, influence the quality of learned representations. Finally, model stitching (as opposed to other model diagnostic methods, like mode connectivity) can localize the different generalization strategies of text classifiers under domain shift to certain hidden layers.

Brown, Davis R.↗

DOE OSTI2020

Joint Analysis of Program Data Representations using Machine Learning for Improved Software Assurance and Development Capabilities

We explore the use of multiple deep learning models for detecting flaws in software programs. Current, standard approaches for flaw detection rely on a single representation of a software program (e.g., source code or a program binary). We illustrate that, by using techniques from multimodal deep learning, we can simultaneously leverage multiple representations of software programs to improve flaw detection over single representation analyses. Specifically, we adapt three deep learning models from the multimodal learning literature for use in flaw detection and demonstrate how these models outperform traditional deep learning models. We present results on detecting software flaws using the Juliet Test Suite and Linux Kernel.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Learned implicit representations of aerosol chemistry and physics for enhancing the predictability of water cycle extreme events

Focal Area(s): Focal area 2: Predictive modeling through the use of AI-derived model components; and Focal area 3: physics-guided AI. Science Challenge: Comprehensive models of many geophysical processes require a large number of state variables, disqualifying them for inclusion in Earth System Models (ESMs) for the foreseeable future. This white paper proposes the paradigm shift from the use of state variables representing explicit physical quantities to the use of machine-learning to create and integrate a compact, implicit representation of a physical system with a smaller number of state variables. As an initial application, we propose to create parsimonious machine-learned surrogate models of gas- and aerosol-phase chemistry and physics with the purpose of improving the accuracy of the representation of cloud formation and cloud-aerosol interaction in the E3SM model. This type of improved representation of cloud microphysics is critical for enhancing the predictability of water cycle extremes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Understanding and improving model representation of aerosol optical properties for a Chinese haze event measured during KORUS-AQ

KORUS-AQ was an international cooperative air quality field study in South Korea that measured local and remote sources of air pollution affecting the Korean Peninsula during May–June 2016. Some of the largest aerosol mass concentrations were measured during a Chinese haze transport event (24 May). Air quality forecasts using the WRF-Chem model with aerosol optical depth (AOD) data assimilation captured AOD during this pollution episode but overpredicted surface particulate matter concentrations in South Korea, especially PM 2.5 , often by a factor of 2 or larger. Analysis revealed multiple sources of model deficiency related to the calculation of optical properties from aerosol mass that explain these discrepancies. Using in situ observations of aerosol size and composition as inputs to the optical properties calculations showed that using a low-resolution size bin representation (four bins) underestimates the efficiency with which aerosols scatter and absorb light (mass extinction efficiency). Besides using finer-resolution size bins (8–16 bins), it was also necessary to increase the refractive indices and hygroscopicity of select aerosol species within the range of values reported in the literature to achieve better consistency with measured values of the mass extinction efficiency (6.7 m 2 g –1 observed average) and light-scattering enhancement factor (ƒ(RH)) due to aerosol hygroscopic growth (2.2 observed average). Furthermore, an evaluation of the optical properties obtained using modeled aerosol properties revealed the inability of sectional and modal aerosol representations in WRF-Chem to properly reproduce the observed size distribution, with the models displaying a much wider accumulation mode. Other model deficiencies included an underestimate of organic aerosol density (1.0 g cm –3 in the model vs. observed average of 1.5 g cm –3 ) and an overprediction of the fractional contribution of submicron inorganic aerosols other than sulfate, ammonium, nitrate, chloride, and sodium corresponding to mostly dust (17 %–28 % modeled vs. 12 % estimated from observations). These results illustrate the complexity of achieving an accurate model representation of optical properties and provide potential solutions that are relevant to multiple disciplines and applications such as air quality forecasts, health impact assessments, climate projections, solar power forecasts, and aerosol data assimilation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Breakups are complicated: an efficient representation of collisional breakup in the superdroplet method

Abstract. A key constraint of particle-based methods for modeling cloud microphysics is the conservation of total particle number, which is required for computational tractability. The process of collisional breakup poses a particular challenge to this framework, as breakup events often produce many droplet fragments of varying sizes, which would require creating new particles in the system. This work introduces a representation of collisional breakup in the so-called “superdroplet” method which conserves the total number of superdroplets in the system. This representation extends an existing stochastic collisional-coalescence scheme and samples from a fragment size distribution in an additional Monte Carlo step. This method is demonstrated in a set of idealized box model and single-column warm-rain simulations. We further discuss the effects of the breakup dynamic and fragment size distribution on the particle size distribution, hydrometeor population, and microphysical process rates. Box model experiments serve to characterize the impacts of properties such as coalescence efficiency and fragmentation function on the relative roles of collisional breakup and coalescence. The results demonstrate that this representation of collisional breakup can produce a stationary particle size distribution, in which breakup and coalescence rates are approximately equal, and that it recovers expected behavior such as a reduction in precipitate-sized particles in the column model. The breakup algorithm presented here contributes to an open-source pythonic implementation of the superdroplet method, PySDM, which will facilitate future research using particle-based microphysics.

de Jong, Emily (ORCID:0000000253104554)↗

DOE OSTI2025

Assessing the climate impact of an improved volcanic sulfate aerosol representation in E3SM

Accurately simulating historical surface temperature variations is essential for evaluating climate models, yet many struggle to reproduce the mid-20th-century temperature trends associated with significant volcanic eruptions. This study examines the impact of volcanic sulfate aerosol representation on these biases using the Energy Exascale Earth System Model (E3SM). The standard CMIP6 protocol prescribes volcanic forcing through radiative perturbations, omitting volcanic aerosol–cloud interactions (VACIs). Here, we implement an emission-based approach with an updated volcanic eruption inventory that directly incorporates volcanic sulfur dioxide (SO 2 ) emissions, enabling a more process-based representation of volcanic forcing. This approach leads to improved surface temperature variability and a modest reduction in cold biases between 1940 and 1980 compared to the CMIP6 setup. Additionally, we assess cloud property responses to a more realistic volcanic sulfate aerosol representation, which weakens cloud-induced cooling during periods of lower volcanic activity. However, despite these refinements, a significant temperature cold bias remains, indicating that further improvements in atmospheric chemistry, aerosol microphysics, cloud processes, and model parameterizations are needed to fully resolve this issue in E3SM.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1972

Geopotential representation with sampling functions.

Satellite-to-ocean altitudes measured to meter accuracy eventually can yield a geoid representation with significant short-wavelength structure over ocean areas. To cope conveniently with this expected detail, one suggested analytical technique would represent the geopotential or the geoid as an expansion in sampling functions that are linear combinations of spherical harmonics. Each of the sampling functions makes its principal contribution to the geopotential in a single geographical region. For a representation truncated after degree N, there are (N + 1) squared such functions associated with a like number of points distributed nearly regularly on the globe. The features of this geopotential representation can be illustrated by considering the case N = 22, for which an expansion in sampling functions can be produced that is equivalent to the geopotential of the 1969 Smithsonian standard earth.

Lundquist, C. A.↗

NASA NTRS1974

A representation of Jacchia's thermospheric models in spherical harmonic functions

The Jacchia models are represented in terms of spherical harmonic functions. This representation has the advantage of ease of comparison with other global theoretical and empirical models that use this mathematical form. Furthermore, it is analytic, continuous, and has continuous derivatives all over the globe. The representation of the exospheric temperatures shows clearly the amplitudes of the various periodic terms and uses relatively few constants. An example of a similar representation for the total mass density at a particular height and level of solar activity is given as well.

Blum, P.↗

NASA NTRS1975

Use of the Wigner representation in scattering problems

The basic equations of quantum scattering were translated into the Wigner representation, putting quantum mechanics in the form of a stochastic process in phase space, with real valued probability distributions and source functions. The interpretative picture associated with this representation is developed and stressed and results used in applications published elsewhere are derived. The form of the integral equation for scattering as well as its multiple scattering expansion in this representation are derived. Quantum corrections to classical propagators are briefly discussed. The basic approximation used in the Monte-Carlo method is derived in a fashion which allows for future refinement and which includes bound state production. Finally, as a simple illustration of some of the formalism, scattering is treated by a bound two body problem. Simple expressions for single and double scattering contributions to total and differential cross-sections as well as for all necessary shadow corrections are obtained.

Bemler, E. A.↗

NASA NTRS1974

Integral representation of field variables for the finite element solution of viscous flow problems

The kinematics aspects of compressible and incompressible viscous flow problems are recasted into an integral representation for the velocity vector. For the incompressible flow problem, the kinetics aspect is similarly recasted into an integral representation. The result is a system of integral equations ideally suited for the finite element method. The integral representations are shown to permit the confinement of the computation field to the region of nonnegligible vorticity and dilatation which, for the incompressible flow, is identified with the viscous region. This drastic reduction in computation field results in a superior solution speed which is further improved by the use of a flowfield segmentation technique. The new approach is further shown to remove the difficulties associated with previous methods in specifying the far field and extraneous boundary conditions.

Wu, J. C.↗

NASA NTRS1980

Quantitative representation of nonrepetitive temporal behavior

Analytical representations suitable to analyze the nonrepetitive pulse-like temporal behavior of physical quantities are derived. The representation utilizes solutions of a linear model equation in which the temporal variation is subject to time-dependent driving and dissipative forces. The property of solutions is described, and it is shown that such representations can provide a basis for quantitative comparisons of behaviors and a basis for physically meaningful interpretations of the results. Observations of solar flares in the soft X-ray flux have been analyzed with this method.

Nakagawa, Y.↗

NASA NTRS1988

Hologram representation of design data in an expert system knowledge base

A novel representational scheme for design object descriptions is presented. An abstract notion of modules and signals is developed as a conceptual foundation for the scheme. This abstraction relates the objects to the meaning of system descriptions. Anchored on this abstraction, a representational model which incorporates dynamic semantics for these objects is presented. This representational model is called a hologram scheme since it represents dual level information, namely, structural and semantic. The benefits of this scheme are presented.

Shiva, S. G.↗

NASA NTRS1988

Representation and matching of knowledge to design digital systems

A knowledge-based expert system is described that provides an approach to solve a problem requiring an expert with considerable domain expertise and facts about available digital hardware building blocks. To design digital hardware systems from their high level VHDL (Very High Speed Integrated Circuit Hardware Description Language) representation to their finished form, a special data representation is required. This data representation as well as the functioning of the overall system is described.

Jones, J. U.↗