Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Embedding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Diverse Power Iteration Embeddings and Its Applications

Abstract—Spectral Embedding is one of the most effective dimension reduction algorithms in data mining. However, its computation complexity has to be mitigated in order to apply it for real-world large scale data analysis. Many researches have been focusing on developing approximate spectral embeddings which are more efficient, but meanwhile far less effective. This paper proposes Diverse Power Iteration Embeddings (DPIE), which not only retains the similar efficiency of power iteration methods but also produces a series of diverse and more effective embedding vectors. We test this novel method by applying it to various data mining applications (e.g. clustering, anomaly detection and feature selection) and evaluating their performance improvements. The experimental results show our proposed DPIE is more effective than popular spectral approximation methods, and obtains the similar quality of classic spectral embedding derived from eigen-decompositions. Moreover it is extremely fast on big data applications. For example in terms of clustering result, DPIE achieves as good as 95% of classic spectral clustering on the complex datasets but 4000+ times faster in limited memory environment.

97 MATHEMATICS AND COMPUTING↗

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗

DOME: Directional medical embedding vectors from Electronic Health Records

Motivation: The increasing availability of Electronic Health Record (EHR) systems has created enormous potential for translational research. Recent developments in representation learning techniques have led to effective large-scale representations of EHR concepts along with knowledge graphs that empower downstream EHR studies. However, most existing methods require training with patient-level data, limiting their abilities to expand the training with multi-institutional EHR data. On the other hand, scalable approaches that only require summary-level data do not incorporate temporal dependencies between concepts. Methods: We introduce a DirectiOnal Medical Embedding (DOME) algorithm to encode temporally directional relationships between medical concepts, using summary-level EHR data. Specifically, DOME first aggregates patient-level EHR data into an asymmetric co-occurrence matrix. Then it computes two Positive Pointwise Mutual Information (PPMI) matrices to correspondingly encode the pairwise prior and posterior dependencies between medical concepts. Following that, a joint matrix factorization is performed on the two PPMI matrices, which results in three vectors for each concept: a semantic embedding and two directional context embeddings. They collectively provide a comprehensive depiction of the temporal relationship between EHR concepts. Results: We highlight the advantages and translational potential of DOME through three sets of validation studies. First, DOME consistently improves existing direction-agnostic embedding vectors for disease risk prediction in several diseases, for example achieving a relative gain of 5.5% in the area under the receiver operating characteristic (AUROC) for lung cancer. Second, DOME excels in directional drug-disease relationship inference by successfully differentiating between drug side effects and indications, correspondingly achieving relative AUROC gain over the state-of-the-art methods by 10.8% and 6.6%. Finally, DOME effectively constructs directional knowledge graphs, which distinguish disease risk factors from comorbidities, thereby revealing disease progression trajectories. The source codes are provided at https://github.com/celehs/Directional-EHRembedding.

60 APPLIED LIFE SCIENCES↗

Projective embedding of dynamical systems: Uniform mean field equations

Herein we study embeddings of continuous dynamical systems in larger dimensions via projector operators. We call this technique PEDS, projective embedding of dynamical systems, as the stable fixed point of the original system dynamics are recovered via projection from the higher dimensional space. In this paper we provide a general definition and prove that for a particular type of rank-1 projector operator, the uniform mean field projector, the equations of motion become a mean field approximation of the dynamical system. While in general the embedding depends on a specified variable ordering, the same is not true for the uniform mean field projector. We prove a variety of results on the relationship between the spectrum of the Jacobian for fixed points in the original and in the embedded system. Direct applications of PEDS can be non-convex optimization and machine learning.

97 MATHEMATICS AND COMPUTING↗

Accelerating Embedding Potential Optimization by Reconstructing the Pseudo-Valence Electron Density

Density functional embedding theory (DFET) enables use of electronic structure methods with higher accuracy than density functional theory in a local region, with applications thus far ranging from (photo/electro)catalysis to reactions in solution. DFET partitions a large collection of atoms into smaller groups that interact via a shared embedding (interaction) potential V emb , determined via functional optimization. The optimized effective potential (OEP) process used to optimize V emb is time-consuming and becomes a computational bottleneck due to sharp, oscillating features of V emb near nuclei. Here, similar to pseudopotential theory, by reconstructing electron densities used in the OEP process from smoother pseudo-valence-only (PVO) electron densities as proxies for total densities of the full system and subsystems, we can retain accuracy in the embedded electronic structure calculations while potentially reducing the overhead of V emb construction, within the projector augmented-wave (PAW) formalism. We explore three different chemical reactions as exemplars to test PVO–DFET, namely, H 2 dissociative adsorption on a Cu(111) surface, H 2 O adsorption on a Pt(111) surface, and aqueous [Ca 2+ –SO 4 2– ] ion-pair formation. The PVO approximation works well for all three systems with minimal loss of accuracy (∼10–70 meV error relative to the original exact-derivative (ED) approach) while accelerating V emb generation for the Cu and Pt systems respectively by 20× and 5×. Given proper numerical convergence parameters, the spatial distributions of differences between PVO- and ED-based V emb outside the core regions are small, explaining the exceptional agreement between the two approaches. Finally, we anticipate that this more efficient PVO–DFET approximation will be useful whenever computation of V emb is much more expensive than subsequent embedded high-level electron correlation calculations.

approximation↗

Subspace Density Matrix Functional Embedding Theory: Theory, Implementation, and Applications to Molecular Systems

We introduce the subspace density matrix functional embedding theory (sDMFET), in which optimization of the nonlocal embedding potential and subsequent embedded correlated wave function calculations are carried out within a truncated subspace determined by a Schmidt decomposition. As compared to the original density matrix functional embedding theory [K. Yu and E. A. Carter, Proceedings of the National Academy of Sciences 2017, 114, E10861], the computational cost of sDMFET is significantly reduced while the accuracy is preserved. Here, we perform test calculations for both covalently and noncovalently bound molecular systems to demonstrate the feasibility of our theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fully Quantum Embedding with Density Functional Theory for Full Configuration Interaction Quantum Monte Carlo

We here develop a fully quantum embedded version of initiator full configuration interaction quantum Monte Carlo (i–FCIQMC) and apply it to study an ionic bond (lithium hydride, LiH) and a covalent bond (hydrogen flouride, HF) physisorbed to a benzene molecule. The embedding is performed using a recently developed Huzinaga projection operator approach, which affords good synergy with i–FCIQMC by minimizing the number of orbitals in the calculation. When considering the dissociation energy of these bonds into closed-shell ionic fragments, we find that i–FCIQMC embedded in density functional theory (i–FCIQMC-in-DFT) delivers comparable accuracy with coupled cluster singles and doubles with perturbative triples embedded in density functional theory (CCSD(T)-in-DFT). In treating the bond dissociation energy curve of HF, i–FCIQMC-in-DFT has improved accuracy over CCSD(T)-in-DFT due to the presence of strong correlation. Lastly, we discuss the implications of the new i–FCIQMC-in-DFT method as applied to bond breaking in catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Embedding Methods for Quantum Chemistry: Applications from Materials to Life Sciences

Quantum mechanical embedding methods hold the promise to transform not just the way calculations are performed, but to significantly reduce computational costs and improve scaling for macro molecular systems containing hundreds if not thousands of atoms. The field of embedding has grown increasingly broad with many approaches of different intersecting flavors. Here, we lay out the methods into two streams: QM:MM and QM:QM, showcasing the advantages and disadvantages of both. We provide a review of the literature, the underpinning theories including our contributions, and we highlight current applications with select examples spanning both materials and life sciences. Lastly, we conclude with prospects and future outlook on embedding, and our view on the use of universal test case scenarios for cross comparisons of the many available (and future) embedding theories.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Embedding thermocouples in SS316 with laser powder bed fusion

Recent advances in manufacturing technologies have enabled the fabrication of complex geometries for a wide range of applications, including the energy, aerospace, and civil sectors. The ability to integrate sensors at critical locations within these complex components during the manufacturing process could benefit process monitoring and control by reducing reliance on models to relate surface measurements to internal phenomena. This study investigated embedding thermocouples in a SS316 matrix using laser powder bed fusion. Under optimal processing conditions, embedded thermocouples were characterized post-building, finding good bonding to the matrix with no melt pool penetration to the sensing elements. Futher, the embedded thermocouple performed similarly to an identical non-embedded thermocouple during thermal testing to 500 °C with only a slight difference in response time, which was attributed to the differences in mass and the associated thermal time constants.

image analysis↗

Impacts of Control, Penetration, and Distribution of Embedded Storage Network in Bulk Power System

The current shift in generation mix from fossil fuel plants towards variable and intermittent renewable energy sources is poised to create a future grid with reduced physical inertia and mismatch between generation and demand. Embedded storage, which is a concept of a coordinated network of storage units sited at the interface between the transmission and distribution system, is proposed as a mechanism to provide a buffer between generation and demand. This paper proposes an automated framework to model and integrate embedded storage in large-scale power systems with industry-grade grid-following (GFL) and grid-forming (GFM) control technologies. More importantly, the developed framework is used to explore the impacts of embedded storage control, penetration, location, and capacity in providing fast frequency response to the grid under contingency events such as generator trips and faults. The framework and study are conducted using the transient-stability simulation tool PSS/E and a realistic model of the Puerto Rico grid as a chosen test system. The simulation results show that GFL and GFM embedded storage, distributed throughout the system, with sufficient penetration and capacity, can effectively improve primary frequency response of the system under the studied contingency events.

Battery Energy Storage, embedded storage, grid-for↗

Automotive Silicon Carbide Power Module Cooling With A Novel Modular Manifold And Embedded Heat Sink

The next generation of integrated power electronics packages will implement wide-bandgap devices with ultrahigh device heat fluxes. Although jet impingement has received attention for power electronics thermal management, it is not used in commercial electric vehicles (EVs) because of the associated pressure drop and reliability concerns. Here, in this paper, we present a modular thermal management system designed for automotive power electronics. The system achieves superior thermal performance to benchmarked EVs, while adhering to reliability standards and with low pumping power. The system utilizes a low-cost and lightweight plastic manifold to generate jets over an optimized heat sink, which is embedded in the direct-bonded-copper (DBC) substrate. The embedded heat sink concept leverages additive manufacturing to add elliptical pin fins to the DBC substrate. The heat sink geometry is optimized for submerged jet impingement using a unit-cell model and an exhaustive search algorithm. The model predictions are validated using unit-cell experiments. A full-scale power module model is then used to compare the DBC-embedded heat sink against direct DBC cooling and baseplate-integrated heat sinks for single-sided (SS) and double-sided (DS) cooling concepts. Using the SS and DS DBC-embedded cooling concepts, the models predict a thermal resistance that represents a reduction of 75% and 85% compared to the 2015 BMW i3, respectively, for the same water-ethylene glycol inverter flow rate. We have shown that an inverter with a 100-kilo-Watt-per-liter power density is achievable with the proposed design.

33 ADVANCED PROPULSION SYSTEMS↗

Fiber-optic sensor packaging assessment and benchmarking for embedded sensing applications

Fiber optic-based sensing for non-destructive evaluation (NDE) and structural health monitoring of various infrastructure and energy assets is an increasingly important sensing scheme. Because of their immunity to electromagnetic interferences, versatility in sensing mechanisms and designs as well as capability for distributed sensing, the fiber optic sensing is of great interest for embedding within infrastructures using advanced manufacturing methods. However, the protection of fiber optic sensors during advanced manufacturing-based embedding is an important aspect for infrastructure monitoring in practice. While successful installation of fiber optic sensors has been accomplished through application of epoxy or adhesives on infrastructure surfaces, there has been only limited investigation of fiber protection packaging schemes which are compatible with in-situ repair techniques such as the metallic cold-spray. With increasing interest and importance of cold spray-based repair processes, the integration of fiber optic sensors simultaneously during the repair is equally important. In this work, we focus our efforts on investigating various types of packaging schemes for their compatibility and integrability on the surfaces of metallic structures such as oil and gas pipelines during an in-situ repair coating. First, we consider sandblasting using silica sand particles of various size for optical fibers on the surface of a metallic coupon as a useful proxy test of sensor packaging stability. Structural damage of packaging is characterized by means of optical microscopy and the optical integrity of embedded fiber optic cables is examined using optical backscatter reflectometry (OBR). In addition, initial investigation of metallic cold-spray embedded fiber optic cables under various packaging on metallic substrates is also considered with early conclusions and future directions.

Fiber-optic sensors, Sensors packaging, Metallic C↗

ESTEEM: A Novel Framework for Qualitatively Evaluating and Visualizing Spatiotemporal Embeddings in Social Media

Analyzing and visualizing large amounts of social media communications and contrasting short-term conversation changes over time and geo-locations is extremely important for commercial and government applications. Earlier approaches for large-scale text stream summarization used dynamic topic models and trending words. Instead, we rely on text embeddings – low-dimensional word representations in a continuous vector space where similar words are embedded nearby each other. This paper presents ESTEEM,1 a novel tool for visualizing and evaluating spatiotemporal embeddings learned from streaming social media texts. Our tool allows users to monitor and analyze query words and their closest neighbors with an interactive interface. We used state-of- the-art techniques to learn embeddings and developed a visualization to represent dynamically changing relations between words in social media over time and other dimensions. This is the first interactive visualization of streaming text representations learned from social media texts that also allows users to contrast differences across multiple dimensions of the data.

social media dynamics↗

Understanding Event Trajectories Across Massive Temporal Datasets with Word Embeddings and Visualization

In collaboration with researchers from Virginia Tech, Savannah River National Laboratory has continued development of a natural language processing pipeline to identify and extract events of interest from massive open data sources in the domain of worldwide state-sponsored civil nuclear energy. The foundation of the pipeline is built on compass aligned temporal word embedding models, whereby contextual shifts are automatically identified by comparing keyword embedding vectors across successive time windows. Within the approach, a contextual shift indicates the occurrence of a potential event of interest. However, in such a broad topical domain that captures events at a global scale, across various life cycle stages, and across numerous different technology types, a user that is monitoring events may have broad interests in capturing many different event types with varying degrees of signal. As such, the quantity of information that may be returned from an automated event extraction pipeline can be substantial, requiring manual effort to sift through the information to identify any relevant bits of information. Therefore, a more streamlined workflow that aids in directing a user toward specific information at different points in time is necessary. The workflow presented here has been developed with this concept in mind, built on top of the initial prototype event extraction pipeline, whereby a user can analyze temporal text-based data sources at multiple different contextual levels to isolate key points in time and key subdomains captured within a data corpus. Using multiple corpuses that consist of approximately 7 million Tweets and 7 million news articles, the team has extended compass aligned temporal word embedding models to establish an interconnected and hierarchical structure that relates known key words of interest to documents, local topics (i.e., within a time window), and global topics across the corpuses. All of this information is packaged into a visual analytics system that is linked to the information extraction pipeline and enables a user to identify contextual information that describes the evolution of a high dimensional embedding space across time to isolate changes of interest and explore associated events. This report demonstrates the use of these analytics and a means to fuse information across multiple datasets.

97 MATHEMATICS AND COMPUTING↗

Embedding of Optical Fibers with Electric Field Assisted Sintering

The Electric Field Assisted Sintering (EFAS) technique was used for embedding the fibers, involving rapid heating via an electric current and pressure, reducing fiber exposure to high temperatures. Stainless steel guide tubes were inserted at the fiber-matrix junctions to prevent fiber breakage during the sintering process. The study varied key EFAS parameters—temperature (800°C to 980°C), pressure (40-50 MPa), and hold time (5-10 minutes)—to assess how they influenced fiber embedding. After embedding, the fibers were inspected using optical frequency domain reflectometry (OFDR) to evaluate optical losses and strain along the fiber length. The OFDR scans confirmed that the fibers remained intact, and subsequent transmission tests demonstrated no macroscopic fractures. The embedded samples were also analyzed using scanning electron microscopy (SEM) and X-ray computed tomography (CT) scans. These tests confirmed good bonding between the fiber and matrix with no cracking, though some porosity was present in samples fabricated at lower temperatures. At higher temperatures (980°C), the fiber-matrix bonding was continuous and defect-free, with metal coatings aiding in the bonding process. Elemental analysis showed interdiffusion between the fiber coatings and matrix materials, particularly between the gold coating and stainless steel. Helium leak tests revealed that lower sintering temperatures resulted in matrix porosity, causing leaks, but samples fabricated at 980°C were leak-tight.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Embedding Fiber Optic Sensors in Stainless Steel using Spark Plasma Sintering for Structural Health Monitoring in Harsh Environments

Embedded fiber optic sensors such as fiber Bragg gratings (FBGs) offer a unique route for distributed real-time in-situ imaging of various engineering parameters for numerous purposes. This study advanced the current sensor embedding approaches by exploring a spark plasma sintering (SPS)-assisted technology to embed FBGs in high-temperature structural materials and demonstrated the capability of temperature measurement. In this approach, single-mode FBGs were integrated into stainless steel (SS) 316L components using SPS, followed by the evaluation of the bonding quality between the FBGs and matrix, the optical attenuation of the fibers induced by embedding, and the sensing characters of the FBGs under temperature stimuli. The results demonstrated that superior bonding was achieved between the FBGs and highly-densified SS316L. Examination of the behavior of Bragg gratings validated signal fidelity after embedding. Real-time thermal imaging under temperature cycling using the FBGs demonstrated the effectiveness of the technique for smart materials manufacturing.

36 - MATERIALS SCIENCE↗

Multilevel graph embedding

The goal of the present paper is the design of embeddings of a general sparse graph into a set of points in $\mathbb{R}^d$ for appropriate d ≥ 2. The embeddings that we are looking at here aim to keep vertices that are grouped in communities together and keep the rest apart. To achieve this property, we utilize coarsening that respects possible community structures of the given graph. We employ a hierarchical multilevel coarsening approach that identifies communities (strongly connected groups of vertices) at every level. The multilevel strategy allows any given (presumably expensive) graph embedding algorithm to be made into a more scalable (and faster) algorithm. We demonstrate the presented approach on a number of given embedding algorithms and large-scale graphs and achieve speed-up over the methods in a recent paper.

97 MATHEMATICS AND COMPUTING↗

Functional fiber-optic sensors embedded in stainless steel components using ultrasonic additive manufacturing for distributed temperature and strain measurements

The nuclear industry is progressing toward microreactors that can be factory assembled and deployed to remote regions for reliable, scalable power generation. However, the reduced power output requires enhanced monitoring capabilities to reduce staffing and eventually move toward autonomous control to improve the economics of microreactors. The ability to embed sensors such as fiber-optics, which can provide spatially distributed temperature and strain measurements, within microreactor components for real-time health monitoring would be particularly advantageous. Recent advances in ultrasonic additive manufacturing (UAM) have demonstrated the successful embedding of fiber-optics in soft materials such as Al and Cu by placing the sensors in machined cavities and ultrasonically welding over the top with thin foils. This article reports the first successful embedment of fiber-optic sensors and thermocouples within a common nuclear reactor material, SS304, via UAM. UAM parameters were first explored with simple plate geometries before moving to more complex geometries, such as pipes and other test articles for heat pipe–based microreactors. Select samples were sectioned for microscopy to evaluate the sensor/foil and foil/foil interfaces from samples fabricated by using 100% SS304 foils vs. foils plated with a Ni coating to improve UAM bonding. Furthermore, embedding metal-coated, low-bend loss fibers resulted in greatly reduced signal attenuation and adequate compressive residual strain in the embedded region to ensure successful strain coupling. Pipe specimen functional testing was performed by monitoring temperature and strain during transient and steady-state thermal testing.

36 MATERIALS SCIENCE↗