SEARCH · Engineering Papers

Results for “embedded systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Influence of Agricultural Managed Aquifer Recharge (AgMAR) and Stratigraphic Heterogeneities on Nitrate Reduction in the Deep Subsurface

This data package contains input files for TOUGHREACT for a modeling study examining the effects of managed aquifer recharge on agricultural lands on nitrate cycling and transport in the Central Valley of CA near Modesto. The files contain all the geochemical species, reactions, and hydrological parameters for the model. The files are text files used for the TOUGH family of code created by LBNL. To use the files a license is required. https://tough.lbl.gov/licensing-download/toughreact-licensing-download/Accompanying Paper Abstract: Agricultural managed aquifer recharge (AgMAR) is a proposed management strategy whereby surface water flows are used to intentionally flood croplands with the purpose of recharging underlying aquifers. However, legacy nitrate (NO3-) contamination in agriculturally-intensive regions poses a threat to groundwater resources under AgMAR. To address these concerns, we use a reactive transport modeling framework to better understand the effects of AgMAR management strategies (i.e., by varying the frequency, duration between flooding events, and amount of water) on N leaching to groundwater under different stratigraphic configurations and antecedent moisture conditions. In particular, we examine the potential of denitrification and nitrogen retention in deep vadose zone sediments (~15 m) using variable AgMAR application rates on two-dimensional representations of differently textured soils, soils with discontinuous bands/channels, and soils with preferential flow paths characteristic of typical agricultural field sites. Our results indicate that finer textured sediments, such as silt loams, alone or embedded within high flow regions, are important reducing zones providing conditions needed for denitrification. Simulation results further suggest that applying water all-at-once rather than in increments for a fixed volume of recharge transports higher concentrations of NO3- deeper into the profile, which has the potential to exacerbate groundwater quality. This transport into deeper depths can be aggravated by wetter antecedent soil moisture conditions. However, applying water all-at-once also increases denitrification within the vadose zone by promoting anoxic conditions. We conclude that AgMAR management strategies can be designed to enhance denitrification in the subsurface and reduce N leaching to groundwater, while specifically accounting for lithologic heterogeneity, antecedent soil moisture conditions, and depth to the water table. Our findings are potentially relevant to other systems that experience flooding inundation such as riparian corridors, floodplains, wetlands, and other managed landscapes like dedicated recharge basins.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Bringing OpenCL to Commodity RISC-V CPUs

The importance of open-source hardware has been increasing in recent years with the introduction of the RISC-V Open ISA. This has also accelerated the push for support of the open-source software stack from compiler tools to full-blown operating systems. Parallel computing with today’s Application Programming Interfaces such as OpenCL has proven to be effective at leveraging the parallelism in commodity multi-core processors and programmable parallel accelerators. However, to the best of our knowledge, there is currently no publicly available implementation of OpenCL targeting commodity RISC-V processors that is accessible to the open-source community. Besides opening RISC-V to the existing rich variety of scientific parallel applications, OpenCL also provides access to a unique genre of benchmarks useful in computer architecture research. In this work, we extended an Open-source implementation of OpenCL to target RISC-V CPUs. Our work not only cover commodity multi-core RISC-V processors, but also plethora of low- profile embedded RISC-V CPUs that often do not support atomic instructions or multi-threading.

Tine, Blaise↗

DOE OSTI2024

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗

DOE OSTI2025

A Novel Framework for Performance Evaluation and Design Optimization of PCM Embedded Heat Exchangers for the Built Environment

This research sheds light on the performance evaluation and design optimization of PCM-HXs for the built environment, addressing several barriers to practical issues to PCM-HX commercialization such as modeling aspects (i.e., modeling expertise and computational / time investment, etc.), manufacturing aspects (i.e., at-scale manufacturing, cost assessments, etc.) and experimental performance assessment (i.e., reliable experimental data, assessment of multiple PCM-working fluid combinations, etc.). We present a novel, comprehensive, and experimentally-validated design optimization framework for PCM-HXs capable of simulating any PCM-HX geometry with reasonable accuracy and significant computational time savings when compared to traditional CFD-based design practices. The framework was validated for a wide range of PCM-HX configurations, including a design optimization for a domestic hot water heater application where TES partially replaces electrical heating input. The resulting PCM-HXs were found to deliver 34-68% of the total daily hot water supply with only 5-10% package volume increase from the water heater, thus within U.S. DOE targets for TES systems. To identify the most promising HXs for PCM applications, first-order geometry and cost analyses were conducted based on off-the-shelf HX products. As part of this work, 9 PCM-HX prototypes were manufactured using additive and conventional manufacturing methods. Detailed economy-of-scale assessments were conducted for the most promising PCM-HXs and were found to have a good outlook for the next 5-10 years. The PCM-HX design optimization framework was validated through comprehensive in-house experimental testing using newly-developed PCM-to-fluid test facilities. In total,10 total in-house component-level experiments were conducted using these prototypes, including 9 with water and 1 with refrigerant (R410A) as the working fluid. It was found that the framework can successfully predict experimental thermal-hydraulic performance within ±10-20% the first time without manual design changes, eliminating the need for time-consuming and expensive prototyping efforts as part of the design process. As part of this work, a publicly-available PCM web tool was released which includes a PCM property database (531 PCMs) and PCM-HX modeling tool to assist the design community on common PCM-HX use-cases, e.g., single/multiple flow path(s) fluid-to-PCM and air-to-fluid-to-PCM configurations (https://ceeeweb.umd.edu/pcmapp/). This work will accelerate the design and time to market for next generation PCM-HXs.

25 ENERGY STORAGE↗

DOE OSTI2023

Stretchable Photodiodes with Polymer-Engineered Semiconductor Nanowires for Wearable Photoplethysmography

Healthcare systems worldwide have been stressed to provide sufficient resources to serve the increasing and aging population in our society. The situation became more challenging at the time of pandemic. Technology advancement, especially the adoption of wearable health monitoring devices, has provided an important supplement to current clinical equipment. Most health monitoring devices are rigid, however, human tissues are soft. Such a difference has prohibited intimate contact between the two and jeopardized wearing comfortableness, which hurdles measurement accuracy especially during longtime usage. Here, in this work, we report a soft and stretchable photodiode that can conformally adhere onto the human body without any pressure and measure cardiovascular variables for an extended period with higher reliability than commercial devices. The photodiode used a composite light absorber consisting of an organic bulk heterojunction embedded into an elastic polymer matrix. It is discovered that the elastic polymer matrix not only improves the morphology of the bulk heterojunction for obtaining the desired mechanical properties but also alters its electronic band structure and improves the electrical properties that lead to a reduced dark current and enhanced photovoltage in the stretchable photodiode. The work has demonstrated high fidelity measurements and longtime monitoring of heat rate variability and oxygen saturation, potentially enabling next-generation wearable photoplethysmography devices for point-of-care diagnosis of cardiovascular diseases in a more accessible and affordable way.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2023

Optically Active Spin Defects in Few-Layer Thick Hexagonal Boron Nitride

Optically active spin defects in hexagonal boron nitride (hBN) are promising quantum systems for the design of two-dimensional quantum sensing units offering optimal proximity to the sample being probed. In this Letter, we first demonstrate that the electron spin resonance frequencies of boron vacancy centers ($V$$^{–}_{B}$) can be detected optically in the limit of few-atomic-layer thick hBN flakes despite the nanoscale proximity of the crystal surface that often leads to a degradation of the stability of solid-state spin defects. We then analyze the variations of the electronic spin properties of $V$$^{–}_{B}$ centers with the hBN thickness with a focus on (i) the zero-field splitting parameters, (ii) the optically induced spin polarization rate and (iii) the longitudinal spin relaxation time. Furthermore, this Letter provides important insights into the properties of $V$$^{–}_{B}$ centers embedded in ultrathin hBN flakes, which are valuable for future developments of foil-based quantum sensing technologies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

Transient Efficiency, Flexibility, and Reliability Optimization of Coal-Fired Power Plants - Final Report

This program developed an advanced model-based monitoring and model-predictive control algorithms for a coal fired power plant (CFPP), and deployed these algorithms in a real-time platform to demonstrate performance benefits for transient flexibility and plant operation efficiency. More specifically, the objectives were successfully achieved through a combination of (i) developing a high-fidelity transient plant model in Apros, which was used as a high-fidelity plant simulation between $100-50\% TMCR$ where TMCR denotes the turbine maximum continuous rating, i.e., baseload, (ii) developing a very fast physics-based reduced-order model (ROM) of the plant, which ran more than $100\times$ faster than real-time, enabling its use as real-time embedded model for model-based estimation (MBE) and model predictive control (MPC) (iii) implementing a real-time MBE based on ROM using a robust unscented Kalman filter (UKF) to continuously tune the ROM to match the measurements from high-fidelity Apros plant model despite significant plant-model mismatch, and thus, obtain a Digital Twin of the plant (iv) designing and implementing a real-time MPC with dual objectives of transient plant load tracking with high ramp rates and minimizing coal consumption, i.e., improving plant efficiency in the baseload-partload operation range of $100-50\% TMCR$. Each key element above was developed and tested individually, and has been reported in corresponding Topical Reports. Finally, all the individual elements were integrated in an overall closed-loop system, that was successfully tested in desktop Simulink test harness simulations with ROM or high-fidelity model as the plant. Thereafter, the Simulink implementation was used to auto-generate C-code and deploy as real-time Docker microservice containers in Linux, and validate that they can run in real-time in the hardware-in-the loop (HIL) setup and produce the same results as in Simulink. The results of the integrated simulation tests in Simulink as well as the real-time HIL deployment are documented in this final report, showing good load tracking for load ramps at $3-4\%/min$ ramp rates, and achieving up to $5.5\%$ reduction in coal relative to baseline operation at $50\% TMCR$ load. The desktop and HIL simulations show successful performance of the overall model based estimation and control solution and achieve the key objectives of the program for flexible, efficient and reliable operation of subcritical coal fired power plants.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2023

Transient Efficiency, Flexibility, and Reliability Optimization of Coal-Fired Power Plants - Final Program Review

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2024

From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak

Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.

integrated data analysis↗

DOE OSTI2022

Nuclear cusps and singularities in the nonadditive kinetic potential bifunctional from analytical inversion

The non-additive kinetic potential $v^{\text{NAD}}$ is a key quantity in density-functional theory (DFT) embedding methods, such as frozen density embedding theory and partition DFT. $v^{\text{NAD}}$ is a bi-functional of electron densities $\rho_{\rm B}$ and $\rho_{\rm tot} = \rho_{\rm A} + \rho_{\rm B}$. It can be evaluated using approximate kinetic-energy functionals, but accurate approximations are challenging. The behavior of $v^{\text{NAD}}$ in the vicinity of the nuclei has long been questioned, and singularities were seen in some approximate calculations. In this article, the existence of singularities in $v^{\text{NAD}}$ is analyzed analytically for various choices of $\rho_{\rm B}$ and $\rho_{\rm tot}$, using the nuclear cusp conditions for the density and Kohn-Sham potential. It is shown that no singularities arise from smoothly partitioned ground-state Kohn-Sham densities. We confirm this result by numerical calculations on diatomic test systems HeHe, HeLi$^+$, and H$_2$, using analytical inversion to obtain a numerically exact $v^{\rm NAD}$ for the local density approximation. We examine features of $v^{\rm NAD}$ which can be used for development and testing of approximations to $v^{\rm NAD}[\rho_{\rm B},\rho_{\rm tot}]$ and kinetic-energy functionals.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2026

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

Aubourg, Eric [APC, Paris] (ORCID:000000025592023X↗

DOE OSTI2023

A Real-Time ANPC Inverter Digital Twin with Integrated Design-For-Trust

The demand for renewable energy has increased over the last few years, and so has the demand for greater expectations within the energy market. This increasing trend has been accompanied by more significant usage of internet-connected devices (IoT), leading to critical electrical infrastructure being connected to the internet. Implementing internet connectivity with such devices and systems provides benefits such as improving the system's performance, facilitating irregularity and anomaly mitigation, and providing additional situational awareness for enhanced decision-making. However, enhancing the connected system with IoT introduces a drawback – a greater vulnerability to cyber-attacks. Cyber-attacks targeting critical infrastructure in the electrical sector have occurred in the United States and Ukraine. These cyber-attacks highlight and expose vulnerabilities that a system inherits when connecting to the internet. These attacks left thousands of customers without electricity for hours until operators could regain control of the electric utility grid. Therefore, to address the vulnerabilities of an internet-connected power electronic device, this work focused on the hardware layer of the system. Implementing a cyber-control system inside the hardware layer can significantly reduce the possibility of an attacker patching malicious controller firmware into a photovoltaic grid-connected inverter, thus mitigating the likelihood that the inverter becomes inactive a cyber-attack scenario. With this mitigation technique, if a cyberattack is successful and an attacker gains control of the network, a cyber-defense technique is in place to mitigate the impact of the cyber-attack. This additional protection layer was developed based on an innovative concept known as Digital Twin (DT). A DT, in this case, replicates an Active-Neutral Point Clamped (ANPC) inverter and was designed using a hardware language known as VHDL (Very High-Speed Integrated Circuit Hardware Description Language) and applied to Field-Programmable-GateArray (FPGA). The DT is embedded within the FPGA and contained in a controller board, the UCB (Unified Controller Board), developed by the University of Arkansas electrical engineering team. This UCB also contains two Digital Signal Processors (DSPs) responsible for generating associated signals to control an authentic physical inverter. These DSP signals are received and processed by the FPGA that implements the DT of an ANPC; in other words, it simulates in realtime the expected output of an actual ANPC inverter using the signals from the DSP. When a new firmware is ready to be patched, the DT provides output signals simulating behavior that a real ANPC inverter would generate with the new firmware. The new firmware is tested to check if it meets all the operational requirements established using a Design-For-Trust technique (DFTr). If the new firmware fails in at least one of the DFT tests, it is considered malicious and must be rejected. This work is divided into sections, such as Background, which explains the pieces that were used and the strategy behind this work; Process and Procedure, which explains the methodology that was adopted to prove the reliability and effectiveness of this work; Results and Discussion, where the simulations and results are described and explained; followed by Conclusion and Future work section, which concludes this work and adds possible future projects to continue this work further.

do Amaral Custodio, Paulo Vitor↗

DOE OSTI2022

High-Throughput Microfluidics Platform for Intracellular Delivery and Sampling of Biomolecules from Live Cells

Nondestructive cell membrane permeabilization systems enable the intracellular delivery of exogenous biomolecules for cell engineering tasks as well as the temporal sampling of cytosolic contents from live cells for the analysis of dynamic processes. Here, in this paper, we report a microwell array format live-cell analysis device (LCAD) that can perform localized-electroporation induced membrane permeabilization, for cellular delivery or sampling, and directly interfaces with surface-based biosensors for analyzing the extracted contents. We demonstrate the capabilities of the LCAD via an automated high-throughput workflow for multimodal analysis of live-cell dynamics, consisting of quantitative measurements of enzyme activity using self-assembled monolayers for MALDI mass spectrometry (SAMDI) and deep-learning enhanced imaging and analysis. By combining a fabrication protocol that enables robust assembly and operation of multilayer devices with embedded gold electrodes and an automated imaging workflow, we successfully deliver functional molecules (plasmid and siRNA) into live cells at multiple time-points and track their effect on gene expression and cell morphology temporally. Furthermore, we report sampling performance enhancements, achieving saturation levels of protein tyrosine phosphatase activity measured from as few as 60 cells, and demonstrate control over the amount of sampled contents by optimization of electroporation parameters using a lumped model. Lastly, we investigate the implications of cell morphology on electroporation-induced sampling of fluorescent molecules using a deep-learning enhanced image analysis workflow.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Chlorophylls as primary electron acceptors in reaction centers

Photosynthetic Reaction Centers (RCs) can be considered blueprints for highly efficient energy transfer. Embedded with an array of cofactors, including (bacterio)chlorophyll ((B)Chl) and (B)pheophytin ((B)Pheo) molecules, RCs function with a high quantum yield that spans a wide spectral range. Understanding the principles that underlie their function can influence the design of the next generation of artificial photosynthetic devices. We are particularly interested in the factors that influence the early stages of light-driven charge separation in RCs. With the recent publication of several highly anticipated RC structures and advanced computational methods available, it is possible to probe both the geometric and electronic structures of an array of RCs. In this chapter, we review the electronic and geometric structures of the (B)Chl and (B)Pheo primary electron acceptors from fiveRCs, comprising both Type I and Type II RCs and representing both heterodimeric and homodimeric systems. We showcase the dimeric A0•- state of Type I RCs, whereby the unpaired electron is delocalized, to various extents, over two (B)Chl molecules (B)Chl2 and (B)Chl3. This delocalization is controlled by several factors, including the structure of the (B)Chls, interactions with the surrounding protein matrix, and the orientation and distances of the cofactors themselves. In contrast, the primary acceptors of Type II RCs are entirely monomeric, with electron density residing solely on the (B)Pheo. We compare the natural design of the primary acceptors of the Type I and Type II RCs from both an evolutionary and application based perspective.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Unsupervised machine learning for unbiased chemical classification in X-ray absorption spectroscopy and X-ray emission spectroscopy

Here we report a comprehensive computational study of unsupervised machine learning for extraction of chemically relevant information in X-ray absorption near edge structure (XANES) and in valence-to-core X-ray emission spectra (VtC-XES) for classification of a broad ensemble of sulphorganic molecules. By progressively decreasing the constraining assumptions of the unsupervised machine learning algorithm, moving from principal component analysis (PCA) to a variational autoencoder (VAE) to t-distributed stochastic neighbour embedding (t-SNE), we find improved sensitivity to steadily more refined chemical information. Surprisingly, when embedding the ensemble of spectra in merely two dimensions, t-SNE distinguishes not just oxidation state and general sulphur bonding environment but also the aromaticity of the bonding radical group with 87% accuracy as well as identifying even finer details in electronic structure within aromatic or aliphatic sub-classes. We find that the chemical information in XANES and VtC-XES is very similar in character and content, although they unexpectedly have different sensitivity within a given molecular class. We also discuss likely benefits from further effort with unsupervised machine learning and from the interplay between supervised and unsupervised machine learning for X-ray spectroscopies. Our overall results, i.e., the ability to reliably classify without user bias and to discover unexpected chemical signatures for XANES and VtC-XES, likely generalize to other systems as well as to other one-dimensional chemical spectroscopies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Magneto-Structural Combined Dimensional and Topology Optimization of Interior Permanent Magnet Synchronous Machine Rotors

Not provided.

Engineering↗

DOE OSTI2026

Cooperative effect of local active stresses on the macroscopic contractility of elastic fiber networks

The collective action of actively contractile units embedded in elastic biopolymer networks plays a crucial role in regulating the network's macroscopic mechanical response. Here, in this study, we investigate how the macroscopic boundary stress in model elastic fiber networks depends on the number and nature of embedded contractile units, each exerting an isotropic force dipole, as well as on the bending stiffness of fibers. We find that the macroscopic stress increases nonlinearly with the number of dipoles due to mutual stiffening of initially soft, bending-dominated networks. Using effective medium theory, we relate this enhanced contractility to an increase in the effective average network coordination number due to constraints imposed by the force dipoles. By comparing three distinct force dipole models that differ in their local structures, we demonstrate that the specific manner in which an active unit constrains the network strongly influences the onset and nature of the stiffening transition. Our results highlight that not only the quantity but also the local geometry of force-generating units critically determines the macroscopic mechanical behavior. This framework provides a physical basis for understanding how biological systems—such as molecular motors in the cytoskeleton, or adherent cells in the extracellular matrix—can modulate network-scale nonlinear elastic properties through local tuning of active force-generating units.

Biological and medical sciences↗

DOE OSTI2022

Tackling the Challenges in Scene Graph Generation With Local-to-Global Interactions

In this work, we seek new insights into the underlying challenges of the scene graph generation (SGG) task. Quantitative and qualitative analysis of the visual genome (VG) dataset implies: 1) ambiguity: even if interobject relationship contains the same object (or predicate), they may not be visually or semantically similar; 2) asymmetry: despite the nature of the relationship that embodied the direction, it was not well addressed in previous studies; and 3) higher-order contexts: leveraging the identities of certain graph elements can help generate accurate scene graphs. Motivated by the analysis, we design a novel SGG framework, Local-to-global interaction networks (LOGINs). Locally, interactions extract the essence between three instances of subject, object, and background, while baking direction awareness into the network by explicitly constraining the input order of subject and object. Globally, interactions encode the contexts between every graph component (i.e., nodes and edges). Finally, Attract and Repel loss is utilized to fine-tune the distribution of predicate embeddings. By design, our framework enables predicting the scene graph in a bottom-up manner, leveraging the possible complementariness. To quantify how much LOGIN is aware of relational direction, a new diagnostic task called Bidirectional Relationship Classification (BRC) is also proposed. Overall, experimental results demonstrate that LOGIN can successfully distinguish relational direction than existing methods (in BRC task), while showing state-of-the-art results on the VG benchmark (in SGG task).

97 MATHEMATICS AND COMPUTING↗