Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “interacting agent systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An intelligent energy router for managing behind-the-meter resources and assets

With increase in distributed energy resources (DERs) and smart loads, each energy resource and load need a separate power conversion system leading to complex coordination and interaction, reduced energy conversion efficiency, coordinating compliance to grid standards (IEEE 1547) from multiple sources, reduced security. Also, multiple vendors with legacy system designs and proprietary communications interfaces result in redundancy and increase in cost of power electronics systems. This paper presents an energy router concept for buildings applications which provides autonomous power flow between sources and loads with a novel agent-based software interface.

Chinthavali, Madhu Sudhan↗
DOE OSTI2022

DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing

Cluster schedulers are crucial in high-performance computing (HPC). They determine when and which user jobs should be allocated to available system resources. Existing cluster scheduling heuristics are developed by human experts based on their experience with specific HPC systems and workloads. However, the increasing complexity of computing systems and the highly dynamic nature of application workloads have placed tremendous burden on manually designed and tuned scheduling heuristics. More aggressive optimization and automation are needed for cluster scheduling in HPC. In this work, we present an automated HPC scheduling agent named DRAS (Deep Reinforcement Agent for Scheduling) by leveraging deep reinforcement learning. DRAS is built on a hierarchical neural network incorporating special HPC scheduling features such as resource reservation and backfilling. An efficient training strategy is presented to enable DRAS to rapidly learn the target environment. Once being provided a specific scheduling objective given by the system manager, DRAS automatically learns to improve its policy through interaction with the scheduling environment and dynamically adjusts its policy as workload changes. We implement DRAS into a HPC scheduling platform called CQGym. CQGym provides a common platform allowing users to flexibly evaluate DRAS and other scheduling methods such as heuristic and optimization methods. Furthermore, the experiments using CQGym with different production workloads demonstrate that DRAS outperforms the existing heuristic and optimization approaches by up to 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Neutron Radiography and Computed Tomography of Biological Systems at the Oak Ridge National Laboratory's High Flux Isotope Reactor

Neutrons have historically been used for a broad range of biological applications employing techniques such as small-angle neutron scattering, neutron spin echo, diffraction, and inelastic scattering. Unlike neutron scattering techniques that obtain information in reciprocal space, attenuation-based neutron imaging measures a signal in real space that is resolved on the order of tens of micrometers. The principle of neutron imaging follows the Beer-Lambert law and is based on the measurement of the bulk neutron attenuation through a sample. Greater attenuation is exhibited by some light elements (most notably, hydrogen), which are major components of biological samples. Contrast agents such as deuterium, gadolinium, or lithium compounds can be used to enhance contrast in a similar fashion as it is done in medical imaging, including techniques such as optical imaging, magnetic resonance imaging, X-ray, and positron emission tomography. For biological systems, neutron radiography and computed tomography have increasingly been used to investigate the complexity of the underground plant root network, its interaction with soils, and the dynamics of water flux in situ. Moreover, efforts to understand contrast details in animal samples, such as soft tissues and bones, have been explored. This manuscript focuses on the advances in neutron bioimaging such as sample preparation, instrumentation, data acquisition strategy, and data analysis using the High Flux Isotope Reactor CG-1D neutron imaging beamline. The aforementioned capabilities will be illustrated using a selection of examples in plant physiology (herbaceous plant/root/soil system) and biomedical applications (rat femur and mouse lung).

Bilheux, Hassina↗
DOE OSTI2024

Investigation of the Potential of Repurposing Medium-Density Fiberboard Waste as an Adsorbent for Heavy Metal Ion Removal

Medium-density fiberboard (MDF) waste generation has increased steadily over the past decades, and therefore, the investigation of novel methods to recycle this waste is very important. The potential of repurposing MDF waste as an adsorbent for the treatment of Cd(II), Cu(II), Pb(II), and Zn(II) ions in water was investigated using MDF offcuts. The highest adsorption potential in single-metal ion solution systems was observed for Pb(II) ions. The experimental data of Pb(II) ions fit well with the Freundlich isotherm and pseudo-second-order kinetic models. Complexation and electrostatic interactions were identified as the adsorption mechanisms. The adsorption behavior of multi-metal ion adsorption systems was investigated by introducing Cd(II) ions as a competitive metal ion. The presence of the Cd(II) ions reduced the adsorption potential of Pb(II) ions, yet the preference for the Pb(II) ions remained. Regeneration studies were performed by using 0.1 M HCl as a regeneration agent for both systems. Even though a significant amount of adsorbed metal ions were recovered, the adsorption potential of the MDF was reduced in the subsequent adsorption cycles. Based on these results, MDF fines have the potential to be used as an economical adsorbent for remediation of wastewater containing heavy metal ions.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Adsorptive behavior of poly (vinylidene fluoride) membranes for the recovery of lignin-derived hydrophobic deep eutectic solvents

Abstract Recently, membrane technology has gained significant traction as an energy-efficient alternative to traditional thermal processes for solvent recovery. Deep eutectic solvents (DESs) have emerged as sustainable alternatives to conventional organic solvents, yet a systematic methodology for selecting compatible membrane materials for their recovery remains underdeveloped. This study established a predictive framework for membrane material selection in hydrophobic DES applications using Hansen Solubility Parameters (HSP) with inverted criteria targeting materials with relative energy difference (RED) values greater than 1.0. Flat sheet membranes were fabricated via the non-solvent induced phase separation (NIPS) technique. Four NIPS fabricated polymer membranes were evaluated: polysulfone, cellulose acetate, polyvinylidene fluoride (PVDF) fabricated with polyethylene glycol (PEG) as a pore-forming agent, and polybenzimidazole (PBI). The HSP approach successfully predicted membrane-solvent compatibility, with polysulfone (RED = 0.6) and cellulose acetate (RED = 0.9) dissolving completely within 24 h, while PVDF (RED = 1.9) and PBI (RED = 1.1) maintained structural integrity throughout a 7-day exposure period. Furthermore, PVDF demonstrated superior performance with minimal weight gain (3.0%), hydrophobic surface characteristics (122° water contact angle), and enhanced mechanical properties following DES exposure. Comprehensive chemical and morphological characterization confirmed PVDF’s chemical stability and revealed a surface-selective interaction mechanism involving simultaneous PEG (pore-forming agent) extraction and DES component adsorption. Adsorption kinetics followed pseudo-first-order behavior with reversible characteristics, best described by the Temkin isotherm model (R² = 0.9987). PVDF membranes-maintained separation functionality with average lignin rejection (75.2 ± 7.69%) and demonstrated filtration permeability of 2.0 ± 0.34 LMH/bar. This methodology provides a rational approach for membrane selection in emerging solvent systems, contributing to the advancement of sustainable separation technologies for DES-based biomass processing applications.

Science & Technology - Other Topics↗
DOE OSTI2026

SetGo: Metadata Readiness for Scientific AI Datasets

Scientific datasets intended for AI use require both computational readiness for model training and metadata readiness for discovery, sharing, and reuse. The Readiness Engine for Data Integration (REDI) addresses computational readiness, but no corresponding tool evaluates whether a dataset’s metadata are sufficiently complete, governed, and standards-compliant for publication and agent-based consumption. Existing FAIR assessors operate only on published repository records, and no single system covers FAIR compliance, licensing, provenance, governance, reproducibility, and catalog readiness together. We present SetGo, an open-source Python toolkit that assesses and repairs metadata readiness across these six dimensions before a dataset is published or archived. Applied to four scientific corpora, SetGo surfaces deficiencies that general-purpose tools do not detect: ERA5 climate metadata scores 4% on ACDD 1.3 compliance; materials datasets fail OPTIMADE species-definition requirements; and PDB-derived proteomics data carries licensing terms incompatible with standard SPDX identifiers. Guided enrichment raises overall FAIR scores from 52–57% to 81–91%, and a single setgo publish command pushes to Hugging Face Hub, CKAN, or OpenMetadata with ML Commons Croissant 1.0 metadata sidecars. To support interactive and automated workflows, SetGo integrates with coding agents powered by large language models (LLMs) through a /setgo skill that enables natural-language execution of the full assess–enrich–publish loop, with user involvement limited to supplying missing metadata values.

Wilkinson, Sean [ORNL] (ORCID:0000000214437479)↗
DOE OSTI2026

Desorption Electrospray Ionization–Mass Spectrometry Imaging Provides Spatiochemical Information on Potential Biocontrol Agents against Phytophthora capsici Infection in Tomato Plants

Biological control agents can offer an eco-friendly and more sustainable alternative to conventional chemical pesticides, providing protection against destructive pathogens, such as Phytophthora capsici, while reducing potential environmental harm associated with synthetic pesticide use in agricultural systems. This work evaluates the biocontrol effectiveness of Bacillus vallismortis, Bacillus amyloliquefaciens, Bacillus thuringiensis, and Bacillus subtilis, against the widespread plant pathogen Phytophthora capsici. Our studies showed that Bacillus thuringiensis and Bacillus subtilis promote plant growth and provide protection against Phytophthora capsici in both in vitro and in vivo greenhouse studies, while Bacillus vallismortis and Bacillus amyloliquefaciens were effective in vitro but not in vivo. Specifically, Bacillus thuringiensis was observed to both hinder the growth of Phytophthora capsici and enhance plant resilience to this pathogen, with B. thuringiensis-treated, pathogen-exposed plants displaying a 94.4% increase in root length and a 74.0% increase in shoot height compared to plants with only oomycete exposure. To probe the molecular interactions between the biocontrol agent and pathogen, a dual culture of Bacillus thuringiensis and Phytophthora capsici was analyzed in situ using a desorption electrospray ionization–mass spectrometry imaging (DESI-MSI) workflow. This approach interrogated the spatially oriented biochemical interactions that may serve as the molecular foundation for the effectiveness of these biological control agents in crop protection, identifying seven unique phenotypic regions within the dual culture. Herein, we demonstrate the benefits of biological control agent application in tomato cultivation and showcase the strengths of desorption electrospray ionization–mass spectrometry imaging when applied to the spatially resolved molecular characterization of agriculturally relevant microorganisms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

CityLearn v2: energy-flexible, resilient, occupant-centric, and carbon-aware management of grid-interactive communities

As more distributed energy resources become part of the demand-side infrastructure, quantifying their energy flexibility on a community scale is crucial. CityLearn v1 provided an environment for benchmarking control algorithms. However, there is no standardized environment utilizing realistic building-stock datasets for distributed energy resource control benchmarking without co-simulation or third-party frameworks. CityLearn v2 extends CityLearn v1 by providing a stand-alone simulation environment that leverages the End-Use Load Profiles for the U.S. Building Stock dataset to create grid-interactive communities for resilient, multi-agent, and objective control of distributed energy resources with dynamic occupant feedback. While the v1 environment used pre-simulated building thermal loads, the v2 environment uses data-driven thermal dynamics and eliminates the need for co-simulation with building energy performance software. This work details the v2 environment and provides application examples that use reinforcement learning control to manage battery energy storage system, vehicle-to-grid control, and thermal comfort during heat pump power modulation.

Nweye, Kingsley↗
DOE OSTI2022

UrbanPop: A spatial microsimulation framework for exploring demographic influences on human dynamics

Ensuring the social equity of planning measures in social systems requires an understanding of human dynamics, particularly how individual relationships, activities, and interactions intersect with individual needs. Spatial microsimulation models (SMSMs) support planning for human security goals by representing human dynamics through realistic, georeferenced synthetic populations, that a) provide a complete representation of social systems while b) also protecting individual privacy. In this paper, we present UrbanPop, an open and reproducible SMSM framework for analysis of human dynamics with high spatial, temporal, and demographic resolution. UrbanPop creates synthetic populations of demographically detailed worker and student agents, positioning them first at probable nighttime locations (home), then moving them to probable daytime locations (work/school). Summary aggregations of these populations match the granular detail available at the census block group level in the American Community Survey Summary File (SF), providing realistic approximations of the actual population. UrbanPop users can select particular demographic traits important in their application, resulting in a highly tailored agent population. We first lay out UrbanPop's baseline methodology, including population synthesis, activity modeling, and diagnostics, then demonstrate these capabilities by developing case studies of shifting population distributions and high-risk populations in Knox County, TN during the global COVID-19 pandemic.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Agent-Based Coordination Scheme for PV Integration (ABC4PV)

Renewables and especially photovoltaics (PV) have benefitted significantly from a host of incentives and policies targeted toward enhanced integration and adoption of specific energy technologies. However, with the push to move forward into a subsidy-free market framework, behind-the-meter residential PV applications have generally struggled to retain their value (unlike utility scale and commercial projects) [1]. This project focused on developing control-theoretic solutions aimed at improving the integration and interaction of behind-the-meter residential PV with other distribution system assets (controllable and non-controllable) to enhance the integrated value of residential PV. To this end, a suite of decentralized control methodologies have been developed to enable effective coordination and control of behind-the-meter residential load customers’ PV, battery storage systems (BSS), controllable loads and other similar assets within a distribution feeder. This interaction aims at procuring energy savings and, thus, energy bill savings. The main source of savings is drawn from reducing the effect of demand charge pricing and is realized at the feeder level, assuming community level interaction and management among the aforementioned assets. Optimal control of the assets is implemented with a distributed optimization methodology, leveraging consensus-based algorithms. The results gathered from the optimal control simulations demonstrates that the savings can be duly achieved and the algorithm decision times (to dynamically control asset set points, for example) are fast. As for the overall efficiency of PV+BSS systems, to procure energy savings from curtailment of the demand charge pricing effects, the optimal control is set up so as to minimize the variance of the load for all customers, throughout a feeder and throughout time in a rolling horizon scheduling with model predictive control. The control takes into account inter-temporal electrochemical storage (battery) degradation costs: specifically, we have developed a long-term lifetime model for the BSS that weighs in the effect of the degradation factor in the dispatch formulations, thus, a considerable operating cost that affects energy decision making. The levelized cost of energy (LCOE – redefined for the purpose of quantifying asset integration effectiveness through the customers’ energy cost) is shown to be below the threshold set for the combined PV+BSS topology of $ 0.14/kWh for multiple cases of PV penetration all the way up to 50%, provided that a policy of shared ownership of and savings is in place. Further, the LCOE calculated for the case before the deployment PV+BSS systems is also achievable, i.e. the deployment of PV+BSS, if planned and scheduled optimally. will have no effect on customers’ energy costs. From the control methodology viewpoint, the developed consensus-based algorithms are shown to converge for a wide range of problem cases (spanning normal operating scenarios and contingencies), guaranteeing dispatch solutions under forecasting errors, communication break-downs and cyber-security attacks. The proposed control solutions are scalable and real-time implementable, with dispatch computations and device set-point updates converging in less than 2s in most practical instances of the above events.

14 SOLAR ENERGY↗
DOE OSTI2020

Sn-Based Alloys Synthesized in an Ionic Liquid at Room Temperature: Cu6Sn5 as a Case Study

Sn-based alloys are increasingly investigated owing to possible electronic/structural modulations of interest for electrocatalysis and energy storage applications. Here, we report on the use of a chemical system consisting of an ionic liquid (1-ethyl-3- methylimidazolium bis(trifluoromethanesulfonyl)imide: [EMIm(+)][TFSI-]) and Sn-based precursor Sn(TFSI)(2) both featuring similar anionic groups. This strategy increases the solubility of the cationic precursor in the IL and avoids the formation of side-products during the precipitation of Sn-nanoparticles formed upon reaction with a reducing agent (NaBH4). Using NMR relaxometry, we further established that these nanoparticles are stabilized by specific interactions with the cationic group of the IL. Targeting the composition Cu6Sn5, we further demonstrated that this approach can be used to prepare Sn-based alloys which could not be prepared using conventional chloride-based precursors.

cyclic voltammetry↗
DOE OSTI2024

Lignin - A green material for antibacterial application — A review

Lignin's antibacterial properties have become increasingly relevant due to the rise of microbial infectious diseases and antibiotic resistance. Lignin is capable of interacting electrostatically with bacteria and contains polyphenols that cause damage to their cell walls. These features make lignin a desirable material to exhibit antibacterial behavior. Therefore, lignin in antibacterial applications offers a novel approach to address the growing need for sustainable and effective antibacterial materials. Recent research has explored the incorporation of lignin in various biomedical applications, such as wound dressings, implants, and drug delivery systems, highlighting their potential as a sustainable alternative to synthetic antibacterial agents. Furthermore, the development of lignin-based nanomaterials with enhanced antimicrobial activity is an active area of research that holds great promise for the future. Here, in this review, we have provided a summary of how lignin can be incorporated into different forms, such as composite and non-composite synthesis of antibacterial agents and their performances. The challenges and future considerations are also discussed in this review article.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

HumoNet: A Framework for Realistic Modeling and Simulation of Human Mobility Network

Understanding, analyzing, and predicting human mobility and dynamics are valuable to solving pressing problems, developing effective plans, and prescribing timely remedies. As a computational approach, realistic human mobility simulations allow us to understand, analyze, and predict complex systems, including human societies. Accurate simulations rely on (1) the model that captures interactions and behaviors of myriad entities in our society and (2) the mapping of model instances to real-world entities. Taking this into account, this paper introduces the Human Mobility Network simulation framework (HumoNet), an integrated patterns of life (POL) simulation framework that leverages real-world data layers including transportation networks, points of interest, populations, popularity, and human trajectories. HumoNet is a data informed model in which agents are equipped with activities, locomotion, and planning capabilities. To simulate realistic kinematic maneuvers of individuals in transportation networks, HumoNet harnesses a microscopic traffic simulator that provides interaction among vehicles and traffic objects. In this paper, we describe the framework, outline our methodologies, and discuss the data processing and challenges of each data layer. Through experiments, we demonstrate that our simulations capture key features of human mobility by comparing them to the literature and real data using standard measures of human mobility (i.e., the radius of gyration, number of locations visited, level of exploration) and metrics scoring (i.e., Jensen-Shannon divergence). We envision that the synthetic data produced by HumoNet will serve as a benchmark for analyzing epidemics, deploying EV charging networks, and validating AI/ML tasks such as location prediction.

Kim, Joon-Seok↗
DOE OSTI2024

HybridSystemsSimulations.jl - Solving the Merchant Collocated Facilities with JuMP

The development of new clean-generation technologies also leads to new plant-level architectures that combine several generation and storage assets behind the point of connection. These co-located generation resources (Hybrid Systems) primarily operate as merchant assets that employ automated market bidding models and internal Energy Management Systems (EMS) to comply with the operator's signals. Formulating an optimal bidding model requires embedding the EMS control model into the bidding algorithm, resulting in a bi-level optimization problem. In this presentation, we first showcase using JuMP to formulate and solve this problem effectively for multiple merchant systems and the bidding outcomes considering different model formulations. Second, the bidding outcomes are later integrated into a PowerSimulations.jl (also built with JuMP) simulation to study the system-level effects of the various merchant bidding and the interactions between market-clearing models and the embedded EMS model. We will showcase simulations conducted in the RTS system considering different levels of merchant hybrid systems participation. The presentation provides the following specific insights on JuMP usage: 1) the Formulation of specialized bi-level problems with custom cuts to solve the merchant hybrid system bidding problem; 2) the integration of a modular model within a complex simulation workflow supported by JuMP in PowerSimulations.jl; 3) Accelerating the solution of power systems operations simulation that employ agent optimization problems using JuMP.

energy markets↗
DOE OSTI2022

VOLTTRON Modular Framework: Enabling flexible and scalable deployment solutions

VOLTTRON ™ is an open-source platform for distributed sensing and control. The platform provides services for collecting and storing data from buildings and devices and provides an environment for developing applications which interact with that data. The platform allows developers to build out their use cases by utilizing these frameworks and integrating new capabilities. To simplify the deployment of systems built on VOLTTRON, a new way of organizing the codebase is being explored. This document details these efforts through a new code repository layout for the VOLTTRON platform and services, and how this new layout provides targeted deployments using standard python deployment packages (wheels). In addition, this paper will discuss the development of third-party agents and how they can be integrated within the VOLTTRON ecosystem. Finally, we will discuss core platform development and direction for the modularized version of VOLTTRON.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Extended molecular eigenmodes treatment of dipole–dipole NMR relaxation in real fluids

Traditional models of NMR relaxation fail to account for the complex, multi-exponential behavior of the autocorrelation function in realistic systems characterized by soft-interactions and molecules that are chemically and physically complex. Here, in this study, we describe the relative diffusion of the spin dipoles by means of a Fokker–Planck equation that includes an interaction potential of mean force to account for the response of the physical/chemical environment around the dipoles. By numerically solving the Fokker–Planck equation for the diffusion propagator, we estimate dipole–dipole NMR relaxation for like- and unlike-spin systems via its eigenmode solution. We test the model against molecular simulations of diffusing dipoles with harmonic potentials and also validate using experimental longitudinal relaxation data from real systems, including Gd(III)–aqua and Gd(III)–DO3A–butrol complexes, the latter being an important MRI contrast agent. Using this novel approach, we predict both the inner- and outer-shell contributions to the relaxivity rates with excellent accuracy at frequencies relevant to MRI. We also show that, under the appropriate assumptions, our framework naturally recovers the Bloembergen–Purcell–Pound, the Solomon–Bloembergen–Morgan, and the Hwang–Freed models. Our implementation is general and publicly available for application to a broad range of systems.

Pinheiro dos Santos, Thiago J. [Rice Univ., Housto↗