Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Demand Driven Cycamore Archetypes

Future nuclear fuel cycle options may present advantages over today’s once-through fuel cycle. Nuclear fuel cycle simulation tools assess the performance of those fuel cycles as well as the dynamics of long-term technology transitions. In many nuclear fuel cycle simulation tools, it has historically been the responsibility of the user to manually define facility deployment schemes and all facility parameters. While this is straightforward in simple fuel cycles, transitions from one fuel cycle to another can be more complex. In particular, deployment schemes for supportive fuel cycle facilities beyond the reactor become complex if the analyst desires to avoid gaps in the nuclear fuel and power supply chain during those transition scenarios. As nuclear fuel cycle analysis approaches questions regarding the feasibility and performance of the deployment schemes and technology choices during technology transition, automation of this historically manual process is necessary. The main objective of this work was to develop and demonstrate Cyclus automation capabilities toward key nuclear fuel cycle transition scenarios. While deploying reactors to meet power demand is trivial, and existed in the earliest versions of CYCLUS, automated, predictive deployment and decommissioning of other facilities is more complex. These include mining, milling, enrichment, fuel fabrication, reprocessing, and others. For example, a balanced closed fuel cycle may require ensuring that there is enough fast reactor fuel for their operation and may drive deployment of a fleet of light water reactors. This concern comprises the main challenge that drove the project effort. The Demand-Driven Cycamore Archetype project (NEUP-FY16-10512) aimed to develop CYCAMORE demand-driven deployment capabilities and thereby automate transition scenario definition. The developed software package, d3ploy, in the form of a CYCLUS Institution agent, deploys Facilities to meet the front-end and back-end demands of the fuel cycle. The University of South Carolina and the University of Illinois applied multiple algorithmic approaches to this challenge. This project developed an in situ demand-driven development schedule calculation through non-optimizing, deterministic-optimizing, and stochastic-optimizing algorithms as CYCLUS archetypes and demonstrated these new archetypes in program-supporting fuel cycle transition scenarios. Both objectives were achieved. This report documents the results and deliverables obtained toward these achievements in detail.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Advanced Engine and Fuel Technologies Annual Progress Report (FY2019)

On behalf of the Vehicle Technologies Office of the U.S. Department of Energy, we are pleased to introduce the Fiscal Year (FY) 2019 Annual Progress Report for the Advanced Engine and Fuel Technologies Program. In support of the Vehicle Technology Office’s goal for future U.S. economic growth, the Program focuses on early-stage research and development to improve understanding of combustion processes, fuel properties, and emissions control technologies, generating knowledge and insight necessary for industry to cost-effectively develop the next generation of engines and fuels. One of the most promising and cost-effective approaches to improving the fuel economy of the U.S. vehicle fleet is to introduce the next generation of higher-efficiency, very-low-emission combustion engines that meet future federal emissions regulations into the passenger and commercial vehicle markets. Advanced fuel formulations that can incorporate non-petroleum-based blending agents could further enhance engine efficiency, reduce greenhouse gas emissions, and provide fuel diversification. Also, innovations in combustion, fuels, emissions control, air control, turbomachinery, and energy recovery could potentially increase fuel economy considerably compared to today’s vehicles. The expected national economic, environmental, and energy security benefits from these next-generation engines and fuels would be significant inasmuch as the majority of vehicles sold over the next several decades will still include an engine. The Program has set the following goals for passenger and commercial vehicle fuel economy improvements. By 2030, increase light-duty engine efficiency to demonstrate 35% improvement in passenger vehicle fuel economy (25% improvement from engine efficiency and 10% from fuel co-optimization) relative to a 2015 baseline vehicle, while meeting the U.S. Environmental Protection Agency Tier 3 Emission and Fuel Standards. By 2030, improve heavy-duty engine efficiency by 35% relative to a 2009 baseline vehicle and identify cost-effective high-performance fuels that can further increase efficiency up to an additional 4%, while meeting prevailing U.S. Environmental Protection Agency emissions standards. The Program utilized advanced combustion processes to increase engine efficiency, resulting in a modeled passenger vehicle fuel economy improvement of 19.4% (over a Model Year 2015 baseline) in FY 2019. This report highlights progress achieved by the Advanced Engine and Fuel Technologies Program during FY 2019. The nature, current focus, and recent progress of the Program are described together with summaries of National Laboratory, industry, and university projects that provide an overview of the exciting work being conducted to address critical technical barriers and challenges to commercializing the next generation of higher-efficiency engine, emissions control, and fuel technologies for passenger and commercial vehicles.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Yang_et_al_2020_Hydrology_Data

Data supporting the paper "Impact of climate change on adaptive management decisions in the face of water scarcity" in the Journal of Hydrology.

58 GEOSCIENCES↗
DOE OSTI2023

Architecture for Co-Simulation of Transportation and Distribution Systems with Electric Vehicle Charging at Scale in the San Francisco Bay Area

This work describes the Grid-Enhanced, Mobility-Integrated Network Infrastructures for Extreme Fast Charging (GEMINI) architecture for the co-simulation of distribution and transportation systems to evaluate EV charging impacts on electric distribution systems of a large metropolitan area and the surrounding rural regions with high fidelity. The current co-simulation is applied to Oakland and Alameda, California, and in future work will be extended to the full San Francisco Bay Area. It uses the HELICS co-simulation framework to enable parallel instances of vetted grid and transportation software programs to interact at every model timestep, allowing high-fidelity simulations at a large scale. This enables not only the impacts of electrified transportation systems across a larger interconnected collection of distribution feeders to be evaluated, but also the feedbacks between the two systems, such as through control systems, to be captured and compared. The findings are that with moderate passenger EV adoption rates, inverter controls combined with some distribution system hardware upgrades can maintain grid voltages within ANSI C.84 range A limits of 0.95 to 1.05 p.u. without smart charging. However, EV charging control may be required for higher levels of charging or to reduce grid upgrades, and this will be explored in future work.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Targeting the Bet-Hedging Strategy with an Inhibitor of Bacterial Efflux Capacity Enhances Antibiotic Efficiency and Ameliorates Bacterial Persistence In Vitro

Persistence is a bet-hedging strategy in bacterial populations that increases antibiotic tolerance and leads to the establishment of latent infections. In this study, we demonstrated that a synthetic non-toxic taxane-based reversal agent (tRA), developed as an inhibitor of ABC transporter systems in mammalian cancer cells, enhanced antibiotic killing of persister populations from different pathogens, including Burkholderia, Pseudomonas, Francisella, and Yersinia. Acting as an inhibitor of bacterial efflux at 100 nM, tRA99020 enhanced antibiotic efficiency and suppressed the production of natural products of Burkholderia species polyketide synthase (PKS) function. We demonstrate that the metabolites produced by PKS in response to stress by different antibiotics act as inhibitors of mammalian histone deacetylase activity and stimulate cell death. Applying a single-molecule fluorescence in situ hybridization (smFISH) assay, we analyzed on a single-cell level the activation profiles of the persistence regulating pks gene in Burkholderia thailandensis treated with tRA99020 and antibiotics. We posit that a multi-pronged approach encompassing antibiotic therapies and inhibition of efflux systems and fatty acid catabolism will be required for efficient eradication of persistent bacterial populations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Yeast Deletomics to Uncover Gadolinium Toxicity Targets and Resistance Mechanisms

Among the rare earth elements (REEs), a crucial group of metals for high-technologies. Gadolinium (Gd) is the only REE intentionally injected to human patients. The use of Gd-based contrasting agents for magnetic resonance imaging (MRI) is the primary route for Gd direct exposure and accumulation in humans. Consequently, aquatic environments are increasingly exposed to Gd due to its excretion through the urinary tract of patients following an MRI examination. The increasing number of reports mentioning Gd toxicity, notably originating from medical applications of Gd, necessitates an improved risk–benefit assessment of Gd utilizations. To go beyond toxicological studies, unravelling the mechanistic impact of Gd on humans and the ecosystem requires the use of genome-wide approaches. We used functional deletomics, a robust method relying on the screening of a knock-out mutant library of Saccharomyces cerevisiae exposed to toxic concentrations of Gd. The analysis of Gd-resistant and -sensitive mutants highlighted the cell wall, endosomes and the vacuolar compartment as cellular hotspots involved in the Gd response. Furthermore, we identified endocytosis and vesicular trafficking pathways (ESCRT) as well as sphingolipids homeostasis as playing pivotal roles mediating Gd toxicity. Finally, tens of yeast genes with human orthologs linked to renal dysfunction were identified as Gd-responsive. Therefore, the molecular and cellular pathways involved in Gd toxicity and detoxification uncovered in this study underline the pleotropic consequences of the increasing exposure to this strategic metal.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Integrated GW Farm ABM

This Data Repository includes data used for the integrated groundwater- farm ABM model, raw model output from scenario ensemble, and processed outputs that isolate the groundwater storage depletion outcomes for the 35,000 farm cells. Model Inputs: Farm ABM Inputs: This folder contains the input data used by the integrated groundwater - farm ABM modelling script (Python file) used for the high performance computing (HPC) experiments. The sub-folder "data inputs" contains all of the farm attribute data, while the three files in the folder have the hydrogeological data lookup table (NLDAS Cost Curve Attributes.csv), a lookup table (Theis well function table.csv) for the groundwater cost curve function, and the farm indexes and corresponding NLDAS ids for all of the cells run in this experiment (nldas farms subset final.csv). NLDAS Cost curve hydrogeological data: Hydrogeological data aggregated to 1/8 degree resolution and aligned with the NLDAS grid. Parameters include: water depth below ground surface [meters], subsurface porosity [unitless], aquifer depth from ground surface to aquifer bottom [meters], annual average recharge (USGS: mm, Doll: meters), and three different hydraulic conductivity (K) values (meters/day). The three K values represent the mean value from Gleeson et al. (2018), one standard deviation above the mean from Gleeson et al. (2018), and the de Graaf et al. 2020 modifications to certain lithologies. Additional information about these datasets and their processing are documented in the supplement to Yoon et al. 2025 (in review). Output: Raw outputs: This folder contains a .zip file that has model outputs for the entire scenario ensemble. There is one csv for each farm id, using the format "farm farmid cases.csv". The relationship between the farm id and NLDAS id is defined by the "nldas farms subset final.csv" located in the Farm ABM Inputs folder. Each csv has 625 rows, corresponding to 625 combinations of different scenario parameter values. Each row (scenario) represents the outcome of a 100 year simulation. Columns define scenario settings and summary statistics for each scenario. The first four columns define the scenario settings: "hydro ratio," "econ ratio," "K scenario," and "gamma scenario." The hydro and econ ratios are values passed to the modeling script that influence multipliers for other model parameters, as documented in the supplement to Yoon et al. 2025 (in review). The gamma multiplier is a coefficient multiplier applied to the baseline gamma values (values below 1 represent lower unobserved costs compared to baseline, values above 1 represent higher costs). The K scenario names represent K values of: "low": 0.5 m/d, "int 1": 2.5 m/d, "int 2": 10 m/d, "high": 50 m/d, and "gleeson": mean Gleeson K value. "Perc vol depleted" is the fraction of groundwater depleted at the end of the 100 simulation. Processed Output: Derived depletion outcomes from raw outputs: All of the individual csv files from the Raw outputs were aggregated into a single file that has the scenario settings and fraction depletion "Perc vol depleted" for every farm cell, for every scenario. The other two files define relationships between the farm id, NLDAS id, and local and major aquifer units, used for aquifer-level depletion analysis.

Agent based modeling↗
DOE OSTI2020

Modeling Market Interactions

This slide deck provides a high-level overview of wholesale electricity market design model development activities occurring at NREL. The motivation for this work, as well as the broader NREL modeling landscape in which it belongs, is first presented. Then the various model formulations and features are described.

agent-based simulation↗
DOE OSTI2020

Open Source dGen: Beta Release

This presentation provides an update on the dGen beta release as it approaches the full release in September 2020. The presentation includes the open source approach, updates for the open source, a dGen setup and demo, and the road map for the full release and upcoming reports.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2021

Distributed Solar and Storage Adoption Modeling

The National Renewable Energy Laboratory (NREL) is analyzing the rapidly increasing role of energy storage in the electrical grid through 2050 through its Storage Futures Study. In one phase of the study, NREL used the laboratory's Distributed Generation Market (dGen) model to examine the various future distributed storage capacity adoption scenarios, results, and implications.

agent-based modeling↗
DOE OSTI2022

Eagle Behavior and Risk Modeling for Wind Energy Webinar

NREL presents recent progress in the development and validation of new eagle behavioral models, highlighting applications for wind-plant siting and operations. This webinar features talks focused on three areas: atmospheric modeling across the spatiotemporal scales of interest, facility-scale behavioral modeling, and turbine-scale data-driven behavioral modeling. A final presentation demonstrates micrositing as an application of our completely open-source analysis framework.

agent-based movement model↗
DOE OSTI2024

Multi-Agent Graph-Attention Deep Reinforcement Learning for Post-Contingency Grid Emergency Voltage Control

Grid emergency voltage control (GEVC) is paramount in electric power systems to improve voltage stability and prevent cascading outages and blackouts in case of contingencies. While most deep reinforcement learning (DRL)-based paradigms perform single agents in a static environment, real-world agents for GEVC are expected to cooperate in a dynamically shifting grid. Moreover, due to high uncertainties from combinatory natures of various contingencies and load consumption, along with the complexity of dynamic grid operation, the data efficiency and control performance of the existing DRL-based methods are challenged. To address these limitations, we propose a multi-agent graph-attention (GATT)-based DRL algorithm for GEVC in multi-area power systems. Here, we develop graph convolutional network (GCN)-based agents for feature representation of the graph-structured voltages to improve the decision accuracy in a data-efficient manner. Furthermore, a cutting-edge attention mechanism concentrates on effective information sharing among multiple agents, synergizing different-sized subnetworks in the grid for cooperative learning. We address several key challenges in the existing DRL-based GEVC approaches, including low scalability and poor stability against high uncertainties. Test results in the IEEE benchmark system verify the advantages of the proposed method over several recent multi-agent DRL-based algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Optimizing Traffic Signal Control to Enhance Transportation Efficiency and Maximize Pedestrian Benefits in the Road Network

Increasing urban mobility requirements demand efficient transportation system strategies for both vehicular and pedestrian movement. This study enhances the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) approach, originally tailored for vehicular traffic signal timing, to incorporate pedestrian traffic dynamics. The improved algorithm considers crucial metrics such as Eco_PI, assesses vehicle fuel consumption by factoring in stops and delays, and addresses pedestrian waiting time, crucial for system efficiency while acknowledging driver waiting time impact. Utilizing Digital Twin simulation along the MLK Smart Corridor in Chattanooga, Tennessee, the algorithm's performance is compared for various pedestrian control scenarios. To evaluate the effectiveness of DGMARL, this study compared DGMARL-enabled signal management with automated pedestrian traffic detection and an actuated signal management system (real-word baseline) with pedestrian recall, which predetermingly enforces a pedestrian phase every cycle. Findings indicate substantial improvements with DGMARL, showing a 28.29% enhancement in vehicle Eco_PI, a 60.55 % reduction in pedestrian waiting time, and a 55.74% decrease in driver stop delay, on average, compared to the baseline actuated signal timing plan.

Kumarasamy, Vijayalakshmi K [The University of Ten↗
DOE OSTI2023

Traffic Signal Optimization by Integrating Reinforcement Learning and Digital Twins

Machine learning (ML) methods, especially reinforcement learning (RL), have been widely considered for traffic signal optimization in intelligent transportation systems. Most of these ML methods are centralized, lacking in scalability and adaptability in large traffic networks. Further, it is challenging to train such ML models due to the lack of training platforms and/or the cost of deploying and training in a real traffic networks. This paper presents an approach for the integration of decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin (DT) to optimize traffic signals for the reduction of traffic congestion and network-wide fuel consumption related to stopping. Specifically, the DGMARL agents learn traffic state patterns and make decisions regarding traffic signal control with assistance from a Digital Twin module, which simulates and replicates the traffic behaviors of a real traffic network. The proposed approach was evaluated using PTV-Vissim [1], a microscopic traffic simulation platform. PTV-Vissim is also the simulation engine of the DT, enabling emulation and optimization of the traffic signals on the MLK Smart Corridor in Chattanooga, Tennessee. Compared to an actuated signal control baseline approach, experiment results show that Eco_PI, a developed performance measure capturing the impact of stops on fuel consumption, was reduced by 44.27% in a 24-hour and an average of 29.88% in a PM-peak-hour scenario.

Multi-Agent Reinforcement Learning, Digital Twin, ↗
DOE OSTI2024

Influence of Carboxymethyl Cellulose as a Thickening Agent for Glauber’s Salt-Based Low Temperature PCM

This work is focused on a novel, promising low temperature phase change material (PCM), based on the eutectic Glauber’s salt composition. To allow phase transition within the refrigeration range of temperatures of +5 °C to +12 °C, combined with a high repeatability of melting–freezing processes, and minimized subcooling, the application of three variants of sodium carboxymethyl cellulose (Na-CMC) with distinct molecular weights (700,000, 250,000, and 90,000) is considered. The primary objective is to optimize the stabilization of this eutectic PCM formulation, while maintaining the desired enthalpy level. Preparation methods are refined to ensure repeatability in mixing components, thereby optimizing performance and stability. Additionally, the influence of Na-CMC molecular weight on stabilization is examined through differential scanning calorimetry (DSC), T-history, and rheology tests. The PCM formulation of interest builds upon prior research in which borax, ammonium chloride, and potassium chloride were used as additives to sodium sulfate decahydrate (Glauber’s salt), prioritizing environmentally responsible materials. The results reveal that CMC with molecular weights of 250 kg/mol and 90 kg/mol effectively stabilize the PCM without phase separation issues, slowing crystallization kinetics. Conversely, CMC of 700 kg/mol proved ineffective due to the disruption of gel formation at its low gel point, hindering higher concentrations. Calculations of ionic concentration indicate higher Na ion content in PCM stabilized with 90 kg/mol CMC, suggesting increased ionic interactions and gel strength. A tradeoff is discovered between the faster crystallization in lower molecular weight CMC and the higher concentration required, which increases the amount of inert material that does not participate in the phase transition. After thermal cycling, the best formulation had a latent heat of 130 J/g with no supercooling, demonstrating excellent performance. This work advances PCM’s reliability as a thermal energy storage solution for diverse applications and highlights the complex relationship between Na-CMC molecular weight and PCM stabilization.

25 ENERGY STORAGE↗