Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Developing Microalgae-Based Non-Isocyanate Polyurethane Foam Materials

Polyurethane is a versatile material with a wide range of applications in the production of foam products such as car seats, mattresses, footwear, insulation foam, and more. The traditional process for producing polyurethane foam involves the fast reaction of isocyanate with water, which generates CO2 as a blowing agent. However, the use of isocyanate has raised concerns due to its potential for causing allergic reactions and aspiration symptoms. This has led to increased regulation of isocyanate, leading to a growing interest in developing alternatives. Non-isocyanate polyurethane (NIPU) has emerged as a promising alternative to traditional toxic PU production. The most promising approach for producing NIPU is the aminolysis of cyclic carbonate with diamine. The NIPU produced through this process has a polyhydroxyurethane structure, which is similar to traditional PU chemistry. We have demonstrated that microalgal oil is a favored feedstock, as it can provide high reactivity for industrial applications. However, the NIPU production process does not generate gas, and a blowing agent is required to achieve the desired foam structure. One of the challenges in producing NIPU foam is to match the bubble formation and curing rates. We have developed a novel approach to producing NIPU foam that utilizes carbamate as a bifunctional blowing and crosslinking agent. We have used vegetable oil and microalgal oil as feedstocks to produce various NIPU for characterization. The development of microalgal NIPU provides an exciting opportunity for reducing the environmental impact of foam production and improving the safety of the materials used in the production process. The production of value-added NIPU foam can also drive down the cost of microalgal biorefinery, advancing the commercialization of microalgal biofuel.

algae↗
DOE OSTI2025

National Modeling of Geothermal District Energy Systems with Ambient-Temperature Loops Using dGeo

Geothermal district energy systems (DES) with ambient-temperature loops, also known as thermal energy networks, are one option for decarbonizing space heating and cooling loads. Geothermal fifth-generation DES include an "ambient" temperature thermal loop that connects heat pumps at each building with thermal balancing sources such as geothermal borehole fields. Heating and cooling are provided via a water-source heat pump at each end-user. This project seeks to analyze the nationwide potential for ambient-temperature loop districts by creating a new module within the Distributed Geothermal Market Demand Model (dGeo). dGeo is an agent-based modeling tool for distributed geothermal resources; it can investigate potential on a nationwide or statewide scale using geospatial data for all 50 states and thermal demands for existing buildings. This process allows for high-level estimates of technical and economic potential for ambient-temperature loop districts across the United States. A lookup table was created using GHEDesigner to size borehole fields for different thermal loads and ground conditions experienced across the country. A cost and financing structure, along with incentives, were applied. Cost estimates include costs for the distribution network, borehole field installation and operation, and circulation pump operation, while savings are calculated based on energy bills for building owners (agents). This newly developed module can be used for assessing which areas of the country have the highest potential for agent benefits from ambient-temperature loop installation and assess the impact of future cost and price scenarios. Initial results for statewide analysis (for Vermont) and nationwide (for United States) are provided. Future work includes expanding the module to consider mixed residential and commercial districts as well as evaluating multiple cost scenarios.

ambient-temperature loop↗
DOE OSTI2026

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider

High-throughput scientific facilities such as the Large Hadron Collider depend on real-time event filtering (\textit{triggering}) under tight constraints on bandwidth, latency, and storage. In practice, trigger menus are largely static and hand-tuned and can become suboptimal as detector conditions, pileup, and background composition drift over time. We cast online threshold tuning as a sequential decision-making problem: a reinforcement learning agent ingests streaming summaries of recent rates and signal-sensitive features and updates trigger thresholds to maximize signal efficiency while tracking a target background rate within a tolerance band. We adapt Group-Filtered Policy Optimization (GFPO) to streaming control and introduce two variants (GFPO-F, GFPO-FR) that enforce background rate feasibility during training. On a benchmark that emulates realistic collider operation, we study two representative triggers: a total transverse energy ($H_{T}$) trigger sensitive to pileup variation, and an anomaly-detection (AD) trigger based on reconstruction loss for rare or non-standard signatures. On Monte Carlo streams, our agent increases the fraction of in-tolerance time intervals by 48% ($H_T$) and 28% (AD), with a cumulative gain of up to 2% in signal efficiency on those in-tolerance intervals. Transferring from simulation to \emph{real} collision data (CMS Run 283408), the same agent, without fine-tuning, achieves a 56% ($H_T$) and 28% (AD) in-tolerance improvement over baselines, with further signal-efficiency gain on both triggers. To our knowledge, this is the \emph{first} demonstration of RL-based trigger control on real Large Hadron Collider collision data. Code is available at https://github.com/Zixind/GFPO_LHC (see repo for details).

Ding, Zixin [Chicago U.]↗
DOE OSTI2026

A Physics-Informed Reinforcement Learning Framework for Economic-Thermal Co-Optimization of Crypto Mining Data Centers: Preprint

The rapid expansion of cryptocurrency mining has created a new class of high-density data centers characterized by extreme thermal flux and high sensitivity to volatile economic markets. Traditional thermal management strategies, typically reliant on rule-based control, maintain static setpoints that fail to account for fluctuating electricity prices and cryptocurrency values - factors critical to mining profitability. To address this, we present a physics-informed reinforcement learning (PIRL) framework for economic-thermal co-optimization in crypto mining data centers. This framework consists of a proximal policy optimization (PPO) agent, a virtual testbed powered by high-fidelity physics-based models, and an interactive frontend dashboard. The PPO agent is trained using the virtual testbed and strict hardware safety limits. This physics-informed approach allows the agent to learn a stochastic policy that dynamically balances mining revenue against operational costs by co-optimizing HVAC cooling setpoints and IT computational hashrate. The simulation results demonstrate that the integrated framework achieved an 8.62% increase in net operational profit compared to traditional baseline strategies while strictly adhering to safety-critical temperature constraints (coolant supply temperature < 32 degrees C). This work provides a scalable template for the deployment of reinforcement learning in mission critical facilities where economic volatility and physical safety must be managed simultaneously.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

dGen (Distributed Generation Market Demand) Model Data: Alpha Release

Open sourced data needed to run the basic alpha release version of the dGen model. Includes a pre-generated agent file of 100,000 agents in pickle file format along with the base schema and table data in parquet format that are needed to create a postgreSQL database for the model to interact with.

14 SOLAR ENERGY↗
DOE OSTI2025

Enhanced Interfacial Strength in Carbon Fiber Composites via Mussel‐Inspired Sizing Polymers

Composite materials possess a high strength-to-weight ratio. A key determinant of their mechanical performance is the interfacial strength between the fibers and the matrix. Sizing agents are commonly used to improve this interface by promoting better adhesion, though optimizing this interaction remains a significant challenge. Here, this study evaluates the use of poly(catechol-styrene) (PCS), a mussel-inspired sizing agent, to enhance fiber–matrix bonding in carbon fiber composites. Woven carbon fiber laminates were dip-coated with varying concentrations of PCS (0.05 and 0.1 wt%) and subsequently fabricated using vacuum-assisted resin transfer molding followed by compression molding. Interlaminar shear strength (ILSS) tests showed improvements of 4% and 8% for the 0.05% and 0.1% PCS treatments, respectively. These results indicate that PCS is effective in reinforcing interfacial adhesion, thereby improving the mechanical integrity of carbon fiber-reinforced composites.

Carbon fiber composites↗
DOE OSTI2026

Optimal CO 2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: A Markov game perspective

Geological carbon storage (GCS) projects could involve a diverse array of stakeholders or players from public, private, and regulatory sectors, each with different objectives and responsibilities. Given the complexity, scale, and long-term nature of GCS operations, determining whether individual stakeholders can independently optimize their interests — or whether collaborative coalition agreements are needed — remains a central question for effective GCS project planning and management. To access large, high-quality storage resources, future GCS deployment may increasingly occur in geologically connected sites, where shared geological features such as pressure space and reservoir pore capacity can lead to competitive behavior among stakeholders. In this work, we propose a paradigm based on Markov games to quantitatively investigate how different coalition structures affect the goals of stakeholders. We frame this multi-stakeholder multi-site problem as a multi-agent reinforcement learning problem with safety constraints. Our approach enables agents to learn optimal strategies while complying with safety regulations. We present an example where multiple operators are injecting CO 2 into their respective project areas in a geologically connected basin. To address the high computational cost of repeated simulations of high fidelity models, a previously developed surrogate model based on the Embed-to-Control (E2C) framework is employed. Our results demonstrate the effectiveness of the proposed framework in addressing optimal management of CO 2 storage when multiple stakeholders with different objectives and goals are involved.

58 GEOSCIENCES↗
DOE OSTI2020

A Repositioning Method for Shared Autonomous Vehicles Operation

Shared fully-automated, or autonomous, mobility (SAVs) is anticipated to be the likely choice for future urban travel. SAVs boast many operational benefits but will add congestion in the form of unoccupied miles. The fleet's success further depends on service measures like the wait times for pickup trips. Agent-based simulation tools have closely looked at SAV operations but typically lack the integration between the supply and demand sides when simulating a population at scale. This paper focuses on the impact of SAV relocation on traveler wait times using a novel algorithm for repositioning. POLARIS, an agent-based tool, is used for a case study of Bloomington, Illinois to quantify the benefits of allowing SAV repositioning. On average, the wait times were lower with repositioning for all adequate fleet sizes. SAVs were available more uniformly across the region's zones, and proportional to trip-making at different times of day. In addition, with repositioning enable a higher share of demands were served. Finally, the increase in empty fleet miles from SAV repositioning may be justified with more trips being served, and an overall improvement in SAV wait times. (C) 2020 The Authors. Published by Elsevier B.V.

Agent-Based Simulation↗
DOE OSTI2026

Comparing Delay-, Distance-, and Cordon-Based Congestion Pricing Strategies Via Large-Scale Simulation

This study compares the impacts of delay-, distance-, and cordon-based congestion pricing strategies for Austin, Texas, using the POLARIS agent-based activity-based travel demand simulation model. This approach enables agent-level heterogeneity and realistic choice options (including destination, mode, and activity scheduling) for dynamic traffic assignment and congestion feedbacks across a major metro region, which are features lacking in past work. To ensure comparability, distance-based tolls were set to generate the same revenue as delay-based tolling of $3.5 M/day, averaging $1.17/resident/day or $0.42/vehicle-trip. Delay-based pricing delivers 44% lower network delay and 13% lower VHT compared to the no-toll baseline, levels unmatched by other pricing strategies. At the height of the AM peak, drivers pay up to $0.13/mile on average, though most links in the network remain untolled. Distance-based pricing is the most effective at reducing VMT (by 4%), but VHT reductions (of 6%) primarily stem from drivers selecting closer destinations, achieving only one-fourth the delay reduction of delay-based pricing. Across various implementations of delay- and distance-based pricing, the results suggest that spatial variations of tolls are far more important than temporal variations. Cordon tolls produce minimal impacts at the network-wide level, but offer substantial delay reductions inside the cordon. Other major findings include: 1) delay-based pricing increases trip-making during the PM peak period due to backward shifts in discretionary-activity start times by higher-income residents; and 2) tolls’ spatial impacts, including changes in network flows and tolls paid by residents, vary substantially between delay- and distance-based pricing strategies.

Agent-based modeling↗
DOE OSTI2025

SWARM: Reimagining scientific workflow management systems in a distributed world

Modern scientific workflows process massive amounts of data from diverse instruments and sensors, leveraging geographically distributed, heterogeneous compute and storage resources—from leadership-class systems to edge devices—connected by high-performance networks. The diversity of resources introduces challenges in harnessing their full potential, with resilience issues arising across applications, system software, networks, storage, and hardware. Today, workflow management systems (WMS) coordinate the execution of computation and data management tasks across target resources. However, WMS’s centralized nature makes them vulnerable to faults and scalability issues that may result in failures of entire computational campaigns. In conclusion, this paper introduces a novel agentic framework for workflow management, fully distributing and decentralizing the WMS functions and modeling them as swarm intelligence agents infused with advanced artificial intelligence solutions and traditional distributed computing algorithms that can make coordinated decisions in the presence of failures of the underlying cyberinfrastructure.

Swarm intelligence↗
DOE OSTI2020

Model Exploration of an Information-Based Healthcare Intervention Using Parallelization and Active Learning

This paper describes the application of a large-scale active learning method to characterize the parameter space of a computational agent-based model developed to investigate the impact of CommunityRx, a clinical information-based health intervention that provides patients with personalized information about local community resources to meet basic and self-care needs. Additionally, the diffusion of information about community resources and their use is modeled via networked interactions and their subsequent effect on agents' use of community resources across an urban population. A random forest model is iteratively fitted to model evaluations to characterize the model parameter space with respect to observed empirical data. We demonstrate the feasibility of using high-performance computing and active learning model exploration techniques to characterize large parameter spaces; by partitioning the parameter space into potentially viable and non-viable regions, we rule out regions of space where simulation output is implausible to observed empirical data. We argue that such methods are necessary to enable model exploration in complex computational models that incorporate increasingly available micro-level behavior data. We provide public access to the model and high-performance computing experimentation code.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Generating Mixed Patterns of Residential Segregation: An Evolutionary Approach

The Schelling model of residential segregation has demonstrated that even the slightest preference for neighbors of the same race can be amplified into community-wide segregation. However, these models are unable to simulate mixed, coexisting patterns of segregation and integration, which have been seen to exist in cities. Using evolutionary model discovery we demonstrate how including social factors beyond racial bias when modeling relocation behavior enables the emergence of strongly mixed patterns. Our results indicate that the emergence of mixed patterns is better explained by multiple factors influencing the decision to relocate; the most important being the interaction of nonlinear, rapidly diminishing racial bias with a recent, historical tendency to move. Additionally, preference for less isolated neighborhoods or preference for neighborhoods with longer residing neighbors may produce weaker mixed patterns. Finally, this work highlights the importance of exploring the influence of multiple hypothesized factors of decision making, and their interactions, within agent rules, when studying emergent outcomes generated by agent-based models of complex social systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Distributed Solar Adoption in Orlando: A Household-Level Model for Distribution Resource Planning

Potential for rooftop solar in Florida is massive (47% of retail sales, 3rd overall nationally), yet adoption lags (12th nationally). A 2018 Florida Public Service Commission ruling authorizing solar third-party ownership (leasing) has substantially increased attention on distributed solar in the state. The city of Orlando has committed to a 100% clean-energy target by 2050 and deployment of solar and storage are expected to contribute significantly to reaching the goal. Deployment of customer-adopted solar, unlike utility-procured solar, is uncertain, but known to be spatially correlated with demographic factors and existing adoption. We develop a new method to adapt NREL's dGen model in order to represent building-level agents in adoption forecasts for the Orlando Utility Commission (OUC) service territory. Using the agent-based model we develop projections of solar adoption, subject to scenarios varying future solar costs and valuation, and aggregate adoption predictions by OUC distribution feeder. We find substantial spatial heterogeneity in the projected level of adoption by OUC distribution feeder. For instance, 25% of all projected adoption through 2050 would be concentrated on just 5% of feeders and 88% of projected adoption on 50% of feeders. Because of the uncertainty in adoption, bottoms-up solar adoption forecasting methods at the household-level are integral to long-term resource planning by anticipating system needs as customers increasingly adopt distributed solar, storage, electric vehicles, and other distributed energy resources.

14 SOLAR ENERGY↗
DOE OSTI2024

Photocatalytic Generation of Singlet Oxygen by Graphitic Carbon Nitride for Antibacterial Applications

Carbon-based functional nanocomposites have emerged as potent antimicrobial agents and can be exploited as a viable option to overcome antibiotic resistance of bacterial strains. In the present study, graphitic carbon nitride nanosheets are prepared by controlled calcination of urea. Spectroscopic measurements show that the nanosheets consist of abundant carbonyl groups and exhibit apparent photocatalytic activity under UV photoirradiation towards the selective production of singlet oxygen. Therefore, the nanosheets can effectively damage the bacterial cell membranes and inhibit the growth of bacterial cells, such as Gram-negative Escherichia coli, as confirmed in photodynamic, fluorescence microscopy, and scanning electron microscopy measurements. The results from this research highlight the unique potential of carbon nitride derivatives as potent antimicrobial agents.

36 MATERIALS SCIENCE↗
NASA NTRS2021

Inertial Transfer Concept for Autonomous In-Space Assembly

Rocket payload and fairing size have placed strict mass and volume limitations on single launch in-space structures. These limitations are what motivates In-Space Assembly (ISA) and where Inertial Transfer has potential to improve or augment ISA capabilities by utilizing a multiagent autonomous system to transport untethered payloads. The Inertial Transfer concept is presented including autonomy capabilities, potential risks, and three system configurations. These configurations are based on the autonomous system’s available sensor coverage that tracks the payload’s state. Participating agents have well-defined roles, expectations, and assumptions in their physical organization and coordination of actions depending the mode of operation. The sensor information available to participating agents is considered as it affects the uncertainty in the estimated state and the actions required to capture the payload.

Multi-Agent↗
NASA NTRS2024

An On-Board Off-Board Framework for Online Replanning: Applied to UAVs in Urban Environments

Autonomous systems are being used in a multitude of areas at an increasing rate and require a high level of adaptivity and intelligence to operate safely, especially under faulty conditions. This paper introduces a novel genetic algorithm tailored for UAV trajectory replanning, with an improved execution time via search space reduction based on the operating conditions of the UAV and its remaining mission. A unique characteristic of the replanning agent is its fast-start and adaptive properties, pre-seeding candidates with partial solutions and dynamically tuning elitism, crossover, and mutation rates in correspondence to the average fitness and diversity of the population. A population restart mechanism and early stopping mechanism are evaluated as well to assess their effect on solution quality and runtime. Previous work on genetic algorithms for UAV replanning were conducted with short trajectories in a small state space. Our UAV operates in a 56,000 square meter simulated urban environment, with static obstacles and a total of 53 possible waypoints. The agent increases the safety and reliability of UAV autonomy when operating under faulty conditions and when replanning is required.

Machine Learning↗