Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) for Transportation Hubs (Final Report)

This report summarizes the work performed under the award number EE0008524. The project develops the Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) platform as the next-generation transportation solution based on autonomous electric vehicles (AEV) serving passenger trips from and to urban transportation hubs, to substantially reduce transportation energy consumption. Extensive data collection and analyses were first conducted to understand the demand patterns and energy consumption of hub-based on-road trips. Then, a data-driven framework that consists of an analytical module and a simulation module was proposed. For the analytical module, five planning + operation tools were developed to support the planning and energy-efficient operations of urban AEV services: the charging station planning that robotically allocates charging supplies based on the stationary charging demand distribution; the transit planning and demand adaptive scheduling model that efficiently generates\ candidate transit routes from hubs to other places and dynamically adjusts the transit time table to fit the current demand; the online energy-efficient routing that learns the energy-optimal paths from observations of link-level energy consumption in real-time; the hub-based ridesharing that matches trip requests together with account for the uncertainty of future trip demand and vehicle supply; and finally, the integrated demand prediction and anomaly detection pipeline that leverages the flight/train time table and support other planning/operation tools. To demonstrate the performance of these tools, a scalable high-performance agent-based simulator was built. We divided the urban space into multiple service zones where each zone was considered as an agent for passenger generation and vehicle charging. Two types of AEV agents were coded to model two types of mobility services: AEV taxi and AEV transit. For the AEV taxi, the team implemented the functions of pickup/drop-off passengers, energy-efficient routing, ridesharing, fleet rebalancing, and recharging. For the AEV bus, the team implemented the functions of demand-adaptive route scheduling, passenger boarding, and recharging. A high-performance computing framework was introduced to receive various profiling information (such as link energy updates, vehicle speed) from the simulator instances and communicate the operational commands back to the instances. The numerical experiments show that each of the proposed operational algorithms can reduce energy consumption and improve system efficiency. Furthermore, there exists the need to collectively consider multiple planning + operational strategies as multiple strategies can influence each other in terms of performance impacts. Recommendations for future work related to AEV planning and simulation are discussed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Moving the needle: Employing deep reinforcement learning to push the boundaries of coarse-grained vaccine models

Highly mutable infectious disease pathogens (hm-IDPs) such as HIV and influenza evolve faster than the human immune system can contain them, allowing them to circumvent traditional vaccination approaches and causing over one million deaths annually. Agent-based models can be used to simulate the complex interactions that occur between immune cells and hm-IDP-like proteins (antigens) during affinity maturation—the process by which antibodies evolve. Compared to existing experimental approaches, agent-based models offer a safe, low-cost, and rapid route to study the immune response to vaccines spanning a wide range of design variables. However, the highly stochastic nature of affinity maturation and vast sequence space of hm-IDPs render brute force searches intractable for exploring all pertinent vaccine design variables and the subset of immunization protocols encompassed therein. To address this challenge, we employed deep reinforcement learning to drive a recently developed agent-based model of affinity maturation to focus sampling on immunization protocols with greater potential to improve the chosen metrics of protection, namely the broadly neutralizing antibody (bnAb) titers or fraction of bnAbs produced. Using this approach, we were able to coarse-grain a wide range of vaccine design variables and explore the relevant design space. Our work offers new testable insights into how vaccines should be formulated to maximize protective immune responses to hm-IDPs and how they can be minimally tailored to account for major sources of heterogeneity in human immune responses and various socioeconomic factors. Our results indicate that the first 3 to 5 immunizations, depending on the metric of protection, should be specially tailored to achieve a robust protective immune response, but that beyond this point further immunizations require only subtle changes in formulation to sustain a durable bnAb response.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2002

Continual coordination of shared activities

Interacting agents that interleave planning and execution must reach consensus on their commitments to each other. For domains with varying degrees of interaction and different constraints on communication and computation, agents will require different coordination protocols in order to efficiently achieve their goals. ShAC (Shared Activity Coordination) is a framework for designing coordination protocols and an algorithm for continually coordinating agents using these protocols during execution. We show how a variety of protocols can be constructed using this framework and describe how ShAC coordinates two rovers and an orbiter in a simulated Mars scenario.

multiple agents coordination planning scheduling M↗
NASA NTRS2021

Inertial Transfer Concept for Autonomous In-Space Assembly

Rocket payload and fairing size have placed strict mass and volume limitations on single launch in-space structures. These limitations are what motivates In-Space Assembly (ISA)and where Inertial Transfer has potential to improve or augment ISA capabilities by utilizing an efficient multi-agent autonomous system to transport untethered payloads. Adoption of an inertial transfer approach significantly reduces system complexity, energy and time needed for assembly compared to conventional ISA capabilities, increasing the likelihood of early adoption for assembly. The Inertial Transfer concept is presented including autonomy capabilities, potential risks, and three system configurations. These configurations are based on the autonomous system’s available sensor coverage that tracks the payload’s state. Participating agents have well-defined roles, expectations, and assumptions in their physical organization and coordination of actions depending the mode of operation. The sensor information available to participating agents is considered as it affects the uncertainty in the estimated state and theactions required to capture the payload.

Multi-Agent↗
NASA NTRSDate not supplied

Impact of Traffic-Following on Order of Autonomous Airspace Operations

In this paper, we investigate the dynamic emergence of traffic order in a distributed multi-agent system, aiming to minimize inefficiencies that stem from unnecessary structural impositions. We introduce a methodology for developing a dynamically updating traffic pattern map of the airspace by leveraging information about the consistency and frequency of flow directions used by current as well as preceding traffic. Informed by this map, an agent can discern the degree to which it is advantageous to follow traffic by trading off utilities such as time and order. We show that for the traffic levels studied, for low degrees of traffic-following behavior, there is minimal penalty in terms of aircraft travel times while improving the overall orderliness of the airspace. On the other hand, heightened traffic-following behavior may result in increased aircraft travel times, while marginally reducing the overall entropy of the airspace. Ultimately, the methods and metrics presented in this paper can be used to optimally and dynamically adjust an agent’s traffic-following behavior based on these trade-offs.

Airspace Operations↗
NASA NTRSDate not supplied

Impact of Traffic-Following on Order of Autonomous Airspace Operations

We investigate the dynamic emergence of traffic order in a distributed multi-agent system, aiming to minimize inefficiencies that stem from unnecessary structural impositions. We introduce a methodology for developing a dynamically updating traffic pattern map of the airspace by leveraging information about the consistency and frequency of flow directions used by current as well as preceding traffic. Informed by this map, an agent can discern the degree to which it is advantageous to follow traffic by trading off utilities such as time and order. We show that for the traffic levels studied, for low degrees of traffic-following behavior, there is minimal penalty in terms of aircraft travel times while improving the overall orderliness of the airspace. On the other hand, heightened traffic-following behavior may result in increased aircraft travel times, while marginally reducing the overall entropy of the airspace. Ultimately, the methods and metrics presented in this paper can be used to optimally and dynamically adjust an agent’s traffic-following behavior based on these trade-offs.

Airspace Operations↗
DOE OSTI2021

Exploring PV Circularity by Modeling Socio-Technical Dynamics of Modules' End-of-Life Management: Preprint

The circular economy (CE) tackles environmental and resource scarcity issues by maximizing value retention in the economy. The concept implies design strategies such as reducing the use of materials or improving products’ durability and end-of-life (EOL) strategies such as reusing products and components and recycling materials. With an estimated 80 million tons of global cumulative EOL photovoltaic (PV) modules, applying CE principles to the PV industry could alleviate resource scarcity issues while also providing economic benefits. However, transitioning to a CE may imply changes in organizations and consumer behaviors. In this context, assessment of CE strategies may require accounting for behavioral change, a requirement that methods from complex system science such as agent-based modeling meet. Thus, this paper uses an agent-based modeling (ABM) approach to study circularity in the photovoltaics supply chain. Four types of agents are represented in the ABM: PV owners, installers, recyclers, and manufacturers. Moreover, five possible EOL options – including three CE strategies – are modeled. Departing from traditional techno-economic analysis, the model includes techno-economic factors as well as social factors to model EOL management decisions. Results show that each dollar decrease in the recycling fees improves the recycling rate by roughly 1.1%. However, excluding social factors underestimates the effect that lower recycling prices have on material circularity.

28 EE - Advanced Manufacturing Office (EE-5A)↗
DOE OSTI2022

A Reactive Inkjet Printing Process for Fabricating Biodegradable Conductive Zinc Structures

A novel reactive inkjet printing (RIJ) process for fabricating environmentally benign, conductive zinc structures on biodegradable substrates is reported. A precursor consisting of oxidized zinc microparticles is formulated into a viscous ink for high‐resolution, high‐repeatability screen printing. A single RIJ process is performed to selectively dispense an acid‐based oxide etching agent onto the screen‐printed zinc ink to significantly improve its electrical conductivity, up to 4 × 10 4 S m −1 . The RIJ process enables precise control of the amount of deposited etching agent, allowing control of conductivity and avoiding damage caused by excessive acid exposure. The RIJ process deposits the etching agent selectively on the screen‐printed, water‐soluble zinc patterns, thus preserving the print fidelity by avoiding ink smearing that can occur when using a blanket treatment such as submersion. A printed biodegradable antenna with a minimum feature size of 500 μm for use with a batteryless radio frequency identification (RFID) chip is fabricated as demonstration. Due to the higher ink conductivity and improved pattern fidelity, the antenna fabricated by the RIJ process shows a ≈2.2× increase in reading distance compared with a similar antenna that is screen printed and activated using a drop‐casting process.

Sui, Yongkun↗
DOE OSTI2020

Application of multidimensional structural characterization to detect and describe moderate forest disturbance

The study of vegetation community and structural change has been central to ecology for over a century, yet the ways in which disturbances reshape the physical structure of forest canopies remain relatively unknown. Moderate severity disturbances affect different canopy strata and plant species, resulting in variable structural outcomes and ecological consequences. Terrestrial lidar (light detection and ranging) offers an unprecedented view of the interior arrangement and distribution of canopy elements, permitting the derivation of multidimensional measures of canopy structure that describe several canopy structural traits (CSTs) with known links to ecosystem function. We used lidar-derived CSTs within a machine learning framework to detect and describe the structural changes that result from various disturbance agents, including moderate severity fire, ice storm damage, age-related senescence, hemlock woolly adelgid, beech bark disease, and chronic acidification. We found that fire and ice storms primarily affected the amount and position of vegetation within canopies, while acidification, senescence, pathogen, and insect infestation altered canopy arrangement and complexity. Only two of the six disturbance agents significantly reduced leaf area, counter to common assumptions regarding many moderate severity disturbances. While findings are limited in their generalizability due to lack of replication among disturbances, they do suggest that the current limitations of standard disturbance detection methods—such as optical-based remote sensing platforms, which are often above-canopy perspectives—limit our ability to understand the full ecological and structural impacts of disturbance, and to evaluate the consistency of structural patterns within and among disturbance agents. A more broadly inclusive definition of ecological disturbance that incorporates multiple aspects of canopy structural change may potentially improve the modeling, detection, and prediction of functional implications of moderate severity disturbance as well as broaden our understanding of the ecological impacts of disturbance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Self‐gated, dynamic contrast‐enhanced magnetic resonance imaging with compressed‐sensing reconstruction for evaluating endothelial permeability in the aortic root of atherosclerotic mice

High‐risk atherosclerotic plaques are characterized by active inflammation and abundant leaky microvessels. We present a self‐gated, dynamic contrast‐enhanced magnetic resonance imaging (DCE‐MRI) acquisition with compressed sensing reconstruction and apply it to assess longitudinal changes in endothelial permeability in the aortic root of Apoe −/− atherosclerotic mice during natural disease progression. Twenty‐four, 8‐week‐old, female Apoe −/− mice were divided into four groups (n = 6 each) and imaged with self‐gated DCE‐MRI at 4, 8, 12, and 16 weeks after high‐fat diet initiation, and then euthanized for CD68 immunohistochemistry for macrophages. Eight additional mice were kept on a high‐fat diet and imaged longitudinally at the same time points. Aortic‐root pseudo‐concentration curves were analyzed using a validated piecewise linear model. Contrast agent wash‐in and washout slopes ( b 1 and b 2 ) were measured as surrogates of aortic root endothelial permeability and compared with macrophage density by immunohistochemistry. b 2 , indicating contrast agent washout, was significantly higher in mice kept on an high‐fat diet for longer periods of time ( p = 0.03). Group comparison revealed significant differences between mice on a high‐fat diet for 4 versus 16 weeks ( p = 0.03). Macrophage density also significantly increased with diet duration ( p = 0.009). Spearman correlation between b 2 from DCE‐MRI and macrophage density indicated a weak relationship between the two parameters (r = 0.28, p = 0.20). Validated piecewise linear modeling of the DCE‐MRI data showed that the aortic root contrast agent washout rate is significantly different during disease progression. Further development of this technique from a single‐slice to a 3D acquisition may enable better investigation of the relationship between in vivo imaging of endothelial permeability and atherosclerotic plaques' genetic, molecular, and cellular makeup in this important model of disease.

Calcagno, Claudia↗
DOE OSTI2024

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗
DOE OSTI2024

Synthesis and characterization of biobased copolyesters based on pentanediol: (2) Poly(pentylene adipate–co–terephthalate)

Traditionally, most flexible food packaging is made of linear low-density polyethylene (LLDPE) which cannot easily be recycled, nor will it degrade in a reasonable timescale. In this work, a biobased biodegradable polyester alternative was investigated as a possible replacement for LLDPE. High molecular weight poly (pentylene adipate-co-terephthalate) with a 40/60 adipic acid/terephthalic acid mole ratio was synthesized using direct esterification and polycondensation. Glycerol and hexane-1,2,5,6-tetrol were added as branching agents to better match the structure of the LLDPE which in turn might help the ability of these materials in film-blowing. Thermal, mechanical, and rheological properties of the copolyesters were thoroughly investigated. All copolyesters had a weight-average molecular weight of over 140,000 g/mol, which is necessary for proper rheology, and were thermally stable up to 350°C. Here, the addition of branching agents led to a slight decrease in crystallinity, d-spacing, melting temperature, enthalpy of melting, stress at break, and elongation at break. However, an increase in Young's modulus and complex viscosity at high frequency were observed compared to PPeAT60 without branching agent added. Although the improved crystallinity and mechanical properties of the copolyesters made them viable for film-blowing, the slow crystallization rate creates a major challenge.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Collaboration and Negotiation

Collaboration and Negotiation is a critical high-level function of an Autonomous Intelligent Cyber-Defense Agent (AICA) that enables communication among agents, central cyber C2, and human operators. Maintaining the Confidentiality, Integrity, and Availability (CIA) triad while achieving mission goals requires stealthy AICA agents to exercise: 1) minimal communication as needed for avoiding detection, 2) verification of information received with possibly limited resources, and 3) active learning during operations to address dynamic conditions. Moreover, negotiations to jointly identify and execute a Course of Action (COA) solution will require building consensus under distributed and/or decentralized multiagent settings with information uncertainties. This chapter presents algorithmic approaches for enabling the collaboration and negotiation function. Strengths and limitations of potential techniques are identified, and a representative example is illustrated. Recommendations for future development are also discussed.

Chatterjee, Samrat↗
DOE OSTI2024

Reinforcement learning for block decomposition of planar CAD models

Abstract The problem of hexahedral mesh generation of general CAD models has vexed researchers for over 3 decades and analysts often spend more than 50% of the design-analysis cycle time decomposing complex models into simpler blocks meshable by existing techniques. The decomposed blocks are required for generating good quality meshes (tilings of quadrilaterals or hexahedra) suitable for numerical simulations of physical systems governed by conservation laws. We present a novel AI-assisted method for decomposing (segmenting) planar CAD (computer-aided design) models into well shaped rectangular blocks. Even though the simple examples presented here can also be meshed using many conventional methods, we believe this work is proof-of-principle of a AI-based decomposition method that can eventually be generalized to complex 2D and 3D CAD models. Our method uses reinforcement learning to train an agent to perform a series of optimal cuts on the CAD model that result in a good quality block decomposition. We show that the agent quickly learns an effective strategy for picking the location and direction of the cuts and maximizing its rewards. This paper is the first successful demonstration of an agent autonomously learning how to perform this block decomposition task effectively, thereby holding the promise of a viable method to automate this challenging process for more complex cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Bleach Rescues Nannochloropsis from an Obligate Parasite and Alters Microbial and Metabolite Signatures of Outdoor Cultures

Chemical agents are commonly used to protect algal crops. Yet, few studies have characterized the effects of these agents on associated microbial communities to understand effects on microbial functions relevant to algal crop production and protection. Here, we used shotgun metagenomic sequencing and untargeted exometabolite profiling to link the application of bleach, a -cidal agent used to protect algae from pests, to changes in community composition, metabolic pathways, and exometabolies - at a whole community level. Bleach protected the algal crop from crashing but altered bacterial diversity. Analysis of metagenome-assembled genomes (MAGs) revealed a classic predator-prey cycle between Oligoflexus and our target alga Nannochloropsis. Olifoflexus genomes from our study were notably similar to a previously identified BALO (Bdellovibrio and like organism), FD111, known to kill Nannochloropsis cultures, providing strong evidence that an FD111-like organism was responsible for the crash. Metabolic pathway composition differed between bleached and unbleached ponds, with abundance of twelve pathways related to stress tolerance, including the superpathway of methylglyoxal degradation, lipid IVA biosynthesis, and ectoine biosynthesis, greater in bleached ponds compared to unbleached ponds. Virulence factors related to adherence, biofilm formation, motility, and pathogenicity increased dramatically in bleached ponds with time, although this increase was not coupled with an increase in pathogens - algal or otherwise - or a decline in algal health. Our study highlights the importance of coupling 16S rRNA gene sequencing with whole genome data and other -omics tools to sketch a larger picture of community structure and function in crop systems. Moreover, our results highlight that continued long-term bleaching may lead to negative effects to crop health or downstream adverse health effects to humans or animals, depending on the algal product (i.e. human supplements or animal feedstocks). Future work on alternative treatment methods that would reduce resistance is necessary in the field.

09 BIOMASS FUELS↗
DOE OSTI2021

Mineralogical and microstructural alterations in a portland cement paste after an accelerated decalcification process

Cement paste leaching and concomitant decalcification is a common cause of concrete structure deterioration. Such alterations entail microstructural changes that condition concrete durability. This study analysed those changes in cement pastes exposed to accelerated decalcification, layer-by-layer, from the surface in contact with the leaching agent, 6 M NH{sub 4}NO{sub 3,} to the unaltered area. The microstructural changes were analysed with BSEM, MIP and BET whilst the mineralogical and nanostructural alterations in each layer were assessed with XRD, FTIR, {sup 29}Si and {sup 27}Al MAS NMR and BSD. Decalcification affected not only portlandite and CSH gel, but also the anhydrous clinker and ettringite, inducing major micro- and nano-structural changes, particularly in the two layers closest to the leaching agent. CSH gel decalcification was more intense in the outer layers where long chain gels co-existed with silicon rich gels. BDS, in turn, revealed differences between the amount of bound water in the surface interfacing with the leaching agent and in the leaching front. More specifically, larger numbers of water molecules were tightly bound to silanol groups in the outer, whereas hydroxyl group distribution was more orderly in the inner layers.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Temperature measurements in heavily-sooting ethylene/air flames using synchrotron x-ray fluorescence of krypton

High-fidelity temperature field measurements have been made for several heavily-sooting ethylene/air flames that have historically been challenging environments for conventional optical diagnostics. These challenges have largely been overcome here, in this study, by conducting x-ray fluorescence (XRF) measurements of a Kr fluorescent agent in the hard x-ray regime (15 keV). The current methodology presents a more economical diagnostic than a previously reported implementation of the Kr-XRF method, by limiting seeding of the expensive fluorescent agent to only the fuel stream flows. Detailed reacting flow simulations have been used to interpret experimental signals by tracking the mole fraction of the fluorescent agent in the flow field. Simulated Kr densities are in excellent agreement with measurements throughout the flow field. Temperature measurements of the flow field also agree well with simulations and recent literature studies. However, uncertainties in the measurements become increasingly large downstream of the burner surface as the krypton fraction drops due to mixing of the fuel and co-flow streams. Additionally, we demonstrate that soot particles in the heavily sooting flames studied do not impede the Kr-XRF measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗