Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Reducing Sample Size While Improving Equity in Vaccine Clinical Trials: A Machine Learning-Based Recruitment Methodology with Application to Improving Trials of Hepatitis C Virus Vaccines in People Who Inject Drugs

Despite the availability of direct-acting antivirals that cure individuals infected with the hepatitis C virus (HCV), developing a vaccine is critically needed in achieving HCV elimination. HCV vaccine trials have been performed in populations with high incidence of new HCV infection such as people who inject drugs (PWID). Developing strategies of optimal recruitment of PWID for HCV vaccine trials could reduce sample size, follow-up costs and disparities in enrollment. We investigate trial recruitment informed by machine learning and evaluate a strategy for HCV vaccine trials termed PREDICTEE—Predictive Recruitment and Enrichment method balancing Demographics and Incidence for Clinical Trial Equity and Efficiency. PREDICTEE utilizes a survival analysis model applied to trial candidates, considering their demographic and injection characteristics to predict the candidate’s probability of HCV infection during the trial. The decision to recruit considers both the candidate’s predicted incidence and demographic characteristics such as age, sex, and race. We evaluated PREDICTEE using in silico methods, in which we first generated a synthetic candidate pool and their respective HCV infection events using HepCEP, a validated agent-based simulation model of HCV transmission among PWID in metropolitan Chicago. We then compared PREDICTEE to conventional recruitment of high-risk PWID who share drugs or injection equipment in terms of sample size and recruitment equity, with the latter measured by participation-to-prevalence ratio (PPR) across age, sex, and race. Comparing conventional recruitment to PREDICTEE found a reduction in sample size from 802 (95%: 642–1010) to 278 (95%: 264–294) with PREDICTEE, while also reducing screening requirements by 30%. Simultaneously, PPR increased from 0.475 (95%: 0.356–0.568) to 0.754 (95%: 0.685–0.834). Even when targeting a dissimilar maximally balanced population in which achieving recruitment equity would be more difficult, PREDICTEE is able to reduce sample size from 802 (95%: 642–1010) to 304 (95%: 288–322) while improving PPR to 0.807 (95%: 0.792–0.821). PREDICTEE presents a promising strategy for HCV clinical trial recruitment, achieving sample size reduction while improving recruitment equity.

60 APPLIED LIFE SCIENCES↗
NASA NTRSDate not supplied

Aerial Vehicle Routing and Scheduling for UAS Traffic Management: A Monte Carlo Tree Search Approach

Numerous unmanned aircraft systems operating at low altitudes to deliver goods and services may one day become ubiquitous in our cities. In the Unmanned Aircraft Systems (UAS) Traffic Management (UTM) framework, such a concept is envisioned, where aerial vehicles operate beyond visual line of sight (BVLOS) within specifically reserved and time stamped “corridors” in the airspace. For example, these corridors or operational intent volumes can connect an aerial vehicle’s origin site to its destination site for package delivery operations. There may also be more than one corridor available for an aerial vehicle to choose from and often different corridors may intersect with one another. Thus, it is imperative to ensure flight trajectories belonging to different aerial vehicles are not in conflict. Per the UTM CONOPs, we assume that a vehicle almost always stays inside its corridor or operational volume. This work provides a framework for strategic deconfliction of UTM or package delivery drones, where we schedule the departure time of all vehicles subject to various temporal constraints (including the corridor deconfliction at the intersections). We present the “multi-route weighted package delivery problem” which serves as an exemplifying model for strategic deconfliction in UTM. In the multi-route weighted package delivery problem, a graph network is given which consists of a set of depots (source) and drop-off (destination) nodes, with multiple routes (defined as a sequence of waypoints) connecting the depots to drop-off nodes. In addition, routes are weighted by the associated ground risk and total travel distance for package delivery. The goal is for a known set of aerial vehicles to depart from the depots, choose a route and take off time, while avoiding conflicts with other aerial vehicles, and minimizing both risk and distance traveled. We provide a mixed integer linear programming (MILP) formulation of the problem, as well as a heuristic solution based on Monte Carlo Tree Search (MCTS) – a method used in game theory and artificial intelligence – to overcome limitations inherent to optimal solvers. Computational results show the advantages of using MCTS over the MILP formulation; the former can provide a sub-optimal solution quickly, and may sometimes even reach an optimal solution, whereas the latter may not even produce a solution in reasonable time. Furthermore, results from both the MILP formulation and MCTS methods were validated using a preliminary agent-based simulator implementing the UTM concept of operations. Thus, the MCTS method can be seen as a scalable solution to the complex multi-route weighted package delivery problem and may possibly be extended to similar complex optimization problems.

Kenny Chour↗
DOE OSTI2022

Next Generation System Analysis Model: Recently Added Features and Future Plans

To better enable informed decision-making regarding the back-end of the nuclear fuel cycle, the Integrated Waste Management System (IWMS) program within the U.S. Department of Energy, Office of Nuclear Energy (DOE-NE) has been sponsoring the development and application of system analysis tools capable of analyzing various system options for the management of spent nuclear fuel (SNF) and high-level radioactive waste (HLW).With these tools, IWMS architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). The Next Generation System Analysis Model (NGSAM) is an agent-based simulation software tool expressly designed to be capable of modeling features within various IWMS architectures. NGSAM imports data from Oak Ridge National Laboratory (ORNL)’s unified database (e.g., historic assembly information, thermal profiles for assembly heat, and at-reactor dry storage loadings) to ensure that each simulation initializes with a realistic representation of the state of commercial SNF in the U.S. Recent major enhancements implemented into NGSAM in the period since NGSAM was last presented at the WM2019 conference include: • Tracking of railroad escort car acquisition and buffer car acquisition • The addition of heavy haul truck (HHT) and barge routes for some sites, as well as support for user-defined inter-modal routes • Updates to the logic that checks the transportation cask thermal limit maps prior to package transport • An allocation method that predicts when reactor sites would pack assemblies from their spent fuel pools for dry storage, and prioritizes shipments directly from the pools of those reactor sites in the preceding periods (before the predicted loadings to dry storage), thus reducing the number of casks loaded into dry storage at reactor sites • The addition of “reactor site family” operational limits to restrict the number of loads of SNF taken from the pool and from dry storage at a given reactor site each year • Added support for multiple canister loading map options and packages with multiple compatible transportation overpacks • Updates to the handling of non-commercial SNF, including a new database that contains data to support the updates • Updates to allow analysis of hypothetical scenarios which include repackaging at reactor sites, e.g., for possible comparative analysis with other scenarios • Implementation of additional output reports, or modification of existing ones • The ability to generate and implement user edits via the NGSAM website • The ability to model loading SNF from pool storage at an interim storage facility (ISF) into dry storage at the ISF • The ability to model consolidating SNF from different existing storage containers at a DOE site into the same DOE standard canister • The ability to model transferring SNF casks from one transportation mode to another, e.g., from HHT to rail, referred to as transloading. These new features have improved NGSAM capabilities and users’ experience with the model. Preliminary NGSAM requirements for modeling advanced reactor fuels, reprocessing, treatment, and conditioning were considered, and this paper describes them at a high level. Other nuclear fuel cycle system analysis tools developed under sponsorship of DOE-NE, like the VISION code developed at Idaho National Laboratory, might be better suited for initial high-level analysis of those technologies and advanced fuel cycles. As technologies are developed and system concepts evolve, NGSAM could provide value by providing more detailed modeling of transport, storage, and disposal of spent fuel and wastes from advanced reactors and advanced fuel cycles at the fuel element and waste container level.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Next Generation System Analysis Model Recently Added Features and Future Plans - Abstract

The Nuclear Waste Policy Act of 1982, as amended (NWPA 1982), established the federal government’s responsibility to accept spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from waste owners and generators for ultimate disposition. SNF generated by the current fleet of commercial nuclear reactors is being stored at the reactor sites in spent fuel pools (SFPs) and in dry independent spent fuel storage installations (ISFSIs). The US Department of Energy Office of Nuclear Energy (DOE-NE) is developing an Integrated Waste Management Program (IWMP) comprising a suite of options and supporting analyses to enable future informed choices. The IWMP is applying integrated waste management system architecture analysis, system engineering, and decision analysis principles to inform potential future decisions regarding potential nuclear waste management system architectures. Architecture analyses of the IWM system are being conducted to support the future deployment of a comprehensive system for managing nuclear waste that considers all major aspects of the back end of the nuclear fuel cycle (i.e., transportation, storage, and disposal). The Next Generation System Analysis Model (NGSAM) is an agent-based simulation software tool designed for the express purpose of modeling the IWM system. NGSAM imports data from the Oak Ridge National Laboratory (ORNL) Unified Database (e.g., historic assembly information, thermal profiles for assembly heat, at-reactor dry storage loadings) to ensure that the simulation initializes with a realistic representation of the state of commercial SNF in the United States. Recent major enhancements that have been implemented into NGSAM since NGSAM was last presented at the WM2019 conference include: • Tracking of railroad escort and buffer car acquisition. • Addition of heavy haul and barge routes for some sites, as well as support for user-defined inter-modal routes. • Updates to the logic that checks the thermal maps prior to package transport. • Addition of an allocation method that predicts when reactor sites will pack assemblies from their pools for dry storage and allocates packages to those reactor sites in the preceding periods, favoring direct transport packages and reducing the number of packages that reactor sites pack for dry storage at their ISFSIs. • Addition of reactor site family operational limits, which are used to limit the number of loads from the pool and from dry storage at a given reactor site per year. • Support has been added for multiple canister loading maps and packages having multiple compatible transportation overpacks. • Updates in the handling of non-commercial fuel, including a new database containing data to support the updates. • Support for repackaging at reactor sites. • Implementing additional output reports or modifying existing reports. • User edits can now be created and edited via the NGSAM website. • Ability to load packages for dry storage at ISF pools. • Same-type package blending at DOE sites. • Support for multi-mode transloading at reactor sites. These new features have improved NGSAM capabilities and/or improve the user experience with the model and will be discussed in more detail. The initial NGSAM requirements for advanced reactor fuels, reprocessing, treatment, and conditioning are preliminary and are described at a high level in this paper: analysts will provide more specific requirements to the NGSAM team in the future. Additionally, there are many data needs associated with modeling advanced reactors in NGSAM, but many of the data or plans are still in progress and/or yet to be fully defined. However, this document describes an initial exploration of the data relevant to this program. Advanced reactor data will likely require revision as concepts evolve and new considerations are made. This is a technical paper that does not take into account contractual limitations or obligations under the Standard Contract for Disposal of Spent Nuclear Fuel and/or High-Level Radioactive Waste (Standard Contract) (10 CFR Part 961). For example, under the provisions of the Standard Contract, spent nuclear fuel in multi-assembly canisters is not an acceptable waste form, absent a mutually agreed to contract amendment. To the extent discussions or recommendations in this paper conflict with the provisions of the Standard Contract, the Standard Contract governs the obligations of the parties, and this paper in no manner supersedes, overrides, or amends the Standard Contract. This paper reflects technical work which could support future decision making by DOE. No inferences should be drawn from this paper regarding future actions by DOE, which are limited both by the terms of the Standard Contract and Congressional appropriations for the Department to fulfill its obligations under the Nuclear Waste Policy Act including licensing and construction of a spent nuclear fuel repository.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

System Analysis Modeling and Intermodal Transportation for Commercial Spent Nuclear Fuel

The United States Department of Energy (DOE) Office of Nuclear Energy is applying knowledge and understanding in the areas of systems level engineering, analysis, and decision making to better inform the waste management pathways for U.S. spent nuclear fuel (SNF). Currently there are 93 operating and 23 shutdown commercial nuclear reactors in the United States. SNF at most of these locations is being stored in spent fuel pools, dry storage, or both [1, 2]. This paper initially goes over the basics of the agent-based simulation tool known as the Next Generation System Analysis Model (NGSAM) that has the capability to model interaction and movements of individual components or groups like casks, railcars etc. The next section covers some of the methods implemented in the Java Transportation Operations Model (JTOM) to facilitate the movement of assemblies, casks, railcars etc. and the various intermodal transfer options. This section also covers the current cask loading and intermodal transfer times implemented in NGSAM. The last section goes over the proposed values for intermodal transportation, and cask transfer/loading operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Overview of System Integration Analysis Activities for Integrated Waste Management

Spent nuclear fuel (SNF) generated by the current fleet of commercial nuclear reactors is being stored at the reactor sites in spent fuel pools (SFPs) and in dry independent spent fuel storage installations (ISFSIs). The US Department of Energy Office of Nuclear Energy (DOE-NE) is developing an Integrated Waste Management Program (IWMP) comprising a suite of options and supporting analyses to enable future informed choices. The IWMP is organized into the following five major areas: 1) Consent-Based Siting, 2) IWM Facilities and Equipment Concepts and Development, 3) Transportation Capability Analysis and Support, 4) Information Technology Solutions and Support, and 5) System Integration Analysis and Support. This paper discusses the activities ongoing in the IWMP System Integration Analysis and Support area. Two main areas of research in system integration are data and tools development, as well as system analysis assessments. One of the tools being developed in the system integration area is the Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS) tool. It is being developed as a foundational resource for DOE-NE to manage SNF data, along with several compatible analysis tools for time-dependent characterization of SNF and related systems. UNF-ST&DARDS has the unparalleled ability to track SNF through the entire back end of the fuel cycle—from the time the fuel is discharged from a reactor through its disposal in a geological repository. UNF ST&DARDS interfaces with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Another main tool being developed is the Next Generation System Analysis Model (NGSAM). NGSAM is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system. NGSAM has been developed to enable informed decision-making by providing the capability of analyzing various potential system options for the management of SNF and HLW. Using NGSAM, system architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). System analysis assessments may investigate the implications of various strategies such as different acceptance rates, acceptance queues, facility capacities and options, standardized canisters, and different assumed system operation start dates. Recently, some system analysis effort has begun to look at how the waste management system might operate for advanced reactor fuel cycles.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Integrating Human Factors in Dynamic Rideshare Assignment: Willingness-To-Pay for Delay

Dynamic ride-sharing (DRS) has been projected to be a key solution to lowering system-wide congestion. Despite recent developmental progress, demand studies for DRS suggest low levels of willingness for travelers to use such services. The disconnect between DRS system designs and user preferences limits the application impacts of DRS in the real world. Therefore, this paper aims to design a new DRS trip/vehicle assignment strategy by considering the user preferences of choices under different levels of service. In this study, an agent-based simulation approach is used to model a fleet of shared vehicles that allows DRS. An optimization model is developed to match riders to vehicles while accounting for traveler delay and delay acceptance. Travelers are also dynamically issued predictive discounts, catered to their expected willingness to pay, to incentivize them to accept longer trip delays. Results show that the proposed approach can improve system efficiency by increasing average vehicle occupancy by up to 1.0 persons/trip and DRS acceptance by up to 38.9% depending on fleet size. Additionally, congestion is eased through the decrease of empty vehicle miles traveled by up to 7.1%.

Paul, Joseph↗
DOE OSTI2025

An Agent-Based Modeling Approach for Spatiotemporal Optimization of Electric Vehicle Fast-Charging Station Demand

With increasing electric vehicle (EV) adoption, managing public fast-charging demand effectively is crucial to avoid grid strain. This study investigates the potential of using dynamic pricing schemes to address this challenge. Presented in this study is a scalable agent-based simulation framework, which is applied to a case study in Richmond, Virginia, that assumes a 50% EV adoption rate in 2040. Two pricing schemes are compared: (1) a dynamic-pricing scheme based on station utilization and (2) a dynamic-pricing scheme based on peak power at the station. These schemes are compared to two baseline scenarios: (1) unscheduled first-come, first-served and (2) scheduled with constant price. The study’s results suggest that dynamic pricing has the potential to influence EV charging behavior, inducing both spatial and temporal shifts, but does so at the cost of inducing inconvenience to EV drivers. The results suggest the peak-power dynamic pricing scheme has the potential to mitigate peak demand pressures on the grid with minimal inconvenience, offering a promising approach for sustainable EV charging infrastructure expansion.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Agent-based modeling and simulation for the circular economy: Lessons learned and path forward

Circular economy aims at decoupling human activities from resource use and creating wealth. However, many have questioned the link between increased circularity and sustainability, resulting in several methodological approaches being developed to answer that question. This article analyzes and discusses the insights gained from applying agent-based modeling and simulation to study the techno-economic and social conditions promoting circularity and sustainability. This article analyzes the benefits and limitations of this technology and discusses future methodology developments within the circular economy context. Moreover, six limits of the circular economy concept are used to interpret insights from the literature: thermodynamic limits, system boundary limits, limits posed by the physical scale of the economy, limits posed by path dependencies and lock-in, limits of governance and management, and limits of social and cultural definitions. Promising research avenues are to use this methodology with machine learning, industrial ecology methods, and detailed geographic information.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

A Review on Simulation Platforms for Agent-Based Modeling in Electrified Transportation

As the use of combustion engine vehicles plays a deciding role in global warming, we can observe a trend to replace them with electric vehicles (EV) driven by new environmentally conscious policies and increasing technological capabilities. With improvements in driving range and reduction in prices come new challenges that may hamper the progress towards complete battery driven transportation. A major challenge for the increasing EV adoption is the planning of extensions to existing infrastructure or the inclusion of new infrastructure components in the planning process. This demands increasingly complex planning tools that can simulate the interplay between different stakeholders in modern transportation scenarios such as EVs, charging stations, energy providers, and general transportation participants. Simulation platforms for agent-based modeling in transportation have been developed as effective interactive tools that allow planners to explore different trade-offs across different scenarios with the ability to simulate the impact of policy or infrastructure decisions on the different stakeholders in the simulation. This article surveys several of the major simulation platforms that include modern EV-based forms of transportation and allow the simulation of relevant infrastructure components alongside the well established transportation simulations. These tools allow researchers to analyze expected traffic flow, identify possible charging station locations based on area demand, predict electrical grid demand, and more. Here this survey intends to make it easier for researchers to identify and apply a simulation platform in the context of supporting the increasing electrification of the transportation sector, enabling more efficient simulation and planning capabilities in this domain.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Synergies between repositioning and charging strategies for shared autonomous electric vehicle fleets

The emergence of on-demand shared autonomous electric vehicle (SAEV) service requires careful charging station planning and a joint charging and repositioning strategy to mitigate empty travel. This study couples charging and repositioning events as a means of improving service quality (rider wait times), reducing empty travel due to repositioning or charging, and improving fleet utilization (average daily trips per vehicle and charging queues). This synergy is explored for the Austin, Texas region using POLARIS, an agent-based model. On average, wait times were 39% lower, and average daily trips served per SAEV increased up to 6.4 (or 28%) compared to SAEV repositioning with heuristic charging. Coupling repositioning with charging decreased the fleet's percent empty travel on average by 1.6%, relative to the scenario treating them as independent events (which varies by charging station design). Sparser charging stations reduce investment costs, and operators can leverage this framework to keep traveler wait times low.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Ten questions concerning agent-based modeling of occupant behavior for energy and environmental performance of buildings

We report the complexity of occupant behavior is one of the major contributors to uncertainty in building performance simulation. Agent-based modeling (ABM), a computational simulation technique, has gained attention in the occupant modeling field due to its capability and flexibility to capture the heterogeneity and dynamics of human behavior and the emergent effects. While multiple efforts in the past decade have demonstrated the usefulness of the ABM approach for simulating occupants and their impacts on building performance, several crucial matters in the ABM research still remain unexplored. This paper presents ten questions that highlight the most important issues regarding ABM research and applications for occupant behavior in the context of building performance simulation. The questions and answers aim to provide insights into current and future ABM research, and more importantly to inspire new significant questions from young researchers in the field. This research is part of the IEA EBC Annex 79 project, occupant-centric building design and operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Behavior, Energy, Autonomy, Mobility Modeling Framework (BEAM) v1.0

The Behavior, Energy, Autonomy, and Mobility (BEAM) model is an integrated, agent-based travel demand simulation framework. Individual agents express preferences through a utility- maximizing evolutionary algorithm that minimizes each individual’s cost and time spent traveling via diverse modal options, including the competition for scarce supply resources such as parking spaces and charging infrastructure. BEAM simulates the essential elements that compose a dynamic transportation system. From the road network, parking and charging infrastructure, to the transit system and a synthetic population with plans and preferences, the virtual system is an amalgamation of multiple spatially resolved layers that together represent an integrated transportation system. BEAM is an extension to the MATSim (Multi-Agent Transportation Simulation) model, where agents employ reinforcement learning across successive simulated days to maximize their personal utility through plan mutation (exploration) and selecting between previously executed plans (exploitation). The BEAM model shifts some of the behavioral emphasis in MATSim from across-day planning to within- day planning, where agents dynamically respond to the state of the system during the mobility simulation. In BEAM, agents can plan across all major modes of travel including driving, walking, biking, transit, and demand-responsive ride hailing. It is designed to integrate with other open source transportation models, such as ActivitySim.

Lazarus, Jessica↗
DOE OSTI2021

The Chicago Social Interaction Model (ChiSIM)

ChiSIM is a framework for implementing agent-based models that simulate the mixing of a synthetic population. In a ChiSIM based model, each agent, that is, each person in the simulated population, resides in a place (a household, dormitory or retirement home/long term care facility, for example), and moves among other places such as workplaces, homes, clinics, and community resources. Agents typically move between places according to their domain specific activity profile, such that each agent has a profile that determines at what times throughout the day they occupy a particular location. Once in a place, an agent mixes with other agents in some model or domain-specific way. For example, an agent may expose other agents to a disease in an epidemiological model.

Ozik, Jonathan↗
DOE OSTI2024

SAGESim

SAGESim: Scalable Agent-based GPU-Enabled Simulator is a distributed GPU agent-based modeling framework in Python. SAGESim enables researchers to study complex adaptive systems at large scales on high-performance computing systems

Gunaratne, Chathika↗
NASA NTRSDate not supplied

Aerial Vehicle Routing and Scheduling for UAS Traffic Management: A Hybrid Monte Carlo Tree Search Approach

We present the Multi-Route Weighted Package Delivery Problem (MRWPDP) and a scalable solution methodology as a major step towards enabling an airspace deconfliction service for drone delivery operations. The problem is motivated by Strategic deconfliction under the FAA’s “Unmanned Aircraft Systems Traffic Management” Concept of Operations. MRWPDP falls under a class of vehicle routing and scheduling problems, and as such is NP-Hard. In MRWPDP, a graph network is given which consists of depots, drop-off sites, and multiple routes connecting the two. In addition, routes are weighted by the associated ground risk and total travel distance for package delivery. The goal is to optimally schedule the departure time and assign routes to a known set of vehicles at the depot. We propose a heuristic solution to the problem by borrowing techniques from Mixed Integer Linear Programming (MILP), Constraint Programming, and Monte Carlo Tree Search (MCTS). The resulting hybrid framework is MCTS with Bound-and-Prune (BP) and rapid simulated updates (U), or MCTS-BP-U. This approach is able to quickly provide a feasible solution for MRWPDP, even for large problem instances up to 1000 vehicles. We provide a MILP formulation of MRWPDP and compare its performance against MCTS-BP-U in terms of solution quality. An agent-based model simulation is conducted as a final step to validate the efficacy of our approach.

air traffic scheduling↗
NASA NTRSDate not supplied

Aerial Vehicle Routing and Scheduling for UAS Traffic Management: A Hybrid Monte Carlo Tree Search Approach

We present the Multi-Route Weighted Package Delivery Problem (MRWPDP) and a scalable solution methodology as a major step towards enabling an airspace deconfliction service for drone delivery operations. The problem is motivated by Strategic deconfliction under the FAA’s “Unmanned Aircraft Systems Traffic Management” Concept of Operations. MRWPDP falls under a class of vehicle routing and scheduling problems, and as such is NP-Hard. In MRWPDP, a graph network is given which consists of depots, drop-off sites, and multiple routes connecting the two. In addition, routes are weighted by the associated ground risk and total travel distance for package delivery. The goal is to optimally schedule the departure time and assign routes to a known set of vehicles at the depot. We propose a heuristic solution to the problem by borrowing techniques from Mixed Integer Linear Programming (MILP), Constraint Programming, and Monte Carlo Tree Search (MCTS). The resulting hybrid framework is MCTS with Bound-and-Prune (BP) and rapid simulated updates (U), or MCTS-BP-U. This approach is able to quickly provide a feasible solution for MRWPDP, even for large problem instances up to 1000 vehicles. We provide a MILP formulation of MRWPDP and compare its performance against MCTS-BP-U in terms of solution quality. An agent-based model simulation is conducted as a final step to validate the efficacy of our approach.

air traffic scheduling↗