Exploring the Low-Thrust Transfer Design Space in an Ephemeris Model via Multi-Objective Reinforcement Learning
No abstract provided
Engineering topics
Publications and source records attributed to Anderson, Rodney L.
No abstract provided
No abstract provided
Many unstable periodic orbits of the planar circular restricted 3-body problem (PCRTBP) persist as invariant tori when a periodic forcing is added to the equa- tions of motion. In this study, we compute tori corresponding to exterior Jupiter- Europa and interior Jupiter-Ganymede PCRTBP resonant periodic orbits in a con- centric circular restricted 4-body problem (CCR4BP). Motivated by the 2:1 Laplace resonance between Europa and Ganymede’s orbits, we then attempt the continu- ation of a Jupiter-Europa 3:4 resonant orbit from the CCR4BP into the Jupiter- Ganymede PCRTBP. We strongly believe that the resulting dynamical object is a KAM torus lying near but not on the 3:2 Jupiter-Ganymede resonance.
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.
Multi-Reward Proximal Policy Optimization, a multi-objective deep reinforcement learning algorithm, is used to examine the design space of low-thrust trajectories for a SmallSat transferring between two libration point orbits in the Earth- Moon system. Using Multi-Reward Proximal Policy Optimiza- tion, multiple policies are simultaneously and efficiently trained on three distinct trajectory design scenarios. Each policy is trained to create a unique control scheme based on the trajectory design scenario and assigned reward function: a unique combination of weights scaling competing objectives that guide the spacecraft to the target mission orbit, incentivize faster flight times, and penalize propellant mass usage. Then, the policies are evaluated on the same set of perturbed initial conditions in each scenario to generate the propellant mass usages, flight times, and state discontinuities from a reference trajectory for each control scheme. This solution space of low-thrust trajectories for a SmallSat is used to examine the multi-objective trade space for the trajectory design scenario. By autonomously constructing the solution space, insights into the required propellant mass, flight time, and transfer geometry are rapidly achieved.
No abstract provided
When the planar circular restricted 3-body problem is periodically perturbed, most unstable periodic orbits become invariant tori. However, 2D Poincare ́ sections no longer work to find their manifolds’ intersections; new methods are needed. In this study, we first review a method of restricting the intersection search to only certain manifold subsets. We then implement this search using Julia and OpenCL, representing the manifolds as triangular meshes and gaining a 30x speedup using GPUs. We finally show how to use manifold parametrizations to refine the ap- proximate connections found in the mesh search. We demonstrate the tools on the planar elliptic RTBP.
No abstract provided
No abstract provided