Motion Primitive Approach to Spacecraft Trajectory Design in a Multi-body System
Explore the source record for details and available documents.
Engineering topics
Publications and source records attributed to Natasha Bosanac.
Explore the source record for details and available documents.
The purpose and direction of this document is to provide U.S. government agencies, specifically National Aeronautics and Space Administration (NASA) and Department of Defense (DoD) space related centers, with a foundational summary of astrodynamics concepts for trajectory design, navigation, and operations in the cislunar, lunar, and libration point regions. This document is provided in response to an Interagency Agreement (IAA) between NASA and the National Geospatial-Intelligence Agency (NGA). With applications to these regions of the Earth-Moon system, this document summarizes: the definitions of standard and unique coordinate systems for Positioning, Navigation, Timing and targeting (PNT), transformations between those coordinate frames, definitions of common time systems, a description of numerical integration, description of a widely-used and approximate dynamical model of a three-body system for preliminary analysis and nomenclature definition, description of higher-fidelity models of cislunar space, and the application of these concepts to sample scenarios with a focus on common steps in trajectory and maneuver design for a spacecraft in cislunar space. This information is critical to mission design and navigation far above the geosynchronous orbit region, where lunar perturbations are required to be modeled accurately and consistently but render trajectory design and analysis a complex procedure. Software tools such as the Goddard Space Flight Center (GSFC) open source General Mission Analysis Tool (GMAT) is used as a reference, along with a wide variety of resources constructed by NASA and other government agencies, academia, and industry, for mathematical specifications and practical considerations. This document has been prepared by and under the auspices of NASA. The GSFC Mission Engineering and Systems Analysis (MESA) Division (Code 590) and the Navigation and Mission Design Branch (Code 595) are part of NASA. Their engineers and scientists have expertise in lunar, cislunar, and libration point region trajectory guidance and navigation and timing. NASA GSFC has supported many successful lunar and cislunar missions over the past several decades. These missions include the Lunar Reconnaissance Orbiter (LRO), the two Acceleration, Reconnection, Turbulence and Electrodynamics of the Moon’s Interaction with the Sun (ARTEMIS) spacecraft, Transiting Exoplanet Survey Satellite (TESS), Lunar Prospector, Lunar Crater Observation and Sensing Satellite (LCROSS), Clementine, and several Sun-Earth libration point missions such as WIND and Deep Space Climate Observatory (DSCOVR), dating back four decades. NASA GSFC also supports the upcoming Gateway lunar mission, the Artemis Lunar Program and Human Landing Systems, and leads both the Lunar IceCube low thrust mission and concept design for the Lunar Communication Relay and Navigation System (LCRNS).
Multi-Reward Proximal Policy Optimization, a multi-objective deep reinforcement learning algorithm, is used to examine the design space of low-thrust trajectories for a SmallSat transferring between two libration point orbits in the Earth-Moon system. Using Multi-Reward Proximal Policy Optimization, multiple policies are simultaneously and efficiently trained on three distinct trajectory design scenarios. Each policy is trained to create a unique control scheme based on the trajectory design scenario and assigned reward function: a unique combination of weights scaling competing objectives that guide the spacecraft to the target mission orbit, incentivize faster flight times, and penalize propellant mass usage. Then, the policies are evaluated on the same set of perturbed initial conditions in each scenario to generate the propellant mass usages, flight times, and state discontinuities from a reference trajectory for each control scheme. This solution space of low-thrust trajectories for a SmallSat is used to examine the multi-objective trade space for the trajectory design scenario. By autonomously constructing the solution space, insights into the required propellant mass, flight time, and transfer geometry are rapidly achieved.
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a traditional optimization formulation.
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.
Explore the source record for details and available documents.
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to train multiple policies to uncover solutions within a multi-objective solution space. MRPPO is used in this paper to train policies to construct low-thrust transfers for a SmallSat from the vicinity of !2 to an !5 short period orbit in the Sun-Earth-Moon system. First, the policies are trained in this scenario in the circular restricted three-body problem. This information is used to initialize the policies before training in a higher-fidelity ephemeris model; a process known as transfer learning. The recovered segments of the solution space will be compared to fundamental dynamical structures to both examine the results of MRPPO in this complex design scenario and explore the effectiveness of transfer learning.
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to train multiple policies to uncover solutions within a multi-objective solution space. MRPPO is used in this paper to train policies to construct low-thrust transfers for a SmallSat from the vicinity of L2 to an L5 short period orbit in the Sun-Earth-Moon system. First, the policies are trained in this scenario in the circular restricted three-body problem. This information is used to initialize the policies before training in a higher-fidelity ephemeris model; a process known as transfer learning. The recovered segments of the solution space will be compared to fundamental dynamical structures to both examine the results of MRPPO in this complex design scenario and explore the effectiveness of transfer learning.
Low lunar frozen orbits are of continued interest in the astrodynamics community for trajectory design and space domain awareness. This paper presents a data-driven approach to analyzing a wide variety of numerically-generated lunar trajectories in a 100 × 100 lunar gravity model with the point mass gravity of the Earth and Sun. First, clustering is used to extract a summary of these trajectories: within each cluster, trajectories possess a geometrically similar evolution of perilune but varying drift and lifetimes. Within some clusters, trajectories with a bounded perilune evolution are also identified to produce candidates for lunar frozen orbits of distinct geometries.
Explore the source record for details and available documents.