Engineering PapersSearch

Engineering topics

Portia Banerjee

Publications and source records attributed to Portia Banerjee.

25 records · Page 2

Markov Decision Process based Trajectory Planning for UAVs under Uncertain Wind Conditions

In this paper we propose a Markov Decision Process (MDP) algorithm for path-planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to path-planning for UAVs are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs needs to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health and off-nominal battery power consumption. Machine learning methods such as Markov Decision Process (MDPs) have the potential to revolutionize how vehicles navigate in such uncertain environments. Previous papers have demonstrated the use of MDPs to optimize UAV path-planning for energy consumption under time-varying wind distribution. In this study, UAV trajectories from a pre-determined waypoint to target cell, will be computed on a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption, and operation time. The UAV navigates the grid by taking actions to move in either of the eight cardinal and intercardinal directions, under constant thrust profile. The next state of the UAV is calculated by considering its action, transition probability, obstacle cells and the wind speed magnitude and direction. Both constant and stochastic wind will be considered in this paper, the parameters being extracted from real wind measurements in proximity to an experimental UAV flight. One of the studies to be demonstrated in this paper is that as the unmanned airspace gets more complex with multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance needs to be made. Further, MDPs are capable of fast computation of UAV trajectories under varying wind, hence making them suitable for in-flight path planners.

decision-making

Vibration Anomaly Detection by Clustering in Unmanned Aerial Vehicles.

One of the critical factors affecting flight safety of unmanned aerial vehicles (UAVs) is the amount of vibration they are exposed to during a flight. On one hand, external causes such as wind gusts and turbulences or internal vehicle-centric faults such as incorrect sensor mounting or propeller imbalances can cause high vibrations in UAVs. On the other hand, high vibration itself may induce noise in the onboard miniature sensors of the UAV such as its accelerometers, gyroscopes and GPS that can lead to uncertain state estimation causing the multi-rotor to drift from its desired position or even result in loss-of-control. Hence, it is important to monitor the vibration levels during a UAV flight. This paper specifically looks into vibrations recorded by the autopilot system of a multi-rotor in presence of varying magnitudes of wind. Using data from experimental flights conducted at two separate flight test regions under varying wind conditions, we aim to classify between a nominal and anomalous vibration level for small UAV systems. Further, we analyse other parameters of interest that affect vibrations in UAVs such as UAV air speed and any propeller imbalance signatures. Analysis results from experimental flights demonstrate the effect of wind on vibration magnitude in unmanned aircrafts.

unmanned aviation

Tensor Decomposition Analysis for UAV Anomaly Detection

Vibrational anomalies can provide valuable insights into the health status of an unmanned aerial vehicle, potentially indicating system degradation including propeller, motor, or sensor damage, as well as environmental anomalies such as strong wind gusts and turbulence. However, many causes for vibrational anomalies are not related to vehicle health, such as sharp shifts in velocity or direction of flight. Thus, depending strictly on vibration signals to detect anomalies can result in false positives for failures. Hence, it is important to include additional telemetries in detecting and diagnosing in-flight anomalies. This paper considers an approach to anomaly detection based on tensor decompositions that incorporates information from vibration signals, as well as additional flight data such as velocity, current draw, voltage drop, and attitude. Using experimental flight data collected by the University of Notre Dame, we construct third-order tensors then apply the CANDECOMP/PARAFAC decomposition to identify trends within each flight and classify flights as nominal or anomalous.

unmanned aviation

Role of PHM in Autonomous Decision-Making: Aerospace applications

There is an increased need for onboard decision-making capabilities in cyber-physical systems be it in energy, automotive, aviation, space, or other industries as they aim for increased efficiency, resiliency, and mission assurance capabilities. Emerging next-gen technologies such as multi-rover planetary missions, distributed satellites, unmanned ground and aerial vehicle operations and smart grid systems rely on in-time risk assessment and autonomous decision-making. One critical piece of the autonomy puzzle is reliable prediction of system behavior under time-varying and potentially uncertain environmental conditions. Further, if agent states change during operation such as initiation of faults or degradation, reliable diagnostic tools need to be investigated. In this tutorial, we will revise approaches that integrates existing physics-based and data-driven models of agents interacting with probability models of the environment and component operation state. Role of existing PHM methodologies as they feed into decision-making under uncertainty will be studied. Balancing critical trade-offs between high-fidelity prognostic models, prediction time-horizons and the computational requirements for in-time cost-effective decision-making will be discussed through the implementation of surrogate models. Finally, the audience will be introduced to a real-time application of in-time trajectory planning of an unmanned aerial system (UAS) based on its PHM assessments under uncertain and varying wind conditions.

decision-making

Energy-Optimized Path Planning for Uas in Varying Winds Via Reinforcement Learning

In this paper we propose a reinforcement learning (RL) algorithm for path planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to UAV path planning problems are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs need to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health, and off-nominal battery power consumption. Machine learning methods such as reinforcement learning (RL) have the potential to revolutionize how vehicles navigate in such uncertain environments. In this study, we compute UAV trajectories from a pre-determined starting position to a target cell within a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption and operation time. The UAV navigates the grid by taking actions to move in any of the eight cardinal and inter-cardinal directions, under constant thrust profile. The resultant UAV state is sampled from a probability distribution which accounts for the UAV’s action, local wind velocity, and the presence of obstacles or boundaries. As the unmanned airspace gets more complex due to multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance need to be made. Our Markov Decision Process (MDP) environment model can capture any combination of these in the optimization objective, making it novel compared to other work in the field.

trajectory planning

Dynamic Anomaly Response and Integrated Analysis (DARIA): A Fault Investigation Toolset Supporting Earth-Independent Operations in Future Crewed Mars Missions

NASA's Moon to Mars Objectives outline a strategic vision for human spaceflight culminating in crewed missions to Mars. A critical component of this objective is the development of systems that are capable of being Earth-Independent Operated (EIO). A key aspect of EIO is the ability to rapidly detect, diagnose, and respond to anomalies in crew-supporting habitat and connected systems. To address this, the Dynamic Anomaly Response and Integrated Analysis (DARIA) architecture has been developed. DARIA incorporates a network of compact, wireless sensing devices called the System for Telemetry Amalgamation of Multimodal PrognosticS (STAMPS) for increased state awareness of EIO habitats. Able to perform on-the-fly data acquisition, STAMPS are connected to integrated anomaly data dashboards for crew visualization. DARIA is designed to seamlessly integrate into various off-world environments, including the International Space Station, Lunar Gateway, Artemis Base Camp, and future Mars habitats. By leveraging Commercial Off-The-Shelf (COTS) hardware, the NASA Internet of Things (NASA IoT) framework, and EIO fault detection methods, DARIA provides a cost-effective and adaptable solution for anomaly detection and response in EIO habitats.

Diagnostics