Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supervised”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Fault Detection and Diagnosis in Spacecraft Electrical Power Systems

The ability to accurately identify and isolate failures in the electrical power system (EPS) is critical to ensure the reliability of spacecraft. This paper proposes a novel solution to the problem of fault detection and diagnosis in direct current (DC) electric power systems for spacecraft. Autonomous operation becomes essential during deep space missions that lack the ability to monitor and control the spacecraft from ground locations. The current state of EPS fault supervision is insufficient to guarantee highly reliable operation. To solve this issue, a combination of model-based and knowledge-based techniques are used in a hierarchical framework to improve the diagnostic performance of the system. Noise, disturbances, and modeling errors are considered in the design of the fault detection system. Practical considerations related to spacecraft flight hardware and software are accounted for in the system design for flight applications. To assess the functionality of the design, a wide array of failures are simulated in a series of experiments. The experiments showed that the technique improved the capability of the autonomous system by increasing the number of fault types diagnosed. The significance of this study is to provide a framework capable of advanced diagnostics of an EPS with little to no interaction from human operators.

Autonomous Power Systems↗

Florida Transportation and Infrastructure: Monitoring Water Quality Along Southern Florida Seaports to Assess Impact on Coral Reef Tracts from Harbor Deepening Projects

The U.S. Army Corps of Engineers (USACE) and National Oceanic and Atmospheric Administration (NOAA) National Marine Fisheries Service (NMFS) will be supervising a harbor deepening project in Port Everglades, Florida. The project raises concerns about potential impacts on the nearby Florida reef tract through increased turbidity and sediment from the dredging. To better understand these potential impacts, the NASA DEVELOP team created an interactive Google Earth Engine tool to help establish a historical baseline of water quality parameters and assist monitoring these parameters more frequently than traditional sampling. This Seaport & Harbor Area Resource Quality (SHARQ) tool incorporates remotely sensed data from Sentinel-2 Multispectral Instrument, Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper+, Landsat 8 Operational Land Imager, and Aqua Moderate Resolution Imaging Spectroradiometer. It allows users to view true color images and calculate water quality parameters, like turbidity and chlorophyll-a, for any given study area and time period from 1984 onward. The SHARQ tool also generate time series charts, allowing users to interpret changes in water quality over a given time range. The accuracy of the remotely sensed water quality parameter algorithms was determined using in situ data to calculate percent difference and root mean square error values (RMSE), which ranged from 0.32 to 0.58 error between sites. Using the SHARQ tool’s time series analysis feature, a baseline average turbidity metric of ~6.8 FNUs provides a historical baseline average for turbidity between September 2000 and 2020 and can assist in future decision-making for determining thresholds for turbidity.

Benjamin Rocha↗

Assessing Flooding Vulnerability to Assist High Water Intervention and Urban Planning Programs in the Charles River Watershed with NASA DEVELOP

The Charles River watershed intersects 35 municipalities within the Boston Metropolitan Area and has a total population of 1.2 million, making it one of the most densely populated watersheds in New England. In recent years, the watershed has observed higher rates of flood inundation, mainly due to increased development, extreme precipitation events, and increased surface runoff. As the frequency of flooding events increases and a changing climate poses an ongoing threat to local communities, governments and organizations in Massachusetts are in need of accurate flood risk assessments. NASA DEVELOP partnered with the Charles River Watershed Association, the Town of Natick’s Office of Sustainability, and the Massachusetts Audubon Society to assess flood vulnerability and susceptibility in the watershed. The team used Landsat 5 Thematic Mapper, Landsat 8 Operational Land Imager, Sentinel-1 C-Band Synthetic Aperture Radar, and Sentinel-2 MultiSpectral Instrument to assess the feasibility of identifying the extent of past flood events using remote sensing. After identifying images that overlapped with reported flood events, the team concluded that it was not feasible to use Earth observation data to detect localized flooding in the time available for this study. Instead, the Federal Emergency Management Agency (FEMA) 100-year floodplain was used as a proxy for areas where flooding may occur. The team used statistical regression analysis and validation and supervised classification to develop a flood susceptibility map, incorporating several flood conditioning factors. The susceptibility maps were calibrated to various thresholds, including two that highlight hypothetical flooding under more liberal and more conservative planning scenarios. These were overlaid with demographic and socioeconomic data to create flood vulnerability maps. The team’s flood susceptibility maps showed an improvement in capturing known flood events over the FEMA 100-year and 500-year floodplain maps. These results will be improved with the addition of stormwater drainage mapping and precipitation data. Results can be used to fill in the gaps to help the stakeholders understand their communities’ vulnerability and susceptibility to flooding and improve their preparedness plans.

Trista Brophy↗

Application of Support Vector Regression to Derive Crater Depth/Diameter From Satellite Images

Through the study of impact crater shapes, one can draw important conclusions about the nature and evolution of planetary surfaces [e.g., 1-4].In particular, studying the depth (d) to diameter (D)ratio (d/D) of a population of impact craters, in combination with crater count statistics, can yield valuable insights regarding rates of erosion and burial[5]. Motivated by the great abundance of available planetary surface image data, the goal of this project is to develop an efficient way to estimate d/D from satellite images of impact craters for which stereo information is not available [6]. We set out to develop and train a machine learning algorithm to extract d/D from a dataset of synthetic impact crater images for which model d/D is known. The applications of machine learning to planetary science are numerous and diverse [7], including automatic planetary surface mapping [8] and the detection of impact craters [9]. Our algorithm makes use of Support Vector Regression (SVR), which is a type of Support Vector Machine (SVM) [10, 11].SVMs are a branch of supervised machine learning valued for their straightforward implementation and versatility in solving both classification and regression problems. In regression analysis, an SVR algorithm produces a hyperplane function to fit the training data points, as well as an ε-tube that surrounds the hyperplane. Tunable hyperparameters include the width of the ε-tube (ε) and the amount an algorithm is penalized for points which fall outside the ε-tube.

L R Chin↗

Run Time Assurance for Electric Vertical Takeoff and Landing Aircraft

NASA is conducting research to demonstrate and evaluate the application of Run Time Assurance (RTA) as a means to assure safety in Electric Vertical Takeoff and Landing (eVTOL) aircraft with highly automated or autonomous flight capability supervised by a single onboard pilot. The work described in this report demonstrates an application of RTA and examines the implications for design and analysis of aircraft functions and systems; aircraft safety hazards; safety assurance; development assurance; and pilot tasks and performance. This research effort also seeks to assess the efficacy of the combined application of traditional Functional Hazard Analysis (FHA) and the more modern System Theoretic Process Analysis (STPA) techniques to perform hazard analyses on aircraft with complex automated and autonomous systems and an onboard pilot. During the research effort we developed architectural designs of two alternate eVTOL aircraft, generally following the process characterized in the SAE standards ARP4754 and ARP4761. The design has focused on the control architectures of these aircraft, which are identical except that one incorporates RTA techniques to reduce the criticality of some key software components. Artifacts of this process include a taxonomy of aircraft-level functions, aircraft-level architecture diagrams, aircraft-level functional hazard assessments (AFHA), function allocations onto aircraft systems and subsystems, functional block diagrams for a select set of control-related functions, and system-level functional hazard assessments (SFHA) for those functions. This project has highlighted the notion that DAL D is something of a sweet spot for low-confidence controllers in an RTA-based design. Among the many activities described in DO-178C, the activities related to requirement verifiability, algorithmic accuracy, and test coverage can be the most challenging for the kinds of advanced control techniques that may be desirable in novel UAM designs, such as adaptive control, machine-learning, artificial intelligence, numerical search, and Monte Carlo based algorithms. Moreover, the standard requires that development teams demonstrate that errors leading to unacceptable failure conditions have been removed from the software. The RTA architecture, which cordons off the low-confidence function, makes it much easier to show this for these kinds of algorithms. With regard to the use of STPA and FHA as complementary hazard analysis techniques, our research effort led us to the conclusion that STPA should be used to derive requirements for hardware and software systems and/or components. Also, STPA is a natural complement to other processes in ARP4754A involving design studies and iteration.

Run-time assurance↗

Human Autonomy Teaming - m:N Operations

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust).

multi-vehicle control↗

A Robotically Assembled and Serviced Science Station for Earth Observations

In this paper we present the overall architecture of a ”Science Station”, a robotically assembled and serviced persistent platform that can host multiple payloads for Earth observations. Recent decadal survey findings motivate the need to have spatial and temporal concurrency in measurements from multiple instruments. We have architected the science station to simultaneously host up to twelve Earth Venture class instruments at a time. These instruments can be replaced by newer instruments periodically to take advantage of evolving science needs and technology capabilities. The Science Station can also concurrently host science, commercial, defense and other national interest payloads. The Science Station may provide a cost-effective paradigm by mitigating some of the risks and costs associated with multiple free-flyers that may otherwise be needed for the various instruments. It leverages emergent and existent technologies in robotic assembly and servicing, lower cost commercial launch vehicles, secondary launch vehicles, and rendezvous and proximity operations. In this paper, we report the findings of a survey we conducted on the desired performance of the Science Station from various instrument hosting perspectives. We report the various trade studies that we conducted to developed a feasible architecture that meets the goals of the Science Station while also meeting the constraints of a space system. We also report the various considerations in the configuration, thermal system, pointing system, overall concept of operations, and the robotic system of the Science Station architecture. The paper then describes a testbed activity we are undertaking to evaluate the supervised autonomy robotics needed for the Science Station as well as to conduct a riskreduction demonstration of the end-to-end robotics behaviors.

Mukherjee, Rudranarayan↗

Efficient Active Learning for New Domains

The promise of active learning is to reduce the number of labeled examples required by supervised machine learning algorithms. The largest potential benefits lie in entirely new domains, for which no labeled examples yet exist. Yet to date, most active learning studies are retroactive and demonstrate the benefits that could have been gained if active learning had been used. What are the barriers to true adoption and utilization of active learning? We focus on two: (1) the cold start or class discovery problem, in which active learning methods may struggle to make progress with zero labeled examples, and (2) the cost of having the classifier in the loop to select the next example to be labeled. We assess different active learning approaches in the context of these two barriers and conclude with recommendations for how to employ active learning in new domains. As an example, we report on the use of active learning on a large, novel data set of Mars surface images.

Lu, Steven↗

Evaluation of a Remote Data Collection Method to Study Human-Automation Interaction and Workload

Technological advances have increased the automation of Uncrewed Aerial Vehicles, allowing human operators to manage multiple vehicles at a high-level without the need to understand low-level system behaviors. Previous laboratory studies have explored the relationship between reliability, trust, use of automation and the effects of number of vehicles under supervision on subjective workload. Due to the limitations resulting from the COVID-19 pandemic, in-person laboratory studies are not always possible. Therefore, this work aimed to investigate if remote data collection alternatives, such as Amazon’s Mechanical Turk, can provide comparative results as those obtained in laboratory settings. A study was conducted in the context of small drone operations. As expected, higher reliability led to higher trust ratings and the inclusion of more vehicles led to higher workload. In contrast, reliability unexpectedly had no effect on intention to use the automation. Though these results were encouraging, several limitations were identified.

trust↗

NASA HAT Lab Activities

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust).

multi-vehicle control↗

Uncrewed Lunar Surface Operations and Support Activities

Sustained human presence on the surface of the Moon and future missions to Mars require increased independence from surface crews and Earth-based mission control to operate efficiently, safely, and reliably. The time for surface crews to perform tasks will be limited. Extravehicular activities by surface personnel are burdensome and time-consuming, even when a continuous human presence on the surface occurs. Identifying and balancing human/automation roles and tasks and infusing automation and autonomy practices early in a system’s lifecycle will be essential to achieve mission objectives. Among these objectives are attaining a sustained human presence, improving performance and mission effectiveness, reducing operations and maintenance (O&M) costs, and ensuring operations that are robust to communication delays. To achieve these objectives, an operational shift toward increased automation and autonomy with less reliance on humans is needed. Uncrewed lunar surface operations and support activities occur when surface crews are not present or are independent of surface crew timeline activities requiring no surface crew oversight or intervention. These uncrewed surface opportunities can also be planned to minimize crew workload that avoids routine maintenance and support tasks, thus maximizing crew exploration time. Uncrewed preparations such as staging and prepositioning equipment and materials before the crew arrives could improve crew task efficiency. Additional opportunities exist to conduct uncrewed science, exploration, and utilization. Uncrewed surface architecture functions can include science and exploration; habitation; launch and landing support; surface communication and navigation; surface power generation and distribution; human surface mobility; lifting, handling, manipulating; excavation, construction, and site preparation; logistics management; maintenance and repair; surface resource utilization; integrated site operations and shared support services (e.g., site scheduling/prioritization, dust mitigation/contamination control, and surface safety). Early robotic lunar surface campaigns will provide information on the availability of resources, such as oxygen and water, and demonstrate surface-based technologies. After the Artemis III human lunar return mission, a series of landers will deliver surface systems, cargo, supplies, science packages, spare parts, and commodities. A balance of crewed and uncrewed surface operations will enable a sustained lunar surface presence at the South Pole of the Moon at a site that will be known as the Artemis Base Camp (ABC). It is envisioned that base camp operations on and around the Moon will then help prepare for the mission durations and activities needed to support the first human mission to Mars. Before long-duration crew missions to the base camp can occur, the necessary surface infrastructure will be pre-deployed and verified operational. Surface assets will be teleoperated and remotely managed from Earth. Additionally, robotic and short-duration crewed missions to the ABC will ensure the site’s merit to achieve long-term science objectives, availability of usable resources, and that terrain, seasonal variations, and illumination conditions are acceptable. ABC will consist of different areas where specific functions and services are rendered, including: • Launch and Landing Area • Habitation Area • Power Production Area • Resource Areas Launch and Landing Area—The launch and landing area will support associated functions for the arrival and departure of vehicles, such as crewed landing and ascent and uncrewed cargo deliveries and offloading. It will evolve from an unimproved site at the beginning of the exploration campaign to a more sustainable landing and launch area that can support repeated arrivals and departures. Initial uncrewed Lunar Terrain Vehicle (LTV) surface operations may include emplacement of navigation beacons and communication equipment, real-time video and photography of landing/liftoff events, and element repositioning, such as portable utility power (PUP) (applicable for other landed assets at other areas). Site preparations, such as surface leveling, soil compaction, and berm/path construction, may be needed for a more sustainable launch and landing area capable of accommodating vehicles that are increasingly more reusable and reduce the effects of plume surface interactions and ejecta impacts on nearby surface assets. During the ABC missions, cargo and logistics will be delivered to the lunar surface via robotic cargo landers before the crew arrives. These shipments, which can arrive in pressurized logistics carriers, will deliver the logistics necessary to support a crewed mission and include items such as food, water, equipment spares, etc. Providing the capability to retrieve, offload, and transport the logistics closer to the ABC site before the arrival of the crew will increase the overall efficiency of crew operations once they arrive. In the sustained phase of exploration, other supporting services may be needed, such as lander propellant servicing, surface power services, commodity refreshes, and additional inspection, maintenance, and repair capabilities, to sustain a cadence of extended personnel stays and cargo arrivals and departures. Habitation Area—Uncrewed support to surface habitation could involve supporting activation and pre-entry operations of the habitat while the crew is in orbit at the Gateway outpost preparing for a surface landing. Surface Habitat (SH) uncrewed operations may include bringing the cabin environment to a habitable temperature and air mix and activating other critical crew support systems. Potential crop production uncrewed tasks in the SH could also include autonomous watering and tending. Additionally, when the crew departs, the SH enters dormancy for the long period of uncrewed operation. A logistical staging area could also be collocated near the SH. If so, staging operations for crew supplies, waste re-location, and recycling operations may be opportunities for uncrewed operations. Power Production Area—The Fission Surface Power (FSP) element and its supporting distribution equipment provide power to surface elements as needed across the ABC to supplement day-to-day operations and survive lunar nights. Uncrewed support of this power system includes any initial LTV-assisted deployments of cables and other distributed equipment, associated electrical connections, and system testing and activation operations. Robotically performing some inspections, maintenance, or repair tasks on the power distribution equipment could reduce the surface crew workload. Resource Area— Uncrewed resource prospecting, mapping, and characterizing possible resource sites is likely to be time-consuming and represents an opportunity for uncrewed operations between crewed missions. Uncrewed mobile equipment operations will be needed in the extreme environments of permanently shadowed locations where resource extractions occur. As In-Situ Resource Utilization (ISRU) pilot plant operations begin, uncrewed surface support activities with available mobile and portable assets (LTV, PUP, etc.) will better support these operations. Any produced commodities can be stored at a centralized storage location for future use. Also associated with these operations is the use of mobile robotic excavators for resource acquisition and robotic/autonomous regolith processing. The waste tailings generated during excavation and regolith processing would also need to be transported and deposited at a dedicated location. Surface assets will continue operating between crew visits to maintain surface capabilities, conduct lunar surface science, technology demonstrations, and public outreach opportunities. Additionally, certain sustaining tasks that would consume valuable crew time could be performed before crew arrival, or after their departure. This capability may offer more affordable options to construct, activate, test, and maintain a broad set of surface assets. Telerobotically operated human surface mobility systems, such as the LTV and Pressurized Rover (PR), can be utilized for various tasks. Surface environmental conditions pose a distinct challenge for all these activities. Surface illumination and localized shadows are one such factor. Night-survival operations could consist of thermal management, battery pre-charging, and load shedding. Some surface systems may hibernate through the night and then awake and continue nominal operations. Uncrewed mobile assets may use a more adaptive approach to optimize their power and operations; one method is to follow the sunlight. Night-survival operations may be initiated remotely by teleoperation, automated, or accomplished by supervised autonomous operation. The ability to pre-deploy and control remote assets in orbit or on Mars before the arrival of the mission crew is a key capability that can be simulated on the moon. The base camp provides a venue where these advanced operational concepts, technologies, and autonomous methods and techniques, including the incorporation of time delays to simulate Earth-Mars latency can be replicated to help buy down future Mars mission risks. This paper will examine the evolution of uncrewed lunar surface operations and support activities. It will also discuss the lunar surface environmental conditions (thermal, lighting, terrain, topography, communications) along with the challenges they pose on uncrewed surface operations, and the performance of these activities with limited to minimal human interaction and/or teleoperation. Since lunar missions include Mars mission analogs, such investigation provides the framework for future uncrewed Mars mission support.

Mark E Lewis↗

m:N Working Group

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the background and progress of the m:N working group.

multi-vehicle control↗

Future Operations

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the future of GCS control stations and need for Human Systems Integration.

multi-vehicle control↗

m:N Operations and Future

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N).This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT).This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the barriers and requirements for future m:N operations.

multi-vehicle control↗

Very High-Resolution Satellite-Derived Bathymetry and Habitat Mapping Using Pleiades-1 and ICESat-2

Accurate and reliable bathymetric data are needed for a wide diversity of marine research and management applications. Satellite-derived bathymetry represents a time saving method to map large shallow waters of remote regions compared to the current costly in situ measurement techniques. This study aims to create very high-resolution (VHR) bathymetry and habitat mapping in Mayotte island waters (Indian Ocean) by fusing 0.5 m Pleiades-1 passive multispectral imagery and active ICESat-2 LiDAR bathymetry. ICESat-2 georeferenced photons were filtered to remove noise and corrected for water column refraction. The bathymetric point clouds were validated using the French naval hydrographic and oceanographic service Litto3D® dataset and then used to calibrate the multispectral image to produce a digital depth model (DDM). The latter enabled the creation of a digital albedo model used to classify benthic habitats. ICESat-2 provided bathymetry down to 15 m depth with a vertical accuracy of bathymetry estimates reaching 0.89 m. The benthic habitats map produced using the maximum likelihood supervised classification provided an overall accuracy of 96.62%. This study successfully produced a VHR DDM solely from satellite data. Digital models of higher accuracy were further discussed in the light of the recent and near-future launch of higher spectral and spatial resolution satellites.

Bathymetry↗

Attentional Considerations in Advanced Air Mobility Operations: Control, Manage, or Assist?

The implementation of automation will enable Advanced Air Mobility (AAM), which could alter the hu-man’s responsibilities from those of an active controller to a passive monitor of vehicles. Mature AAM operations will likely rely on both experienced and novice operators to supervise multiple aircraft. As AAM constitutes a complex and increasingly autonomous system, the human operator’s set of responsibilities will transition from those of a controller, to a manager, and eventually to an assistant to highly automated systems. The development of AAM will require system designers to characterize these three sets of human responsibilities. The present work proposes different human responsibilities across various roles (i.e., pilot in command, system operator, system assistant) in the context of AAM along with pertinent attention-related constructs that could contribute to each of the three identified roles of AAM operators including situation awareness, workload, complacency, and vigilance.

Advanced Air Mobility↗

Dense Feature Tracking of Atmospheric Winds with Deep Optical Flow

Atmospheric winds are a key physical phenomenon impacting natural hazards, energy transport, ocean currents, large-scale circulation, and ecosystem fluxes. Observing winds is a complex process and presents a large gap in NASA’s Earth Observation System. Atmospheric motion vectors (AMVs) aim to fill this gap by making numerical estimates of cloud movement between sequences of multi-spectral satellite images, tracking clouds and water vapor. Recent imaging hardware and software advancements have enabled the use of numerical optical flow techniques to produce accurate and dense vector fields outperforming traditional methods. This work presents WindFlow as the first machine learning based system for feature tracking atmospheric motion using optical flow. Due to the lack of large-scale satellite-based observations, we leverage high-resolution numerical simulations from NASA's GEOS-5 Nature Run to perform supervised learning and transfer to satellite images. We demonstrate that our approach using deep learning based optical flow scales to ultra-high-resolution images of size 2881x5760 with less than 1 m/s bias and 2.5 m/s average error. Four network and learning architectures are compared and it is found that recurrent all-pairs field transforms (RAFT) produces the lowest errors on all metrics for wind speed and direction. Results on held out numerical outputs shows RAFT's good performance in each of the spatial, temporal, and physical dimensions. A comparison between WindFlow and an operational AMV product against rawinsonde observations show that RAFT transfers across simulations and thermal infrared satellite observations. This work shows that machine learning based optical flow is an efficient approach to generating robust feature tracking for AMVs consistently over large regions.

Atmospheric winds↗

Astrobee's Multi-year Activities at the International Space Station's Japanese Experimental Module

The Astrobee free-flying robots recently completed their third successful year of operations, housed in the Japanese Experimental Module (JEM) on the International Space Station. We summarize the three years of operation, giving special attention to JAXA's 1st and 2nd Kibo Robot Programming Challenge (RPC) and the mapping processes and tools that make Astrobees' autonomous operation possible. The JEM is an ever changing, dynamic environment where light settings, cargo, payloads, and crew members constantly move and interact with one another. The 1st JAXA Kibo RPC event, a collaboration between JAXA and NASA, was held in 2020. Students from several countries in the Asia-Pacific region competed in programming challenges with a simulated Astrobee. The finalists were then invited to run their code on an actual Astrobee in the JEM. For the final round, students programmed Astrobee to visit three different locations to obtain data that would instruct the robot to complete a final task with the participation of ISS crew. The first competition was a tremendous success, leading to an equally successful 2nd JAXA Kibo RPC in 2021 with even larger participation. The 3rd JAXA Kibo RPC will occur in 2022 expanding further to incorporate US participants. These activities led to several firsts in Astrobee’s history: operation of an Astrobee free-flying robot without crew supervision in preparation for on-orbit operations, autonomous image acquisition towards updates of the navigation map, non-NASA code running on the robot (both from JAXA and participating students), two heterogeneous free-flying robots from two different space agencies working together (Int-Ball and Astrobee) during the final event in 2020, the first payload using Astrobee, and having Astrobee controlled from a non-NASA location (Tsukuba Space Center). The preparation towards these activities involved constant evaluation of the different components of Astrobee's systems, specially mapping and localization. The paper describes the evolution of these systems such as the improvements made in localization to reduce localization drift by using graph-based optimization instead of the extended Kalman Filter localizer. Additionally, it reports on the mapping process and analysis tools created to validate map consistency across different activities in the constantly changing JEM environment. These enhancements have enabled the Astrobee facility to successfully execute over 100 ISS activities supporting over a dozen researchers and partners around the world.

Astrobee↗