Using Artificial Intelligence Planning to Automate SAR Image Processing for Scientific Data Analysis
In recent times, improvements in imaging technology have made available an incredible array of information in image format.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
In recent times, improvements in imaging technology have made available an incredible array of information in image format.
The development of autonomy capabilities is the key to three vastly important strategic technical challenges facing NASA: the reduction of mission costs, the continuing return of quality science products through limited communications bandwidth, and the launching of a new era of solar system exploration characterized by sustained presence and in-depth scientific studies, including the search for life. Autonomy will benefit future NASA missions by migrating routine, traditionally ground-based functions to the spacecraft, by directly supporting the decoupling of spacecraft from the ground through new operations concepts, by enabling direct links between scientists and the space platforms carrying their instruments of investigation, and by the closing, of planning and control loops onboard, enabling space platforms to directly address uncertainty in the real-time mission context. The talk will survey ongoing, autonomy technology development projects at NASA, many of which have been or will soon be the subject of flight technology experiments, or are already targeted for mission use. The talk will also survey the exciting suite of future NASA space exploration missions, and make the case for the central role of autonomy in achieving the goals of these bold, unprecedented missions: cooperating rovers on the surface of Mars, the search for Earth-like planets around nearby stars, asteroid and comet landers, aerobots in planetary atmospheres, and a series of missions to intriguing Europa, perhaps culminating in a submersible to investigate its putative ocean. Finally, the talk will conclude with some farther-reaching speculations on how to create properties such as long-term survivability and evolvability in future space systems, such that they will be well equipped to extend humanity exploratory presence into the interstellar realm.
Artificial Intelligence has been recognized as one of the most powerful tools for scientific research. It has a wide range of applications in atmospheric science and plays a significant role in advancing our understanding of the Earth-Atmosphere system, as well as improving our ability to monitor, predict, and respond to atmospheric observations and simulations. Different AI architectures can help us handle various problems according to our research goals. In this presentation, we will introduce several use cases and models for applying computer vision to active remote sensing data from CALIOP, analyzing cloud dynamical relationships for climate model parameterizations, and building surrogate models for lidar simulations. The presentation will highlight the advantages that AI offers compared to traditional analytical methods. By assembling pieces of the multidimensional atmospheric science puzzle, we can integrate our knowledge from observations to simulations.
About 40% of the budget of a scientific spacecraft mission is usually consumed by Mission Operations & Data Analysis (MO&DA) with MO driving these costs. In the current practice, MO is separated from spacecraft design and comes in focus relatively late in the mission life cycle. As a result, spacecraft may be designed that are very difficult to operate. NASA centers have extensive MO expertise but often lessons learned in one mission are not exploited for other parallel or future missions. A significant reduction of MO costs is essential to ensure a continuing and growing access to space for the scientific community. We are addressing some of these issues with a highly automated payload operations and command system for an existing mission, the Extreme Ultraviolet Explorer (EUVE). EUVE is currently operated jointly by the Goddard Space Flight Center (GSFC), responsible for spacecraft operations, and the Center for Extreme Ultraviolet Astrophysics (CEA) of the University of California, Berkeley, which controls the telescopes and scientific instruments aboard the satellite. The new automated system is being developed by a team including personnel from the NASA Ames Research Center (ARC), the Jet Propulsion Laboratory (JPL) and the Center for EUV Astrophysics (CEA). An important goal of the project is to provide AI-based technology that can be easily operated by nonspecialists in AI. Another important goal is the reusability of the techniques for other missions. Models of the EUVE spacecraft need to be built both for planning/scheduling and for monitoring. In both cases, our modeling tools allow the assembly of a spacecraft model from separate sub-models of the various spacecraft subsystems. These sub-models are reusable; therefore, building mission operations systems for another small satellite mission will require choosing pre-existing modules, reparametrizing them with respect to the actual satellite telemetry information, and reassembling them in a new model. We briefly describe the EUVE mission and indicate why it is particularly suitable for the task. Then we briefly outline our current work in mission planning/scheduling and spacecraft and instrument health monitoring.
The National Aeronautics and Space Administration is currently funding research into the design of a Mars rover vehicle. This unmanned rover will be used to explore a number of scientific and geologic sites on the Martian surface. Since the rover can not be driven from Earth in real-time, due to lengthy communication time delays, a locomotion strategy that optimizes vehicle range and minimizes potential risk must be developed. In order to assess the degree of on-board artificial intelligence (AI) required for a rover to carry out its' mission, researchers conducted an experiment to define a no AI baseline. In the experiment 24 subjects, divided into stereo and monoscopic groups, were shown video snapshots of four terrain scenes. The subjects' task was to choose a suitable path for the vehicle through each of the four scenes. Paths were scored based on distance travelled and hazard avoidance. Study results are presented with respect to: (1) risk versus range; (2) stereo versus monocular video; (3) vehicle camera height; and (4) camera field-of-view.
Foundation Models (FMs), AI models designed to replace task-specific models, are increasingly being recognized for their versatility across numerous downstream applications. These models, trained using self-supervised techniques on any type of sequence data, circumvent the need for large annotated datasets, a major bottleneck in traditional AI model development. FMs can be applied to downstream tasks using few-shot learning and fine-tuning, significantly reducing the need for large labeled training datasets and computational resources. However, the development of FMs requires substantial resources, including access to data and compute power, expertise in the latest models, and specialized scientific knowledge for systematic evaluation. It is challenging for a single group to possess all these capabilities. To address this, NASA IMPACT has initiated an open collaborative effort, leveraging partnerships with the private sector and other groups within and outside NASA, to jointly build FMs. The overarching goal is to develop a consistent and collaborative approach to building FMs for high-value science datasets. This initiative has fostered collaboration within NASA and with external partners, including IBM Research, Clark University, DOE’s ORNL, ESA, and USGS. The effort focuses on identifying key datasets with a wide range of downstream applications, pretraining and building FMs using modified transformer architectures, evaluating compute infrastructure needs, and sharing models, pretraining and fine-tuning code, and data with the community. Furthermore, it aims to train the Earth science community to fine-tune these models for various downstream applications. Our initial effort resulted in the creation of a 100 million parameter HLS Geospatial Model within six months, which was released on HuggingFace. We are now expanding our scope to include data from weather and climate models and investigating multimodal models. We invite those interested in participating in this effort to join us by sharing their use cases, expertise, or data.
The present work describes the mission operations system (MOS) design process for remote-sensing missions. A MOS is defined as the system required to perform, monitor, and control an operation, encompassing personnel, hardware, software and/or documentation. Attention is given to telecommunications and remote-sensing instrumentation, MOS definition program phases and reviews, and MOS organization, management, and staffing. Also treated are the uplink and downlink processes, anomalies and contingency plans, the illustrative case of the MOS for the Magellan radar sensing mission, and a projection of future MOSs incorporating AI.
This paper represents a progress report on HyLite (Hypermedia Library technology): a research and development activity to produce a versatile system as part of NASA's technology thrusts in automation, information sciences, and communications. HyLite can be used as a system or tool to facilitate the creation and maintenance of large distributed electronic libraries. The contents of such a library may be software components, hardware parts or designs, scientific data sets or databases, configuration management information, etc. Proliferation of computer use has made the diversity and quantity of information too large for any single user to sort, process, and utilize effectively. In response to this information deluge, we have created HyLite to enable the user to process relevant information into a more efficient organization for presentation, retrieval, and readability. To accomplish this end, we have incorporated various AI techniques into the HyLite hypermedia engine to facilitate parameters and properties of the system. The proposed techniques include intelligent searching tools for the libraries, intelligent retrievals, and navigational assistance based on user histories. HyLite itself is based on an earlier project, the Encyclopedia of Software Components (ESC) which used hypermedia to facilitate and encourage software reuse.
Project Overview This project is focused on developing technologies that enable construction of a Lunar Safe Haven type structure on the moon. A full scale architectural and structural design will be completed based on lunar conditions and Artemis mission needs. A scaled structure will be 3D printed in simulated lunar environments. Technical Approach Polymer bound regolith composite materials will be developed and characterized for lunar additive construction applications. A full scale architectural and structural design will be completed based on the latest scientific data on lunar environments including radiation, meteoroids, thermal conditions, reduced gravity, and moonquakes. The project will culminate with a demonstration of additive construction in simulated lunar vacuum, thermal, regolith, and UV conditions. Results/Summary Preliminary material specifications have been developed and an initial batch has been produced. A first iteration of the architectural and structural designs have been completed. Hardware for 3D printing in simulated lunar conditions is under development. Contributing Partners AI Space Factory – Winner of the NASA 3D Printed Habitat Centennial Challenge Infusion and Transition Plan On-surface construction of infrastructure is a critical capability of the sustainable phase of the Artemis Program and eventual sustainable human presence on Mars. It provides the ability to create protective shelters on-demand using local resources. The 3D-printing technology will achieve TRL 6 in 1g/vacuum tests with thermal/UV exposure in this project. CLPS missions will be pursued for infusion to demonstrate vertical construction with lunar regolith and conditions. Modeling and simulation will be used to define the pilot-scale shelter construction mission for long-term exposure on the lunar surface to validate the system for Artemis operational deployment.
Development of an Intelligent Information System (IIS) involves application of numerous artificial intelligence (AI) paradigms and advanced technologies. The National Aeronautics and Space Administration (NASA) is interested in an IIS that can automatically collect, classify, store and retrieve data, as well as develop, manipulate and restructure knowledge regarding the data and its application (Campbell et al., 1987, p.3). This interest stems in part from a NASA initiative in support of the interagency Global Change Research program. NASA's space data problems are so large and varied that scientific researchers will find it almost impossible to access the most suitable information from a software system if meta-information (metadata and meta-knowledge) is not embedded in that system. Even if more, faster, larger hardware is used, new innovative software systems will be required to organize, link, maintain, and properly archive the Earth Observing System (EOS) data that is to be stored and distributed by the EOS Data and Information System (EOSDIS) (Dozier, 1990). Although efforts are being made to specify the metadata that will be used in EOSDIS, meta-knowledge specification issues are not clear. With the expectation that EOSDIS might evolve into an IIS, this paper presents certain ideas on the concept of meta-knowledge and demonstrates how meta-knowledge might be represented in a pixel classification problem.
NASA’s Artemis program has the lofty goal of creating a sustained lunar presence to provide unprecedented opportunities for scientific discovery and to ensure American industry’s access to the unlimited resources and commercial potential in space. To achieve this goal, NASA must incrementally develop and expand its capabilities beyond the short lunar stays of the Apollo program to a robust continued presence with infrastructure and equipment to reduce mission risk by providing safer and more reliable access to the surface, its resources, and protection from the environment. Kennedy Space Center’s Swamp Works Granular Mechanics and Regolith Operations laboratory has partnered with AI SpaceFactory to develop the architectural and structural design of a robotically constructable unpressurized shelter. The shelter, called Lina is designed to protect astronauts and surface assets from radiation, meteoroid impact, moon quakes and thermal gradients. A Fused Filament Fabrication (FFF) construction process using regolith polymer composites was developed. The construction system and associated print parameters are discussed along with the environmental simulation equipment and a summary of test conditions. Test samples were printed in simulated lunar dirty thermal vacuum conditions (~-180 C, ~10-3 torr) and subjected to a series of tests. The resulting strength properties are summarized here, the full details of the material characteristics are provided in a related paper. Lina’s structural design criteria and the resulting initial structure design are detailed in two related papers, this paper presents an update to Lina’s design based on the achieved material strength properties. Finally, a scaled down version of the updated Lina was built on a regolith simulant surface using a novel anchoring technique in simulated lunar vacuum conditions.
This report contains information on the activities of the Artificial Intelligence Research Branch (FIA) at NASA Ames Research Center (ARC) in 1992, as well as planned work in 1993. These activities span a range from basic scientific research through engineering development to fielded NASA applications, particularly those applications that are enabled by basic research carried out in FIA. Work is conducted in-house and through collaborative partners in academia and industry. All of our work has research themes with a dual commitment to technical excellence and applicability to NASA short, medium, and long-term problems. FIA acts as the Agency's lead organization for research aspects of artificial intelligence, working closely with a second research laboratory at the Jet Propulsion Laboratory (JPL) and AI applications groups throughout all NASA centers. This report is organized along three major research themes: (1) Planning and Scheduling: deciding on a sequence of actions to achieve a set of complex goals and determining when to execute those actions and how to allocate resources to carry them out; (2) Machine Learning: techniques for forming theories about natural and man-made phenomena; and for improving the problem-solving performance of computational systems over time; and (3) Research on the acquisition, representation, and utilization of knowledge in support of diagnosis design of engineered systems and analysis of actual systems.
Short-latency vestibular-evoked potentials to pulsed linear acceleration were characterized in the quail. Responses occurred within 8 ms following the onset of stimuli and were composed of a series of positive and negative peaks. The latencies and amplitudes of the first four peaks were quantitatively characterized. Mean latencies at 1.0 g ms-1 ranged from 1265 +/- 208 microseconds (P1, N = 18) to 4802 +/- 441 microseconds (N4, N = 13). Amplitudes ranged from 3.72 +/- 1.51 microV (P1/N1, N = 18) to 1.49 +/- 0.77 microV (P3/N3, N = 16). Latency-intensity (LI) slopes ranged from -38.7 +/- 7.3 microseconds dB-1 (P1, N = 18) to -71.6 +/- 21.9 microseconds dB-1 (N3, N = 15) and amplitude-intensity (AI) slopes ranged from 0.20 +/- 0.08 microV dB-1 (P1/N1, N = 18) to 0.07 +/- 0.04 microV dB-1 (P3/N3, N = 11). The mean response threshold across all animals was -21.83 +/- 3.34 dB re: 1.0 g ms-1 (N = 18). Responses remained after cochlear extirpation showing that they could not depend critically on cochlear activity. Responses were eliminated by destruction of the vestibular end organs, thus showing that responses depended critically and specifically on the vestibular system. The results demonstrate that the responses are vestibular and the findings provide a scientific basis for using vestibular responses to evaluate vestibular function through ontogeny and senescence in the quail.
This document describes the progress and plans of the Artificial Intelligence Research Branch (RIA) at ARC in 1990. Activities span a range from basic scientific research to engineering development and to fielded NASA applications, particularly those applications that are enabled by basic research carried out at RIA. Work is conducted in-house and through collaborative partners in academia and industry. Our major focus is on a limited number of research themes with a dual commitment to technical excellence and proven applicability to NASA short, medium, and long-term problems. RIA acts as the Agency's lead organization for research aspects of artificial intelligence, working closely with a second research laboratory at JPL and AI applications groups at all NASA centers.
NASA’s Artemis Program seeks to establish a long-term presence on the moon to enable scientific discoveries and utilization of lunar resources through public-private partnerships. Over the next decades, a lunar spaceport enabling regular transportation from and to Earth will need to be established to provide the services and facilities that are necessary to achieve this goal. Robotic construction technologies using in-situ materials must be developed to build up enabling infrastructure such as launch/landing pads, blast protection, power/communications towers, improved trafficability pathways and radiation protection shelters. Kennedy Space Center’s Granular Mechanics and Regolith Operations laboratory at Swamp Works has partnered with AI SpaceFactory to develop the architectural and structural design of an unpressurized shelter. The shelter, called Lina, is designed to protect astronauts and surface assets from radiation, meteoroid impact, moon quakes and thermal gradients. Lina’s structural design criteria and the resulting structure design are detailed in separate papers. A Fused Filament Fabrication (FFF) construction process using regolith polymer composites has been developed. This paper presents the material formulations and selection rationale for each of the composite components. Formulations include 70:30, 80:20, and 85:15 wt.% mixture ratios of lunar mare simulant Black Point-1 (BP-1): Polylactic Acid (PLA), 80:20 Lunar Highlands Simulant (LHS-1): PLA and an 80:20 BP-1:PLA formulation with a processing aid/compatibilizer additive. Test samples were printed in simulated lunar dirty thermal vacuum conditions (~-180 °C, ~10 -3 torr). The test environment evolved throughout the duration of the print process. A series of tests were performed to characterize the mixture ratios achieved for each formulation, the off-gassing products during vacuum printing, the strength properties, and porosity of printed products. The LHS-1: PLA formulation yielded an advantageous combination of properties and was used in a final test that additively constructed a sub-scaled Lina on regolith simulant in dirty vacuum conditions.
Understanding the coastal zone of the Antarctic Ice Sheet (AIS), where it interacts with the Southern Ocean and warmer air masses, is crucial for predicting Antarctica's influence on the global climate and sea level. This region has multiple tipping mechanisms that could trigger large, rapid, and potentially irreversible changes in the AIS, the Southern Ocean and their global connections in the coming centuries. The AIS remains the largest source of uncertainty in future sea-level projections. Bed topography beneath the ice shelves and the coastal ice sheet is not yet well documented, and is a major source of this uncertainty. This review assesses current knowledge of the coastal zone and highlights methods to investigate it, including aerogeophysical surveys, ground- and ship-based measurements, satellite observations, and computer modeling. An ensemble analysis of published bed topography data sets identifies significant data gaps and their regional distribution, framed in the context of current ice-sheet behavior and potential instability. We propose scientific priorities and guidelines for future aerogeophysical surveys, advocating for a comprehensive, coordinated international effort to build a next-generation data set of Antarctic bed properties. Such an initiative would significantly advance understanding of the role of coastal processes in ice-sheet dynamics, reducing uncertainties in sea-level rise projections and improving predictions of future ocean and climate changes.
The Mars Exploration Rovers Mars '03 mission is one of NASA's most ambitious science missions to date. The rovers will be launched in the summer of 2003 with each rover carrying instruments to conduct remote and in-situ observation to elucidate the planet's past climate, water activity, and habitability. Science is the primary driver of MER and, as a consequence, making best use of the scientific instruments, within the available resources, is a crucial aspect of the mission. To address this critically, the MER project has selected MAPGEN (Mixed-Initiative Activity Plan GENerator) as an activity planning tool. MAPGEN combines two exiting systems, each with a strong heritage: APGEN the Activity Planning tool from the Jet Propulsion Laboratory and the Europs Planning/Scheduling system from NASA Ames Research Center. This paper discusses the issues arising from combining these tools in the context of this mission.
Mixed-Initiative Activity Plan Generator (MAPGEN) is a ground-based computer program for planning and scheduling the scientific activities of instrumented exploratory robotic vehicles, within the limitations of available resources onboard the vehicle. MAPGEN is a combination of two prior software systems: (1) an activity-planning program, APGEN, developed at NASA s Jet Propulsion Laboratory and (2) the Europa planner/scheduler from NASA Ames Research Center. MAPGEN performs all of the following functions: Automatic generation of plans and schedules for scientific and engineering activities; Testing of hypotheses (or what-if analyses of various scenarios); Editing of plans; Computation and analysis of resources; and Enforcement and maintenance of constraints, including resolution of temporal and resource conflicts among planned activities. MAPGEN can be used in either of two modes: one in which the planner/scheduler is turned off and only the basic APGEN functionality is utilized, or one in which both component programs are used to obtain the full planning, scheduling, and constraint-maintenance functionality.