Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “collective intelligence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

A shared-world conceptual model for integrating space station life sciences telescience operations

Mental models of the Space Station and its ancillary facilities will be employed by users of the Space Station as they draw upon past experiences, perform tasks, and collectively plan for future activities. The operational environment of the Space Station will incorporate telescience, a new set of operational modes. To investigate properties of the operational environment, distributed users, and the mental models they employ to manipulate resources while conducting telescience, an integrating shared-world conceptual model of Space Station telescience is proposed. The model comprises distributed users and resources (active elements); agents who mediate interactions among these elements on the basis of intelligent processing of shared information; and telescience protocols which structure the interactions of agents as they engage in cooperative, responsive interactions on behalf of users and resources distributed in space and time. Examples from the life sciences are used to instantiate and refine the model's principles. Implications for transaction management and autonomy are discussed. Experiments employing the model are described which the authors intend to conduct using the Space Station Life Sciences Telescience Testbed currently under development at Ames Research Center.

Johnson, Vicki↗

Mass Inferencing Model Creation and Deployment to the RASSOR Lunar Excavation Robot

The Regolith Advanced Surface Systems Operations Robot (RASSOR) Excavator is a mobile robotic bucket-drum excavator platform with a unique space regolith excavation capability. The Intelligent Capabilities Enhanced RASSOR research project developed functionality for estimating the quantity of regolith mass ingested during RASSOR operation, enhancing RASSOR’s ability to successfully complete In-Situ Resource Utilization (ISRU) missions. To teleoperate or run autonomously, it is crucial for the amount of regolith mass ingested to be available as a system state for efficient operation. For example, during autonomous operation, RASSOR should navigate and move to a processing plant to offload the collected regolith when the drums are full; without knowledge of the total mass in the drums, this type of high-level planning is not possible. Three distinct modeling approaches were employed in developing a mass inferencing approach that could work on RASSOR, none of which require modification to the hardware. All take in system states, such as arm/drum motor positions, velocities, currents, voltages, and robot pose, and output a mass prediction for each set of the robot’s bucket drums. The developed models run in real-time, outputting predictions for the front drum mass, rear drum mass, timestamp of the last prediction, and total drum mass (sum of front and rear) in RASSOR’s drums. Models deployed to the hardware have low error (<7.5% mean error over the mass range, and <2.6% mean error when drums are more than half full) when making predictions in real-time. Our modeling approach can be adapted to use lunar excavation data to create models that are reflective of RASSOR’s dynamics when operating on the lunar surface. The results of this work are promising and show that models can be developed to accurately estimate excavated regolith mass.

Bucket Drum Excavators↗

Mass Inferencing Model Creation and Deployment to the RASSOR Lunar Excavation Robot

The Regolith Advanced Surface Systems Operations Robot (RASSOR) Excavator is a mobile robotic bucket-drum excavator platform with a unique space regolith excavation capability. The Intelligent Capabilities Enhanced RASSOR research project developed functionality for estimating the quantity of regolith mass ingested during RASSOR operation, enhancing RASSOR’s ability to successfully complete In-Situ Resource Utilization (ISRU) missions. To teleoperate or run autonomously, it is crucial for the amount of regolith mass ingested to be available as a system state for efficient operation. For example, during autonomous operation, RASSOR should navigate and move to a processing plant to offload the collected regolith when the drums are full; without knowledge of the total mass in the drums, this type of high-level planning is not possible. Three distinct modeling approaches were employed in developing a mass inferencing approach that could work on RASSOR, none of which require modification to the hardware. All take in system states, such as arm/drum motor positions, velocities, currents, voltages, and robot pose, and output a mass prediction for each set of the robot’s bucket drums. The developed models run in real-time, outputting predictions for the front drum mass, rear drum mass, timestamp of the last prediction, and total drum mass (sum of front and rear) in RASSOR’s drums. Models deployed to the hardware have low error (<7.5% mean error over the mass range, and <2.6% mean error when drums are more than half full) when making predictions in real-time. Our modeling approach can be adapted to use lunar excavation data to create models that are reflective of RASSOR’s dynamics when operating on the lunar surface. The results of this work are promising and show that models can be developed to accurately estimate excavated regolith mass.

bucket drum excavators↗

Presound: UAV Diagnostic System Enabled by Vibration-Based Machine Learning

A low-weight, inexpensive small unmanned aerial system (sUAS) that takes off, performs a mission, lands, and safely stows and recharges itself has myriad future applications ranging from agricultural imaging to last-mile package delivery. Likewise, Urban Air Mobility (UAM) systems will enable people to take air taxis from point to point in cities, rapidly moving commuters long distances without concern for road traffic and congestion. Fully electric aviation systems will be cleaner and quieter than ground transport. Cities could eliminate cars and buses, and convert roads to higher capacity bike and pedestrian throughways. Yet, for sUAS as well as UAM, system reliability and assurance is a limiting factor to deploying affordable autonomous flight systems. For this bright future of aviation to be realized, aircraft must be able to autonomously and accurately self-diagnose health issues both before takeoff and during flight. The GreenSight PreSound system is designed to identify defects on aircraft through intelligent analysis of vibration. It accomplishes this by measuring structural vibrations induced by the vehicle’s own propellers, and analyzing that data using a machine learning model that determines whether a defect is present. The PreSound system is designed to require no human oversight, and to operate across a wide array of vehicles through re-training of the model for each target aircraft. PreSound has been developed and seen limited early success using data collected from the GreenSight Dreamer sUAS, a 5lb quadrotor vehicle designed for aerial imaging applications. The final detection model, trained on data with props spinning at 50% throttle, achieves excellent performance with over 99% average accuracy in detecting blade damage using a single FFT vector input. It demonstrates the ability to generalize to new types of blade damage, correctly classifying a different type of blade damage with 98% accuracy. Full test pulses were classified with 100% accuracy, and in live testing, all sets of data during blade movement were classified accurately with over 95% confidence. When trained on in-flight data, the same model achieves an average accuracy of 85% in distinguishing between undamaged and blade-damaged states in flight. The authors believe that these accuracies show significant potential of this approach to expand unmanned flight safety, with significant potential benefits in accelerating Advanced Aerial Mobility (AAM) and UAM aviation applications.

UAS↗

NASA Pilot-Engaged Expert Response Using IBM Watson Technology: Prototype Evaluation of Knowledge Retrieval System

NASA Langley Research Center and IBM have been investigating the use of IBM Watson technology in aerospace research and development. One application of Watson technology is the Pilot-Engaged Expert Response (PEER) use case. The PEER system is envisioned as an in-cockpit advisor that will act as a source of situationally-relevant information for pilots and other flight crew members to assist in decision making about real-time events and situations that arise in the course of aircraft operations. PEER will make available vast stores of knowledge and information quickly and directly, putting important informational resources where they are needed most. IBM has worked with NASA to develop an architecture and articulate a roadmap for the development of the PEER system. That vision is built around Watson Discovery Advisor (WDA) software solution, derived from IBM's Jeopardy!-winning automatic question answering system. PEER makes use of WDA's sophisticated question-answering capabilities as its core, adding important User Interface components and other customizations for the cockpit environment, including communication with flight systems and other external data sources. The development plan for PEER includes four development stages, with the current project constituting the first phase. In this project, a prototype instance of PEER was successfully adapted to the aviation domain, enabling users to ask questions about aviation topics and receive useful and accurate answers to these questions. Major tasks accomplished include the development of procedures for domain adaptation through automatic lexicon extraction from domain glossaries; generation of question-answer training data which was used to train the system; and assessment of the effectiveness of domain adaptation, which showed a dramatic improvement in the ability of the PEER system to answer domain-relevant questions. In addition, the vision for the PEER system was pushed forward by the articulation of a plan for the automatic enhancement of question-answering with contextual information. This initial phase focused on two main goals: 1) the targeted domain adaptation of the underlying WDA system to the aviation domain; and, 2) the design of the software systems needed to leverage flight-contextual data. Domain adaptation of the WDA system proceeds via three main activities: Domain data ingestion, lexical customization and model training. A textual corpus consisting of 1,147 individual documents with more than 7.5 million words of text was ingested into the system and this served as the basis of all further development. A domain lexicon of over 3,500 aviation-domain terms was semi-automatically generated from domain documents and used to train the system. In addition, a set of over 500 question-answer (QA) pairs relevant to the PEER use case was developed; these were used to train and assess the system. These important first steps established the basis for the PEER system. In addition, steps were taken towards the integration of the PEER system into the cockpit environment with the development of a functional design for the Contextual Data Augmentation (CDA) subsystem. This subsystem brings to bear contextual data to improve system responses. It has three main submodules: the Contextual Data Collection module, the Contextual Data Selection module, and the Contextual QA Augmentation module. These modules form a processing pipeline that addresses the problems associated with automatically integrating information from external resources into the knowledge-retrieval mechanism.

Machine learning↗

International Symposium on Remote Sensing of Environment, 17th, University of Michigan, Ann Arbor, MI, May 9-13, 1983, Proceedings. Volumes 1, 2 & 3

The collection, processing, and analysis of remote-sensing data from ground-based, airborne, and spaceborne instruments for application to the monitoring and management of the earth and environment and resources are examined in reviews and reports, some in summary form. Subject areas covered include US policy and directions on remote sensing (RS); the future of terrestrial RS from space; RS of land, oceans, and atmosphere from a global perspective; RS in hydrological modeling; microprocessing technology; array processors; geobased information systems; artificial intelligence; the Shuttle imaging radar; and current results from Landsat-4. Among the specific topics discussed are RS application to hydrocarbon exploration, airborne gamma-radiation assessment of snow water equivalent, surface-vegetation-biomass modeling from AVHRR and Landsat data, Landsat imagery of Mediterranean pollution, fast two-dimensional filtering of thermal-scanner data, RS of severe convective storms, registration of rotated images by invariant moments, and the geometric accuracy of Landsat-4 Thematic-Mapper P-tapes.

Source record↗

Experiences with the JPL telerobot testbed: Issues and insights

The Jet Propulsion Laboratory's (JPL) Telerobot Testbed is an integrated robotic testbed used to develop, implement, and evaluate the performance of advanced concepts in autonomous, tele-autonomous, and tele-operated control of robotic manipulators. Using the Telerobot Testbed, researchers demonstrated several of the capabilities and technological advances in the control and integration of robotic systems which have been under development at JPL for several years. In particular, the Telerobot Testbed was recently employed to perform a near completely automated, end-to-end, satellite grapple and repair sequence. The task of integrating existing as well as new concepts in robot control into the Telerobot Testbed has been a very difficult and timely one. Now that researchers have completed the first major milestone (i.e., the end-to-end demonstration) it is important to reflect back upon experiences and to collect the knowledge that has been gained so that improvements can be made to the existing system. It is also believed that the experiences are of value to the others in the robotics community. Therefore, the primary objective here will be to use the Telerobot Testbed as a case study to identify real problems and technological gaps which exist in the areas of robotics and in particular systems integration. Such problems have surely hindered the development of what could be reasonably called an intelligent robot. In addition to identifying such problems, researchers briefly discuss what approaches have been taken to resolve them or, in several cases, to circumvent them until better approaches can be developed.

Stone, Henry W.↗

Long-range communications with Pioneer 10 at Jupiter

The longest two-way telecommunications link ever established connected Pioneer 10 with its controllers and experimenters on earth during the first Jovian encounter. This radio link, operating in the 2.1 and 2.3 gigahertz frequency bands, maintained high-quality communications over a distance of 5-1/2 astronomical units. The data collected by eleven on-board advanced scientific instruments were transmitted to the investigators, providing a new wealth of information about the largest planet of the solar system. A descriptive review is presented of the spacecraft design and the ground data system configuration with an analysis of the telecommunications downlink. Pioneer 10, aided by Jupiter's gravitational field, is the first spacecraft to leave the solar system. A plaque attached to the spacecraft represents man's first attempt to send a message to another intelligence within our galaxy.

Dickerson, L. W.↗

Shuttle Topography Data Inform Solar Power Analysis

The next time you flip on a light switch, there s a chance that you could be benefitting from data originally acquired during the Space Shuttle Program. An effort spearheaded by Jet Propulsion Laboratory (JPL) and the National Geospatial-Intelligence Agency (NGA) in 2000 put together the first near-global elevation map of the Earth ever assembled, which has found use in everything from 3D terrain maps to models that inform solar power production. For the project, called the Shuttle Radar Topography Mission (SRTM), engineers at JPL designed a 60-meter mast that was fitted onto Shuttle Endeavour. Once deployed in space, an antenna attached to the end of the mast worked in combination with another antenna on the shuttle to simultaneously collect data from two perspectives. Just as having two eyes makes depth perception possible, the SRTM data sets could be combined to form an accurate picture of the Earth s surface elevations, the first hight-detail, near-global elevation map ever assembled. What made SRTM unique was not just its surface mapping capabilities but the completeness of the data it acquired. Over the course of 11 days, the shuttle orbited the Earth nearly 180 times, covering everything between the 60deg north and 54deg south latitudes, or roughly 80 percent of the world s total landmass. Of that targeted land area, 95 percent was mapped at least twice, and 24 percent was mapped at least four times. Following several years of processing, NASA released the data to the public in partnership with NGA. Robert Crippen, a member of the SRTM science team, says that the data have proven useful in a variety of fields. "Satellites have produced vast amounts of remote sensing data, which over the years have been mostly two-dimensional. But the Earth s surface is three-dimensional. Detailed topographic data give us the means to visualize and analyze remote sensing data in their natural three-dimensional structure, facilitating a greater understanding of the features and processes taking place on Earth."

Source record↗

Operations mission planner beyond the baseline

The scheduling of Space Station Freedom must satisfy four major requirements. It must ensure efficient housekeeping operations, maximize the collection of science, respond to changes in tasking and available resources, and accommodate the above changes in a manner that minimizes disruption of the ongoing operations of the station. While meeting these requirements the scheduler must cope with the complexity, scope, and flexibility of SSF operations. This requires the scheduler to deal with an astronomical number of possible schedules. The Operations Mission Planner (OMP) is centered around minimally disruptive replanning and the use of heuristics limit search in scheduling. OMP has already shown several artificial intelligence based scheduling techniques such as Interleaved Iterative Refinement and Bottleneck Identification using Process Chronologies.

Biefeld, Eric↗

Effective Team Support: From Task and Cognitive Modeling to Software Agents for Time-Critical Complex Work Environments

The purpose of this research contract was to perform multidisciplinary research between CMU psychologists, computer scientists and NASA researchers to design a next generation collaborative system to support a team of human experts and intelligent agents. To achieve robust performance enhancement of such a system, we had proposed to perform task and cognitive modeling to thoroughly understand the impact technology makes on the organization and on key individual personnel. Guided by cognitively-inspired requirements, we would then develop software agents that support the human team in decision making, information filtering, information distribution and integration to enhance team situational awareness. During the period covered by this final report, we made substantial progress in completing a system for empirical data collection, cognitive modeling, and the building of software agents to support a team's tasks, and in running experiments for the collection of baseline data.

Remington, Roger W.↗

Robonaut 2 and Watson: Cognitive Dexterity for Future Exploration

Future exploration missions will dictate a level of autonomy never before experienced in human spaceflight. Mission plans involving the uncrewed phases of complex human spacecraft in deep space will require a coordinated autonomous capability to be able to maintain the spacecraft when ground control is not available. One promising direction involves embedding intelligence into the system design both through the employment of state-of-the-art system engineering principles as well as through the creation of a cognitive network between a smart spacecraft or habitat and embodiments of cognitive agents. The work described here details efforts to integrate IBM's Watson and other cognitive computing services into NASA Johnson Space Center (JSC)'s Robonaut 2 (R2) anthropomorphic robot. This paper also discusses future directions this work will take. A cognitive spacecraft management system that is able to seamlessly collect data from subsystems, determine corrective actions, and provide commands to enable those actions is the end goal. These commands could be to embedded spacecraft systems or to a set of robotic assets that are tied into the cognitive system. An exciting collaboration with Woodside provides a promising Earth-bound testing analog, as controlling and maintaining not normally manned off-shore platforms have similar constraints to the space missions described.

Badger, Julia M.↗

An evaluation of training effectiveness of an intelligent tutoring system

The study evaluated the training effectiveness of an intelligent tutoring system (ITS) for the Remote Manipulator System (RMS). The study examined how well individuals learn the training content and skills from the RMS ITS and to what extent the content and skills learned using the ITS transfer to RMS task performance in the SES, a high fidelity simulator. Three astronauts completed 8 2-hour ITS sessions addressing movement in three coordinate systems, grapple, ungrapple, berth, and unberth procedures, and singularities and reach limits. Their performance was also observed in an SES training session. Performance data were collected using multiple measures: ITS task performance, transfer performance on the SES, a conceptual knowledge test, an opinion survey completed by astronauts, and comments and observations from astronauts and trainers. Results indicated the RMS ITS to be moderately effective and provided evidence of the efficacy of ITS's, in general. Comments and suggestions are provided relating to how the ITS could be improved and to enable decision makers to judge the effectiveness of the RMS ITS.

Johnson, Debra Steele↗

In Situ Water Quality Data for the Chesapeake Bay

This paper examines in situ water quality datameasured during2020-2021in the Chesapeake Bay for comparison with optical satellite data. Thiscollection was performed as part of a NASA project aiming to develop new methods for water quality monitoring from satellite remote sensingusing artificial intelligence. Our objective is to use insitu data as ground-truth to provide water quality classifications, or labels,to their overlapping (in time and location)satellite imagery. Having such labeled data, can help us achieve our project’s longer-termgoal:to train artificial intelligencemodelsto recognize features in spectral informationfor monitoringwater qualityfrom satellites. Because routine monitoring by state agencies is conducted at discrete locations, we obtained a flow-through system operated from small boats to measure waterquality parameters along transects for comparison with two-dimensional maps collected from space, with an initial focus on low oxygenevents, due to their large spatial extent and regular occurrence each summer.We also evaluated similar in situ data collected during 1984-2021by the Chesapeake Program.

Nargess Memarsadeghi↗

Computational Inference of Vibratory System with Incomplete Modal Information Using Parallel, Interactive and Adaptive Markov Chains

Inverse analysis of vibratory system is an important subject in fault identification, model updating, and robust design and control. It is challenging subject because 1) the problem is oftentimes underdetermined while the measurements are limited and/or incomplete; 2) many combinations of parameters may yield results that are similar with respect to actual response measurements; and 3) uncertainties inevitably exist. The aim of this research is to leverage upon computational intelligence through statistical inference to facilitate an enhanced, probabilistic framework using incomplete modal response measurement. This new framework is built upon efficient inverse identification through optimization, whereas Bayesian inference is employed to account for the effect of uncertainties. To overcome the computational cost barrier, we adopt Markov chain Monte Carlo (MCMC) to characterize the target function/distribution. Instead of using single Markov chain in conventional Bayesian approach, we develop a new sampling theory with multiple parallel, interactive and adaptive Markov chains and incorporate it into Bayesian inference. This can harness the collective power of these Markov chains to realize the concurrent search of multiple local optima. The number of required Markov chains and their respective initial model parameters are automatically determined via Monte Carlo simulation-based sample pre-screening followed by K-means clustering analysis. These enhancements can effectively address the aforementioned challenges in finite element inverse analysis. The validity of this framework is systematically demonstrated through case studies.

K Zhou↗

Instrument technologies for the detection of extraterrestrial intersteller robotic probes.

In the continuing endeavor to detect evidence of ETI (Extraterrestrial Intelligence) in the solar neighborhood, instrument technologies now exist that allow the formation of a scientific method to carry out a search for interstellar robotic probes of possible extraterrestrial origin. The range of currently observable probe features/manifestations will be shown and how they influence search space, instrument selection and deployment. Autonomous instrument platforms (i.e. robotic observatories) to search for anomalous energy signatures can be designed and assembled using Commercial off-the-shelf (COTS) hardware and software. The COTS approach to observatory design provides an economical, flexible and robust path toward collecting reliable data. The present variety of COTS instruments permits the necessary observational sensitivity , bandwidth and embedded processing speed to establish a nearby robotic probe detection envelope. A survey of these instrument technologies will be presented and how they can be applied to the challenge of collecting enough scientific data on anomalous observational phenomena to determine whether or not a robotic probe was detected

Stride, Scot Lloyd↗

Effective Team Support: From Modeling to Software Agents

The purpose of this research contract was to perform multidisciplinary research between CMU psychologists, computer scientists and engineers and NASA researchers to design a next generation collaborative system to support a team of human experts and intelligent agents. To achieve robust performance enhancement of such a system, we had proposed to perform task and cognitive modeling to thoroughly understand the impact technology makes on the organization and on key individual personnel. Guided by cognitively-inspired requirements, we would then develop software agents that support the human team in decision making, information filtering, information distribution and integration to enhance team situational awareness. During the period covered by this final report, we made substantial progress in modeling infrastructure and task infrastructure. Work is continuing under a different contract to complete empirical data collection, cognitive modeling, and the building of software agents to support the teams task.

Remington, Roger W.↗

AmesDT: Digital Twin and Autonomy Validation Environment

A simulation of NASA Ames Research Center was developed to provide a common testbed for multiple areas of research within the Intelligent Systems Division, primarily related to verification and validation of autonomous technologies, machine learning, and digital twin systems. AmesSim corresponds a physical rover that is capable of navigation in the real-world environment; in this way, the same experiments can be run in both settings, with the same software and hardware stacks in the loop. The simulation is built in Unreal Engine 4 and uses the AirSim plugin for API convenience. Several custom modifications allow deterministic, faster-than-realtime execution, which enables consistent testing of on-line algorithms and large-scale data collection. This paper describes the architecture and capabilities of the simulation and discusses development challenge.

simulation↗