Cognitive signal processing
Unsupervised signal pattern recognition - computer simulation of noisy signal pattern format, and construction of asymptotic Bayes decision boundary form
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Unsupervised signal pattern recognition - computer simulation of noisy signal pattern format, and construction of asymptotic Bayes decision boundary form
This paper presents a concept for a human mission to Mars orbit that features direct robotic exploration of the planet s surface via teleoperation from orbit. This mission is a good example of Human Exploration using Real-time Robotic Operations (HERRO), an exploration strategy that refrains from sending humans to the surfaces of planets with large gravity wells. HERRO avoids the need for complex and expensive man-rated lander/ascent vehicles and surface systems. Additionally, the humans are close enough to the surface to effectively eliminate the two-way communication latency that constrains typical robotic space missions, thus allowing real-time command and control of surface operations and experiments by the crew. Through use of state-of-the-art telecommunications and robotics, HERRO provides the cognitive and decision-making advantages of having humans at the site of study for only a fraction of the cost of conventional human surface missions. It is very similar to how oceanographers and oil companies use telerobotic submersibles to work in inaccessible areas of the ocean, and represents a more expedient, near-term step prior to landing humans on Mars and other large planetary bodies. Results suggest that a single HERRO mission with six crew members could achieve the same exploratory and scientific return as three conventional crewed missions to the Mars surface.
Historically, neuroscience principles have heavily influenced artificial intelligence (AI), for example the influence of the perceptron model, essentially a simple model of a biological neuron, on artificial neural networks. More recently, notable recent AI advances, for example the growing popularity of reinforcement learning, often appear more aligned with cognitive neuroscience or psychology, focusing on function at a relatively abstract level. At the same time, neuroscience stands poised to enter a new era of large-scale high-resolution data and appears more focused on underlying neural mechanisms or architectures that can, at times, seem rather removed from functional descriptions. While this might seem to foretell a new generation of AI approaches arising from a deeper exploration of neuroscience specifically for AI, the most direct path for achieving this is unclear. Here we discuss cultural differences between the two fields, including divergent priorities that should be considered when leveraging modern-day neuroscience for AI. For example, the two fields feed two very different applications that at times require potentially conflicting perspectives. We highlight small but significant cultural shifts that we feel would greatly facilitate increased synergy between the two fields.
Widespread integration of social media into daily life has fundamentally changed the way society communicates, and, as a result, how individuals develop attitudes, personal philosophies, and worldviews. The excess spread of disinformation and misinformation due to this increased connectedness and streamlined communication has been extensively studied, simulated, and modeled. Less studied is the interaction of many pieces of misinformation, and the resulting formation of attitudes. We develop a framework for the simulation of attitude formation based on exposure to multiple cognitions. We allow a set of cognitions with some implicit relational topology to spread on a social network, which is defined with separate layers to specify online and offline relationships. An individual’s opinion on each cognition is determined by a process inspired by the Ising model for ferromagnetism. We conduct experimentation using this framework to test the effect of topology, connectedness, and social media adoption on the ultimate prevalence of and exposure to certain attitudes.
An AlN MEMS resonator technology has been developed, enabling massively parallel filter arrays on a single chip. Low-loss filter banks covering the 10 MHz--10-GHz frequency range have been demonstrated, as has monolithic integration with inductors and CMOS circuitry. The high level of integration enables miniature multi-bandm spectrally aware, and cognitive radios.
Principles for the design of dynamic spatial instruments for communicating quantitative information to viewers are considered through a brief review of the history of pictorial communication. Pictorial communication is seen to have two directions: (1) from the picture to the viewer; and (2) from the viewer to the picture. Optimization of the design of interactive instruments using pictorial formats requires an understanding of the manipulative, perceptual, and cognitive limitations of human viewers.
Digital Engineering is a transformative strategy that leverages an integrated model-based approach to improve communication, decision making, design understanding, and acquisition efficiency of system development. As modern systems are derived from pre-existing systems, harvesting tacit knowledge from existing systems in a useful, model-based way will reduce the experiential learning and cognition required for new system development, contributing to a Digital Engineering transformation. This study enables such a technique by demonstrating the use of architectural theory in expressing tacit knowledge from existing systems and presenting that knowledge according to the model-based view offered by the Functional Architecture of Systems methodology. By validating the functional information expressed by the design pattern, this work solidifies design patterns as a critical component of a technical architecture and proposes a functional architecture viewpoint for describing mined knowledge in a usable, model-based, way suitable for archival in a modern knowledge management system.
Digital Engineering is a transformative strategy that leverages an integrated model-based approach to improve communication, decision making, design understanding, and acquisition efficiency of system development. As modern systems are derived from pre-existing systems, harvesting expert knowledge from proven systems in a useful, model-based way will reduce the experiential learning and cognition required for new system development, contributing to a Digital Engineering transformation. Motivated by performance gains observed during a multi-year, sequential development activity, this survey reviews knowledge, architecture, and pattern literature to establish a framework for research of architectural methods for expert knowledge identification and description using Model Based System Engineering. The multi-year sequential development activity is offered as the experimental system of interest for this research. This work aims to enable a digital engineering strategy that improves concept phase decision making, accelerates knowledge acquisition from lessons learned repositories, and eases the burden of generational knowledge loss.
4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.
NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.
NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.
Prevailing team effectiveness models suggest that teams are best positioned for success when certain enabling conditions are in place (Hackman, 1987; Hackman, 2012; Mathieu, Maynard, Rapp, & Gilson, 2008; Wageman, Hackman, & Lehman, 2005). Team composition, or the configuration of member attributes, is an enabling structure key to fostering competent teamwork (Hackman, 2002; Wageman et al., 2005). A vast body of research supports the importance of team composition in team design (Bell, 2007). For example, team composition is empirically linked to outcomes such as cooperation (Eby & Dobbins, 1997), social integration (Harrison, Price, Gavin, & Florey, 2002), shared cognition (Fisher, Bell, Dierdorff, & Belohlav, 2012), information sharing (Randall, Resick, & DeChurch, 2011), adaptability (LePine, 2005), and team performance (e.g., Bell, 2007). As such, NASA has identified team composition as a potentially powerful means for mitigating the risk of performance decrements due to inadequate crew cooperation, coordination, communication, and psychosocial adaptation in future space exploration missions. Much of what is known about effective team composition is drawn from research conducted in conventional workplaces (e.g., corporate offices, production plants). Quantitative reviews of the team composition literature (e.g., Bell, 2007; Bell, Villado, Lukasik, Belau, & Briggs, 2011) are based primarily on traditional teams. Less is known about how composition affects teams operating in extreme environments such as those that will be experienced by crews of future space exploration missions. For example, long-distance and long-duration space exploration (LDSE) crews are expected to live and work in isolated and confined environments (ICEs) for up to 30 months. Crews will also experience communication time delays from mission control, which will require crews to work more autonomously (see Appendix A for more detailed information regarding the LDSE context). Given the unique context within which LDSE crews will operate, NASA identified both a gap in knowledge related to the effective composition of autonomous, LDSE crews, and the need to identify psychological and psychosocial factors, measures, and combinations thereof that can be used to compose highly effective crews (Team Gap 8). As an initial step to address Team Gap 8, we conducted a focused literature review and operational assessment related to team composition issues for LDSE. The objectives of our research were to: (1) identify critical team composition issues and their effects on team functioning in LDSE-analogous environments with a focus on key composition factors that will most likely have the strongest influence on team performance and well-being, and 1 Astronaut diary entry in regards to group interaction aboard the ISS (p.22; Stuster, 2010) 2 (2) identify and evaluate methods used to compose teams with a focus on methods used in analogous environments. The remainder of the report includes the following components: (a) literature review methodology, (b) review of team composition theory and research, (c) methods for composing teams, (d) operational assessment results, and (e) recommendations.
The UC Davis team conducted architecture, algorithm and experimental studies for next generation ultra-high-bandwidth optical networks in support of extreme-scale science applications. In particular, over the course of this 3-year project, the UC Davis team achieved the following main accomplishments: Designed a network architecture for automated multi-domain service provisioning: Designed information exchange schemes between autonomous systems (domains) Designed application programming interfaces to orchestrate resource reservation in data centers, high performance computation facilities, and communication networks belonging to different autonomous systems Experimentally assessed the multi-domain network architecture in a distributed field trial set-up connecting premises in three continents Designed a broker-based orchestrated multi-domain optical networking framework supporting observe-analyze-act cycle based cognitive inter-domain service provisioning: Designed an inter-domain operation mechanism, e.g., topology abstraction, for the broker plane and domain managers to collaboratively accomplish inter-domain service provisioning while respecting the autonomy of each administrative domain Designed an alien wavelength monitoring scheme and an artificial neural network based optical signal-to-noise ratio estimator for quality-of-transmission aware inter-domain service provisioning Developed a deep neural network based multi-domain traffic predictor and a cognitive routing and spectrum assignment algorithm to realize knowledge-based autonomous traffic engineering in multi-domain networks Implemented an optical signal-to-noise ratio estimator and traffic predictor with Google’s Tensor flow and assessed their performance using experimental and synthetic data Demonstrated the benefits of the proposed cognitive schemes with experiments ona two-domain elastic optical network testbed and evaluations on a six-domain simulation framework Built a two-domain software-defined networking control plane testbed using the ONOS platform and demonstrated the workflow of broker and domain manager cooperation, including hierarchical performance monitoring, topology abstraction and cognitive resource allocation. Designed self-learning cognitive service provisioning schemes using advanced machine learning technologies: Designed a self-taught anomaly detection framework for optical networks, including an unsupervised data clustering module for pattern recognition, a supervised data regression and classification module for online anomaly detection, and the system operation principle Experimentally validated the effectiveness of the self-taught anomaly detection framework with various failure/anomaly scenarios. Designed a self-learning autonomic routing, modulation and spectrum assignment (RMSA) provisioning framework for elastic optical networks with deep reinforcement learning. Designed effective modeling and training mechanisms for the self-learning RMSA framework Conducted extensive numerical simulations with various traffic patterns and topologies to verify the advantage of the self-learning RMSA framework.
During the last decade, teleoperated robotic systems have extended humans’ sensorimotor competence to digitally fly beyond the physical barrier of distance and scale and thus transmit sensorimotor skills of the human through direct communication. Telepresence capabilities have enabled tele-physical remote access at small scales thanks to telerobotic mediums. Although the concept was initially motivated by space applications, such technologies quickly have expanded into the medical domain and resulted in teleoperated medical robots, including telerobotic surgical systems (such as the da Vinci surgical system). Effective telepresence fundamentally depends on an agile, reliable, and secure communication medium that can transmit real-time information between the operator and a remote device. However, direct telepresence may not be achievable for long-duration exploration spaceflight missions. Thus, autonomous systems and local intelligence represent potential solutions to the aforementioned issues. One example solution employs demonstration systems which enable learning from the pre-captured inputs of a skilled human operator. These will be computationally modeled and later probabilistically replicated toward the completion of remote physical tasks when direct telepresence is not viable - such as under communication blackout conditions. In other words, trained autonomous systems (e.g., robots) can perform remote operations that mimic the physical performance of experts during remote operations/training. Beyond learning the physics of the task, autonomous agents can also be used to conduct algorithmic decision-making that mimics the higher-level cognition of the expert. Thus, using an autonomous system, pre-trained cognitive and manipulation-based skills can be leveraged (acquired during pre-mission events) to produce digital twins of an intelligent operator. Such systems can be used for the real-time conduction of intricate tasks in complex and unstructured environments. Such systems will operationalize “cognitive digital twins” and can expand the reach of human cognition and manipulation through the power of data-driven learning from demonstration algorithms. This system category will be discussed as a fully autonomous operation in this talk. In addition to the above, we will also propose and discuss the possibility of partial-automation using remote intelligence and remote sensing. In contrast to full automation, partial automation can close the loop through a local operator equipped with augmented sensory awareness through wearable systems. Such technologies will allow the local operator to conduct delicate tasks while being guided using sensory augmentation and being monitored to gauge her/his level of cognitive focus and performance. The difference with the previous category is that a remote human will conduct the task. Further, rather than making a digital twin of human cognition, we will augment the control inputs of the local human to match those of the skilled expert operator who is not accessible in real-time. Going beyond classic telepresence and thus approaching intelligent telepresence, our vision is that autonomous agents will eventually enable the safe, consistent and efficient delivery of complex, remote and smart medical care during space exploration across operators in an Earth-independent fashion. We will discuss our collective vision from NASA and MERIIT@NYU lab in this talk.
NASA’s Human Research Program oversees the Team Risk (i.e., Risk of Performance and Behavioral Health Decrements due to Inadequate Cooperation, Coordination, Communication and Psychosocial Adaptation within a Team). Research in this area informs all aspects of an astronaut’s career, from hiring to training to mission support, and works to address new challenges related to lunar and Mars missions. NASA’s astronaut selection process creates an astronaut corps of highly qualified, team-oriented individuals, which allows mission planners much flexibility in composing small crews for specific missions. These crews are further developed and supported through extensive training, including team skills training, and countermeasures available to the crew throughout the mission. However, in the high consequence environment of long-duration missions, team composition is complex and is not a one-time concern to be addressed pre-mission. Team factors such as team cohesion, dyadic relationships, and shared team cognition are likely to change dynamically in response to each interaction and event experienced by the individuals and the team as a whole. Thus, monitoring and optimizing team composition at a more micro level (e.g., per task) is one way to support team functioning and performance. Spaceflight teams research also includes the multi-team system of Mission Control and coordination between space-to-ground, adding another avenue in which risk might be introduced, particularly under exploration missions that experience significant communication delays. Spaceflight teams research has recently experienced a concentrated flurry of analog research over the past decade, shedding light on the many unique challenges and potential solutions to mitigate the team risk in long-duration exploration missions. However, questions still remain about how to, for example, create unobtrusive operational measures and how to advance interdisciplinary teams research and countermeasure development. We present an overview of the challenges facing teams in space, our current knowledge, and the next steps for research and spaceflight operations.
Results are presented of many years of research on the methods of teaching primates the language and cognitive skills which were long considered to be unteachable to particular species of primates. It was found that chimpanzee subjects could not only learn a number of 'stock sentences' but to use them in variations and several combinations for the purpose of solving various problems. Apes placed in different rooms could be taught to communicate via computer, and collaborate with each other on doing specific tasks. Contrary to expectations, young rhesus monkeys proved to be able to learn as much as the chimpanzee species.
The success of current and future NASA missions relies in great part on the performance reliability and robustness of the communication circuits and systems of said missions. Some of the manifestations of reliability and robustness are comprised by properties such as graceful degradation, which provide redundancy and potentially longer life to the mission, and the ability to perform efficiently in harsh environments destinations such as Venus and the Jovian and Saturnian moons Europa and Enceladus, respectively. While several approaches have been considered or are currently underway to develop communications circuitry capable of performing in harsh environments, they lack the flexibility to enable reconfigurability to preserve functionality under adverse or contingency scenarios. This paper discusses some examples of self-healing RF/Microwave communications circuits and systems that could provide advantageous options in support of NASA missions.
There are three issues to consider when building an embedded training system for a task domain involving the operation of complex equipment: (1) how skill is acquired in the task domain; (2) how the training system should be designed to assist in the acquisition of the skill, and more specifically, how an intelligent tutor could aid in learning; and (3) whether it is feasible to incorporate the resulting training system into the operational environment. This paper describes how these issues have been addressed in a prototype training system that was developed for operations in NASA's Deep Space Network (DSN). The first two issues were addressed by building an executable cognitive model of problem solving and skill acquisition of the task domain and then using the model to design an intelligent tutor. The cognitive model was developed in Soar for the DSN's Link Monitor and Control (LMC) system; it led to several insights about learning in the task domain that were used to design an intelligent tutor called REACT that implements a method called 'impasse-driven tutoring'. REACT is one component of the LMC training system, which also includes a communications link simulator and a graphical user interface. A pilot study of the LMC training system indicates that REACT shows promise as an effective way for helping operators to quickly acquire expert skills.