Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “increasing automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions

Blanson, Nina↗

Reducing Size, Weight, and Power (SWaP) of Perception Systems in Small Autonomous Aerial Systems

The objectives are to examine recent trends in the reduction of size, weight, and power (SWaP) requirements of sensor systems for environmental perception and to explore new technology that may overcome limitations in current systems. Improving perception systems to facilitate situation awareness is critical in the move to introduce increasing autonomy in aerial systems. Whether the autonomy is in the current state-of-the-art of increasing automation or is enabling cognitive decisions that facilitate adaptive behavior, collection of environmental information and fusion of that information into knowledge that can direct actuation is imperative to decisions resulting in appropriate behavior. Artificial sensory systems such as cameras, radar, LIDAR, and acoustic sensors have been in use on aircraft for many years but, due to the large size and weight of the airplane and electrical power made available through powerful engines, the SWaP requirements of these sensors was inconsequential. With the proliferation of Remote Piloted Vehicles (RPV), the trend is in significant reduction in SWaP of the vehicles. This requires at least an equivalent reduction in SWaP for the sensory systems. A survey of some currently available sensor systems and changing technology will reveal the trend toward reduction of SWaP of these systems and will predict future reductions. A new technology will be introduced that provides an example of a desirable new trend. A new device replaces multiple conventional sensory devices facilitating synchronization, localization, altimetry, collision avoidance, terrain mapping, and data communication in a single integrated, small form-factor, extremely lightweight, and low power device that it is practical for integration into small autonomous vehicles and can facilitate cooperative behavior. The technology is based on Ultra WideBand (UWB) radio using short pulses of energy rather than continuous sine waves. The characteristics of UWB yield several desirable characteristics to facilitate integration of perception for autonomous activities. The capabilities of this device and its limitations will be assessed.

Jones, Kennie H.↗

Risk of Performance Decrements and Adverse Health Outcomes Resulting from Sleep Loss, Circadian Desynchronization, and Work Overload

Sleep loss, circadian desynchronization, and work overload occur to some extent for ground and flight crews, prior to and during spaceflight missions. Ground evidence indicates that such risk factors may lead to performance decrements and adverse health outcomes, which could potentially compromise mission objectives. Efforts are needed to identify the environmental and mission conditions that interfere with sleep and circadian alignment, as well as individual differences in vulnerability and resiliency to sleep loss and circadian desynchronization. Specifically, this report highlights a collection of new evidence to better characterize the risk and reveals new gaps in this risk as follows: Sleep loss is apparent during spaceflight. Astronauts consistently average less sleep during spaceflight relative to on the ground. The causes of this sleep loss remain unknown, however ground-based evidence suggests that the sleep duration of astronauts is likely to lead to performance impairment and short and long-term health consequences. Further research is needed in this area in order to develop screening tools to assess individual astronaut sleep need in order to quantify the magnitude of sleep loss during spaceflight; current and planned efforts in BHP's research portfolio address this need. In addition, it is still unclear whether the conditions of spaceflight environment lead to sleep loss or whether other factors, such as work overload lead to the reduced sleep duration. Future data mining efforts and continued data collection on the ISS will help to further characterize factors contributing to sleep loss. Sleep inertia has not been evaluated during spaceflight. Ground-based studies confirm that it takes two to four hours to achieve optimal performance after waking from a sleep episode. Sleep inertia has been associated with increased accidents and reduced performance in operational environments. Sleep inertia poses considerable risk during spaceflight when emergency situations necessitate that crewmembers wake from sleep and make quick decisions. A recently completed BHP investigation assesses the effects of sleep inertia upon abrupt awakening, with and without hypnotics currently used in spaceflight; results from this investigation will help to inform strategies relative to sleep inertia effects on performance. Circadian desynchrony has been observed during spaceflight. Circadian desynchrony during spaceflight develops due to schedule constraints requiring non-24 operations or 'slam-shifts' and due to insufficient or mis-timed light exposure. In addition, circadian misalignment has been associated with reduced sleep duration and increased medication use. In ground-based studies, circadian desynchrony has been associated with significant performance impairment and increased risk of accidents when operations coincide with the circadian nadir. There is a great deal of information available on how to manage circadian misalignment, however, there are currently no easily collected biomarkers that can be used during spaceflight to determine circadian phase. Current research efforts are addressing this gap. Work overload has been documented during current spaceflight operations. NASA has established work hour guidelines that limit shift duration, however, schedule creep, where duty requirements necessitate working beyond scheduled work hours, has been reported. This observation warrants the documentation of actual work hours in order to improve planning and in order to ensure that astronauts receive adequate down time. In addition to concerns about work overload, ground based evidence suggests that work underload may be a concern during deep space missions, where torpor may develop and physically demanding workload will be exchanged for monitoring of autonomous systems. Given that increased automation is anticipated for exploration vehicles, fatigue effects in the context of such systems needs to be further understood. Performance metrics are needed to evaluate fitness-for-duty during spaceflight. Although ground-based evidence supports the notion that sleep loss, circadian desynchronization and work overload lead to performance impairment, inconsistency in the measures used to evaluate performance during spaceflight make it difficult to evaluate the magnitude of performance impairment during spaceflight. Work is underway to standardize measures of performance evaluation during spaceflight. Once established, such performance indicators need to be correlated with operational performance. Individual differences in sleep need and circadian preference, phase shifting ability and period have been documented in ground-based studies. Individual differences in response to sleep loss and circadian misalignment have also been documented and are presumed to be associated with genetic polymorphisms. No studies have systematically reported individual differences in sleep or circadian-related outcomes during spaceflight. More work is needed in this area in order to identify genetic or phenotypic biomarkers that predict resilience or vulnerability to sleep loss in order to personalize countermeasure strategies and mitigate performance impairment during spaceflight. Two laboratory and field investigations specific to this topic are currently ongoing; additional efforts, including an effort to mine existing biological data from spaceflight relative to sleep and circadian outcomes, are planned. Sex differences in sleep need and circadian period and phase have been reported in ground-based studies. The impact of these sex differences on performance is unclear. Sex differences in sleep need and circadian rhythms have not been systematically studied during spaceflight, presumably due to the small number of women that have flown in space. More research is needed in this area to evaluate whether any of the observed sex differences in physiology lead to altered performance in spaceflight and on the ground.

Flynn-Evans, Erin↗

Remote Strain Sensing of CFRP Using Microwave Frequency Domain Reflectometry

NASA's Advanced Composites Project is investigating technologies that increase automated remote inspection of aircraft composite structures. Therefore, microwave Frequency Domain Reflectometry (FDR) is being investigated as a method of enabling rapid remote measurement of strain occurring at the first ply of a composite fiber reinforced polymer (CFRP) structure using Radio Frequency (RF) Electro-Magnetic (EM) radiation. While microwave reflectometry has been used to detect disbonds in CFRP structures, its use in detecting strain has been limited. This work will present data demonstrating the measurement of the reactance changes due to loading conditions that are indicative of strain in a CFRP structure. In addition, the basic EM signature will be presented along with an analysis of temperature and humidity effects.

Wilson, William C.↗

Carbon Fiber TOW Angle Determination Using Microwave Reflectometry

NASA's Advanced Composites Project is investigating technologies that increase automated remote inspection of aircraft composite structures. Therefore, microwave Frequency Domain Reflectometry (FDR) is being investigated as a method of enabling rapid remote inspection of angular orientation of the tow using microwave radiation. This work will present preliminary data demonstrating that frequency shifts in the reflection spectrum of a carbon fiber tow sample are indicative of the angle of the tow with respect to an interrogating antenna's linear polarized output.

Wilson, William C.↗

Architecture for Cognitive Networking within NASAs Future Space Communications Infrastructure

Future space mission concepts and designs pose many networking challenges for command, telemetry, and science data applications with diverse end-to-end data delivery needs. For future end-to-end architecture designs, a key challenge is meeting expected application quality of service requirements for multiple simultaneous mission data flows with options to use diverse onboard local data buses, commercial ground networks, and multiple satellite relay constellations in LEO, MEO, GEO, or even deep space relay links. Effectively utilizing a complex network topology requires orchestration and direction that spans the many discrete, individually addressable computer systems, which cause them to act in concert to achieve the overall network goals. The system must be intelligent enough to not only function under nominal conditions, but also adapt to unexpected situations, and reorganize or adapt to perform roles not originally intended for the system or explicitly programmed. This paper describes architecture features of cognitive networking within the future NASA space communications infrastructure, and interacting with the legacy systems and infrastructure in the meantime. The paper begins by discussing the need for increased automation, including inter-system collaboration. This discussion motivates the features of an architecture including cognitive networking for future missions and relays, interoperating with both existing endpoint-based networking models and emerging information-centric models. From this basis, we discuss progress on a proof-of-concept implementation of this architecture as a cognitive networking on-orbit application on the SCaN Testbed attached to the International Space Station.

space networks↗

Architecture for Cognitive Networking within NASA's Future Space Communications Infrastructure

Future space mission concepts and designs pose many networking challenges for command, telemetry, and science data applications with diverse end-to-end data delivery needs. For future end-to-end architecture designs, a key challenge is meeting expected application quality of service requirements for multiple simultaneous mission data flows with options to use diverse onboard local data buses, commercial ground networks, and multiple satellite relay constellations in LEO, GEO, MEO, or even deep space relay links. Effectively utilizing a complex network topology requires orchestration and direction that spans the many discrete, individually addressable computer systems, which cause them to act in concert to achieve the overall network goals. The system must be intelligent enough to not only function under nominal conditions, but also adapt to unexpected situations, and reorganize or adapt to perform roles not originally intended for the system or explicitly programmed. This paper describes an architecture enabling the development and deployment of cognitive networking capabilities into the envisioned future NASA space communications infrastructure. We begin by discussing the need for increased automation, including inter-system discovery and collaboration. This discussion frames the requirements for an architecture supporting cognitive networking for future missions and relays, including both existing endpoint-based networking models and emerging information-centric models. From this basis, we discuss progress on a proof-of-concept implementation of this architecture, and results of implementation and initial testing of a cognitive networking on-orbit application on the SCaN Testbed attached to the International Space Station.

space networks↗

The Influence of Mental Workload in Causes of System Degradation in Air Traffic Control

System safety and resilience is a critical concern in the air traffic domain. An important element of maintaining system safety and resilience is the ability of systems to ‘degrade gracefully’. However, previous research on the causes of system degradation in the air traffic domain are sporadic, and the potential interaction between the causes of degradation, and the resulting possible compound effect on the entire system, has been under-researched. An interview study was conducted with 12 retired controllers as participants. The results of a thematic analysis revealed the key causes of system degradation, and the associated impact on the ability of the controllers to prevent system degradation or recover the system. Findings have direct implications for identifying and mitigating potential risks of increasingly automated air traffic control systems.

Edwards, Tamsyn E.↗

The Influence of Mental Workload in Causes of System Degradation in Air Traffic Control

System safety and resilience is a critical concern in the air traffic domain. An important element of maintaining system safety and resilience is the ability of systems to ‘degrade gracefully'. However, previous research on the causes of system degradation in the air traffic domain are sporadic, and the potential interaction between the causes of degradation, and the resulting possible compound effect on the entire system, has been under-researched. An interview study was conducted with 12 retired controllers as participants. The results of a thematic analysis revealed the key causes of system degradation, and the associated impact on the ability of the controllers to prevent system degradation or recover the system. Findings have direct implications for identifying and mitigating potential risks of increasingly automated air traffic control systems.

Edwards, Tamsyn↗

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

delay; trajectory-based operations; time-based flo↗

Reinforcement Learning Applied to Cognitive Space Communications

The future of space exploration depends on robust, reliable communication systems. As the number of such communication systems increase, automation is fast becoming a requirement to achieve this goal. A reinforcement learning solution can be employed as a possible automation method for such systems. The goal of this study is to build a reinforcement learning algorithm which optimizes data throughput of a single actor. A training environment was created to simulate a link within the NASA Space Communication and Navigation (SCaN) infrastructure, using state of the art simulation tools developed by the SCaN Center for Engineering, Networks, Integration, and Communications (SCENIC) laboratory at NASA Glenn Research Center to obtain the closest possible representation of the real operating environment. Reinforcement learning was then used to train an agent inside this environment to maximize data throughput. The simulation environment contained a single actor in low earth orbit capable of communicating with twenty-five ground stations that compose the Near-Earth Network (NEN). Initial experiments showed promising training results, so additional complexity was added by augmenting simulation data with link fading profiles obtained from real communication events with the International Space Station. A grid search was performed to find the optimal hyperparameters and model architecture for the agent. Using the results of the grid search, an agent was trained on the augmented training data. Testing shows that the agent performs well inside the training environment and can be used as a foundation for future studies with added complexity and eventually tested in the real space environment.

Schubert, Carson D.↗

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

Idris, Husni↗

Workload Considerations in Urban Air Mobility

Urban air mobility (UAM) is receiving increased attention in aviation as a system for passenger and cargo-carrying new entrants in urban airspace. In order to develop a safe and efficient system, numerous possible concepts of operation for UAM are being explored throughout industry and research domains, the features and assumptions of which may differ according to near, medium and far term operations. Much of the current research into the development of UAM has dominantly focused on technological and engineering capabilities, such as vehicle development. Although these areas of research are essential to furthering UAM, research into the role of the human operator in UAM is limited. The research described in this paper aims to begin to address this gap by investigating the capabilities and implications of human operators as traffic managers in the UAM system, focusing on near-term UAM operations. A human in the loop air traffic control simulation was used to investigate the effect of UAM traffic density, airspace routes and communication procedures on subjective workload and efficiency-related task performance. Findings indicate that medium and high-density operations were associated with high workload. A reduction in verbal communications through a letter of agreement, and optimized routes, were associated with reduced workload and increased performance efficiency. However, even with these adjustments, reported workload remained high, particularly during the high-density scenario. Future research should focus on the human operator roles and responsibilities, and the amount of involvement, in UAM system management. Particular focus should be directed on the impact of reduced human operator involvement and increased automation, on the safety and efficiency of UAM operations and the integration of UAM with traditional air traffic management.

Edwards, Tamsyn↗

The Residuum-Those Who Technology Leaves Behind

The introduction of new technologies has direct and indirect advantages and disadvantages on societies. As the relentless pace of technology increases, societies have to adjust, accommodate, integrate or reject the latest invention or innovation. Many people even experience the unintended consequences associated with these technologies. Some technologies appear to have a stabilizing effect on society (where the technology lifts all of society) while other technologies appear disruptive with unsettling effects(benefits are shared by a few with previously established firms being displaced). In this latter case, companies with the most disruptive technologies provide benefits but also gain market share by decimating their competitors. Those in society who have the means or the opportunity to seize the benefits of advanced technologies undoubtedly gain efficiencies of time and effectiveness while those who cannot afford or those who chose not to adopt these same technologies unfortunately fall behind. During the present worldwide pandemic, schools have physically closed their doors causing the mto pursue virtual classrooms. How will the teachers and children without internet access in their homes compare to those who do? In the near future, increased automation will lead to some reduction in the full-time workforce. A co-worker recently improved her skills in a fortuitous technical discipline. Others did not. Who should be held responsible for reskilling? Stated another way, who should be held responsible for finding new employment opportunities?In the distant future, parents who incorporated genetically enhanced benefits during childbirth will have offspring who will probably advance beyond those who cannot afford the technology. In these various ways, who should be held responsible for those who technology leaves behind?Are those left behind simply those who suffer inequality or is there something more?Should the semi-transparent hand of technology be allowed to roam freely through society selecting the survival of the fittest as it chooses? Should the invisible hand of the financial market make the decisions? Or, should governments and companies bear some responsibility by crafting policies to mitigate the consequences to those cast aside by the technology? This paper will endeavor to address some of the underlying issues of this question while attempting to find a set of sensible solutions to this problem.

Residuum↗

Keck interferometer update

The Keck Interferometer is a NASA-funded joint development between JPL and the W. M. Keck Observatory. The first phase of the project combines the two 10-m Keck Telescopes for high sensitivity near-infrared fringe visibility measurements, nulling interferometry at 10 pm to measure the quantity of exozodiacal emission around nearby stars, and differential-phase measurements to detect hot Jupiters by their direct emission. First fringes with the interferometer were obtained in March 200 1 using the two Kecks with their A 0 systems. Subsequent engineering work been focusedtoward the visibility mode in the areas of improving sensitivity, increasing automation, and adding functionality, in preparation for the high-precision modes. Recently four shared-risk teams were selected by NASA to participate in early science observations, and initial shared-risk science observations have begun.

Keck↗

Streamlining Tactical Operator Handoffs During Multi-Vehicle Applications

Increased automation has shifted the operator control paradigm from a single operator controlling a single vehicle, to multiple operators collaborating to control multiple vehicles; this paradigm is known as m:N. Many questions remain unanswered in this new operational paradigm about the division of assets as workload for individual operators varies overtime. This paper explores the management of workload by enabling operators to temporarily handoff vehicles among each other. A study was conducted to explore both a manual and assisted method for performing handoffs during manipulated contingency scenarios. The assisted handoff method allowed subjects to easily choose and group nominal and/or contingency vehicles. The number of contingencies was also manipulated to determine the effect workload had on how pilots utilized the ability to handoff vehicles. Results show subjects performed handoffs more often when there were more contingencies and when the assisted handoff tool was available. In addition, the assisted tool make subjects feel more comfortable, enabling them to feel like they could take longer to resolve contingency situations. Lastly, even during contingencies, subjects were able to successfully complete secondary tasks.

M:N operations↗

Streamlining Tactical Operator Handoffs During Multi-Vehicle Operations

Increased automation has shifted the operator control paradigm from a single operator controlling a single vehicle, to multiple operators collaborating to control multiple vehicles; this paradigm is known as m:N. Many questions remain unanswered in this new operational paradigm about the division of assets as workload for individual operators varies over time. This paper explores the management of workload by enabling operators to temporarily handoff vehicles among each other. A study was conducted to explore both a manual and assisted method for performing handoffs during manipulated contingency scenarios. The assisted handoff method allowed subjects to easily choose and group nominal and/or contingency vehicles. The number of contingencies was also manipulated to determine the effect workload had on how pilots utilized the ability to handoff vehicles. Results show subjects performed handoffs more often when there were more contingencies and when the assisted handoff tool was available. In addition, the assisted tool made subjects feel more comfortable, enabling them to feel like they could take longer to resolve contingency situations. Lastly, even during contingencies, subjects were able to successfully complete secondary tasks.

m:N operations↗

Requirement Discovery Using Embedded Knowledge Graph With ChatGPT

The field of Advanced Air Mobility (AAM) is witnessing a transformation with innovations such as electric aircraft and increasingly automated airspace operations. Within AAM, the Urban Air Mobility (UAM) con-cept focuses on providing air-taxi services in densely populated urban areas. This research introduces the utilization of Large Language Models (LLMs), such as OpenAI's GPT-4, to enhance the UAM Requirement discovery process. This study explores two distinct approaches to leverage LLMs in the context of UAM Requirement discovery. The first approach evaluates the LLM's ability to provide responses without relying on additional outside systems, such as a relational or graph database. Instead, a vector store provides relevant information to the LLM based on the user’s question, a process known as Retrieval Augmented Generation (RAG). The second approach integrates the LLM with a graph database. The LLM acts as an intermediary between the user and the graph database, translating user questions into cypher queries for the database and database responses into human-readable answers for the user. Our team implemented and tested both solutions to analyze require-ments within a UAM dataset. This paper will talk about our approaches, implementations, and findings related to both approaches.

systems engineering↗