Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated decision support”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Development of a Discrepancy Checker for the Digital Twin in a Supervisory Control System for a Thermal Energy Delivery System

Defined as a virtual representation of a physical object, process, or service, and used to support real-world decision-making, a digital twin (DT) can be utilized to combine classical and novel frameworks in sensors, state predictions, and multi-input/multi-output systems, and to enable optimal autonomous operations. However, a DT’s usefulness largely depends on its ability to adequately mirror the state of its physical counterpart, and this adequacy should be reflected by the level of uncertainty in the underlying simulation models when estimating and predicting quantities of interest (QOIs). Moreover, simulation models in a DT may involve multiple fidelities of representations—ranging from physics-based models to data-driven ones—but classical uncertainty quantification (UQ) methods struggle to handle numerous uncertainty sources, nor are they designed for real-time applications. This work presents a UQ-based discrepancy checking and diagnosis tool for a DT-based supervisory control system applied to a thermal energy delivery system (TEDS) at Idaho National Laboratory. The discrepancy checker was developed using metadata from an automated DT development process, and these metadata included different combinations of physical model forms and model parameters, training data and hyperparameters for surrogate models, and design parameters for supervisory control systems. Next, correlations between the uncertainty results and the metadata were established and then applied to the DT operations. The discrepancy checker evaluates the discrepancies between model predictions from virtual and sensor measurements and backtraces them to the corresponding major sources of uncertainty. The discrepancy checker showed reasonable performance in detecting discrepancies and diagnosing sources of uncertainty in testing scenarios.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Computational Models of Human Performance: Validation of Memory and Procedural Representation in Advanced Air/Ground Simulation

The Man-Machine Interaction Design and Analysis System (MIDAS) under joint U.S. Army and NASA cooperative is intended to assist designers of complex human/automation systems in successfully incorporating human performance capabilities and limitations into decision and action support systems. MIDAS is a computational representation of multiple human operators, selected perceptual, cognitive, and physical functions of those operators, and the physical/functional representation of the equipment with which they operate. MIDAS has been used as an integrated predictive framework for the investigation of human/machine systems, particularly in situations with high demands on the operators. We have extended the human performance models to include representation of both human operators and intelligent aiding systems in flight management, and air traffic service. The focus of this development is to predict human performance in response to aiding system developed to identify aircraft conflict and to assist in the shared authority for resolution. The demands of this application requires representation of many intelligent agents sharing world-models, coordinating action/intention, and cooperative scheduling of goals and action in an somewhat unpredictable world of operations. In recent applications to airborne systems development, MIDAS has demonstrated an ability to predict flight crew decision-making and procedural behavior when interacting with automated flight management systems and Air Traffic Control. In this paper, we describe two enhancements to MIDAS. The first involves the addition of working memory in the form of an articulatory buffer for verbal communication protocols and a visuo-spatial buffer for communications via digital datalink. The second enhancement is a representation of multiple operators working as a team. This enhanced model was used to predict the performance of human flight crews and their level of compliance with commercial aviation communication procedures. We show how the data produced by MIDAS compares with flight crew performance data from full mission simulations. Finally, we discuss the use of these features to study communication issues connected with aircraft-based separation assurance.

Corker, Kevin M.↗

An Initial Analysis of Automating Conjunction Assessment and Collision Avoidance Planning in Space Traffic Management

We introduce a framework that automates the process of assessing potential satellite conjunctions in space, and generating collision avoidance maneuvers to support mitigation efforts within a novel space traffic management (STM) architecture. A software implementation of the framework was developed in a MATLAB-STK integrated environment, however, the concept and framework is agnostic to the language or environment. The software pulls from existing catalogs of spaceborne objects and ingests user-defined parameters to produce conjunction data, which could potentially aid collision avoidance planning in the STM architecture. The utility of the software in maneuver planning and exploring a performance-based tradespace of actions is demonstrated using three example cases: one-to-one conjunction, one-versus-four conjunctions, and a near head-on collision. The framework also provides a test-bed for the use of application programming interfaces (APIs) to demonstrate machine-to-machine communication between entities in our proposed STM architecture. Results from this software implementation are expected to aid distributed decision-making among various stakeholders, and inform efficient, autonomous, structured but flexible concept of operations within STM.

Space Systems Engineering↗

A Framework for Assessment of Autonomy Challenges in Air Traffic Management

Traditionally, air traffic management services have been provided by air traffic controllers and managers stationed in ground facilities, employed or contracted by the public sector, and supported by automation. These centralized, human-centric air traffic management services do not scale to accommodate increasing demands from conventional and new entrant operations for access to the national airspace system. One transformation that provides much needed scalability is increasing the level of autonomy of air traffic management by enabling edge agents of the system, including vehicles, operators, and third-party service suppliers, to collectively self-manage independently from the centralized service providers and enabling the automation to also take on more independent traffic management responsibility from the human agents. This paper identifies challenges to increasing the level of autonomy of air traffic management services. It describes a framework to enable a systematic identification of these challenges. The framework consists of a functional breakdown of air traffic management services and several dimensions characterizing different autonomy scales. The autonomy dimensions include the automation level between human and machine agents, the locus of control between centralized and distributed edge agents, cognitive activities for autonomous situation awareness and decision making, intelligence levels ranging from skill-based to expertise-based autonomous behavior, and uncertainty levels of the dynamics and environment in which autonomous agents operate. Several challenges are identified and categorized using the different dimensions of the autonomy framework.

automation, autonomy framework, collective autonom↗

Development of the Surface Management System Integrated with CTAS Arrival Tools

The Surface Management System (SMS) developed by NASA Ames Research Center in coordination with the Federal Aviation Administration (FAA) is a decision support tool to help tower traffic coordinators and Ground/Local controllers in managing and controlling airport surface traffic in order to increase capacity, efficiency, and flexibility. SMS provides common situation awareness to personnel at various air traffic control facilities such as airport traffic control towers (ATCT s), airline ramp towers, Terminal Radar Approach Control (TRACON), and Air Route Traffic Control Center (ARTCC). SMS also provides a traffic management tool to assist ATCT traffic management coordinators (TMCs) in making decisions such as airport configuration and runway load balancing. The Build 1 of the SMS tool was installed and successfully tested at Memphis International Airport (MEM) and received high acceptance scores from ATCT controllers and coordinators, as well as airline ramp controllers. NASA Ames Research Center continues to develop SMS under NASA s Strategic Airspace Usage (SAU) project in order to improve its prediction accuracy and robustness under various modeling uncertainties. This paper reports the recent development effort performed by the NASA Ames Research Center: 1) integration of Center TRACON Automation System (CTAS) capability with SMS and 2) an alternative approach to obtain airline gate information through a publicly available website. The preliminary analysis results performed on the air/surface traffic data at the DFW airport have shown significant improvement in predicting airport arrival demand and IN time at the gate. This paper concludes with recommendations for future research and development.

Jung, Yoon C.↗

Integrated Solutions for Optimized Performance (ISOP) Final Technical Report

The goal of this project was to demonstrate technical feasibility of an integrated approach for deep energy retrofits by packaging innovative technologies with smart communicating controls that represent the next generation of energy efficiency. The integrated solutions for optimized performance (ISOP) package integrates (i) advanced lighting and plug load controls; (ii) intelligent daylight harvesting through automated self-powered shades and window films; (iii) advanced HVAC controls sequences (ASHRAE Guideline (GDL) 36); and (iv) fault detection and diagnosis (FDD) and continuous commissioning (CCx) using advanced analytics. These technologies address energy use across multiple building end uses that represent more than 60% of the energy consumption in all commercial buildings. The project was structured to be implemented over three budget periods: Budget Period 1 scope included site selection, project design, site-specific customization of technology packages, procurement of technologies, initiation of installation of technologies, the development of a measurement and verification plan and collection of pre-retrofit data collection. The first year go/no-go decision was based on securing host sites representing 250,000 sq. ft. of occupied operational spaces, savings analysis, technology procurement and initiation of installation. Budget Period 2 planned to complete technology installations and initiate data collection of post-retrofit performance data. The second year go/no-go was to be the completion of technology installations and commissioning, metering and data collecting to support the requirements laid out in site specific M&V plans. Budget Period 3 planned to collect and analyze post-retrofit performance data and provide data and reporting to support energy efficiency rebate programs. After the team completed activities planned for Budget Period 1, the team reached a Go/No-Go Decision Point. At that point, TRC recommended that DOE discontinue the project without prejudice due to challenges with securing demonstration sites to meet the full 250,000 sf of occupied operational spaces and DOE concurred. In Budget Period 1, the TRC team developed criteria to recruit and evaluate potential demonstration host sites. TRC worked with Princeton University, the project demonstration partner, to identify buildings on their campus as potential candidates for the demonstration. Following the selection of demonstration sites, the TRC team customized energy technology packages according to the needs and characteristics of each site. TRC defined technology specifications, identified vendors, and conducted analysis to estimate energy and cost savings potential. The project team then developed schedules for technology procurement processes and scheduled for installation at all selected demonstration sites. The project team worked with Princeton University and DOE to develop an approach to verify energy savings achieved through measurement and verification (M&V) 2.0 methods. Princeton University initiated open bids to procure the necessary materials and installation contractors. Bid results came back higher than estimates due to a couple of factors – lack of familiarity of the bidders with the proposed technologies and lack of local trained installers to execute the installation of these new measures. Due to the higher bids, projects no longer met the internal cost-effectiveness criteria used by Princeton to proceed with procurement of the full suite of technologies as proposed in ISOP. Princeton had already procured parts of the ISOP package as part of a campus-wide initiative for FDD and lighting retrofits, but with the higher costs for other ISOP components, Princeton could no longer commit to the full ISOP package on the selected sites. Based on this, the team reached the Go/No-Go decision point, where they decided not to proceed with the project. Princeton is separately installing portions of the ISOP package where they individually meet Princeton’s payback criteria but on a different schedule than would have been needed for the DOE ISOP project. The team has learned several lessons from project progress in the first budget period. The team will utilize these lessons in future projects, as should any team which proceeds with a project around the ISOP technology. The first lesson is that more information about the proposed sites is required earlier in the process (perhaps even at the proposal stage) in order to have a successful demonstration. Technical details not evident earlier in the process (such as the TLED limitations for ALCS) can derail project execution. The second lesson is that pricing of emerging technologies is highly variable due to lack of familiarity of local installers and distributor with the proposed technologies as well as alternate bids using products they were more familiar with, but that cost more than the ones proposed by TRC. Finally, the last major lesson is that the host site’s internal project criteria is of critical importance. Based on these higher installed costs and lack of an informed installer base for the products proposed for this project, the project does not meet Princeton’s simple payback goals of five years.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Prognostics and Health Management in Nuclear Power Plants: An Updated Method-Centric Review With Special Focus on Data-Driven Methods

In a carbon-constrained world, future uses of nuclear power technologies can contribute to climate change mitigation as the installed electricity generating capacity and range of applications could be much greater and more diverse than with the current plants. To preserve the nuclear industry competitiveness in the global energy market, prognostics and health management (PHM) of plant assets is expected to be important for supporting and sustaining improvements in the economics associated with operating nuclear power plants (NPPs) while maintaining their high availability. Of interest are long-term operation of the legacy fleet to 80 years through subsequent license renewals and economic operation of new builds of either light water reactors or advanced reactor designs. Recent advances in data-driven analysis methods—largely represented by those in artificial intelligence and machine learning—have enhanced applications ranging from robust anomaly detection to automated control and autonomous operation of complex systems. The NPP equipment PHM is one area where the application of these algorithmic advances can significantly improve the ability to perform asset management. This paper provides an updated method-centric review of the full PHM suite in NPPs focusing on data-driven methods and advances since the last major survey article was published in 2015. The main approaches and the state of practice are described, including those for the tasks of data acquisition, condition monitoring, diagnostics, prognostics, and planning and decision-making. Research advances in non-nuclear power applications are also included to assess findings that may be applicable to the nuclear industry, along with the opportunities and challenges when adapting these developments to NPPs. Finally, this paper identifies key research needs in regard to data availability and quality, verification and validation, and uncertainty quantification.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Expert system decision support for low-cost launch vehicle operations

Progress in assessing the feasibility, benefits, and risks associated with AI expert systems applied to low cost expendable launch vehicle systems is described. Part one identified potential application areas in vehicle operations and on-board functions, assessed measures of cost benefit, and identified key technologies to aid in the implementation of decision support systems in this environment. Part two of the program began the development of prototypes to demonstrate real-time vehicle checkout with controller and diagnostic/analysis intelligent systems and to gather true measures of cost savings vs. conventional software, verification and validation requirements, and maintainability improvement. The main objective of the expert advanced development projects was to provide a robust intelligent system for control/analysis that must be performed within a specified real-time window in order to meet the demands of the given application. The efforts to develop the two prototypes are described. Prime emphasis was on a controller expert system to show real-time performance in a cryogenic propellant loading application and safety validation implementation of this system experimentally, using commercial-off-the-shelf software tools and object oriented programming techniques. This smart ground support equipment prototype is based in C with imbedded expert system rules written in the CLIPS protocol. The relational database, ORACLE, provides non-real-time data support. The second demonstration develops the vehicle/ground intelligent automation concept, from phase one, to show cooperation between multiple expert systems. This automated test conductor (ATC) prototype utilizes a knowledge-bus approach for intelligent information processing by use of virtual sensors and blackboards to solve complex problems. It incorporates distributed processing of real-time data and object-oriented techniques for command, configuration control, and auto-code generation.

Szatkowski, G. P.↗

Automated Wildfire Detection Through Artificial Neural Networks

Wildfires have a profound impact upon the biosphere and our society in general. They cause loss of life, destruction of personal property and natural resources and alter the chemistry of the atmosphere. In response to the concern over the consequences of wildland fire and to support the fire management community, the National Oceanic and Atmospheric Administration (NOAA), National Environmental Satellite, Data and Information Service (NESDIS) located in Camp Springs, Maryland gradually developed an operational system to routinely monitor wildland fire by satellite observations. The Hazard Mapping System, as it is known today, allows a team of trained fire analysts to examine and integrate, on a daily basis, remote sensing data from Geostationary Operational Environmental Satellite (GOES), Advanced Very High Resolution Radiometer (AVHRR) and Moderate Resolution Imaging Spectroradiometer (MODIS) satellite sensors and generate a 24 hour fire product for the conterminous United States. Although assisted by automated fire detection algorithms, N O M has not been able to eliminate the human element from their fire detection procedures. As a consequence, the manually intensive effort has prevented NOAA from transitioning to a global fire product as urged particularly by climate modelers. NASA at Goddard Space Flight Center in Greenbelt, Maryland is helping N O M more fully automate the Hazard Mapping System by training neural networks to mimic the decision-making process of the frre analyst team as well as the automated algorithms.

Miller, Jerry↗

Internet Protocol Display Sharing Solution for Mission Control Center Video System

With the advent of broadcast television as a constant source of information throughout the NASA manned space flight Mission Control Center (MCC) at the Johnson Space Center (JSC), the current Video Transport System (VTS) characteristics provides the ability to visually enhance real-time applications as a broadcast channel that decision making flight controllers come to rely on, but can be difficult to maintain and costly. The Operations Technology Facility (OTF) of the Mission Operations Facility Division (MOFD) has been tasked to provide insight to new innovative technological solutions for the MCC environment focusing on alternative architectures for a VTS. New technology will be provided to enable sharing of all imagery from one specific computer display, better known as Display Sharing (DS), to other computer displays and display systems such as; large projector systems, flight control rooms, and back supporting rooms throughout the facilities and other offsite centers using IP networks. It has been stated that Internet Protocol (IP) applications are easily readied to substitute for the current visual architecture, but quality and speed may need to be forfeited for reducing cost and maintainability. Although the IP infrastructure can support many technologies, the simple task of sharing ones computer display can be rather clumsy and difficult to configure and manage to the many operators and products. The DS process shall invest in collectively automating the sharing of images while focusing on such characteristics as; managing bandwidth, encrypting security measures, synchronizing disconnections from loss of signal / loss of acquisitions, performance latency, and provide functions like, scalability, multi-sharing, ease of initial integration / sustained configuration, integration with video adjustments packages, collaborative tools, host / recipient controllability, and the utmost paramount priority, an enterprise solution that provides ownership to the whole process, while maintaining the integrity of the latest technological displayed image devices. This study will provide insights to the many possibilities that can be filtered down to a harmoniously responsive product that can be used in today's MCC environment.

Brown, Michael A.↗

Integrating Inland and Coastal Water Quality Data for Actionable Knowledge

Water quality measures for inland and coastal waters are available as discrete samples from professional and volunteer water quality monitoring programs and higher-frequency, near-continuous data from automated in situ sensors. Water quality parameters also are estimated from model outputs and remote sensing. The integration of these data, via data assimilation, can result in a more holistic characterization of these highly dynamic ecosystems, and consequently improve water resource management. It is becoming common to see combinations of these data applied to answer relevant scientific questions. Yet, methods for scaling water quality data across regions and beyond, to provide actionable knowledge for stakeholders, have emerged only recently, particularly with the availability of satellite data now providing global coverage at high spatial resolution. In this paper, data sources and existing data integration frameworks are reviewed to give an overview of the present status and identify the gaps in existing frameworks. We propose an integration framework to provide information to user communities through the the Group on Earth Observations (GEO) AquaWatch Initiative. This aims to develop and build the global capacity and utility of water quality data, products, and information to support equitable and inclusive access for water resource management, policy and decision making.

Ghada Y.H. El Serafy↗

Analysis of Interactive Conflict Resolution Tool Usage in a Mixed Equipage Environment

A human-in-the-loop simulation was conducted that examined separation assurance concepts in varying levels of traffic density with mixtures of aircraft equipage and automation. This paper's analysis focuses on one of the experimental conditions in which traffic levels were approximately fifty percent higher than today, and approximately fifty percent of the traffic within the test area were equipped with data communications (data comm) capabilities. The other fifty percent of the aircraft required control by voice much like today. Within this environment, the air traffic controller participants were provided access to tools and automation designed to support the primary task of separation assurance that are currently unavailable. Two tools were selected for analysis in this paper: 1) a pre-probed altitude fly-out menu that provided instant feedback of conflict probe results for a range of altitudes, and 2) an interactive auto resolver that provided on-demand access to an automation-generated conflict resolution trajectory. Although encouraged, use of the support tools was not required; the participants were free to use the tools as they saw fit, and they were also free to accept, reject, or modify the resolutions offered by the automation. This mode of interaction provided a unique opportunity to examine exactly when and how these tools were used, as well as how acceptable the resolutions were. Results showed that the participants used the pre-probed altitude fly-out menu in 14% of conflict cases and preferred to use it in a strategic timeframe on data comm equipped and level flight aircraft. The interactive auto resolver was also used in a primarily strategic timeframe on 22% of conflicts and that their preference was to use it on conflicts involving data comm equipped aircraft as well. Of the 258 resolutions displayed, 46% were implemented and 54% were not. The auto resolver was rated highly by participants in terms of confidence and preference. Factors such as aircraft equipage, ownership, and location of predicted separation loss appeared to play a role in the decision of controllers to accept or reject the auto resolver's resolutions.

auto resolver↗

Future integrated mobility-energy systems: A modeling perspective

After over a century of petroleum dominance, the transportation sector is on the verge of radical transformations driven by rapid technology advancement of alternative fuels, automation, information technologies that create new mobility options and business models, and policies at all levels of government. While the technologies and fuels that will move people and goods in the future remain uncertain, the future transportation system will be more integrated with smart buildings, the electric grid, renewables, and information ecosystems, allowing for great opportunities to exploit these interconnections. Modeling tools for analyzing integrated mobility-energy systems require a deep understanding of these interconnections, of the infrastructure required to support alternative fuel vehicles, and a more nuanced understanding of transportation energy needs across multiple segments and spatiotemporal scales. In this paper, we assess the landscape of existing tools used to represent and model future mobility systems and their interactions with other energy systems. Here, we conclude that (a) out-of-sample extrapolation of emerging trends and future anticipated developments is more important than ever due to the plethora of factors driving disruptive change in mobility systems; (b) understanding adoption opportunities for alternative fuel light-duty vehicles requires modeling intra-household decisions affecting travel demand and mode choice; (c) mobility and energy systems need to be modeled as an integrated continuum, breaking the traditional approach in which dynamic energy supply models use relatively simple transportation demand and vice-versa; and (d) increased spatiotemporal fidelity and scalability are required to dynamically couple transportation/mobility and energy supply models and capitalize on these unprecedented interconnection opportunities.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Stack Characterization System Development and Testing

Oak Ridge National Laboratory, as well as the rest of the U.S. Department of Energy community, has numerous off-gas stacks that need to be decommissioned, demolished, and packaged for disposal. Disposal requires a waste disposition determination phase. Process knowledge typically makes a worst-case scenario decision that may place lower-level waste into a more expensive higher-level waste disposal category. Truly useful radiological and chemical sampling can be problematic on old stacks due to their inherent height and access hazards, and many of these stacks have begun to deteriorate structurally. A remote stack characterization system (SCS) that can manage sample and data collection removes people from the hazards and provides an opportunity for access to difficult to reach internal stack areas. The SCS is a remotely operated articulated radiological data recovery system designed to deploy down into off-gas stacks from the top via crane. The battery-powered SCS is designed to stabilize itself against the stack walls and move various data recovery systems into areas of interest on the inner stack walls. Stabilization is provided by a tripod structure; sensors are mounted in a rotatable bipod underneath the tripod. Sensors include a beta/gamma/alpha detector, a removable contaminant multi-sample automated sampler, and a multi-core remote core drill. Multiple cameras provide remote task viewing, support for sampling, and video documentation of the process. A delay in funding has delayed project delivery somewhat. Therefore, this paper describes the technology and shows fabrication and testing progress to the extent that data is available.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Proposal to Develop Interactive Classification Technology

Research for the first year was oriented towards: 1) the design of an interactive classification tool (ICT); and 2) the development of an appropriate theory of inference for use in ICT technology. The general objective was to develop a theory of classification that could accommodate a diverse array of objects, including events and their constituent objects. Throughout this report, the term "object" is to be interpreted in a broad sense to cover any kind of object, including living beings, non-living physical things, events, even ideas and concepts. The idea was to produce a theory that could serve as the uniting fabric of a base technology capable of being implemented in a variety of automated systems. The decision was made to employ two technologies under development by the principal investigator, namely, SMS (Symbolic Manipulation System) and SL (Symbolic Language) [see debessonet, 1991, for detailed descriptions of SMS and SL]. The plan was to enhance and modify these technologies for use in an ICT environment. As a means of giving focus and direction to the proposed research, the investigators decided to design an interactive, classificatory tool for use in building accessible knowledge bases for selected domains. Accordingly, the proposed research was divisible into tasks that included: 1) the design of technology for classifying domain objects and for building knowledge bases from the results automatically; 2) the development of a scheme of inference capable of drawing upon previously processed classificatory schemes and knowledge bases; and 3) the design of a query/ search module for accessing the knowledge bases built by the inclusive system. The interactive tool for classifying domain objects was to be designed initially for textual corpora with a view to having the technology eventually be used in robots to build sentential knowledge bases that would be supported by inference engines specially designed for the natural or man-made environments in which the robots would be called upon to operate.

deBessonet, Cary↗

Intermediate Levels of Autonomy within the SSM/PMAD Breadboard

The Space Station Module Power Management and Distribution (SSM/PMAD) bread-board is a test bed for the development of advanced power system control and automation. Software control in the SSM/PMAD breadboard is through co-operating systems, called Autonomous Agents. Agents can be a mixture of algorithmic software and expert systems. The early SSM/PMAD system was envisioned as being completely autonomous. It soon became apparent, though, that there would always be a need for human intervention, at least as long as a human interacts with the system in any way. In a system designed only for autonomous operation, manual intervention meant taking full control of the whole system, and loosing whatever expertise was in the system. Several methods for allowing humans to interact at an appropriate level of control were developed. This paper examines some of these intermediate modes of autonomy. The least humanly intrusive mode is simple monitoring. The ability to modify future behavior by altering a schedule involves high-level interaction. Modification of operating activities comes next. The coarsest mode of control is individual, unplanned operation of individual Power System components. Each of these levels is integrated into the SSM/PMAD breadboard, with support for the user (such as warnings of the consequences of control decisions) at every level.

Dugal-Whitehead, Norma R.↗

Automation Bias and Countermeasures in Flight Crews

Results of recent research investigating the use of automated systems have indicated the presence of automation bias, a term describing errors made when decision makers rely on automated cues as a heuristic replacement for vigilant information seeking and processing. Automation commission errors, i.e., errors made when decision makers take inappropriate action because they over-attend to automated information or directives, and automation omission errors, i.e., errors made when decision makers do not take appropriate action because they are not informed of an imminent problem or situation by automated aids, can result from this tendency. In a series of studies, participants who perceived themselves as "accountable" for their strategies of interaction with automation were significantly more likely to verify its correct functioning, and committed significantly fewer automation-related errors than those who did not report this perception. In this study, we focus on two manipulations to encourage verification behaviors within cockpit crews. The first, an information/training manipulation, will focus on explicit information on automation bias, and training for verification of automated functioning. The second manipulation will consist of display prompts to verify automated functioning. Participants (glass-cockpit crews) will fly a series of approaches on the Mini-ACFS, a two-person pan-task flight simulator. Approach scenarios include several automation "events," that is, glitches, malfunctions, or inappropriate recommendations, that can be caught if cross-checked with other cockpit indicators. We anticipate that these manipulations will ameliorate automation bias. Final data analysis will be completed prior to the OSU symposium, and is expected to support the hypotheses that: a) reduced errors are associated with verification behaviors; b) crews will be more likely to verify under training/display conditions than when in the control condition; and c) effects will persist when subjects return for a follow-up exercise 6-9 weeks after their first session. Implications for training and automation design will be discussed.

Mosier, Kathleen, L.↗

Request-Driven Schedule Automation for the Deep Space Network

The DSN Scheduling Engine (DSE) has been developed to increase the level of automated scheduling support available to users of NASA s Deep Space Network (DSN). We have adopted a request-driven approach to DSN scheduling, in contrast to the activity-oriented approach used up to now. Scheduling requests allow users to declaratively specify patterns and conditions on their DSN service allocations, including timing, resource requirements, gaps, overlaps, time linkages among services, repetition, priorities, and a wide range of additional factors and preferences. The DSE incorporates a model of the key constraints and preferences of the DSN scheduling domain, along with algorithms to expand scheduling requests into valid resource allocations, to resolve schedule conflicts, and to repair unsatisfied requests. We use time-bounded systematic search with constraint relaxation to return nearby solutions if exact ones cannot be found, where the relaxation options and order are under user control. To explore the usability aspects of our approach we have developed a graphical user interface incorporating some crucial features to make it easier to work with complex scheduling requests. Among these are: progressive revelation of relevant detail, immediate propagation and visual feedback from a user s decisions, and a meeting calendar metaphor for repeated patterns of requests. Even as a prototype, the DSE has been deployed and adopted as the initial step in building the operational DSN schedule, thus representing an important initial validation of our overall approach. The DSE is a core element of the DSN Service Scheduling Software (S(sup 3)), a web-based collaborative scheduling system now under development for deployment to all DSN users.

Johnston, Mark D.↗