Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Interview”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Effects of Transparency on Pilot Trust and Agreement in the Autonomous Constrained Flight Planner

We performed a human-in-the-loop study to explore the role of transparency in engendering trust and reliance within highly automated systems. Specifically, we examined how transparency impacts trust in and reliance upon the Autonomous Constrained Flight Planner (ACFP), a critical automated system being developed as part of NASA's Reduced Crew Operations (RCO) Concept. The ACFP is designed to provide an enhanced ground operator, termed a super dispatcher, with recommended diversions for aircraft when their primary destinations are unavailable. In the current study, 12 commercial transport rated pilots who played the role of super dispatchers were given six time-pressured all land scenarios where they needed to use the ACFP to determine diversions for multiple aircraft. Two factors were manipulated. The primary factor was level of transparency. In low transparency scenarios the pilots were given a recommended airport and runway, plus basic information about the weather conditions, the aircraft types, and the airport and runway characteristics at that and other airports. In moderate transparency scenarios the pilots were also given a risk evaluation for the recommended airport, and for the other airports if they requested it. In the high transparency scenario additional information including the reasoning for the risk evaluations was made available to the pilots. The secondary factor was level of risk, either high or low. For high-risk aircraft, all potential diversions were rated as highly risky, with the ACFP giving the best option for a bad situation. For low-risk aircraft the ACFP found only low-risk options for the pilot. Both subjective and objective measures were collected, including rated trust, whether the pilots checked the validity of the automation recommendation, and whether the pilots eventually flew to the recommended diversion airport. Key results show that: 1) Pilots trust increased with higher levels of transparency, 2) Pilots were more likely to verify ACFPs recommendations with low levels of transparency and when risk was high, 3) Pilots were more likely to explore other options from the ACFP in low transparency conditions and when risk was high, and 4) Pilots decision to accept or reject ACFPs recommendations increased as a function of the transparency in the explanation. The finding that higher levels of transparency was coupled with higher levels of trust, a lower need to verify other options, and higher levels of agreement with ACFP recommendations, confirms the importance of transparency in aiding reliance on automated recommendations. Additional analyses of qualitative data gathered from subjects through surveys and during debriefing interviews also provided the basis for new design recommendations for the ACFP.

trust↗
NASA NTRS2017

Human Reliability Assessments: Using the Past (Shuttle) to Predict the Future (Orion)

NASA (National Aeronautics and Space Administration) Johnson Space Center (JSC) Safety and Mission Assurance (S&MA) uses two human reliability analysis (HRA) methodologies. The first is a simplified method which is based on how much time is available to complete the action, with consideration included for environmental and personal factors that could influence the human's reliability. This method is expected to provide a conservative value or placeholder as a preliminary estimate. This preliminary estimate or screening value is used to determine which placeholder needs a more detailed assessment. The second methodology is used to develop a more detailed human reliability assessment on the performance of critical human actions. This assessment needs to consider more than the time available, this would include factors such as: the importance of the action, the context, environmental factors, potential human stresses, previous experience, training, physical design interfaces, available procedures/checklists and internal human stresses. The more detailed assessment is expected to be more realistic than that based primarily on time available. When performing an HRA on a system or process that has an operational history, we have information specific to the task based on this history and experience. In the case of a Probabilistic Risk Assessment (PRA) that is based on a new design and has no operational history, providing a "reasonable" assessment of potential crew actions becomes more challenging. To determine what is expected of future operational parameters, the experience from individuals who had relevant experience and were familiar with the system and process previously implemented by NASA was used to provide the "best" available data. Personnel from Flight Operations, Flight Directors, Launch Test Directors, Control Room Console Operators, and Astronauts were all interviewed to provide a comprehensive picture of previous NASA operations. Verification of the assumptions and expectations expressed in the assessments will be needed when the procedures, flight rules, and operational requirements are developed and then finalized.

DeMott, Diana L.↗
NASA NTRS2016

NASA EOSDIS: Enabling Science by Improving User Knowledge

Lessons learned and impacts of applying these newer methods are explained and include several examples from our current efforts such as the interactive, on-line webinars focusing on data discovery and access including tool usage, informal and informative data chats with data experts across our EOSDIS community, data user profile interviews with scientists actively using EOSDIS data in their research, and improved conference and meeting interactions via EOSDIS data interactively used during hyper-wall talks and Worldview application. The suite of internet-based, interactive capabilities and technologies has allowed our project to expand our user community by making the data and applications from numerous Earth science missions more engaging, approachable and meaningful.

EOSDIS↗
NASA NTRS2017

Lessons Learned from Applying Design Thinking in a NASA Rapid Design Study in Aeronautics

In late 2015, NASA's Aeronautics Research Mission Directorate (ARMD) funded an experiment in rapid design and rapid teaming to explore new approaches to solving challenging design problems in aeronautics in an effort to cultivate and foster innovation. This report summarizes several lessons learned from the rapid design portion of the study. This effort entailed learning and applying design thinking, a human-centered design approach, to complete the conceptual design for an open-ended design challenge within six months. The design challenge focused on creating a capability to advance experimental testing of autonomous aeronautics systems, an area of great interest to NASA, the US government as a whole, and an entire ecosystem of users and developers around the globe. A team of nine civil servant researchers from three of NASA's aeronautics field centers with backgrounds in several disciplines was assembled and rapidly trained in design thinking under the guidance of the innovation and design firm IDEO. The design thinking process, while used extensively outside the aerospace industry, is less common and even counter to many practices within the aerospace industry. In this report, several contrasts between common aerospace research and development practices and design thinking are discussed, drawing upon the lessons learned from the NASA rapid design study. The lessons discussed included working towards a design solution without a set of detailed design requirements, which may not be practical or even feasible for management to ascertain for complex, challenging problems. This approach allowed for the possibility of redesigning the original problem statement to better meet the needs of the users. Another lesson learned was to approach problems holistically from the perspective of the needs of individuals that may be affected by advances in topic area instead of purely from a technological feasibility viewpoint. The interdisciplinary nature of the design team also provided valuable experience by allowing team members from different technological backgrounds to work side-by-side instead of dividing into smaller teams, as is frequently done in traditional multidisciplinary design. The team also learned how to work with qualitative data obtained primarily through the 70-plus interviews that were conducted over the course of this project, which was a sharp contrast to using quantitative data with regards to identifying, capturing, analyzing, storing, and recalling the data. When identifying potential interviewees who may have useful contributions to the design subject area, the team found great value in talking to non-traditional users and potential beneficiaries of autonomous aeronautics systems whose impact on the aeronautics autonomy ecosystem is growing swiftly. Finally, the team benefitted from using "sacrificial prototyping," which is a method of rapidly prototyping draft concepts and ideas with the intent of enabling potential users to provide significant feedback early in the design process. This contrasts the more common approach of using expensive prototypes that focus on demonstrating technical feasibility. The unique design approach and lessons learned by the team throughout this process culminated in a final design concept that was quite different than what the team originally assumed would be the design concept initially. A summary of the more usercentered final design concept is also provided.

McGowan, Anna-Maria↗
NASA NTRS2017

Understanding What It Means for Assurance Cases to "Work"

This report is the result of our year-long investigation into assurance case practices and effectiveness. Assurance cases are a method for working toward acceptable critical system performance. They represent a significant thread of applied assurance methods extending back many decades and being employed in a range of industries and applications. Our research presented in this report includes a literature survey of over 50 sources and interviews with nearly a dozen practitioners in the field. We have organized our results into seven major claimed assurance case benefits and their supporting mechanisms, evidence, counter-evidence, and caveats.

David J Rinehart↗
NASA NTRS2016

Summary of 2016 Light Microscopy Module (LMM) Physical Science Experiments on ISS. Update of LMM Science Experiments and Facility Capabilities

This presentation will feature a series of short, entertaining, and informative videos that describe the current status and science support for the Light Microscopy Module (LMM) facility on the International Space Station. These interviews will focus on current experiments and provide an overview of future capabilities. The recently completed experiments include nano-particle haloing, 3-D self-assembly with Janus particles and a model system for nano-particle drug delivery. The videos will share perspectives from the scientists, engineers, and managers working with the NASA Light Microscopy program.

Sicker, Ronald J.↗
NASA NTRS2017

User Needs and Advances in Space Wireless Sensing and Communications

Decades of space exploration and technology trends for future missions show the need for new approaches in space/planetary sensor networks, observatories, internetworking, and communications/data delivery to Earth. The User Needs to be discussed in this talk includes interviews with several scientists and reviews of mission concepts for the next generation of sensors, observatories, and planetary surface missions. These observatories, sensors are envisioned to operate in extreme environments, with advanced autonomy, whereby sometimes communication to Earth is intermittent and delayed. These sensor nodes require software defined networking capabilities in order to learn and adapt to the environment, collect science data, internetwork, and communicate. Also, some user cases require the level of intelligence to manage network functions (either as a host), mobility, security, and interface data to the physical radio/optical layer. For instance, on a planetary surface, autonomous sensor nodes would create their own ad-hoc network, with some nodes handling communication capabilities between the wireless sensor networks and orbiting relay satellites. A section of this talk will cover the advances in space communication and internetworking to support future space missions. NASA's Space Communications and Navigation (SCaN) program continues to evolve with the development of optical communication, a new vision of the integrated network architecture with more capabilities, and the adoption of CCSDS space internetworking protocols. Advances in wireless communications hardware and electronics have enabled software defined networking (DVB-S2, VCM, ACM, DTN, Ad hoc, etc.) protocols for improved wireless communication and network management. Developing technologies to fulfil these user needs for wireless communications and adoption of standardized communication/internetworking protocols will be a huge benefit to future planetary missions, space observatories, and manned missions to other planets.

Kegege, Obadiah↗
NASA NTRS2017

Assessment of Air Traffic Controller Acceptability of Aircrew Route Change Requests

NASA developed the traffic aware strategic aircrew requests concept for a cockpit automation that identifies route improvements and advises the aircrew to request the change from the air traffic controller. In order to increase the chance of air traffic control approval, the automation ensures that the route is clear of known traffic, weather, and airspace restrictions. Hence the technology is anticipated to provide benefits in areas such as flight efficiency, flight schedule compliance, passenger comfort, and pilot and controller workload. In support of a field trial of a prototype of the technology, observations were conducted at the Atlanta and Jacksonville air traffic control centers to identify the main factors that affect the acceptability of aircrew requests by air traffic controllers. Observers shadowed air traffic controllers as the test flight pilot made pre-scripted requests to invoke acceptability issues and then they interviewed voluntarily fifty controllers with experience ranging from one to thirty-five years. The most common reason for rejecting requests is conflicting with traffic followed by violating air traffic procedures, increasing sector workload, and conflicting with major arrival and departure flows and flow restrictions. Quantitative parameters such as the distance that a route should maintain from sector boundaries and special use airspace were identified and recommended for inclusion in the automation.

Flight Optimization; Field Trial↗
NASA NTRS2017

Assessment of Air Traffic Controller Acceptability of Aircrew Route Change Requests

NASA developed the traffic aware strategic aircrew requests concept for a cockpit automation that identifies route improvements and advises the aircrew to request the change from the air traffic controller. In order to increase the chance of air traffic control approval, the automation ensures that the route is clear of known traffic, weather, and airspace restrictions. Hence the technology is anticipated to provide benefits in areas such as flight efficiency, flight schedule compliance, passenger comfort, and pilot and controller workload. In support of a field trial of a prototype of the technology, observations were conducted at the Atlanta and Jacksonville air traffic control centers to identify the main factors that affect the acceptability of aircrew requests by air traffic controllers. Observers shadowed air traffic controllers as the test flight pilot made pre-scripted requests to invoke acceptability issues and then they interviewed voluntarily fifty controllers with experience ranging from one to thirty-five years. The most common reason for rejecting requests is conflicting with traffic followed by violating air traffic procedures, increasing sector workload, and conflicting with major arrival and departure flows and flow restrictions. Quantitative parameters such as the distance that a route should maintain from sector boundaries and special use airspace were identified and recommended for inclusion in the automation.

Flight Optimization; Field Trial↗
NASA NTRS2016

Assessing the Impact of Operational Constraints on the Near-Term Unmanned Aircraft System Traffic Management Supported Market

An economic impact market analysis was conducted for 16 leading sectors of commercial Unmanned Aerial System (UAS) applications predicted to be enabled by 2020 through the NASA UAS Traffic Management (UTM) program. Subject matter experts from seven industries were interviewed to validate concept of operations (ConOps) and market adoption assumptions for each sector. The market analysis was used to estimate direct economic impacts for each sector including serviceable addressable market, capital investment, revenue recovery potential, and operations cost savings. The resultant economic picture distinguishes the agricultural, pipeline and railroad inspection, construction, and maritime sectors of the nascent commercial UAS industry as providing the highest potential economic value in the United States. Sensitivity studies characterized the variability of select UAS sectors economic value to key regulatory or UTM ConOps requirements such as weight, altitude, and flight over populated area constraints. Takeaways from the analysis inform the validation of UTM requirements, technologies and timetables from a commercial market need and value viewpoint. This work concluded in August 2015 and reflects the state of the UAS industry and market projections at that time.

Air Traffic Management↗
NASA NTRS2018

Designing Graceful Degradation into Complex Systems: The Interaction Between Causes of Degradation and the Association with Degradation Prevention and Recovery

System resilience is critical to safety in air traffic control. An important element of maintaining resilience is the ability of systems to degrade gracefully. Of the available graceful degradation research, a majority of studies have focused primarily on technological causes of degradation only, limiting an ecologically valid understanding of the causes of degradation in air traffic control, and the preventative and mitigative strategies that enable graceful degradation. The current study aimed to address this research gap by investigating causes of degradation in air traffic control across the broad categories of technology, the environment, and the human operator, and the potential interactions between these causes. 12 retired controllers participated in semi-structured interviews focused on previous experience of causes of degradation and mitigation strategies. Findings provide an understanding of causation of degradation in air traffic control, and the prevention and mitigation strategies that moderate the relationship between cause and system effect. Findings confirmed that causes appear to interact to create compound, multiple effects on overall system performance. Findings also revealed prevention and mitigation strategies utilized to moderate the effect of the cause on the system. In order to gain an ecologically valid understanding of the causes of degradation, and effective prevention or mitigation strategies, causes from multiple categories, and the interactions between them, must be identified. Findings have implications for designers of future air traffic control systems to ensure the ability of the system to gracefully degrade, as well as risk assessment and system validation processes.

human performance↗
NASA NTRS2018

Evolution of KSC EGS Post Space Shuttle - Success Factors and Lessons Learned

The Human Exploration and Operations Mission Directorate (HEOMD) Knowledge Capture & Transfer (KCT) team conducted video interviews with element managers in the Exploration Ground Systems (EGS) Program Office at Kennedy Space Center (KSC). The immediate goal was to capture a point-in-time profile of challenges, solutions, and lessons learned derived from EGS element development activity from the end of the Space Shuttle Program (SSP) to the present time.

Johnson, Patrick↗
NASA NTRS2018

The Influence of Mental Workload in Causes of System Degradation in Air Traffic Control

System safety and resilience is a critical concern in the air traffic domain. An important element of maintaining system safety and resilience is the ability of systems to ‘degrade gracefully’. However, previous research on the causes of system degradation in the air traffic domain are sporadic, and the potential interaction between the causes of degradation, and the resulting possible compound effect on the entire system, has been under-researched. An interview study was conducted with 12 retired controllers as participants. The results of a thematic analysis revealed the key causes of system degradation, and the associated impact on the ability of the controllers to prevent system degradation or recover the system. Findings have direct implications for identifying and mitigating potential risks of increasingly automated air traffic control systems.

Edwards, Tamsyn E.↗
NASA NTRS2019

Human Performance Contributions to Safety in Commercial Aviation

Every day in aviation, pilots, air traffic controllers, and other front-line personnel perform countless correct judgments and actions in a variety of operational environments. These judgments and actions are often the difference between an accident and a non-event. Ironically, data on these behaviors are rarely collected or analyzed. Data-driven decisions about safety management and design of safety-critical systems are limited by the available data, which influence how decision makers characterize problems and identify solutions. Large volumes of data are collected on the failures and errors that result in infrequent incidents and accidents, but in the absence of data on behaviors that result in routine successful outcomes, safety management and system design decisions are based on a small sample of nonrepresentative safety data. This assessment aimed to find and document “safety successes” made possible by human operators. With many Aeronautics Research Mission Directorate (ARMD) Programs and Projects focusing on increased automation and autonomy and decreased human involvement, failure to fully consider the human contributions to successful system performance in civil aviation represents a significant risk — a risk that has not been recognized to date. Without understanding how humans contribute to safety, any estimate of predicted safety of autonomous capabilities is incomplete and inherently suspect. Furthermore, understanding the ways in which humans contribute to safety can promote strategic interactions among safety technologies, functions, procedures and the people using them. Without this understanding, the full benefits of an integrated, optimized human/technology or autonomous system will not be realized. Historically, safety has been consistently defined in terms of the occurrence of accidents or recognized risks (i.e., in terms of things that go wrong). These adverse outcomes are explained by identifying their causes, and safety is restored by eliminating or mitigating these causes. An alternative to this approach is to focus on what goes right and identify how to replicate that process. Focusing on the rare cases of failures attributed to “human error” provides little information about why human performance routinely prevents adverse events. Hollnagel has proposed that things go right because people continuously adjust their work to match their operating conditions. These adjustments become increasingly important as systems continue to grow in complexity. Thus, the definition of safety should reflect not only “avoiding things that go wrong” but “ensuring that things go right.” The basis for safety management requires developing an understanding of everyday activities. However, few mechanisms to monitor everyday work exist in the aviation domain, which limits opportunities to learn how designs function in reality. This concept of safety thinking and safety management is reflected in the emerging field of resilience engineering. According to Hollnagel, a system is resilient if it can sustain required operations under expected and unexpected conditions by adjusting its functioning prior to, during, or following changes, disturbances, and opportunities. To explore “positive” behaviors that contribute to resilient performance in commercial aviation, the assessment team examined a range of existing sources of data about pilot and air traffic control (ATC) tower controller performance, including subjective interviews with domain experts and objective aircraft flight data records. These data were used to identify strategies that support resilient performance, methods for exploring and refining those strategies in existing data, and proposed methods for capturing and analyzing new data.

Null, Cynthia H.↗
NASA NTRS2019

Space Power Heritage Study Final Results

NASA space missions have long employed Radioisotope Power Systems (RPS) and solar-based power generation architectures. RPS have been used to enable or significantly enhance missions that venture deep into the solar system to distances from the sun which can make using solar architectures unfeasible and to areas where the sun is obscured due to shadows or atmospheric phenomena. The destination, however, is not the absolute factor of the determination of RPS or solar. This is highlighted by the Jupiter missions Galileo and Juno, which employed RPS and solar architectures, respectively. When baselining either RPS or solar architectures for a planetary mission, numerous factors must be considered, including scientific objectives, cost, schedule, and mass just to name a few. In an effort to better understand the decision-making process and provide insight for potential future missions, the NASA RPS Program Office tasked The Aerospace Corporation (Aerospace) to study historical missions that used RPS and solar architectures. Data was collected for a variety of RPS and solar missions to look for possible trends from the selected implementation. Additionally, mission case studies were developed based on interviews with mission personnel who were responsible for defining the power architecture of their mission. Informed by the data collected and case studies, two Measures of Effectiveness (MoEs) were produced: one based on cost of RPS versus solar, and one based on science mission cost effectiveness. The final results of this study have been captured in this briefing package which is available for full and open release. Additionally, a final report document also provides the same details of this package. This briefing package also includes an appendix which contains data not for public release which was used to provide detailed answers to questions raised during this study. The results of these inquiries are discussed in the report, but the proprietary data is not included. Finally, an executive summary package is also publicly available which was used to present the results of the study at the 2018 Aerospace Space Power Workshop.

Study↗
NASA NTRS2018

Designing Graceful Degradation into Complex Systems: Identification of Causes of Degradation, Interactions, and Mitigation of Degradation in Air Traffic Control

System resilience is critical to safety in air traffic control. An important element of maintaining resilience is the ability of systems to degrade gracefully. Of the available graceful degradation research, a majority of studies have focused primarily on technological causes of degradation only, limiting an ecologically valid understanding of the causes of degradation in air traffic control, and the preventative and mitigative strategies that enable graceful degradation. The current study aimed to address this research gap by investigating causes of degradation in air traffic control across the broad categories of technology, the environment, and the human operator, and the potential interactions between these causes. 12 retired controllers participated in semi-structured interviews focused on previous experience of causes of degradation and mitigation strategies. Findings provide an understanding of causation of degradation in air traffic control, and the prevention and mitigation strategies that moderate the relationship between cause and system effect. Findings confirmed that causes appear to interact to create compound, multiple effects on overall system performance. Findings also revealed prevention and mitigation strategies utilized to moderate the effect of the cause on the system. In order to gain an ecologically valid understanding of the causes of degradation, and effective prevention or mitigation strategies, causes from multiple categories, and the interactions between them, must be identified. Findings have implications for designers of future air traffic control systems to ensure the ability of the system to gracefully degrade, as well as risk assessment and system validation processes.

human performance↗
NASA NTRS2018

The Influence of Mental Workload in Causes of System Degradation in Air Traffic Control

System safety and resilience is a critical concern in the air traffic domain. An important element of maintaining system safety and resilience is the ability of systems to ‘degrade gracefully'. However, previous research on the causes of system degradation in the air traffic domain are sporadic, and the potential interaction between the causes of degradation, and the resulting possible compound effect on the entire system, has been under-researched. An interview study was conducted with 12 retired controllers as participants. The results of a thematic analysis revealed the key causes of system degradation, and the associated impact on the ability of the controllers to prevent system degradation or recover the system. Findings have direct implications for identifying and mitigating potential risks of increasingly automated air traffic control systems.

Edwards, Tamsyn↗
NASA NTRS2018

Designing Graceful Degradation into Complex Systems: The Interaction Between Causes of Degradation and the Association with Degradation Prevention and Recovery

System resilience is critical to safety in air traffic control. An important element of maintaining resilience is the ability of systems to degrade gracefully. Of the available graceful degradation research, a majority of studies have focused primarily on technological causes of degradation only, limiting an ecologically valid understanding of the causes of degradation in air traffic control, and the preventative and mitigative strategies that enable graceful degradation. The current study aimed to address this research gap by investigating causes of degradation in air traffic control (ATC) across the broad categories of technology, the environment, and the human operator, and the potential interactions between these causes. 12 retired controllers (ATCOs - Air Traffic Control Officers) participated in semi-structured interviews focused on previous experience of causes of degradation and mitigation strategies. Findings provide an understanding of causation of degradation in air traffic control, and the prevention and mitigation strategies that moderate the relationship between cause and system effect. Findings confirmed that causes appear to interact to create compound, multiple effects on overall system performance. Findings also revealed prevention and mitigation strategies utilized to moderate the effect of the cause on the system. In order to gain an ecologically valid understanding of the causes of degradation, and effective prevention or mitigation strategies, causes from multiple categories, and the interactions between them, must be identified. Findings have implications for designers of future air traffic control systems to ensure the ability of the system to gracefully degrade, as well as risk assessment and system validation processes.

Graceful Degradation↗