Engineering PapersSearch

Engineering topics

Kathryn M Ballard

Publications and source records attributed to Kathryn M Ballard.

Psychophysiological Research Methods to Assess Airline Flight Crew Resilient Performance in High-Fidelity Flight Simulation Scenarios

New concepts in aviation system safety thinking have emerged to consider not only what may go wrong, but also what can be learned when things go right. This approach forms a more comprehensive approach to system safety thinking. A need exists for methods to enable a better understanding of human contributions to aviation safety and how they may inform Safety Management Systems (SMS). A high-fidelity 737-800 simulation study was conducted to study how current type-rated commercial airline flight crews anticipate, monitor, respond to, and learn from expected and unexpected disturbances during line operations. A number of dependent measures were collected that included traditional SMS data types, but also non-traditional safety data to include multiple psychophysiological metrics. This paper describes the psychophysiological measures results that evinced the capability of measures to help identify resilient flight crews. Implications for future research and design of future In-time Aviation Safety Management Systems are discussed.

Psychophysiology

Comparison of Likelihood Methods for Generalized Linear Mixed Models with Application to Quiet Supersonic Flights 2018 Data

Repeated measurement will be a feature of the survey data collected during the Quesst missionX-59 community response tests (CRT). Since each participant will report his or her categorical level of annoyance in response to multiple events, the responses from any single individual may be correlated with one another. Several models within the class of generalized linear mixed models (GLMM) are pertinent to the analysis of correlated categorical outcomes; the random intercept logistic regression model is one example. Both Bayesian and frequentist methods for fitting these models are available, with frequentist methods relying on some form of approximation (of either an integral or the integrand) that appears in the marginal likelihood function. Given several anticipated similarities of the X-59 CRT data to data collected during a past risk reduction, Quiet Supersonic Flights 2018 (QSF18), this short note is intended to create awareness. It documents an instance in which a reported population average dose-response relationship derived from QSF18 single event data was distorted by the integral approximation applied in likelihood-based methods. We review some of the available literature on the topic, compare the outputs of several different computational approaches implemented in available statistical software, and present simple corrective actions that may be useful during the Quesst mission.

dose-response model

Comparison of Two Statistical Models for Low Boom Dose-response Relationships with Correlated Responses

This study compares two statistical models to construct summary dose-response curves for low boom community noise surveys. Data from two NASA field surveys are used that consist of multiple responses per survey participant. These data require an approach that accounts for the correlation among repeated annoyance observations from the same participant. A multilevel model accounts for the correlation by allowing estimated parameters to vary with each survey participant. On the other hand, a population average model utilizes generalized estimating equations and accounts for the correlation via a userspecified within-subject correlation structure. A visual comparison of the dose-response curves for these two methods reveals similar results. When comparing specific points along the summary curves, the multilevel model yields more precise confidence bounds than the population average model. The similarity between the summary curves derived from each model lends validity to both approaches for approximating a population representative summary curve, though modeling assumptions may lend favor to the multilevel logistic modeling approach over the population average model.

dose-response

Environmental Benefits Assessment of the Traffic Aware Strategic Aircrew Requests Concept

Reduction of greenhouse gas emissions has been a focus area of the scientific community for the past several years. Specifically, the aviation industry has set goals to reduce greenhouse gas emissions, providing a sustainable transportation mechanism with minimal impacts on the environment. This reduction must be accomplished through several means, including advanced technology, sustainable propulsion, efficient air traffic management, and improved operations. A potential solution for improving operations in an efficient air traffic management system is the Traffic Aware Strategic Aircrew Requests (TASAR) concept. The TASAR concept applies onboard automation for the purpose of advising the pilot of route modifications that would be beneficial to the flight, leading to a decrease in direct operating costs through fuel burn reduction and shorter flight times. This report discusses analyses that provide an estimate of the potential environmental benefits that result from the application of the TASAR concept. The data used for this benefits assessment was gathered during an operational evaluation on revenue flights with an airline partner between July 2018 and April 2019. The analyses in this report determined that there are impactful potential environmental benefits to be realized using the TASAR concept.

TASAR, Digital TASAR, 4D TASAR, SATM, Green Aviati

Simulation of a Representative Future Trajectory-Based Operations Environment

Trajectory-Based Operations in the National Airspace System is a key aspect of advanced air traffic management research. Trajectory-Based Operations focuses on modernizing the current operating paradigm to increase efficiency, predictability, resilience, and flexibility while migrating toward greater operational autonomy across the airspace. Research conducted at the National Aeronautics and Space Administration supports the transition from current airspace operations to Trajectory-Based Operations targeting a 2035-2045 implementation timeframe. Simulation scenarios that demonstrate a representative Trajectory-Based Operations environment in that timeframe, and enable the evaluation of advanced airborne tools such as strategic airborne trajectory management services, are necessary to support this research effort. This report describes characteristics and assumptions made about the future operating environment that were applied to a scenario development methodology to study a representative 2040 Trajectory-Based Operations environment in a simulation use case. This report also includes descriptions of the study design and analysis approach, discussion of the simulation results, and application of these scenarios to future research activities.

Trajectory Based Operations

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility

Foundational Human-Autonomy Teaming Research and Development in Scalable Remotely Operated Advanced Air Mobility Operations: Research Model and Initial Work

To achieve the scalability envisioned for many Advanced Air Mobility (AAM) applications, uncrewed aerial system (UAS) concepts are being pursued with the goal of enabling fewer human operators to manage more increasingly autonomous vehicles. NASA’s Transformational Tools and Technologies – Revolutionary Aviation Mobility (T3-RAM) subproject has identified human-autonomy teaming (HAT) as a critical area of research required to support these operations. Under T3-RAM, the HAT Foundational Research Activity has been tasked with providing basic research to identify HAT and human-automation interaction (HAI) principles that can be used to achieve scalable multi-vehicle UAS operations. This paper first outlines a research model to produce ecologically relevant basic research, then contextualizes completed and planned research and development activities within this model. Proposed research threads are presented, along with their practical and theoretical implications.

Human-Autonomy Teaming

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility

Dose Error Impacts on A Collection of Realistic Dose-Response Curves Based on A NASA Sonic Boom Community Noise Survey

The National Aeronautics and Space Administration (NASA) plans to conduct surveys of community response to quiet supersonic flight to collect dose-response data for international regulators. Previous models of noise dose versus annoyance response ignored uncertainty in the noise dose experienced by survey respondents. This dose error causes attenuation bias and results in inaccurate dose-response relationships. The impacts of dose errors can be explored by introducing error into the dose estimates of a simulated community noise survey. The simulated population annoyance response is determined by specific noise response characteristics, including the onset of annoyance intercept, rate of increasing annoyance, participant intercept variability, and response rates. This paper explores the effects of dose errors on notional populations created by perturbing the noise response characteristics observed in participants in a recent NASA flight test, QSF18. The QSF18-based population parameters were shifted up to ±20% to create the study populations. For the anticipated dose range of the X-59, changes to the onset of annoyance intercept have the greatest impact on erroneous model results. Quantifying point estimate errors illustrates the impact of dose error, with errors up to 14 dB observed for a fixed high annoyance percentage.

dose-response modeling