Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pilot learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Integrating and Characterizing HPC Task Runtime Systems for hybrid AI-HPC workloads

Scientific workflows increasingly involve both HPC and machine-learning tasks, combining MPI-based simulations, training, and inference in a single execution. Launchers such as Slurm’s srun constrain concurrency and throughput, making them unsuitable for dynamic and heterogeneous workloads. We present a performance study of RADICAL-Pilot (RP) integrated with Flux and Dragon, two complementary runtime systems that enable hierarchical resource management and high-throughput function execution. Using synthetic and production-scale workloads on Frontier, we characterize the task execution properties of RP across runtime configurations. RP+Flux sustains up to 930 tasks/s, and RP+Flux+Dragon exceeds 1,500 tasks/s with over 99.6% utilization. In contrast, srun peaks at 152 tasks/s and degrades with scale, with utilization below 50%. For IMPECCABLE.v2 drug discovery campaign, RP+Flux reduces makespan by 30–60% relative to srun/Slurm and increases throughput more than four times on up to 1,024. These results demonstrate hybrid runtime integration in RP as a scalable approach for hybrid AI-HPC workloads.

HPC-AI↗

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

Autogenic-Feedback Training Exercise (AFTE) Method and System

The Autogenic-Feedback Training Exercise (AFTE) method of the present invention is a combined application of physiologic and perceptual training techniques. such as autogenic therapy and biofeedback. This combined therapy approach produces a methodology that is appreciably more effective than either of the individual techniques used separately. The AFTE method enables sufficient magnitude of control necessary to significantly reduce the behavioral and physiologic reactions to severe environmental stressors. It produces learned effects that are persistent over time and are resistant to extinction and it can be administered in a short period of time. The AFTE method may be used efficiently in several applications, among which are the following: to improve pilot and crew performance during emergency flying conditions; to train people to prevent the occurrence of nausea and vomiting associated with motion and sea sickness, or morning sickness in early pregnancy; as a training method for preventing or counteracting air-sickness symptoms in high-performance military aircraft; for use as a method for cardiovascular training, as well as for multiple other autonomic responses, which may contribute to the alleviation of Space Motion Sickness (SMS) in astronauts and cosmonauts; training people suffering from migraine or tension headaches to control peripheral blood flow and reduce forehead and/or trapezius muscle tension; training elderly people suffering from fecal incontinence to control their sphincter muscles; training cancer patients to reduce the nauseagenic effects of chemotherapy; and training patients with Chronic Intestinal Pseudo-obstruction (CIP).

Cowings, Patricia S.↗

STS-99 CEIT at the OPF High Bay-2, Endeavour, SRTM Mission

Live footage shows the crewmembers of STS-99, Commander Kevin R. Kregel, Pilot Dominic L. Pudwill Gorie, Mission Specialists Janet L. Kavandi, Janice E. Voss, Mamoru Mohri, and Gerhard P.J. Thiele, participating in Crew Equipment Interface Test (CEIT) activities at the Orbiter Processing Facility (OPF). The crew is shown checking out and learning about the equipment.

Source record↗

Human Performance Models of Pilot Behavior

Five modeling teams from industry and academia were chosen by the NASA Aviation Safety and Security Program to develop human performance models (HPM) of pilots performing taxi operations and runway instrument approaches with and without advanced displays. One representative from each team will serve as a panelist to discuss their team s model architecture, augmentations and advancements to HPMs, and aviation-safety related lessons learned. Panelists will discuss how modeling results are influenced by a model s architecture and structure, the role of the external environment, specific modeling advances and future directions and challenges for human performance modeling in aviation.

Foyle, David C.↗

A Systematic Approach for Real-Time Operator Functional State Assessment

A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.

Zhang, Guangfan↗

Motion Cueing for Stall Recovery Training in Commercial Transport Simulators

Starting in 2019, airline pilots will be required to perform full stall recovery training in flight simulators. Historically, training simulators weren't required to provide training at conditions outside their normal flight envelope. Post-stall aircraft models are generally required to be implemented to simulate the aircraft response after the stall point. In addition, motion cues need to adequately represent this response to ensure the skills learned in simulator training are directly usable in real flight. This paper provides and overview of six simulator experiments conducted at NASA Ames Research Center to develop a motion cueing strategies for stall recovery training in commercial transport simulators. One of the experiments verified an enhanced motion cueing strategy for stall recovery training on a level-D-certified full flight simulator. This study showed that the enhanced motion results in lower maximum roll angles in the stall maneuver, lower minimum load factors in the recovery, lower numbers of secondary stick shakers in the stall recovery, and a lower maximum airspeed in the recovery. These results indicate that relatively minor enhancements to the motion logic of heritage commercial transport simulators can significantly improve pilot performance in simulated stall recoveries, and potentially improve stall recovery training.

stall recovery↗

Motion Cueing for Stall Recovery Training in Commercial Transport Simulators

Starting in 2019, airline pilots will be required to perform full stall recovery training in flight simulators. Historically, training simulators weren't required to provide training at conditions outside their normal flight envelope. Post-stall aircraft models are generally required to be implemented to simulate the aircraft response after the stall point. In addition, motion cues need to adequately represent this response to ensure the skills learned in simulator training are directly usable in real flight. This paper provides and overview of six simulator experiments conducted at NASA Ames Research Center to develop a motion cueing strategies for stall recovery training in commercial transport simulators. One of the experiments verified an enhanced motion cueing strategy for stall recovery training on a level-D-certified full flight simulator. This study showed that the enhanced motion results in lower maximum roll angles in the stall maneuver, lower minimum load factors in the recovery, lower numbers of secondary stick shakers in the stall recovery, and a lower maximum airspeed in the recovery. These results indicate that relatively minor enhancements to the motion logic of heritage commercial transport simulators can significantly improve pilot performance in simulated stall recoveries, and potentially improve stall recovery training.

stall recovery↗

Overview of Challenges to Integrating Remotely-Piloted Operations into the National Airspace System

An oral presentation summarizing key challenges to integrating remotely-piloted operations into the National Airspace System. The presentation provides an overview of NASA's Pathfinding for an Airspace with Autonomous Vehicles sub-project, recent research activities focused on enabling autonomous cargo delivery, and some of the challenges that have been learned so far from these activities.

Husni Idris↗

Extracting Lessons of Human Performance and Resilience Management from a Study of Weather-Related Safety Risks and Incidents Reported to NASA's Aviation Safety Reporting System (ASRS)

We present a study of weather-related incident reports submitted to NASA’s Aviation Safety Reporting System (ASRS) by air carrier pilots and air traffic controllers in the US. Using specific examples, we examine the weather-related risks reported and the relevant aspects of human performance and resilience management exhibited during these incidents. We describe our methods of lesson extraction to maximize learning, including the use of advance algorithms, and we conclude with a review of the weather-related risks encountered and the resilient practices employed to mitigate them.

resilience↗

Simulator evaluation of a perspective clipped-pole display and a thrust-vector controller for VTOL zero-zero landings

Five pilots participated in a simulator study to evaluate design features of a perspective clipped pole display and a side arm thrust vector controller for potential applications to VTOL zero visibility landings. Analyses of objective measures by a t test for related means showed significant learning effects, but did not show significant performance differences among display conditions. A mean longitudinal touchdown velocity of less than 4 knots, a mean vertical touchdown velocity of less than 1.22m/sec, and a mean longitudinal position error of approximately 15.24 m were attained during the final 10 trials of the experiment. The conclusion that adequate airspeed and altitude cues could be obtained from the glideslope and runway poles is supported by the absence of significant performance differences among display conditions.

Murphy, M. R.↗

Advanced control technology and airworthiness flying qualities requirements

Flying quality requirements are specified in terms of the complete pilot-airframe-systems loop, the task, and the environment. Results from a study of flying qualities are reported. A review of the treatment of failure cases in various flying quality requirements is presented along with a description of the methods used and relevant lessons learned from recent Autoland certification programs.

Snyder, C. T.↗

Computer-Aided Systems Engineering for Flight Research Projects Using a Workgroup Database

An online systems engineering tool for flight research projects has been developed through the use of a workgroup database. Capabilities are implemented for typical flight research systems engineering needs in document library, configuration control, hazard analysis, hardware database, requirements management, action item tracking, project team information, and technical performance metrics. Repetitive tasks are automated to reduce workload and errors. Current data and documents are instantly available online and can be worked on collaboratively. Existing forms and conventional processes are used, rather than inventing or changing processes to fit the tool. An integrated tool set offers advantages by automatically cross-referencing data, minimizing redundant data entry, and reducing the number of programs that must be learned. With a simplified approach, significant improvements are attained over existing capabilities for minimal cost. By using a workgroup-level database platform, personnel most directly involved in the project can develop, modify, and maintain the system, thereby saving time and money. As a pilot project, the system has been used to support an in-house flight experiment. Options are proposed for developing and deploying this type of tool on a more extensive basis.

Mizukami, Masahi↗

Method for Generating Expert Derived Confidence Scores

We executed a pilot demonstration of a methodology for developing a new confidence metric to help operators calibrate their trust in ML event classifiers. This confidence metric was derived from domain expert judgment and was accompanied with a qualitative description describing the reason for each confidence rating. After learning the boundaries of an ML’s performance by studying a subset of events an SME rated his confidence in the ML’s ability to classify similar events and provided an explanation for his ratings. To demonstrate this methodology, we developed our expert driven confidence scores for the ML event classifier within the ESAMS. Next, we assessed the accuracy of the human expert confidence scores relative to the ML’s uncertainty quantification scores. This report includes a description of our methodology, summary of our findings and future directions.

97 MATHEMATICS AND COMPUTING↗

Toward an embedded training tool for Deep Space Network operations

There are three issues to consider when building an embedded training system for a task domain involving the operation of complex equipment: (1) how skill is acquired in the task domain; (2) how the training system should be designed to assist in the acquisition of the skill, and more specifically, how an intelligent tutor could aid in learning; and (3) whether it is feasible to incorporate the resulting training system into the operational environment. This paper describes how these issues have been addressed in a prototype training system that was developed for operations in NASA's Deep Space Network (DSN). The first two issues were addressed by building an executable cognitive model of problem solving and skill acquisition of the task domain and then using the model to design an intelligent tutor. The cognitive model was developed in Soar for the DSN's Link Monitor and Control (LMC) system; it led to several insights about learning in the task domain that were used to design an intelligent tutor called REACT that implements a method called 'impasse-driven tutoring'. REACT is one component of the LMC training system, which also includes a communications link simulator and a graphical user interface. A pilot study of the LMC training system indicates that REACT shows promise as an effective way for helping operators to quickly acquire expert skills.

Hill, Randall W., Jr.↗

Development of a framework for sequential Bayesian design of experiments: Application to a pilot-scale solvent-based CO 2 capture process

In this paper, a methodology is developed for sequential design of experiments (SDoE) for process systems and applied to a solvent-based CO 2 capture system. In this approach, the prior knowledge of the system is used to prioritize process data collection at specific operating conditions. These data are then incorporated into a Bayesian inference methodology for updating a stochastic model by refining estimations of its underlying parameters, and the updated model is then used to generate the next set of test runs. Thus, the new knowledge obtained from the data is used to guide subsequent iterations of the experimental runs, ensuring that the overall data collection is maximally informative given that most experimental campaigns, especially at pilot or higher-scale plants, are costly, time-consuming, and resource-limited. The test run objective for this work was to minimize the maximum model prediction uncertainty for key output variables, but the methodology is generic and can be readily applied to other test run objectives. This methodology is applied to an aqueous monoethanolamine (MEA) pilot plant campaign at the National Carbon Capture Center (NCCC) in Wilsonville, Alabama, USA. The SDoE framework was utilized for two iterations, while collecting 18 sets of data representing different process conditions, and this resulted in an overall average reduction in uncertainty of approximately 50% in the prediction of CO 2 capture percentage. Moreover, 11 additional data sets were obtained with variation of absorber packing height for further model validation. This work shows the capability of the SDoE framework to maximize learning given limited resources, allowing for the reduction of model uncertainty, which is of great importance for many applications including reduction of technical risk associated with scale-up and economic analysis.

20 FOSSIL-FUELED POWER PLANTS↗

The X-15 airplane - Lessons learned

The X-15 rocket research airplane flew to an altitude of 354,000 ft and reached Mach 6.70. In almost 200 flights, this airplane was used to gather aerodynamic-heating, structural loads, stability and control, and atmospheric-reentry data. This paper describes the origins, design, and operation of the X-15 airplane. In addition, lessons learned from the X-15 airplane that are applicable to designing and testing the National Aero-Space Plane are discussed.

Aeroplane↗