Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Task Performance and Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Man-machine Integration Design and Analysis System (MIDAS) Task Loading Model (TLM) experimental and software detailed design report

This is the experimental and software detailed design report for the prototype task loading model (TLM) developed as part of the man-machine integration design and analysis system (MIDAS), as implemented and tested in phase 6 of the Army-NASA Aircrew/Aircraft Integration (A3I) Program. The A3I program is an exploratory development effort to advance the capabilities and use of computational representations of human performance and behavior in the design, synthesis, and analysis of manned systems. The MIDAS TLM computationally models the demands designs impose on operators to aide engineers in the conceptual design of aircraft crewstations. This report describes TLM and the results of a series of experiments which were run this phase to test its capabilities as a predictive task demand modeling tool. Specifically, it includes discussions of: the inputs and outputs of TLM, the theories underlying it, the results of the test experiments, the use of the TLM as both stand alone tool and part of a complete human operator simulation, and a brief introduction to the TLM software design.

Staveland, Lowell↗

Deep learning-enabled natural language processing to identify directional pharmacokinetic drug–drug interactions

Background. During drug development, it is essential to gather information about the change of clinical exposure of a drug (object) due to the pharmacokinetic (PK) drug-drug interactions (DDIs) with another drug (precipitant). While many natural language processing (NLP) methods for DDI have been published, most were designed to evaluate if (and what kind of) DDI relationships exist in the text, without identifying the direction of DDI (object vs. precipitant drug). Here we present a method for the automatic identification of the directionality of a PK DDI from literature or drug labels. Methods. We reannotated the Text Analysis Conference (TAC) DDI track 2019 corpus for identifying the direction of a PK DDI and evaluated the performance of a fine-tuned BioBERT model on this task by following the training and validation steps prespecified by TAC. Results. This initial attempt showed the model achieved an F-score of 0.82 in identifying sentences as containing PK DDI and an F-score of 0.97 in identifying object versus precipitant drugs in those sentences. Discussion and conclusion. Despite a growing list of NLP methods for DDI extraction, most of them use a common set of corpora to perform general purpose tasks (e.g., classifying a sentence into one of several fixed DDI categories). There is a lack of coordination between the drug development and biomedical informatics method development community to develop corpora and methods to perform specific tasks (e.g., extract clinical exposure changes due to PK DDI). We hope that our effort can encourage such a coordination so that more “fit for purpose” NLP methods could be developed and used to facilitate the drug development process.

59 BASIC BIOLOGICAL SCIENCES↗

ORNL Neutron Cross Section Measurements of 90 Zr

Nuclear criticality modeling and simulations rely on the quality of the existing evaluated nuclear data libraries such as Evaluated Nuclear Data File (ENDF)/B, the Joint Evaluated Fission and Fusion (JEFF) nuclear data library, or the Japanese Evaluated Nuclear Data Library (JENDL). In some cases, the cross-section evaluations of those libraries were found to be deficient in describing criticality benchmarks accurately. More than two decades ago, the US Nuclear Criticality Safety Program (NCSP) established a Nuclear Data (ND) task which encompassed experiments and evaluations. In response to this, the Oak Ridge National Laboratory (ORNL) formed a Nuclear Criticality and Data group which performed ND experiments, data analysis, and evaluations to produce ENDF files for the ND libraries as identified in the NCSP Five-Year Plan. Before being submitted to the ENDF library, files were processed and tested for performance by running benchmark calculations. This procedure was centralized in the ORNL group and is now often referred to as the ND pipeline. NCSP collaborates with the Joint Research Center (JRC) of the European Commission in Geel, Belgium, to perform high-resolution neutron-induced cross section measurements at the Geel Linear Accelerator (GELINA). The objective is to address emerging ND problems in criticality calculations. Difficulties with ND include insufficient neutron energy range, missing covariances, and previously unrecognized inaccuracies with experiments. New neutron total and capture cross sections of 90 Zr in the neutron energy range from 100 eV to several hundred keV were recently performed. These measured data will be used, together with existing high-resolution transmission data from a metallic 90 Zr sample, to improve representation of the cross sections.

97 MATHEMATICS AND COMPUTING↗

Conceptual design study for a teleoperator visual system, phase 1

Results are reported for work performed during the first phase of the conceptual design study for a teleoperator visual system. This phase consists of four tasks: General requirements, concept development, subsystem requirements and analysis, and concept evaluation.

Adams, D.↗

Evaluation of tactual displays for flight control

Manual tracking experiments were conducted to determine the suitability of tactual displays for presenting flight-control information in multitask situations. Although tracking error scores are considerably greater than scores obtained with a continuous visual display, preliminary results indicate that inter-task interference effects are substantially less with the tactual display in situations that impose high visual scanning workloads. The single-task performance degradation found with the tactual display appears to be a result of the coding scheme rather than the use of the tactual sensory mode per se. Analysis with the state-variable pilot/vehicle model shows that reliable predictions of tracking errors can be obtained for wide-band tracking systems once the pilot-related model parameters have been adjusted to reflect the pilot-display interaction.

Levison, W. H.↗

Measuring pilot workload in a motion base simulator. III - Synchronous secondary task

This experiment continues earlier research of Kantowitz et al. (1983) conducted in a GAT-1 motion-base trainer to evaluate choice-reaction secondary tasks as measures of pilot work load. The earlier work used an asynchronous secondary task presented every 22 sec regardless of flying performance. The present experiment uses a synchronous task presented only when a critical event occurred on the flying task. Both two- and four-choice visual secondary tasks were investigated. Analysis of primary flying-task results showed no decrement in error for altitude, indicating that the key assumption necessary for using a choice secondary task was satisfied. Reaction times showed significant differences between 'easy' and 'hard' flight scenarios as well as the ability to discriminate among flight tasks.

Kantowitz, Barry H.↗

Gamma ray astronomy

Miscellaneous tasks related to the development of the Bursts and Transient Source Experiment on the Gamma Ray Observatory and to analysis of archival data from balloon flight experiments were performed. The results are summarized and relevant references are included.

Paciesas, William S.↗

The electrocortical correlates of fluctuating states of attention during vigilance tasks

This study investigated the electrocortical correlates of attention. Sixteen subjects (seven females, nine males) engaged in a forty-minute target detection vigilance task. Task-irrelevant probe tones were presented every 2-4 seconds. While performing the vigilance task, the subjects were asked to press a button if they were daydreaming (i.e. having a task unrelated thought or TUT). Continuous electroencephalograms (EEG's) and event-related potentials (ERP's) were recorded from the subjects during the entire task. The continuous EEG data were analyzed for differences in absolute power throughout the task as well as before and after the subjects indicated that they were daydreaming (TUT response). ERP's elicited by task-irrelevant probe tones were analyzed in the same manner. The results indicated performance decrements as reflected by increased RT to correct detections, and decreased number of hits. Further, as the task progressed, the number of reports of daydreaming increased. The analysis of the EEG data indicated a significant difference in the absolute power of the different frequency bands across periods. The greatest difference was observed at the posterior parietal electrode sites. In addition, when the EEG data was converted into band ratios (beta/alpha and beta/alpha+theta), the pre-TUT conditions were found to be significantly different than the post-TUT conditions in the posterior sites. The ERP components (N1, N2, and P2) were not significantly different before and after a TUT response or across periods. However, the ERP's across periods exhibited amplitudes that were similar to those found in previous studies of vigilance and ERP's.

Cunningham, Stephen G.↗

Handling Qualities Assessment of Manual Lunar Landing with Display Augmentation

Research and development is being conducted to support data-driven design decisions for manual control and human involvement in the lunar landing task under the Human Landing System (HLS) program within the Artemis campaign. A human-in-the-loop simulator evaluation of the manual control of a lunar landing vehicle in the final approach and landing phase was conducted at NASA Langley Research Center in the Lunar Flight Deck simulator using the Altair Design and Analysis Cycle (DAC)-2 government reference vehicle. The objective was to perform a direct comparison of control law types with display aiding for various rotational control powers being considered under HLS. Ten subjects (four NASA test pilots and six current pilot astronauts) provided Cooper-Harper ratings, NASA Task Load Index workload ratings, and qualitative comments. The piloting task was to assume manual control of the vehicle (including vertical descent rate) at 150 m above the landing zone, fly to a redesignated landing target (which was up to 75 m radially from the center of the landing zone) and to touch down within a position accuracy of 5m. The data showed that the display augmentation in the form of a “hover cue” significantly improved the pilot’s ability to control translation and create satisfactory handling qualities for otherwise sluggish configurations; however, the investigation also showed that display augmentation is not a panacea. Handling qualities problems, including pilot-induced oscillations, and higher workload for the lowest control powers can still be evident.

Lynda J. Kramer↗

Handling Qualities Assessment of Manual Lunar Landing with Display Augmentation

Research and development is being conducted to support data-driven design decisions for manual control and human involvement in the lunar landing task under the Human Landing System (HLS) program within the Artemis campaign. A human-in-the-loop simulator evaluation of the manual control of a lunar landing vehicle in the final approach and landing phase was conducted at NASA Langley Research Center in the Lunar Flight Deck simulator using the Altair Design and Analysis Cycle (DAC)-2 government reference vehicle. The objective was to perform a direct comparison of control law types with display aiding for various rotational control powers being considered under HLS. Ten subjects (four NASA test pilots and six current pilot astronauts) provided Cooper-Harper ratings, NASA Task Load Index workload ratings, and qualitative comments. The piloting task was to assume manual control of the vehicle (including vertical descent rate) at 150 m above the landing zone, fly to a redesignated landing target (which was up to 75 m radially from the center of the landing zone) and to touch down within a position accuracy of 5m. The data showed that the display augmentation in the form of a “hover cue” significantly improved the pilot’s ability to control translation and create satisfactory handling qualities for otherwise sluggish configurations; however, the investigation also showed that display augmentation is not a panacea. Handling qualities problems, including pilot-induced oscillations, and higher workload for the lowest control powers can still be evident.

Lynda Kramer↗

Exploration of an oculometer-based model of pilot workload

Potential relationships between eye behavior and pilot workload are discussed. A Honeywell Mark IIA oculometer was used to obtain the eye data in a fixed base transport aircraft simulation facility. The data were analyzed to determine those parameters of eye behavior which were related to changes in level of task difficulty of the simulated manual approach and landing on instruments. A number of trends and relationships between eye variables and pilot ratings were found. A preliminary equation was written based on the results of a stepwise linear regression. High variability in time spent on various instruments was related to differences in scanning strategy among pilots. A more detailed analysis of individual runs by individual pilots was performed to investigate the source of this variability more closely. Results indicated a high degree of intra-pilot variability in instrument scanning. No consistent workload related trends were found. Pupil diameter which had demonstrated a strong relationship to task difficulty was extensively re-exmained.

Krebs, M. J.↗

Environmental isolation task

The failure-analysis process was organized into a more specific set of long-term degradation steps so that material property change can be differentiated from module damage and module failure. Increasing module performance and life are discussed. A polymeric aging computer model is discussed. Early detection of polymer surface reactions due to aging is reported.

Coulbert, C. D.↗

Evaluating Mass Analyzers as Candidates for Small, Portable, Rugged Single Point Mass Spectrometers for Analysis of Permanent Gases

For Space Shuttle launch safety, there is a need to monitor the concentration Of H2, He, O2, and Ar around the launch vehicle. Currently a large mass spectrometry system performs this task, using long transport lines to draw in samples. There is great interest in replacing this stationary system with several miniature, portable, rugged mass spectrometers which act as point sensors which can be placed at the sampling point. Five commercial and two non-commercial analyzers are evaluated. The five commercial systems include the Leybold Inficon XPR-2 linear quadrupole, the Stanford Research (SRS-100) linear quadrupole, the Ferran linear quadrupole array, the ThermoQuest Polaris-Q quadrupole ion trap, and the IonWerks Time-of-Flight (TOF). The non-commercial systems include a compact double focusing sector (CDFMS) developed at the University of Minnesota, and a quadrupole ion trap (UF-IT) developed at the University of Florida.

Arkin, C. Richard↗

Evaluating Mass Analyzers as Candidates for Small, Portable, Rugged Single Point Mass Spectrometers for Analysis of Permanent Gases

For Space Shuttle launch safety, there is a need to monitor the concentration of H2, He, O2 and Ar around the launch vehicle. Currently a large mass spectrometry system performs this task, using long transport lines to draw in samples. There is great interest in replacing this stationary system with several miniature, portable, rugged mass spectrometers which act as point sensors which can be placed at the sampling point. Five commercial and two non-commercial analyzers are evaluated. The five commercial systems include the Leybold Inficon XPR-2 linear quadrupole, the Stanford Research (SRS-100) linear quadrupole, the Ferran linear quadrupole array, the ThermoQuest Polaris-Q quadrupole ion trap, and the IonWerks Time-of-Flight (TOF). The non-commercial systems include a compact double focusing sector (CDFMS) developed at the University of Minnesota, and a quadrupole ion trap (UF-IT) developed at the University of Florida. The System Volume is determined by measuring the entire system volume including the mass analyzer, its associated electronics, the associated vacuum system, the high vacuum pump and rough pump. Also measured are any ion gauge controllers or other required equipment. Computers are not included. Scan Time is the time required for one scan to be acquired and the data to be transferred. It is determined by measuring the time required acquiring a known number of scans and dividing by said number of scans. Limit of Detection is determined first by performing a zero-span calibration (using a 10-point data set). Then the limit of detection (LOD) is defined as 3 times the standard deviation of the zero data set. (An LOD of 10 ppm or less is considered acceptable.)

Arkin, C. Richard↗

Machine Learning-Based Temperature Prediction for Runtime Thermal Management Across System Components

Elevated temperatures limit the peak performance of systems because of frequent interventions by thermal throttling. Non-uniform thermal states across system nodes also cause performance variation within seemingly equivalent nodes leading to significant degradation of overall performance. In this paper we present a framework for creating a lightweight thermal prediction system suitable for run-time management decisions. We pursue two avenues to explore optimized lightweight thermal predictors. First, we use feature selection algorithms to improve the performance of previously designed machine learning methods. Second, we develop alternative methods using neural network and linear regression-based methods to perform a comprehensive comparative study of prediction methods. We show that our optimized models achieve improved performance with better prediction accuracy and lower overhead as compared with the Gaussian process model proposed previously. Specifically we present a reduced version of the Gaussian process model, a neural network-based model, and a linear regression-based model. Using the optimization methods, we are able to reduce the average prediction errors in the Gaussian process from 4: 2 degrees C to 2: 9 degrees C. We also show that the newly developed models using neural network and Lasso linear regression have average prediction errors of 2: 9 degrees C and 3: 8 degrees C respectively. The prediction overheads are 0.22, 0.097, and 0.026 ms per prediction for reduced Gaussian process, neural network, and Lasso linear regression models, respectively, compared with 0.57 ms per prediction for the previous Gaussian process model. We have implemented our proposed thermal prediction models on a two-node system configuration to help identify the optimal task placement. The task placement identified by the models reduces the average system temperature by up to 11: 9 degrees C without any performance degradation. Furthermore, these models respectively achieve 75, 82.5, and 74.17 percent success rates in correctly pointing to those task placements with better thermal response, compared with 72.5 percent success for the original model in achieving the same objective. Lastly, we extended our analysis to a 16-node system and we were able to train models and execute them in real time to guide task migration and achieve on average 17 percent reduction in the overall system cooling power.

97 MATHEMATICS AND COMPUTING↗

Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis

Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Map Applications to Target Exascale Architecture with Machine-Specific Performance Analysis, Including Challenges and Projections

This Exascale Computing Project (ECP) milestone report summarizes the status of all 30 ECP Applications Development (AD) subprojects at the end of FY20. In October and November of 2020, a comprehensive assessment of AD projects was conducted by the ECP leadership. Reviews occurred virtually between October 27, 2020 and November 12, 2020. The review committee—consisting of the AD lead, deputy, and L3—was tasked with evaluating each subproject’s progress in porting their codes to early exascale architectures considered precursors to the planned exascale machines. This includes characterizing which modules have been ported to multi-accelerator nodes, initial performance analyses, the status of software integration, and a current vision of successes, obstacles, and next steps. As such, this report contains not only an accurate snapshot of each subproject’s current status but also represents an unprecedentedly broad account of experiences in porting large scientific applications to next-generation high-performance computing architectures.

97 MATHEMATICS AND COMPUTING↗