Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Human Error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Software Assists in Responding to Anomalous Conditions

Fault Induced Document Retrieval Officer (FIDO) is a computer program that reduces the need for a large and costly team of engineers and/or technicians to monitor the state of a spacecraft and associated ground systems and respond to anomalies. FIDO includes artificial-intelligence components that imitate the reasoning of human experts with reference to a knowledge base of rules that represent failure modes and to a database of engineering documentation. These components act together to give an unskilled operator instantaneous expert assistance and access to information that can enable resolution of most anomalies, without the need for highly paid experts. FIDO provides a system state summary (a configurable engineering summary) and documentation for diagnosis of a potentially failing component that might have caused a given error message or anomaly. FIDO also enables high-level browsing of documentation by use of an interface indexed to the particular error message. The collection of available documents includes information on operations and associated procedures, engineering problem reports, documentation of components, and engineering drawings. FIDO also affords a capability for combining information on the state of ground systems with detailed, hierarchically-organized, hypertext- enabled documentation.

James, Mark↗

Saccades to remembered targets: the effects of smooth pursuit and illusory stimulus motion

1. Measurements were made in four normal human subjects of the accuracy of saccades to remembered locations of targets that were flashed on a 20 x 30 deg random dot display that was either stationary or moving horizontally and sinusoidally at +/-9 deg at 0.3 Hz. During the interval between the target flash and the memory-guided saccade, the "memory period" (1.4 s), subjects either fixated a stationary spot or pursued a spot moving vertically sinusoidally at +/-9 deg at 0.3 Hz. 2. When saccades were made toward the location of targets previously flashed on a stationary background as subjects fixated the stationary spot, median saccadic error was 0.93 deg horizontally and 1.1 deg vertically. These errors were greater than for saccades to visible targets, which had median values of 0.59 deg horizontally and 0.60 deg vertically. 3. When targets were flashed as subjects smoothly pursued a spot that moved vertically across the stationary background, median saccadic error was 1.1 deg horizontally and 1.2 deg vertically, thus being of similar accuracy to when targets were flashed during fixation. In addition, the vertical component of the memory-guided saccade was much more closely correlated with the "spatial error" than with the "retinal error"; this indicated that, when programming the saccade, the brain had taken into account eye movements that occurred during the memory period. 4. When saccades were made to targets flashed during attempted fixation of a stationary spot on a horizontally moving background, a condition that produces a weak Duncker-type illusion of horizontal movement of the primary target, median saccadic error increased horizontally to 3.2 deg but was 1.1 deg vertically. 5. When targets were flashed as subjects smoothly pursued a spot that moved vertically on the horizontally moving background, a condition that induces a strong illusion of diagonal target motion, median saccadic error was 4.0 deg horizontally and 1.5 deg vertically; thus the horizontal error was greater than under any other experimental condition. 6. In most trials, the initial saccade to the remembered target was followed by additional saccades while the subject was still in darkness. These secondary saccades, which were executed in the absence of visual feedback, brought the eye closer to the target location. During paradigms involving horizontal background movement, these corrections were more prominent horizontally than vertically. 7. Further measurements were made in two subjects to determine whether inaccuracy of memory-guided saccades, in the horizontal plane, was due to mislocalization at the time that the target flashed, misrepresentation of the trajectory of the pursuit eye movement during the memory period, or both. 8. The magnitude of the saccadic error, both with and without corrections made in darkness, was mislocalized by approximately 30% of the displacement of the background at the time that the target flashed. The magnitude of the saccadic error also was influenced by net movement of the background during the memory period, corresponding to approximately 25% of net background movement for the initial saccade and approximately 13% for the final eye position achieved in darkness. 9. We formulated simple linear models to test specific hypotheses about which combinations of signals best describe the observed saccadic amplitudes. We tested the possibilities that the brain made an accurate memory of target location and a reliable representation of the eye movement during the memory period, or that one or both of these was corrupted by the illusory visual stimulus. Our data were best accounted for by a model in which both the working memory of target location and the internal representation of the horizontal eye movements were corrupted by the illusory visual stimulus. We conclude that extraretinal signals played only a minor role, in comparison with visual estimates of the direction of gaze, in planning eye movements to remembered targ.

Clinical Trial↗

Modeling of streamflow in a 30 km long reach spanning 5 years using OpenFOAM 5.x

Abstract. Developing accurate and efficient modeling techniques for streamflow at the tens-of-kilometers spatial scale and multi-year temporal scale is critical for evaluating and predicting the impact of climate- and human-induced discharge variations on river hydrodynamics. However, achieving such a goal is challenging because of limited surveys of streambed hydraulic roughness, uncertain boundary condition specifications, and high computational costs. We demonstrate that accurate and efficient three-dimensional (3-D) hydrodynamic modeling of natural rivers at 30 km and 5-year scales is feasible using the following three techniques within OpenFOAM, an open-source computational fluid dynamics platform: (1) generating a distributed hydraulic roughness field for the streambed by integrating water-stage observation data, a rough wall theory, and a local roughness optimization and adjustment strategy; (2) prescribing the boundary condition for the inflow and outflow by integrating precomputed results of a one-dimensional (1-D) hydraulic model with the 3-D model; and (3) reducing computational time using multiple parallel runs constrained by 1-D inflow and outflow boundary conditions. Streamflow modeling for a 30 km long reach in the Columbia River (CR) over 58 months can be achieved in less than 6 d using 1.1 million CPU hours. The mean error between the modeled and the observed water stages for our simulated CR reach ranges from −16 to 9 cm (equivalent to approximately ±7 % relative to the average water depth) at seven locations during most of the years between 2011 and 2019. We can reproduce the velocity distribution measured by the acoustic Doppler current profiler (ADCP). The correlation coefficients of the depth-averaged velocity between the model and ADCP measurements are in the range between 0.71 and 0.83 at 75 % of the survey cross sections. With the validated model, we further show that the relative importance of dynamic pressure versus hydrostatic pressure varies with discharge variations and topography heterogeneity. Given the model's high accuracy and computational efficiency, the model framework provides a generic approach to evaluate and predict the impacts of climate- and human-induced discharge variations on river hydrodynamics at tens-of-kilometers and decadal scales.

58 GEOSCIENCES↗

Automated vehicle microscopic energy consumption study (AV-Micro): Data collection and model development

While the Adaptive Cruise Control (ACC) system in automated vehicles (AVs) is expected to impact transportation energy significantly, existing AV energy consumption models only directly adopt those developed with Human-driven Vehicle (HV) data without even slight adaptation or calibration to accommodate unique AV energy consumption features. This study will investigate how accurately HV data-based models can predict the energy consumption of AVs. Empirical trajectory data and corresponding instantaneous energy consumption rates from both AVs and HVs were collected. We adopted two classical HV data-based models to fit these data. The calibration results indicated that these models yield around 20 30% prediction errors for AVs. To further improve the prediction accuracy, this study designed an AV-Micro model by incorporating components of multiple classic energy consumption models that better capture ACC energy consumption features, including piecewise driving behavior. With this, the AV-Micro model achieves lower than 10% prediction errors. The AV-Micro model’s high consistency across different test runs was verified with statistical significance tests, demonstrating its adaptability in different driving profiles. To confirm the discrepancies between the energy consumption features of AVs and HVs, more statistical significance tests were conducted to show that the AV-Micro model cannot be directly applied to HV data. The findings by calibrated AV-Micro models revealed that AVs consume approximately 80.5–146.4 J more energy than HVs for each meter traveled. Furthermore, the frequency analysis of energy consumption indicates that there is still some room for AVs to improve energy efficiency, particularly given their larger amplitude high-frequency fluctuations.

33 ADVANCED PROPULSION SYSTEMS↗

Accurate Identification of Deamidation and Citrullination from Global Shotgun Proteomics Data Using a Dual-Search Delta Score Strategy

While proteins with deamidated/citrullinated amino acids play critical roles in the pathogenesis of many human diseases, identifying these modifications in complex biological samples has been an ongoing challenge. Herein we present a method to accurately identify these modifications from shotgun proteomics data from a deep proteome profiling study of human pancreatic islets obtained by laser capture microdissection. All MS/MS spectra were searched against database by MSGF+ twice with or without a +0.9840 Da mass shift on amino acids asparagine, glutamine, and arginine (NQR) as a dynamic modification. Consequently, for each spectrum the resulting two peptide-to-spectrum matches (PSM) with their respective MSGF+ scores were used for Delta Score calculation. It was observed that all PSMs with positive Delta Score values were clustered with mass errors around 0 ppm, while PSMs with negative Delta Score values were distributed nearly equally within the defined mass error range (20 ppm) for database searching. To estimate false discovery rate (FDR), a “pseudo-decoy” approach was applied whether datasets were searched against a database with a “real modification” mass shift (+0.9840 Da) and a “mock modification” mass shift (+1.0227 Da). FDR was controlled to ~2% with a Delta Score filter greater than zero. Manual inspection of spectra showed that PSMs with positive Delta Score value contained deamidated/citrullinated fragments in their MS/MS spectra. Finally, the results demonstrated that in-situ deamidated/citrullinated peptides can be accurately identified from shotgun tissue proteomics data by the Dual-search Delta Score Strategy.

59 BASIC BIOLOGICAL SCIENCES↗

Measurement Uncertainty in One-of-a-kind Experiments

A golden standard in science is to repeat an experimental measurement multiple times and calculate the measured value with experimental uncertainty by following well developed statistical procedures. For various reasons – cost, technical difficulty, international treaties, ethics of dealing with human or animal subjects, ecology - many important experiments and observations can not be repeated. Astronomy, earthquakes, hurricanes produce data from one-of-a-kind events. When information is not available in any other way, it should not be dismissed as qualitative, anecdotal evidence only. Analyzed in a mathematically rigorous way, it produces quantitative experimental data. Analysis of data from one-of-a-kind event differs from analysis of repeated experiments’ data. For repeated experiments, the experimental error includes a range of true values generated by repetitions of the experiment, and measurement uncertainty caused by detectors. They are independent. Repetitions of any experiment, as similar as achievable, always have built-in differences resulting in a range of the true values rather than in a single value. Measurement uncertainty depends on the measurement system only. Digital measurements have very small uncertainty, frequently smaller than the range of true experimental values resulting from built-in differences in the experiment repetitions. When data from one–of–a kind experiment are analyzed, only the measurement uncertainty can be reported.

42 ENGINEERING↗

Experiments with Test Case Generation and Runtime Analysis

Software testing is typically an ad hoc process where human testers manually write many test inputs and expected test results, perhaps automating their execution in a regression suite. This process is cumbersome and costly. This paper reports preliminary results on an approach to further automate this process. The approach consists of combining automated test case generation based on systematically exploring the program's input domain, with runtime analysis, where execution traces are monitored and verified against temporal logic specifications, or analyzed using advanced algorithms for detecting concurrency errors such as data races and deadlocks. The approach suggests to generate specifications dynamically per input instance rather than statically once-and-for-all. The paper describes experiments with variants of this approach in the context of two examples, a planetary rover controller and a space craft fault protection system.

Artho, Cyrille↗

A Near-Term Concept for Trajectory Based Operations with Air/Ground Data Link Communication

An operating concept and required system components for trajectory-based operations with air/ground data link for today's en route and transition airspace is proposed. Controllers are fully responsible for separation as they are today, and no new aircraft equipage is required. Trajectory automation computes integrated solutions to problems like metering, weather avoidance, traffic conflicts and the desire to find and fly more time/fuel efficient flight trajectories. A common ground-based system supports all levels of aircraft equipage and performance including those equipped and not equipped for data link. User interface functions for the radar controller's display make trajectory-based clearance advisories easy to visualize, modify if necessary, and implement. Laboratory simulations (without human operators) were conducted to test integrated operation of selected system components with uncertainty modeling. Results are based on 102 hours of Fort Worth Center traffic recordings involving over 37,000 individual flights. The presence of uncertainty had a marginal effect (5%) on minimum-delay conflict resolution performance, and windfavorable routes had no effect on detection and resolution metrics. Flight plan amendments and clearances were substantially reduced compared to today s operations. Top-of-descent prediction errors are the largest cause of failure indicating that better descent predictions are needed to reliably achieve fuel-efficient descent profiles in medium to heavy traffic. Improved conflict detections for climbing flights could enable substantially more continuous climbs to cruise altitude. Unlike today s Conflict Alert, tactical automation must alert when an altitude amendment is entered, but before the aircraft starts the maneuver. In every other failure case tactical automation prevented losses of separation. A real-time prototype trajectory trajectory-automation system is running now and could be made ready for operational testing at an en route Center in 1-2 years.

McNally, David↗

Thomas Leps Internship Abstract

An optical navigation system is being flown as the backup system to the primary Deep Space Network telemetry for navigation and guidance purposes on Orion. This is required to ensure Orion can recover from a loss of communication, which would simultaneously cause a loss of DSN telemetry. Images taken of the Moon and Earth are used to give range and position information to the navigation computer for trajectory calculations and maneuver execution. To get telemetry data from these images, the size and location of the moon need to be calculated with high accuracy and precision. The reentry envelope for the Orion EM-1 mission requires the centroid and radius of the moon images to be determined within 1/3 of a pixel 3 sigma. In order to ensure this accuracy and precision can be attained, I was tasked with building precise dot grid images for camera calibration as well as building a hardware in the loop test stand for flight software and hardware proofing. To calibrate the Op-Nav camera a dot grid is imaged with the camera, the error between the image dot location and the actual dot location can be used to build a distortion map of the camera and lens system so that images can be fixed to display truth locations. To build the dot grid images I used the Electro Optics Lab optical bench Bright Object Simulator System, and gimbal. The gimbal was slewed to a series of elevations and azimuths. An image of the collimated single point light source was then taken at each position. After a series of 99 images were taken at different locations the single light spots were extracted from each image and added to a composite image containing all 99 points. During the development of these grids it was noticed that an intermittent error in the artificial "star" locations occurred. Prior to the summer this error was attributed to the gimbal having glitches in it's pointing direction and was going to be replaced, however after further examining the issue I determined it to be a software issue. I have since narrowed the likely source of the error down to a Software Development Kit released by the camera supplier PixeLink. I have since developed a workaround in order to build star grids for calibration until the software bug can be isolated and fixed. I was also tasked with building a Hardware in the Loop test stand in order to test the full Op-Nav system. A 4k screen displays simulated Lunar and Terrestrial images from a possible Orion trajectory. These images are then projected through a collimator and then captured with an Op-Nav camera controlled by an Intel NUC computer running flight software. The flight software then analyzes the images to determine attitude and position, this data is then reconstructed into a trajectory and matched to the simulated trajectory in order to determine the accuracy of the attitude and position estimates. In order for the system to work it needs to be precisely and accurately aligned. I developed an alignment procedure that allows the screen, collimator and camera to be squared, centered and collinear with each other within a micron spatially and 5 arcseconds in rotation. I also designed a rigid mount for the screen that was machined on site in Building 10 by another intern. While I was working in the EOL we received a $500k Orion startracker for alignment procedure testing. Due to my prior experience in electronics development, as an ancillary duty, I was tasked with building the cables required to operate and power the startracker. If any errors are made building these cables the startracker would be destroyed, I was honored that the director of the lab entrusted such a critical component with me. This internship has cemented my view on public space exploration. I always preferred public sector to privatization because, as a scientist, the most interesting aspects of space for me are not necessarily the most profitable. I was concerned that the public sector was faltering however, and that in order to improve human space exploration I would be forced into private sector. I now know that, at least at JSC, human spaceflight is still progressing, and exciting work is still being done. I am now actively seeking employment at JSC after I complete my Ph.D and have met with my branch chiefs and mentor to discuss transitioning to a grad Co-op position.

Leps, Thomas↗

Extending Validated Human Performance Models to Explore NextGen Concepts

To meet the expected increases in air traffic demands, NASA and FAA are researching and developing Next Generation Air Transportation System (NextGen) concepts. NextGen will require substantial increases in the data available to pilots on the flight deck (e.g., weather,wake, traffic trajectory predictions, etc.) to support more precise and closely coordinated operations (e.g., self-separation, RNAV/RNP, and closely spaced parallel operations, CSPOs). These NextGen procedures and operations, along with the pilot's roles and responsibilities, must be designed with consideration of the pilot's capabilities and limitations. Failure to do so will leave the pilots, and thus the entire aviation system, vulnerable to error. A validated Man-machine Integration and design Analysis System (MIDAS) v5 model was extended to evaluate anticipated changes to flight deck and controller roles and responsibilities in NextGen approach and Land operations. Compared to conditions when the controllers are responsible for separation on decent to land phase of flight, the output from these model predictions suggest that the flight deck response time to detect the lead aircraft blunder will decrease, pilot scans to the navigation display will increase, and workload will increase.

Gore, Brian Francis↗

A quantitative comparison of simultaneous BOLD fMRI and NIRS recordings during functional brain activation

Near-infrared spectroscopy (NIRS) has been used to noninvasively monitor adult human brain function in a wide variety of tasks. While rough spatial correspondences with maps generated from functional magnetic resonance imaging (fMRI) have been found in such experiments, the amplitude correspondences between the two recording modalities have not been fully characterized. To do so, we simultaneously acquired NIRS and blood-oxygenation level-dependent (BOLD) fMRI data and compared Delta(1/BOLD) (approximately R(2)(*)) to changes in oxyhemoglobin, deoxyhemoglobin, and total hemoglobin concentrations derived from the NIRS data from subjects performing a simple motor task. We expected the correlation with deoxyhemoglobin to be strongest, due to the causal relation between changes in deoxyhemoglobin concentrations and BOLD signal. Instead we found highly variable correlations, suggesting the need to account for individual subject differences in our NIRS calculations. We argue that the variability resulted from systematic errors associated with each of the signals, including: (1) partial volume errors due to focal concentration changes, (2) wavelength dependence of this partial volume effect, (3) tissue model errors, and (4) possible spatial incongruence between oxy- and deoxyhemoglobin concentration changes. After such effects were accounted for, strong correlations were found between fMRI changes and all optical measures, with oxyhemoglobin providing the strongest correlation. Importantly, this finding held even when including scalp, skull, and inactive brain tissue in the average BOLD signal. This may reflect, at least in part, the superior contrast-to-noise ratio for oxyhemoglobin relative to deoxyhemoglobin (from optical measurements), rather than physiology related to BOLD signal interpretation.

Non-NASA Center↗

A space servicing telerobotics technology demonstration

Supervised telerobotic controls provide the key to successful remote servicing, as demonstrated in the telerobot testbed of the jet propulsion laboratory. Such advanced techniques and systems are specially applicable to ground-remote operations for servicing tasks, which are to be performed remotely in space and to be operated under human supervision from the ground. Laboratory demonstrations have successfully proven the utility of such techniques and systems. Instrumental to the success of supervised robotic operations are the techniques called object designate and relative target. In addition, a technique called universal camera calibration was also applied in the telerobot testbed. Generalized compliant control techniques were used in the robotic removal and insertion operations. These techniques were proven successful in task situations where preprogrammed automation cannot be adequately exercised due to errors, changes, or omission in the worksite data base.

Kan, Edwin P.↗

Section on Observed Impacts on El Nino

Agricultural applications of El Nino forecasts are already underway in some countries and need to be evaluated or re-evaluated. For example, in Peru, El Nino forecasts have been incorporated into national planning for the agricultural sector, and areas planted with rice and cotton (cotton being the more drought-tolerant crop) are adjusted accordingly. How well are this and other such programs working? Such evaluations will contribute to the governmental and intergovernmental institutions, including the Inter-American Institute for Global Change Research and the US National Ocean and Atmospheric Agency that are fostering programs to aid the effective use of forecasts. As El Nino climate forecasting grows out of the research mode into operational mode, the research focus shifts to include the design of appropriate modes of utilization. Awareness of and sensitivity to the costs of prediction errors also grow. For example, one major forecasting model failed to predict the very large El Nino event of 1997, when Pacific sea-surface temperatures were the highest on record. Although simple correlations between El Nino events and crop yields may be suggestive, more sophisticated work is needed to understand the subtleties of the interplay among the global climate system, regional climate patterns, and local agricultural systems. Honesty about the limitations of an forecast is essential, especially when human livelihoods are at stake. An end-to-end analysis links tools and expertise from the full sequence of ENSO cause-and-effect processes. Representatives from many disciplines are needed to achieve insights, e.g, oceanographers and atmospheric scientists who predict El Nino events, climatologists who drive global climate models with sea-surface temperature predictions, agronomists who translate regional climate connections in to crop yield forecasts, and economists who analyze market adjustments to the vagaries of climate and determine the value of climate forecasts. Methods include historical studies to understand past patterns and to test hindcasts of the prediction tools, crop modeling, spatial analysis and remote sensing. This research involves expanding, deepening, and applying the understanding of physical climate to the fields of agronomy and social science; and the reciprocal understanding of crop growth and farm economics to climatology. Delivery of a regional climate forecast with no information about how the climate forecast was derived limits its effectiveness. Explanation of a region's major climate driving forces helps to place a seasonal forecast in context. Then, a useful approach is to show historical responses to previous El Nino events, and projections, with uncertainty intervals, of crop response from dynamic process crop growth models. Regional ID forecasts should be updated with real-time weather conditions. Since every El Nino event is different, it is important to track, report and advise on each new event as it unfolds. The stability of human enterprises depends on understanding both the potentialities and the limits of predictability. Farmers rely on past experience to anticipate and respond to fluctuations in the biophysical systems on which their livelihoods depend. Now scientists are improving their ability to predict some major elements of climate variability. The improvements in the reliability of El Nino forecasts are encouraging, but seasonal forecasts for agriculture are not, and will probably never be completely infallible, due to the chaotic nature of the climate system. Uncertainties proliferate as we extend beyond Pacific sea-surface temperatures to climate teleconnections and agricultural outcomes. The goal of this research is to shed as a clear light as possible on these inherent uncertainties and thus to contribute to the development of appropriate responses to El Nino and other seasonal forecasts for a range of stakeholders, which, ultimately, includes food consumers everywhere.

Rosenzweig, Cynthia↗

Measuring Image Navigation and Registration Performance at the 3-Sigma Level Using Platinum Quality Landmarks

Geostationary Operational Environmental Satellite (GOES) Image Navigation and Registration (INR) performance is specified at the 3- level, meaning that 99.7% of a collection of individual measurements must comply with specification thresholds. Landmarks are measured by the Replacement Product Monitor (RPM), part of the operational GOES ground system, to assess INR performance and to close the INR loop. The RPM automatically discriminates between valid and invalid measurements enabling it to run without human supervision. In general, this screening is reliable, but a small population of invalid measurements will be falsely identified as valid. Even a small population of invalid measurements can create problems when assessing performance at the 3-sigma level. This paper describes an additional layer of quality control whereby landmarks of the highest quality ("platinum") are identified by their self-consistency. The platinum screening criteria are not simple statistical outlier tests against sigma values in populations of INR errors. In-orbit INR performance metrics for GOES-12 and GOES-13 are presented using the platinum landmark methodology.

Carr, James L.↗

Mission Design Analysis for the Martian Moon Phobos: Close Flybys, Missed Thrusts, and Other In-Flight Entertainment

A robotic mission to the Martian moons Phobos and Deimos would offer a wealth of scientific information and serve as a useful precursor to potential human missions. In this paper, we investigate a prospective mission enabled by solar electric propulsion that would explore Phobos via a series of flybys followed by capture into orbit around the moon. Of particular interest are low-cost options for capture and walkdown to the target science orbits aided by multi-body effects due to the mutual gravitational interaction of Phobos and Mars. We also consider contingency operations in the event of missed thrust or maneuver execution errors.

SEP↗

Transcribing Air Traffic Control System Command Center Planning Telecons Using Cloud-Based Automatic Speech Recognition

This paper addresses the challenge of using Automatic Speech Recognition (ASR) technology to transcribe regular teleconferences that happen between FAA Air Traffic Control System Command Center (ATCSCC) planners, stakeholders and air users. These planning teleconferences (aka telecons or planning webinars) are an integral part of managing air traffic in the U.S. National Airspace System (NAS). In particular, the meetings facilitate the creation and modification of various traffic management initiatives (TMIs), that are used to regulate the flow of air traffic. This is typically a human intensive process, requiring specialists to listen to the entire meeting audio (10-20 minutes duration) and inferring the state of the NAS (e.g., weather phenomenon) that was discussed. It would be advantageous to have digital transcripts of the audio and have useful information (e.g., related to TMIs) automatically extracted from the transcripts. In this regard, we are exploring the adoption of state-of-the-art speech to text and Natural Language Processing (NLP) tools that will achieve our objective of digitizing the webinar audio. Unfortunately, the highly technical phraseology present in the audio and limited data availability for model building make ASR difficult. To overcome this challenge, we have taken the critical first step in creating a human transcription dataset from ~20 hours of speech in the ATCSCC audio with the help of subject matter experts. A novelty of our work is the creation of a ground truth transcription dataset for ATCSCC teleconference webinars, which is particularly important for Aviation domain-specific NLP tasks. Using Microsoft Speech Studio, a cloud-based ASR platform, we have fine-tuned the English pre-trained ASR models (available in speech studio) and achieved an average word error rate (WER) of 6.81%. The baseline ASR also provides a digital version of each planning webinar, making it accessible and text-searchable for future references. Additionally, the transcriptions can serve as a bridge between raw audio data and a range of text-based NLP tasks, such as named entity recognition (NER) and intent classification, potentially enhancing the digital footprint of the webinars and other connected data sources. Our work has several potential applications. Firstly, the transcriptions can be analyzed to understand the complex decision process of creating, implementing and modifying TMIs and may also contribute to TMI prediction services. Secondly, our dataset and model can be used to develop more accurate ASR systems for aviation-specific language, which can bring about digital communication in the aviation industry (and aid current “voice only” communications, which are inherently error-prone). Lastly, the transcriptions themselves can be used as a valuable resource for training other NLP models.

Stephen S. B. Clarke↗

Sustained attention performance during sleep deprivation: evidence of state instability

Nathaniel Kleitman was the first to observe that sleep deprivation in humans did not eliminate the ability to perform neurobehavioral functions, but it did make it difficult to maintain stable performance for more than a few minutes. To investigate variability in performance as a function of sleep deprivation, n = 13 subjects were tested every 2 hours on a 10-minute, sustained-attention, psychomotor vigilance task (PVT) throughout 88 hours of total sleep deprivation (TSD condition), and compared to a control group of n = 15 subjects who were permitted a 2-hour nap every 12 hours (NAP condition) throughout the 88-hour period. PVT reaction time means and standard deviations increased markedly among subjects and within each individual subject in the TSD condition relative to the NAP condition. TSD subjects also had increasingly greater performance variability as a function of time on task after 18 hours of wakefulness. During sleep deprivation, variability in PVT performance reflected a combination of normal timely responses, errors of omission (i.e., lapses), and errors of commission (i.e., responding when no stimulus was present). Errors of omission and errors of commission were highly intercorrelated across deprivation in the TSD condition (r = 0.85, p = 0.0001), suggesting that performance instability is more likely to include compensatory effort than a lack of motivation. The marked increases in PVT performance variability as sleep loss continued supports the "state instability" hypothesis, which posits that performance during sleep deprivation is increasingly variable due to the influence of sleep initiating mechanisms on the endogenous capacity to maintain attention and alertness, thereby creating an unstable state that fluctuates within seconds and that cannot be characterized as either fully awake or asleep.

Non-NASA Center↗