Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Performance consequences of automation-induced 'complacency'

The effect of variations in the reliability of an automated monitoring system on human operator detection of automation failures was examined in two experiments. For four 30-min sessions, 40 subjects performed an IBM PC-based flight simulation that included manual tracking and fuel-management tasks, as well as a system-monitoring task that was under automation control. Automation reliability - the percentage of system malfunctions detected by the automation routine - either remained constant at a low or high level over time or alternated every 10 min from low to high. Operator detection of automation failures was substantially worse for constant-reliability than for variable-reliability automation after about 20 min under automation control, indicating that the former condition induced 'complacency'. When system monitoring was the only task, detection was very efficient and was unaffected by variations in automation reliability. The results provide the first empirical evidence of the performance consequences of automation-induced 'complacency'. We relate findings to operator attitudes toward automation and discuss implications for cockpit automation design.

Parasuraman, Raja↗

A Systematic Approach for Real-Time Operator Functional State Assessment

A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.

Zhang, Guangfan↗

An Autonomous System for Experimental Evolution of Microbial Cultures: Test Results Using Ultraviolet-C Radiation and Escherichia Coli.

At its core, the field of microbial experimental evolution seeks to elucidate the natural laws governing the history of microbial life by understanding its underlying driving mechanisms. However, observing evolution in nature is complex, as environmental conditions are difficult to control. Laboratory-based experiments for observing population evolution provide more control, but manually culturing and studying multiple generations of microorganisms can be time consuming, labor intensive, and prone to inconsistency. We have constructed a prototype, closed system device that automates the process of directed evolution experiments in microorganisms. It is compatible with any liquid microbial culture, including polycultures and field samples, provides flow control and adjustable agitation, continuously monitors optical density (OD), and can dynamically control environmental pressures such as ultraviolet-C (UV-C) radiation and temperature. Here, the results of the prototype are compared to iterative exposure and survival assays conducted using a traditional hood, UV-C lamp, and shutter system.

Microbial Cultures↗

Experiences with Text Mining Large Collections of Unstructured Systems Development Artifacts at JPL

Often repositories of systems engineering artifacts at NASA's Jet Propulsion Laboratory (JPL) are so large and poorly structured that they have outgrown our capability to effectively manually process their contents to extract useful information. Sophisticated text mining methods and tools seem a quick, low-effort approach to automating our limited manual efforts. Our experiences of exploring such methods mainly in three areas including historical risk analysis, defect identification based on requirements analysis, and over-time analysis of system anomalies at JPL, have shown that obtaining useful results requires substantial unanticipated efforts - from preprocessing the data to transforming the output for practical applications. We have not observed any quick 'wins' or realized benefit from short-term effort avoidance through automation in this area. Surprisingly we have realized a number of unexpected long-term benefits from the process of applying text mining to our repositories. This paper elaborates some of these benefits and our important lessons learned from the process of preparing and applying text mining to large unstructured system artifacts at JPL aiming to benefit future TM applications in similar problem domains and also in hope for being extended to broader areas of applications.

text mining↗

Operator versus computer control of adaptive automation

Adaptive automation refers to real-time allocation of functions between the human operator and automated subsystems. The article reports the results of a series of experiments whose aim is to examine the effects of adaptive automation on operator performance during multi-task flight simulation, and to provide an empirical basis for evaluations of different forms of adaptive logic. The combined results of these studies suggest several things. First, it appears that either excessively long, or excessively short, adaptation cycles can limit the effectiveness of adaptive automation in enhancing operator performance of both primary flight and monitoring tasks. Second, occasional brief reversions to manual control can counter some of the monitoring inefficiency typically associated with long cycle automation, and further, that benefits of such reversions can be sustained for some time after return to automated control. Third, no evidence was found that the benefits of such reversions depend on the adaptive logic by which long-cycle adaptive switches are triggered.

Hilburn, Brian↗

Microbial Vessel for Impedance Spectroscopy and Electrochemistry (Mvise): an Extensible, Interoperable Data Acquisition Platform for Liquid Culture Studies in Space Biology Research

The White House Office of Science and Technology Policy (OSTP) has declared 2023 to be the Year of Open Science following an initiative to democratize scientific knowledge. Simultaneously, new sensor technologies have broadened the experimental space available to bioastronautics research. With these open-science goals and technological advances in mind, we have designed and constructed a data acquisition platform for high-precision, real-time monitoring of liquid culture systems. The vessel rig is fitted with six Atlas Scientific probes (micro pH, electrical conductivity, dissolved oxygen, oxidation-reduction potential, liquid temperature, air CO2) and a custom optical density probe similar to the one on BioSentinel’s BioSensor payload. A custom dielectric spectroscopy probe is also planned. The structure of the vessel is resin 3-D printed on a hobbyist-level machine, reducing the production cost and iteration time by over 60% each while increasing extensibility. Data acquisition and storage is controlled with a standalone C state machine-based program running on a Raspberry Pi 3 Model B. When not running headless, an additional program automatically generates and updates plots for live data visualization. Validation of the rig as a data collection system was performed with a yeast liquid culture experiment. While the vessel rig is currently used for standalone experiments, it can also be used as the base perception unit in a self-driving laboratory (SDL). SDLs are high-throughput data collection systems that employ automation and artificial intelligence to conduct and manage routine experiments. Here, we envision an SDL driven by several vessel rigs in which an automated script compares key results, informing the design of future experiments. A vessel rig SDL would streamline many operations, including 1) strain selection for the Lunar Explorer Instrument for space biology Applications (LEIA) investigation and 2) the study of bioregenerative life support systems (BLSS). Ultimately, the datasets that can now be acquired will provide crucial information for accelerating bioastronautics application development in the era of commercial space.

Stephen Lantin↗

Automated Space Processing Payloads Study. Volume 1: Executive Summary

An investigation is described which examined the extent to which the experiment hardware and operational requirements can be met by automatic control and material handling devices; payload and system concepts are defined which make extensive use of automation technology. Topics covered include experiment requirements and hardware data, capabilities and characteristics of industrial automation equipment and controls, payload grouping, automated payload conceptual design, space processing payload preliminary design, automated space processing payloads for early shuttle missions, and cost and scheduling.

Source record↗

Payload crew training scheduler (PACTS) user's manual

The operation of the payload specialist training scheduler (PACTS) is discussed in this user's manual which is used to schedule payload specialists for mission training on the Spacelab experiments. The PACTS program is a fully automated interactive, computerized scheduling program equipped with tutorial displays. The tutorial displays are sufficiently detailed for use by a program analyst having no computer experience. The PACTS program is designed to operate on the UNIVAC 1108 computer system, and has the capability to load output into a PDP 11/45 Interactive Graphics Display System for printing schedules. The program has the capacity to handle up to three overlapping Spacelab missions.

Shipman, D. L.↗

Enhancing and Archiving the APS Catalog of the POSS I

We have worked on two different projects: 1) Archiving the APS Catalog of the POSS I for distribution to NASA's NED at IPAC, SIMBAD in France, and individual astronomers and 2) The automated morphological classification of galaxies. We have completed archiving the Catalog into easily readable binary files. The database together with the software to read it has been distributed on DVD's to the national and international data centers and to individual astronomers. The archived Catalog contains more than 89 million objects in 632 fields in the first epoch Palomar Observatory Sky Survey. Additional image parameters not available in the original on-line version are also included in the archived version. The archived Catalog is also available and can be queried at the APS web site (URL: http://aps.umn.edu) which has been improved with a much faster and more efficient querying system. The Catalog can be downloaded as binary datafiles with the source code for reading it. It is also being integrated into the SkyQuery system which includes the Sloan Digital Sky Survey, 2MASS, and the FIRST radio sky survey. We experimented with different classification algorithms to automate the morphological classification of galaxies. This is an especially difficult problem because there are not only a large number of attributes or parameters and measurement uncertainties, but also the added complication of human disagreement about the adopted types. To solve this problem we used 837 galaxy images from nine POSS I fields at the North Galactic Pole classified by two independent astronomers for which they agree on the morphological types. The initial goal was to separate the galaxies into the three broad classes relevant to issues of large scale structure and galaxy formation and evolution: early (ellipticals and lenticulars), spirals, and late (irregulars) with an accuracy or success rate that rivals the best astronomer classifiers. We also needed to identify a set of parameters derived from the digitized images that separate the galaxies by type. The human eye can easily recognize complicated patterns in images such as spiral arms which can be spotty, blotchy affairs that are difficult for automated techniques. A galaxy image can potentially be described by hundreds of parameters, all of which may have some relation to the morphological type. In the set of initial experiments we used 624 such parameters, in two colors, blue and red. These parameters include the surface brightness and color measured at different radii, ratios of these parameters at different radii, concentration indices, Fourier transforms and wavelet decomposition coefficients. We experimented with three different classes of classification algorithms; decision trees, k-nearest neighbors, and support vector machines (SVM). A range of experiments were conducted and we eventually narrowed the parameters to 23 selected parameters. SVM consistently outperformed the other algorithms with both sets of features. By combining the results from the different algorithms in a weighted scheme we achieved an overall classification success of 86%.

Humphreys, Roberta M.↗

Proceedings of the 20th International Symposium on Space Flight Dynamics

Topics include: Measuring Image Navigation and Registration Performance at the 3-Sigma Level Using Platinum Quality Landmarks; Flight Dynamics Performances of the MetOp A Satellite during the First Months of Operations; Visual Navigation - SARE Mission; Determining a Method of Enabling and Disabling the Integral Torque in the SDO Science and Inertial Mode Controllers; Guaranteeing Pointing Performance of the SDO Sun-Pointing Controllers in Light of Nonlinear Effects; SDO Delta H Mode Design and Analysis; Observing Mode Attitude Controller for the Lunar Reconnaissance Orbiter; Broken-Plane Maneuver Applications for Earth to Mars Trajectories; ExoMars Mission Analysis and Design - Launch, Cruise and Arrival Analyses; Mars Reconnaissance Orbiter Aerobraking Daily Operations and Collision Avoidance; Mars Reconnaissance Orbiter Interplanetary Cruise Navigation; Motion Parameters Determination of the SC and Phobos in the Project Phobos-Grunt; GRAS NRT Precise Orbit Determination: Operational Experience; Orbit Determination of LEO Satellites for a Single Pass through a Radar: Comparison of Methods; Orbit Determination System for Low Earth Orbit Satellites; Precise Orbit Determination for ALOS; Anti-Collision Function Design and Performances of the CNES Formation Flying Experiment on the PRISMA Mission; CNES Approaching Guidance Experiment within FFIORD; Maneuver Recovery Analysis for the Magnetospheric Multiscale Mission; SIMBOL-X: A Formation Flying Mission on HEO for Exploring the Universe; Spaceborne Autonomous and Ground Based Relative Orbit Control for the TerraSAR-X/TanDEM-X Formation; First In-Orbit Experience of TerraSAR-X Flight Dynamics Operations; Automated Target Planning for FUSE Using the SOVA Algorithm; Space Technology 5 Post-Launch Ground Attitude Estimation Experience; Standardizing Navigation Data: A Status Update; and A Study into the Method of Precise Orbit Determination of a HEO Orbiter by GPS and Accelerometer.

Woodard, Mark↗

Cloud identification using genetic algorithms and massively parallel computation

As a Guest Computational Investigator under the NASA administered component of the High Performance Computing and Communication Program, we implemented a massively parallel genetic algorithm on the MasPar SIMD computer. Experiments were conducted using Earth Science data in the domains of meteorology and oceanography. Results obtained in these domains are competitive with, and in most cases better than, similar problems solved using other methods. In the meteorological domain, we chose to identify clouds using AVHRR spectral data. Four cloud speciations were used although most researchers settle for three. Results were remarkedly consistent across all tests (91% accuracy). Refinements of this method may lead to more timely and complete information for Global Circulation Models (GCMS) that are prevalent in weather forecasting and global environment studies. In the oceanographic domain, we chose to identify ocean currents from a spectrometer having similar characteristics to AVHRR. Here the results were mixed (60% to 80% accuracy). Given that one is willing to run the experiment several times (say 10), then it is acceptable to claim the higher accuracy rating. This problem has never been successfully automated. Therefore, these results are encouraging even though less impressive than the cloud experiment. Successful conclusion of an automated ocean current detection system would impact coastal fishing, naval tactics, and the study of micro-climates. Finally we contributed to the basic knowledge of GA (genetic algorithm) behavior in parallel environments. We developed better knowledge of the use of subpopulations in the context of shared breeding pools and the migration of individuals. Rigorous experiments were conducted based on quantifiable performance criteria. While much of the work confirmed current wisdom, for the first time we were able to submit conclusive evidence. The software developed under this grant was placed in the public domain. An extensive user's manual was written and distributed nationwide to scientists whose work might benefit from its availability. Several papers, including two journal articles, were produced.

Buckles, Bill P.↗

Automated space processing payloads study. Volume 2, book 1: Technical report

The extent was investigated to which experiment hardware and operational requirements can be met by automatic control and material handling devices; payload and system concepts that make extensive use of automation technology are defined. Hardware requirements for each experiment were established and tabulated, and investigations of applicable existing hardware were documented. The capabilities and characteristics of industrial automation equipment, controls, and techniques are presented in the form of a summary of applicable equipment characteristics in three basic mutually-supporting formats. Facilities for performing groups of experiments are defined along with four levitation groups and three furnace groups; major hardware elements required to implement them were identified. A conceptual design definition of ten different automated processing facilities is presented along with the specific equipment to implement each facility and the design layouts of the different units. Constraints and packaging, weight, and power requirements for six payloads postulated for shuttle missions in the 1979 to 1982 time period were examined.

Source record↗

SATS HVO Concept Validation Experiment

A human-in-the-loop simulation experiment was conducted at the NASA Langley Research Center s (LaRC) Air Traffic Operations Lab (ATOL) in an effort to comprehensively validate tools and procedures intended to enable the Small Aircraft Transportation System, Higher Volume Operations (SATS HVO) concept of operations. The SATS HVO procedures were developed to increase the rate of operations at non-towered, non-radar airports in near all-weather conditions. A key element of the design is the establishment of a volume of airspace around designated airports where pilots accept responsibility for self-separation. Flights operating at these airports, are given approach sequencing information computed by a ground based automated system. The SATS HVO validation experiment was conducted in the ATOL during the spring of 2004 in order to determine if a pilot can safely and proficiently fly an airplane while performing SATS HVO procedures. Comparative measures of flight path error, perceived workload and situation awareness were obtained for two types of scenarios. Baseline scenarios were representative of today s system utilizing procedure separation, where air traffic control grants one approach or departure clearance at a time. SATS HVO scenarios represented approaches and departure procedures as described in the SATS HVO concept of operations. Results from the experiment indicate that low time pilots were able to fly SATS HVO procedures and maintain self-separation as safely and proficiently as flying today's procedures.

Consiglio, Maria↗

Advanced automated glass cockpit certification: Being wary of human factors

This paper presents some facets of the French experience with human factors in the process of certification of advanced automated cockpits. Three types of difficulties are described: first, the difficulties concerning the hotly debated concept of human error and its non-linear relationship to risk of accident; a typology of errors to be taken into account in the certification process is put forward to respond to this issue. Next, the difficulties connected to the basically gradual and evolving nature of pilot expertise on a given type of aircraft, which contrasts with the immediate and definitive style of certifying systems. The last difficulties to be considered are those related to the goals of certification itself on these new aircraft and the status of findings from human factor analyses (in particular, what should be done with disappointing results, how much can the changes induced by human factors investigation economically affect aircraft design, how many errors do we need to accumulate before we revise the system, what should be remedied when human factor problems are discovered at the certification stage: the machine? pilot training? the rules? or everything?). The growth of advanced-automated glass cockpits has forced the international aeronautical community to pay more attention to human factors during the design phase, the certification phase and pilot training. The recent creation of a human factor desk at the DGAC-SFACT (Official French services) is a direct consequence of this. The paper is divided into three parts. Part one debates human error and its relationship with system design and accident risk. Part two describes difficulties connected to the basically gradual and evolving nature of pilot expertise on a given type of aircraft, which contrasts with the immediate and definitive style of certifying systems. Part three focuses on concrete outcomes of human factors for certification purposes.

Amalberti, Rene↗

A Meta-Analytic Approach to Investigating the Relationship Between Human-Automation Trust and Attention Allocation

Trust and attention allocation are pivotal determinants in human-automation interaction. However, there are scarce empirical findings regarding the relationship between trust and attention allocation. Observations from our previous work suggested there may be a negative correlation between trust in automation and eye movement towards automation, though no formal analysis of these data had been conducted to quantify this relationship. The present meta-analysis examined the relationship between three dimensions of trust in automation (performance, process, and purpose) and visual attention allocation to the automation. Specifically, we applied Cumming’s (2014) meta-analysis technique to combine evidence across three experiments. Results indicated a negative correlation between trust in automation and visual sampling of the automated system monitoring task for performance-based trust, but not for process- or purpose-based trust. These findings suggest that operators scanned the automation’s behavior less frequently when indicating higher performance-based trust towards the automation.

Human-Autonomy Teaming (HAT)↗

Automated clustering-based workload characterization

The demands placed on the mass storage systems at various federal agencies and national laboratories are continuously increasing in intensity. This forces system managers to constantly monitor the system, evaluate the demand placed on it, and tune it appropriately using either heuristics based on experience or analytic models. Performance models require an accurate workload characterization. This can be a laborious and time consuming process. It became evident from our experience that a tool is necessary to automate the workload characterization process. This paper presents the design and discusses the implementation of a tool for workload characterization of mass storage systems. The main features of the tool discussed here are: (1)Automatic support for peak-period determination. Histograms of system activity are generated and presented to the user for peak-period determination; (2) Automatic clustering analysis. The data collected from the mass storage system logs is clustered using clustering algorithms and tightness measures to limit the number of generated clusters; (3) Reporting of varied file statistics. The tool computes several statistics on file sizes such as average, standard deviation, minimum, maximum, frequency, as well as average transfer time. These statistics are given on a per cluster basis; (4) Portability. The tool can easily be used to characterize the workload in mass storage systems of different vendors. The user needs to specify through a simple log description language how the a specific log should be interpreted. The rest of this paper is organized as follows. Section two presents basic concepts in workload characterization as they apply to mass storage systems. Section three describes clustering algorithms and tightness measures. The following section presents the architecture of the tool. Section five presents some results of workload characterization using the tool.Finally, section six presents some concluding remarks.

Pentakalos, Odysseas I.↗

Comparison of ozone measurement techniques using aircraft, balloon, and ground-based measurements

In order to verify the ultraviolet absorption technique used in the Global Atmospheric Sampling Program, two flight experiments were conducted employing several techniques, both in situ and remote, for measuring atmospheric ozone. The first experiment used the NASA CV-990 equipped with an ultraviolet absorption ozone monitor and an ultraviolet spectrophotometer, a balloon ozonesonde, and a Dobson station for determining and comparing the ozone concentration data. A second experiment compared ozone data from an automated sampling system aboard a B-747 with data from a manned system installed on the NASA CV-990 during a cross-country flight with both aircraft following the same flight path separated by 32 kilometers.

Briehl, D.↗

The space exploration initiative. Operational efficiency panel space-basing technology requirements

The topics covered include the following: (1) space basing technology requirements sources; (2) orbit transfer vehicle (OTV) processing heritage; (3) ground processing progression to space processing; (4) technology requirements for space based OTV servicing and maintenance; (5) design and development schedule for OTV's and OTV accommodations/ support hardware; (6) cryogenic technology test program development; (7) cryogenic propellant transfer, storage, and reliquefaction management summary; (8) propellant transfer technology analysis and ground testing; (8) OTV propellant storage depot development critical scaling relationships; (9) flight experiment options; (10) OTV maintenance; (11) automated fault detection/ isolation and system checkout summary; (12) engine replacement; (13) alternative docking operation; (14) OTV/payload integration; and (15) technology criticality and capability assessment. This document is presented in viewgraph form.

Pena, Luis R.↗