Human performance prediction in man-machine systems. Part 2 - The test catalog
Human performance prediction in man machine systems - test catalog tables
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Human performance prediction in man machine systems - test catalog tables
NASA’s plans to return to the moon in the Artemis campaign include intentions for sustainable surface operations. In-Situ Resource Utilization (ISRU) is key to enabling sustainability. The use of water, which has been identified in the lunar polar regions [1-4], could be pivotal to a sustainable architecture. While water has been identified, there is limited information regarding its form and distribution. The Lunar Water ISRU Measurement Study (LWIMS) [5] outlined the current state of knowledge regarding water resources on the moon, what information is lacking, and how to approach a measurement campaign to close those knowledge gaps. However the NASA timeline necessitates that lunar surface water prospecting, or reconnaissance, efforts and ISRU system design to occur in parallel. ISRU hardware and systems development must proceed without key resource knowledge. Yet, engineering design requires come constraints and targets to work to. The goal of this study was to define a set of lunar water reference cases, based on the cur-rent lunar water information, to help focus ISRU de-sign and planning. This approach is similar to an study focused on Mars resources called Mars Water ISRU Planning (MWIP) [6].
It is well known that electronics placement in large-scale human-rated systems provides opportunity to optimize electronics shielding through materials choice and geometric arrangement. For example, several hundred single event upsets (SEUs) occur within the Shuttle avionic computers during a typical mission. An order of magnitude larger SEU rate would occur without careful placement in the Shuttle design. These results used basic physics models (linear energy transfer (LET), track structure, Auger recombination) combined with limited SEU cross section measurements allowing accurate evaluation of target fragment contributions to Shuttle avionics memory upsets. Electronics shielding design on human-rated systems provides opportunity to minimize radiation impact on critical and non-critical electronic systems. Implementation of shielding design tools requires adequate methods for evaluation of design layouts, guiding qualification testing, and an adequate follow-up on final design evaluation including results from a systems/device testing program tailored to meet design requirements.
The cell separation techniques of velocity sedimentation, flow cytometry and continuous flow electrophoresis were used to obtain enriched populations of growth hormone (GH) cells. The goal was to isolate a GH cell subpopulation which releases GH molecules which are very high in biological activity, it was important to use a method which was effective in processing large numbers of cells over a short time span. The techniques based on sedimentation are limited by cell density overlaps and streaming. While flow cytometry is useful in the analytical mode for objectively establishing cell purity, the numbers of cells which can be processed in the sort mode are so small as to make this approach ineffective in terms of the long term goals. It was shown that continuous flow electrophoresis systems (CFES) can separate GH cells from other cell types on the basis of differences in surface charge. The bioreactive producers appear to be more electrophoretically mobile than the low producers. Current ground based CFES efforts are hampered by cell clumping in low ionic strength buffers and poor cell recoveries from the CFES device.
The Office of Chief Technologist, NASA identified the need for research and technology development in part from NASAs Strategic Goal 3.3 of the NASA Strategic Plan to develop and demonstrate the critical technologies that will make NASAs exploration, science, and discovery missions more affordable and more capable. Furthermore, the Game Changing Development Program is a primary avenue to achieve the Agencys 2011 strategic goal to Create the innovative new space technologies for our exploration, science, and economic future. The National Research Council (NRC) Space Technology Roadmaps and Priorities report highlights six challenges and they are: Mass to Surface, Surface Access, Precision Landing, Surface Hazard Detection and Avoidance, Safety and Mission Assurance, and Affordability. In order for NASA to meet these challenges, the report recommends immediate focus on Rigid and Flexible Thermal Protection Systems. Rigid TPS systems such as Avcoat or SLA are honeycomb based and PICA is in the form of tiles. The honeycomb systems are manufactured using techniques that require filling of each (38 cell) by hand, and in a limited amount of time all of the cells must be filled and the heatshield must be cured. The tile systems such as PICA pose a different challenge as the low strain-to-failure and manufacturing size limitations require large number of small tiles with gap-fillers between the tiles. Recent investments in flexible ablative systems have given rise to the potential for conformal ablative TPS. A conformal TPS over a rigid aeroshell has the potential to solve a number of challenges faced by traditional rigid TPS materials. The high strain-to-failure nature of the conformal ablative materials will allow integration of the TPS with the underlying aeroshell structure much easier and enable monolithic-like configuration and larger segments (or parts) to be used. By reducing the overall part count, the cost of installation (based on cost comparisons between blanket and tile materials on shuttle) should be significantly reduced. The conformal ablator design will include a simplified design of seams between gore panels, which should eliminate the need for gap filler design, and should accommodate a wider range of allowable carrier structure imperfections when compared to a rigid material such as PICA.The Conformal TPS development project leverages the past investments made by earlier projects with a goal to develop and deliver a TRL 5 conformal TPS capable of 250 Wcm2 for missions such as MSL or COTS missions. The capabilities goal for the conformal TPS is similar to an MSL design reference mission (250 Wcm2) with matching pressures and shear environments. Both conformal and flexible carbon-felt based materials were successfully tested in stagnation aerothermal environments above 500 Wcm2 under earlier programs. Results on a myriad of materials developed during FY11 were used to determine which materials to start with in FY12. In FY12, the conformal TPS element focused on establishing materials requirements based on MSL-type and COTS Low Earth orbit (LEO) conditions (q 250 Wcm2) to develop and deliver a Conformal Ablative TPS. In FY13, development and refining metrics for mission utilization of conformal ablator technology along with assessment for potential mission stakeholders will be carried out.
Human/process error is potentially a large contributor to failures of aerospace systems. For some systems, such as the space shuttle main engine, large amounts of data are available, and accurate failure rates can be determined empirically. For such systems, the human error is implicit in the empirical failure rate and does not need to be quantified separately. However, for other systems, such as the solid rocket boosters, large amounts of data are not available and the failure rates must be determined by more theoretical means. When empirical data is lacking, structural models and engineering judgment must be employed. In this case, the human/process error must be modeled explicitly. An extensive literature review was performed to determine what methods already exist for modeling human error for aerospace systems. No methods that apply directly were found, although there are a number of methods that have been developed specifically for the nuclear power industry that could probably be modified for space applications. The results of the literature review are presented, as well as recommendations for future research.
Historically, the product development life cycle (spanning from origination of a systems concept to initial delivery or fielding) for large-scale aerospace systems is 10-25 years. Examples of recent programs exhibiting this timeline are the Space Shuttle (13 years), , International Space Station (18 years), NASA Hubble telescope (16 years), USAF F-35 Strike Fighter (22 years), Missile Defense Agency THAAD (21 years), USAF V-22 Osprey (26 years), USAF B-2 Spirt (19 years), US Army RAH-66 Comanche (22 years, cancelled prior to fielding), James Webb Space Telescope (25 years), Space Launch System (10 years). This list illustrates the challenges of developing and fielding a modern integrated multi-disciplinary aerospace system. These development timelines are often preceded by significant research and development programs and followed by multiple increments, blocks, or spirals to reach planned operational capability. In the modern era of aerospace system acquisition, there is significant pressure to reduce system development timelines to meet system objectives and enable competitiveness in the current industry and landscape. Across the aerospace industry, a range of rapid acquisition and prototyping programs are seeking to achieve system development within timelines considerably less than 10 years. Notably, in September of 2019, NASA issued a solicitation for the development and demonstration of a Human Landing System (HLS) to deliver humans to the lunar surface by 2024 (5 years) and for the development and demonstration of a more sustainable HLS by 2026 (7 years). Lengthy product development cycle timelines are a product of multiple factors ranging from programmatic, sociological, technical, and systems engineering issues. New approaches in systems engineering provide new ways to enable these compressed development timelines. These approaches employ expanded application of advanced systems engineering methods and cross-cutting digital tools to accelerate system development, utilizing digital prototyping to connect maturing sub-system or component technologies into system or system-of-systems hardware prototypes. Approaches such as the use of system integrating physics relationships to reduce the number of design analysis cycle iterations and state analysis modeling to reduce necessary software testing (and improving coverage of system execution scenarios) represent steps forward in reducing the engineering time needed to field new systems. In addition to cost, schedule and performance benefits, expanded digital exploration and demonstration reduce risk in live system test and demonstration. This incremental demonstration approach, where digital prototyping and demonstration leads and informs full system test and demonstration, could be more important for space applications because of the increased difficulty of test and demonstration of space systems and architectures. The Advanced Concepts Office (ACO) at Marshall Space Flight Center merges traditional multi-disciplinary concept definition methods with modern, cross-cutting systems engineering concepts to enable iterative design and analysis of space architectures and systems through coordinated, strategic management of human capital, technical processes, and technology. This paper provides an overview of that approach, including recent examples and a strategic path forward to enabling continued reduction of aerospace system product development life cycles.
Human vestibular system and its connection with oculomotor system and their relation to motion perception, spatial disorientation, and illusions
Human-robot systems are expected to have a central role in future space exploration missions that extend beyond low-earth orbit [1]. As part of a directed research project funded by NASA s Human Research Program (HRP), researchers at the Johnson Space Center have started to use a variety of techniques, including literature reviews, case studies, knowledge capture, field studies, and experiments to understand critical human-robot interaction (HRI) variables for current and future systems. Activities accomplished to date include observations of the International Space Station s Special Purpose Dexterous Manipulator (SPDM), Robonaut, and Space Exploration Vehicle (SEV), as well as interviews with robotics trainers, robot operators, and developers of gesture interfaces. A survey of methods and metrics used in HRI was completed to identify those most applicable to space robotics. These methods and metrics included techniques and tools associated with task performance, the quantification of human-robot interactions and communication, usability, human workload, and situation awareness. The need for more research in areas such as natural interfaces, compensations for loss of signal and poor video quality, psycho-physiological feedback, and common HRI testbeds were identified. The initial findings from these activities and planned future research are discussed. Human-robot systems are expected to have a central role in future space exploration missions that extend beyond low-earth orbit [1]. As part of a directed research project funded by NASA s Human Research Program (HRP), researchers at the Johnson Space Center have started to use a variety of techniques, including literature reviews, case studies, knowledge capture, field studies, and experiments to understand critical human-robot interaction (HRI) variables for current and future systems. Activities accomplished to date include observations of the International Space Station s Special Purpose Dexterous Manipulator (SPDM), Robonaut, and Space Exploration Vehicle (SEV), as well as interviews with robotics trainers, robot operators, and developers of gesture interfaces. A survey of methods and metrics used in HRI was completed to identify those most applicable to space robotics. These methods and metrics included techniques and tools associated with task performance, the quantification of human-robot interactions and communication, usability, human workload, and situation awareness. The need for more research in areas such as natural interfaces, compensations for loss of signal and poor video quality, psycho-physiological feedback, and common HRI testbeds were identified. The initial findings from these activities and planned future research are discussed.
This paper has examined the requirements of HF specification and certification within advanced or complex aircrew systems. It suggests reasons for current inadequacies in the use of HF in the design process, giving some examples in support, and suggesting an avenue towards the improvement of the HF certification process. The importance of human cognition to the operation and performance of advanced aircrew systems has been stressed. Many of the shortfalls of advanced aircrew systems must be attributed to over automated designs that show little consideration on either the mental limits or the cognitive capabilities of the human system component. Traditional approaches to system design and HF certification are set within an over physicalistic foundation. Also, traditionally it was assumed that physicalistic system functions could be attributed to either the human or the machine on a one to one basis. Moreover, any problems associated with the parallel needs, or promoting human understanding alongside system operation and direction, were generally equated in reality by the natural flexibility and adaptability of human skills. The consideration of the human component of a complex system is seen as being primarily based on manifestations of human behavior to the almost total exclusion of any appreciation of unobservable human mental and cognitive processes. The argument of this paper is that the considered functionality of any complex human-machine system must contain functions that are purely human and purely cognitive. Human-machine system reliability ultimately depends on human reliability and dependability and, therefore, on the form and frequency of cognitive processes that have to be conducted to support system performance. The greater the demand placed by an advanced aircraft system on the human component's basic knowledge processes or cognition, rather than on skill, the more insiduous the effects the human may have on that system. This paper discusses one example of an attempt to devise an improved method of specificaiton and certification with relation to the advanced aircrew system, that of the RN Merlin helicopter. The method is realized to have limitations in practice, these mainly associated with the late production of the system specification in relation to the system development process. The need for a careful appreciation of the capabilities and support needs of human cognition within the design process of a complex man machine system has been argued, especially with relation to the concept of system functionality. Unlike the physicalistic Fitts list, a new classification of system functionality is proposed, namely: (1) equipment - system equipment related; (2) cognitive - human cognition related; and (3) associated - necessary combinatin of equipment and cognitive. This paper has not proposed a method for a fuller consideration of cognition within systems design, but has suggested the need for such a method and indicated an avenue towards its development. Finally, the HF certification of advanced aircrew systems is seen as only being possible in a qualified sense until the important functions of human cognition are considered within the system design process. (This paper contains the opinions of its authors and does not necessarily refledt the standpoint of their respective organizations).
Two procedures for the evaluation of the performance of expert systems are illustrated: one procedure evaluates predictive accuracy; the other procedure is complementary in that it uncovers the factors that contribute to predictive accuracy. Using these procedures, it is argued that expert systems should be more accurate than human experts in two senses. One sense is that expert systems must be more accurate to be cost-effective. Previous research is reviewed and original results are presented which show that simple statistical models typically perform better than human experts for the task of combining evidence from a given set of information sources. The results also suggest the second sense in which expert systems should be more accurate than human experts. They reveal that expert systems should share factors that contribute to human accuracy, but not factors that detract from human accuracy. Thus the thesis is that one should both require and expect systems to be more accurate than humans.
As described at IPPW-10, in FY12, the CA-TPS element focused on establishing materials requirements based on MSL-type and COTS Low Earth orbit (LEO) conditions (q 250 Wcm2) to develop and deliver a conformal ablative TPS. This involved down selecting, manufacturing and testing two of the best candidate materials, demonstrating uniform infiltration of resins into baseline 2-cm thick carbon felt, selecting a primary conformal material formulation based on novel arc jet and basic material properties testing, developing and demonstrating instrumentation for felt-based materials and, based on the data, developing a low fidelity material response model so that the conformal ablator TPS thickness for missions could be established. In addition, the project began to develop Industry Partnerships. Since the nominal thickness of baseline carbon felts was only 2-cm, a partnership with a rayon felt developer was made in order to upgrade equipment, establish the processes required and attempt to manufacture 10-cm thick white goods. A partnership with a processing house was made to develop the methodology to carbonize large pieces of the white goods into 7.5-cm thick carbon felt. In FY13, more advanced testing and modeling of the down selected conformal material was performed. Material thermal properties tests and structural properties tests were performed. The first 3 and 4-point bend tests were performed on the conformal ablator as well as PICA for comparison and the conformal ablator had outstanding behavior compared to PICA. Arc jet testing was performed with instrumented samples of both the conformal ablator and standard PICA at heating rates ranging from 40 to 400 Wcm2 and shear as high as 600 Pa. The results from these tests showed a remarkable improvement in the thermal penetration through the conformal ablator when compared to PICAs response. The data from these tests were used to develop a mid-fidelity thermal response model. Additional arc jet testing in the same conditions on various seam designs were very successful in showing that the material could be joined with a minimum of adhesive and required no complicated gap and gap filler design for installation. In addition, the partnership with industry to manufacture thicker rayon felt was very successful. The vendor made a 2-m wide by 30-m long sample of 10-cm thick rayon felt. When carbonized, the resulting thickness was over 7.5-cm thick, nearly 4 times the thickest off-the-shelf carbon felt. In FY14, the project has initiated a partnership with another vendor to begin the scale-up manufacturing effort. This year, the vendor will duplicate the process and manufacture at the current scale for comparison with NASA-processed materials. Properties testing and arc jet testing will be performed on the vendor-processed materials. Planning for manufacturing large, 1-m x 1-m, panels will begin as well. In FY15, the vendor will then manufacture large panels and the project will build a 2-m x 2-m Manufacturing Demonstration Unit (MDU).
This presentation will update the community on the development of conformal ablative TPS. As described at IPPW-10, in FY12, the CA-TPS element focused on establishing materials requirements based on MSL-type and COTS Low Earth orbit (LEO) conditions (q 250 Wcm2) to develop and deliver a conformal ablative TPS. This involved downselecting, manufacturing and testing two of the best candidate materials, demonstrating uniform infiltration of resins into baseline 2-cm thick carbon felt, selecting a primary conformal material formulation based on novel arc jet and basic material properties testing, developing and demonstrating instrumentation for felt-based materials and, based on the data, developing a low fidelity material response model so that the conformal ablator TPS thickness for missions could be established. In addition, the project began to develop Industry Partnerships. Since the nominal thickness of baseline carbon felts was only 2-cm, a partnership with a rayon felt developer was made in order to upgrade equipment, establish the processes required and attempt to manufacture 10-cm thick white goods. A partnership with a processing house was made to develop the methodology to carbonize large pieces of the white goods into 7.5-cm thick carbon felt.In FY13, more advanced testing and modeling of the downselected conformal material was performed. Material thermal properties tests and structural properties tests were performed. The first 3 and 4-point bend tests were performed on the conformal ablator as well as PICA for comparison and the conformal ablator had outstanding behavior compared to PICA. Arc jet testing was performed with instrumented samples of both the conformal ablator and standard PICA at heating rates ranging from 40 to 400 Wcm2 and shear as high as 600 Pa. The results from these tests showed a remarkable improvement in the thermal penetration through the conformal ablator when compared to PICAs response. The data from these tests were used to develop a mid-fidelity thermal response model. Additional arc jet testing in the same conditions on various seam designs were very successful in showing that the material could be joined with a minimum of adhesive and required no complicated gap and gap filler design for installation. In addition, the partnership with industry to manufacture thicker rayon felt was very successful. The vendor made a 2-m wide by 30-m long sample of 10-cm thick rayon felt. When carbonized, the resulting thickness was over 7.5-cm thick, nearly 4 times the thickest off-the-shelf carbon felt. In FY14, the project has initiated a partnership with another vendor to begin the scale-up manufacturing effort. This year, the vendor will duplicate the process and manufacture at the current scale for comparison with NASA-processed materials. Properties testing and arc jet testing will be performed on the vendor-processed materials. Planning for manufacturing large, 1-m x 1-m, panels will begin as well. In FY15, the vendor will then manufacture large panels and the project will build a 2-m x 2-m Manufacturing Demonstration Unit (MDU).
The recently released policy directive, "A Renewed Spirit of Discovery: The President's Vision for U. S. Space Exploration," seeks to advance the U. S. scientific, security and economic interest through a program of space exploration which will robotically explore the solar system and extend human presence to the Moon, Mars and beyond. NASA's implementation of this vision will be guided by compelling questions of scientific and societal importance, including the origin of our Solar System and the search for life beyond Earth. The Exploration Roadmap identifies four key targets: the Moon, Mars, the outer Solar System, and extra-solar planets. First, a lunar investigation will set up exploration test beds, search for resources, and study the geological record of the early Solar System. Human missions to the Moon will serve as precursors for human missions to Mars and other destinations, but will also be driven by their support for furthering science. The second key target is the search for past and present water and life on Mars. Following on from discoveries by Spirit and Opportunity, by the end of the decade there will have been an additional rover, a lander and two orbiters studying Mars. These will set the stage for a sample return mission in 2013, increasingly complex robotic investigations, and an eventual human landing. The third key target is the study of underground oceans, biological chemistry, and their potential for life in the outer Solar System. Beginning with the arrival of Cassini at Saturn in July 2004 and a landing on Titan in 2006, the next decade will see an extended investigation of the Jupiter icy moons by a mission making use of Project Prometheus, a program to develop space nuclear power and nuclear-electric propulsion. Finally, the search for Earth-like planets and life includes a series of telescopic missions designed to find and characterize extra-solar planets and search them for evidence of life. These missions include HST and Spitzer, operating now; Kepler, SIM, JWST, and TPF, currently under development; and the vision missions, Life Finder and Planet Imager, which will possibly be constructed in space by astronauts.
Computer-generated human models have been used in aerospace design for a decade. They have come to be highly reliable for worksite analysis of certain types of EVA tasks. In many design environments, this analysis comes after the structural design is largely complete. However, the use of these models as a development tool is gaining acceptance within organizations that practice good systems engineering processes. The design of the United States Propulsion Module for the International Space Station provides an example of this application. The Propulsion Module will provide augmentation to the propulsion capability supplied by the Russian Service Module Zvezda. It is a late addition to the set of modules provided by the United States to the ISS Program, and as a result, faces design challenges that result from the level of immaturity of its integration into the Station. Among these are heat dissipation and physical envelopes. Since the rest of the Station was designed to maximize the use of the cooling system, little margin is available for the addition of another module. The Propulsion Module will attach at the forward end of the Station, and will be between the Orbiter and the rest of ISS. Since cargo must be removed from the Payload Bay and transferred to Station by the Canadarm, there is a potential for protrusions from the module, such as thruster booms, to interfere with robotic operations. These and similar engineering issues must be addressed as part of the development. In the implementation of good system design, all design solutions should be analyzed for compatibility with all affected subsystems. Human modeling has been used in this project to provide rapid input to system trades of design concepts. For example, the placement of radiators and avionics components for optimization of heat dissipation had to be examined for feasibility of EVA translation paths and worksite development. Likewise, the location of and mechanism for the retraction of thruster booms was partly driven by available Orbiter, robotic arm, and other module envelopes; worksite analysis was required for early assessment of task success. Since these trade studies included the EVA analysis as part of the decision criteria, the design had a high degree of assurance of EVA supportability from the outset. This approach contributes greatly to mission success.
Explore the source record for details and available documents.
The second six months of this grant saw further development of GT-CATS, the Georgia Tech Crew Activity Tracking System, and progress on research exploring tutoring concepts for tutors for mode management. The latter included data analysis and a preliminary paper summarizing the development and evaluation of the VNAV Tutor. A follow-on to the VNAV Tutor is planned. Research in this direction will examine the use of OFMspert and GT-CATS to create an 'intelligent' tutor for mode management, a more extensive domain of application than only vertical navigation, and alternative pedagogy, such as substituting focused 'cases' of reported mode management situations rather than lessons defined by full LOFT scenarios.
A series of ongoing research programs at Georgia Tech established a need for a simulation support tool for aircraft computer-based aids. This led to the design and development of the Georgia Tech Electronic Flight Instrument Research Tool (GT-EFIRT). GT-EFIRT is a part-task flight simulator specifically designed to study aircraft display design and single pilot interaction. ne simulator, using commercially available graphics and Unix workstations, replicates to a high level of fidelity the Electronic Flight Instrument Systems (EFIS), Flight Management Computer (FMC) and Auto Flight Director System (AFDS) of the Boeing 757/767 aircraft. The simulator can be configured to present information using conventional looking B757n67 displays or next generation Primary Flight Displays (PFD) such as found on the Beech Starship and MD-11.