SEARCH · Engineering Papers

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2001

Using the Human Eye to Characterize Displays

Monitor characterization has taken on new importance for non-professional users, who are not usually equipped to make photometric measurements. We studied adjusting brightness to set the black level, banding effects due to digitization, and gamma estimation in the light and in the dark, and a color-matching task in the light, on a desktop CRT (Cathode-Ray Tube) and a laptop LCD (Liquid Crystal Display). Observers demonstrated the sensitivity of the visual system for comparative judgments in black-level adjustment, banding visibility, and gamma estimation. The results of the color-matching task were ambiguous. In the brightness adjustment task, the action of the adjustment was not as presumed; however, perceptual judgments were as expected under the actual conditions. When the gamma estimates of observers were compared to photometric measurements, problems with the definition of gamma were identified. Information about absolute light levels that would be important for characterizing a displays, given the shortcomings of gamma in measuring apparent contrast, are not measurable by eye alone. The LCD was not studied as extensively as the CRT because of viewing-angle problems, and its transfer function did not follow a power law, rendering gamma estimation meaningless.

Gille, Jennifer↗

NASA NTRS1994

Gravitational Acceleration as a Cue for Absolute Size and Distance

When an object's motion is influenced by gravity, such as the rise and fall of a thrown ball, the vertical component of acceleration is roughly constant at 9.8 m/sec2. In principle, an observer could use this information to estimate the absolute size and distance of the object (Saxberg, 1987a; Watson, Banks, von Hofsten, & Royden, 1992). In three experiments, we examined the ability to utilize the size and distance information provided by gravitational acceleration. Observers viewed computer simulations of an object rising and falling on a trajectory parallel to the gravitational vector. The simulated objects were three balls of different diameters presented across a wide range of simulated distances. Observers were asked to identify which ball was presented and the distance at which it was presented. The results of Experiment 1 showed that size and distance judgments were significantly better than chance, but not as accurate as expected if the information contained in the dynamics of free fall were used fully utilized. The results of Experiment 2 showed that acceleration information is used, but that observers can also make use of velocity information. Finally, the results of Experiment 3 showed that observers can use projected size information, but that their size and distance judgments are much more accurate when motion information is present as well. These results show that observers can use the information in the dynamics of free fall to estimate absolute size and distance, but their estimates are not as accurate as they could be if the information were used effectively.

Hecht, Heiko↗

NASA NTRS1994

Extracting Depth From Motion Parallax in Real-World and Synthetic Displays

In psychophysical studies on human sensitivity to visual motion parallax (MP), the use of computer displays is pervasive. However, a number of potential problems are associated with such displays: cue conflicts arise when observers accommodate to the screen surface, and observer head and body movements are often not reflected in the displays. We investigated observers' sensitivity to depth information in MP (slant, depth order, relative depth) using various real-world displays and their computer-generated analogs. Angle judgments of real-world stimuli were consistently superior to judgments that were based on computer-generated stimuli. Similar results were found for perceived depth order and relative depth. Perceptual competence of observers tends to be underestimated in research that is based on computer generated displays. Such findings cannot be generalized to more realistic viewing situations.

Hecht, Heiko↗

NASA NTRS1996

Translation and Rotation Trade Off in Human Visual Heading Estimation

We have previously shown that, during simulated curvilinear motion, humans can make reasonably accurate and precise heading judgments from optic flow without either oculomotor or static-depth cues about rotation. We now systematically investigate the effect of varying the parameters of self-motion. We visually simulated 400 ms of self-motion along curved paths (constant rotation and translation rates, fixed retinocentric heading) towards two planes of random dots at 10.3 m and 22.3 m at mid-trial. Retinocentric heading judgments of 4 observers (2 naive) were measured for 12 different combinations of translation (T between 4 and 16 m/s) and rotation (R either 8 or 16 deg/s). In the range tested, heading bias and uncertainty decrease quasilinearly with T/R, but the bias also appears to depend on R. If depth is held constant, the ratio T/R can account for much of the variation in the accuracy and precision of human visual heading estimation, although further experiments are needed to resolve whether absolute rotation rate, total flow rate, or some other factor can account for the observed -2 deg shift between the bias curves.

Stone, Leland S.↗

NASA NTRS2003

Human discrimination of visual direction of motion with and without smooth pursuit eye movements

It has long been known that ocular pursuit of a moving target has a major influence on its perceived speed (Aubert, 1886; Fleischl, 1882). However, little is known about the effect of smooth pursuit on the perception of target direction. Here we compare the precision of human visual-direction judgments under two oculomotor conditions (pursuit vs. fixation). We also examine the impact of stimulus duration (200 ms vs. ~800 ms) and absolute direction (cardinal vs. oblique). Our main finding is that direction discrimination thresholds in the fixation and pursuit conditions are indistinguishable. Furthermore, the two oculomotor conditions showed oblique effects of similar magnitudes. These data suggest that the neural direction signals supporting perception are the same with or without pursuit, despite remarkably different retinal stimulation. During fixation, the stimulus information is restricted to large, purely peripheral retinal motion, while during steady-state pursuit, the stimulus information consists of small, unreliable foveal retinal motion and a large efference-copy signal. A parsimonious explanation of our findings is that the signal limiting the precision of direction judgments is a neural estimate of target motion in head-centered (or world-centered) coordinates (i.e., a combined retinal and eye motion signal) as found in the medial superior temporal area (MST), and not simply an estimate of retinal motion as found in the middle temporal area (MT).

Saccades/physiology↗

NASA NTRS1998

Relative size perception at a distance is best at eye level

Relative size judgments were collected for two objects at 30.5 m and 23.8 from the observer in order to assess how performance depends on the relationship between the size of the objects and the eye level of the observer. In three experiments in an indoor hallway and in one experiment outdoors, accuracy was higher for objects in the neighborhood of eye level. We consider these results in the light of two hypotheses. One proposes that observers localize the horizon as a reference for judging relative size, and the other proposes that observers perceive the general neighborhood of the horizon and then employ a height-in-visual-field heuristic. The finding that relative size judgments are best around the horizon implies that information that is independent of distance perception is used in perceiving size.

NASA Center ARC↗

NASA NTRS2004

Path perception during rotation: influence of instructions, depth range, and dot density

How do observers perceive their direction of self-motion when traveling on a straight path while their eyes are rotating? Our previous findings suggest that information from retinal flow and extra-retinal information about eye movements are each sufficient to solve this problem for both perception and active control of self-motion [Vision Res. 40 (2000) 3873; Psych. Sci. 13 (2002) 485]. In this paper, using displays depicting translation with simulated eye rotation, we investigated how task variables such as instructions, depth range, and dot density influenced the visual system's reliance on retinal vs. extra-retinal information for path perception during rotation. We found that path errors were small when observers expected to travel on a straight path or with neutral instructions, but errors increased markedly when observers expected to travel on a curved path. Increasing depth range or dot density did not improve path judgments. We conclude that the expectation of the shape of an upcoming path can influence the interpretation of the ambiguous retinal flow. A large depth range and dense motion parallax are not essential for accurate path perception during rotation, but reference objects and a large field of view appear to improve path judgments.

Space Perception/physiology↗

NASA NTRS2005

Cognitive Performance in Operational Environments

Optimal cognition during complex and sustained operations is a critical component for success in current and future military operations. "Cognitive Performance, Judgment, and Decision-making" (CPJD) is a newly organized U.S. Army Medical Research and Materiel Command research program focused on sustaining operational effectiveness of Future Force Warriors by developing paradigms through which militarily-relevant, higher-order cognitive performance, judgment, and decision-making can be assessed and sustained in individuals, small teams, and leaders of network-centric fighting units. CPJD evaluates the impact of stressors intrinsic to military operational environments (e.g., sleep deprivation, workload, fatigue, temperature extremes, altitude, environmental/physiological disruption) on military performance, evaluates noninvasive automated methods for monitoring and predicting cognitive performance, and investigates pharmaceutical strategies (e.g., stimulant countermeasures, hypnotics) to mitigate performance decrements. This manuscript describes the CPJD program, discusses the metrics utilized to relate militarily applied research findings to academic research, and discusses how the simulated combat capabilities of a synthetic battle laboratory may facilitate future cognitive performance research.

Russo, Michael↗

NASA NTRS2006

Using Videos Derived from Simulations to Support the Analysis of Spatial Awareness in Synthetic Vision Displays

The evaluation of human-centered systems can be performed using a variety of different methodologies. This paper describes a human-centered systems evaluation methodology where participants watch 5-second non-interactive videos of a system in operation before supplying judgments and subjective measures based on the information conveyed in the videos. This methodology was used to evaluate the ability of different textures and fields of view to convey spatial awareness in synthetic vision systems (SVS) displays. It produced significant results for both judgment based and subjective measures. This method is compared to other methods commonly used to evaluate SVS displays based on cost, the amount of experimental time required, experimental flexibility, and the type of data provided.

Boton, Matthew L.↗

NASA NTRS2010

Application of a Modified Universal Design Survey for Evaluation of Ares 1 Ground Crew Worksites

Operability is a driving requirement for NASA's Ares 1 launch vehicle. Launch site ground operations include several operator tasks to prepare the vehicle for launch or to perform maintenance. Ensuring that components requiring operator interaction at the launch site are designed for optimal human use is a high priority for operability. To support design evaluation, the Ares 1 Upper Stage (US) element Human Factors Engineering (HFE) group developed a survey based on the Universal Design approach. Universal Design is a process to create products that can be used effectively by as many people as possible. Universal Design per se is not a priority for Ares 1 because launch vehicle processing is a specialized skill and not akin to a consumer product that should be used by all people of all abilities. However, applying principles of Universal Design will increase the probability of an error free and efficient design which is a priority for Ares 1. The Design Quality Evaluation Survey centers on the following seven principles: (1) Equitable use, (2) Flexibility in use, (3) Simple and intuitive use, (4) Perceptible information, (5) Tolerance for error, (6) Low physical effort, (7) Size and space for approach and use. Each principle is associated with multiple evaluation criteria which were rated with the degree to which the statement is true. All statements are phrased in the utmost positive, or the design goal so that the degree to which judgments tend toward "completely agree" directly reflects the degree to which the design is good. The Design Quality Evaluation Survey was employed for several US analyses. The tool was found to be most useful for comparative judgments as opposed to an assessment of a single design option. It provided a useful piece of additional data when assessing possible operator interfaces or worksites for operability

Blume, Jennifer L.↗

NASA NTRS2011

The First Flight Decision for New Human Spacecraft Vehicles - A General Approach

Determining when it is safe to fly a crew on a launch vehicle/spacecraft for the first time, especially when the test flight is a part of the overall system certification process, has long been a challenge for program decision makers. The decision on first flight is ultimately the judgment of the program and agency management in conjunction with the design and operations team. To aid in this decision process, a NASA team undertook the task to develop a generic framework for evaluating whether any given program or commercial provider has sufficiently complete and balanced plans in place to allow crewmembers to safely fly on human spaceflight systems for the first time. It was the team s goal to establish a generic framework that could easily be applied to any new system, although the system design and intended mission would require specific assessment. Historical data shows that there are multiple approaches that have been successful in first flight with crew. These approaches have always been tailored to the specific system design, mission objectives, and launch environment. Because specific approaches may vary significantly between different system designs and situations, prescriptive instructions or thorough checklists cannot be provided ahead of time. There are, however, certain general approaches that should be applied in thinking through the decision for first flight. This paper addresses some of the most important factors to consider when developing a new system or evaluating an existing system for whether or not it is safe to fly humans to/from space. In the simplest terms, it is time to fly crew for the first time when it is safe to do so and the benefit of the crewed flight is greater than the residual risk. This is rarely a straight-forward decision. The paper describes the need for experience, sound judgment, close involvement of the technical and management teams, and established decision processes. In addition, the underlying level of confidence the manager has in making the decision will also be discussed. By applying the outlined thought processes and approaches to a specific design, test program and mission objectives, a project team will be better able to focus the debate and discussion on critical areas for consideration and added scrutiny -- allowing decision makers to adequately address the first crewed flight decision.

Schaible, Dawn M.↗

NASA NTRS2012

Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study

Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.

Shih, Ann T.↗

NASA NTRS2018

Unmanned Aerial Systems (UAS) Integration into the National Airspace System (NAS)

NASA's Unmanned Aerial Systems (UAS) integration into the National Air Space (NAS) project has been working closely with the FAA and RTCA Special Committee 228 to identify and break down barriers to UAS integration. A focus of this work is on detect and avoid (DAA) technologies. A pilot has responsibility to see and avoid other aircraft and to remain "well clear," using their best judgment (Federal Aviation Regulations (FAR) Sec. 91.113). For UAS to perform this function, the see function is replaced by sensors to detect the other aircraft. Secondly, the pilot judgment of well clear has to be replaced by a mathematical expression. For Phase 1 of this effort, a well clear violation was defined if all three of these conditions are true: a) the horizontal clearance is less than 4000 ft., and b) the vertical clearance is less than 450 ft., and c) the time to loss of well clear is less than 35 seconds. This definition was developed with a great deal of community input and testing to ensure interoperability with Air Traffic Control (ATC) and pilots of manned aircraft. Appropriate guidance, alerting and displays were developed to allow UAS, with the appropriate sensors, to effectively maintain well clear. This work contributed to FAA Technical Standard Orders: TSO-C211, Detect and Avoid and TSO-C212, ATAR for Traffic Surveillance. Phase 2 of this work extends the operational environment to include the terminal area and lesser capable aircraft that might not have the payload capability to carry the RADAR defined in Phase 1. This session reports on work from Phase 1 and initial work in Phase 2.

UAS↗

NASA NTRS2018

Detect and Avoid: Efforts from NASA's UAS Integration into the NAS Project

Detect and Avoid (DAA)↗

NASA NTRS2019

Human Performance Contributions to Safety in Commercial Aviation

Every day in aviation, pilots, air traffic controllers, and other front-line personnel perform countless correct judgments and actions in a variety of operational environments. These judgments and actions are often the difference between an accident and a non-event. Ironically, data on these behaviors are rarely collected or analyzed. Data-driven decisions about safety management and design of safety-critical systems are limited by the available data, which influence how decision makers characterize problems and identify solutions. Large volumes of data are collected on the failures and errors that result in infrequent incidents and accidents, but in the absence of data on behaviors that result in routine successful outcomes, safety management and system design decisions are based on a small sample of nonrepresentative safety data. This assessment aimed to find and document “safety successes” made possible by human operators. With many Aeronautics Research Mission Directorate (ARMD) Programs and Projects focusing on increased automation and autonomy and decreased human involvement, failure to fully consider the human contributions to successful system performance in civil aviation represents a significant risk — a risk that has not been recognized to date. Without understanding how humans contribute to safety, any estimate of predicted safety of autonomous capabilities is incomplete and inherently suspect. Furthermore, understanding the ways in which humans contribute to safety can promote strategic interactions among safety technologies, functions, procedures and the people using them. Without this understanding, the full benefits of an integrated, optimized human/technology or autonomous system will not be realized. Historically, safety has been consistently defined in terms of the occurrence of accidents or recognized risks (i.e., in terms of things that go wrong). These adverse outcomes are explained by identifying their causes, and safety is restored by eliminating or mitigating these causes. An alternative to this approach is to focus on what goes right and identify how to replicate that process. Focusing on the rare cases of failures attributed to “human error” provides little information about why human performance routinely prevents adverse events. Hollnagel has proposed that things go right because people continuously adjust their work to match their operating conditions. These adjustments become increasingly important as systems continue to grow in complexity. Thus, the definition of safety should reflect not only “avoiding things that go wrong” but “ensuring that things go right.” The basis for safety management requires developing an understanding of everyday activities. However, few mechanisms to monitor everyday work exist in the aviation domain, which limits opportunities to learn how designs function in reality. This concept of safety thinking and safety management is reflected in the emerging field of resilience engineering. According to Hollnagel, a system is resilient if it can sustain required operations under expected and unexpected conditions by adjusting its functioning prior to, during, or following changes, disturbances, and opportunities. To explore “positive” behaviors that contribute to resilient performance in commercial aviation, the assessment team examined a range of existing sources of data about pilot and air traffic control (ATC) tower controller performance, including subjective interviews with domain experts and objective aircraft flight data records. These data were used to identify strategies that support resilient performance, methods for exploring and refining those strategies in existing data, and proposed methods for capturing and analyzing new data.

Null, Cynthia H.↗

NASA NTRS2019

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗

NASA NTRS2019

Medical Decision Making in the Physician Hierarchy: A Pilot Pedagogical Evaluation

Context: Recently, The American College of Graduate Medical Education (ACGME) has included the medical decision making as a core competency in several specialties. To date, the ability to demonstrate and measure a pedagogical evolution of medical judgment in a medical education program has been limited. Objective: In this study we hope to examine differences in medical decision making ability of different physicians across their various stages of post-graduate hierarchy. Method: Physcians spanning a wide spectrum of scientific disciplines were recruited for three catagories: administrative physicians(AP) representing physcians with the most experience but mostly practice administratively; resident physicians completing their postgraduate medical training (RP) and seasoned attending physicians with mastery level experience (MP). Participants completed four medical simulations focused on abdominal pain: cholecystitis (CH) and renal colic(RC) and chest pain; Cardiac ischemia (STEMI) and pneumothorax (PX). Simulation were ordered randomly so that there was no systematic bias due to learning or to fatigue. The Medical judgment metric (MJM) was used to evaluate medical decision-making. Results: There were no significant differences between the AP, RP, and MP groups in the gender, race, ethnicity, education, and baseline heart rate. There was a significant (p=0.002) interaction effect for simulation time and RP group, 6.2 minutes (+/-1.58); MP group, 8.7 minutes (+/-2.46); and AP group, 10.3 minutes (+/-2.78). The RC MJM scores were significantly (P=0.10) worse in the AP group 12.3 (+/-2.66) then the RP 14.7(+/-1.15) and MP17.7 (+/-1.15) groups. In every simulation, the AP group MJM scores were worse on average (no significantly) compared to the MP and RP groups. The AP group was significantly (P=0.040) less likely to stabilize the subject in the RC simulation than MP and RP groups. Conclusion: There remains significant variability in the medical education and skill retention influences medical decision making throughout a physician's career.

Rosasco, John↗

NASA NTRS2023

NASA Passive Thermal Control Engineering Guidebook

The NASA Passive Thermal Control Engineering Guidebook provides recommendations, including best practices and lessons learned, related to the passive thermal control engineering discipline. Topics include analysis (including documentation and review), thermal hardware (design/selection, vendors, and integration), testing, and flight operations. The passive thermal discipline includes thermal control and thermal protection systems. The passive thermal control discipline, which is addressed in this Guidebook, is broad and covers internal and external systems, component passive thermal analysis, vehicle on-orbit attitude timeline analysis, integrated thermal analysis, various thermal control apparatus (heaters and controls, coatings, blankets and insulations, isolators, geometric design for view factors, materials emissivity/absorptivity properties), passive cooling of avionics, purge, vent, and drain for vehicle cavities and compartments, thermal model development and correlation, thermal cycle and thermal-vacuum testing. Topics related to thermal protection systems (TPS) are not within the scope of this document. The Guidebook provides a consolidated reference for early career as well as experienced engineers embarking on a new task. Leveraging the experience of the group minimizes the learning curve that exists at the start of new projects, reduces the risk of repeating mistakes, and improves the organization’s ability to deliver high-quality products efficiently. The intent of this document is to provide guidance based on collective experience, and is not intended impose constraints on project work. Best practices can vary substantially and it is important to apply judgment wisely based on careful consideration of the specific design and requirements. Implementation of the methods described will vary from project to project and should be applied in conjunction with the judgment of the thermal engineers performing and reviewing the work. The recommendations in this document are not intended to replace program, project, branch, Center, or NASA requirements and/or policies.

thermal↗