Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1964

The Effect of Information Feedback Upon Psychophysical Judgments

An analysis was made of the role of presentation schedules and information feedback on performance in a forced-choice signal detection task. The experimental results indicate that information feedback facilitates performance, but only for certain presentation schedules. The present study was designed to assess performance in a signal detection task under two conditions of information feedback. In the I-condition, S was told on each trial whether his detection response was correct or incorrect; in the !-condition S was given no feedback regarding the correctness of his response. The task involved a 2-response, forced-choice auditory detection problem. On each trial 2 temporal intervals were defined and S was required to report which interval he believed contained the signal; i. e., in one interval a tone burst in a background of white noise was presented, while the other interval contained only white noise. A trial will be denoted as s1 or s2, depending on whether the signal was embedded in the 1st or 2nd interval; the S's response will be denoted A1 or A2 to indicate which interval he reported contained the signal. The probability of an s1 trial will be denoted as y. In this study two values of y were used (.50 and.75) and, as indicated above, two conditions of information feedback. Thus there were 4 experimental conditions (501, · 50I, 751, 75I); each S was run under all 4 conditions. Method Gaussian noise was presented binaurally in S's headphones throughout a test session and the signal was a 1000-cps sinusoid tone; the tone was presented for 100 msec. including equal fall and rise times of 20 msec. The ratio of signal energy to noise power in a unit bandwidth was 2.9, and was constant throughout the study. The. S was seated before a stimulus display board. On each trial a red warning light was flashed for 100 msec. Two amber lights then came on successively each for 1 sec.; these lights defined the 2 observation intervals. The onset of the signal occurred 500 msec. after the onset of one of the observation intervals. After the second amber light went off, S indicated his response by pressing 1 of 2 wand switches under cards reading "1st interval" and "2nd interval." For the !-condition a green light flashed on above the correct response key after S's response; the green light was omitted in the !-condition. Each trial lasted 6 sec. The S's were 12 male college students with normal hearing. They were run for two practice sessions followed by 20 test sessions. Test sessions were run on consecutive days, 350 trials/day. Each day S ran on 1 of the 4 experimental conditions; in successive 4-day blocks S ran one day on each of the 4 experimental conditions in a random order. Thus, over 20 days each of the experimental conditions was repeated 5 times.

Atkinson, Richard C.↗
NASA NTRS1962

Sequential Phenomena in Psychophysical Judgments: A Theoretical Analysis

This paper deals with an analysis of psychophysical detection experiments designed to assess the limit of a human observer's level of sensitivity. A mathematical theory or the detection process is introduced that, in contrast to previous theories, provides an analysis of the sequential effects observed in psychophysical data. Two variations of the detection task are considered: information feedback and no-information feedback. In the feedback situation the subject is given information concerning the correctness of his responses, whereas in the no-feedback situation he is not. Data from a visual detection experiment with no-information feedback, and from an auditory detection experiment with information feedback are analyzed in terms of the theory. Finally, some general results are derived concerning the relationship between performance in the feedback situation and the no-feedback situation.

Atkinson, R. C.↗
NASA NTRS1992

Quantification of human responses

Human perception is a complex phenomenon which is difficult to quantify with instruments. For this reason, large panels of people are often used to elicit and aggregate subjective judgments. Print quality, taste, smell, sound quality of a stereo system, softness, and grading Olympic divers and skaters are some examples of situations where subjective measurements or judgments are paramount. We usually express what is in our mind through language as a medium but languages are limited in available choices of vocabularies, and as a result, our verbalizations are only approximate expressions of what we really have in mind. For lack of better methods to quantify subjective judgments, it is customary to set up a numerical scale such as 1, 2, 3, 4, 5 or 1, 2, 3, ..., 9, 10 for characterizing human responses and subjective judgments with no valid justification except that these scales are easy to understand and convenient to use. But these numerical scales are arbitrary simplifications of the complex human mind; the human mind is not restricted to such simple numerical variations. In fact, human responses and subjective judgments are psychophysical phenomena that are fuzzy entities and therefore difficult to handle by conventional mathematics and probability theory. The fuzzy mathematical approach provides a more realistic insight into understanding and quantifying human responses. This paper presents a method for quantifying human responses and subjective judgments without assuming a pattern of linear or numerical variation for human responses. In particular, quantification and evaluation of linguistic judgments was investigated.

Steinlage, R. C.↗
NASA NTRS1976

Visual space perception on a computer graphics night visual attachment

A series of experiments was conducted to compare five psychophysical methods of measuring how people perceive visual space in simulators. Psychologists have used such methods traditionally to measure visual space perception in the real world. Of the five tasks - objective-size judgments, angular-size judgments, shape judgments, slant judgments, and distance judgments - only the angular-size judgment task proved to be of potential use as a measure of simulator realism. In this experiment pilots estimated the relative angular size of triangles placed at various distances along a simulated runway. Estimates made when the display was collimated were closer to real-world performance than estimates made with an uncollimated display.

Palmer, E.↗
NASA NTRS1977

Judgements of relative noisiness of a supersonic transport and several commercial-service aircraft

Two laboratory experiments were conducted on the relative noisiness of takeoff and landing operations of a supersonic transport and several other aircraft in current commercial service. A total of 96 subjects made noisiness judgments on 120 tape-recorded flyover noises in the outdoor-acoustic-simulation experiment; 32 different subjects made judgments on the noises in the indoor-acoustic-simulation experiment. The judgments were made by using the method of numerical category scaling. The effective perceived noise level underestimated the noisiness of the supersonic transport by 3.5 db. For takeoff operations, no difference was found between the noisiness of the supersonic transport and the group of other aircraft for the A-weighted rating scale; however, for landing operations, the noisiness of the supersonic transport was overestimated by 3.7 db. Very high correlation was found between the outdoor-simulation experiment and the indoor-simulation experiment.

Powell, C. A.↗
NASA NTRS1980

Annoyance due to multiple airplane noise exposure

A laboratory study was conducted to investigate the annoyance effects of multiple aircraft noise exposure in which 250 subjects judged the annoyance of half-hour periods of airplane noise simulative of typical indoor home exposures. The variables of the aircraft noise exposure were the peak noise level of flyovers, which was constant within each period, and the number of flyovers. Each subject judged 5 of the possible 25 factorial combinations of level and number. Other variables investigated included the experience of the test subjects in making annoyance judgments and their home exposure to airplane noise. The annoyance judgments increased with both noise level and number of flyovers. The increased annoyance produced by doubling the number of flyovers was found to be the equivalent of a 4 to 6 db increase in noise level. The sensitivity of the subjects to changes in both noise level and number of flyovers increased with laboratory experience. Although the means of the annoyance judgments made in the laboratory were found to decrease with the subjects' home exposure to aircraft noise, the subjects' sensitivities to changes in both level and number were unaffected by their home exposure.

Powell, C. A.↗
NASA NTRS1980

Effects of magnification and visual accommodation on aimpoint estimation in simulated landings with real and virtual image displays

Twenty professional pilots observed a computer-generated airport scene during simulated autopilot-coupled night landing approaches and at two points (20 sec and 10 sec before touchdown) judged whether the airplane would undershoot or overshoot the aimpoint. Visual accommodation was continuously measured using an automatic infrared optometer. Experimental variables included approach slope angle, display magnification, visual focus demand (using ophthalmic lenses), and presentation of the display as either a real (direct view) or a virtual (collimated) image. Aimpoint judgments shifted predictably with actual approach slope and display magnification. Both pilot judgments and measured accommodation interacted with focus demand with real-image displays but not with virtual-image displays. With either type of display, measured accommodation lagged far behind focus demand and was reliably less responsive to the virtual images. Pilot judgments shifted dramatically from an overwhelming perceived-overshoot bias 20 sec before touchdown to a reliable undershoot bias 10 sec later.

Randle, R. J.↗
NASA NTRS1982

Subjective scaling of mental workload in a multi-task environment

Those factors in a multi-task environment that contribute to the operators' "sense" of mental workload were identified. The subjective judgment as conscious experience of mental effort was decided to be the appropriate method of measurement. Thurstone's law of comparative judgment was employed in order to construct interval scales of subjective mental workload from paired comparisons data. An experimental paradigm (Simulated Multi-Task Decision-Making Environment) was employed to represent the ideal experimentally controlled environment in which human operators were asked to "attend" to different cases of Tulga's decision making tasks. Through various statistical analyses it was found that, in general, a lower number of tasks-to-be-processed per unit time (a condition associated with longer interarrival times), results in a lower mental workload, a higher consistency of judgments within a subject, a higher degree of agreement among the subjects, and larger distances between the cases on the Thurstone scale of subjective mental workload. The effects of various control variables and their interactions, and the different characteristics of the subjects on the variation of subjective mental workload are demonstrated.

Daryanian, B.↗
NASA NTRS1982

A model of subjective probabilities from small groups

Methods for aggregating the opinions of individual forecasters in order to improve the quality of probabilistic forecasts are presented. Experimental results obtained by Seaver in his study of probability judgments by groups of four people are considered. The decision variable partition model of subjective probability and a simple model of the effects of interaction on judgments were used to simulate the group judgment of discrete probabilities investigated by Seaver. The initial results of the simulation are very promising in that (1) they show the principal effects Seaver observed and (2) these effects can, for the most part, be traced to specific characteristics of the models.

Ferrell, W. R.↗
NASA NTRS1987

NASA Lewis Research Center Futuring Workshop

On October 21 and 22, 1986, the Futures Group ran a two-day Futuring Workshop on the premises of NASA Lewis Research Center. The workshop had four main goals: to acquaint participants with the general history of technology forecasting; to familiarize participants with the range of forecasting methodologies; to acquaint participants with the range of applicability, strengths, and limitations of each method; and to offer participants some hands-on experience by working through both judgmental and quantitative case studies. Among the topics addressed during this workshop were: information sources; judgmental techniques; quantitative techniques; merger of judgment with quantitative measurement; data collection methods; and dealing with uncertainty.

Boroush, Mark↗
NASA NTRS1987

Absolute magnitude estimation and relative judgement approaches to subjective workload assessment

Two rating scale techniques employing an absolute magnitude estimation method, were compared to a relative judgment method for assessing subjective workload. One of the absolute estimation techniques used was an unidimensional overall workload scale and the other was the multidimensional NASA-Task Load Index technique. Thomas Saaty's Analytic Hierarchy Process was the unidimensional relative judgment method used. These techniques were used to assess the subjective workload of various single- and dual-tracking conditions. The validity of the techniques was defined as their ability to detect the same phenomena observed in the tracking performance. Reliability was assessed by calculating test-retest correlations. Within the context of the experiment, the Saaty Analytic Hierarchy Process was found to be superior in validity and reliability. These findings suggest that the relative judgment method would be an effective addition to the currently available subjective workload assessment techniques.

Vidulich, Michael A.↗
NASA NTRS1990

Symbolic enhancement of perspective displays

Two exocentric azimuth judgment experiments with a perspective display were conducted with 16 subjects. Previous work has shown these judgments to exhibit a bias possibly due to misinterpretation of the viewing parameters used to generate the display. Though geometric compensations may be used to correct for the bias, an alternate technique selected in the following 2 experiments was the introduction of symbolic enhancements in the form of compass roses. It is suggested that a compass rose with 30 deg divisions results in overall optimal azimuth estimation accuracy when accuracy and decision time are both considered. The data also suggest that the added radial lines on the compass roses may interact with normalization processes that influence the judgment errors.

Ellis, Stephen R.↗
NASA NTRS1996

Comparison of the Performance of Noise Metrics as Predictions of the Annoyance of Stage 2 and Stage 3 Aircraft Overflights

Thirty audiometrically screened test participants judged the relative annoyance of two comparison (variable level) and thirty-four standard (fixed level) signals in an adaptive paired comparison psychoacoustic study. The signal ensemble included both FAR Part 36 Stage 2 and 3 aircraft overflights, as well as synthesized aircraft noise signatures and other non-aircraft signals. All test signals were presented for judgment as heard indoors, in the presence of continuous background noise, under free-field listening conditions in an anechoic chamber. Analyses of the performance of 30 noise metrics as predictors of these annoyance judgments confirmed that the more complex metrics were generally more accurate and precise predictors than the simpler methods. EPNL was somewhat less accurate and precise as a predictor of the annoyance judgments than a duration-adjusted variant of Zwicker's Loudness Level.

Pearsons, Karl S.↗
NASA NTRS2001

Using the Human Eye to Characterize Displays

Monitor characterization has taken on new importance for non-professional users, who are not usually equipped to make photometric measurements. Our purpose was to examine some of the visual judgments used in characterization schemes that have been proposed for web users. We studied adjusting brightness to set the black level, banding effects due to digitization, and gamma estimation in the light and in the dark, and a color-matching task in the light, on a desktop CRT and a laptop LCD. Observers demonstrated the sensitivity of the visual system for comparative judgments in black-level adjustment, banding visibility, and gamma estimation. The results of the color-matching task were ambiguous. In the brightness adjustment task, the action of the adjustment was not as presumed; however, perceptual judgments were as expected under the actual conditions. When the gamma estimates of observers were compared to photometric measurements, problems with the definition of gamma were identified. Information about absolute light levels that would be important for characterizing a display, given the shortcomings of gamma in measuring apparent contrast, are not measurable by eye alone. The LCD was not studied as extensively as the CRT because of viewing-angle problems, and its transfer function did not follow a power law, rendering gamma estimation meaningless.

Gille, Jennifer↗
NASA NTRS2004

Development of an Expert Judgement Elicitation and Calibration Methodology for Risk Analysis in Conceptual Vehicle Design

A comprehensive expert-judgment elicitation methodology to quantify input parameter uncertainty and analysis tool uncertainty in a conceptual launch vehicle design analysis has been developed. The ten-phase methodology seeks to obtain expert judgment opinion for quantifying uncertainties as a probability distribution so that multidisciplinary risk analysis studies can be performed. The calibration and aggregation techniques presented as part of the methodology are aimed at improving individual expert estimates, and provide an approach to aggregate multiple expert judgments into a single probability distribution. The purpose of this report is to document the methodology development and its validation through application to a reference aerospace vehicle. A detailed summary of the application exercise, including calibration and aggregation results is presented. A discussion of possible future steps in this research area is given.

Unal, Resit↗
NASA NTRS1998

Two memories for geographical slant: separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

NASA Discipline Space Human Factors↗
DOE OSTI2025

Identifying preferential flow from soil moisture time series: Review of methodologies

Abstract Identifying and quantifying preferential flow (PF) through soil—the rapid movement of water through spatially distinct pathways in the subsurface—is vital to understanding how the hydrologic cycle responds to climate, land cover, and anthropogenic changes. In recent decades, methods have been developed that use measured soil moisture time series to identify PF. Because they allow for continuous monitoring and are relatively easy to implement, these methods have become an important tool for recognizing when, where, and under what conditions PF occurs. The methods seek to identify a pattern or quantification that indicates the occurrence of PF. Most commonly, the chosen signature is either (1) a nonsequential response to infiltrated water, in which soil moisture responses do not occur in order of shallowest to deepest, or (2) a velocity criterion, in which newly infiltrated water is detected at depth earlier than is possible by nonpreferential flow processes. Alternative signatures have also been developed that have certain advantages but are less commonly utilized. Choosing among these possible signatures requires attention to their pertinent characteristics, including susceptibility to errors, possible bias toward false negatives or false positives, reliance on subjective judgments, and possible requirements for additional types of data. We review 77 studies that have applied such methods to highlight important information for readers who want to identify PF from soil moisture data and to inform those who aim to develop new methods or improve existing ones. Core Ideas Soil moisture data can be used to identify the occurrence of preferential flow (PF) and its initiating conditions. Various data‐analysis methods to identify PF differ in susceptibility to error, bias, and subjectivity. These methods can utilize vast amounts of data from soil moisture monitoring networks to develop understanding of when, where, and under what conditions PF occurs. Newly developed methods may lead to better accuracy and reliability, and reduce the need for subjective judgments. Plain Language Summary Preferential flow through soil occurs when a large amount of water is suddenly available, as during an intense storm. This type of flow moves rapidly through the soil in distinct narrow pathways rather than moving evenly throughout the body of soil, with major consequences for groundwater resources, ecosystems, spreading of contaminants, and other vital concerns. Methods of detecting preferential flow have been developed that utilize measurements of soil water content made by sensors installed at various depths. This measurement technology has been widely implemented, many locations now having datasets years in length, and various methods have been developed for using these to identify preferential flow. The various methods are based on different features in the soil moisture records and vary in their advantages and shortcomings. In this review, we explain and evaluate these methods, highlighting important information for their implementation to identify preferential flow from soil moisture data and for efforts to develop new methods or improve existing ones.

Nimmo, John R↗
DOE OSTI2025

A mathematical approach to using the forgetting curve to evaluate experience and training factors in human reliability analysis

Traditional human reliability analysis (HRA) methods have difficulty dealing with the dynamic nature of factors such as time and rely on static and expert-judgment-based assessments of performance-shaping factors (PSFs) across limited levels. In this study, we introduce a mathematical approach for dynamically evaluating the experience and training PSF. Our proposed method integrates the psychological concept of the “forgetting curve” to evaluate how PSFs are impacted by the number of trainings and the time elapsed since training. To confirm the validity of the model, we provide experimental data fitted by identifying the quantitative relationship between training and human performance. This research enables dynamic and objective assessments, thus reducing reliance on subjective expert judgment and improving the accuracy of HRA.

99 - GENERAL AND MISCELLANEOUS↗