Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “experimental data error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Accelerating Time-Varying Hardware Volume Rendering Using TSP Trees and Color-Based Error Metrics

This paper describes a new hardware volume rendering algorithm for time-varying data. The algorithm uses the Time-Space Partitioning (TSP) tree data structure to identify regions within the data that have spatial or temporal coherence. By using this coherence, the rendering algorithm can improve performance when the volume data is larger than the texture memory capacity by decreasing the amount of textures required. This coherence can also allow improved speed by appropriately rendering flat-shaded polygons instead of textured polygons, and by not rendering transparent regions. To reduce the polygonization overhead caused by the use of the hierarchical data structure, we introduce an optimization method using polygon templates. The paper also introduces new color-based error metrics, which more accurately identify coherent regions compared to the earlier scalar-based metrics. By showing experimental results from runs using different data sets and error metrics, we demonstrate that the new methods give substantial improvements in volume rendering performance.

Ellsworth, David↗

Microgravity Propellant Tank Geyser Analysis and Prediction

An established correlation for geyser height prediction of an axial jet inflow into a microgravity propellant tank was analyzed and an effort to develop an improved correlation was made. The original correlation, developed using data from ethanol flow in small-scale drop tower tests, uses the jet-Weber number and the jet-Bond number to predict geyser height. A new correlation was developed from the same set of experimental data using the jet-Weber number and both the jet-Bond number and tank-Bond number to describe the geyser formation. The resulting correlation produced nearly a 40% reduction in geyser height predictive error compared to the original correlation with experimental data. Two additional tanks were computationally modeled in addition to the small-scale tank used in the drop tower testing. One of these tanks was a 50% enlarged small-scale tank and the other a full-scale 2 m radius tank. Simulations were also run for liquid oxygen and liquid hydrogen. Results indicated that the new correlation outperformed the original correlation in geyser height prediction under most circumstances. The new correlation has also shown a superior ability to recognize the difference between flow patterns II (geyser formation only) and III (pooling at opposite end of tank from the bulk fluid region).

Thornton, Randall J.↗

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗

Experiments in software reliability - Life-critical applications

The paper discusses four reliability data gathering experiments which were conducted using a small sample of programs for two problems having ultrareliability requirements, n-version programming for fault detection, and repetitive run modeling for failure and fault rate estimation. The experimental results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay. The fourth experiment underscored the difficulty in distinguishing between observations of deficiencies in the design of the algorithm and observations of software faults for real-time process control software. These experiments are a part of a program of serial experiments being pursued by the System Validation Methods of NASA-Langley Research Center to find a means of credibly performing reliability evaluations of flight control software.

Dunham, J. R.↗

Evidence of Completion of Milestone 4: Simulation Testbed Validated with Experimental Data

Milestone 4 is given in the SOPO as being due in quarter 5 (ending 9/11/2020) and is described thus: Milestone 4: Enhanced Simulation Testbed Validated with Experimental Data (UM, Mathieu). Simulation testbed validated with data obtained from experimental testbed, specifically, nonlinear load behaviors and communication network issues observed in the experimental testbed will be modeled in the simulation testbed. The simulation testbed should accurately capture TCL real and reactive power consumption (including during extreme events associated with nonlinear behaviors and communication network failures) to within 5% RMSE error with respect to data obtained from the experimental testbed. The Tasks comprising the work to achieve Milestone 4 are outlined here.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evidence of Completion of Milestone 4: Simulation Testbed Validated with Experimental Data

Milestone 4 is given in the SOPO as being due in quarter 5 (ending 9/11/2020) and is described thus: Milestone 4: Enhanced Simulation Testbed Validated with Experimental Data (UM, Mathieu) Simulation testbed validated with data obtained from experimental testbed, specifically, nonlinear load behaviors and communication network issues observed in the experimental testbed will be modeled in the simulation testbed. The simulation testbed should accurately capture TCL real and reactive power consumption (including during extreme events associated with nonlinear behaviors and communication network failures) to within 5% RMSE error with respect to data obtained from the experimental testbed.

99 GENERAL AND MISCELLANEOUS↗

A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators

Data scarcity in human reliability analysis (HRA) has been a major challenge in the quantification process. Many institutes have collected HRA data through experiments using full-scope simulators with actual operators. Nevertheless, there are still some limitations to relying solely on full-scope studies. This paper aims to propose how full-scope data collection studies can be supported through the Simplified Human Error Experimental Program (SHEEP). The SHEEP framework was developed by Idaho National Laboratory (INL) to collect HRA data through a simplified simulator and student operators. This paper introduces the major tasks in the SHEEP framework, with a particular focus on differences that arise due to participant type (i.e., student vs. actual operator), based on experiments using a simplified simulator (i.e., the Rancor Microworld). This paper also describes whether the data collected via this approach could support a representative full-scope data collection study (i.e., the HuREX study) based on the experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

The Effects of Aviation Weather Information Systems on General Aviation Weather Information Systems on General Pilots' Workload

My work at NASA Langley has focused around Aviation Weather Information CAWING displays. The majority of my time at LYRIC has been spent on the Workload and Relative Position (WaRP) Study. The goal of this project is to determine how an AWIN display at various positions within the cockpit affects pilot performance and workload. The project is being conducted in Languages Cessna 206H research aircraft. During the past year the design of the experiment was finalized and approved. Despite facing several delays the data collection was completed in early February. Alter the completion of the data collection an extensive data entry task began. This required recording air speed, altitude, course heading, bank angle, and vertical speed information from videos of the primary flight displays. This data was then used to determine root mean square error (RMSE) for each experimental condition. In addition to the performance data (RMSE) taken from flight path deviation, the study also collected data on pilot;s accuracy in reporting weather information, and a subjective rating of workload from the pilot. The data for this experiment is currently being analyzed. Overall the current experiment should help to determine potential costs and benefits associated with AWIN displays. The data will be used to determine if a private pilot can safely fly a general aviation aircraft while operating a weather display. Clearly a display that adds to the pilot#s already heavy workload represents a potential problem. The study will compare the use of an AWIN display to conventional means of acquiring weather data. The placement of the display within the cockpit (i.e., either on the yoke, kneeboard, or panel) will be also compared in terms of workload, performance, and pilot preference.

Scerbo, Mark↗

Strain gage measurement errors in the transient heating of structural components

Significant strain-gage errors may exist in measurements acquired in transient thermal environments if conventional correction methods are applied. Conventional correction theory was modified and a new experimental method was developed to correct indicated strain data for errors created in radiant heating environments ranging from 0.6 C/sec (1 F/sec) to over 56 C/sec (100 F/sec). In some cases the new and conventional methods differed by as much as 30 percent. Experimental and analytical results were compared to demonstrate the new technique. For heating conditions greater than 6 C/sec (10 F/sec), the indicated strain data corrected with the developed technique compared much better to analysis than the same data corrected with the conventional technique.

Richards, W. Lance↗

High-Pressure Apparatus for Monitoring Solid–Liquid Phase Transitions

This work presents a new technique for observing the solid–liquid phase transformations in complex diesel fuel blends and diesel surrogates under high-pressure conditions intended to simulate those occurring in vehicle fuel injectors. A high-pressure apparatus based on a visual identification of freezing and thawing has been designed and built to monitor phase behavior and determine the crystallization temperature of complex fuels to predict wax precipitation. The proposed methodology was validated using pure substances—n-hexadecane (C16H34), cyclohexane (C6H12), and a binary cyclohexane/n-hexadecane mixture—all of which have been well-characterized previously. The crystallization temperatures of these compounds were measured from atmospheric pressure to 400 MPa for temperatures varying from 290 to 363 K and compared to those reported in the literature. The standard error of the estimated temperatures, based on a given pressure, between the experimental data obtained in this work was compared to data in the literature from Domanska et al. This methodology is being extended to investigate the properties of more complex fuel mixtures.

High-Pressure, phase change, diesel, solidificatio↗

An experiment in software reliability

The results of a software reliability experiment conducted in a controlled laboratory setting are reported. The experiment was undertaken to gather data on software failures and is one in a series of experiments being pursued by the Fault Tolerant Systems Branch of NASA Langley Research Center to find a means of credibly performing reliability evaluations of flight control software. The experiment tests a small sample of implementations of radar tracking software having ultra-reliability requirements and uses n-version programming for error detection, and repetitive run modeling for failure and fault rate estimation. The experiment results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay.

Dunham, J. R.↗

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Measurement Uncertainty in One-Of-A-Kind Event Data Analysis

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable, have unavoidable built-in differences resulting in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates over the measurement uncertainty. Range of true values depends on built-in differences in physics of the experiment. Stochastic physical processes result typically in a broader range of true values than non-stochastic processes do. Measurement uncertainty depends on a measurement method (properties of the detector not of the experiment). Modern measurement methods, including digital ones, frequently make the measurement uncertainty very small. When data from one–of –a kind experiment are analyzed, only the measurement uncertainty is reported. It provides no information about the range of true experimental values, neither about reliability of a reported data point. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable. Methods for data analysis from an experiment repeated statistically significant number of times are very well developed. They do not require a detailed expertise in physics of an experiment, nor in the properties of the measurement system used, and meaning of the reported uncertainty is well understood in any scientific community. It all changes when data from one-of-a-kind experiment is analyzed. Analyst’s expertise is required both in the physics of the experiment and in all aspects of the measurement system, all possible malfunctions. Data users must remember that only measurement uncertainty is reported from any one-of-a-kind experiment. Theory with simulations may provide estimation of expected built-in differences in the experiment, and by this of expected range of true values for a given experiment; yet measurement uncertainty can never be used in place of the range of true experimental values.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Thermal Output of WK-Type Strain Gauges on Various Materials at Cryogenic and Elevated Temperatures

Strain gage apparent strain (thermal output) is one of the largest sources of error associated with the measurement of strain when temperatures and mechanical loads are varied. In this paper, experimentally determined apparent strains of WK-type strain gages, installed on both metallic and composite-laminate materials of various lay-ups and resin systems for temperatures ranging from -450 F to 230 F are presented. For the composite materials apparent strain in both the 0 ply orientation angle and the 90 ply orientation angle were measured. Metal specimens tested included: aluminum-lithium alloy (Al-LI 2195-T87), aluminum alloy (Al 2219-T87), and titanium alloy. Composite materials tested include: graphite-toughened-epoxy (IM7/997- 2), graphite-bismaleimide (IM7/5260), and graphite-K3 (IM7/K3B). The experimentally determined apparent strain data are curve fit with a fourth-order polynomial for each of the materials studied. The apparent strain data and the polynomials that are fit to the data are compared with those produced by the strain gage manufacturer, and the results and comparisons are presented. Unacceptably high errors between the manufacture's data and the experimentally determined data were observed (especially at temperatures below - 270-F).

Kowalkowski, Matthew K.↗

AI to Predict Glass Compositions Satisfying Property and Cooling Rate Criteria

This project aimed to develop a predictive, artificial intelligence/machine learning-based model to identify glass compositions satisfying specified property requirements. Such a model would provide a systematic approach for narrowing down the nearly infinite range of possible compositions for glasses and minimize unnecessary experimental trial and error. A large empirical data set for training and testing the algorithm was obtained from the SciGlass database. It contains glass compositions and corresponding property data from a wide range of literature sources. However, the currently available form of this data, recently released under an open database license, is not conducive to easy querying and use. The data structure was deciphered and a customized parsing code developed to make this data more usable for the current and future work. Neural network models were developed and trained on viscosity data from the database and demonstrated potential for improving prediction accuracy over a traditional regression model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Vibrational sensitivity of a measuring instrument and methods of increasing the accuracy of its determinations

The properties and peculiarities of two groups of measuring systems reacting to vibrations are discussed. Specifically, results of the action of a three dimensional, cophasal, monoharmonic vibration on the linear system of a measuring instrument was analyzed. Data are also given on the connection between vibration sensitivity and vibration resistance for instruments, methods for estimating vibration resistance, and formulas for expressing test results of vibration resistance. Experimental data are also given for decreasing errors in nonlinear systems during vibrations.

Mironov, Y. S.↗