Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Gas Sensor Evaluations in Polymer Combustion Product Atmospheres

Toxic gases produced by the combustion or thermo-oxidative degradation of materials such as wire insulation, foam, plastics, or electronic circuit boards in space shuttle or space station crew cabins may pose a significant hazard to the flight crew. Toxic gas sensors are routinely evaluated in pure gas standard mixtures, but the possible interferences from polymer combustion products are not routinely evaluated. The NASA White Sands Test Facility (WSTF) has developed a test system that provides atmospheres containing predetermined quantities of target gases combined with the coincidental combustion products of common spacecraft materials. The target gases are quantitated in real time by infrared (IR) spectroscopy and verified by grab samples. The sensor responses are recorded in real time and are compared to the IR and validation analyses. Target gases such as carbon monoxide, hydrogen cyanide, hydrogen chloride, and hydrogen fluoride can be generated by the combustion of poly(vinyl chloride), polyimide-fluoropolymer wire insulation, polyurethane foam, or electronic circuit board materials. The kinetics and product identifications for the combustion of the various materials were determined by thermogravimetric-IR spectroscopic studies. These data were then scaled to provide the required levels of target gases in the sensor evaluation system. Multisensor toxic gas monitors from two manufacturers were evaluated using this system. In general, the sensor responses satisfactorily tracked the real-time concentrations of toxic gases in a dynamic mixture. Interferences from a number of organic combustion products including acetaldehyde and bisphenol-A were minimal. Hydrogen bromide in the products of circuit board combustion registered as hydrogen chloride. The use of actual polymer combustion atmospheres for the evaluation of sensors can provide additional confidence in the reliability of the sensor response.

Delgado, Rafael H.↗

Structural Evaluation of the RSRM Nozzle Replacement Adhesive

This paper describes the structural performance evaluation of a replacement adhesive for the Reusable Solid Rocket Motor (RSRM) nozzle utilizing finite element analysis. Due to material obsolescence and industrial safety issues, the two current structural adhesives, EA 913 and EA 946 are to be replaced with a new adhesive. TIGA 321. The structural evaluation in support of the adhesive replacement effort includes residual stress, transportation, and flight analyses. Factors of safety are calculated using the stress response from each analysis. The factors of safety are used as the limiting criteria to compare the replacement adhesive against the current adhesives. Included in this paper are the analytical approach, assumptions and modeling techniques as well as the results of the evaluation. An important factor to the evaluation is the similarity in constitutive material properties (elastic modulus and Poisson's ratio) between TIGA 321 and EA 913. This similarity leads to equivalent material response from the two adhesives. However, TIGA 321 surpasses EA 913's performance due to higher material capabilities. Conversely, the change in stress response from EA 946 to TIGA 321 is more apparent: this is primarily attributed to the difference in the modulii of the two adhesives, which differ by two orders of magnitude. The results of the bondline evaluation indicate that the replacement adhesive provides superior performance than the current adhesives with only minor exceptions. Furthermore, TIGA 321 causes only a minor chance in the response of the phenolic and metal components.

Batista-Rodriguez, A.↗

Evaluation of the Regional Atmospheric Modeling System in the Eastern Range Dispersion Assessment System

The Applied Meteorology Unit is conducting an evaluation of the Regional Atmospheric Modeling System (RAMS) contained within the Eastern Range Dispersion Assessment System (ERDAS). ERDAS provides emergency response guidance for operations at the Cape Canaveral Air Force Station and the Kennedy Space Center in the event of an accidental hazardous material release or aborted vehicle launch. The prognostic data from RAMS is available to ERDAS for display and is used to initialize the 45th Range Safety (45 SW/SE) dispersion model. Thus, the accuracy of the 45 SW/SE dispersion model is dependent upon the accuracy of RAMS forecasts. The RAMS evaluation task consists of an objective and subjective component for the Florida warm and cool seasons of 1999-2000. The objective evaluation includes gridded and point error statistics at surface and upper-level observational sites, a comparison of the model errors to a coarser grid configuration of RAMS, and a benchmark of RAMS against the widely accepted Eta model. The warm-season subjective evaluation involves a verification of the onset and movement of the Florida east coast sea breeze and RAMS forecast precipitation. This interim report provides a summary of the RAMS objective and subjective evaluation for the 1999 Florida warm season only.

Case, Jonathan↗

Phased Array Ultrasonic Evaluation of Space Shuttle Main Engine (SSME) Nozzle Weld

This viewgraph presentation gives an overview of the phased array ultrasonic evaluation of the Space Shuttle Main Engine (SSME) nozzle weld. Details are given on the nondestructive testing evaluation approach, conventional shear wave and phased array techniques, and an x-ray versus phased array risk analysis. The field set-up was duplicated to the greatest extent possible in the laboratory and the phased array ultrasonic technique was developed and validated prior to weld evaluation. Results are shown for the phased array ultrasonic evaluation and conventional ultrasonic evaluation results.

James, Steve↗

Electronic Nose: Evaluation of Kamina Prototype Unit

The Kamina, Sam and Cyranose electronic nose systems were evaluated and partially trained. Much work was performed on the Kamina as it has the ability to respond to low (less than 10 ppb) concentrations of hydrazine compounds. We were able to tell the difference between Hydrazine (Hz) and Monomethylhydrazine (MMH) in standard clean humid air. We were able to detect MMH in reduced pressure (1/3 atm) at about 250 ppb, however the training set was to far from the real situation to be useful now. Various engineering and usability aspects of both the noses was noted, especially the software. One serious physical engineering flaw was remedied in the Kamina system. A gas flow manifold was created for the Sam system. Different chips were evaluated for the Kamina system. It is still unclear if they can be exchanged without retraining the software.The Sam Detect commercial unit was evaluated for solvent detection and evaluation. It was able to successfully identify some solvents. The Cyranose, was observed and evaluated for two days. It has the ability to detect gasses in the 100 parts per million level but not the 10 parts per billion level. It is very sensitive to humidity changes; there is software to partially handle this.

Schattke, Nathan↗

AHS Technical Committee Highlights: Test and Evaluation

The AHS technical committee for Test and Evaluation is comprised of representatives from industry and government rotorcraft technology development centers. The committee considers many aspects of rotorcraft and VTOL testing, including the evaluation of components and subsystems. In addition, the committee seeks to evaluate the effectiveness of new procedures and operational solutions to problems that are encountered in the low-speed flight regime for both land and ship-based environments. This article presents the test and evaluation committee highlights for 98-99. Though by no means comprehensive, the article includes significant efforts related to test and evaluation contributed by the committee members for their respective organizations.

Jacklin, Stephen A.↗

A Gold Standards Approach to Training Instructors to Evaluate Crew Performance

The Advanced Qualification Program requires that airlines evaluate crew performance in Line Oriented Simulation. For this evaluation to be meaningful, instructors must observe relevant crew behaviors and evaluate those behaviors consistently and accurately against standards established by the airline. The airline industry has largely settled on an approach in which instructors evaluate crew performance on a series of event sets, using standardized grade sheets on which behaviors specific to event set are listed. Typically, new instructors are given a class in which they learn to use the grade sheets and practice evaluating crew performance observed on videotapes. These classes emphasize reliability, providing detailed instruction and practice in scoring so that all instructors within a given class will give similar scores to similar performance. This approach has value but also has important limitations; (1) ratings within one class of new instructors may differ from those of other classes; (2) ratings may not be driven primarily by the specific behaviors on which the company wanted the crews to be scored; and (3) ratings may not be calibrated to company standards for level of performance skill required. In this paper we provide a method to extend the existing method of training instructors to address these three limitations. We call this method the "gold standards" approach because it uses ratings from the company's most experienced instructors as the basis for training rater accuracy. This approach ties the training to the specific behaviors on which the experienced instructors based their ratings.

Baker, David P.↗

Novel approaches and application of contemporary sensory evaluation practices in iron fortification programs

Iron deficiency is the leading nutritional deficiency in the U.S. and the rest of the world, with its highest prevalences in the developing world. Iron fortification of food has been proposed as a strategy to reduce the high prevalence of iron deficiency. Poor consumer acceptance, unacceptable taste, and discoloration of the iron-fortified foods have been frequently listed as causes of unsuccessful iron fortification programs. An excellent prospect for improving consumer acceptance of iron-fortified foods is the incorporation of a thorough, organized, and unified approach to sensory evaluation practices into iron fortification programs for product optimization. The information gained from systematic sensory evaluation allows for the manipulation of the sensory attributes, and thus improvement of the sensory properties of the fortified food. However, iron fortification programs have not systematically measured the effect of fortification on the sensory quality of the food. Because sensory evaluation is an important criterion in successful iron fortification, an integrated approach is necessary. Therefore, nutritionists and sensory scientists should work closely with each other to select the most suitable sensory tests and methods. The objectives of this article are to: (1) critically review and discuss some traditional and contemporary approaches and applications of sensory evaluation practices in iron fortification programs, and (2) demonstrate the importance of incorporating a multidisciplinary, systematic sensory evaluation approach in iron fortification programs.

Review, Tutorial↗

An Evaluation Methodology for Traffic Awareness Displays

An evaluation methodology for traffic awareness displays for helicopters and other vertical/short takeoff aircraft was developed. Pilots of vertical/short takeoff aircraft wil1 require more traffic information than would pilots of conventional aircraft to avoid both other vertical/short takeoff traffic and conventional traffic. The BF Goodrich Skywatch traffic advisory display was used as a candidate display to develop a procedure for evaluating the usefulness of such displays. Four high-time helicopter pilots participated in a 16-hour flight evaluation. They flew a closed circuit in the San Francisco Bay Area. In one-half of the flights the evaluation pilot had the traffic advisory display as an aid in detecting and locating traffic. In the other half of the flights the traffic advisory display was not available to the evaluation pilot. Data examined include measures of traffic advisory display performance and pilot performance in detecting traffic, as well as subjective workload and situation awareness data. The traffic advisory system did not help the pilots to detect more traffic. The importance of detection to traffic awareness is discussed.

DeMaio, Joe↗

Evaluation of shoulder integrity in space: first report of musculoskeletal US on the International Space Station

Investigative procedures were approved by Henry Ford Human Investigation Committee and NASA Johnson Space Center Committee for Protection of Human Subjects. Informed consent was obtained. Authors evaluated ability of nonphysician crewmember to obtain diagnostic-quality musculoskeletal ultrasonographic (US) data of the shoulder by following a just-in-time training algorithm and using real-time remote guidance aboard the International Space Station (ISS). ISS Expedition-9 crewmembers attended a 2.5-hour didactic and hands-on US training session 4 months before launch. Aboard the ISS, they completed a 1-hour computer-based Onboard Proficiency Enhancement program 7 days before examination. Crewmembers did not receive specific training in shoulder anatomy or shoulder US techniques. Evaluation of astronaut shoulder integrity was done by using a Human Research Facility US system. Crew used special positioning techniques for subject and operator to facilitate US in microgravity environment. Common anatomic reference points aided initial probe placement. Real-time US video of shoulder was transmitted to remote experienced sonologists in Telescience Center at Johnson Space Center. Probe manipulation and equipment adjustments were guided with verbal commands from remote sonologists to astronaut operators to complete rotator cuff evaluation. Comprehensive US of crewmember's shoulder included transverse and longitudinal images of biceps and supraspinatus tendons and articular cartilage surface. Total examination time required to guide astronaut operator to acquire necessary images was approximately 15 minutes. Multiple arm and probe positions were used to acquire dynamic video images that were of excellent quality to allow evaluation of shoulder integrity. Postsession download and analysis of high-fidelity US images collected onboard demonstrated additional anatomic detail that could be used to exclude subtle injury. Musculoskeletal US can be performed in space by minimally trained operators by using remote guidance. This technique can be used to evaluate shoulder integrity in symptomatic crewmembers after strenuous extravehicular activities or to monitor microgravity-associated changes in musculoskeletal anatomy. Just-in-time training, combined with remote experienced physician guidance, may provide a useful approach to complex medical tasks performed by nonexperienced personnel in a variety of remote settings, including current and future space programs. (c) RSNA, 2004.

Space Flight/education↗

Lithium-Ion Batteries Being Evaluated for Low-Earth-Orbit Applications

The performance characteristics and long-term cycle life of aerospace lithium-ion (Li-ion) batteries in low-Earth-orbit applications are being investigated. A statistically designed test using Li-ion cells from various manufacturers began in September 2004 to study the effects of temperature, end-of-charge voltage, and depth-of-discharge operating conditions on the cycle life and performance of these cells. Performance degradation with cycling is being evaluated, and performance characteristics and failure modes are being modeled statistically. As technology improvements are incorporated into aerospace Li-ion cells, these new designs can be added to the test to evaluate the effect of the design changes on performance and life. Cells from Lithion and Saft have achieved over 2000 cycles under 10 different test condition combinations and are being evaluated. Cells from Mine Safety Appliances (MSA) and modules made up of commercial-off-the-shelf 18650 Li-ion cells connected in series/parallel combinations are scheduled to be added in the summer of 2005. The test conditions include temperatures of 10, 20, and 30 C, end-of-charge voltages of 3.85, 3.95, and 4.05 V, and depth-of-discharges from 20 to 40 percent. The low-Earth-orbit regime consists of a 55 min charge, at a constant-current rate that is 110 percent of the current required to fully recharge the cells in 55 min until the charge voltage limit is reached, and then at a constant voltage for the remaining charge time. Cells are discharged for 35 min at the current required for their particular depth-of-discharge condition. Cells are being evaluated in four-cell series strings with charge voltage limits being applied to individual cells by the use of charge-control units designed and produced at the NASA Glenn Research Center. These charge-control units clamp the individual cell voltages as each cell reaches its end-of-charge voltage limit, and they bypass the excess current from that cell, while allowing the full current flow to the remaining cells in the pack. The goal of this evaluation is to identify conditions and cell designs for Li-ion technology that can achieve more than 30,000 low-Earth-orbit cycles. Testing is being performed at the Naval Surface Warfare Center, Crane Division, in Crane, Indiana.

McKissock, Barbara I.↗

An Evaluation of the Vapor Phase Catalytic Ammonia Removal Process for Use in a Mars Transit Vehicle

An experimental program has been developed to evaluate the potential of the Vapor Phase Catalytic Ammonia Reduction (VPCAR) technology for use as a Mars Transit Vehicle water purification system. Design modifications which will be required to ensure proper operation of the VPCAR system in reduced gravity are also evaluated. The VPCAR system is an integrated wastewater treatment technology that combines a distillation process with high temperature catalytic oxidation. The distillation portion of the system utilizes a vapor compression distillation process to provide an energy efficient phase change separation. This portion of the system removes any inorganic salts and large molecular weight, organic contaminates, i.e., non-volatile, from the product water stream and concentrates these contaminates into a byproduct stream. To oxidize the volatile organic compounds and ammonia, a vapor phase, high temperature catalytic oxidizer is used. This catalytic system converts these compounds along with the aqueous product into CO2, H2O, and N2O. A secondary catalytic bed can then be used to reduce the N2O to nitrogen and oxygen (although not evaluated in this study). This paper describes the design specification of the VPCAR process, the relative benefits of its utilization in a Mars Transit Vehicle, and the design modification which will be required to ensure its proper operation in reduced gravity. In addition, the results of an experimental evaluation of the processors is presented. This evaluation presents the processors performance based upon product water purity, water recovery rates, and power.

Flynn, Michael↗

Simple and Efficient Numerical Evaluation of Near-Hypersingular Integrals

Recently, significant progress has been made in the handling of singular and nearly-singular potential integrals that commonly arise in the Boundary Element Method (BEM). To facilitate object-oriented programming and handling of higher order basis functions, cancellation techniques are favored over techniques involving singularity subtraction. However, gradients of the Newton-type potentials, which produce hypersingular kernels, are also frequently required in BEM formulations. As is the case with the potentials, treatment of the near-hypersingular integrals has proven more challenging than treating the limiting case in which the observation point approaches the surface. Historically, numerical evaluation of these near-hypersingularities has often involved a two-step procedure: a singularity subtraction to reduce the order of the singularity, followed by a boundary contour integral evaluation of the extracted part. Since this evaluation necessarily links basis function, Green s function, and the integration domain (element shape), the approach ill fits object-oriented programming concepts. Thus, there is a need for cancellation-type techniques for efficient numerical evaluation of the gradient of the potential. Progress in the development of efficient cancellation-type procedures for the gradient potentials was recently presented. To the extent possible, a change of variables is chosen such that the Jacobian of the transformation cancels the singularity. However, since the gradient kernel involves singularities of different orders, we also require that the transformation leaves remaining terms that are analytic. The terms "normal" and "tangential" are used herein with reference to the source element. Also, since computational formulations often involve the numerical evaluation of both potentials and their gradients, it is highly desirable that a single integration procedure efficiently handles both.

Fink, Patrick W.↗

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Kalinowski, Kevin F.↗

Evaluation of Radiation Belt Space Weather Forecasts for Internal Charging Analyses

A variety of static electron radiation belt models, space weather prediction tools, and energetic electron datasets are used by spacecraft designers and operations support personnel as internal charging code inputs to evaluate electrostatic discharge risks in space systems due to exposure to relativistic electron environments. Evaluating the environment inputs is often accomplished by comparing whether the data set or forecast tool reliability predicts measured electron flux (or fluence over a given period) for some chosen period. While this technique is useful as a model metric, it does not provide the information necessary to evaluate whether short term deviances of the predicted flux is important in the charging evaluations. In this paper, we use a 1-D internal charging model to compute electric fields generated in insulating materials as a function of time when exposed to relativistic electrons in the Earth's magnetosphere. The resulting fields are assumed to represent the "true" electric fields and are compared with electric field values computed from relativistic electron environments derived from a variety of space environment and forecast tools. Deviances in predicted fields compared to the "true" fields which depend on insulator charging time constants will be evaluated as a potential metric for determining the importance of predicted and measured relativistic electron flux deviations over a range of time scales.

Minow, Joseph I.↗

Evaluation of Long-Term Cloud-Resolving Model Simulations Using Satellite Radiance Observations and Multi-Frequency Satellite Simulators

This paper proposes a methodology known as the Tropical Rainfall Measuring Mission (TRMM) Triple-Sensor Three-step Evaluation Framework (T3EF) for the systematic evaluation of precipitating cloud types and microphysics in a cloud-resolving model (CRM). T3EF utilizes multi-frequency satellite simulators and novel statistics of multi-frequency radiance and backscattering signals observed from the TRMM satellite. Specifically, T3EF compares CRM and satellite observations in the form of combined probability distributions of precipitation radar (PR) reflectivity, polarization-corrected microwave brightness temperature (Tb), and infrared Tb to evaluate the candidate CRM. T3EF is used to evaluate the Goddard Cumulus Ensemble (GCE) model for cases involving the South China Sea Monsoon Experiment (SCSMEX) and Kwajalein Experiment (KWAJEX). This evaluation reveals that the GCE properly captures the satellite-measured frequencies of different precipitating cloud types in the SCSMEX case but underestimates the frequencies of deep convective and deep stratiform types in the KWAJEX case. Moreover, the GCE tends to simulate excessively large and abundant frozen condensates in deep convective clouds as inferred from the overestimated GCE-simulated radar reflectivities and microwave Tb depressions. Unveiling the detailed errors in the GCE s performance provides the best direction for model improvements.

Matsui, Toshihisa↗

TurboTech Technical Evaluation Automated System

TurboTech software is a Web-based process that simplifies and semiautomates technical evaluation of NASA proposals for Contracting Officer's Technical Representatives (COTRs). At the time of this reporting, there have been no set standards or systems for training new COTRs in technical evaluations. This new process provides boilerplate text in response to interview style questions. This text is collected into a Microsoft Word document that can then be further edited to conform to specific cases. By providing technical language and a structured format, TurboTech allows the COTRs to concentrate more on the actual evaluation, and less on deciding what language would be most appropriate. Since the actual word choice is one of the more time-consuming parts of a COTRs job, this process should allow for an increase in quantity of proposals evaluated. TurboTech is applicable to composing technical evaluations of contractor proposals, task and delivery orders, change order modifications, requests for proposals, new work modifications, task assignments, as well as any changes to existing contracts.

Tiffany, Dorothy J.↗

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗