SEARCH · Engineering Papers

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRS1995

NASAwide electronic publishing system: Electronic printing and duplicating, stage-2 evaluation report (GSFC)

The NASA Scientific and Technical Information Office was assigned the responsibility to continue with the expansion of the NASAwide networked electronic duplicating effort by including the Goddard Space Flight Center (GSFC) as an additional node to the existing configuration of networked electronic duplicating systems within NASA. The subject of this report is the evaluation of a networked electronic duplicating system which meets the duplicating requirements and expands electronic publishing capabilities without increasing current operating costs. This report continues the evaluation reported in 'NASA Electronic Publishing System - Electronic Printing and Duplicating Evaluation Report' (NASA TM-106242) and 'NASA Electronic Publishing System - Stage 1 Evaluation Report' (NASA TM-106510). This report differs from the previous reports through the inclusion of an external networked desktop editing, archival, and publishing functionality which did not exist with the previous networked electronic duplicating system. Additionally, a two-phase approach to the evaluation was undertaken; the first was a paper study justifying a 90-day, on-site evaluation, and the second phase was to validate, during the 90-day evaluation, the cost benefits and productivity increases that could be achieved in an operational mode. A benchmark of the functionality of the networked electronic publishing system and external networked desktop editing, archival, and publishing system was performed under a simulated daily production environment. This report can be used to guide others in determining the most cost effective duplicating/publishing alternative through the use of cost/benefit analysis and return on investment techniques. A treatise on the use of these techniques can be found by referring to 'NASA Electronic Publishing System -Cost/Benefit Methodology' (NASA TM-106662).

Tuey, Richard C.↗

NASA NTRS1994

Formative and summative evaluation efforts for the Teacher Enhancement Institute conducted at the NASA Langley Research Center, summer 1994

The Teacher Enhancement Institute (TEI) at NASA Langley Research Center was developed in response to Executive Order 12821 which mandates national laboratories to 'assist in the mathematics and science education of our Nation's students, teachers, parents, and the public by establishing programs at their agency to provide for training elementary and secondary school teachers to improve their knowledge of mathematics and science. Such programs, to the maximum extent possible, shall involve partnerships with universities, state and local elementary and secondary school authorities, corporations and community based organizations'. The faculty worked closely with one another and the invited speakers to insure that the sessions supported the objectives. Speakers were informed of the objectives and given guidance concerning form and function for the session. Faculty members monitored sessions to assist speakers and to provide a quality control function. Faculty provided feedback to speakers concerning general objective accomplishment. Participant comments were also provided when applicable. Post TEI surveys asked for specific comments about each TEI session. During the second of the two, two week institutes, daily critiques were provided to the participants for their reflection. This seemed to provide much improved feedback to speakers and faculty because the sessions were fresh in each participant's mind. Between sessions one and two, some changes were made to the program as a result of the formative evaluation process. Those changes, though, were minor in nature and comprised what may be called 'fine tuning' a well conceived and implemented program. After the objectives were written, an assessment instrument was developed to test the accomplishment of the objectives. This instrument was actually two surveys, one given before the TEI and one given after the TEI. In using such a series, it was expected that changes in the participants induced by attendance at TEI may be discovered. Because the institute was limited in time and depth of exposure, attitudinal changes (self-assessment of ability and confidence) were chosen to be surveyed. On the pre-survey, seven general categories of questions were asked. The post-survey repeated three of these categories, providing a pre and post evaluation of the same questions and added a fourth category which asked the participant to self-assess objective accomplishment. The assessment process for TEI was valuable when one looks at the final accomplishments of the TEI. A number of aspects stand out: (1) formative evaluation during project development allowed the goals and objectives to guide the development of the institute; (2) formative evaluation provided positive guidance to presenters in developing and implementing their session; (3) formative evaluation helped presenters to improve or focus their sessions; (4) summative evaluation provided managers a way to gauge the success of the institute; (5) summative evaluation provided a benchmark for future programs to be measured against.

Carlson, Randal D.↗

NASA NTRS1993

Criteria for evaluation of grid generation systems

Many CFD grid generation systems are in use nationally, but few comparative studies have been performed to quantify their relative merits. A study was undertaken to systematically evaluate and select the best CFD grid generation codes available. Detailed evaluation criteria were established as the basis for the evaluation conducted. Descriptions of thirty-four separate criteria, grouped into eight general categories are provided. Benchmark test cases, developed to test basic features of selected codes, are described in detail. Scoring guidelines were generated to establish standards for measuring code capabilities, ensuring uniformity of ratings, and minimizing personal bias among the three code evaluators. Ten candidate codes were identified from government, industry, universities, and commercial software companies. A three phase evaluation was conducted. In Phase 1, ten codes identified were screened through conversations with code authors and other industry experts. Seven codes were carried forward into a Phase 2 evaluation in which all codes were scored according to the predefined criteria. Two codes emerged as being significantly better than the others: RAGGS and GRIDGEN. Finally, these two codes were carried forward into a Phase 3 evaluation in which complex 3-D multizone grids were generated to verify capability.

Ascoli, Edward P.↗

NASA NTRS1997

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.↗

NASA NTRS1999

Ergonomic Evaluation of the Foot Restraint Equipment Device (FRED)

Within the scope of the Microgravity Workstation and Restraint Evaluation project, funded by the NASA Headquarters Life Sciences Division, evaluations were proposed to be conducted in ground, KC-135, and/or Shuttle environments to investigate the human factors engineering (HFE) issues concerning confined/unique workstations, including crew restraint requirements. As part of these evaluations, KC-135 flights were conducted to investigate user/ workstation/ restraint integration for microgravity use of the FRED with the RMS workstation. This evaluation was a pre-cursor to Detailed Supplementary Objective (DSO) - 904 on STS-88. On that mission, a small-statured astronaut will be using the FRED restraint while working at the Aft RMS workstation. The DSO will collect video for later posture analyses, as well as subjective data in the form of an electronic questionnaire. This report describes the current FRED KC-135 evaluations. The primary objectives were to evaluate the usability of the FRED and to verify the DSO in-flight setup. The restraint interface evaluation consisted of four basic areas of restraint use: 1) adjustability; 2) general usability and comfort; 3) usability at the RMS workstation; and 4) assembly and disassembly.

Whitmore, Mihriban↗

NASA NTRS2000

Rainfall Product Evaluation for the TRMM Ground Validation Program

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Amitai, E.↗

NASA NTRS2005

Coordinating Multi-Rover Systems: Evaluation Functions for Dynamic and Noisy Environments

This paper addresses the evolution of control strategies for a collective: a set of entities that collectively strives to maximize a global evaluation function that rates the performance of the full system. Directly addressing such problems by having a population of collectives and applying the evolutionary algorithm to that population is appealing, but the search space is prohibitively large in most cases. Instead, we focus on evolving control policies for each member of the collective. The fundamental issue in this approach is how to create an evaluation function for each member of the collective that is both aligned with the global evaluation function and is sensitive to the fitness changes of the member, while relatively insensitive to the fitness changes of other members. We show how to construct evaluation functions in dynamic, noisy and communication-limited collective environments. On a rover coordination problem, a control policy evolved using aligned and member-sensitive evaluations outperfoms global evaluation methods by up to 400%. More notably, in the presence of a larger number of rovers or rovers with noisy and communication limited sensors, the proposed method outperforms global evaluation by a higher percentage than in noise-free conditions with a small number of rovers.

Turner, Kagan↗

NASA NTRS2005

Field Evaluations Test Plan for Validation of Alternative Low-Emission Surface Preparation/Depainting Technologies for Structural Steel

Headquarters National Aeronautics and Space Administration (NASA) chartered the Acquisition Pollution Prevention (AP2) Office to coordinate agency activities affecting pollution prevention issues identified during system and component acquisition and sustainment processes. The primary objectives of the AP2 Office are to: (1) Reduce or eliminate the use of hazardous materials (HazMats) or hazardous processes at manufacturing, remanufacturing, and sustainment locations. (2) Avoid duplication of effort in actions required to reduce or eliminate HazMats through joint center cooperation and technology sharing. To achieve a substrate condition suitable for the application of a coating system, both new and old (in-situ) substrates must undergo some type of surface preparation and/or depainting operation to ensure adhesion of the new coating system. The level of cleanliness or anchor profile desired is typically a function of the type of coating to be applied and the specification being adhered to. In high performance environments, cleanliness and surface profile requirements for carbon steel (the dominant substrate for facilities, structures and equipment) dictates the use of abrasive media. Many of the abrasive media currently used across NASA and Air Force Space Command (AFSPC) installations generate large quantities of fugitive particulate emissions and waste. The high quantities of airborne dust and waste generated from these operations pose significant environmental concern. Efforts to contain emissions and the reduce quantity of waste generated have significant implications on project cost; this is often a deterrent to engaging in maintenance activities. In response to recent technological developments and NASA's and AFSPC's need to undertake environmentally conscious corrosion prevention projects, a review of the industry needs to be undertaken to evaluate surface preparation technologies (materials and processes) for embrace. This project will identify, evaluate and approve alternative surface preparation technologies for use at NASA and AFSPC installations. Materials and processes will be evaluated with the goal of selecting those processes that will improve corrosion protection at critical systems, facilitate easier maintenance activity, extend maintenance cycles, eliminate flight hardware contamination and reduce the amount of hazardous waste generated. This Field Evaluations Test Plan defines the field evaluation and testing requirements for validating alternative surface preparation/depainting technologies and supplements the JTP. The field evaluations will be performed at Stennis Space Center, Mississippi, under the oversight of the Project Engineer. Additional field evaluations may be performed at other NASA centers or AFSPC facilities.

Lewis, Pattie↗

NASA NTRS2013

A Tool for the Automated Design and Evaluation of Habitat Interior Layouts

The objective of space habitat design is to minimize mass and system size while providing adequate space for all necessary equipment and a functional layout that supports crew health and productivity. Unfortunately, development and evaluation of interior layouts is often ignored during conceptual design because of the subjectivity and long times required using current evaluation methods (e.g., human-in-the-loop mockup tests and in-depth CAD evaluations). Early, more objective assessment could prevent expensive design changes that may increase vehicle mass and compromise functionality. This paper describes a new interior design evaluation method to enable early, structured consideration of habitat interior layouts. This interior layout evaluation method features a comprehensive list of quantifiable habitat layout evaluation criteria, automatic methods to measure these criteria from a geometry model, and application of systems engineering tools and numerical methods to construct a multi-objective value function measuring the overall habitat layout performance. In addition to a detailed description of this method, a C++/OpenGL software tool which has been developed to implement this method is also discussed. This tool leverages geometry modeling coupled with collision detection techniques to identify favorable layouts subject to multiple constraints and objectives (e.g., minimize mass, maximize contiguous habitable volume, maximize task performance, and minimize crew safety risks). Finally, a few habitat layout evaluation examples are described to demonstrate the effectiveness of this method and tool to influence habitat design.

Simon, Matthew A.↗

NASA NTRS2017

Ocular Coherence Tomography in the Evaluation of Anterior Eye Injuries in Space Flight

While Ocular Coherence Tomography (OCT) is not a first-line modality to evaluate anterior eye structures terrestrially, it is a resource already available on the International Space Station (ISS) that can be used in medical contingencies that involve the anterior eye. With remote guidance and subject matter expert (SME) support from the ground, a minimally trained crewmember can now use OCT to evaluate anterior eye pathologies on orbit. OCT utilizes low-coherence interferometry to produce detailed cross-sectional and 3D images of the eye in real time. Terrestrially, it has been used to evaluate macular pathologies and glaucoma. Since 2013, OCT has been used onboard the ISS as one part of a suite of hardware to evaluate the Visual Impairment/Intracranial Pressure risk faced by astronauts, specifically assessing changes in the retina and choroid during space flight. The Anterior Segment Module (ASM), an add-on lens, was also flown for research studies, providing an opportunity to evaluate the anterior eye in real time if clinically indicated. Anterior eye pathologies that could be evaluated using OCT were identified. These included corneal abrasions and ulcers, scleritis, and acute angle closure glaucoma. A remote guider script was written to provide ground specialists with step-by-step instructions to guide ISS crewmembers, who do not get trained on the ASM, to evaluate the anterior eye. The instructions were tested on novice subjects and/or operators, whose feedback was incorporated iteratively. The final remote guider script was reviewed by SME optometrists and NASA flight surgeons. The novel application of OCT technology to space flight allows for the acquisition of objective data to diagnose anterior eye pathologies when other modalities are not available. This demonstrates the versatility of OCT and highlights the advantages of using existing hardware and remote guidance skills to expand clinical capabilities in space flight.

Fer, Dan M.↗

NASA NTRS2017

Evaluating a Priori Ozone Profile Information Used in TEMPO (Tropospheric Emissions: Monitoring of Pollution) Tropospheric Ozone Retrievals

A primary objective for TOLNet is the evaluation and validation of space-based tropospheric O3 retrievals from future systems such as the Tropospheric Emissions: Monitoring of Pollution (TEMPO) satellite. This study is designed to evaluate the tropopause-based O3 climatology (TB-Clim) dataset which will be used as the a priori profile information in TEMPO O3 retrievals. This study also evaluates model simulated O3 profiles, which could potentially serve as a priori O3 profile information in TEMPO retrievals, from near-real-time (NRT) data assimilation model products (NASA Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System (GEOS-5) Forward Processing (FP) and Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA2)) and full chemical transport model (CTM), GEOS-Chem, simulations. The TB-Clim dataset and model products are evaluated with surface (0-2 km) and tropospheric (0-10 km) TOLNet observations to demonstrate the accuracy of the suggested a priori dataset and information which could potentially be used in TEMPO O3 algorithms. This study also presents the impact of individual a priori profile sources on the accuracy of theoretical TEMPO O3 retrievals in the troposphere and at the surface. Preliminary results indicate that while the TB-Clim climatological dataset can replicate seasonally-averaged tropospheric O3 profiles observed by TOLNet, model-simulated profiles from a full CTM (GEOS-Chem is used as a proxy for CTM O3 predictions) resulted in more accurate tropospheric and surface-level O3 retrievals from TEMPO when compared to hourly (diurnal cycle evaluation) and daily-averaged (daily variability evaluation) TOLNet observations. Furthermore, it was determined that when large daily-averaged surface O3 mixing ratios are observed (65 ppb), which are important for air quality purposes, TEMPO retrieval values at the surface display higher correlations and less bias when applying CTM a priori profile information compared to all other data products. The primary reason for this is that CTM predictions better capture the spatio-temporal variability of the vertical profiles of observed tropospheric O3 compared to the TB-Clim dataset and other NRT data assimilation models evaluated during this study.

Pollution↗

NASA NTRS2015

Survey and Assessment of Crew Performance Evaluation Methods Applicable to Human Spacecraft Design

Space is an unforgiving environment where the actions of the crew play a critical role in their health and safety. Given the limited number of crewmembers typically onboard a spacecraft and the multitude of complex systems they must operate, the performance of each individual is of paramount importance. Spacecraft habitat layout and operations are two main drivers affecting crew performance efficiency. Having the capability to analyze and compare crew performance across various spacecraft configurations can help identify improvements early in the conceptual design process where changes are less costly to implement, ultimately reducing overall project costs and improving long-term operations of the system. Currently, there are few comprehensive methods readily available for evaluating crew integration within a spacecraft in the conceptual design phase. In order to address this shortcoming, the goal of this work was to analyze various specialized evaluation methods found in analogous industries that have potential application to human spacecraft design. A survey of more than 400 human performance evaluation methods was completed. Over twenty different attributes were identified for each method and a variety of analyses were conducted to characterize and evaluate their potential use for assessing human spacecraft design options. The analysis revealed a particular deficiency of quantitative evaluation methods that are applicable early in the systems engineering design phase. It also identified five existing methods that could be supplemented to achieve the needs of an early design evaluation method. Additional discussion describes potential issues that must be overcome when developing a method specific for use in human spacecraft evaluations.

crew performance↗

NASA NTRS2019

Scheduling Improvements Following the Phase 1 Field Evaluation of the ATD-2 Integrated Arrival, Departure, and Surface Concept

NASA is conducting the Airspace Technology Demonstration-2 (ATD-2) to evaluate an Integrated Arrival, Departure, and Surface (IADS) traffic management system that extends traffic sequencing for the entire life-cycle of a flight from departure gate to arrival gate within multi-airport, metroplex environments. After development and testing in human-in-the-loop simulations, the IADS system was deployed to Charlotte Douglas International Airport for a three-year field evaluation. From the initial IADS concept development through the end of the Phase 1 field evaluation many lessons were learned with regards to the IADS scheduler. In this paper we describe how data from the Phase 1 field evaluation helped identify scheduler improvements and guided the implementation of refinements. The improvements in the IADS scheduler described in this paper are incorporated into the IADS Phase 2 scheduler enabling strategic Surface Metering Programs and will be evaluated during the field evaluation.

Airspace Technology Demonstration-2↗

NASA NTRS1980

Shuttle orbiter Ku-band radar/communications system design evaluation

Tasks performed in an examination and critique of a Ku-band radar communications system for the shuttle orbiter are reported. Topics cover: (1) Ku-band high gain antenna/widebeam horn design evaluation; (2) evaluation of the Ku-band SPA and EA-1 LRU software; (3) system test evaluation; (4) critical design review and development test evaluation; (5) Ku-band bent pipe channel performance evaluation; (6) Ku-band LRU interchangeability analysis; and (7) deliverable test equipment evaluation. Where discrepancies were found, modifications and improvements to the Ku-band system and the associated test procedures are suggested.

Dodds, J.↗

NASA NTRS1987

The application of flow competence evaluations to the assessment of flood-flow velocities and stresses

The concept of flow competence is generally employed to evaluate the velocities, discharges, and bottom stresses of river floods inferred from the size of the largest sediment particles transported. Flow competence has become an important tool for evaluating the hydraulics of exceptional floods on Earth, including those which eroded the Channeled Scabland of eastern Washington, and has potential for similar evaluations of the floods which carved the outflow channels on Mars. For the most part, flow-competence evaluations were empirical, based on data compiled from a variety of sources including major terrestrial floods caused by natural processes or dam failures. Such flow-competence relationships would appear to provide a straight-forward assessment of flood-flow stresses and velocities based on the maximum size of gravel and boulders transported. However, a re-examination of the data base and comparisons with measurements of selective entrainment and transport of gravel in rivers open to question such evaluations. Analyses of the forces acting on the grain during entrainment by pivoting, rolling, or sliding, an approach which focuses more on the physical processes than the purely empirical relationships can be demonstrated. These derived equations require further testing by flume and field measurements before being applied to flow-competence evaluations. Such tests are now underway.

Komar, Paul D.↗

NASA NTRS1990

Preliminary evaluation of space station transmission line in a ring configuration

The results of a preliminary evaluation of a space station type transmission line and commercial transmission lines in a ring configuration, are reported. In a ring configuration, each node has two paths for the return current of each wire. The additional path can create an unbalanced condition, where the magnetic fields created by the forward and return currents do not cancel. This evaluation was to quantify the effects of the unbalanced case upon the external fields. The transmission lines evaluated were standard commercial coaxial cables, RG59 and RG213, and a space station designed flat Litz transmission line. Each was evaluated in a balanced and unbalanced mode of operation. Currents and their harmonic content were recorded and compared. As expected, the harmonic content of the different current (I delta) was substantial for the unbalanced case as compared to the balanced case. For the balanced case, very little difference was noted among the various transmission lines evaluated. The evaluation is discussed, and the test circuit, the measurements, and the resulting data are described.

Roth, Mary Ellen↗

NASA NTRS1989

Thiokol/Wasatch installation evaluation of the redesigned field joint protection system (concepts 1 and 3)

The procedures, performance, and results obtained from the Thiokol Corporation/Wasatch Redesigned Field Joint Protection System (FJPS) Installation Evaluation are documented. The purpose of the evaluation was to demonstrate and develop the procedures required to install two different concepts (referred to as Concepts 1 and 3) of the redesigned FJPS. The processing capability of each configuration was then evaluated and compared. The FJPS is installed on redesigned solid rocket motors (RSRM) to protect the field joints from rain intrusion and to maintain the joint temperature sensor measurement between 85 and 122 F while the boosters are on the launch pad. The FJPS is being redesigned to reduce installation timelines at KSC and to simplify or eliminate installation processing problems related to the present design of an EPDM moisture seal/extruded cork combination. Several installation techniques were evaluated, and a preferred method of application was developed for each concept. The installations were performed with the test article in the vertical (flight) position. Comparative timelines between the two concepts were also developed. An additional evaluation of the Concept 3 configuration was performed with the test article in the horizontal position, to simulate an overhead installation on a technical evaluation motor (TEM).

Cook, M.↗

NASA NTRS1990

Evaluation of a proposed expert system development methodology: Two case studies

Two expert system development projects were studied to evaluate a proposed Expert Systems Development Methodology (ESDM). The ESDM was developed to provide guidance to managers and technical personnel and serve as a standard in the development of expert systems. It was agreed that the proposed ESDM must be evaluated before it could be adopted; therefore a study was planned for its evaluation. This detailed study is now underway. Before the study began, however, two ongoing projects were selected for a retrospective evaluation. They were the Ranging Equipment Diagnostic Expert System (REDEX) and the Backup Control Mode Analysis and Utility System (BCAUS). Both projects were approximately 1 year into development. Interviews of project personnel were conducted, and the resulting data was used to prepare the retrospective evaluation. Decision models of the two projects were constructed and used to evaluate the completeness and accuracy of key provisions of ESDM. A major conclusion reached from these case studies is that suitability and risk analysis should be required for all AI projects, large and small. Further, the objectives of each stage of development during a project should be selected to reduce the next largest area of risk or uncertainty on the project.

Gilstrap, Lewey↗