SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗

DOE OSTI2024

Evaluating the 238 U PFNS Including Chi-Nu Experimental Data

This report documents an evaluation of 238 U prompt fission neutron spectra (PFNS) which is a deliverable for a FY2024 Q4 NCSP (Nuclear Criticality Safety Program) milestone. This evaluation is new; its prior input is based on extended Los Alamos and exciton models implemented in the code CoH. Experimental covariances were estimated for five experimental data sets. One of these data sets that was measured by the Chi-Nu team of LANL and LLNL. It covers the 238 U PFNS for continuous incident-neutron energies of 1–20 MeV and outgoing-neutron energies from 10 keV– 10 MeV with high precision. Contrary to Chi-Nu data, previous data sets were measured in a limited energy range. The resulting evaluated data correspond well to the experimental PFNS taken into account for the evaluation. The evaluated PFNS also produce average mean energies in agreement with associated Chi-Nu data. If one uses the new evaluated data to predict the neutron multiplication factor, k eff , of the Flattop, Flattop-Pu and BigTen ICSBEP critical assemblies (which all have thick reflectors with high percentages of 238 U), the differences of simulated values compared to those using ENDF/B-VIII.1β3 is modest (less than 25 pcm). In addition to that, the new PFNS predict on average 238 U LLNL pulsed-sphere neutron-leakage spectra slightly better than ENDF/BVIIII.0 and ENDF/B-VIII.1β3 PFNS. The differences are, however, well within the experimental uncertainties.

238U↗

DOE OSTI2023

A computational modeling framework for pre-clinical evaluation of cardiac mapping systems

There are a variety of difficulties in evaluating clinical cardiac mapping systems, most notably the inability to record the transmembrane potential throughout the entire heart during patient procedures which prevents the comparison to a relevant “gold standard”. Cardiac mapping systems are comprised of hardware and software elements including sophisticated mathematical algorithms, both of which continue to undergo rapid innovation. The purpose of this study is to develop a computational modeling framework to evaluate the performance of cardiac mapping systems. The framework enables rigorous evaluation of a mapping system’s ability to localize and characterize (i.e., focal or reentrant) arrhythmogenic sources in the heart. The main component of our tool is a library of computer simulations of various dynamic patterns throughout the entire heart in which the type and location of the arrhythmogenic sources are known. Our framework allows for performance evaluation for various electrode configurations, heart geometries, arrhythmias, and electrogram noise levels and involves blind comparison of mapping systems against a “silver standard” comprised of computer simulations in which the precise transmembrane potential patterns throughout the heart are known. A feasibility study was performed using simulations of patterns in the human left atria and three hypothetical virtual catheter electrode arrays. Activation times (AcT) and patterns (AcP) were computed for three virtual electrode arrays: two basket arrays with good and poor contact and one high-resolution grid with uniform spacing. The average root mean squared difference of AcTs of electrograms and those of the nearest endocardial action potential was less than 1 ms and therefore appears to be a poor performance metric. In an effort to standardize performance evaluation of mapping systems a novel performance metric is introduced based on the number of AcPs identified correctly and those considered spurious as well as misclassifications of arrhythmia type; spatial and temporal localization accuracy of correctly identified patterns was also quantified. This approach provides a rigorous quantitative analysis of cardiac mapping system performance. Proof of concept of this computational evaluation framework suggests that it could help safeguard that mapping systems perform as expected as well as provide estimates of system accuracy.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1980

Shuttle orbiter Ku-band radar/communications system design evaluation

Tasks performed in an examination and critique of a Ku-band radar communications system for the shuttle orbiter are reported. Topics cover: (1) Ku-band high gain antenna/widebeam horn design evaluation; (2) evaluation of the Ku-band SPA and EA-1 LRU software; (3) system test evaluation; (4) critical design review and development test evaluation; (5) Ku-band bent pipe channel performance evaluation; (6) Ku-band LRU interchangeability analysis; and (7) deliverable test equipment evaluation. Where discrepancies were found, modifications and improvements to the Ku-band system and the associated test procedures are suggested.

Dodds, J.↗

NASA NTRS1987

The application of flow competence evaluations to the assessment of flood-flow velocities and stresses

The concept of flow competence is generally employed to evaluate the velocities, discharges, and bottom stresses of river floods inferred from the size of the largest sediment particles transported. Flow competence has become an important tool for evaluating the hydraulics of exceptional floods on Earth, including those which eroded the Channeled Scabland of eastern Washington, and has potential for similar evaluations of the floods which carved the outflow channels on Mars. For the most part, flow-competence evaluations were empirical, based on data compiled from a variety of sources including major terrestrial floods caused by natural processes or dam failures. Such flow-competence relationships would appear to provide a straight-forward assessment of flood-flow stresses and velocities based on the maximum size of gravel and boulders transported. However, a re-examination of the data base and comparisons with measurements of selective entrainment and transport of gravel in rivers open to question such evaluations. Analyses of the forces acting on the grain during entrainment by pivoting, rolling, or sliding, an approach which focuses more on the physical processes than the purely empirical relationships can be demonstrated. These derived equations require further testing by flume and field measurements before being applied to flow-competence evaluations. Such tests are now underway.

Komar, Paul D.↗

NASA NTRS1990

Preliminary evaluation of space station transmission line in a ring configuration

The results of a preliminary evaluation of a space station type transmission line and commercial transmission lines in a ring configuration, are reported. In a ring configuration, each node has two paths for the return current of each wire. The additional path can create an unbalanced condition, where the magnetic fields created by the forward and return currents do not cancel. This evaluation was to quantify the effects of the unbalanced case upon the external fields. The transmission lines evaluated were standard commercial coaxial cables, RG59 and RG213, and a space station designed flat Litz transmission line. Each was evaluated in a balanced and unbalanced mode of operation. Currents and their harmonic content were recorded and compared. As expected, the harmonic content of the different current (I delta) was substantial for the unbalanced case as compared to the balanced case. For the balanced case, very little difference was noted among the various transmission lines evaluated. The evaluation is discussed, and the test circuit, the measurements, and the resulting data are described.

Roth, Mary Ellen↗

NASA NTRS1989

Thiokol/Wasatch installation evaluation of the redesigned field joint protection system (concepts 1 and 3)

The procedures, performance, and results obtained from the Thiokol Corporation/Wasatch Redesigned Field Joint Protection System (FJPS) Installation Evaluation are documented. The purpose of the evaluation was to demonstrate and develop the procedures required to install two different concepts (referred to as Concepts 1 and 3) of the redesigned FJPS. The processing capability of each configuration was then evaluated and compared. The FJPS is installed on redesigned solid rocket motors (RSRM) to protect the field joints from rain intrusion and to maintain the joint temperature sensor measurement between 85 and 122 F while the boosters are on the launch pad. The FJPS is being redesigned to reduce installation timelines at KSC and to simplify or eliminate installation processing problems related to the present design of an EPDM moisture seal/extruded cork combination. Several installation techniques were evaluated, and a preferred method of application was developed for each concept. The installations were performed with the test article in the vertical (flight) position. Comparative timelines between the two concepts were also developed. An additional evaluation of the Concept 3 configuration was performed with the test article in the horizontal position, to simulate an overhead installation on a technical evaluation motor (TEM).

Cook, M.↗

NASA NTRS1990

Evaluation of a proposed expert system development methodology: Two case studies

Two expert system development projects were studied to evaluate a proposed Expert Systems Development Methodology (ESDM). The ESDM was developed to provide guidance to managers and technical personnel and serve as a standard in the development of expert systems. It was agreed that the proposed ESDM must be evaluated before it could be adopted; therefore a study was planned for its evaluation. This detailed study is now underway. Before the study began, however, two ongoing projects were selected for a retrospective evaluation. They were the Ranging Equipment Diagnostic Expert System (REDEX) and the Backup Control Mode Analysis and Utility System (BCAUS). Both projects were approximately 1 year into development. Interviews of project personnel were conducted, and the resulting data was used to prepare the retrospective evaluation. Decision models of the two projects were constructed and used to evaluate the completeness and accuracy of key provisions of ESDM. A major conclusion reached from these case studies is that suitability and risk analysis should be required for all AI projects, large and small. Further, the objectives of each stage of development during a project should be selected to reduce the next largest area of risk or uncertainty on the project.

Gilstrap, Lewey↗

NASA NTRS1991

Evaluation of components, subsystems, and networks for high rate, high frequency space communications

The development of new space communications technologies by NASA has included both commercial applications and space science requirements. At NASA's Lewis Research Center, methods and facilities have been developed for evaluating these new technologies in the laboratory. NASA's Systems Integration, Test and Evaluation (SITE) Space Communication System Simulator is a hardware-based laboratory simulator for evaluating space communications technologies at the component, subsystem, system, and network level, geared toward high frequency, high data rate systems. The SITE facility is well-suited for evaluation of the new technologies required for the Space Exploration Initiative (SEI) and advanced commercial systems. This paper describes the technology developments and evaluation requirements for current and planned commercial and space science programs. Also examined are the capabilities of SITE, the past, present, and planned future configurations of the SITE facility, and applications of SITE to evaluation of SEI technology.

Kerczewski, Robert J.↗

NASA NTRS1992

Training evaluation final report

In the area of management training, 'evaluation' refers both to the specific evaluation instrument used to determine whether a training effort was considered effective, and to the procedures followed to evaluate specific training requests. This report recommends to evaluate new training requests in the same way new procurement or new projects are evaluated. This includes examining training requests from the perspective of KSC goals and objectives, and determining expected ROI of proposed training program (does training result in improved productivity, through savings of time, improved outputs, and/or personnel reduction?). To determine whether a specific training course is effective, a statement of what constitutes 'good performance' is required. The user (NOT the Training Branch) must define what is 'required level of performance'. This 'model' will be the basis for the design and development of an objective, performance-based, training evaluation instrument.

Sepulveda, Jose A.↗

NASA NTRS1993

Test techniques for evaluating flight displays

The rapid development of graphics technology allows for greater flexibility in aircraft displays, but display evaluation techniques have not kept pace. Historically, display evaluation has been based on subjective opinion and not on the actual aircraft/pilot performance. Existing electronic display specifications and evaluation techniques are reviewed. A display rating technique analogous to handling qualities ratings was developed and is recommended for future evaluations. The choice of evaluation pilots is also discussed and the use of a limited number of trained evaluators is recommended over the use of a large number of operational pilots.

Haworth, Loran A.↗

NASA NTRS1993

Medical evaluations on the KC-135 1991 flight report summary

The medical investigations completed on the KC-135 during FY 1991 in support of the development of the Health Maintenance Facility and Medical Operations are presented. The experiments consisted of medical and engineering evaluations of medical hardware and procedures and were conducted by medical and engineering personnel. The hardware evaluated included prototypes of a crew medical restraint system and advanced life support pack, a shuttle orbiter medical system, an airway medical accessory kit, a supplementary extended duration orbiter medical kit, and a surgical overhead canopy. The evaluations will be used to design flight hardware and identify hardware-specific training requirements. The following procedures were evaluated: transport of an ill or injured crewmember at man-tended capability, surgical technique in microgravity, transfer of liquids in microgravity, advanced cardiac life support using man-tended capability Health Maintenance Facility hardware, medical transport using a model of the assured crew return vehicle, and evaluation of delivery mechanisms for aerosolized medications in microgravity. The results of these evaluation flights allow for a better understanding of the types of procedures that can be performed in a microgravity environment.

Lloyd, Charles W.↗

NASA NTRS1993

Integration and evaluation of a simulator designed to be used within a dynamic prototyping environment

The human computer interface (HCI) prototyping environment is designed to allow developers to rapidly prototype systems so that the interface and functionality of a system can be evaluated and iteratively refined early in the development process. This keeps development costs down by modifying the interface during the requirements definition phase, thus minimizing changes that need to be made during and after flight code development. Problems occur within a system when the user interface is not adequately developed and when designers and developers have an incomplete understanding of the system requirements. A process has been developed for prototyping on-board payload displays for Space Station Freedom. This prototyping process consists of five phases: identification of known requirements, analysis of the requirements, development of a formal design representation and specification, development of the prototype, and evaluation of the prototype. The actual development of the prototype involves prototyping the displays, developing a low fidelity simulator, building of an interface (or communication) between the displays and the simulator, integration of these components, and testing to ensure that the interface does what the developer expects. This research integrates and evaluates a software tool which has been developed to serve as a simulator within the prototyping environment. The tool is being evaluated to determine whether or not it meets the basic requirements which are needed for a low fidelity simulator within this environment. In order to evaluate the architecture and its components, a human computer interface for and a simulator of an automobile have been developed as a prototype. The individual components (i.e., the interface and simulator) have been developed, and the current research was designed to integrate and test the complete working system within the prototyping environment. The following sections will describe the architecture and components of the rapid prototyping environment, the development of a system to assess the environment, and the integration and evaluation of PERCNET.

Moore, Loretta A.↗

NASA NTRS1992

Comprehensive system models: Strategies for evaluation

The task of evaluating comprehensive earth system models is vast involving validations of every model component at every scale of organization, as well as tests of all the individual linkages. Even the most detailed evaluation of each of the component processes and the individual links among them should not, however, engender confidence in the performance of the whole. The integrated earth system is so rich with complex feedback loops, often involving components of the atmosphere, oceans, biosphere, and cryosphere, that it is certain to exhibit emergent properties very difficult to predict from the perspective of a narrow focus on any individual component of the system. Therefore, a substantial share of the task of evaluating comprehensive earth system models must reside at the level of whole system evaluations. Since complete, integrated atmosphere/ ocean/ biosphere/ hydrology models are not yet operational, questions of evaluation must be addressed at the level of the kinds of earth system processes that the models should be competent to simulate, rather than at the level of specific performance criteria. Here, we have tried to identify examples of earth system processes that are difficult to simulate with existing models and that involve a rich enough suite of feedbacks that they are unlikely to be satisfactorily described by highly simplified or toy models. Our purpose is not to specify a checklist of evaluation criteria but to introduce characteristics of the earth system that may present useful opportunities for model testing and, of course, improvement.

Field, Christopher↗

NASA NTRS1995

Evaluation of Visualization Software

Visualization software is widely used in scientific and engineering research. But computed visualizations can be very misleading, and the errors are easy to miss. We feel that the software producing the visualizations must be thoroughly evaluated and the evaluation process as well as the results must be made available. Testing and evaluation of visualization software is not a trivial problem. Several methods used in testing other software are helpful, but these methods are (apparently) often not used. When they are used, the description and results are generally not available to the end user. Additional evaluation methods specific to visualization must also be developed. We present several useful approaches to evaluation, ranging from numerical analysis of mathematical portions of algorithms to measurement of human performance while using visualization systems. Along with this brief survey, we present arguments for the importance of evaluations and discussions of appropriate use of some methods.

Globus, Al↗

NASA NTRS1996

Evaluation of an Anthropometric Human Body Model for Simulated EVA Task Assessment

One of the more mission-critical tasks performed in space is extravehicular activity (EVA) which requires the astronaut to be external to the station or spacecraft, and subsequently at risk from the many threats posed by space. These threats include, but are not limited to: no significant atmosphere, harmful electromagnetic radiation, micrometeoroids, and space debris. To protect the astronaut from this environment, a special EVA suit is worn which is designed to maintain a sustainable atmosphere (at 1/3 atmosphere) and provide protection against the hazards of space. While the EVA suit serves these functions well, it does impose limitations on the astronaut as a consequence of the safety it provides. Since the astronaut is in a virtual vacuum, any atmospheric pressure inside the suit serves to pressurize the suit and restricts mobility of flexible joints (such as fabric). Although some of the EVA suit joints are fixed, rotary-style joints, most of the mobility is achieved by the simple flexibility of the fabric. There are multiple layers of fabric, each of which serves a special purpose in the safety of the astronaut. These multiple layers add to the restriction of motion the astronaut experiences in the space environment. Ground-based testing is implemented to evaluate the capability of EVA-suited astronauts to perform the various tasks in space. In addition to the restriction of motion imposed by the EVA suit, most EVA activity is performed in a micro-gravity (weight less) environment. To simulate weightlessness EVA-suited testing is performed in a neutral buoyancy simulator (NBS). The NBS is composed of a large container of water (pool) in which a weightless environment can be simulated. A subject is normally buoyant in the pressurized suit; however he/she can be made neutrally buoyant with the addition of weights. In addition, most objects the astronaut must interface with in the NBS sink in water and flotation must be added to render them "weightless". The implementation of NBS testing has proven to invaluable in the assessment of EVA activities performed with the Orbiter and is considered to be a key step in the construction of the International Space Station (ISS). While the NBS testing is extremely valuable, it does require considerable overhead to maintain and operate. It has been estimated that the cost of utilizing the facility is approximately $10,000 per day. Therefore it is important to maximize the utility of NBS testing for optimal results. One important aspect to consider in any human/worksite interface is the considerable wealth of anthropometric and ergonomic data available. A subset of this information specific to EVA activity is available in NASA standard 3000. The difficulty in implementing this data is that most of the anthropometric information is represented in a two-dimensional format. This poses some limitations in complete evaluation of the astronaut's capabilities in a three-dimensional environment. Advances in computer hardware and software have provided for three-dimensional design and implementation of hardware with the advance of computer aided design (CAD) software. There are a number of CAD products available and most companies and agencies have adopted CAD as a fundamental aspect of the design process. Another factor which supports the use of CAD is the implementation of computer aided manufacturing (CAM) software and hardware which provides for rapid prototyping and decreases the time to product in the design process. It is probable that most hardware to be accessed by astronauts in EVA or IVA (intravehicular activity) has been designed by a CAD system, and is therefore represented in three-dimensional space for evaluation. Because of the implementation of CAD systems and the movement towards early prototyping, a need has arisen in industry and government for tools which facilitate the evaluation of ergonomic consideration in a three-dimensional environment where the hardware has been designed by the CAD tools. One such product is Jack which was developed by the University of Pennsylvania with funding from several government agencies, including NASA. While the primary purpose of Jack is to model human figures in a ground-based (gravity) environment, it can be utilized to evaluate EVA-suited activities as well. The effects of simulated gravity must be turned off by turning off "behaviors". Although Jack provides human figures for manipulation, the primary instrument to be evaluated for EVA mobility is the work envelope provided by the EVA suit. An EVA Jack suit model has been developed by NASA-JSC and was utilized in this study. This suit model provided a more restrictive motion environment as expected for an EVA suited subject. As part of this study, the anthropometric dimensions for a 50th percentile male were compared with basic anthropometric data and were found to be representative for the population group expected in the NASA flight program. The joints for the suit were created in a manner which provided consistent performance with EVA reach envelopes published in NASA standard #3000.

Etter, Brad↗

NASA NTRS1998

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs immediately after the instruction. Although EDCATS is designed for teachers to enter their data logged onto the appropriate internet web site, most surveys were completed on a printed copy and entered into the EDCATS system by USSF personnel. The Aviation and Space Basics class were taken to a computer lab where they responded to the survey on-line. Data from the Inservice surveys were manually entered into a computer spreadsheet program by US Space Foundation personnel and processed using the statistical program SPSS for Windows. The raw data and copy of the EDCATS survey for the five-day programs are in Appendix 1. The raw data and copy of the Inservice survey are in Appendix 2. Comments from both programs are in Appendices 3 and 4, respectively.

Ewell, Bob↗

NASA NTRS1999

Human Modeling Evaluations in Microgravity Workstation and Restraint Development

The International Space Station (ISS) will provide long-term missions which will enable the astronauts to live and work, as well as, conduct research in a microgravity environment. The dominant factor in space affecting the crew is "weightlessness" which creates a challenge for establishing workstation microgravity design requirements. The crewmembers will work at various workstations such as Human Research Facility (HRF), Microgravity Sciences Glovebox (MSG) and Life Sciences Glovebox (LSG). Since the crew will spend considerable amount of time at these workstations, it is critical that ergonomic design requirements are integral part of design and development effort. In order to achieve this goal, the Space Human Factors Laboratory in the Johnson Space Center Flight Crew Support Division has been tasked to conduct integrated evaluations of workstations and associated crew restraints. Thus, a two-phase approach was used: 1) ground and microgravity evaluations of the physical dimensions and layout of the workstation components, and 2) human modeling analyses of the user interface. Computer-based human modeling evaluations were an important part of the approach throughout the design and development process. Human modeling during the conceptual design phase included crew reach and accessibility of individual equipment, as well as, crew restraint needs. During later design phases, human modeling has been used in conjunction with ground reviews and microgravity evaluations of the mock-ups in order to verify the human factors requirements. (Specific examples will be discussed.) This two-phase approach was the most efficient method to determine ergonomic design characteristics for workstations and restraints. The real-time evaluations provided a hands-on implementation in a microgravity environment. On the other hand, only a limited number of participants could be tested. The human modeling evaluations provided a more detailed analysis of the setup. The issues identified during the real-time testing were investigated in the human modeling analyses. In some cases, the opposite was true where preliminary human modeling analyses provided the design engineers with critical issues that needed to be addressed further. This extensive approach provided an effective means to fully address ergonomic design considerations and accurately identify critical issues.

Whitmore, Mihriban↗