Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Simple and Efficient Numerical Evaluation of Near-Hypersingular Integrals

Recently, significant progress has been made in the handling of singular and nearly-singular potential integrals that commonly arise in the Boundary Element Method (BEM). To facilitate object-oriented programming and handling of higher order basis functions, cancellation techniques are favored over techniques involving singularity subtraction. However, gradients of the Newton-type potentials, which produce hypersingular kernels, are also frequently required in BEM formulations. As is the case with the potentials, treatment of the near-hypersingular integrals has proven more challenging than treating the limiting case in which the observation point approaches the surface. Historically, numerical evaluation of these near-hypersingularities has often involved a two-step procedure: a singularity subtraction to reduce the order of the singularity, followed by a boundary contour integral evaluation of the extracted part. Since this evaluation necessarily links basis function, Green s function, and the integration domain (element shape), the approach ill fits object-oriented programming concepts. Thus, there is a need for cancellation-type techniques for efficient numerical evaluation of the gradient of the potential. Progress in the development of efficient cancellation-type procedures for the gradient potentials was recently presented. To the extent possible, a change of variables is chosen such that the Jacobian of the transformation cancels the singularity. However, since the gradient kernel involves singularities of different orders, we also require that the transformation leaves remaining terms that are analytic. The terms "normal" and "tangential" are used herein with reference to the source element. Also, since computational formulations often involve the numerical evaluation of both potentials and their gradients, it is highly desirable that a single integration procedure efficiently handles both.

Fink, Patrick W.↗

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Kalinowski, Kevin F.↗

Evaluation of Radiation Belt Space Weather Forecasts for Internal Charging Analyses

A variety of static electron radiation belt models, space weather prediction tools, and energetic electron datasets are used by spacecraft designers and operations support personnel as internal charging code inputs to evaluate electrostatic discharge risks in space systems due to exposure to relativistic electron environments. Evaluating the environment inputs is often accomplished by comparing whether the data set or forecast tool reliability predicts measured electron flux (or fluence over a given period) for some chosen period. While this technique is useful as a model metric, it does not provide the information necessary to evaluate whether short term deviances of the predicted flux is important in the charging evaluations. In this paper, we use a 1-D internal charging model to compute electric fields generated in insulating materials as a function of time when exposed to relativistic electrons in the Earth's magnetosphere. The resulting fields are assumed to represent the "true" electric fields and are compared with electric field values computed from relativistic electron environments derived from a variety of space environment and forecast tools. Deviances in predicted fields compared to the "true" fields which depend on insulator charging time constants will be evaluated as a potential metric for determining the importance of predicted and measured relativistic electron flux deviations over a range of time scales.

Minow, Joseph I.↗

Evaluation of Long-Term Cloud-Resolving Model Simulations Using Satellite Radiance Observations and Multi-Frequency Satellite Simulators

This paper proposes a methodology known as the Tropical Rainfall Measuring Mission (TRMM) Triple-Sensor Three-step Evaluation Framework (T3EF) for the systematic evaluation of precipitating cloud types and microphysics in a cloud-resolving model (CRM). T3EF utilizes multi-frequency satellite simulators and novel statistics of multi-frequency radiance and backscattering signals observed from the TRMM satellite. Specifically, T3EF compares CRM and satellite observations in the form of combined probability distributions of precipitation radar (PR) reflectivity, polarization-corrected microwave brightness temperature (Tb), and infrared Tb to evaluate the candidate CRM. T3EF is used to evaluate the Goddard Cumulus Ensemble (GCE) model for cases involving the South China Sea Monsoon Experiment (SCSMEX) and Kwajalein Experiment (KWAJEX). This evaluation reveals that the GCE properly captures the satellite-measured frequencies of different precipitating cloud types in the SCSMEX case but underestimates the frequencies of deep convective and deep stratiform types in the KWAJEX case. Moreover, the GCE tends to simulate excessively large and abundant frozen condensates in deep convective clouds as inferred from the overestimated GCE-simulated radar reflectivities and microwave Tb depressions. Unveiling the detailed errors in the GCE s performance provides the best direction for model improvements.

Matsui, Toshihisa↗

TurboTech Technical Evaluation Automated System

TurboTech software is a Web-based process that simplifies and semiautomates technical evaluation of NASA proposals for Contracting Officer's Technical Representatives (COTRs). At the time of this reporting, there have been no set standards or systems for training new COTRs in technical evaluations. This new process provides boilerplate text in response to interview style questions. This text is collected into a Microsoft Word document that can then be further edited to conform to specific cases. By providing technical language and a structured format, TurboTech allows the COTRs to concentrate more on the actual evaluation, and less on deciding what language would be most appropriate. Since the actual word choice is one of the more time-consuming parts of a COTRs job, this process should allow for an increase in quantity of proposals evaluated. TurboTech is applicable to composing technical evaluations of contractor proposals, task and delivery orders, change order modifications, requests for proposals, new work modifications, task assignments, as well as any changes to existing contracts.

Tiffany, Dorothy J.↗

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗

VIIRS Product Evaluation at the Ocean PEATE

The National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) mission will support the continuation of climate records generated from NASA missions. The NASA Science Data Segment (SDS) relies upon discipline-specific centers of expertise to evaluate the NPP data products for suitability as climate data records, The Ocean Product Evaluation and Analysis Tool Element (PEATE) will build upon Well established NASA capabilities within the Ocean Color program in order to evaluate the NPP Visible and Infrared Imager/Radiometer Suite (VIIRS) Ocean Color and Chlorophyll data products. The specific evaluation methods will support not only the evaluation of product quality but also the sources of differences with existing data records.

Patt, Frederick S.↗

Operational Concept Evaluation of Solid Oxide Fuel Cells for Space Vehicle Applications

With the end of the Space Shuttle Program, NASA is evaluating many different technologies to support future missions. Green propellants, like liquid methane and liquid oxygen, have potential advantages for some applications. A Lander propelled with LOX/methane engines is one such application. When the total vehicle design and infrastructure are considered, the advantages of the integration of propulsion, heat rejection, life support and power generation become attractive for further evaluation. Scavenged residual propellants from the propulsion tanks could be used to generate needed electric power, heat and water with a Solid Oxide Fuel Cell(SOFC). In-Situ Resource Utilization(ISRU) technologies may also generate quantities of green propellants to refill these tanks and/or supply these fuel cells. Technology demonstration projects such as the Morpheus Lander are currently underway to evaluate the practicality of such designs and operational concepts. Tethered tests are currently in progress on this vertical test bed to evaluate the propulsion and avionics systems. Evaluation of the SOFC seeks to determine the feasibility of using these green propellants to supply power and identify the limits to the integration of this technology into a space vehicle prototype.

Poast, Kenneth I.↗

Evaluation of the VIIRS Land Algorithms at Land PEATE

The Land Product Evaluation and Algorithm Testing Element (Land PEATE), a component of the Science Data Segment of the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP), is being developed at the NASA Goddard Space Flight Center (GSFC). The primary task of the Land PEATE is to assess the quality of the Visible Infrared Imaging Radiometer Suite (VIIRS) Land data products made by the Interface Data Processing System (IDPS) using the Operational (OPS) Code during the NPP era and to recommend improvements to the algorithms in the IDPS OPS code. The Land PEATE uses a version of the MODIS Adaptive Processing System (MODAPS), NPPDAPS, that has been modified to produce products from the IDPS OPS code and software provided by the VIIRS Science Team, and uses the MODIS Land Data Operational Product Evaluation (LDOPE) team for evaluation of the data records generated by the NPPDAPS. Land PEATE evaluates the algorithms by comparing data products generated using different versions of the algorithm and also by comparing to heritage products generated from different instrument such as MODIS using various quality assessment tools developed at LDOPE. This paper describes the Land PEATE system and some of the approaches used by the Land PEATE for evaluating the VIIRS Land algorithms during the pre-launch period of the NPP mission and the proposed plan for long term monitoring of the quality of the VIIRS Land products post-launch.

Wolfe, Robert E.↗

Voluntary Consensus Organization Standards for Nondestructive Evaluation of Thin-Walled Metallic Liners and Composite Overwraps in Composite Overwrapped Pressure Vessels

NASA fracture control requirements outlined in NASA-STD-5009 and NASA-STD-5014 are predicated on the availability and use of sensitive nondestructive evaluation (NDE) methods that can detect and monitor defects, thereby providing data that can be used to predict failure or reduce the risk of failure in fracture critical components. However, in the case of composite materials and components, including composite overwrapped pressure vessels (COPVs), the effect of defects is poorly understood, the NDE methods used to evaluate locate and size defects are typically at lower technical readiness level than analogous NDE methods used for metals, and demonstration studies to verify the probability of detection (POD) are generally lacking or unavailable. These factors together make failure prediction of fracture critical composite materials and components based on size, quantity, or orientation of defects nearly impossible. Also, when inspecting metal liners in as-manufactured COPVs, sensitivity is lost and only the inner surface of the liner is accessible. Also, NDE of COPVs as applied during manufacturing varies significantly from manufacturer to manufacturer and has not yet been standardized. Although requirements exist to perform NDE immediately after manufacturing to establish initial integrity of the parts, procedural detail for NDE of composites is still nonexistent or under development. For example, in practice, only a visual inspection of COPVs is performed during manufacturing and service, leaving in question whether defects of concern, for example, bridging, overwrap winding anomalies, impact damage below visible threshold, out-of-family strain growth, and liner buckling have been adequately detected and monitored. To address these shortcomings, in 2005 the NASA Nondestructive Evaluation Working Group (NNWG) began funding work to develop and adopt standards for nondestructive evaluation of aerospace composites in collaboration with the American Society for Testing and Materials (ASTM) Committee E07 on Nondestructive Testing. Similarly, in 2006 the NASA Engineering and Safety Center (NESC) recommended that nondestructive evaluation methods that can predict composite failure in COPVs should be developed and verified, and integrated into the damage control plan for these vessels

Waller, Jess↗

SRT Evaluation of AIRS Version-6.02 and Version-6.02 AIRS Only (6.02 AO) Products

Version-6 contains a number of significant improvements over Version-5. This report compares Version-6 products resulting from the advances listed below to those from Version-5. 1. Improved methodology to determine skin temperature (T(sub s)) and spectral emissivity (Epsilon(sub v)). 2. Use of Neural-net start-up state. 3. Improvements which decrease the spurious negative Version-5 trend in tropospheric temperatures. 4. Improved QC methodology. Version-6 uses separate QC thresholds optimized for Data Assimilation (QC=0) and Climate applications (QC=0,1) respectively. 5. Channel-by-channel clear-column radiances R-hat(sub tau) QC flags. 6. Improved cloud parameter retrieval algorithm. 7. Improved OLR RTA. Our evaluation compared V6.02 and V6.02 AIRS Only (V6.02 AO) Quality Controlled products with those of Version-5.0. In particular we evaluated surface skin temperature T(sub s), surface spectral emissivity Epsilon(sub v), temperature profile T(p), water vapor profile q(p), OLR, OLR(sub CLR), effective cloud fraction alpha-Epsilon, and cloud cleared radiances R-hat(sub tau) . We conducted two types of evaluations. The first compared results on 7 focus days to collocated ECMWF truth. The seven focus days are: September 6, 2002; January 25, 2003; September 29, 2004; August 5, 2005; February 24, 2007; August 10, 2007; and May 30, 2010. In these evaluations, we show results for T(sub s), Epsilon(sub v), T(p), and q(p) in terms of yields, and RMS differences and biases with regard to ECMWF. We also show yield trends as well as bias trends of these quantities relative to ECMWF truth. We also show yields and accuracy of channel by channel QC d values of R-hat(sub tau) for V6.02 and V6.02 AO. Version-5 did not contain channel by channel QC d values of R-hat(sub tau). In the second type of evaluation, we compared V6.03 monthly mean Level-3 products to those of Version-5.0, for four different months: January, April, July, and October; in 3 different years 2003, 2007, and 2011. In particular, we compared V6.03 and V5.0 trends of T(p), q(p), alpha-Epsilon, OLR, and OLR(sub CLR) computed based on results for these 12 time periods

Susskind, Joel↗

Evaluation of Algorithms for a Miles-in-Trail Decision Support Tool

Four machine learning algorithms were prototyped and evaluated for use in a proposed decision support tool that would assist air traffic managers as they set Miles-in-Trail restrictions. The tool would display probabilities that each possible Miles-in-Trail value should be used in a given situation. The algorithms were evaluated with an expected Miles-in-Trail cost that assumes traffic managers set restrictions based on the tool-suggested probabilities. Basic Support Vector Machine, random forest, and decision tree algorithms were evaluated, as was a softmax regression algorithm that was modified to explicitly reduce the expected Miles-in-Trail cost. The algorithms were evaluated with data from the summer of 2011 for air traffic flows bound to the Newark Liberty International Airport (EWR) over the ARD, PENNS, and SHAFF fixes. The algorithms were provided with 18 input features that describe the weather at EWR, the runway configuration at EWR, the scheduled traffic demand at EWR and the fixes, and other traffic management initiatives in place at EWR. Features describing other traffic management initiatives at EWR and the weather at EWR achieved relatively high information gain scores, indicating that they are the most useful for estimating Miles-in-Trail. In spite of a high variance or over-fitting problem, the decision tree algorithm achieved the lowest expected Miles-in-Trail costs when the algorithms were evaluated using 10-fold cross validation with the summer 2011 data for these air traffic flows.

Bloem, Michael↗

Evaluation of Underwater Adhesives and Friction Coatings for In Situ Attachment of Fiber Optic Sensor System for Subsea Applications

Integrity and performance monitoring of subsea pipelines and structures provides critical information for managing offshore oil and gas production operation and preventing environmentally damaging and costly catastrophic failure. Currently pipeline monitoring devices require ground assembly and installation prior to the underwater deployment of the pipeline. A monitoring device that could be installed in situ on the operating underwater structures could enhance the productivity and improve the safety of current offshore operation. Through a Space Act Agreement (SAA) between the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) and Astro Technology, Inc. (ATI), JSC provides technical expertise and testing facilities to support the development of fiber optic sensor technologies by ATI. This paper details the first collaboration effort between NASA JSC and ATI in evaluating underwater applicable adhesives and friction coatings for attaching fiber optic sensor system to subsea pipeline. A market survey was conducted to examine different commercial ]off ]the ]shelf (COTS) underwater adhesive systems and to select adhesive candidates for testing and evaluation. Four COTS epoxy based underwater adhesives were selected and evaluated. The adhesives were applied and cured in simulated seawater conditions and then evaluated for application characteristics and adhesive strength. The adhesive that demonstrated the best underwater application characteristics and highest adhesive strength were identified for further evaluation in developing an attachment system that could be deployed in the harsh subsea environment. Various friction coatings were also tested in this study to measure their shear strengths for a mechanical clamping design concept for attaching fiber optic sensor system. A COTS carbide alloy coating was found to increase the shear strength of metal to metal clamping interface by up to 46 percent. This study provides valuable data for assessing the feasibility of developing the next generation fiber optic senor system that could be retrofitted onto existing subsea pipeline structures.

Tang, Henry H.↗

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

pilot human performance models↗

Stress Corrosion Evaluation of Nitinol 60 for the International Space Station Water Recycling System

A stress corrosion cracking (SCC) evaluation of Nitinol 60 was performed because this alloy is considered a candidate bearing material for the Environmental Control and Life Support System (ECLSS), specifically in the Urine Processing Assembly of the International Space Station. An SCC evaluation that preceded this one during the 2013-2014 timeframe included various alloys: Inconel 625, Hastelloy C-276, titanium (Ti) commercially pure (CP), Ti 6Al-4V, extra-low interstitial (ELI) Ti 6Al-4V, and Cronidur 30. In that evaluation, most specimens were exposed for a year. The results of that evaluation were published in NASA/TM-2015-218206, entitled "Stress Corrosion Evaluation of Various Metallic Materials for the International Space Station Water Recycling System,"1 available at the NASA Scientific and Technical Information program web page: http://www.sti.nasa.gov. Nitinol 60 was added to the test program in 2014.

Torres, P. D.↗

Combustion Stability Evaluation of Artificial Disturbance Dynamic Response

General guidelines are provided in CPIA Publication 6551 for evaluation of the response due to an artificial disturbance, however the guideline also allows for ambiguous interpretation. Stability rating devices that produce an artificial disturbance are traditionally explosive bombs and pulse guns. This paper reviews a recently developed objective process that can be applied consistently in the reduction of artificial disturbance dynamic data. It also examines three methods of response evaluation. The first method examines the response of a specific mode of interest and requires data filtering encompassing that mode. The second method examines the response of a specific mode of interest and its nonlinear components and requires a more complex filtering scheme. The third method examines the response of the entire dynamic system and consists of examining a wide bandwidth consisting of multiple modes of interest. The evaluation process is described and the advantages and disadvantages of the evaluation methods are discussed. Signal processing is used as a tool in quantifying the assessment, clearly as an improvement from the subjective heritage approach consisting primarily of engineering judgement. Data for several engines and components have been compiled and evaluated using these methods. A summary of these combustion devices is provided and observations are discussed.

Casiano, M. J.↗

CNS Simulation Tool Development for Increasingly Complex Airspace Operation Evaluation

As unmanned aircraft operations continue to grow and new vehicles such as air taxi, supersonic aircraft and high-altitude long endurance aircraft seek access to the airspace, it is anticipated that National Airspace System (NAS) operations will increase in density and complexity. To manage the influx, demand and safe integration of these new aircraft and missions into the NAS, a careful evaluation of existing and new operational concepts, vehicle characteristics and technology performance is required. Communications, Navigation and Surveillance (CNS) technologies operating in the NAS have evolved to meet changing needs of the Air Traffic Control System and the vehicles operating in the airspace. Today's CNS systems have been architected to deliver critical services to a carefully designed airspace configuration and to serve airborne vehicles equipped with standardized systems that enable global air navigation. The introduction of new vehicles is projected to expand NAS operations beyond today's configuration to include a new breed of aircraft operating from non-conventional aerodromes, resulting in a mix of vehicles operating in the same airspace. To enable this expansion, it is anticipated that modeling and simulation will play an important role in the evaluation of new management concept of operations.In this regard, NASA is developing simulation capabilities that will enable the evaluation of new concepts of operation and CNS technology performance in an increasingly dense, high-tempo operational environment. The NASA Glenn Research Center is working on the development of CNS simulation capabilities intended to support the integrated evaluation of operational concepts and emerging technologies. This presentation describes simulation capability development efforts that, together with other simulation tools, will enable evaluation of new concepts and technologies for the integration of new vehicles and services into the NAS. [Also discussed: NASA Shadow Mode Assessment using Realistic Technologies for the National Airspace System (SMART NAS)]

Surveillance↗

Best Practices for Evaluating Flight Deck Interfaces for Transport Category Aircraft with Particular Relevance to Issues of Attention, Awareness, and Understanding CAST SE-210 Output 2 Report 6 of 6

Attention, awareness, and understanding of the flight crew are a critical contributor to safety and the flight deck plays a critical role in supporting these cognitive functions. Changes to the flight deck need to be evaluated for whether the changed device provides adequate support for these functions. This report describes a set of diverse evaluation methods. The report recommends designing the interface-evaluation to span the phases of the device development, from early to late, and it provides methods appropriate at each phase. It describes the various ways in which an interface or interface component can fail to support awareness as potential issues to be assessed in evaluation. It summarizes appropriate methods to evaluate different issues concerning inadequate support for these functions, throughout the phases of development.

Billman, Dorrit O.↗