Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

The Evaluation of High Temperature Adhesive Bonding Processes for Rocket Engine Combustion Chamber Applications

NASA Glenn Research Center is currently evaluating the possibility of using high- temperature polymer matrix composites to reinforce the combustion chamber of a rocket engine. One potential design utilizes a honeycomb structure composed of a PMR-II- 50/M40J 4HS composite facesheet and titanium honeycomb core to reinforce a stainless steel shell. In order to properly fabricate this structure, adhesive bond PMR-II-50 composite. Proper prebond surface preparation is critical in order to obtain an acceptable adhesive bond. Improperly treated surfaces will exhibit decreased bond strength and durability, especially in metallic bonds where interface are susceptible to degradation due to heat and moisture. Most treatments for titanium and stainless steel alloys require the use of strong chemicals to etch and clean the surface. This processes are difficult to perform due to limited processing facilities as well as safety and environmental risks and they do not consistently yield optimum bond durability. Boeing Phantom Works previously developed sol-gel surface preparations for titanium alloys using a PETI-5 based polyimide adhesive. In support of part of NASA Glenn Research Center, UDRI and Boeing Phantom Works evaluated variations of this high temperature sol-gel surface preparation, primer type, and primer cure conditions on the adhesion performance of titanium and stainless steel using Cytec FM 680-1 polyimide adhesive. It was also found that a modified cure cycle of the FM 680-1 adhesive, i.e., 4 hrs at 370 F in vacuum + post cure, significantly increased the adhesion strength compared to the manufacturer's suggested cure cycle. In addition, the surface preparation of the PMR-II-50 composite was evaluated in terms of surface cleanness and roughness. This presentation will discuss the results of strength and durability testing conducted on titanium, stainless steel, and PMR-II-50 composite adherends to evaluate possible bonding processes.

McCray, Daniel↗
NASA NTRS2004

The Processing of Airspace Concept Evaluations Using FASTE-CNS as a Pre- or Post-Simulation CNS Analysis Tool

As NASA speculates on and explores the future of aviation, the technological and physical aspects of our environment increasing become hurdles that must be overcome for success. Research into methods for overcoming some of these selected hurdles have been purposed by several NASA research partners as concepts. The task of establishing a common evaluation environment was placed on NASA's Virtual Airspace Simulation Technologies (VAST) project (sub-project of VAMS), and they responded with the development of the Airspace Concept Evaluation System (ACES). As one examines the ACES environment from a communication, navigation or surveillance (CNS) perspective, the simulation parameters are built with assumed perfection in the transactions associated with CNS. To truly evaluate these concepts in a realistic sense, the contributions/effects of CNS must be part of the ACES. NASA Glenn Research Center (GRC) has supported the Virtual Airspace Modeling and Simulation (VAMS) project through the continued development of CNS models and analysis capabilities which supports the ACES environment. NASA GRC initiated the development a communications traffic loading analysis tool, called the Future Aeronautical Sub-network Traffic Emulator for Communications, Navigation and Surveillance (FASTE-CNS), as part of this support. This tool allows for forecasting of communications load with the understanding that, there is no single, common source for loading models used to evaluate the existing and planned communications channels; and that, consensus and accuracy in the traffic load models is a very important input to the decisions being made on the acceptability of communication techniques used to fulfill the aeronautical requirements. Leveraging off the existing capabilities of the FASTE-CNS tool, GRC has called for FASTE-CNS to have the functionality to pre- and post-process the simulation runs of ACES to report on instances when traffic density, frequency congestion or aircraft spacing/distance violations have occurred. The integration of these functions require that the CNS models used to characterize these avionic system be of higher fidelity and better consistency then is present in FASTE-CNS system. This presentation will explore the capabilities of FASTE-CNS with renewed emphasis on the enhancements being added to perform these processing functions; the fidelity and reliability of CNS models necessary to make the enhancements work; and the benchmarking of FASTE-CNS results to improve confidence for the results of the new processing capabilities.

Mainger, Steve↗
NASA NTRS1996

Ergonomic Evaluations of Microgravity Workstations

Various gloveboxes (GBXs) have been used aboard the Shuttle and ISS. Though the overall technical specifications are similar, each GBX's crew interface is unique. JSC conducted a series of ergonomic evaluations of the various glovebox designs to identify human factors requirements for new designs to provide operator commonality across different designs. We conducted 2 0g evaluations aboard the Shuttle to evaluate the material sciences GBX and the General Purpose Workstation (GPWS), and a KC-135 evaluation to compare combinations of arm hole interfaces and foot restraints (flexible arm holes were better than rigid ports for repetitive fine manipulation tasks). Posture analysis revealed that the smallest and tallest subjects assumed similar postures at all four configurations, suggesting that problematic postures are not necessarily a function of the operator s height but a function of the task characteristics. There was concern that the subjects were using the restrictive nature of the GBX s cuffs as an upper-body restraint to achieve such high forces, which might lead to neck/shoulder discomfort. EMG data revealed more consistent muscle performance at the GBX; the variability in the EMG profiles observed at the GPWS was attributed to the subjects attempts to provide more stabilization for themselves in the loose, flexible gauntlets. Tests revealed that the GBX should be designed for a 95 percentile American male to accommodate a neutral working posture. In addition, the foot restraint with knee support appeared beneficial for GBX operations. Crew comments were to provide 2 foot restraint mechanical modes, loose and lock-down, to accommodate a wide range of tasks without egressing the restraint system. Thus far, we have developed preliminary design guidelines for GBXs and foot.

Whitmore, Mihriban↗
NASA NTRS2005

Advanced Pathway Guidance Evaluations on a Synthetic Vision Head-Up Display

NASA's Synthetic Vision Systems (SVS) project is developing technologies with practical applications to potentially eliminate low visibility conditions as a causal factor to civil aircraft accidents while replicating the operational benefits of clear day flight operations, regardless of the actual outside visibility condition. A major thrust of the SVS project involves the development/demonstration of affordable, certifiable display configurations that provide intuitive out-the-window terrain and obstacle information with advanced guidance for commercial and business aircraft. This experiment evaluated the influence of different pathway and guidance display concepts upon pilot situation awareness (SA), mental workload, and flight path tracking performance for Synthetic Vision display concepts using a Head-Up Display (HUD). Two pathway formats (dynamic and minimal tunnel presentations) were evaluated against a baseline condition (no tunnel) during simulated instrument meteorological conditions approaches to Reno-Tahoe International airport. Two guidance cues (tadpole, follow-me aircraft) were also evaluated to assess their influence. Results indicated that the presence of a tunnel on an SVS HUD had no effect on flight path performance but that it did have significant effects on pilot SA and mental workload. The dynamic tunnel concept with the follow-me aircraft guidance symbol produced the lowest workload and provided the highest SA among the tunnel concepts evaluated.

Kramer, Lynda J.↗
NASA NTRS2003

Three-Dimensional Magnetic Analysis Technique Developed for Evaluating Stirling Convertor Linear Alternators

The Department of Energy, the Stirling Technology Company (STC), and the NASA Glenn Research Center are developing Stirling convertors for Stirling radioisotope generators to provide electrical power for future NASA deep space missions. STC is developing the 55-We technology demonstration convertor (TDC) under contract to the Department of Energy. The Department of Energy recently named Lockheed Martin as the system integration contractor for the Stirling radioisotope generator development project. Lockheed Martin will develop the Stirling radioisotope generator engineering unit and has contract options to develop the qualification unit and the first flight unit. Glenn s role includes an in-house project to provide convertor, component, and materials testing and evaluation in support of the overall power system development. As a part of this work, Glenn has established an in-house Stirling research laboratory for testing, analyzing, and evaluating Stirling machines. STC has built four 55-We convertors for NASA, and these are being tested at Glenn. A cross-sectional view of the 55-We TDC is shown in the figure. Of critical importance to the successful development of the Stirling convertor for space power applications is the development of a lightweight and highly efficient linear alternator. In support, Glenn has been developing finite element analysis and finite element method tools for performing various linear alternator thermal and electromagnetic analyses and evaluating design configurations. A three-dimensional magnetostatic finite element model of STC's 55-We TDC linear alternator was developed to evaluate the demagnetization fields affecting the alternator magnets. Since the actual linear alternator hardware is symmetric to the quarter section about the axis of motion, only a quarter section of the alternator was modeled. The components modeled included the mover laminations, the neodymium-iron-boron magnets, the stator laminations, and the copper coils. The three-dimensional magnetostatic model was then coupled with a circuit simulator model of the alternator load and convertor controller. The coupled model was then used to generate alternator terminal voltage and current predictions. The predicted voltage and current waveforms agreed well with the experimental data, which tended to validate the accuracy of the coupled model. The model was then used to generate predictions of the demagnetization fields acting on the alternator magnets for the alternator under load. The preliminary model predictions indicate that the highest potential for demagnetization is along the inside surface of the uncovered magnets. The demagnetization field for the uncovered magnets when the mover is positioned at the end of a stroke is higher than it is when the mover is at the position of maximum induced voltage or maximum alternator current. Assuming normal load conditions, the model predicted that the onset of demagnetization is most likely to occur for magnet temperatures above 101 C.

Geng, Steven M.↗
NASA NTRSDate not supplied

Nondestructive Evaluation for the Space Shuttle's Wing Leading Edge

The loss of the Space Shuttle Columbia highlighted concerns about the integrity of the Shuttle's thermal protection system, which includes Reinforced Carbon-Carbon (RCC) on the leading edge. This led NASA to investigate nondestructive evaluation (NDE) methods for certifying the integrity of the Shuttle's wing leading edge. That investigation was performed simultaneously with a large study conducted to understand the impact damage caused by errant debris. Among the many advanced NDE methods investigated for applicability to the RCC material, advanced digital radiography, high resolution computed tomography, thermography, ultrasound, acoustic emission and eddy current systems have demonstrated the maturity and success for application to the Shuttle RCC panels. For the purposes of evaluating the RCC panels while they are installed on the orbiters, thermographic detection incorporating principal component analysis (PCA) and eddy current array scanning systems demonstrated the ability to measure the RCC panels from one side only and to detect several flaw types of concern. These systems were field tested at Kennedy Space Center (KSC) and at several locations where impact testing was being conducted. Another advanced method that NASA has been investigating is an automated acoustic based detection system. Such a system would be based in part on methods developed over the years for acoustic emission testing. Impact sensing has been demonstrated through numerous impact tests on both reinforced carbon-carbon (RCC) leading edge materials as well as Shuttle tile materials on representative aluminum wing structures. A variety of impact materials and conditions have been evaluated including foam, ice, and ablator materials at ascent velocities as well as simulated hypervelocity micrometeoroid and orbital debris impacts. These tests have successfully demonstrated the capability to detect and localize impact events on Shuttle's wing structures. A first generation impact sensing system has been designed for the next Shuttle flight and is undergoing final evaluation for deployment on the Shuttle's first return to flight. This system will employ wireless accelerometer sensors that were qualified for other applications on previous Shuttle flights. These sensors will be deployed on the wing's leading edge to detect impacts on the RCC leading edge panels. The application of these methods will help to insure the continued integrity of the Shuttle wing's leading edge system as the Shuttle flights resume and until their retirement.

Eric I Madaras↗
NASA NTRS2005

Evaluation of Life Sciences Glovebox (LSG) and Multi-Purpose Crew Restraint Concepts

Within the scope of the Multi-purpose Crew Restraints for Long Duration Spaceflights project, funded by Code U, it was proposed to conduct a series of evaluations on the ground and on the KC-135 to investigate the human factors issues concerning confined/unique workstations, such as the design of crew restraints. The usability of multiple crew restraints was evaluated for use with the Life Sciences Glovebox (LSG) and for performing general purpose tasks. The purpose of the KC-135 microgravity evaluation was to: (1) to investigate the usability and effectiveness of the concepts developed, (2) to gather recommendations for further development of the concepts, and (3) to verify the validity of the existing requirements. Some designs had already been tested during a March KC-135 evaluation, and testing revealed the need for modifications/enhancements. This flight was designed to test the new iterations, as well as some new concepts. This flight also involved higher fidelity tasks in the LSG, and the addition of load cells on the gloveports.

Whitmore, Mihriban↗
NASA NTRS2005

A Probabilistic Software System Attribute Acceptance Paradigm for COTS Software Evaluation

Standard software requirement formats are written from top-down perspectives only, that is, from an ideal notion of a client s needs. Despite the exactness of the standard format, software and system errors in designed systems have abounded. Bad and inadequate requirements have resulted in cost overruns, schedule slips and lost profitability. Commercial off-the-shelf (COTS) software components are even more troublesome than designed systems because they are often provided as is and subsequently delivered with unsubstantiated validation of described capabilities. For COTS software, there needs to be a way to express the client s software needs in a consistent and formal manner using software system attributes derived from software quality standards. Additionally, the format needs to be amenable to software evaluation processes that integrate observable evidence garnered from historical data. This paper presents a paradigm that effectively bridges the gap between what a client desires (top-down) and what has been demonstrated (bottom-up) for COTS software evaluation. The paradigm addresses the specification of needs before the software evaluation is performed and can be used to increase the shared understanding between clients and software evaluators about what is required and what is technically possible.

Morris, A. Terry↗
NASA NTRS2005

Distributed Evaluation Functions for Fault Tolerant Multi-Rover Systems

The ability to evolve fault tolerant control strategies for large collections of agents is critical to the successful application of evolutionary strategies to domains where failures are common. Furthermore, while evolutionary algorithms have been highly successful in discovering single-agent control strategies, extending such algorithms to multiagent domains has proven to be difficult. In this paper we present a method for shaping evaluation functions for agents that provide control strategies that both are tolerant to different types of failures and lead to coordinated behavior in a multi-agent setting. This method neither relies of a centralized strategy (susceptible to single point of failures) nor a distributed strategy where each agent uses a system wide evaluation function (severe credit assignment problem). In a multi-rover problem, we show that agents using our agent-specific evaluation perform up to 500% better than agents using the system evaluation. In addition we show that agents are still able to maintain a high level of performance when up to 60% of the agents fail due to actuator, communication or controller faults.

Agogino, Adrian↗
NASA NTRS2007

Evaluation of Hands-Free Devices for the Display of Maintenance Procedures

Over the past year, NASA's focus has turned to crewed long duration and exploration missions. On these journeys, crewmembers will be required to execute thousands of procedures to maintain life support systems, check out space suits, conduct science experiments, and perform medical exams. To support the many complex tasks crewmembers undertake in microgravity, NASA is interested in providing crewmembers a hands-free work environment to promote more efficient operations. The overarching objective is to allow crewmembers to use both of their hands for tasks related to their mission, versus holding a paper manual or interacting with a display. The use of advanced, hands-free tools will undoubtedly make the crewmembers task easier, but they can also add to overall task complexity if not properly designed. A leading candidate technology for supporting a hands-free environment is the Head-Mounted Display (HMD). A more recent technology (e-book reader) that could be easily temp-stowed near the work area is also a potential hands-free solution. Previous work at NASA involved the evaluation of several commercially available HMDs for visual quality, comfort, and fit, as well as suitability for use in microgravity. Based on results from this work, three HMDs were selected for further evaluation (along with an e-book reader), using International Space Station (ISS)-like maintenance procedures. Two evaluations were conducted in the Space Station Mockup and Trainer Facility (SSMTF) located at the NASA Johnson Space Center (building 9). The SSMTF is a full scale, medium fidelity replica of the pressurized portions of the ISS. It supports crew training such as ingress and egress, habitability, and emergency procedures. In each of the two evaluations, the participants performed two maintenance procedures. One maintenance procedure involved inspecting air filters in a life support system and replacing them with a clean filter if one were found to be contaminated. The second maintenance procedure focused on working in a confined space; specifically, pulling down a rack to inspect wiring configurations, and rewiring in a different pattern. The maintenance procedures were selected to assess mobility, tool use, and access to multiple document sources during task performance. That is, the participant had to move from rack to rack, use a wrench, a camera, etc., replace components, and refer to diagrams to complete tasks. A constraint was imposed that the ISS-like format of the procedures was to be retained, and not modified or optimized for the electronic device ("plug and play" approach). This was based on future plans to test with real procedures on ISS.

Ronald B Hoffman↗
NASA NTRS2007

Evaluation of the MOCAGE Chemistry Transport Model during the ICARTT/ITOP Experiment

We evaluate the Meteo-France global chemistry transport 3D model MOCAGE (MOdele de Chimie Atmospherique a Grande Echelle) using the important set of aircraft measurements collected during the ICARRT/ITOP experiment. This experiment took place between US and Europe during summer 2004 (July 15-August 15). Four aircraft were involved in this experiment providing a wealth of chemical data in a large area including the North East of US and western Europe. The model outputs are compared to the following species of which concentration is measured by the aircraft: OH, H2O2, CO, NO, NO2, PAN, HNO3, isoprene, ethane, HCHO and O3. Moreover, to complete this evaluation at larger scale, we used also satellite data such as SCIAMACHY NO2 and MOPITT CO. Interestingly, the comprehensive dataset allowed us to evaluate separately the model representation of emissions, transport and chemical processes. Using a daily emission source of biomass burning, we obtain a very good agreement for CO while the evaluation of NO2 points out incertainties resulting from inaccurate ratio of emission factors of NOx/CO. Moreover, the chemical behavior of O3 is satisfactory as discussed in the paper.

Bousserez, N.↗
NASA NTRS2006

Process evaluation distributed system

The distributed system includes a database server, an administration module, a process evaluation module, and a data display module. The administration module is in communication with the database server for providing observation criteria information to the database server. The process evaluation module is in communication with the database server for obtaining the observation criteria information from the database server and collecting process data based on the observation criteria information. The process evaluation module utilizes a personal digital assistant (PDA). A data display module in communication with the database server, including a website for viewing collected process data in a desired metrics form, the data display module also for providing desired editing and modification of the collected process data. The connectivity established by the database server to the administration module, the process evaluation module, and the data display module, minimizes the requirement for manual input of the collected process data.

Moffatt, Christopher L.↗
NASA NTRS2008

Early Impacts of a Human-in-the-Loop Evaluation in a Space Vehicle Mock-up Facility

The development of a new space vehicle, the Orion Crew Exploration Vehicle (CEV), provides Human Factors engineers an excellent opportunity to have an impact early in the design process. This case study highlights a Human-in-the-Loop (HITL) evaluation conducted in a Space Vehicle Mock-Up Facility and will describe the human-centered approach and how the findings are impacting design and operational concepts early in space vehicle design. The focus of this HITL evaluation centered on the activities that astronaut crewmembers would be expected to perform within the functional internal volume of the Crew Module (CM) of the space vehicle. The primary objective was to determine if there are aspects of a baseline vehicle configuration that would limit or prevent the performance of dynamically volume-driving activities (e.g. six crewmembers donning their suits in an evacuation scenario). A second objective was to step through concepts of operations for known systems and evaluate them in integrated scenarios. The functional volume for crewmember activities is closely tied to every aspect of system design (e.g. avionics, safety, stowage, seats, suits, and structural support placement). As this evaluation took place before the Preliminary Design Review of the space vehicle with some designs very early in the development, it was not meant to determine definitely that the crewmembers could complete every activity, but rather to provide inputs that could improve developing designs and concepts of operations definition refinement.

Byrne, Vicky↗
NASA NTRS2008

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗
NASA NTRS2009

Evaluation of Low Altitude Cloud Amount Using CALIPSO Observations

Clouds strongly modulate the transfer of solar and thermal radiation within the atmosphere. Changes in the distribution and properties of clouds in a changing climate represent climate feedbacks affecting climate sensitivity, but the predicted responses of clouds from current climate models are inconsistent. Of particular concern is the response of low clouds, and it is recognized that proper representation of low clouds in global models is in need of improvement. Accurate satellite cloud climatologies are necessary to evaluate model performance, but existing climatologies require validation and are inadequate in some respects for model evaluation. CALIPSO and CloudSat have been acquiring high vertical resolution cloud profiles since launch in 2006. These global cloud datasets represent a new tool for evaluation of both models and existing satellite climatologies. While a recently available merged CALIPSO-CloudSat cloud climatology provides the most comprehensive view of global 3-D cloud distribution, the CALIPSO dataset set on its own has several unique characteristics, including profiles of the atmospheric boundary layer with 30 meter vertical resolution. In this paper we investigate the use of CALIPSO data to characterize boundary layer clouds, looking toward the development of a reliable global dataset suitable for evaluation of model performance.

Winker, Dave↗
NASA NTRS2010

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

Benbenek, Daniel↗
NASA NTRS2010

The MODIS Aerosol Algorithm: Critical Evaluation and Plans for Collection 6

For ten years the MODIS aerosol algorithm has been applied to measured MODIS radiances to produce a continuous set of aerosol products, over land and ocean. The MODIS aerosol products are widely used by the scientific and applied science communities for variety of purposes that span operational air quality forecasting in estimates o[ clear-sky direct radiative effects over ocean and aerosol-cloud interactions. The products undergo continual evaluation, including self-consistency checks and comparisons with highly accurate ground-based instruments. The result of these evaluation exercises is a quantitative understanding of the strengths and weaknesses of the retrieval, where and when the products are accurate and the situations where and when accuracy degrades. We intend 10 present results of the most recent critical evaluations including the first comparison of the over ocean products against the shipboard aerosol optical depth measurements of the Marine Aerosol Network (MAN), the demonstration of the lack of sensitivity to size parameter in the over land products and identification of residual problems and regional issues. While the current data set is undergoing evaluation, we are preparing for the next data processing, labeled Collection 6. Collection 6 will include transparent Quality Flags, a 3 km aerosol product and the 500m resolution cloud mask used within the aerosol n:bicvu|. These new products and adjustments to algorithm assumptions should provide users with more options and greater control, as they adapt the product for their own purposes.

Remer, Lorraine↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗