Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

The MODIS Aerosol Algorithm: Critical Evaluation and Plans for Collection 6

For ten years the MODIS aerosol algorithm has been applied to measured MODIS radiances to produce a continuous set of aerosol products, over land and ocean. The MODIS aerosol products are widely used by the scientific and applied science communities for variety of purposes that span operational air quality forecasting in estimates o[ clear-sky direct radiative effects over ocean and aerosol-cloud interactions. The products undergo continual evaluation, including self-consistency checks and comparisons with highly accurate ground-based instruments. The result of these evaluation exercises is a quantitative understanding of the strengths and weaknesses of the retrieval, where and when the products are accurate and the situations where and when accuracy degrades. We intend 10 present results of the most recent critical evaluations including the first comparison of the over ocean products against the shipboard aerosol optical depth measurements of the Marine Aerosol Network (MAN), the demonstration of the lack of sensitivity to size parameter in the over land products and identification of residual problems and regional issues. While the current data set is undergoing evaluation, we are preparing for the next data processing, labeled Collection 6. Collection 6 will include transparent Quality Flags, a 3 km aerosol product and the 500m resolution cloud mask used within the aerosol n:bicvu|. These new products and adjustments to algorithm assumptions should provide users with more options and greater control, as they adapt the product for their own purposes.

Remer, Lorraine↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗
NASA NTRS2010

Application of a Modified Universal Design Survey for Evaluation of Ares 1 Ground Crew Worksites

Operability is a driving requirement for NASA's Ares 1 launch vehicle. Launch site ground operations include several operator tasks to prepare the vehicle for launch or to perform maintenance. Ensuring that components requiring operator interaction at the launch site are designed for optimal human use is a high priority for operability. To support design evaluation, the Ares 1 Upper Stage (US) element Human Factors Engineering (HFE) group developed a survey based on the Universal Design approach. Universal Design is a process to create products that can be used effectively by as many people as possible. Universal Design per se is not a priority for Ares 1 because launch vehicle processing is a specialized skill and not akin to a consumer product that should be used by all people of all abilities. However, applying principles of Universal Design will increase the probability of an error free and efficient design which is a priority for Ares 1. The Design Quality Evaluation Survey centers on the following seven principles: (1) Equitable use, (2) Flexibility in use, (3) Simple and intuitive use, (4) Perceptible information, (5) Tolerance for error, (6) Low physical effort, (7) Size and space for approach and use. Each principle is associated with multiple evaluation criteria which were rated with the degree to which the statement is true. All statements are phrased in the utmost positive, or the design goal so that the degree to which judgments tend toward "completely agree" directly reflects the degree to which the design is good. The Design Quality Evaluation Survey was employed for several US analyses. The tool was found to be most useful for comparative judgments as opposed to an assessment of a single design option. It provided a useful piece of additional data when assessing possible operator interfaces or worksites for operability

Blume, Jennifer L.↗
NASA NTRS2011

SMOS/SMAP Synergy for SMAP Level 2 Soil Moisture Algorithm Evaluation

Soil Moisture Active Passive (SMAP) satellite has been proposed to provide global measurements of soil moisture and land freeze/thaw state at 10 km and 3 km resolutions, respectively. SMAP would also provide a radiometer-only soil moisture product at 40-km spatial resolution. This product and the supporting brightness temperature observations are common to both SMAP and European Space Agency's Soil Moisture and Ocean Salinity (SMOS) mission. As a result, there are opportunities for synergies between the two missions. These include exploiting the data for calibration and validation and establishing longer term L-band brightness temperature and derived soil moisture products. In this investigation we will be using SMOS brightness temperature, ancillary data, and soil moisture products to develop and evaluate a candidate SMAP L2 passive soil moisture retrieval algorithm. This work will begin with evaluations based on the SMOS product grids and ancillary data sets and transition to those that will be used by SMAP. An important step in this analysis is reprocessing the multiple incidence angle observations provided by SMOS to a global brightness temperature product that simulates the constant 40 degree incidence angle observations that SMAP will provide. The reprocessed brightness temperature data provide a basis for evaluating different SMAP algorithm alternatives. Several algorithms are being considered for the SMAP radiometer-only soil moisture retrieval. In this first phase, we utilized only the Single Channel Algorithm (SCA), which is based on the radiative transfer equation and uses the channel that is most sensitive to soil moisture (H-pol). Brightness temperature is corrected sequentially for the effects of temperature, vegetation, roughness (dynamic ancillary data sets) and soil texture (static ancillary data set). European Centre for Medium-Range Weather Forecasts (ECMWF) estimates of soil temperature for the top layer (as provided as part of the SMOS ancillary data) were used to correct for surface temperature effects and to derive microwave emissivity. ECMWF data were also used for precipitation forecasts, presence of snow, and frozen ground. Vegetation options are described below. One year of soil moisture observations from a set of four watersheds in the U.S. were used to evaluate four different retrieval methodologies: (1) SMOS soil moisture estimates (version 400), (2) SeA soil moisture estimates using the SMOS/SMAP data with SMOS estimated vegetation optical depth, which is part of the SMOS level 2 product, (3) SeA soil moisture estimates using the SMOS/SMAP data and the MODIS-based vegetation climatology data, and (4) SeA soil moisture estimates using the SMOS/SMAP data and actual MODIS observations. The use of SMOS real-world global microwave observations and the analyses described here will help in the development and selection of different land surface parameters and ancillary observations needed for the SMAP soil moisture algorithms. These investigations will greatly improve the quality and reliability of this SMAP product at launch.

Bindlish, Rajat↗
NASA NTRS2011

Operational Evaluation of VEGGIE Food Production System in the Habitat Demonstration Unit

The 2010 Desert Research and Technology Studies (DRATS) of the VEGGIE Food Production System in the Habitat Demonstration Unit (HDU) Pressurized Excursion Module (PEM) was the first operational evaluation of salad crop production technology in a NASA analog test. A systematic evaluation of rooting media and nutrient delivery systems were evaluated for three lettuce cultivars that have shown promise as candidates for a surface based food production system. The VEGGIE nutrient delivery system worked well, was able to be maintained by multiple operators with a minimum of training, and supported excellent lettuce growth for the duration of the test. A Hazard Analysis and Critical Control Point (HACCP) evaluation was performed using ProSan(tm) as sanitation agent prior to consumption was approved, and the crew was allowed to consume the lettuce grown using the VEGGIE light cap and gravity based nutrient delivery system at the completion of the 14-day DRAT field test. The DRAT field test validated the crew operations; Growth of all lettuce cultivars was excellent. The operational DRAT field testing in the HDU identified light quality issues related to morphology and pigment development that will need to be addressed through additional testing. Feedback from the crew, ground support personnel, and human factors leads was uniformly positive on the psychological value of having the crop production system in the excursion module. A number of areas have been identified for future work, to minimize the "footprint" of the Food Production system through creative use of unused wall and floor space in the unit.

Stutte, Gary W.↗
NASA NTRS2011

Operation Evaluation of the VEGGIE Food Production System in the Habitat Demonstration Unit

The 2010 Desert Research and Technology Studies (DRATS) of the VEGGIE Food Production System in the Habitat Demonstration Unit (HDU) Pressurized Excursion Module (PEM) was the first operational evaluation of salad crop production technology in a NASA analog test. A systematic evaluation of rooting media and nutrient delivery systems were evaluated for three lettuce cultivars that have shown promise as candidates for a surface based food production system. The VEGGIE nutrient delivery system worked well, was able to be maintained by multiple operators with a minimum of training, and supported excellent lettuce growth for the duration of the test. A Hazard Analysis and Critical Control Point (HACCP) evaluation was performed using ProSantm as sanitation agent prior to consumption was approved, and the crew was allowed to consume the lettuce grown using the VEGGIE light cap and gravity based nutrient delivery system at the completion of the 14-day DRAT field test. The DRAT field test validated the crew operations; Growth of all lettuce cultivars was excellent. The operational DRAT field testing in the HDU identified light quality issues related to morphology and pigment development that will need to be addressed through additional testing. Feedback from the crew, ground support personnel, and human factors leads was uniformly positive on the psychological value of having the crop production system in the excursion module. A number of areas have been identified for future work, to minimize the "footprint" of the Food Production system through creative use of unused wall and floor space in the unit.

Stutte, Gary W.↗
NASA NTRS2011

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗
NASA NTRS2011

Experimental and Analytical Evaluation of a Composite Honeycomb Deployable Energy Absorber

In 2006, the NASA Subsonic Rotary Wing Aeronautics Program sponsored the experimental and analytical evaluation of an externally deployable composite honeycomb structure that is designed to attenuate impact energy during helicopter crashes. The concept, which is designated the Deployable Energy Absorber (DEA), utilizes an expandable Kevlar honeycomb structure to dissipate kinetic energy through crushing. The DEA incorporates a unique flexible hinge design that allows the honeycomb to be packaged and stowed flat until needed for deployment. A variety of deployment options such as linear, radial, and/or hybrid methods can be used. Experimental evaluation of the DEA utilized a building block approach that included material characterization testing of its constituent, Kevlar -129 fabric/epoxy, and flexural testing of single hexagonal cells. In addition, the energy attenuation capabilities of the DEA were demonstrated through multi-cell component dynamic crush tests, and vertical drop tests of a composite fuselage section, retrofitted with DEA blocks, onto concrete, water, and soft soil. During each stage of the DEA evaluation process, finite element models of the test articles were developed and simulations were performed using the explicit, nonlinear transient dynamic finite element code, LS-DYNA. This report documents the results of the experimental evaluation that was conducted to assess the energy absorption capabilities of the DEA.

Jackson, Karen E.↗
NASA NTRS2011

Using Innovative Technologies for Manufacturing and Evaluating Rocket Engine Hardware

Many of the manufacturing and evaluation techniques that are currently used for rocket engine component production are traditional methods that have been proven through years of experience and historical precedence. As we enter into a new space age where new launch vehicles are being designed and propulsion systems are being improved upon, it is sometimes necessary to adopt new and innovative techniques for manufacturing and evaluating hardware. With a heavy emphasis on cost reduction and improvements in manufacturing time, manufacturing techniques such as Direct Metal Laser Sintering (DMLS) and white light scanning are being adopted and evaluated for their use on J-2X, with hopes of employing both technologies on a wide variety of future projects. DMLS has the potential to significantly reduce the processing time and cost of engine hardware, while achieving desirable material properties by using a layered powdered metal manufacturing process in order to produce complex part geometries. The white light technique is a non-invasive method that can be used to inspect for geometric feature alignment. Both the DMLS manufacturing method and the white light scanning technique have proven to be viable options for manufacturing and evaluating rocket engine hardware, and further development and use of these techniques is recommended.

Betts, Erin M.↗
NASA NTRS2012

Evaluation of NASA SPoRT's Pseudo-Geostationary Lightning Mapper Products in the 2011 Spring Program

NASA's Short-term Prediction Research and Transition (SPoRT) program is a contributing partner with the GOES-R Proving Ground (PG) preparing forecasters to understand and utilize the unique products that will be available in the GOES-R era. This presentation emphasizes SPoRT s actions to prepare the end user community for the Geostationary Lightning Mapper (GLM). This preparation is a collaborative effort with SPoRT's National Weather Service partners, the National Severe Storms Laboratory (NSSL), and the Hazardous Weather Testbed s Spring Program. SPoRT continues to use its effective paradigm of matching capabilities to forecast problems through collaborations with our end users and working with the developers at NSSL to create effective evaluations and visualizations. Furthermore, SPoRT continues to develop software plug-ins so that these products will be available to forecasters in their own decision support system, AWIPS and eventually AWIPS II. In 2009, the SPoRT program developed the original pseudo geostationary lightning mapper (PGLM) flash extent product to demonstrate what forecasters may see with GLM. The PGLM replaced the previous GLM product and serves as a stepping-stone until the AWG s official GLM proxy is ready. The PGLM algorithm is simple and can be applied to any ground-based total lightning network. For 2011, the PGLM used observations from four ground-based networks (North Alabama, Kennedy Space Center, Oklahoma, and Washington D.C.). While the PGLM is not a true proxy product, it is intended as a tool to train forecasters about total lightning as well as foster discussions on product visualizations and incorporating GLM-resolution data into forecast operations. The PGLM has been used in 2010 and 2011 and is likely to remain the primary lightning training tool for the GOES-R program for the near future. This presentation will emphasize the feedback received during the 2011 Spring Program. This will discuss several topics. Based on feedback from the 2010 Spring Program, SPoRT created two variant PGLM products, which NSSL produced locally and provided in real-time within AWIPS for 2011. The first is the flash initiation density (FID) product, which creates a gridded display showing the number of flashes that originated in each 8 8 km grid box. The second product is the maximum flash density (MFD). This shows the highest PGLM value for each grid point over a specific period of time, ranging from 30 to 120 minutes. In addition to the evaluation of these two new products, the evaluation of the PGLM itself will be covered. The presentation will conclude with forecaster feedback for additional improvements requested for future evaluations, such as within the 2012 Spring Program.

Stano, Geoffrey T.↗
NASA NTRS2012

In Flight Evaluation of Active Inceptor Force-Feel Characteristics and Handling Qualities

The effect of inceptor feel-system characteristics on piloted handling qualities has been a research topic of interest for many years. Most of the research efforts have focused on advanced fly-by-wire fixed-wing aircraft with only a few studies investigating the effects on rotorcraft. Consequently, only limited guidance is available on how cyclic force-feel characteristics should be set to obtain optimal handling qualities for rotorcraft. To study this effect, the U.S. Army Aeroflightdynamics Directorate working with the DLR Institute of Flight Systems in Germany under Task X of the U.S. German Memorandum of Understanding have been conducting flight test evaluations. In the U.S., five experimental test pilots have completed evaluations of two Mission Task Elements (MTEs) from ADS-33E-PRF and two command/response types for a matrix of center-stick cyclic force-feel characteristics at Moffett Field. In Germany, three experimental test Pilots have conducted initial evaluations of the two MTEs with two command/response types for a parallel matrix of side-stick cyclic force-feel characteristics at WTD-61 in Manching. The resulting data set is used to correlate the effect of changes in natural frequency and damping ratio of the cyclic inceptor on the piloted handling qualities. Existing criteria in ADS-33E and a proposed Handling Qualities Sensitivity Function that includes the effects of the cyclic force-feel characteristics are also evaluated against the data set and discussed.

Lusardi, Jeff A.↗
NASA NTRS2012

Towards an Improved Pilot-Vehicle Interface for Highly Automated Aircraft: Evaluation of the Haptic Flight Control System

The control automation and interaction paradigm (e.g., manual, autopilot, flight management system) used on virtually all large highly automated aircraft has long been an exemplar of breakdowns in human factors and human-centered design. An alternative paradigm is the Haptic Flight Control System (HFCS) that is part of NASA Langley Research Center s Naturalistic Flight Deck Concept. The HFCS uses only stick and throttle for easily and intuitively controlling the actual flight of the aircraft without losing any of the efficiency and operational benefits of the current paradigm. Initial prototypes of the HFCS are being evaluated and this paper describes one such evaluation. In this evaluation we examined claims regarding improved situation awareness, appropriate workload, graceful degradation, and improved pilot acceptance. Twenty-four instrument-rated pilots were instructed to plan and fly four different flights in a fictitious airspace using a moderate fidelity desktop simulation. Three different flight control paradigms were tested: Manual control, Full Automation control, and a simplified version of the HFCS. Dependent variables included both subjective (questionnaire) and objective (SAGAT) measures of situation awareness, workload (NASA-TLX), secondary task performance, time to recognize automation failures, and pilot preference (questionnaire). The results showed a statistically significant advantage for the HFCS in a number of measures. Results that were not statistically significant still favored the HFCS. The results suggest that the HFCS does offer an attractive and viable alternative to the tactical components of today s FMS/autopilot control system. The paper describes further studies that are planned to continue to evaluate the HFCS.

Schutte, Paul↗
NASA NTRS2012

Evaluation of Atmospheric Loading and Improved Troposphere Modelling

Forward modeling of non-tidal atmospheric loading displacements at geodetic tracking stations have not routinely been included in Doppler Orbitography and Radiopositionning Integrated by Satellite (DORIS) or Satellite Laser Ranging (SLR) station analyses for either POD applications or reference frame determination. The displacements which are computed from 6-hourly models such as the ECMWF and can amount to 3-10 mm in the east, north and up components depending on the tracking station locations. We evaluate the application of atmospheric loading in a number ways using the NASA GSFC GEODYN software: First we assess the impact on SLR & DORIS-determined orbits such as Jason-2, where we evaluate the impact on the tracking data RMS of fit and how the total orbits are changed with the application of this correction. Preliminary results show an RMS radial change of 0.5 mm for Jason-2 over 54 cycles and a total change in the Z-centering of the orbit of 3 mm peak-to-peak over one year. We also evaluate the effects on other DORIS-satellites such as Cryosat-2, Envisat and the SPOT satellites. In the second step, we produce two SINEX time series based on data from available DORIS satellites and assess the differences in WRMS, scale and Helmert translation parameters. Troposphere refraction is obviously an important correction for radiometric data types such as DORIS. We evaluate recent improvements in DORIS processing at GSFC including the application of the Vienna Mapping Function (VMF1) grids with a-priori hydrostatic (VZHDs) and wet (VZWDs) zenith delays. We reduce the gridded VZHD at the stations height using pressure and temperature derived from GPT (strategy 1) and Saastamoinen. We discuss the validation of the VMF1 implementation and its application to the Jason-2 POD processing, compared to corrections using the Niell mapping function and the GMF. Using one year of data, we also assess the impact of the new troposphere corrections on the DORIS-only solutions, most importantly on the scale of the weekly solutions.

Zelensky, Nikita P.↗
NASA NTRS2012

Evaluating Three Active Thermal Architectures for Exploration Missions

Mass and cost are typically the two biggest challenges facing space craft designers. Active thermal control systems for crewed space-craft are typically among the more massive and costly systems on the vehicle. A study was completed evaluating three different thermal control system architectures to evaluate overall performance, mass and cost for a typical exploration mission profile. The architectures that were evaluated were 1 - a two-loop system using an internal liquid loop interfacing with an external liquid loop and flow loop with flow through radiators; 2 - a-single loop architecture with flow through radiators utilizing a regenerative heat exchanger and heater; and 3 - a single-loop architecture with heat pipe radiators. Environmental conditions, calculated for a given lunar exploration mission, and mission heat load profiles, generated based on previous Orion time lines, were evalauated through the phases of the on orbit mission. Performance for each of the architectures was evaluated along with the resultant mass of each system. Recommendations include adding a thermal topping system to lunar missions due to the extreme hot environments encountered in near-lunar approaches.

Cross, Cynthia D.↗
NASA NTRS2013

Evaluation of Ceramic Matrix Composite Technology for Aircraft Turbine Engine Applications

The goals of the NASA Environmentally Responsible Aviation (ERA) Project are to reduce the NO(x) emissions, fuel burn, and noise from turbine engines. In order to help meet these goals, commercially-produced ceramic matrix composite (CMC) components and environmental barrier coatings (EBCs) are being evaluated as parts and panels. The components include a CMC combustor liner, a CMC high pressure turbine vane, and a CMC exhaust nozzle as well as advanced EBCs that are tailored to the operating conditions of the CMC combustor and vane. The CMC combustor (w/EBC) could provide 2700 F temperature capability with less component cooling requirements to allow for more efficient combustion and reductions in NOx emissions. The CMC vane (w/EBC) will also have temperature capability up to 2700 F and allow for reduced fuel burn. The CMC mixer nozzle will offer reduced weight and improved mixing efficiency to provide reduced fuel burn. The main objectives are to evaluate the manufacturability of the complex-shaped components and to evaluate their performance under simulated engine operating conditions. Progress in CMC component fabrication, evaluation, and testing is presented in which the goal is to advance from the proof of concept validation (TRL 3) to a system/subsystem or prototype demonstration in a relevant environment (TRL 6).

Halbig, Michael C.↗
NASA NTRS2007

KSC Vertical Launch Site Evaluation

RS&H was tasked to evaluate the potential available launch sites for a combined two user launch pad. The Launch sites were to be contained entirely within current Kennedy Space Center property lines. The user launch vehicles to be used for evaluation are in the one million pounds of first stage thrust range. Additionally a second evaluation criterion was added early on in the study. A single user launch site was to be evaluated for a two million pound first stage thrust vehicle. Both scenarios were to be included in the report. To provide fidelity to the study criteria, a specific launch vehicle in the one million pound thrust range was chosen as a guide post or straw-man launch vehicle. The RpK K-1 vehicle is a current Commercial Orbital Transportation System (COTS), contract awardee along with the SpaceX Falcon 9 vehicle. SpaceX, at the time of writing, is planning to launch COTS and possibly other payloads from Cx-40 on Cape Canaveral Air Force Station property. RpK has yet to declare a specific launch site as their east coast US launch location. As such it was deemed appropriate that RpK's vehicle requirements be used as conceptual criteria. For the purposes of this study those criteria were marginally generalized to make them less specifiC.

Phillips, Lynne V.↗
NASA NTRS2014

Evaluation of the Sensor Data Record from the Nadir Instruments of the Ozone Mapping Profiler Suite (OMPS)

This paper evaluates the first 15 months of the Ozone Mapping and Profiler Suite (OMPS) Sensor Data Record (SDR) acquired by the nadir sensors and processed by the National Oceanic and Atmospheric Administration Interface Data Processing Segment. The evaluation consists of an inter-comparison with a similar satellite instrument, an analysis using a radiative transfer model, and an assessment of product stability. This is in addition to the evaluation of sensor calibration and the Environment Data Record product that are also reported in this Special Issue. All these are parts of synergetic effort to provide comprehensive assessment at every level of the products to ensure its quality. It is found that the OMPS nadir SDR quality is satisfactory for the current Provisional maturity. Methods used in the evaluation are being further refined, developed, and expanded, in collaboration with international community through the Global Space-based Inter-Calibration System, to support the upcoming long-term monitoring.

validation↗
NASA NTRS2015

Evaluation of the 7-km GEOS-5 Nature Run

This report documents an evaluation by the Global Modeling and Assimilation Office (GMAO) of a two-year 7-km-resolution non-hydrostatic global mesoscale simulation produced with the Goddard Earth Observing System (GEOS-5) atmospheric general circulation model. The simulation was produced as a Nature Run for conducting observing system simulation experiments (OSSEs). Generation of the GEOS-5 Nature Run (G5NR) was motivated in part by the desire of the OSSE community for an improved high-resolution sequel to an existing Nature Run produced by the European Centre for Medium-Range Weather Forecasts (ECMWF), which has served the community for several years. The intended use of the G5NR in this context is for generating simulated observations to test proposed observing system designs regarding new instruments and their deployments. Because NASA's interest in OSSEs extends beyond traditional weather forecasting applications, the G5NR includes, in addition to standard meteorological components, a suite of aerosol types and several trace gas concentrations, with emissions downscaled to 10 km using ancillary information such as power plant location, population density and night-light information. The evaluation exercise described here involved more than twenty-five GMAO scientists investigating various aspects of the G5NR performance, including time mean temperature and wind fields, energy spectra, precipitation and the hydrological cycle, the representation of waves, tropical cyclones and midlatitude storms, land and ocean surface characteristics, the representation and forcing effects of clouds and radiation, dynamics of the stratosphere and mesosphere, and the representation of aerosols and trace gases. Comparisons are made with observational data sets when possible, as well as with reanalyses and other long model simulations. The evaluation is broad in scope, as it is meant to assess the overall realism of basic aspects of the G5NR deemed relevant to the conduct of OSSEs. However, because of the relatively short record and other practical considerations, these comparisons cannot provide a definitive, statistically sound assessment of all model deficiencies, or guarantee the G5NR's suitability for all OSSE applications. Differences between the observed and simulated behavior also must be judged in the context of basic internal atmospheric variability which can introduce variations that are not necessarily controlled by the prescribed sea surface temperatures used in generating the G5NR. The results show that the G5NR performs well as measured by the majority of metrics applied in this evaluation. Particular benefits derived from the 7-km resolution of G5NR include realistic representations of extreme weather events in both the tropics and extratropics including tropical cyclones, Nor'easters and mesoscale convective complexes; improved representation of the diurnal cycle of precipitation over land; well-resolved surface-atmosphere interactions such as katabatic wind flows over Antarctica and Greenland; and resolution of orographically generated gravity waves that propagate into the upper atmosphere and influence the large scale circulation. Obvious deficiencies in the G5NR include a "splitting" of the inter-tropical convergence zone, which leads to a weaker-than-observed Hadley circulation and related deficiencies in the depiction of stationary wave patterns. Also, while the G5NR captures global cloud features and radiative effects well in general, close comparison with observations reveals higher-than-observed cloud brightness, likely due to an overabundance of cloud condensate; less distinct cloud minima in subtropical subsidence zones, consistent with a weak Hadley circualtion; and too few near-coastal marine stratocumulus clouds.

GEOS-5↗