Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error indicators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Preliminary Effect of Synthetic Vision Systems Displays to Reduce Low-Visibility Loss of Control and Controlled Flight Into Terrain Accidents

An experimental investigation was conducted to study the effectiveness of Synthetic Vision Systems (SVS) flight displays as a means of eliminating Low Visibility Loss of Control (LVLOC) and Controlled Flight Into Terrain (CFIT) accidents by low time general aviation (GA) pilots. A series of basic maneuvers were performed by 18 subject pilots during transition from Visual Meteorological Conditions (VMC) to Instrument Meteorological Conditions (IMC), with continued flight into IMC, employing a fixed-based flight simulator. A total of three display concepts were employed for this evaluation. One display concept, referred to as the Attitude Indicator (AI) replicated instrumentation common in today's General Aviation (GA) aircraft. The second display concept, referred to as the Electronic Attitude Indicator (EAI), featured an enlarged attitude indicator that was more representative of a glass display that also included advanced flight symbology, such as a velocity vector. The third concept, referred to as the SVS display, was identical to the EAI except that computer-generated terrain imagery replaced the conventional blue-sky/brown-ground of the EAI. Pilot performance parameters, pilot control inputs and physiological data were recorded for post-test analysis. Situation awareness (SA) and qualitative pilot comments were obtained through questionnaires and free-form interviews administered immediately after the experimental session. Initial pilot performance data were obtained by instructor pilot observations. Physiological data (skin temperature, heart rate, and muscle flexure) were also recorded. Preliminary results indicate that far less errors were committed when using the EAI and SVS displays than when using conventional instruments. The specific data example examined in this report illustrates the benefit from SVS displays to avoid massive loss of SA conditions. All pilots acknowledged the enhanced situation awareness provided by the SVS display concept. Levels of pilot stress appear to be correlated with skin temperature measurements.

Glaab, Louis J.↗

Cross-sectional structural parameters from densitometry

Bone densitometry has previously been used to obtain cross-sectional properties of bone from a single X-ray projection across the bone width. Using three unique projections, we have extended the method to obtain the principal area moments of inertia and orientations of the principal axes at each scan cross-section along the length of the scan. Various aluminum phantoms were used to examine scanner characteristics to develop the highest accuracy possible for in vitro non-invasive analysis of cross-sectional properties. Factors considered included X-ray photon energy, initial scan orientation, the angle spanned by the three scans (included angle), and I(min)/I(max) ratios. Principal moments of inertia were accurate to within +/-3.1% and principal angles were within +/-1 degrees of the expected value for phantoms scanned with included angles of 60 degrees and 90 degrees at the higher X-ray photon energy (140 kVp). Low standard deviations in the error (0.68-1.84%) also indicate high precision of calculated measurements with these included angles. Accuracy and precision decreased slightly when the included angle was reduced to 30 degrees. The method was then successfully applied to a pair of excised cadaveric tibiae. The accuracy and insensitivity of the algorithms to cross-sectional shape and changing isotropy (I(min)/I(max)) values when various included angles are used make this technique viable for future in vivo studies.

NASA Center ARC↗

Video-task acquisition in rhesus monkeys (Macaca mulatta) and chimpanzees (Pan troglodytes): a comparative analysis

This study describes video-task acquisition in two nonhuman primate species. The subjects were seven rhesus monkeys (Macaca mulatta) and seven chimpanzees (Pan troglodytes). All subjects were trained to manipulate a joystick which controlled a cursor displayed on a computer monitor. Two criterion levels were used: one based on conceptual knowledge of the task and one based on motor performance. Chimpanzees and rhesus monkeys attained criterion in a comparable number of trials using a conceptually based criterion. However, using a criterion based on motor performance, chimpanzees reached criterion significantly faster than rhesus monkeys. Analysis of error patterns and latency indicated that the rhesus monkeys had a larger asymmetry in response bias and were significantly slower in responding than the chimpanzees. The results are discussed in terms of the relation between object manipulation skills and video-task acquisition.

NASA Discipline Space Human Factors↗

Wind Prediction Accuracy for Air Traffic Management Decision Support Tools

The performance of Air Traffic Management and flight deck decision support tools depends in large part on the accuracy of the supporting 4D trajectory predictions. This is particularly relevant to conflict prediction and active advisories for the resolution of conflicts and the conformance with of traffic-flow management flow-rate constraints (e.g., arrival metering / required time of arrival). Flight test results have indicated that wind prediction errors may represent the largest source of trajectory prediction error. The tests also discovered relatively large errors (e.g., greater than 20 knots), existing in pockets of space and time critical to ATM DST performance (one or more sectors, greater than 20 minutes), are inadequately represented by the classic RMS aggregate prediction-accuracy studies of the past. To facilitate the identification and reduction of DST-critical wind-prediction errors, NASA has lead a collaborative research and development activity with MIT Lincoln Laboratories and the Forecast Systems Lab of the National Oceanographic and Atmospheric Administration (NOAA). This activity, begun in 1996, has focussed on the development of key metrics for ATM DST performance, assessment of wind-prediction skill for state of the art systems, and development/validation of system enhancements to improve skill. A 13 month study was conducted for the Denver Center airspace in 1997. Two complementary wind-prediction systems were analyzed and compared to the forecast performance of the then standard 60 km Rapid Update Cycle - version 1 (RUC-1). One system, developed by NOAA, was the prototype 40-km RUC-2 that became operational at NCEP in 1999. RUC-2 introduced a faster cycle (1 hr vs. 3 hr) and improved mesoscale physics. The second system, Augmented Winds (AW), is a prototype en route wind application developed by MITLL based on the Integrated Terminal Wind System (ITWS). AW is run at a local facility (Center) level, and updates RUC predictions based on an optimal interpolation of the latest ACARS reports since the RUC run. This paper presents an overview of the study's results including the identification and use of new large mor wind-prediction accuracy metrics that are key to ATM DST performance.

Cole, Rod↗

Satellite-Scale Snow Water Equivalent Assimilation into a High-Resolution Land Surface Model

An ensemble Kalman filter (EnKF) is used in a suite of synthetic experiments to assimilate coarse-scale (25 km) snow water equivalent (SWE) observations (typical of satellite retrievals) into fine-scale (1 km) model simulations. Coarse-scale observations are assimilated directly using an observation operator for mapping between the coarse and fine scales or, alternatively, after disaggregation (re-gridding) to the fine-scale model resolution prior to data assimilation. In either case observations are assimilated either simultaneously or independently for each location. Results indicate that assimilating disaggregated fine-scale observations independently (method 1D-F1) is less efficient than assimilating a collection of neighboring disaggregated observations (method 3D-Fm). Direct assimilation of coarse-scale observations is superior to a priori disaggregation. Independent assimilation of individual coarse-scale observations (method 3D-C1) can bring the overall mean analyzed field close to the truth, but does not necessarily improve estimates of the fine-scale structure. There is a clear benefit to simultaneously assimilating multiple coarse-scale observations (method 3D-Cm) even as the entire domain is observed, indicating that underlying spatial error correlations can be exploited to improve SWE estimates. Method 3D-Cm avoids artificial transitions at the coarse observation pixel boundaries and can reduce the RMSE by 60% when compared to the open loop in this study.

De Lannoy, Gabrielle J.M.↗

Axisymmetric Flow Properties for Magnetic Elements of Differing Strength

Aspects of the structure and dynamics of the flows in the Sun's surface shear layer remain uncertain and yet are critically important for understanding the observed magnetic behavior. In our previous studies of the axisymmetric transport of magnetic elements we found systematic changes in both the differential rotation and the meridional flow over the course of Solar Cycle 23. Here we examine how those flows depend upon the strength (and presumably anchoring depth) of the magnetic elements. Line of sight magnetograms obtained by the HMI instrument aboard SDO over the course of Carrington Rotation 2097 were mapped to heliographic coordinates and averaged over 12 minutes to remove the 5-min oscillations. Data masks were constructed based on the field strength of each mapped pixel to isolate magnetic elements of differing field strength. We used Local Correlation Tracking of the unmasked data (separated in time by 1- to 8-hours) to determine the longitudinal and latitudinal motions of the magnetic elements. We then calculated average flow velocities as functions of latitude and longitude from the central meridian for approx 600 image pairs over the 27-day rotation. Variations with longitude indicate and characterize systematic errors in the flow measurements associated with changes in the signal from disk center to limb. Removing these systematic errors reveals changes in the axisymmetric flow properties that reflect changes in flow properties with depth in the surface shear layer.

Rightmire-Upton, Lisa↗

Evaluation of Model Microphysics Within Precipitation Bands of Extratropical Cyclones

Recent studies evaluating the bulk microphysical schemes (BMPs) within cloud resolving models (CRMs) have indicated large uncertainties and errors in the amount and size distributions of snow and cloud ice aloft. The snow prediction is sensitive to the snow densities, habits, and degree of riming within the BMPs. Improving these BMPs is a crucial step toward improving both weather forecasting and climate predictions. Several microphysical schemes in the Weather Research and Forecasting (WRF) model down to 1.33‐km grid spacing are evaluated using aircraft, radar, and ground in situ data from the Global Precipitation Mission Coldseason Precipitation Experiment (GCPEx) experiment, as well as a few years (15 winter storms) of surface measurements of riming, crystal habit, snow density, and radar measurements at Stony Brook, NY (SBNY on north shore of Long Island) during the 2009-2012 winter seasons. Surface microphysical measurements at SBNY were taken every 15 to 30 minutes using a stereo microscope and camera, and snow depth and snow density were also recorded. During these storms, a vertically-pointing Ku-band radar was used to observe the vertical evolution of reflectivity and Doppler vertical velocities. A Particle Size and Velocity (PARSIVEL) disdrometer was also used to measure the surface size distribution and fall speeds of snow at SBNY. For the 15 cases at SBNY, the WSM6, Morrison (MORR), Thompson (THOM2), and Stony Brook (SBU-YLIN) BMPs were validated. A non-spherical snow assumption (THOM2 and SBU-YLIN) simulated a more realistic distribution of reflectivity than spherical snow assumptions in the WSM6 and MORR schemes. The MORR, WSM6, and SBU-YLIN schemes are comparable to the observed velocity distribution in light and moderate riming periods. The THOM2 is ~0.25 meters per second too slow with its velocity distribution in these periods. In heavier riming, the vertical Doppler velocities in the WSM6, THOM2, and MORR schemes were ~0.25 meters per second too slow, while the SBU-YLIN was 0.25 to 0.5 meters per second too fast. Overall, the BMPs simulate a size distribution close to the observed for D < 4 mm in the dendritic, plates, and mixed habit periods. The model BMPs underestimate the size distribution when large aggregates were observed. For D > 6 mm in the dendrites, side planes, and mixed habit periods, the BMPs are likely not simulating enough aggregation to create a larger size distribution, although the MORR (double moment) scheme seemed to perform best. These SBNY results will be compared with some results from GCPEx for a warm frontal snow band observed at 18 February 2012.

Colle, Brian A.↗

Evaluation of Model Microphysics within Precipitation Bands of Extratropical Cyclones

Recent studies evaluating the bulk microphysical schemes (BMPs) within cloud resolving models (CRMs) have indicated large uncertainties and errors in the amount and size distributions of snow and cloud ice aloft. The snow prediction is sensitive to the snow densities, habits, and degree of riming within the BMPs. Improving these BMPs is a crucial step toward improving both weather forecasting and climate predictions. Several microphysical schemes in the Weather Research and Forecasting (WRF) model down to 1.33‐km grid spacing are evaluated using aircraft, radar, and ground in situ data from the Global Precipitation Mission Coldseason Precipitation Experiment (GCPEx) experiment, as well as a few years (15 winter storms) of surface measurements of riming, crystal habit, snow density, and radar measurements at Stony Brook, NY (SBNY on north shore of Long Island) during the 2009-2012 winter seasons. Surface microphysical measurements at SBNY were taken every 15 to 30 minutes using a stereo microscope and camera, and snow depth and snow density were also recorded. During these storms, a vertically-pointing Ku-band radar was used to observe the vertical evolution of reflectivity and Doppler vertical velocities. A Particle Size and Velocity (PARSIVEL) disdrometer was also used to measure the surface size distribution and fall speeds of snow at SBNY. For the 15 cases at SBNY, the WSM6, Morrison (MORR), Thompson (THOM2), and Stony Brook (SBU-YLIN) BMPs were validated. A non-spherical snow assumption (THOM2 and SBU-YLIN) simulated a more realistic distribution of reflectivity than spherical snow assumptions in the WSM6 and MORR schemes. The MORR, WSM6, and SBU-YLIN schemes are comparable to the observed velocity distribution in light and moderate riming periods. The THOM2 is approx 0.25 m/s too slow with its velocity distribution in these periods. In heavier riming, the vertical Doppler velocities in the WSM6, THOM2, and MORR schemes were approx 0.25 m/s too slow, while the SBU-YLIN was 0.25 to 0.5 m/s too fast. Overall, the BMPs simulate a size distribution close to the observed for D < 4 mm in the dendritic, plates, and mixed habit periods. The model BMPs underestimate the size distribution when large aggregates were observed. For D > 6 mm in the dendrites, side planes, and mixed habit periods, the BMPs are likely not simulating enough aggregation to create a larger size distribution, although the MORR (double moment) scheme seemed to perform best. These SBNY results will be compared with some results from GCPEx for a warm frontal snow band observed at 18 February 2012.

Colle, Brian A.↗

The String Stability of a Trajectory-Based Interval Management Algorithm in the Midterm Airspace

NASA's first Air Traffic Management (ATM) Technology Demonstration (ATD-1) was created to facilitate the transition of mature ATM technologies from the laboratory to operational use. The technologies selected for demonstration are the Traffic Management Advisor with Terminal Metering (TMA-TM), which provides precise time-based scheduling in the terminal airspace; Controller Managed Spacing (CMS), which provides terminal controllers with decision support tools enabling precise schedule conformance; and Interval Management (IM), which consists of flight deck automation that enables aircraft to achieve or maintain a precise spacing interval behind a target aircraft. As the percentage of IM equipped aircraft increases, controllers may provide IM clearances to sequences, or strings, of IM-equipped aircraft. It is important for these strings to maintain stable performance. This paper describes an analytic analysis of the string stability of the latest version of NASA's IM algorithm and a fast-time simulation designed to characterize the string performance of the IM algorithm. The analytic analysis showed that the spacing algorithm has stable poles, indicating that a spacing error perturbation will be reduced as a function of string position. The fast-time simulation investigated IM operations at two airports using constraints associated with the midterm airspace, including limited information of the target aircraft's intended speed profile and limited information of the wind forecast on the target aircraft's route. The results of the fast-time simulation demonstrated that the performance of the spacing algorithm is acceptable for strings of moderate length; however, there is some degradation in IM performance as a function of string position.

Swieringa, Kurt A.↗

Global Assessment of the SMAP Level-4 Soil Moisture Product Using Assimilation Diagnostics

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx. 2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

Reichle, Rolf↗

Using Data Assimilation Diagnostics to Assess the SMAP Level-4 Soil Moisture Product

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx.2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

SMAP↗

Reliability Characterization of TaOx-Based Commercial ReRAM in Combination with Radiation

We present reliability data combined with total dose gamma radiation for one of the first commercially available resistive memory devices. These Tantalum Oxide (TaOX)-based resistive memory chips demonstrate operation in dynamic program and erase testing up to ~130 Krad(Si) of 60Co gamma dose. In static and unbiased conditions, the stored data in the memory cells were able to withstand up to 50Mrad(Si) of exposure. The access circuitry, though, seemed less robust to gamma radiation and was able to operate only up to a total dose of 3Mrad(Si). Post exposure reliability as indicated by endurance, cycling error rate, and data retention tests showed no detectable impact from the combination with prior gamma irradiation. Overall, the total dose radiation tolerance of the commercial TaOx-based resistive memory chip appears to be higher than flash memory chips and in agreement with prior tests conducted with single cell resistive memories.

total ionizing dose↗

VIIRS Deep Blue Aerosol Products Over Land: Extending the EOS Long‐Term Aerosol Data Records

A primary goal of the Deep Blue (DB) project is to create consistent long‐term aerosol data records, suitable for climate studies, using multiple satellite instruments. In order to continue Earth Observing System (EOS)‐era aerosol products into the Joint Polar Satellite System era, we have successfully ported the DB algorithm to process data from the Visible Infrared Imaging Radiometer Suite (VIIRS). Although the basic structure of the VIIRS algorithm is similar to that for the Moderate Resolution Imaging Spectroradiometer (MODIS), many enhancements have been made compared to the MODIS collection 6 (C6) version. Most have also been implemented in the latest MODIS Collection 6.1 (C6.1). For example, a new smoke mask was developed based on the spectral curvature of measured reflectance to distinguish biomass burning smoke from weakly absorbing urban/industrial aerosols. Consequently, a new aerosol‐type flag was added into the VIIRS DB data set. In addition, new dust models have been developed to account for the nonsphericity of mineral dust. As a result, a discontinuity in the retrieved aerosol optical depth (AOD) of Saharan dust plumes seen in MODIS C6 products near the boundary between North Africa and the Atlantic has been much reduced. We have also evaluated the VIIRS and MODIS Terra/Aqua C6.1 AOD against Aerosol Robotic Network data. VIIRS and MODIS retrievals show similar performance; around 80% of matchups agree with Aerosol Robotic Network within the expected error of ±(0.05 + 20)%, indicating that DB can provide consistent AOD through the historical EOS and present Joint Polar Satellite System eras.

aerosols↗

Listening to the Forest: An Artificial Neural Network‐Based Model of Carbon Uptake at Harvard Forest

Abstract The terrestrial biosphere strongly modulates atmospheric CO 2 mixing ratios, whose inexorable rise propels anthropogenic climate change. Modeling and mechanistically understanding C uptake by the terrestrial biosphere are thus of broad societal concerns. Yet despite considerable progress, scaling up point observations to landscape and larger scales continues to frustrate analyses of the anthropogenically perturbed global C cycle. While that up‐scaling is our overarching motivation, here we focus on one of its elements, modeling C uptake at a given site. We devise a novel artificial neural network (ANN)‐based model of C uptake at Harvard Forest that combines locally observed and remotely sensed variables. Most of our model predictors are those used by an established ecosystem C uptake model, the Vegetation Photosynthesis and Respiration Model (VPRM), easing comparisons. To those, we add observed cumulative antecedent precipitation and soil temperature. We find that model errors are much larger in winter, indicating that better understanding and modeling of respiration will likely discernibly improve model performance. Comparing the ANN and VPRM results reveals errors attributed to unrealistic treatment of temperature in the VPRM formulation, indicating that better representation of temperature dependencies is also likely to enhance model skill. By judiciously comparing VPRM and ANN errors we thus overcome ANNs' notoriety for concealing the mechanisms underlying their predictive skills. We demonstrate their ability to identify outstanding ecosystem science knowledge gaps and particularly fruitful corresponding model development directions, improving site specific and up‐scaling flux modeling and understanding of the climate impacts of the northern forest.

Eshel, Gidon↗

Description of the dedicated gravitational satellite mission /Gravsat/

A description of the dedicated gravitational satellite (Gravsat) mission is presented. Scientific objectives are to substantially improve knowledge of solid earth geophysics and oceanography by determining a more accurate geopotential. The most stringent requirement is determination of mean gravity anomalies over regions 100-km square to an accuracy of 2.5 mgal (1 gal = 1 cm/s squared). Fundamental geodetic data will be satellite-to-satellite measurement of relative range rate. Orbital characteristics are discussed. An error budget is presented which indicates that the requisite measurement precision can be achieved by closed-loop RF doppler measurements. Implicit in the discussion of the error budget is a description of the spacecraft and systems components.

Pisacane, V. L.↗

Transmission errors and bearing contact of spur, helical and spiral bevel gears

An investigation of transmission errors and bearing contact of spur, helical and spiral bevel gears was performed. Modified tooth surfaces for these gears have been proposed in order to absorb linear transmission errors caused by gear misalignment and to localize the bearing contact. Numerical examples for spur, helical, and spiral bevel gears are presented to illustrate the behavior of the modified gear surfaces with respect to misalignment and errors of assembly. The numerical results indicate that the modified surfaces will perform with a low level of transmission error in non-ideal operating environments.

F. L. Litvin↗

An Alternate Method for Estimating Dynamic Height from XBT Profiles Using Empirical Vertical Modes

A technique is presented that applies modal decomposition to estimate dynamic height (0-450 db) from Expendable BathyThermograph (XBT) temperature profiles. Salinity-Temperature-Depth (STD) data are used to establish empirical relationships between vertically integrated temperature profiles and empirical dynamic height modes. These are then applied to XBT data to estimate dynamic height. A standard error of 0.028 dynamic meters is obtained for the waters of the Gulf of Alaska- an ocean region subject to substantial freshwater buoyancy forcing and with a T-S relationship that has considerable scatter. The residual error is a substantial improvement relative to the conventional T-S correlation technique when applied to this region. Systematic errors between estimated and true dynamic height were evaluated. The 20-year-long time series at Ocean Station P (50 deg N, 145 deg W) indicated weak variations in the error interannually, but not seasonally. There were no evident systematic alongshore variations in the error in the ocean boundary current regime near the perimeter of the Alaska gyre. The results prove satisfactory for the purpose of this work, which is to generate dynamic height from XBT data for coanalysis with satellite altimeter data, given that the altimeter height precision is likewise on the order of 2-3 cm. While the technique has not been applied to other ocean regions where the T-S relation has less scatter, it is suggested that it could provide some improvement over previously applied methods, as well.

Lagerloef, Gary S. E.↗

Model Evaluation by Measurements from Collocated Remote Sensors in Complex Terrain

Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.

54 ENVIRONMENTAL SCIENCES↗