Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model evaluation/performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

77 records · Page 5

Influences of the South American Low-Level Jet on the Convective Environment in Central Argentina Using a Convection-Permitting Simulation

This study documents the spatial and temporal distribution of the South American low-level jet (SALLJ) and quantifies its impact on the convective environment using a 6.5-month convection-permitting simulation during the Remote Sensing of Electrification, Lightning, And Mesoscale/Microscale Processes with Adaptive Ground Observations and Clouds, Aerosols, and Complex Terrain Interactions (RELAMPAGO-CACTI) campaigns. Overall, the simulation reproduces the observed SALLJ characteristics in central Argentina near the Sierras de Córdoba (SDC), a focal point for terrain-focused upscale growth. SALLJs most frequently occur in the summer with maxima to the northwest and east of the SDC and minima over the higher terrain. The shallower SALLJs (<1750 m) have a strong overnight skew, while the elevated jets are more equally spread throughout the day. SALLJ periods often have higher amounts of low-level moisture and instability compared to non-SALLJ periods, with these impacts increasing over time when the SALLJ is present and decreasing afterward. The SALLJ may enhance low-level wind shear magnitudes (particularly when accounting for the jet height); however, enhancement is somewhat limited due to the presence of speed shear in most situations. SALLJ periods are associated with low-level directional shear favorable for organized convection and an orientation of cloud-layer wind shear parallel to the terrain, which could favor upscale growth. A case study is shown in which the SALLJ influenced both the magnitude and direction of wind shear concurrent with convective upscale growth near the SDC. This study highlights the complex relationship between the SALLJ and its impacts during periods of widespread convection.

54 ENVIRONMENTAL SCIENCES↗

Modeling the Evolution and Life Cycle of Stable Cold Pools

Stable cold pools in California’s Central Valley (CV) are conducive to freezing temperatures, high relative humidity, and, in some cases, fog. Here, it will be shown that the Weather Research and Forecasting (WRF) Model as commonly configured cannot reproduce such conditions because of a persistent warm and dry bias near the surface. It was discovered that removing horizontal diffusion, which by default operates on model levels and thus up and down the valley’s sides, can reduce but not entirely fix the problem. Further improvements include enhancing the near-surface vertical resolution and the surface–air coupling, as both directly control the surface fluxes, especially evaporation. Yet, these alterations actually have the largest impact in the forested region surrounding the Central Valley, and influence the nighttime relative humidity in the CV only indirectly via nocturnal drainage flows. While it is not clear how realistic are the increased evaporation in the forest or the drainage flows, how and why these alterations result in significantly improved relative humidity reconstructions within the Central Valley are shown.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Rapid Refresh Numerical Weather Prediction Model over Arctic Alaska

Abstract Despite a need for accurate weather forecasts for societal and economic interests in the U.S. Arctic, thorough evaluations of operational numerical weather prediction in the region have been limited. In particular, the Rapid Refresh Model (RAP), which plays a key role in short-term forecasting and decision-making, has seen very limited assessment in northern Alaska, with most evaluation efforts focused on lower latitudes. In the present study, we verify forecasts from version 4 of the RAP against radiosonde, surface meteorological, and radiative flux observations from two Arctic sites on the northern Alaskan coastline, with a focus on boundary layer thermodynamic and dynamic biases, model representation of surface inversions, and cloud characteristics. We find persistent seasonal thermodynamic biases near the surface that vary with wind direction, and may be related to the RAP’s handling of sea ice and ocean interactions. These biases seem to have diminished in the latest version of the RAP (version 5), which includes refined handling of sea ice, among other improvements. In addition, we find that despite capturing boundary layer temperature profiles well overall, the RAP struggles to consistently represent strong, shallow surface inversions. Further, while the RAP seems to forecast the presence of clouds accurately in most cases, there are errors in the simulated characteristics of these clouds, which we hypothesize may be related to the RAP’s treatment of mixed-phase clouds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗

Model Evaluation by Measurements from Collocated Remote Sensors in Complex Terrain

Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.

54 ENVIRONMENTAL SCIENCES↗