Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗
NASA NTRS2004

Basin Scale Estimates of Evapotranspiration Using GRACE and other Observations

Evapotranspiration is integral to studies of the Earth system, yet it is difficult to measure on regional scales. One estimation technique is a terrestrial water budget, i.e., total precipitation minus the sum of evapotranspiration and net runoff equals the change in water storage. Gravity Recovery and Climate Experiment (GRACE) satellite gravity observations are now enabling closure of this equation by providing the terrestrial water storage change. Equations are presented here for estimating evapotranspiration using observation based information, taking into account the unique nature of GRACE observations. GRACE water storage changes are first substantiated by comparing with results from a land surface model and a combined atmospheric-terrestrial water budget approach. Evapotranspiration is then estimated for 14 time periods over the Mississippi River basin and compared with output from three modeling systems. The GRACE estimates generally lay in the middle of the models and may provide skill in evaluating modeled evapotranspiration.

Rodell, M.↗
NASA NTRS2014

ENSO Effect on East Asian Tropical Cyclone Landfall via Changes in Tracks and Genesis in a Statistical Model

Improvements on a statistical tropical cyclone (TC) track model in the western North Pacific Ocean are described. The goal of the model is to study the effect of El Nino-Southern Oscillation (ENSO) on East Asian TC landfall. The model is based on the International Best-Track Archive for Climate Stewardship (IBTrACS) database of TC observations for 1945-2007 and employs local regression of TC formation rates and track increments on the Nino-3.4 index and seasonally varying climate parameters. The main improvements are the inclusion of ENSO dependence in the track propagation and accounting for seasonality in both genesis and tracks. A comparison of simulations of the 1945-2007 period with observations concludes that the model updates improve the skill of this model in simulating TCs. Changes in TC genesis and tracks are analyzed separately and cumulatively in simulations of stationary extreme ENSO states. ENSO effects on regional (100-km scale) landfall are attributed to changes in genesis and tracks. The effect of ENSO on genesis is predominantly a shift in genesis location from the southeast in El Nino years to the northwest in La Nina years, resulting in higher landfall rates for the East Asian coast during La Nina. The effect of ENSO on track propagation varies seasonally and spatially. In the peak activity season (July-October), there are significant changes in mean tracks with ENSO. Landfall-rate changes from genesis- and track-ENSO effects in the Philippines cancel out, while coastal segments of Vietnam, China, the Korean Peninsula, and Japan show enhanced La Nina-year increases.

simulation↗
NASA NTRS2020

Subseasonal-to-Seasonal Hindcast Skill Assessment of Ridging Events Related to Drought Over the Western United States

Persistent atmospheric ridging events centered near the western United States are associated with widespread precipitation deficits and meteorological drought. Due to the relatively low skill of- dynamical models in forecasting precipitation on subseasonal‐to‐seasonal (S2S) time scales across this region, forecasts of ridging are explored in this study as a potential bridge for early warning drought prediction. To assess skill, we evaluate deterministic and probabilistic S2S hindcasts (out to 6 week lead time) of ridging events and geopotential height anomalies over the western United States in five ensemble hindcast systems. Prediction skill for ridging events is shown to be highly variable across models. For some models, longer‐time‐averaged patterns of geopotential height anomalies across the first 6 weeks can be skillfully simulated, when evaluated probabilistically against climatology. The most skillful models show modest skill in forecasting above normal ridging occurrences at lead times of Weeks 3–4 and Weeks 5–6,with some sensitivity to the specific ridge location and method for determining skill. Using the European Centre for Medium‐Range Weather Forecasts (ECMWF) model as a case study, longer lead time forecast busts are shown to often occur under extended periods of highly active La Nina‐like tropical convection. Model errors at simulating these tropical convection features may have a disproportionately large impact and degrade downstream forecasts over the western United States. Despite the documented model shortcomings, our results highlight an opportunity to target skillful ridging forecasts from dynamical models for improving early warning drought forecasting at S2S lead times.

S2S↗
NASA NTRS2020

Modeling the smoky troposphere of the southeast Atlantic: a comparison to ORACLES airborne observations from September of 2016

In the southeast Atlantic, well-defined smoke plumes from Africa advect over marine boundary layer cloud decks; both are most extensive around September, when most of the smoke resides in the free troposphere. A framework is put forth for evaluating the performance of a range of global and regional atmospheric composition models against observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) airborne mission in September 2016. A strength of the comparison is a focus on the spatial distribution of a wider range of aerosol composition and optical properties than has been done previously. The sparse airborne observations are aggregated into approximately 2° grid boxes and into three vertical layers: 3–6 km, the layer from cloud top to 3 km, and the cloud-topped marine boundary layer. Simulated aerosol extensive properties suggest that the flight-day observations are reasonably representative of the regional monthly average, with systematic deviations of 30 % or less. Evaluation against observations indicates that all models have strengths and weaknesses, and there is no single model that is superior to all the others in all metrics evaluated. Whereas all six models typically place the top of the smoke layer within 0–500 m of the airborne lidar observations, the models tend to place the smoke layer bottom 300–1400 m lower than the observations. A spatial pattern emerges, in which most models underestimate the mean of most smoke quantities (black carbon, extinction, carbon monoxide) on the diagonal corridor between 16° S, 6° E, and 10° S, 0° E, in the 3–6 km layer, and overestimate them further south, closer to the coast, where less aerosol is present. Model representations of the above-cloud aerosol optical depth differ more widely. Most models overestimate the organic aerosol mass concentrations relative to those of black carbon, and with less skill, indicating model uncertainties in secondary organic aerosol processes. Regional-mean free-tropospheric model ambient single scattering albedos vary widely, between 0.83 and 0.93 compared with in situ dry measurements centered at 0.86, despite minimal impact of humidification on particulate scattering. The modeled ratios of the particulate extinction to the sum of the black carbon and organic aerosol mass concentrations (a mass extinction efficiency proxy) are typically too low and vary too little spatially, with significant inter-model differences. Most models overestimate the carbonaceous mass within the offshore boundary layer. Overall, the diversity in the model biases suggests that different model processes are responsible. The wide range of model optical properties requires further scrutiny because of their importance for radiative effect estimates.

Yohei Shinozuka↗
NASA NTRS2021

Evaluation of High Mountain Asia-Land Data Assimilation System (Version 1) from 2003 to 2016, Part I: A Hyper-Resolution Terrestrial Modeling System

This first paper of the two-part series focuses on demonstrating the accuracy of a hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region. To this end, this study systematically evaluates four sets of model simulations at point scale, basin scale, and domain scale obtained from different spatial resolutions including 0.01° (∼1-km) and 0.25° (∼25-km). The assessment is conducted via comparisons against ground-based observations and satellite-derived reference products. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent, and total runoff. In the evaluation against ground-based measurements, the superiority of the 0.01° estimates are mostly demonstrated across relatively complex terrain. Specifically, hyper-resolution modeling improves the skill in meteorological forcing estimates (except precipitation) by 9% relative to coarse-resolution estimates. The model forced by downscaled forcings in its entirety yields the highest skill in model output states as well as precipitation, which improves the skill obtained by coarse-resolution estimates by 7%. These findings, on one hand, corroborate the importance of employing the hyper-resolution versus coarse-resolution modeling in areas characterized by complex terrain. On the other hand, by evaluating four sets of model simulations forced with different precipitation products, this study emphasizes the importance of accurate hyper-resolution precipitation products to drive model simulations.

Yuan Xue↗
NASA NTRS2013

Technical Report Series on Global Modeling and Data Assimilation: Global Surface Ocean Carbon Estimates in a Model Forced by MERRA - Volume 31

MERRA products were used to force an established ocean biogeochemical model to estimate surface carbon inventories and fluxes in the global oceans. The results were compared to public archives of in situ carbon data and estimates. The model exhibited skill for ocean dissolved inorganic carbon (DIC), partial pressure of ocean CO2 (pCO2) and air-sea fluxes (FCO2). The MERRA-forced model produced global mean differences of 0.02% (approximately 0.3 microns) for DIC, -0.3% (about -1.2 (micro) atm; model lower) for pCO2, and -2.3% (-0.003 mol C/sq m/y) for FCO2 compared to in situ estimates. Basin-scale distributions were significantly correlated with observations for all three variables (r=0.97, 0.76, and 0.73, P<0.05, respectively for DIC, pCO2, and FCO2). All major oceanographic basins were represented as sources to the atmosphere or sinks in agreement with in situ estimates. However, there were substantial basin-scale and local departures.

Gregg, Watson W.↗
NASA NTRS2016

Forecasting the Northern African Dust Outbreak Towards Europe in April 2011: A Model Intercomparison

In the framework of the World Meteorological Organisation's Sand and Dust Storm Warning Advisory and Assessment System, we evaluated the predictions of five state-of-the-art dust forecast models during an intense Saharan dust outbreak affecting western and northern Europe in April 2011. We assessed the capacity of the models to predict the evolution of the dust cloud with lead times of up to 72 hours using observations of aerosol optical depth (AOD) from the AErosol RObotic NETwork (AERONET) and the Moderate Resolution Imaging Spectroradiometer (MODIS) and dust surface concentrations from a ground-based measurement network. In addition, the predicted vertical dust distribution was evaluated with vertical extinction profiles from the Cloud and Aerosol Lidar with Orthogonal Polarization (CALIOP). To assess the diversity in forecast capability among the models, the analysis was extended to wind field (both surface and profile), synoptic conditions, emissions and deposition fluxes. Models predict the onset and evolution of the AOD for all analysed lead times. On average, differences among the models are larger than differences among lead times for each individual model. In spite of large differences in emission and deposition, the models present comparable skill for AOD. In general, models are better in predicting AOD than near-surface dust concentration over the Iberian Peninsula. Models tend to underestimate the long-range transport towards northern Europe. Our analysis suggests that this is partly due to difficulties in simulating the vertical distribution dust and horizontal wind. Differences in the size distribution and wet scavenging efficiency may also account for model diversity in long-range transport.

dust storms↗
NASA NTRS2019

Global Assimilation of L-Band Brightness Temperature Observations from SMAP and SMOS into the Catchment Land Surface Model and Contribution to the Skill of Soil Moisture Estimates

The Soil Moisture Active Passive (SMAP) and Soil Moisture Ocean Salinity (SMOS) missions provide global observations of L-band (1.4 GHz) passive microwave brightness temperature (Tb) observations at a resolution of ~40 km every 2-3 days. These observations have been available since 2015 from SMAP and since 2010 from SMOS.Soil moisture estimates from the separate assimilation of SMAP and SMOS Tb observations into land surface models were previously shown to improve over model-only estimates, thereby demonstrating the value of assimilating L-band Tb observations for soil moisture estimation. The assimilation experiments documented in the literature do not, however, establish whether the joint assimilation of SMAP and SMOS Tbs improves the skill of the resulting soil moisture estimates beyond what can be achieved with either set of observations alone. Moreover, because the published SMAP and SMOS results used different assimilation systems and configurations and applied different evaluation data and procedures, it is unclear whether the assimilation of SMAP-only or SMOS-only Tbs results in better soil moisture skill. In this presentation, we compare the results of three separate assimilation experiments for the period from April 2015 to present. The experiments utilize the SMAP Level-4 Soil Moisture (L4_SM) algorithm, which assimilates L-band Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. Specifically, the three experiments presented here assimilate (i) SMAP Tbs only, as in the L4_SM product, (ii) SMOS Tbs only, after interpolation of 40° incidence angle, and (iii) both SMAP and SMOS Tbs. In all other respects, the configuration of three experiments is identical, as is the validation of the output. Preliminary results suggest that the joint assimilation of SMAP and SMOS Tbs yields the most skillful soil moisture estimates when compared to independent in situ measurements. Moreover, the skill of the SMAP-only assimilation exceeds that of the SMOS-only assimilation. The presentation provides an in-depth evaluation of the skill of the assimilation estimates vs. independent in situ and satellite measurements and in terms of statistics of the observation-minus-forecast residuals and analysis increments.

Reichle, Rolf↗
NASA NTRS1981

A model for the control mode man-computer interface dialogue

A four stage model is presented for the control mode man-computer interface dialogue. It consists of context development, semantic development syntactic development, and command execution. Each stage is discussed in terms of the operator skill levels (naive, novice, competent, and expert) and pertinent human factors issues. These issues are human problem solving, human memory, and schemata. The execution stage is discussed in terms of the operators typing skills. This model provides an understanding of the human process in command mode activity for computer systems and a foundation for relating system characteristics to operator characteristics.

Chafin, R. L.↗
NASA NTRS2000

The Instrument Synthesis for Analysis Laboratory at the Goddard Space Flight Center

The objectives of the Instrument Synthesis and Analysis laboratory (ISAL) are to: 1) Provide a rapid and sustainable instrument development environment with clear efficient processes and tools, re-usable models and skilled engineers. 2) Provide a capability for quick and efficient trade studies of instrument architectures and concepts. 3) Streamline and optimize instrument systems design for the entire life cycle, including cost and technology assessment. 4) Provide detailed multi-disciplinary modeling and analysis for phase C/D design validation and for operational investigations.

Wood, H. John↗
NASA NTRS1999

Potential Predictability of the Monsoon Subclimate Systems

While El Nino/Southern Oscillation (ENSO) phenomenon can be predicted with some success using coupled oceanic-atmospheric models, the skill of predicting the tropical monsoons is low regardless of the methods applied. The low skill of monsoon prediction may be either because the monsoons are not defined appropriately or because they are not influenced significantly by boundary forcing. The latter characterizes the importance of internal dynamics in monsoon variability and leads to many eminent chaotic features of the monsoons. In this study, we analyze results from nine AMIP-type ensemble experiments with the NASA/GEOS-2 general circulation model to assess the potential predictability of the tropical climate system. We will focus on the variability and predictability of tropical monsoon rainfall on seasonal-to-interannual time scales. It is known that the tropical climate is more predictable than its extratropical counterpart. However, predictability is different from one climate subsystem to another within the tropics. It is important to understand the differences among these subsystems in order to increase our skill of seasonal-to-interannual prediction. We assess potential predictability by comparing the magnitude of internal and forced variances as defined by Harzallah and Sadourny (1995). The internal variance measures the spread among the various ensemble members. The forced part of rainfall variance is determined by the magnitude of the ensemble mean rainfall anomaly and by the degree of consistency of the results from the various experiments.

Yang, Song↗
NASA NTRS2010

Improving Forecast Skill by Assimilation of AIRS Temperature Soundings

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The AIRS Version 5 retrieval algorithm, is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates delta T(p) for retrieved quantities and the use of these error estimates for Quality Control. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 deg. latitude X 0.67 deg longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates delta (p) were used as the uncertainty for each measurement in the data assimilation process. We compared forecasts analyses generated from the analyses done by assimilation of AIRS temperature profiles with three different sets of thresholds; Standard, Medium, and Tight. Assimilation of Quality Controlled AIRS temperature profiles significantly improve 5-7 day forecast skill compared to that obtained without the benefit of AIRS data in all of the cases studied. In addition, assimilation of Quality Controlled AIRS temperature soundings performs better than assimilation of AIRS observed radiances. Based on the experiments shown, Tight Quality Control of AIRS temperature profile performs best on the average from the perspective of improving Global 7 day forecast skill.

Susskind, Joel↗
NASA NTRS2021

Australian tidal currents – assessment of a barotropic model (COMPAS v1.3.0 rev6631) with an unstructured grid

While the variations of tidal range are large and fairly well known across Australia (less than 1 m near Perth but more than 14 m in King Sound), the properties of the tidal currents are not. We describe a new regional model of Australian tides and assess it against a validation dataset comprising tidal height and velocity constituents at 615 tide gauge sites and 95 current meter sites. The model is a barotropic implementation of COMPAS, an unstructured-grid primitive-equation model that is forced at the open boundaries by TPXO9v1. The mean absolute error (MAE) of the modelled M2 height amplitude is 8.8 cm, or 12 % of the 73 cm mean observed amplitude. The MAE of phase (10°), however, is significant, so the M2 mean magnitude of vector error (MMVE, 18.2 cm) is significantly greater. The root sum square over the eight major constituents is 26 % of the observed amplitude. We conclude that while the model has skill at height in all regions, there is definitely room for improvement (especially at some specific locations). For the M2 major axis velocity amplitude, the MAE across the 95 current meter sites, where the observed amplitude ranges from 0.1 to 156 cm s −1 , is 6.9 cm s −1 , or 22 % of the 31.7 cm s −1 observed mean. This nationwide average result is encouraging, but it conceals a very large regional variation. Relative errors of the tidal current amplitudes on the narrow shelves of New South Wales (NSW) and Western Australia exceed 100 %, but tidal currents are weak and negligible there compared to non-tidal currents, so the tidal errors are of little practical significance. Looking nationwide, we show that the model has predictive value for much of the 79 % of Australia's shelf seas where tides are a major component of the total velocity variability. In descending order this includes the Bass Strait, the Kimberley to Arnhem Land, and southern Great Barrier Reef regions. There is limited observational evidence to confirm that the model is also valuable for currents in other regions across northern Australia. We plan to commence publishing “unofficial” tidal current predictions for chosen regions in the near future based on both our COMPAS model and the validation dataset we have assembled.

Tidal currents↗
NASA NTRS1989

Global models: Robot sensing, control, and sensory-motor skills

Robotics research has begun to address the modeling and implementation of a wide variety of unstructured tasks. Examples include automated navigation, platform servicing, custom fabrication and repair, deployment and recovery, and science exploration. Such tasks are poorly described at onset; the workspace layout is partially unfamiliar, and the task control sequence is only qualitatively characterized. The robot must model the workspace, plan detailed physical actions from qualitative goals, and adapt its instantaneous control regimes to unpredicted events. Developing robust representations and computational approaches for these sensing, planning, and control functions is a major challenge. The underlying domain constraints are very general, and seem to offer little guidance for well-bounded approximation of object shape and motion, manipulation postures and trajectories, and the like. This generalized modeling problem is discussed, with an emphasis on the role of sensing. It is also discussed that unstructured tasks often have, in fact, a high degree of underlying physical symmetry, and such implicit knowledge should be drawn on to model task performance strategies in a methodological fashion. A group-theoretic decomposition of the workspace organization, task goals, and their admissible interactions are proposed. This group-mechanical approach to task representation helps to clarify the functional interplay of perception and control, in essence, describing what perception is specifically for, versus how it is generically modeled. One also gains insight how perception might logically evolve in response to needs of more complex motor skills. It is discussed why, of the many solutions that are often mathematically admissible to a given sensory motor-coordination problem, one may be preferred over others.

Schenker, Paul S.↗
NASA NTRS1986

Prediction of monthly 700 mb heights using simulated medium-range numerical forecasts

Standardized 700 mb heights at 126 grid points over the Northern Hemisphere during 1948-80 were used to quantify the persistence of the heights from one month to the next (using various antecedent period lengths) and to determine predictive skill for calendar-month 700 mb heights using antecedent and simulated prognostic height information. The calculations showed that optimum period length and its corresponding average pattern correlation vary widely over the course of the year, being largest in summer and winter. The skill of models using simulated prog heights was found to be much superior to those using antecedent heights.

Harnack, R.↗
NASA NTRS1990

Systematic errors in the annual and intraseasonal variations of the planetary-scale divergent circulation in NMC medium-range forecasts

The systematic error in the National Meteorological Center's (NMC) medium-range operational forecasts of the global divergence during 1987 and 1988 is examined in this study. As in other operational NWP models the NMC model has too weak an annual mean, annual cycle, and 30-60 day oscillation. This weakness shows up after only a few days, especially over the monsoon region and tropical areas. When the intraseasonal oscillation amplitude is large the model predictive skill is improved. The eastward propagation of the low-frequency mode is well predicted throughout the 10-day forecast period. The north-south migration of the tropical Hadley circulation, depicted primarily by the annual-cycle mode, is also weaker although the phase pattern predicted by the MRF is consistent with analyses.

Chen, Tsing-Chang↗
NASA NTRS2000

The Tropical Rainfall Measuring (TRMM) - What Have We Learned and What Does the Future Hold?

Rainfall is important in the hydrological cycle and to the lives and welfare of humans. In addition to being a life-giving resource, rainfall processes also plays a crucial role in the dynamics of the global atmospheric circulation. Three-fourths of the energy that drives the atmospheric wind circulation comes from the latent heat released by tropical precipitation. It varies greatly in space and time. The rain-producing cloud systems may last several hours or days. Their dimensions range from 10 km to several hundred km. This makes it difficult to incorporate rainfall directly large-scale weather and climate models. Until the end of 1997, precipitation in the global tropics was not known to within a factor of two. Regarding "global warming", the various large-scale models differed among themselves in the predicted magnitude of the warming and in the expected regional effects of these temperature and moisture changes. The Tropical Rainfall Measuring Mission (TRMM) satellite has yielded important interim results related to rainfall observations, data assimilation and model forecast skills when rainfall data is assimilated. This talk will summarize where the TRMM science team is with regards to answering some of these important scientific challenges, as well as discuss the future Global Precipitation Mission which will provide 3 hourly rainfall coverage and offers some unique collaborative potential for NOAA and NASA.

Kummerow, C.↗