Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A mesoscale numerical simulation of an index for use in the forecasting of the potential severity of wet microbursts

This paper demonstrates the feasibility of using the wet microburst potential intensity index developed by Proctor (1989) for predicting the onset of a wet microburst. After describing the index and the principles involved in its derivation, the version 4.0 of the Mesoscale Atmospheric Simulation System (MASS) model described by Karyampudi et al. (1988) was used to illustrate how the index would perform as a forecast product. An analysis is presented of the use of the microburst potential intensity index in the numerical simulation of the DFR aircraft accident on August 2, 1985 in a downburst environment.

Zack, John W.↗

Performance of a Local Mesoscale Model with Data Denial

Forecasters at the 45th Weather Squadron (45 WS) use observations from the Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) wind tower network and daily rawinsonde observations (RAOB) to issue and verify wind advisories, watches, and warnings for operations. They are also used by the Spaceflight Meteorology Group and Melbourne, Florida National Weather Service to initialize locally run mesoscale models. Due to impending budget cuts, some or all of the mainland wind towers and RAOBs may be eliminated, The loss of these data may significantly impact the forecast capability of the 45 WS and SMG. The Applied Meteorology Unit (AMU) was tasked to conduct an objective independent modeling study to determine how important these observations are to the accuracy of the model output used by the forecasters as input to their forecasts. To accomplish this, the AMU performed a sensitivity study using the Weather Research and Forecasting (WRF) model run with and without KSC/CCAFS wind tower and CCAFS RAOB observations and assessed the accuracy of model forecasts by comparing them to the observations.

Watson, Leela↗

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗

Cold Season QPF: Sensitivities to Snow Parameterizations and Comparisons to NASA CloudSat Observations

As operational numerical weather prediction is performed at increasingly finer spatial resolution, precipitation traditionally represented by sub-grid scale parameterization schemes is now being calculated explicitly through the use of single- or multi-moment, bulk water microphysics schemes. As computational resources grow, the real-time application of these schemes is becoming available to a broader audience, ranging from national meteorological centers to their component forecast offices. A need for improved quantitative precipitation forecasts has been highlighted by the United States Weather Research Program, which advised that gains in forecasting skill will draw upon improved simulations of clouds and cloud microphysical processes. Investments in space-borne remote sensing have produced the NASA A-Train of polar orbiting satellites, specially equipped to observe and catalog cloud properties. The NASA CloudSat instrument, a recent addition to the A-Train and the first 94 GHz radar system operated in space, provides a unique opportunity to compare observed cloud profiles to their modeled counterparts. Comparisons are available through the use of a radiative transfer model (QuickBeam), which simulates 94 GHz radar returns based on the microphysics of cloudy model profiles and the prescribed characteristics of their constituent hydrometeor classes. CloudSat observations of snowfall are presented for a case in the central United States, with comparisons made to precipitating clouds as simulated by the Weather Research and Forecasting Model and the Goddard single-moment microphysics scheme. An additional forecast cycle is performed with a temperature-based parameterization of the snow distribution slope parameter, with comparisons to CloudSat observations provided through the QuickBeam simulator.

Molthan, A. L.↗

NASA Physics of Failure (PoF) for Reliability

An item’s reliability or longevity is dependent not only on its design but also on how it is used, manufactured, tested, and the stresses it has or will experience. Stresses include operational and environmental exposures to thermal, voltage, current, age/exposure, mechanical, and radiation mechanisms. Therefore, in reliability analysis, it is important to consider the contributions of all of these factors when predicting the failure rates of components. Historically, there has been a reliance on handbook data (e.g., MIL-HDBK-217), but experience has shown that these values and distributions are not representative of actual performance (1,2). Therefore, to make more credible reliability and risk assessments for its missions, NASA must transition to estimating likelihoods of failure based on an item’s reliability/longevity factors (or the physical susceptibilities and strengths impacting the design’s performance) has or will experience, whenever possible. To facilitate this transition a “Handbook on Methodology for Physics of Failure Based Reliability Assessments” has been developed by NASA to assist in applying physics experiences or experiment physics for empirical analysis and conceptualized physics exposures or theoretical physics for deterministic analysis, to develop and aggregate realistic likelihoods of failure leading to more credible forecasts of item performance and longevity. In addition, since it is NASA’s intention that this document continues to evolve based on community lessons learned and the introduction of new assessment methodologies, NASA is encouraging and appreciates the contributions of current and future authors to maintain and enhance this handbook and its supporting case studies.

Physics of Failure↗

NASA Physics of Failure (PoF) for Reliability

An item’s reliability or longevity is dependent not only on its design but also on how it is used, manufactured, tested, and the stresses it has or will experience. Stresses include operational and environmental exposures to thermal, voltage, current, age/exposure, mechanical, and radiation mechanisms. Therefore, in reliability analysis, it is important to consider the contributions of all these factors when predicting the failure rates of components. Historically, there has been a reliance on handbook data (e.g., MIL-HDBK-217), but experience has shown that these values and distributions are not representative of actual performance. Therefore, to make more credible reliability and risk assessments for its missions, NASA must transition to estimating likelihoods of failure based on an item’s reliability or longevity factors (or the physical susceptibilities and strengths impacting the design’s performance) has or will experience, whenever possible. To facilitate this transition, a Handbook on Methodology for Physics of Failure Based Reliability Assessments has been developed by NASA to assist in applying physics experiences or experimental physics for empirical analysis and conceptualized physics exposures or theoretical physics for deterministic analysis, to develop and aggregate realistic likelihoods of failure leading to more credible forecasts of item performance and longevity. In addition, since it is NASA’s intention that this document continues to evolve based on community lessons learned and the introduction of new assessment methodologies, NASA is encouraging and appreciates the contributions of current and future authors to maintain and enhance this handbook and its supporting case studies.

PoF↗

A New ML-Based Adaptive Thinning Methodology to Improve the Impact of AIRS and CrIS Assimilation on Global Tropical Cyclone Forecasts

This work builds on previous research performed by this team to improve the forecast of Tropical Cyclones (TCs) by assimilating AIRS and CrIS radiances into the NASA Global Earth Observing System (GEOS). Past published work demonstrated that the assimilation of radiances with variable density was beneficial to TC forecasting in the GEOS. In the previous setup, a fixed-size moving square named 'TC domain' was activated by the so-called TC-vitals, an international real-time message accessible to all NWP forecasting centers, that documents the existence of a TC, its estimated position, and its size. The information from TC-vitals activated a switch in the GEOS, which allowed to reduce the distance used for thinning AIRS and CrIS data inside a 15 degrees by 15 degrees moving TC domain centered on the storm, so that more data were assimilated in the vicinity of the TC during its lifetime. The methodology produced improved TC analyses and led to better forecasts, particularly related to intensity, without damaging the global forecast skill. In the new version, the adaptive thinning methodology is based on a machine-learning technique. The technique searches for TCs and creates TC masks by using cloud-top temperatures from all geostationary satellites without the need for additional information. It is being trained against the International Best Track Archive for Climate Stewardship (IBTrACS) data base. Once a TC mask is created, a switch identical to the one used in the previous adaptive thinning method is activated, allowing the GEOS to ingest more data in the TC-shaped size-changing domain that follows the storm. As of today, the team has been able to successfully assimilate data inside the ML-detected TC domains. Future work includes an improved capability of reducing false alarm rates (i.e., cloud systems that are erroneously labeled as TCs).

Oreste Reale↗

Decomposition of Sources of Errors in Seasonal Streamflow Forecasting over the U.S. Sunbelt

Seasonal streamflow forecasts, contingent on climate information, can be utilized to ensure water supply for multiple uses including municipal demands, hydroelectric power generation, and for planning agricultural operations. However, uncertainties in the streamflow forecasts pose significant challenges in their utilization in real-time operations. In this study, we systematically decompose various sources of errors in developing seasonal streamflow forecasts from two Land Surface Models (LSMs) (Noah3.2 and CLM2), which are forced with downscaled and disaggregated climate forecasts. In particular, the study quantifies the relative contributions of the sources of errors from LSMs, climate forecasts, and downscaling/disaggregation techniques in developing seasonal streamflow forecast. For this purpose, three month ahead seasonal precipitation forecasts from the ECHAM4.5 general circulation model (GCM) were statistically downscaled from 2.8deg to 1/8deg spatial resolution using principal component regression (PCR) and then temporally disaggregated from monthly to daily time step using kernel-nearest neighbor (K-NN) approach. For other climatic forcings, excluding precipitation, we considered the North American Land Data Assimilation System version 2 (NLDAS-2) hourly climatology over the years 1979 to 2010. Then the selected LSMs were forced with precipitation forecasts and NLDAS-2 hourly climatology to develop retrospective seasonal streamflow forecasts over a period of 20 years (1991-2010). Finally, the performance of LSMs in forecasting streamflow under different schemes was analyzed to quantify the relative contribution of various sources of errors in developing seasonal streamflow forecast. Our results indicate that the most dominant source of errors during winter and fall seasons is the errors due to ECHAM4.5 precipitation forecasts, while temporal disaggregation scheme contributes to maximum errors during summer season.

Decomposition↗

Forecasting Sensorimotor Adaptability from Baseline Inter-Trial Correlations

One of the greatest challenges surrounding adaptation to the spaceflight environment is the large variability in symptoms, and corresponding functional impairments, from one crewmember to the next. This renders preflight training and countermeasure development difficult, as a "one-size-fits-all" approach is inappropriate. Therefore, it would be highly advantageous to know ahead of time which crewmembers might have more difficulty adjusting to the novel g-levels inherent to spaceflight. Such knowledge could guide individually customized countermeasures, which would enable more efficient use of crew time, both preflight and inflight, and provide better outcomes. The primary goal of this project is to look for a baseline performance metric that can forecast sensorimotor adaptability without exposure to an adaptive stimulus. We propose a novel hypothesis that considers baseline inter-trial correlations, the trial-to-trial fluctuations in motor performance, as a predictor of individual sensorimotor adaptive capabilities. To-date, a strong relationship has been found between baseline inter-trial correlations and adaptability in two oculomotor systems. For this project, we will explore an analogous predictive mechanism in the locomotion system. METHODS: Baseline Inter-trial Correlations: Inter-trial correlations specify the relationships among repeated trials of a given task that transpire as a consequence of correcting for previous performance errors over multiple timescales. We can quantify the strength of inter-trial correlations by measuring the decay of the autocorrelation function (ACF), which describes how rapidly information from past trials is "forgotten." Processes whose ACFs decay more slowly exhibit longer-term inter-trial correlations (longer memory processes), while processes whose ACFs decay more rapidly exhibit shorterterm inter-trial correlations (shorter memory processes). Longer-term correlations reflect low-frequency activity, which is more easily measured in the frequency domain. Therefore, we use the power spectrum (PS), which is the Fourier transform of the ACF, to describe our inter-trial correlations. The decay of the PS yields a straight line on a log-log frequency plot, which we quantify by Beta = - (slope of PS on log-log axes). Hence, Beta is a measure of the strength of inter- trial correlations in the baseline data. Larger Beta values are indicative of longer inter-trial correlations. Experimental Approach: We will begin by performing a retrospective analysis of treadmill-gait adaptation data previously collected by Dr. Bloomberg and colleagues. Specifically, we will quantify the strength of inter-trial correlations in the baseline step cadence and heart rate data and compare it to the locomotor adaptability performance results already described by these investigators. Incorporating these datasets will also allow us to explore the applicability of (and potential limitations surrounding) the use of Beta in forecasting physiological performance. We will also perform a new experiment, in which Beta will be derived from baseline data collected during over-ground (non-treadmill) walking, which will enable us to consider locomotor performance, through the parameter Beta, under the most functionallyrelevant, natural gait condition. This experiment will incorporate two baseline and five post-training over-ground locomotion tests to explore the consistency and potential adaptability of the Beta values themselves. HYPOTHESES: We hypothesize that the strength of baseline inter-trial correlations of step cadence and heart rate will relate to locomotor adaptability. Specifically, we anticipate that individuals who show weaker longer-term inter-trial correlations in baseline step cadence data will be the better adaptors, as step cadence can be modified in real-time (i.e., online corrections are an inherent property of the locomotor system; analogous to results observed in the VOR). Conversely, because heart rate is not altered mid-beat, we expect that individuals who demonstrate stronger longer-term correlations in heart rate will be the better adaptors (analogous to results observed in the saccadic system). CONCLUSIONS: At the conclusion of this project we hope to uncover a baseline predictor of locomotor adaptability. If our hypotheses hold true, our results will demonstrate that the temporal structure of baseline behavioral data contains important information that may aid in forecasting adaptive capacities. The ability to predict such adaptability in the sensorimotor system has significant implications for spaceflight, where astronauts must adjust their motor programs following a change in g-level to retain movement accuracy.

Beaton, K. H.↗

Trajectory-Based Performance Assessment for Aviation Weather Information

Based on an analysis of aviation decision-makers' time-related weather information needs, an abstraction of the aviation weather decision task was developed, that involves 4-D intersection testing between aircraft trajectory hypertubes and hazardous weather hypervolumes. The framework builds on the hypothesis that hazardous meteorological fields can be simplified using discrete boundaries of surrogate threat attributes. The abstractions developed in the framework may be useful in studying how to improve the performance of weather forecasts from the trajectory-centric perspective, as well as for developing useful visualization techniques of weather information.

Vigeant-Langlois, Laurence↗

Complexity Computational Environment: Data Assimilation SERVOGrid

We are using Web (Grid) service technology to demonstrate the assimilation of multiple distributed data sources (a typical data grid problem) into a major parallel high-performance computing earthquake forecasting code. Such a linkage of Geoinformatics with Geocomplexity demonstrates the value of the Solid Earth Research Virtual Observatory (SERVO) Grid concept, and advance Grid technology by building the first real-time large-scale data assimilation grid Here we develop the next steps for both the SERVO concept and the identified need for a Solid Earth problem-solving environment. We use a challenging motivating problem of importance to NASA namely integrating NASA space geodetic observations with numerical simulations of a changing earth.

data assimiliation↗

QuakeSim and the Solid Earth Research Virtual Observatory

We are developing simulation and analysis tools in order to develop a solid Earth science framework for understanding and studying active tectonic and earthquake processes. The goal of QuakeSim and its extension, the Solid Earth Research Virtual Observatory (SERVO), is to study the physics of earthquakes using state-of-the-art modeling, data manipulation, and pattern recognition technologies. We are developing clearly defined accessible data formats and code protocols as inputs to simulations, which are adapted to high-performance computers. The solid Earth system is extremely complex and nonlinear resulting in computationally intensive problems with millions of unknowns. With these tools it will be possible to construct the more complex models and simulations necessary to develop hazard assessment systems critical for reducing future losses from major earthquakes. We are using Web (Grid) service technology to demonstrate the assimilation of multiple distributed data sources (a typical data grid problem) into a major parallel high-performance computing earthquake forecasting code. Such a linkage of Geoinformatics with Geocomplexity demonstrates the value of the Solid Earth Research Virtual Observatory (SERVO) Grid concept, and advances Grid technology by building the first real-time large-scale data assimilation grid.

virtual observatory↗

Assessing the Impact of Observations on Numerical Weather Forecasts Using the Adjoint Method

The adjoint of a data assimilation system provides a flexible and efficient tool for estimating observation impacts on short-range weather forecasts. The impacts of any or all observations can be estimated simultaneously based on a single execution of the adjoint system. The results can be easily aggregated according to data type, location, channel, etc., making this technique especially attractive for examining the impacts of new hyper-spectral satellite instruments and for conducting regular, even near-real time, monitoring of the entire observing system. This talk provides a general overview of the adjoint method, including the theoretical basis and practical implementation of the technique. Results are presented from the adjoint-based observation impact monitoring tool in NASA's GEOS-5 global atmospheric data assimilation and forecast system. When performed in conjunction with standard observing system experiments (OSEs), the adjoint results reveal both redundancies and dependencies between observing system impacts as observations are added or removed from the assimilation system. Understanding these dependencies may be important for optimizing the use of the current observational network and defining requirements for future observing systems

Gelaro, Ronald↗

Space Evaporator-Absorber-Radiator (SEAR)

A system for non-venting thermal control for spacesuits was built by integrating two previously developed technologies, namely NASA s Spacesuit Water Membrane Evaporator (SWME), and Creare s flexible version of the Lithium Chloride Absorber Radiator (LCAR). This SEAR system was tested in relevant thermal vacuum conditions. These tests show that a 1 m2 radiator having about three times as much absorption media as in the test article would be required to support a 7 hour spacewalk. The serial flow arrangement of the LCAR of the flexible version proved to be inefficient for venting non-condensable gas (NCG). A different LCAR packaging arrangement was conceived wherein the Portable Life Support System (PLSS) housing would be made with a high-strength carbon fiber composite honeycomb, the cells of which would be filled with the chemical absorption media. This new packaging reduces the mass and volume impact of the SEAR on the Portable Life Support System (PLSS) compared to the flexible design. A 0.2 sq m panel with flight-like honeycomb geometry is being constructed and will be tested in thermal and thermal vacuum conditions. Design analyses forecast improved system performance and improved NCG control. A flight-like regeneration system also is also being built and tested. Design analyses for the structurally integrated prototype as well as the earlier test data show that SEAR is not only practical for spacesuits but also has useful applications in spacecraft thermal control.

Bue, Grant C.↗

Multifunctional Space Evaporator-Absorber-Radiator (SEAR)

A system for non-venting thermal control for spacesuits was built by integrating two previously developed technologies, namely NASA's Spacesuit Water Membrane Evaporator (SWME), and Creare's flexible version of the Lithium Chloride Absorber Radiator (LCAR). This SEAR system was tested in relevant thermal vacuum conditions. These tests show that a 1 sq m radiator having about three times as much absorption media as in the test article would be required to support a 7 hour spacewalk. The serial flow arrangement of the LCAR of the flexible version proved to be inefficient for venting non-condensable gas (NCG). A different LCAR packaging arrangement was conceived wherein the Portable Life Support System (PLSS) housing would be made with a high-strength carbon fiber composite honeycomb, the cells of which would be filled with the chemical absorption media. This new packaging reduce the mass and volume impact of the SEAR on the Portable Life Support System (PLSS) compared to the flexible design. A 0.2 sq m panel with flight-like honeycomb geometry is being constructed and will be tested in thermal and thermal vacuum conditions. Design analyses forecast improved system performance and improved NCG control. A flight-like regeneration system also is also being built and tested. Design analyses for the structurally integrated prototype as well as the earlier test data show that SEAR is not only practical for spacesuits but also has useful applications in spacecraft thermal control.

Bue, Grant C.↗

Surface Pressure Dependencies in the GEOS-Chem-Adjoint System and the Impact of the GEOS-5 Surface Pressure on CO2 Model Forecast

In the GEOS-Chem Adjoint (GCA) system, the total (wet) surface pressure of the GEOS meteorology is employed as dry surface pressure, ignoring the presence of water vapor. The Jet Propulsion Laboratory (JPL) Carbon Monitoring System (CMS) research team has been evaluating the impact of the above discrepancy on the CO2 model forecast and the CO2 flux inversion. The JPL CMS research utilizes a multi-mission assimilation framework developed by the Multi-Mission Observation Operator (M2O2) research team at JPL extending the GCA system. The GCA-M2O2 framework facilitates mission-generic 3D and 4D-variational assimilations streamlining the interfaces to the satellite data products and prior emission inventories. The GCA-M2O2 framework currently integrates the GCA system version 35h and provides a dry surface pressure setup to allow the CO2 model forecast to be performed with the GEOS-5 surface pressure directly or after converting it to dry surface pressure.

Lee, Meemong↗

Using the Coronal Evolution to Successfully Forward Model CMEs' In Situ Magnetic Profiles

Predicting the effects of a coronal mass ejection (CME) impact requires knowing if impact will occur, which part of the CME impacts, and its magnetic properties. We explore the relation between CME deflections and rotations, which change the position and orientation of a CME, and the resulting magnetic profiles at 1 AU. For 45 STEREO-era, Earth-impacting CMEs, we determine the solar source of each CME, reconstruct its coronal position and orientation, and perform a ForeCAT (Forecasting a CME's Altered Trajectory) simulation of the coronal deflection and rotation. From the reconstructed and modeled CME deflections and rotations, we determine the solar cycle variation and correlations with CME properties. We assume no evolution between the outer corona and 1 AU and use the ForeCAT results to drive the ForeCAT In situ Data Observer (FIDO) in situ magnetic field model, allowing for comparisons with ACE and Wind observations. We do not attempt to reproduce the arrival time. On average FIDO reproduces the in situ magnetic field for each vector component with an error equivalent to 35 percent of the average total magnetic field strength when the total modeled magnetic field is scaled to match the average observed value. Random walk best fits distinguish between ForeCAT's ability to determine FIDO's input parameters and the limitations of the simple flux rope model. These best fits reduce the average error to 30 percent.The FIDO results are sensitive to changes of order a degree in the CME latitude, longitude, and tilt, suggesting that accurate space weather predictions require accurate measurements of a CME's position and orientation.

Kay, C.↗