SEARCH · Engineering Papers

Results for “time series forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2022

MSASGCN : Multi-Head Self-Attention Spatiotemporal Graph Convolutional Network for Traffic Flow Forecasting

Traffic flow forecasting is an essential task of an intelligent transportation system (ITS), closely related to intelligent transportation management and resource scheduling. Dynamic spatial-temporal dependencies in traffic data make traffic flow forecasting to be a challenging task. Most existing research cannot model dynamic spatial and temporal correlations to achieve well-forecasting performance. The multi-head self-attention mechanism is a valuable method to capture dynamic spatial-temporal correlations, and combining it with graph convolutional networks is a promising solution. Therefore, we propose a multi-head self-attention spatiotemporal graph convolutional network (MSASGCN) model. It can effectively capture local correlations and potential global correlations of spatial structures, can handle dynamic evolution of the road network, and, in the time dimension, can effectively capture dynamic temporal correlations. Experiments on two real datasets verify the stability of our proposed model, obtaining a better prediction performance than the baseline algorithms. The correlation metrics get significantly reduced compared with traditional time series prediction methods and deep learning methods without using graph neural networks, according to MAE and RMSE results. Compared with advanced traffic flow forecasting methods, our model also has a performance improvement and a more stable prediction performance. We also discuss some problems and challenges in traffic forecasting.

Cao, Yang↗

DOE OSTI2022

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The ongoing growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Through access to a large number of time series data sets from different power plants, we have found common issues that impede the modeling process. Namely, the time series data are hard to transfer between groups due to differences in variable nomenclature, and the quality of the data sets can vary. We address the issue of variable nomenclature by FAIRifying spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. We have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. With access to large time series data sets across many power plants, we can utilize spatiotemporal coherence between the sites in order to improve the quality of our data. To solve the issue of data missingness, we propose the use of Spatiotemporal-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

NASA NTRSDate not supplied

Global Solar Activity Data Portal for Studying 3D Dynamics and Activity of the Sun

The main problems with understanding and predicting solar activity are tightly linked to limitations in describing the global evolution of the Sun from the deep interior to the corona. Because of the complexity of interactions in a wide range of dynamical, turbulent, and spatial scales and dramatic changes in thermodynamic and magnetic field conditions, only physics-based models can provide essential background to generate reliable solar activity forecasts. However, performing accurate model calibration and estimating uncertainties is often challenging due to the unavailability of a long time series of observations. To mitigate these limitations, we have developed the Global Solar Activity (GSA) Data Portal, which enables convenient access to a variety of modern and historical data. The portal supports a dynamic visualization for 1D time series (such as the sunspot number and solar irradiance) and quick-look visualization for 2D datasets (e.g., synoptic magnetograms, the solar internal rotation, and flows). The GSA portal includes a search engine that enables data retrieval from user-specified data sources and time intervals. In this presentation, we will discuss the current and upcoming capabilities of the data portal and its potential applications for space weather studies.

SMD↗

NASA NTRS2019

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗

NASA NTRS1993

Comparison between the land surface response of the ECMWF model and the FIFE-1987 data

An averaged time series for the surface data for the 15 x 15 km FIFE site was prepared for the summer of 1987. Comparisons with 48-hr forecasts from the ECMWF model for extended periods in July, August, and October 1987 identified model errors in the incoming SW radiation in clear skies, the ground heat flux, the formulation of surface evaporation, the soil-moisture model, and the entrainment at boundary-layer top. The model clear-sky SW flux is too high at the surface by 5-10 percent. The ground heat flux is too large by a factor of 2 to 3 because of the large thermal capacity of the first soil layer (which is 7 cm thick), and a time truncation error. The surface evaporation was near zero in October 1987, rather than of order 70 W/sq m at noon. The surface evaporation falls too rapidly after rainfall, with a time-scale of a few days rather than the 7-10 d (or more) of the observations. On time-scales of more than a few days the specified 'climate layer' soil moisture, rather than the storage of precipitation, has a large control on the evapotranspiration. The boundary-layer-top entrainment is too low. This results in a moist bias in the boundary-layer mixing ratio of order 2 g/Kg in forecasts from an experimental analysis with nearly realistic surface fluxes; this because there is insufficient downward mixing of dry air.

Betts, Alan K.↗

DOE OSTI2021

Concurrent Optimization of Capital Cost and Expected O&M

Concentrating solar power (CSP) technologies can utilize heat from concentrated sunlight from a field of tracking mirrors to generate electricity, reform fuel, provide process heat, or augment fossil plant heat sources. Electricity-generating power tower systems focus light from thousands of independent heliostats onto a thermal receiver, which uses the focused light to warm a heat transfer fluid (HTF), typically, a molten nitrate salt. The HTF is then sent to a power generation cycle or diverted into thermal energy storage (TES) for later use. Thermal storage is – in principle – a straightforward proposition. However, optimal utilization of a TES resource is complex and multi-faceted: thermal energy may be dispatched to produce electricity immediately upon first availability, or thermal energy may be reserved for next-day peak periods at risk of filling storage and dumping energy, or a portion of the thermal energy can be reserved to maintain equipment temperatures, reducing power cycle startup time, etc. Many possible dispatch permutations variously emphasize producing peak power, operating through transients, expediting daily startup, etc. The best operation strategy can change day-to-day throughout the year, depending on the weather and market pricing forecasts. The project we describe in this report develops a software package that allows users to explore design optimization, operations decisions, and performance characterization of concentrating solar power tower plants. Users interface with the tool through a scripting language, and results are reported in time series tables, plots, runtime logs, and design outputs. Users choose from a list of variables such as tower height, solar multiple, design-point irradiance, thermal storage size, etc., and specify information about the system using a list of parameters. The software can then optimize the specified variables to reduce the cost of energy produced by the system while meeting certain production requirements, accounting for uncertain weather and electricity price forecasts, and correcting for equipment failures or repair time. The software we develop is the first comprehensive design tool of its kind to incorporate all of these aspects while being deployed as open source.

14 SOLAR ENERGY↗

NASA NTRS2016

Nasa Space Flight Instruments: Cost Time Trends

Are NASA’s space flight instruments becoming cheaper or more expensive as time marches forward? After analyzing the costs of hundreds of instruments launched over the last 30 years, the short answer to this question is no… and yes. This paper gives a visual analysis of the cost time trends for various NASA space flight instrument types, such as optical, particles detectors, fields detectors and microwave instruments. In addition to the statistical approaches utilized, such as significance tests, cluster analysis and principle components analysis (PCA), we will also discuss the intangibles which are likely at play, including technological progress, NASA policy and the luck of the draw associated with mission manifests. This analysis was performed as the main driver for the NASA Instrument Cost Model (NICM) recent cost estimating model redesign. Started in 2004, the first version of NICM was based off of instruments launched from 1985-2005, or 20 years’ worth of data. As NICM hit its 10-year anniversary, we wanted to know: should NICM continue to only use the most recent 20 years’ worth of data (1995-2015)? Are instruments becoming cheaper or more expensive as time marches forward? There is evidence in favor of a drop in the median dollar-per-kg value across some instrument types, but little in others. Whereas further research is needed to substantiate, Particles and Optical-Planetary instrument types show moderate to strong evidence of a downward trend in dollar-per-kg. Further research is required to study the nature of this trend (shift, taper, cyclic, etc.). Little evidence for a similar downward trend was detected for Fields or Microwave instruments, or Optical instruments on Earth Orbiting spacecraft. We presented evidence in favor of a drop in the median dollar-per-kg value for Particles and Optical-Planetary instrument types. While similar evidence was weak at best for Fields and Microwave instruments. We can speculate as to the causes for this effect, but we are also equipped to begin to rule out, or at least prioritize, some of the suspected drivers. We observed, for Particles and Optical-Planetary instruments, that perhaps a launch manifest effect was playing part of the role in the observed decrease in dollar-per-kg over the years, noting that the more flagship class missions, which have more money to spend on their instruments, were seen in the earlier years in our data, versus the later years which were dominated by less expensive class missions. However, if this were a dominating driver, would we not have seen the downward trend in the Fields and Microwave instruments as well, which were drawn from that same launch manifest? The fact that we did not observe this helps us rule out the launch manifest effect, and other drivers, such as advances in technology, that seem to be more likely suspects. In that case, however, why would technology advances be helping the Particles and Optical-Planetary instruments only? Why would it not be impacting Optical-Earth Orbiting instruments? Further suspects were looked at as well and ruled out, such as the “Faster, Better, Cheaper”era of NASA development which did not seem to actually impact trends by instrument type on a dollar-perkg scale. VI. Future Work A. Time Series Detailed Statistical Assessment The analysis discussed above sets the foundation for a more rigorous time series analysis of the data. Time series analysis will further explore evidence to-date of time trends for the instrument types which showed the strongest indicators for a decrease in dollar-per-kg: Optical (Planetary) and Particles instruments. More than providing evidence and top-level significance tests, time series analysis would help elucidate what kind of trend that exists in the data, their significance and allow statistically based forecasting (see Figure 10)

Mrozinksi, Joseph↗

NASA NTRSDate not supplied

Cloud-Based Time Series Analysis of Extremes: Use Cases and Applications

"Extreme weather events, such as hurricanes, tornadoes, floods, droughts, heatwaves, and blizzards, can cause widespread damage, disrupting ecosystems, agricultural production, and economies. The frequency and intensity of these events have been increasing, likely due to climate change, raising concerns and the need for more accurate analysis and predictions. NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) has migrated its long-term historical datasets, including precipitation data from MERRA-2 reanalysis, GLDAS land data assimilation, and IMERG satellite observations, to the cloud. This cloud-stored data enables scientists and researchers to utilize cloud computing for advanced modeling and forecasting of extreme weather events, eliminating the need to download large datasets. In this presentation, we will provide an overview of the cloud-based data and services managed by GES DISC; demonstrate methods for accessing and analyzing time series data stored in the cloud; and compare results across various datasets to address critical questions related to extreme precipitation. We will present use cases including: 1. Determining the average total precipitation in California during January and February from 2000 to 2024, and identifying anomalous precipitation in 2021. 2. Calculating the 10, 20, 50, and 100-year return periods for maximum daily rainfall based on 25 years of historical precipitation data (2000-2024) for Maryland.

time series↗

NASA NTRS1984

Analogs in the wintertime 500 mb height field

Lorenz (1969) has considered the possibility that an atmospheric circulation pattern might recur, taking into account the definition of a pair of analogous flows or 'analogs'. The present investigation is concerned with a search of time series of Northern Hemisphere wintertime geopotential heights for possible analogs. Attention is given to data and analysis procedure, analog quality, and error growth rates. The obtained results imply that the found analogs are not a useful tool for forecasting the evolution of the midlatitude flow on time scales of several days. It is pointed out, however, that the negative results should not be extended to other applications of analog forecasting.

Gutzler, D. S.↗

NASA NTRS2014

Soil Dust Aerosols and Wind as Predictors of Seasonal Meningitis Incidence in Niger

Background: Epidemics of meningococcal meningitis are concentrated in sub-Saharan Africa during the dry season, a period when the region is affected by the Harmattan, a dry and dusty northeasterly trade wind blowing from the Sahara into the Gulf of Guinea.Objectives: We examined the potential of climate-based statistical forecasting models to predict seasonal incidence of meningitis in Niger at both the national and district levels.Data and methods: We used time series of meningitis incidence from 1986 through 2006 for 38 districts in Niger. We tested models based on data that would be readily available in an operational framework, such as climate and dust, population, and the incidence of early cases before the onset of the meningitis season in January-May. Incidence was used as a proxy for immunological state.

Soil dust↗

NASA NTRS2022

Maine Ecological Forecasting II: Identifying Forest Cover and Assessing Federally Endangered Atlantic Salmon Habitat in Maine Using Earth Observations

Major declines in Atlantic salmon (Salmo salar) populations have occurred alongside dam construction, shifting temperatures, and changing land use and land cover (LULC), restricting the last remaining wild population in the United States to Maine. In collaboration with the Maine Department of Marine Resources and the Downeast Salmon Federation, the NASA DEVELOP team utilized Earth observations to assess changes within critical salmon habitat. The team used the Landsat 5 Thematic Mapper (TM), Landsat 8 Operation Land Imager (OLI), Sentinel-2 MultiSpectral Instrument (MSI), and National Land Cover Database (NLCD) to refine historical LULC maps from 1985 to 2021. The team also used elevation data from the Shuttle Radar Topography Mission (SRTM) and IDRISI TerrSet Land Change Modeler to forecast LULC change to 2040. From Terra Moderate Resolution Imaging Spectroradiometer (MODIS) land surface temperature (LST) data, the team derived a time series, summer averages, and anomaly maps between 2000 and 2021. The team analyzed LST in relation to LULC classes, specifically forest cover type, and in-situ stream temperature from the Spatial Hydro-Ecological Decision System (EcoSHEDS). LULC trends from 1985 to 2021 revealed a net transition of coniferous forest to other classes, such as deciduous forest and developed land. The team found an association between warmer temperatures and a greater presence of developed and mixed forest classes per 10,000 acres across Maine. These visualizations and analyses will aid partners in identifying riparian locations with ideal or unfavorable habitat conditions to inform Atlantic salmon population recovery efforts.

Tony Bowman↗

NASA NTRS1993

Solar flux forecasting using mutual information with an optimal delay

Solar flux F(sub 10.7) directly affects the atmospheric density, thereby changing the lifetime and prediction of satellite orbits. For this reason, accurate forecasting of F(sub 10.7) is crucial for orbit determination of spacecraft. Our attempts to model and forecast F(sub 10.7) uncovered highly entangled dynamics. We concluded that the general lack of predictability in solar activity arises from its nonlinear nature. Nonlinear dynamics allow us to predict F(sub 10.7) more accurately than is possible using stochastic methods for time scales shorter than a characteristic horizon, and with about the same accuracy as using stochastic techniques when the forecasted data exceed this horizon. The forecast horizon is a function of two dynamical invariants: the attractor dimension and the Lyapunov exponent. In recent years, estimation of the attractor dimension reconstructed from a time series has become an important tool in data analysis. In calculating the invariants of the system, the first necessary step is the reconstruction of the attractor for the system from the time-delayed values of the time series. The choice of the time delay is critical for this reconstruction. For an infinite amount of noise-free data, the time delay can, in principle, be chosen almost arbitrarily. However, the quality of the phase portraits produced using the time-delay technique is determined by the value chosen for the delay time. Fraser and Swinney have shown that a good choice for this time delay is the one suggested by Shaw, which uses the first local minimum of the mutual information rather than the autocorrelation function to determine the time delay. This paper presents a refinement of this criterion and applies the refined technique to solar flux data to produce a forecast of the solar activity.

Ashrafi, S.↗

NASA NTRS2023

Development of Solar Energetic Particle Prediction Portal (SEP3)

Robust prediction of Solar Energetic Particle (SEP) events is among the key priorities of the space weather community. In the framework of NASA’s Early Stage Innovation Program, we develop the Solar Energetic Particle Prediction Portal (SEP3: https://sun.njit.edu/SEP3), which hosts web applications that allow the users to retrieve the database records. In particular, SEP3 lists the API examples to query each data source potentially important for the SEP prediction. The Portal has a search page for browsing the events from the most widely used catalogs (https://sun.njit.edu/SEP3/search.php) and a dedicated space to share the most recent achievements of the team. In addition, we have added a CDAW SEP catalog and a LASCO/SOHO CME catalog and introduced the possibility of displaying the properties of the connected events (parental solar flares and CMEs for SEPs) on the search page. The interactive widget has the capability to display GOES soft X-ray and proton flux time series from different satellites with the GOES flare records on top of them. The data portal has been used to evaluate the forecasts of the solar proton events based on the statistical properties of the GOES soft X-ray and proton fluxes and investigate machine-learning approaches to the SEP prediction.

SMD↗

NASA NTRS2017

Identifying Stratospheric Air Intrusions and Associated Hurricane-Force Wind Events over the North Pacific Ocean

Motivation: Ocean data is sparse: reliance on satellite imagery for marine forecasting; Ocean Prediction Center (OPC) –“mariner’s weather lifeline”. Responsible for: Pacific, Atlantic, Pacific Alaska surface analyses –24, 48, 96 hrs.; Wind & wave analyses –24, 48, 96 hrs.; Issue warnings, make decisions, Geostationary Operational Environmental Satellite –R Series (now GOES-16), Compared to the old GOES: 3 times spectral resolution, 4 times spatial resolution, 5 times faster coverage; Comparable to Japanese Meteorological Agency’s Himawari-8, used a lot throughout this research. Research Question: How can integrating satellite data imagery and derived products help forecasters improve prognosis of rapid cyclogenesis and hurricane-force wind events? Phase I –Identifying stratospheric air intrusions: Water Vapor –6.2, 6.9, 7.3 micron channels; Airmass RGB Product; AIRS, IASI, NUCAPS total column ozone and ozone anomaly; ASCAT (A/B) and AMSR-2 wind data.

Ozone↗

NASA NTRS2019

Near Real-Time Sub/Seasonal Prediction of Aerosol and Air Quality at the NASA Global Modeling and Assimilation Office

Version 2 of the coupled modeling and analysis system used to produce near real time subseasonal to seasonal forecasts was released almost two years ago by the NASA/Goddard Global Modeling and Assimilation Office. The model runs at approximately 1/2 degree globally in the atmosphere and ocean, contains a realistic description of the cryosphere, and includes an interactive aerosol model. The data assimilation used to produce initial conditions is weakly coupled, in which the atmosphere-only assimilated state is coupled to an ocean data assimilation system using a Local Ensemble Transform Kalman Filter. Results of aerosol-derived air quality (Particulate Matter) from an extensive series of retrospective forecasts will be shown, with particular focus on the continental United States and eastern Asia. In addition, under some circumstances, the interactive aerosol is shown to improve seasonal time scale prediction skill. Plans for a future version of the system with predicted biomass burning from fires will also be discussed.

Molod, Andrea↗

NASA NTRS1981

The potential impact of scatterometry on oceanography - A wave forecasting case

A series of observing system simulation experiments have been performed in order to assess the potential impact of marine surface wind data on numerical weather prediction. In addition to conventional data, the experiments simulated the time-continuous assimilation of remotely sensed marine surface wind or temperature sounding data. The wind data were fabricated directly for model grid points intercepted by a Seasat-1 scatterometer swath and were assimilated into the lowest active level (945 mb) of the model using a localized successive correction method. It is shown that Seasat wind data can greatly improve numerical weather forecasts due to better definition of specific features. The case of the QE II storm is examined.

Cane, M. A.↗

DOE OSTI2020

Atmospheric condition identification in multivariate data through a metric for total variation

Identification of atmospheric conditions within a multivariable atmospheric data set is a necessary step in the validation of emerging and existing high-fidelity models used to simulate wind plant flows and operation.Atmospheric conditions relevant for wind energy research include stationary conditions, given the need for well-converged statistics for model validation, as well as conditions observed less frequently, such as extreme atmospheric events, which are used in wind turbine and wind plant design.Aggregation of observations without regard to covariance between time series discounts the dynamical nature of the atmosphere and is not sufficiently representative of atmospheric conditions.Identification and characterization of continuous time periods with atmospheric conditions that have a high value for analysis or simulation set the stage for more advanced model validation and the development of real-time control and operational strategies.The current work explores a single metric for variation in a multivariate data sample that quantifies variability within each channel as well as covariance between channels.The total variation is used to identify conditions of interest that conform to desired objective functions, such as stationary conditions, ramps or waves of wind speed, and changes in wind direction.Total variation is somewhat sensitive to the presence of outliers in the input data, and the method is best complemented by quality-control procedures to ensure reliable results.The direct detection and classification of events or conditions of interest within atmospheric data sets is vital to developing our understanding of wind plant response and to the formulation of forecasting and control models.

17 WIND ENERGY↗

NASA NTRS1993

A direct evaluation of the Geosat altimeter wet atmospheric range delay using very long baseline interferometry observations

The overall accuracy of the U.S. Navy Geosat altimeter wet atmospheric range delay caused by refraction through the atmosphere is directly assessed by comparing the estimates made from the DMSP Special Sensor Microwave/Imager and the U.S. Navy Fleet Numerical Ocean Center forecast model for Geosat with measurements of total zenith columnar water vapor content from four VLBI sites. The assessment is made by comparing time series of range delay from various methods at each location. To determine the importance of diurnal variation in water vapor content in noncoincident estimates, the VLBI measurements were made at 15-min intervals over a few days. The VLBI measurements showed strong diurnal variations in columnar water vapor at several sites, causing errors of the order 3 cm rms in any noncoincident measurement of the wet troposphere range delay. These errors have an effect on studies of annual and interannual changes in sea level with Geosat data.

Koblinsky, C. J.↗