Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Predominant periods in the time series of drought area index for the Western High Plains AD 1700 to 1962

The detection of the combined presence of the Hale magnetic sunspot cycle (22.28 years) and the lunar nodal tidal cycle (18.61 years) in both the Eastern North American January air temperatures and the Western U.S. High Plains drought series led to an extended analysis of the Drought Area Index time series. This analysis indicated that the mean dominant period of the drought series should be 20.0 to 20.5 years and that the principal period should be resolvable into two components of about 22.28 and 18.61 years. This note details the successful accomplishment of this task.

Bell, P. R.↗

How Accurate is Land/Ocean Moisture Transport Variability in Reanalyses?

Quantifying the global hydrological cycle and its variability across various time scales remains a challenge to the climate community. Direct measurements of evaporation (E), evapotranspiration (ET), and precipitation (P) are not feasible on a global scale, nor is the transport of water vapor over the global oceans and sparsely populated land areas. Expanding satellite data streams have enabled development of various water (and energy) flux products, complementing reanalyses and facilitating observationally constrained modeling. But the evolution of the global observing system has produced additional complications--improvements in satellite sensor resolution and accuracy have resulted in "epochs" of observational quasi-uniformity that can adversely affect reanalysis trends. In this work we focus on vertically integrated moisture flux convergence (VMFC) variations within the period 1979 - present integrated over global land. We show that VMFC in recent reanalyses (e.g. ERA-I, NASA MERRA, NOAA CFSR and JRA55) suffers from observing system changes, though differently in each product. Land Surface Models (LSMs) forced with observations-based precipitation, radiation and near-surface meteorology share closely the interannual P-ET variations of the reanalyses associated with ENSO events. (VMFC over land and P-ET estimates are equivalent quantities since atmospheric storage changes are small on these scales.) But the long-term LSM trend over the period since 1979 is approximately one-fourth that of the reanalyses. Additional reduced observation reanalyses assimilating only surface pressure and /or specifying seasurface temperature also have a much smaller trend in P-ET like the LSMs. We explore the regional manifestation of the reanalysis P-ET / VMFC problems, particularly over land. Both principal component analysis and a simple time series changepoint analysis highlight problems associated with data poor regions such as Equatorial Africa and, for one reanalysis, the Equatorial Andes region. Onset of the availability of passive microwave Special Sensor Microwave Imager (SSMI) moisture data in July 1987 and the transition from the Microwave Sounder Unit (MSU) to an advanced version (AMSU) have significant impacts on VMFC variability. Simple accounting for these errors of leading importance results in modified reanalysis VMFC estimates that agree much better with the LSM results. Regional details of the modified reanalysis VMFC and LSM P-ET are related to changes in Pacific Decadal Variability as manifest in SST changes after the late 1990s.

Robertson, F. R.↗

Chromospheric Variability: Analysis of 36 years of Time Series from the National Solar Observatory/Sacramento Peak Ca II K-line Monitoring Program

Analysis of more than 36 years of time series of seven parameters measured in the NSO/AFRL/Sac Peak K-line monitoring program elucidates five elucidates five components of the variation: (1) the solar cycle (period approx. 11 years), (2) quasi-periodic variations (periods approx 100 days), (3) a broad band stochastic process (wide range of periods), (4) rotational modulation, and (5) random observational errors. Correlation and power spectrum analyses elucidate periodic and aperiodic variation of the chromospheric parameters. Time-frequency analysis illuminates periodic and quasi periodic signals, details of frequency modulation due to differential rotation, and in particular elucidates the rather complex harmonic structure (1) and (2) at time scales in the range approx 0.1 - 10 years. These results using only full-disk data further suggest that similar analyses will be useful at detecting and characterizing differential rotation in stars from stellar light-curves such as those being produced by NASA's Kepler observatory. Component (3) consists of variations over a range of timescales, in the manner of a 1/f random noise process. A timedependent Wilson-Bappu effect appears to be present in the solar cycle variations (1), but not in the stochastic process (3). Component (4) characterizes differential rotation of the active regions, and (5) is of course not characteristic of solar variability, but the fact that the observational errors are quite small greatly facilitates the analysis of the other components. The recent data suggest that the current cycle is starting late and may be relatively weak. The data analyzed in this paper can be found at the National Solar Observatory web site http://nsosp.nso.edu/cak_mon/, or by file transfer protocol at ftp://ftp.nso.edu/idl/cak.parameters.

Solar physics↗

Rotation of EOFs by the Independent Component Analysis: Towards A Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

The Independent Component Analysis is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components, a stronger constraint that uses higher-order statistics, instead of the classical decorrelation, a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e. exploratory approach). We demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis, the Independent Component Analysis performs a rotation of the classical PCA (or EOF) solution. This rotation uses no localization criterion like other Rotation Techniques (RT), only the global generalization of decorrelation by statistical independence is used. This rotation of the PCA solution seems to be able to solve the tendency of PCA to mix several physical phenomena, even when the signal is just their linear sum.

Aires, Filipe↗

Rotation of EOFs by the Independent Component Analysis: Towards a Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

The Independent Component Analysis is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components, a stronger constraint that uses higher-order statistics, instead of the classical decorrelation, a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e. exploratory approach). We demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis, the Independent Component Analysis performs a rotation of the classical PCA (or EOF) solution. This rotation uses no localization criterion like other Rotation Techniques (RT), only the global generalization of decorrelation by statistical independence is used. This rotation of the PCA solution seems to be able to solve the tendency of PCA to mix several physical phenomena, even when the signal is just their linear sum.

Aires, Filipe↗

The Statistical Consulting Center for Astronomy (SCCA)

The process by which raw astronomical data acquisition is transformed into scientifically meaningful results and interpretation typically involves many statistical steps. Traditional astronomy limits itself to a narrow range of old and familiar statistical methods: means and standard deviations; least-squares methods like chi(sup 2) minimization; and simple nonparametric procedures such as the Kolmogorov-Smirnov tests. These tools are often inadequate for the complex problems and datasets under investigations, and recent years have witnessed an increased usage of maximum-likelihood, survival analysis, multivariate analysis, wavelet and advanced time-series methods. The Statistical Consulting Center for Astronomy (SCCA) assisted astronomers with the use of sophisticated tools, and to match these tools with specific problems. The SCCA operated with two professors of statistics and a professor of astronomy working together. Questions were received by e-mail, and were discussed in detail with the questioner. Summaries of those questions and answers leading to new approaches were posted on the Web (www.state.psu.edu/ mga/SCCA). In addition to serving individual astronomers, the SCCA established a Web site for general use that provides hypertext links to selected on-line public-domain statistical software and services. The StatCodes site (www.astro.psu.edu/statcodes) provides over 200 links in the areas of: Bayesian statistics; censored and truncated data; correlation and regression, density estimation and smoothing, general statistics packages and information; image analysis; interactive Web tools; multivariate analysis; multivariate clustering and classification; nonparametric analysis; software written by astronomers; spatial statistics; statistical distributions; time series analysis; and visualization tools. StatCodes has received a remarkable high and constant hit rate of 250 hits/week (over 10,000/year) since its inception in mid-1997. It is of interest to scientists both within and outside of astronomy. The most popular sections are multivariate techniques, image analysis, and time series analysis. Hundreds of copies of the ASURV, SLOPES and CENS-TAU codes developed by SCCA scientists were also downloaded from the StatCodes site. In addition to formal SCCA duties, SCCA scientists continued a variety of related activities in astrostatistics, including refereeing of statistically oriented papers submitted to the Astrophysical Journal, talks in meetings including Feigelson's talk to science journalists entitled "The reemergence of astrostatistics" at the American Association for the Advancement of Science meeting, and published papers of astrostatistical content.

Akritas, Michael↗

Variance Analysis of Unevenly Spaced Time Series Data

We have investigated the effect of uneven data spacing on the computation of delta (sub chi)(gamma). Evenly spaced simulated data sets were generated for noise processes ranging from white phase modulation (PM) to random walk frequency modulation (FM). Delta(sub chi)(gamma) was then calculated for each noise type. Data were subsequently removed from each simulated data set using typical two-way satellite time and frequency transfer (TWSTFT) data patterns to create two unevenly spaced sets with average intervals of 2.8 and 3.6 days. Delta(sub chi)(gamma) was then calculated for each sparse data set using two different approaches. First the missing data points were replaced by linear interpolation and delta (sub chi)(gamma) calculated from this now full data set. The second approach ignored the fact that the data were unevenly spaced and calculated delta(sub chi)(gamma) as if the data were equally spaced with average spacing of 2.8 or 3.6 days. Both approaches have advantages and disadvantages, and techniques are presented for correcting errors caused by uneven data spacing in typical TWSTFT data sets.

Hackman, Christine↗

Statistical Challenges in Modern Astronomy II

Wavelets are the central idea of a broad framework for thinking about displaying, and analyzing data - not just a new specialized technique. They are localized basis functions that provide an extremely flexible and efficient representation of time series. Current developments in the theory and application of wavelets are yielding powerful multiresolution techniques for the analysis of time series and image data. Wavelet methods can effect noise removal. characterization of stochastic behavior, depiction of power spectrum time-variations, and data compression - for time series data, image data, and data of higher dimensions. I review published applications of wavelets in astronomy.

Scargle, Jeffrey D.↗

Simplification of multiple Fourier series - An example of algorithmic approach

This paper describes one example of multiple Fourier series which originate from a problem of spectral analysis of time series data. The example is exercised here with an algorithmic approach which can be generalized for other series manipulation on a computer. The generalized approach is presently pursued towards applications to a variety of multiple series and towards a general purpose algorithm for computer algebra implementation.

Ng, E. W.↗

HAPI: An API Standard for Accessing Heliophysics Time Series Data

Heliophysics data analysis often involves combining diverse science measurements, many of them captured as time series. Although there are now only a few commonly used data file formats, the diversity in mechanisms for automated access to and aggregation of such data holdings can make analysis that requires intercomparison of data from multiple data providers difficult. The Heliophysics Application Programmer's Interface (HAPI) is a recently developed standard for accessing distributed time series data to increase interoperability. The HAPI specification is based on the common elements of existing data services, and it standardizes the two main parts of a data service: the request interface and the response data structures. The interface is based on the REpresentational State Transfer (REST) or RESTful architecture style, and the HAPI specification defines five required REST endpoints. Data are returned via a streaming format that hides file boundaries; the metadata is detailed enough for the content to be scientifically useful, e.g., plotted with appropriate axes layout, units, and labels. Multiple mature HAPI-related open-source projects offer server-side implementation tools and client-side libraries for reading HAPI data in multiple languages (IDL, Java, MATLAB, and Python). Multiple data providers in the US and Europe have added HAPI access alongside their existing interfaces. Based on this experience, data can be served via HAPI with little or no information loss compared to similar existing web interfaces. Finally, HAPI has been recommended as a COSPAR standard for time series data delivery.

Robert S. Weigel↗

Deviations from uniform power law scaling in nonstationary time series

A classic problem in physics is the analysis of highly nonstationary time series that typically exhibit long-range correlations. Here we test the hypothesis that the scaling properties of the dynamics of healthy physiological systems are more stable than those of pathological systems by studying beat-to-beat fluctuations in the human heart rate. We develop techniques based on the Fano factor and Allan factor functions, as well as on detrended fluctuation analysis, for quantifying deviations from uniform power-law scaling in nonstationary time series. By analyzing extremely long data sets of up to N = 10(5) beats for 11 healthy subjects, we find that the fluctuations in the heart rate scale approximately uniformly over several temporal orders of magnitude. By contrast, we find that in data sets of comparable length for 14 subjects with heart disease, the fluctuations grow erratically, indicating a loss of scaling stability.

Non-NASA Center↗

The local properties of ocean surface waves by the phase-time method

A new approach using phase information to view and study the properties of frequency modulation, wave group structures, and wave breaking is presented. The method is applied to ocean wave time series data and a new type of wave group (containing the large 'rogue' waves) is identified. The method also has the capability of broad applications in the analysis of time series data in general.

Huang, Norden E.↗

Time scales and variability of area-averaged tropical oceanic rainfall

A statistical analysis of time series of area-averaged rainfall over the oceans has been conducted around the diurnal time scale. The results of this analysis can be applied directly to the problem of establishing the magnitude of expected errors to be incurred in the estimation of monthly area-averaged rain rate from low orbiting satellites. Such statistics as the mean, standard deviation, integral time scale of background red noise, and spectral analyses were performed on time series of the GOES precipitation index taken at 3-hour intervals during the period spanning December 19, 1987 to March 31, 1988 over the central and eastern tropical Pacific. The analyses have been conducted on 2.5 x 2.5 deg and 5 x 5 deg grid boxes, separately. The study shows that rainfall measurements by a sun-synchronous satellite visiting a spot twice per day will include a bias due to the existence of the semidiurnal cycle in the SPCZ ranging from 5 to 10 percentage points. The bias in the ITCZ may be of the order of 5 percentage points.

Shin, Kyung-Sup↗

Solar-Terrestrial Coupling Evidenced by Periodic Behavior in Geomagnetic Indexes and the Infrared Energy Budget of the Thermosphere

We examine time series of the daily global power (W) radiated by carbon dioxide (at 15 microns) and by nitric oxide (at 5.3 microns) from the Earth s thermosphere between 100 km and 200 km altitude. Also examined is a time series of the daily absorbed solar ultraviolet power in the same altitude region in the wavelength span 0 to 175 nm. The infrared data are derived from the SABER instrument and the solar data are derived from the SEE instrument, both on the NASA TIMED satellite. The time series cover nearly 5 years from 2002 through 2006. The infrared and solar time series exhibit a decrease in radiated and absorbed power consistent with the declining phase of the current 11-year solar cycle. The infrared time series also exhibits high frequency variations that are not evident in the solar power time series. Spectral analysis shows a statistically significant 9-day periodicity in the infrared data but not in the solar data. A very strong 9-day periodicity is also found to exist in the time series of daily A(sub p) and K(sub p) geomagnetic indexes. These 9-day periodicities are linked to the recurrence of coronal holes on the Sun. These results demonstrate a direct coupling between the upper atmosphere of the Sun and the infrared energy budget of the thermosphere.

Mlynczak, Martin G.↗

Wildfire Emergency Response Hazard Extraction and Analysis of Trends (HEAT) through Natural Language Processing and Time Series

A methodology for Hazard Extraction and Analysis of Trends (HEAT) is proposed and conducted on a data set of wildfire incident response forms, known as ICS-209-PLUS.The HEAT processes: (1) extract a set of hazards from a data set, (2) calculate hazard-relevant metrics in a primary analysis, (3) analyze trends over time in metrics using timeseries, and (4) examine potential explanations for metric trends using a secondary analysis. Hazards are extracted from narrative data in the ICS-209-PLUS based on a framework previously developed by the authors, using natural language processing. Metrics examined for each hazard include operational time to occurrence, rate of occurrence, frequency, and severity. Primary results include a taxonomy of hazards present in the data set with relevant quantitative metrics. The most frequent hazards identified are environmental and include hazardous terrain. Most hazards occur on average between 35-55% containment. Incidents with hazards tend to have a higher average severity score when compared to the average score for all incidents. Time series of the metrics and relevant predictors, including fire characteristics, fire intensity, and operations, are created to facilitate further analysis. Secondary results used to determine which factors best predict hazard frequency include a correlation matrix and regression analysis. These findings are relevant to safety for current, as well as emerging wildfire operations, and are an exploratory first step in developing historical data-driven risk assessment models.

Sequoia R. Andrade↗

Have Heat Waves Become More Intense and Frequent in North America in the Past 40 Years?

Extreme events, especially heat waves, have seemingly become more frequent and intense in the past decades worldwide, likely associated with global warming. This study uses the extreme detection indices product derived from the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to address whether heat waves have become more intense and frequent in North America in the past 40 years. We also examine in-depth the recent heat wave in June 2023 in Canada and the associated drought and wildfire events and compare them with previous years. We use additional data products in this study for cross-validation, including surface temperature from Phase 2 of the North American Land Data Assimilation System (NLDAS 2.0) and Atmospheric Infrared Sounder (AIRS) version 7, with a shorter data latency, only a few days. In addition, we will demonstrate how to efficiently conduct long-term time-series data analysis, which involves a large volume of data, using data services developed at NASA GES DISC, such as Giovanni, datarod, and Thematic Real-time Environmental Distributed Data Services (THREDDS) Data Server (TDS). These services can be used to visualize and explore extreme events, and to download only the data that is of interest.

Xiaohua Pan↗