Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Implementing Superresolution of Nonstationary Tides with Wavelets: An Introduction to CWT_Multi

Abstract Tides are often nonstationary due to nonastronomical influences. Investigating variable tidal properties implies a trade-off between separating adjacent frequencies (using long analysis windows) and resolving their time variations (short analysis windows). Previous continuous wavelet transform (CWT) tidal methods resolved tidal species. Here, we present CWT_Multi, a MATLAB code that 1) uses CWT linearity (via the “response coefficient method”) to implement superresolution, i.e., resolving tidal constituents beyond the Rayleigh criterion; 2) provides a Munk–Hasselmann constituent selection criterion appropriate for superresolution; and 3) introduces an objective, time-variable form of inference (“dynamic inference”) based on time-varying data properties. CWT_Multi resolves tidal species on time scales of days, and multiple constituents per species with fortnightly filters. It outputs astronomical phase lags and admittances, analyzes multiple records, and provides power spectra of the signal(s), residual(s), and reconstruction(s); confidence limits; and signal-to-noise ratios. Artificial data and water levels from the Lower Columbia River Estuary (LCRE) and San Francisco Bay Delta (SFBD) are used to test CWT_Multi and compare it to harmonic analysis programs NS_Tide and UTide. CWT_Multi provides superior reconstruction, detiding, dynamic analysis utility, and time resolution of constituents (but with broader confidence limits). Dynamic inference resolves closely spaced constituents (like K 1 , S 1 , and P 1 ) on fortnightly time scales, quantifying impacts of diel power peaking (with a 24-h period, like S 1 ) on water levels in the LCRE. CWT_Multi also helps quantify the impacts of high flows and a salt barrier closing on tidal properties in the SFBD. On the other hand, CWT_Multi does not excel at prediction, and results depend on analysis details, as for any method applied to nonstationary data. Significance Statement Ocean tides, especially in coastal and estuarine systems, are often nonstationary, in the sense that the mean and standard deviation of tidal properties vary over time, usually in response to some nontidal process. We introduce here a MATLAB code, CWT_Multi, that uses wavelet transforms to resolve both tidal species and constituents on time scales from a few days to months. Our code accommodates multiple scalar time series and has typical tidal analysis features like constituent selection and inference, plus two forms of uncertainty analyses. It is flexible, allowing the user to adapt analysis properties to diverse datasets. CWT_Multi is applicable to many problems involving time-variable tides, including sea level rise, compound flooding, sediment transport, and wetland habitat analyses. Application to vector data is a straightforward extension, but further development of our uncertainty analysis is merited. Because nonstationary tidal analysis is rapidly advancing, we also define the features of a “well-formed” analysis code.

Lobo, Matthew↗
DOE OSTI2022

PVAnalytics: A Python Package for Automated Processing of Solar Time Series Data

Multiple publicly available software packages exist that analyze solar time series data, including RdTools and Solar Data Tools, among others. Several of these packages contain their own unique quality assurance (QA) and feature recognition algorithms. The python PVAnalytics package was developed to offer an internally consistent source for these analysis tools, making it easier for the end user to deploy these routines on his or her solar data. The PVAnalytics package currently contains routines for outlier detection, inverter clipping detection, irradiance and temperature checks, orientation checks, and data shift detection, among other functions. These functions have been aggregated from various sources including Solar Forecast Arbiter, RdTools, and the QA process developed by NREL's PV Fleets Initiative. We are continuously adding new functionality to the package, including documentation, examples and algorithms. By bundling QA functionality into a single software package, we hope to make PVAnalytics a comprehensive software library to support analysis of solar metadata and time series data.

data cleaning↗
DOE OSTI2025

Multitaper Magnitude‐Squared Coherence for Time Series With Missing Data: Understanding Oscillatory Processes Traced by Multiple Observables

To explore the hypothesis of a common source of variability in two time series, observers may estimate the magnitude-squared coherence (MSC), which is a frequency-domain view of the cross correlation. For time series that do not have uniform observing cadence, MSC can be estimated using Welch's overlapping segment averaging. However, multitaper has superior statistical properties to Welch's method in terms of the tradeoff between bias, variance, and bandwidth. The classical multitaper technique has recently been extended to accommodate time series with underlying uniform observing cadence from which some observations are missing. This situation is common for solar and geomagnetic data sets, which may have gaps due to breaks in satellite coverage, instrument downtime, or poor observing conditions. We demonstrate the scientific use of missing-data multitaper magnitude-squared coherence by detecting known solar mid-term oscillations in simultaneous, missing-data time series of solar Lyman α flux and geomagnetic Disturbance Storm Time index. Due to their superior statistical properties, we recommend that multitaper methods be used for all heliospheric time series with underlying uniform observing cadence.

Astro-statistics techniques (1886)↗
DOE OSTI2023

Wavelength-Dependent Excitonic Properties of Covalent Organic Frameworks Explored by Theory and Experiments

Many aspects of the correlation between physical structure, light harvesting, and excitonic properties of covalent organic frameworks (COFs) remain unclear despite being key properties determining their photocatalytic function. One area of COF research that could bring clarity is through using both electronic structure theory and time-resolved spectroscopic analysis over a series of isomeric COFs. Here, we show structure-property relationships between four imine COFs built from a combination of ditopic and tritopic monomers using transient absorption spectroscopy together with time-dependent density functional theory. We find that monomer selection only moderately affects the charge transfer (CT) behavior of the COFs. Instead, we infer that imine chemistry profoundly impacts CT by acting as a CT mediator. Moreover, we discover two distinct valence bands arising from varying degrees of locally excited/CT mixing, which is responsible for energy dependent exciton dynamics. Finally, we use theory to hypothesize that interlayer interactions can modify excitonic properties that we correlate with tail states commonly observed, but rarely investigated in COFs. Furthermore, these results reveal that imine chemistry should be recognized as a very important factor to consider in the development of COF photocatalysts and the correlation of their structural environment with light harvesting and CT properties that should ultimately determine their photocatalytic function.

14 SOLAR ENERGY↗
NASA NTRS2008

Modern Era Retrospective Restrospective-Analysis for Research and Applications (MERRA) Data and Services at the GES DISC

The Modern Era Retrospective-analysis for Research and Applications (MERRA) dataset is a NASA satellite era, 30 year (1979 - present), reanalysis using the Goddard Earth Observing System Data Assimilation System, Version 5 (GEOS-5). The project, run out of NASA's Global Modeling and Assimilation Office at Goddard Space Flight Center, provides the science and application communities with a state-of-the-art global analysis with emphasis on improved estimates of the hydrological cycle over a broad range of weather and climate time scales. MERRA products are generated as a long-term synthesis that places the NASA EOS suite of observations in a climate context. The MERRA analysis is performed at a horizontal resolution of 2/3 longitude x 1/2 latitude (540x361 global gridpoints) with observational analyses every 6 hours. The MERRA output data will include 3 dimensional state fields for every 6 hourly analysis cycle on 42 pressure levels (or 72 terrain following model coordinate levels) from the surface through the stratosphere. Several data products are specifically designed to support chemistry and stratosphere transport modeling. The 2 dimensional surface and atmospheric diagnostics (numbering 259) are being stored on the native grid at 1 hourly intervals. These include radiation and vertical integrals of the atmosphere for water and energy budget studies and also surface diagnostics where the diurnal cycle is important. The one hourly surface and near surface data product will also facilitate research on the integrated analysis of Earth system observations in the land, ocean and cryosphere. The MERRA products are archived and distributed by the Goddard Earth Sciences Data and Information Services Center (GES DISC) through its Modeling DISC Web (MDISC) portal. Multiple data access methods and services are available for MERRA data through MDISC: (1) Mirador offers a quick, comprehensive search of MERRA and all GES DISC archived data holdings, allowing searches on keywords, location names or latitude/longitude box, and date/time, with responses within a few seconds. (2) Giovanni is a GES DISC developed Web application that provides data visualization and analysis online. Giovanni features popular visualizations such as latitude-longitude maps, animations, cross sections, profiles, time series, etc. and some basic statistical analysis functions such as scatter plots and correlation coefficient maps. Users are able to download results in several different formats, including Google Earth. (3) On-the-fly parameter subsetting of data within a spatial/temporal window is provided through a simple select and click Web page. (4) MERRA data are also available via OPeNDAP, GrADS Data Server (GDS) and can be converted to netCDF on the fly.

Berrick, Stephen W.↗
DOE OSTI2022

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series: Preprint

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.

changepoint detection↗
DOE OSTI2022

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.

changepoint detection↗
NASA NTRS2004

Global Autocorrelation Scales of the Partial Pressure of Oceanic CO2

A global database of approximately 1.7 million observations of the partial pressure of carbon dioxide in surface ocean waters (pCO2) collected between 1970 and 2003 is used to estimate its spatial autocorrelation structure. The patterns of the lag distance where the autocorrelation exceeds 0.8 is similar to patterns in the spatial distribution of the first baroclinic Rossby radius of deformation indicating that ocean circulation processes play a significant role in determining the spatial variability of pCO2. For example, the global maximum of the distance at which autocorrelations exceed 0.8 averages about 140 km in the equatorial Pacific. Also, the lag distance at which the autocorrelation exceed 0.8 is greater in the vicinity of the Gulf Stream than it is near the Kuroshio, approximately 50 km near the Gulf Stream as opposed to 20 km near the Kuroshio. Separate calculations for times when the sun is north and south of the equator revealed no obvious seasonal dependence of the spatial autocorrelation scales. The pCO2 measurements at Ocean Weather Station (OWS) 'P', in the eastern subarctic Pacific (50 N, 145 W) is the only fixed location where an uninterrupted time series of sufficient length exists to calculate a meaningful temporal autocorrelation function for lags greater than a few days. The estimated temporal autocorrelation function at OWS 'P', is highly variable. A spectral analysis of the longest four pCO2 time series indicates a high level of variability occurring over periods from the atmospheric synoptic to the maximum length of the time series, in this case 42 days. It is likely that a relative peak in variability with a period of 3-6 days is related to atmospheric synoptic period variability and ocean mixing events due to wind stirring. However, the short length of available time series makes identifying temporal relationships between pCO2 and atmospheric or ocean processes problematic.

Li, Zhen↗
NASA NTRS2004

Fitting Flux Ropes to a Global MHD Solution: A Comparison of Techniques

Flux rope fitting (FRF) techniques are an invaluable tool for extracting information about the properties of a sub-class of coronal mass ejections (CMEs) in the solar wind. However, it has proven difficult to assess their accuracy since the underlying global structure of the CME cannot be independently determined from the data. In contrast, large-scale MHD simulations of CME evolution can provide both a global view as well as localized time series at specific points in space. In this study we apply five different fitting techniques to two hypothetical time series derived from MHD simulation results. Independent teams performed the analysis of the events in "blind tests", for which no information, other than time series, was provided. From the results, we infer the following: 1) Accuracy decreases markedly with increasingly glancing encounters; 2) Correct identification of the boundaries of the flux rope can be a significant limiter; 3) Results from techniques that infer global morphology must be viewed with caution. In spite of these limitations, FRF techniques remain a useful tool for describing in situ observations of flux rope CMEs.

Riley, Pete↗
DOE OSTI2020

Photometry as a Proxy for Stellar Activity in Radial Velocity Analyses

Stellar activity remains a limiting factor in measuring precise planet parameters from radial velocity spectroscopy, not least in the search for Earth-mass planets orbiting in the habitable zones of Sun-like stars. One approach to mitigate stellar activity is to use combined analyses of both radial velocity and time-series photometry. We present an analysis of simultaneous disk-integrated photometry and radial velocity data of the Sun in order to determine the useful limits of a combined analysis. We find that simple periodogram or autocorrelation analysis of solar photometry give the correct rotation period <50% of the time. We therefore use a Gaussian process to investigate the time variability of solar photometry and to directly compare simultaneous photometry with radial velocity data. We find that the hyperparameter posteriors are relatively stable over 70 yr of solar photometry and the amplitude tracks the solar cycle. We observe good agreement between the hyperparameter posteriors for the simultaneous photometry and radial velocity data. Our primary conclusion is a recommendation to include an additional prior in Gaussian process fits to constrain the evolutionary timescale to be greater than the recurrence timescale (i.e., the rotation period) to recover more physically plausible and useful results. Our results indicate that such simultaneous monitoring may be a useful tool in enhancing the precision of radial velocity surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Elastic Changepoint Detection for Globally-indexed Functional Time Series Data with Climate Applications

Changepoint detection is a vital tool in the application of climate data analysis. Numerous types of climate observation data are most properly represented by functional time series, implying a need for accurate changepoint detection methods applicable to functional time series data. Such data taken at a global scale often contain both spatial heterogeneity and dependence as well as phase (time) misalignment. In this report, we present methods which can detect spatially-dependent changepoints while allowing different estimates of change time and change strength depending on location. Additionally, we provide extensions to this spatially-predicted model which controls for phase variability among observations. Our methods provide the ability to detect a single change, or control for epidemic changes (where a “return-to-normal” change is more likely to be detected than the initial change). We showcase results analyzing the June 1991 eruption of Mt. Pinatubo, where our methods demonstrate the ability to accurately detect both single and epidemic changepoints even in the presence of strong seasonal variability. We find that our spatially-predicted model improves the detection of relevant changepoints versus methods which do not take spatial information into account, and we find that controlling for phase variability helps to control the false discovery rate during the detection process.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

Fitting Flux Ropes to a Global MHD Solution: A Comparison of Techniques

Flux rope fitting (FRF) techniques are an invaluable tool for extracting information about the properties of a subclass of CMEs in the solar wind. However, it has proven difficult to assess their accuracy since the underlying global structure of the CME cannot be independently determined from the data. In contrast, large-scale MHD simulations of CME evolution can provide both a global view as well as localized time series at specific points in space. In this study we apply 5 different fitting techniques to 2 hypothetical time series derived from MHD simulation results. Independent teams performed the analysis of the events in "blind tests", for which no information, other than the time series, was provided. F rom the results, we infer the following: (1) Accuracy decreases markedly with increasingly glancing encounters; (2) Correct identification of the boundaries of the flux rope can be a significant limiter; and (3) Results from techniques that infer global morphology must be viewed with caution. In spite of these limitations, FRF techniques remain a useful tool for describing in situ observations of flux rope CMEs.

Riley, Pete↗
NASA NTRS2011

A New SBUV Ozone Profile Time Series

Under NASA's MEaSUREs program for creating long term multi-instrument data sets, our group at Goddard has re-processed ozone profile data from a series of SBUV instruments. We have processed data from the Nimbus 7 SBUV instrument (1979-1990) and data from SBUV/2 instruments on NOAA-9 (1985-1998), NOAA-11 (1989-1995), NOAA-16 (2001-2010), NOAA-17 (2002-2010), and NOAA-18 (2005-2010). This reprocessing uses the version 8 ozone profile algorithm but now uses the Brion, Daumont, and Malicet (BMD) ozone cross sections instead of the Bass and Paur cross sections. The new cross sections have much better resolution, and extended wavelength range, and a more consistent temperature dependence. The re-processing also uses an improved cloud height climatology based on the Raman cloud retrievals of OMI. Finally, the instrument-to-instrument calibration is set using matched scenes so that ozone diurnal variation in the upper stratosphere does not alias into the ozone trands. Where there is no instrument overlap, SAGE and MLS are used to estimate calibration offsets. Preliminary analysis shows a more coherent time series as a function of altitude. The net effect on profile total column ozone is on average an absolute reduction of about one percent. Comparisons with ground-based systems are significantly better at high latitudes.

McPeters, Richard↗
NASA NTRS1998

[MODIS Investigation]

The objective of the last six months were: (1) Continue analysis of Hawaii Ocean Time-series (HOT) bio-optical mooring data, and Southern Ocean bio-optical drifter data; (2) Complete development of documentation of MOCEAN algorithms and software for use by MOCEAN team and GLI team; (3) Deploy instrumentation during JGOFS cruises in the Southern Ocean; (4) Participate in test cruise for Fast Repetition Rate (FRR) fluorometer; (5) Continue chemostat experiments on the relationship of fluorescence quantum yield to environmental factors; and (6) Continue to develop and expand browser-based information system for in situ bio-optical data. We are continuing to analyze bio-optical data collected at the Hawaii Ocean Time Series mooring as well as data from bio-optical drifters that were deployed in the Southern Ocean. A draft manuscript has now been prepared and is being revised. A second manuscript is also in preparation that explores the vector wind fields derived from NSCAT measurements. The HOT bio-optical mooring was recovered in December 1997. After retrieving the data, the sensor package was serviced and redeployed. We have begun preliminary analysis of these data, but we have only had the data for 3 weeks. However, all of the data were recovered, and there were no obvious anomalies. We will add second sensor package to the mooring when it is serviced next spring. In addition, Ricardo Letelier is funded as part of the SeaWiFS calibration/validation effort (through a subcontract from the University of Hawaii, Dr. John Porter), and he will be collecting bio-optical and fluorescence data as part of the HOT activity. This will provide additional in situ measurements for MODIS validation. As noted in the previous quarterly report, we have been analyzing data from three bio-optical drifters that were deployed in the Southern Ocean in September 1996. We presented results on chlorophyll and drifter speed. For the 1998 Ocean Sciences meeting, a paper will be presented on this data set, focusing on the diel variations in fluorescence quantum yield. Briefly, there are systematic patterns in the apparent quantum yield of fluorescence (defined as the slope of the line relating fluorescence/chlorophyll and incoming solar radiation). These systematic variations appear to be related to changes in the circulation of the Antarctic Polar Front which force nutrients into the upper ocean. A more complete analysis will be provided in the next Quarterly report.

Abbott, Mark R.↗
NASA NTRS2010

Multi-decade Measurements of the Long-Term Trends of Atmospheric Species by High-Spectral-Resolution Infrared Solar Absorption Spectroscopy

Solar absorption spectra were recorded for the first time in 5 years with the McMath Fourier transform spectrometer at the US National solar Observatory on Kitt Peak in southern Arizona, USA (31.91 N latitude, 111.61 W longitude, 2.09 km altitude). The solar absorption spectra cover 750-1300 and 1850-5000 cm(sup -1) and were recorded on 20 days during March-June 2009. The measurements mark the continuation of a long-term record of atmospheric chemical composition measurements that have been used to quantify seasonal cycles and long-term trends of both tropospheric and stratospheric species from observations that began i 1977. Fits to the measured spectra have been performed, and they indicate the spectra obtained since return to operational status are nearly free of channeling and the instrument line shape function is well reproduced taking into account the measurement parameters. We report updated time series measurements of total columns for six atmospheric species and their analysis for seasonal cycles and long-term trends. An sn example, the time series fit shows a decrease in the annual increase rate i Montreal-Protocol-regulated chlorofluorocarbon CCL2F2 from 1.51 plus or minus 0.38% yr(sup -1) at the beginning of the time span to -1.54 plus or minus 1.28 yr(sup -1) at the end of the time span, 1 sigma, and hence provides evidence for the impact of those regulations on the trend.

Rinsland, Curtis P.↗
NASA NTRS1979

Electrical Evaluation of RCA MWS5001D Random Access Memory, Volume 4, Appendix C

The electrical characterization and qualification test results are presented for the RCA MWS5001D random access memory. The tests included functional tests, AC and DC parametric tests, AC parametric worst-case pattern selection test, determination of worst-case transition for setup and hold times, and a series of schmoo plots. Statistical analysis data is supplied along with write pulse width, read cycle time, write cycle time, and chip enable time data.

Klute, A.↗
DOE OSTI2025

Dynamic mode decomposition for gyrokinetic eigenmode analysis

Dynamic mode decomposition (DMD) is a post-processing approach to decompose a complex time series into a set of modes via spectral analysis. DMD provides a new and powerful method to recover gyrokinetic drift-wave eigenfrequencies and eigenfunctions based only on the solution of the gyrokinetic-Maxwell initial value problem with almost no added cost to the initial value solver. In the present paper, DMD is applied to the CGYRO gyrokinetic code using a newly-developed CGYRO-DMD post-processor. CGYRO-DMD is numerically efficient, even on a single CPU. It does not set any restrictions on the plasma shape, beta (ratio of the plasma pressure to the magnetic field pressure), collisionality or number of species, and allows one to resolve numerous eigenmodes, even of comparable growth rates. In addition, DMD is not limited to unstable modes, but rather can capture stable and unstable branches simultaneously. In this work, we illustrate the accuracy of DMD through gyrokinetic analysis of mode transition for electromagnetic drift wave instabilities.

drift-wave eigenmodes↗
NASA NTRS1988

Hierarchical neural networks for autonomous data analysis and decision making

A neural network based data analysis and decision making system to increase the autonomy of a planetary rover or similar exploratory vehicle is presented. A hierarchical series of neural networks for real time analysis of scientific images is used. The system under development emphasizes analysis of multispectral images by classifier and feature detector neural networks, to provide information on the mineral composition of a scene. A hierarchy of alternating analysis and decision making networks is being developed to allow increasingly fine scale analysis in regions of the image that are potentially important. It is noted that this system will facilitate both the selection of high priorty scientific information for transmission to earth, and the autonomous collection of rocks and soil for sample return.

Eberlein, Susan↗