Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Interannual Variations In the Low-Degree Components of the Geopotential derived from SLR and the Connections With Geophysical/Climatic Processes

Recent Satellite Laser Ranging derived long wavelength gravity time series analysis has focused to a large extent on the effects of the recent large changes in the Earth s 52, and the potential causes. However, it is difficult to determine whether there are corresponding signals in the shorter wavelength zonals from the existing SLR-derived time variable gravity results, although it appears that geophysical fluid transport is being observed. For example, the recovered J3 time series shows remarkable agreement with NCEP-derived estimates of atmospheric gravity variations. Likewise, some of the non-zonal spherical harmonic coefficient series have significant interannual signal that appears to be related to mass transport. The non-zonal degree 2 terms show reasonable correlation with atmospheric signals, as well as climatic effects such as El Nino Southern Oscillation. While the formal uncertainty of these terms is significantly higher than that for J2, it is also clear that there is useful signal to be extracted. Consequently, the SLR time series is being reprocessed to improve the time variable gravity field recovery. We will present recent updates on the J2 evolution, as well as a look at other components of the interannual variations of the gravity field, complete through degree 4, and possible geophysical and climatic causes.

Chao, Benjamin F.↗
NASA NTRS2017

Detecting Inter-Annual Variations in the Phenology of Evergreen Conifers Using Long-Term MODIS Vegetation Index Time Series

Long-term observations of vegetation phenology can be used to monitor the response of terrestrial ecosystems to climate change. Satellite remote sensing provides the most efficient means to observe phenological events through time series analysis of vegetation indices such as the Normalized Difference Vegetation Index (NDVI). This study investigates the potential of a Photochemical Reflectance Index (PRI), which has been linked to vegetation light use efficiency, to improve the accuracy of MODIS-based estimates of phenology in an evergreen conifer forest. Timings of the start and end of the growing season (SGS and EGS) were derived from a 13-year-long time series of PRI and NDVI based on a MAIAC (multi-angle implementation of atmospheric correction) processed MODIS dataset and standard MODIS NDVI product data. The derived dates were validated with phenology estimates from ground-based flux tower measurements of ecosystem productivity. Significant correlations were found between the MAIAC time series and ground-estimated SGS (R (sup 2) equals 0.36-0.8), which is remarkable since previous studies have found it difficult to observe inter-annual phenological variations in evergreen vegetation from satellite data. The considerably noisier NDVI product could not accurately predict SGS, and EGS could not be derived successfully from any of the time series. While the strongest relationship overall was found between SGS derived from the ground data and PRI, MAIAC NDVI exhibited high correlations with SGS more consistently (R (sup 2) is greater than 0.6 in all cases). The results suggest that PRI can serve as an effective indicator of spring seasonal transitions, however, additional work is necessary to confirm the relationships observed and to further explore the usefulness of MODIS PRI for detecting phenology.

Ulsig, Laura↗
NASA NTRS1990

Upper atmosphere dynamics

The spatial distribution of stratospheric ozone is useful in diagnosis of some features of the large scale atmospheric circulation, and the ozone may also interact with the atmospheric general circulation. Local maxima in the column ozone distribution are often associated with disturbances in the lower stratosphere and upper troposphere, which may herald cyclone development in the troposphere. One research objective is to explore these issues by means of time series analysis of a zonal index of total column ozone, to suggest the existence or nonexistence of relationships between column ozone and dynamical processes which are known to occur on various time scales. Another objective is to investigate the correlation between the ozone mixing ratio on the 350 K isentropic surface and the column integrated ozone, and to investigate the use of an easily derived parameter as a proxy for ozone mixing ratio, which is conserved in the stratosphere for time scales shorter than the photochemical time scale. The source of data for these studies is the Total Ozone Mapping Spectrometer (TOMS) data set.

Miller, Timothy L.↗
NASA NTRS2007

Application of the Hilbert-Huang Transform to the Search for Gravitational Waves

We present the application of a novel method of time-series analysis, the Hilbert-Huang Transform, to the search for gravitational waves. This algorithm is adaptive and does not impose a basis set on the data, and thus the time-frequency decomposition it provides is not limited by time-frequency uncertainty spreading. Because of its high time-frequency resolution it has important applications to both signal detection and instrumental characterization. Applications to the data analysis of the ground and space based gravitational wave detectors, LIGO and LISA, are described.

Camp, Jordan B.↗
NASA NTRS2016

Time Series Explorer: Bayesian Blocks with Generalized Profiles and in Higher Dimensions

The Time Series Explorer (TSE) is a project aimed at provided new and advanced time series analysis algorithms in two forms: a tool kit and an automated pipeline applying selected tools in machine learning settings. I will present a sketch of TSE with emphasis on time-domain modeling in general and recent improvements of the Bayesian Block (BB) algorithm in particular. This includes generalizing the shape of the elementary blocks from the current constant-rate model to general shapes, such as two-sided exponentials. Related topics will include extension of BB to higher dimensions and a novel way to detect and characterize short time-scale bursts in time-tagged event data. The Fermi Gamma Ray Space Telescope light curve for the Crab Nebula will be used as an example for all of the algorithms discussed. This work is in collaboration with Tom Loredo.

Bayesian Block (BB) algorithm↗
DOE OSTI2022

2022 FORCE Development Status Update

Integrated energy systems (IESs) are essential for decarbonizing electricity and industrial sectors and fully exploiting these systems requires sophisticated planning, scheduling, and dispatching tools to maximize their socio-economic benefits. The Framework for Optimization of Resources and Economics (FORCE) is a tool suite developed at Idaho National Laboratory and is dedicated to making robust analyses of IESs easier for analysts and researchers. The report summarizes the improvements and updates to FORCE during the most recent development cycle. Particularly, we demonstrate improvements to user accessibility, stochastic time-series analysis, and vertical integration with the software tools provided in FORCE.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2019

MARGInS Model-Based Analysis of Realizable Goals in Systems

The high complexity of modern aircraft and spacecraft requires elaborate Verification and Validation (V&V) approaches to make sure that such complex systems work properly and reliably. MARGInS is a framework for the analysis, understanding, and prediction of the behavior of a complex, hybrid system. MARGInS contains a set of machine learning and statistical algorithms for multivariate clustering, treatment learning, critical factor determination, time-series analysis, event prediction, and safety-boundary detection and characterization. The framework supports system testing and can be configured to find novel features in test suites, determine classes of behavior, propose new experiments that can efficiently explore and characterize the boundaries between classes of system behavior, and to create visualizations and reports.

He, Yuning↗
NASA NTRS1985

A perspective on the evidence for periodic cometary impacts on earth

Recent suggestions of periodic cometary showers coincident with mass extinctions have prompted a review of the terrestrial cratering record. From the point of view of completeness of search and crater retention, the record used to argue for statistical periodicities is incomplete and may not be representative. Estimates of crater ages are of variable accuracy and precision and, in some cases, different dating methods yield discordant results. It is possible to define through time-series analysis a number of periodicities of different magnitude (about 29, 21, 18.5, and 13.5 m.y.) and phase, depending on which craters are considered the most representative sample of the record. Arguing against periodic cometary showers is the observation that estimates of the average cratering rate in recent time and observations on Apollo bodies are equivalent. In addition, siderophile element data from impact melt rocks suggest a variety of projectile types were responsible for relatively large terrestrial craters. Given these observations, it is concluded that statements regarding periodic cometray showers are not categorical and require evidence beyond arguments based on time-series analyses of an incomplete cratering record.

Grieve, R. A. F.↗
NASA NTRS2019

Global Validation of Columnar Water Vapor Derived from EOS MODIS-MAIAC Algorithm Against the Ground-Based AERONET Observations

The water vapor is a relevant greenhouse gas in the Earth's climate system, and satellite products become one of the most effective way to characterize and monitor the columnar water vapor (CWV) content at global scale. Recently, a new product (MCD19) was released as part of MODIS (Moderate Resolution Imaging Spectroradiometer) Collection 6 (C6). This operational product from the Multi-Angle Implementation for Atmospheric Correction (MAIAC) algorithm includes a high 1-kilometer resolution CWV retrievals. This study presents the first global validation of MAIAC C6 CWV obtained from MODIS MCD19A2 product. This evaluation was performed using Aerosol Robotic Network (AERONET) observations at 265 sites (2000-2017). Overall, the results show a good agreement between MAIAC/AERONET CWV retrievals, with correlation coefficient higher than 0.95 and RMS (Root Mean Square) error lower than 0.250 centimeters. The binned error analysis revealed an underestimation (approximately 10 percent) of Aqua CWV retrievals with negative bias for CWV higher than 3.0 centimeters. In contrast, Terra CWV retrievals show a slope of regression close to unity and a low mean bias of 0.075 centimeters. While the accuracy is relatively similar between 1.0 and 5.0 centimeters for both sensor products, Terra dataset is more reliable for applications in humid tropical areas (less than 5.0 centimeters). The expected error was defined as plus or minus 15 percent, with less than 68 percent of retrievals falling within this envelope. However, the accuracy is regionally dependent, and lower error should be expected in some regions, such as South America and Oceania. Since MODIS instruments have exceeded their design lifetime, time series analysis was also presented for both sensor products. The temporal analysis revealed a systematic offset of global average between Terra and Aqua CWV records. We also found an upward trend (approximately 0.2 centimeters per decade) in Terra CWV retrievals, while Aqua CWV retrievals remain stable over time. The sensor degradation influences the ability to detect climate signals, and this study indicates the need for revisiting calibration of the MODIS bands 17-19, mainly for Terra instrument, to assure the quality of the MODIS water vapor product. Finally, this study presents a comprehensive validation analysis of MAIAC CWV over land, raising the understanding of its overall quality.

MAIAC↗
DOE OSTI2021

Identification and Online Updating of Dynamic Models for Demand Response of an Industrial Air Separation Unit

Demand-response operation of air separation units requires frequent changes in production rate(s), and scheduling calculations must explicitly consider process dynamics to ensure feasibility of the solutions. To this end, scale-bridging models (SBMs) approximate the scheduling-relevant dynamics of a process and its controller in a low-order representation. In contrast to previous works that have employed nonlinear SBMs, this paper proposes linear SBMs, developed using time-series analysis, to facilitate online scheduling computations. Using a year-long industrial dataset, we nd that compact linear SBMs are suitable approximations over typical scheduling horizons, but that their accuracies are unpredictable over time. We introduce a strategy for online updating of the SBMs, based on Kalman ltering schemes for online parameter estimation. The approach greatly improves the accuracy of SBM predictions and will enable the use of linear SBM-based demand-response scheduling in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Con Connections: Detecting Fraud from Abstracts using Topological Data Analysis

In this paper we present a novel approach for identifying fraudulent papers from their titles and abstracts. The premise of the approach is that there are holes in the presentation of the approach and findings of fraudulent research papers. As an abstract is intended to highlight key features of the approach as well as important conclusions the authors seek to determine if the assumed existence of holes can be identified from analysis of abstracts alone. The data set considered is derived from papers sharing a single author with labels determined based on a formal linguistic analysis of the complete documents. To detect these logical and literary holes we utilize techniques from topological data analysis which summarizes data based on the presence of multi-dimensional, topological holes. We find that, in fact, topological features derived through a combination of techniques in natural language processing and time-series analysis allow for superior detection of the fraudulent papers than the natural language processing tools alone. Thus we conclude that the connections and holes present in the abstracts of research cons contributes to an ability to infer the scientific validity of the corresponding work.

Tymochko, Sarah J.↗
NASA NTRS2004

Virtual Sensors: Using Data Mining to Efficiently Estimate Spectra

Detecting clouds within a satellite image is essential for retrieving surface geophysical parameters, such as albedo and temperature, from optical and thermal imagery because the retrieval methods tend to be valid for clear skies only. Thus, routine satellite data processing requires reliable automated cloud detection algorithms that are applicable to many surface types. Unfortunately, cloud detection over snow and ice is difficult due to the lack of spectral contrast between clouds and snow. Snow and clouds are both highly reflective in the visible wavelen,ats and often show little contrast in the thermal Infrared. However, at 1.6 microns, the spectral signatures of snow and clouds differ enough to allow improved snow/ice/cloud discrimination. The recent Terra and Aqua Moderate Resolution Imaging Spectro-Radiometer (MODIS) sensors have a channel (channel 6) at 1.6 microns. Presently the most comprehensive, long-term information on surface albedo and temperature over snow- and ice-covered surfaces comes from the Advanced Very High Resolution Radiometer ( AVHRR) sensor that has been providing imagery since July 1981. The earlier AVHRR sensors (e.g. AVHRR/2) did not however have a channel designed for discriminating clouds from snow, such as the 1.6 micron channel available on the more recent AVHRR/3 or the MODIS sensors. In the absence of the 1.6 micron channel, the AVHRR Polar Pathfinder (APP) product performs cloud detection using a combination of time-series analysis and multispectral threshold tests based on the satellite's measuring channels to produce a cloud mask. The method has been found to work reasonably well over sea ice, but not so well over the ice sheets. Thus, improving the cloud mask in the APP dataset would be extremely helpful toward increasing the accuracy of the albedo and temperature retrievals, as well as extending the time-series of albedo and temperature retrievals from the more recent sensors to the historical ones. In this work, we use data mining methods to construct a model of MODIS channel 6 as a function of other channels that are common to both MODIS and AVHRR. The idea is to use the model to generate the equivalent of MODIS channel 6 for AVHRR as a function of the AVHRR equivalents to MODIS channels. We call this a Virtual Sensor because it predicts unmeasured spectra. The goal is to use this virtual channel 6. to yield a cloud mask superior to what is currently used in APP . Our results show that several data mining methods such as multilayer perceptrons (MLPs), ensemble methods (e.g., bagging), and kernel methods (e.g., support vector machines) generate channel 6 for unseen MODIS images with high accuracy. Because the true channel 6 is not available for AVHRR images, we qualitatively assess the virtual channel 6 for several AVHRR images.

Srivastava, Ashok↗
NASA NTRS2012

Using NASA's Giovanni System to Simulate Time-Series Stations in the Outflow Region of California's Eel River

Oceanographic time-series stations provide vital data for the monitoring of oceanic processes, particularly those associated with trends over time and interannual variability. There are likely numerous locations where the establishment of a time-series station would be desirable, but for reasons of funding or logistics, such establishment may not be feasible. An alternative to an operational time-series station is monitoring of sites via remote sensing. In this study, the NASA Giovanni data system is employed to simulate the establishment of two time-series stations near the outflow region of California s Eel River, which carries a high sediment load. Previous time-series analysis of this location (Acker et al. 2009) indicated that remotely-sensed chl a exhibits a statistically significant increasing trend during summer (low flow) months, but no apparent trend during winter (high flow) months. Examination of several newly-available ocean data parameters in Giovanni, including 8-day resolution data, demonstrates the differences in ocean parameter trends at the two locations compared to regionally-averaged time-series. The hypothesis that the increased summer chl a values are related to increasing SST is evaluated, and the signature of the Eel River plume is defined with ocean optical parameters.

Acker, James G.↗
NASA NTRS2005

Regression Analysis of Long-term Profile Ozone Data Set from BUV Instruments

We have produced a profile merged ozone data set (MOD) based on the SBUV/SBUV2 series of nadir-viewing satellite backscatter instruments, covering the period from November 1978 - December 2003. In 2004, data from the Nimbus 7 SBUV and NOAA 9,11, and 16 SBUV/2 instruments were reprocessed using the Version 8 (V8) algorithm and most recent calibrations. More recently, data from the Nimbus 4 BUV instrument, which operated from 1970 - 1977, were also reprocessed using the V8 algorithm. As part of the V8 profile calibration, the Nimbus 7 and NOAA 9 (1993-1997 only) instrument calibrations have been adjusted to match the NOAA 11 calibration, which was established from comparisons with SSBUV shuttle flight data. Given the level of agreement between the data sets, we simply average the ozone values during periods of instrument overlap to produce the MOD profile data set. We use statistical time-series analysis of the MOD profile data set (1978-2003) to estimate the change in profile ozone due to changing stratospheric chlorine levels. The Nimbus 4 BUV data offer an opportunity to test the physical properties of our statistical model. We extrapolate our statistical model fit backwards in time and compare to the Nimbus 4 data. We compare the statistics of the residuals from the fit for the Nimbus 4 period to those obtained from the 1978-2003 period over which the statistical model coefficients were estimated.

Frith, Stacey↗
DOE OSTI2023

Vis-SAGA: Visual Analytics for Situational Awareness of Grid Anomalies: Preprint

We describe supporting near real-time situational awareness of the electric distribution system by visualizing novel data from voltage sensors deployed on existing broadband cable television network equipment. Our scalable web-based visual analytics platform supports interactive geospatial exploration, time-series analysis, and summarization of grid behavior during potentially anomalous events. The broadband cable television sensor network provides observability of the electrical distribution system at a higher local spatial resolution than is typically available to most utilities, revealing the operational state of the network and aiding in the detection of abnormal behaviors or deviations from expected patterns, particularly across electric utility service areas. We outline the design and development of interactive geospatial and time-series visualization components and the scalable data services that supply metadata, historical, and real-time streams of sensor data across the network. We evaluate our platform during periods of extreme weather, demonstrating its ability to assist in detecting patterns of operation that affect power availability, quality, resiliency, and service restoration.

cable television↗
NASA NTRS2017

Understanding the International Space Station Crew Perspective following Long-Duration Missions through Data Analytics & Visualization of Crew Feedback

The International Space Station (ISS) first became a home and research laboratory for NASA and International Partner crewmembers over 16 years ago. Each ISS mission lasts approximately 6 months and consists of three to six crewmembers. After returning to Earth, most crewmembers participate in an extensive series of 30+ debriefs intended to further understand life onboard ISS and allow crews to reflect on their experiences. Examples of debrief data collected include ISS crew feedback about sleep, dining, payload science, scheduling and time planning, health & safety, and maintenance. The Flight Crew Integration (FCI) Operational Habitability (OpsHab) team, based at Johnson Space Center (JSC), is a small group of Human Factors engineers and one stenographer that has worked collaboratively with the NASA Astronaut office and ISS Program to collect, maintain, disseminate and analyze this data. The database provides an exceptional and unique resource for understanding the "crew perspective" on long duration space missions. Data is formatted and categorized to allow for ease of search, reporting, and ultimately trending, in order to understand lessons learned, recurring issues and efficiencies gained over time. Recently, the FCI OpsHab team began collaborating with the NASA JSC Knowledge Management team to provide analytical analysis and visualization of these over 75,000 crew comments in order to better ascertain the crew's perspective on long duration spaceflight and gain insight on changes over time. In this initial phase of study, a text mining framework was used to cluster similar comments and develop measures of similarity useful for identifying relevant topics affecting crew health or performance, locating similar comments when a particular issue or item of operational interest is identified, and providing search capabilities to identify information pertinent to future spaceflight systems and processes for things like procedure development and training. In addition, the comments were scored for sentiment using a polarity scoring algorithm to identify both positive and negative comments for particular groups and clusters, allowing the team to make analytically informed decisions regarding future hardware and operating procedures. The use of polarity scoring with time series analysis was used to provide insight into how crew health and habitability is changing throughout various spaceflight increments or the station lifecycle as a whole. Finally, a visualization framework was developed to address the needs of the end users to search for and analyze comments by user, category or mission. This paper will discuss how the use of an analytical framework in conjunction with the current human interface, improved the understanding of crew perspective and shortened the time for analysis allowing for more informed decisions and rapid development of improvements. These methods are significantly optimizing the way that this valuable data can be assessed and applied to current and future spaceflight design and development. This collaboration allows the FCI OpsHab team to effectively analyze and share data in a more automated and timely fashion. Trends are no longer derived manually and can be illustrated effectively and accurately with these evolving techniques to an ever growing group of human spaceflight end users.

Bryant, Cody↗
NASA NTRS2004

The Validation of Version 8 Ozone Profiles: Is SBUV Ready for Prime Time?

Ozone profile data are now available from a series of BUV instruments - SBUV on Nimbus 7 and SBW/2 instruments on NOAA 9, NOAA 11, and NOAA 16. The data have been processed through the new version 8 algorithm, which is designed to be more accurate and, more importantly, to reduce the influence of the a priori on ozone trends. As a part of the version 8 reprocessing we have attempted to apply a consistent calibration to the individual instruments so that their data records can be used together in a time series analysis. Validation consists of examining not only the mean difference from external datasets (i.e trends) but also consistency in the interannual variability of the data. Here we validate the v8 BUV data through comparison with ECC sondes, lidar and microwave measurements, and with SAGE II and HALOE satellite data records. We find that individual profiles generally agree with external data sets within +/-10% between 30 hPa and 1 hPa (approx. 24 - 50 km) and frequently agree within +/-5%. The interannual variability of the BUV ozone time series agrees well with that of SAGE II . On the average, different B W instruments usually agree within +/-5% with each other, though the relative error increases near the ends of the Nimbus 7 and NOAA 16 data records as a result of instrument problems. The combined v8 BUV data sets cover the 1979-2003 time period giving daily global coverage of the ozone vertical distribution to better accuracy than has ever been possible before.

McPeters, R. D.↗
NASA NTRS2018

PYSAT: Python Satellite Data Analysis Toolkit

A common problem in space science data analysis is combining complementary data sources that are provided and analyzed in different formats and programming languages. The Python Satellite Data Analysis Toolkit (pysat) addresses this issue by providing an open source toolkit that implements the general process of space science data analysis, from beginning to end, in an instrumentindependent manner. This toolkit uses an Instrument object that enables systematic analysis of science data from a variety of platforms within a single interface. Basic functions such as downloading, loading, and cleaning are included for all supported instruments. Common analysis routines are also included, which are instrument and data source independent. A nanokernel is used to provide instrument independence, it is attached to the Instrument object and mediates the systematic and arbitrary modification of loaded data. Pysat uses the nanokernel to improve the rigor of time series analysis, support onthefly orbit determination, and cleanly span file breaks. Pysat's functions and higherlevel scientific analysis features are validated through the use of unit testing. Further adoption by the community provides a set of scientific results produced by a common core, constituting a distributed heritage that supports the validity of the underlying processing and scientific output. These features are used to demonstrate consistency between derived electron density profiles and measured ion drifts, particularly downward ion drifts in the afternoon hours during extreme solar minimum. Pysat builds upon open source Python software that is freely available and encourages communitydriven development.

Stoneback, R.A.↗