Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Role of Detuning in the Final Stage of Subharmonic Mode Transition in Boundary Layers

This work involves mechanisms for transition to turbulence in a Blasius boundary layer through resonant interactions between a plane Tollmien-Schlichting Wave and pairs of oblique waves with equal-but-opposite wave angles. When the frequency of the TS wave is exactly twice that of the oblique waves, we have a "tuned" subharmonic resonance. This leads to the enhanced growth of the oblique modes. Following this, other nonlinear interactions lead to the growth of other 3-D modes which are harmonically based, along with a 3-D mean flow distortion. In the final stage of this process, a gradual spectral filling occurs which we have traced to the growth of fundamental and subharmonic side-band modes. To simulate this with controlled inputs, we introduced the oblique wave pairs at the same conditions, but shifted the frequency of the plane TS mode (by as much as 12 percent) so that it was not exactly twice that of the 3-D modes. These "detuned" conditions also lead to the enhanced growth of the oblique modes, as well as discrete side-band modes which come about through sum and difference interactions. Other interactions quickly lead to a broad band of discrete modes. Of particular importance is the lowest difference frequency which produces a low frequency modulation similar to what has been seen in past experiments with natural 3-D mode input. Cross-bispectral analysis of time series allows us to trace the origin and development of the different modes. Following these leads to a scenario which we believe is more relevant to conditions of "natural" transitions, where low amplitude background disturbances either lead to the gradual detuning of exact fundamental/subharmonic resonance, or in which 3-D mode resonance is detuned from the onset. The results contrast the two conditions, and document the propensity of the 2-D/3-D mode interactions to become detuned.

Corke, Thomas C.↗

Automated Detection of Oscillating Regions in the Solar Atmosphere

Recently observed oscillations in the solar atmosphere have been interpreted and modeled as magnetohydrodynamic wave modes. This has allowed for the estimation of parameters that are otherwise hard to derive, such as the coronal magnetic-field strength. This work crucially relies on the initial detection of the oscillations, which is commonly done manually. The volume of Solar Dynamics Observatory (SDO) data will make manual detection inefficient for detecting all of the oscillating regions. An algorithm is presented that automates the detection of areas of the solar atmosphere that support spatially extended oscillations. The algorithm identifies areas in the solar atmosphere whose oscillation content is described by a single, dominant oscillation within a user-defined frequency range. The method is based on Bayesian spectral analysis of time series and image filtering. A Bayesian approach sidesteps the need for an a-priori noise estimate to calculate rejection criteria for the observed signal, and it also provides estimates of oscillation frequency, amplitude, and noise, and the error in all of these quantities, in a self-consistent way. The algorithm also introduces the notion of quality measures to those regions for which a positive detection is claimed, allowing for simple post-detection discrimination by the user. The algorithm is demonstrated on two Transition Region and Coronal Explorer (TRACE) datasets, and comments regarding its suitability for oscillation detection in SDO are made.

Ireland, J.↗

Assessment of a Bidirectional Reflectance Distribution Correction of Above-Water and Satellite Water-Leaving Radiance in Coastal Waters

Water-leaving radiances, retrieved from in situ or satellite measurements, need to be corrected for the bidirectional properties of the measured light in order to standardize the data and make them comparable with each other. The current operational algorithm for the correction of bidirectional effects from the satellite ocean color data is optimized for typical oceanic waters. However, versions of bidirectional reflectance correction algorithms specifically tuned for typical coastal waters and other case 2 conditions are particularly needed to improve the overall quality of those data. In order to analyze the bidirectional reflectance distribution function (BRDF) of case 2 waters, a dataset of typical remote sensing reflectances was generated through radiative transfer simulations for a large range of viewing and illumination geometries. Based on this simulated dataset, a case 2 water focused remote sensing reflectance model is proposed to correct above-water and satellite water-leaving radiance data for bidirectional effects. The proposed model is first validated with a one year time series of in situ above-water measurements acquired by collocated multispectral and hyperspectral radiometers, which have different viewing geometries installed at the Long Island Sound Coastal Observatory (LISCO). Match-ups and intercomparisons performed on these concurrent measurements show that the proposed algorithm outperforms the algorithm currently in use at all wavelengths, with average improvement of 2.4% over the spectral range. LISCO's time series data have also been used to evaluate improvements in match-up comparisons of Moderate Resolution Imaging Spectroradiometer satellite data when the proposed BRDF correction is used in lieu of the current algorithm. It is shown that the discrepancies between coincident in-situ sea-based and satellite data decreased by 3.15% with the use of the proposed algorithm.

LISCO(LONG ISLAND SOUND COASTAL OBSERVATORY)↗

Tracking the Momentum Flux of a CME and Quantifying Its Influence on Geomagnetically Induced Currents at Earth

We investigate a coronal mass ejection (CME) propagating toward Earth on 29 March 2011. This event is specifically chosen for its predominately northward directed magnetic field, so that the influence from the momentum flux onto Earth can be isolated. We focus our study on understanding how a small Earth-directed segment propagates. Mass images are created from the white-light cameras onboard STEREO which are also converted into mass height-time maps (mass J-maps). The mass tracks on these J-maps correspond to the sheath region between the CME and its associated shockfront as detected by in situ measurements at L1. A time series of mass measurements from the STEREOCOR-2A instrument is made along the Earth propagation direction. Qualitatively, this mass time series shows a remarkable resemblance to the L1 in situ density series. The in situ measurements are used as inputs into a three-dimensional (3-D) magnetospheric space weather simulation from the Community Coordinated Modeling Center. These simulations display a sudden compression of the magnetosphere from the large momentum flux at the leading edge of the CME, and predictions are made for the time derivative of the magnetic field (dBdt) on the ground. The predicted dBdt values were then compared with the observations from specific equatorially located ground stations and showed notable similarity. This study of the momentum of a CME from the Sun down to its influence on magnetic ground stations on Earth is presented as a preliminary proof of concept, such that future attempts may try to use remote sensing to create density and velocity time series as inputs to magnetospheric simulations.

time series analysis↗

Semi-Supervised Novelty Detection with Adaptive Eigenbases, and Application to Radio Transients

We present a semi-supervised online method for novelty detection and evaluate its performance for radio astronomy time series data. Our approach uses adaptive eigenbases to combine 1) prior knowledge about uninteresting signals with 2) online estimation of the current data properties to enable highly sensitive and precise detection of novel signals. We apply the method to the problem of detecting fast transient radio anomalies and compare it to current alternative algorithms. Tests based on observations from the Parkes Multibeam Survey show both effective detection of interesting rare events and robustness to known false alarm anomalies.

anomaly detection↗

Optimal Reorganization of NASA Earth Science Data for Enhanced Accessibility and Usability for the Hydrology Community

A long-standing "Digital Divide" in data representation exists between the preferred way of data access by the hydrology community and the common way of data archival by earth science data centers. Typically, in hydrology, earth surface features are expressed as discrete spatial objects (e.g., watersheds), and time-varying data are contained in associated time series. Data in earth science archives, although stored as discrete values (of satellite swath pixels or geographical grids), represent continuous spatial fields, one file per time step. This Divide has been an obstacle, specifically, between the Consortium of Universities for the Advancement of Hydrologic Science, Inc. and NASA earth science data systems. In essence, the way data are archived is conceptually orthogonal to the desired method of access. Our recent work has shown an optimal method of bridging the Divide, by enabling operational access to long-time series (e.g., 36 years of hourly data) of selected NASA datasets. These time series, which we have termed "data rods," are pre-generated or generated on-the-fly. This optimal solution was arrived at after extensive investigations of various approaches, including one based on "data curtains." The on-the-fly generation of data rods uses "data cubes," NASA Giovanni, and parallel processing. The optimal reorganization of NASA earth science data has significantly enhanced the access to and use of the data for the hydrology user community.

data rods↗

Interpretable Categorization of Heterogeneous Time Series Data

We analyze data from simulated aircraft encounters to validate and inform the development of a prototype aircraft collision avoidance system. The high-dimensional and heterogeneous time series dataset is analyzed to discover properties of near mid-air collisions (NMACs) and categorize the NMAC encounters. Domain experts use these properties to better organize and understand NMAC occurrences. Existing solutions either are not capable of handling high-dimensional and heterogeneous time series datasets or do not provide explanations that are interpretable by a domain expert. The latter is critical to the acceptance and deployment of safety-critical systems. To address this gap, we propose grammar-based decision trees along with a learning algorithm. Our approach extends decision trees with a grammar framework for classifying heterogeneous time series data. A context-free grammar is used to derive decision expressions that are interpretable, application-specific, and support heterogeneous data types. In addition to classification, we show how grammar-based decision trees can also be used for categorization, which is a combination of clustering and generating interpretable explanations for each cluster. We apply grammar-based decision trees to a simulated aircraft encounter dataset and evaluate the performance of four variants of our learning algorithm. The best algorithm is used to analyze and categorize near mid-air collisions in the aircraft encounter dataset. We describe each discovered category in detail and discuss its relevance to aircraft collision avoidance.

Drones↗

Prediction of Adverse Events in Time Series Data Using ACCEPT (Adverse Condition and Critical Event Prediction Toolbox)

Abstract:An open-source toolbox called ACCEPT (Adverse Condition and Critical Event Prediction Toolbox) that operates from within the Matlab programming environment is introduced. The toolbox provides an open source, special-purpose functionality that can be used specifically for the prediction or forecasting of adverse events in time series data. It also provides a single, unifying framework in which to compare a variety of combinations of algorithmic approaches addressing this problem. The architectural framework also offers the flexibility for expansion to accommodate the newest, latest popular regression and detection methods for this particular problem, enabling the development of an infrastructure that can act as a proving ground platform for comparing new techniques to the state of the art. As such, its intention is to act as a catalyst in advancing the state of the art in technologies related to this problem. There are a variety of other toolboxes that offer similar capabilities and features, however they are either more suitable as general purpose machine learning toolboxes or are only available commercially or through agreements. ACCEPT fills that niche by offering visibility into a specific approach for addressing the adverse event prediction problem.

programming environments↗

Derivation and Testing of Consumptive Water Use Fraction for Specialty Crops

The Crop Consumptive Use Fraction (CCUF) expresses beneficial water use in the form of seasonal evapotranspiration of applied water (ETAW), relative to total irrigation volume. The metric is an indicator of the efficiency of agricultural water use and is a recommended component for preparation of agricultural water management plans in California. An FAO-56 based web application has been developed to facilitate retrospective evaluation of ETAW, and hence CCUF, at field level. The current application is optimized for prevailing climate in four of the state’s main growing regions: San Joaquin Valley, Sacramento Valley, Central Coast, and North Coast. User inputs include crop type, soil texture, irrigation method, daily irrigation volume, daily rainfall, and seasonal start/stop dates to define the analysis period. Time series of fractional green canopy cover (Fc), based on Landsat and Sentinel-2 Earth-resource satellite observations, are imported from NASA’s Satellite Irrigation Management Support (SIMS) system. Grass reference evapotranspiration (ETo) time series are accessed from Spatial CIMIS (California Irrigation Management Information System). Daily crop height (h) is estimated as a simple function of typical maximum height for the given crop type (from FAO-56) and Fc. A vegetation density coefficient (Kd) is derived from Fc and h. Stomatal control factors during mid-and late-season are applied to tree and vine crops. Typical values for minimum daily relative humidity and mean daily windspeed, derived from historical CIMIS weather data, are used to correct for regional deviations from standard climate (defined as RHmin=45%, windspeed =2m/s). The resulting daily basal crop coefficient (Kcb) represents the ET of a well-watered crop with minimal soil evaporation, relative to ETo. A soil water balance sub-model for the top 0.1 m is used to calculate daily evaporation coefficients (Ke). A second sub-model applies to the root zone to calculate crop water stress coefficients (Ks) and effective precipitation (Pe), which is the fraction of rainfall that is available for crop use. Those coefficients are combined with Kcb and ETo to calculate daily ETc. ETAW is then derived as cumulative ETc less cumulative Pe. For verification purposes, sensor installations were used to measure seasonal ETc in commercial fields for several annual and perennial specialty crops by soil water balance and energy balance methods. Model estimates of seasonal ETc show mean absolute error of <10% compared to the ground measurements.

Derivation↗

Maldives Climate II: Evaluating the Potential Impacts of Sea Level Rise on Human Development and Coastal Infrastructure

The Republic of the Maldives is a low-lying island nation in the Indian Ocean which has experienced rapid urbanization, landcover changes, and sea level rise over recent years. The growth of tourism, coastal erosion, and urbanization have all driven land reclamation efforts across many islands. As in-situ landcover change monitoring has proven difficult across the vast archipelago, the NASA DEVELOP team collaborated with the Maldives Ministry of Environment, Climate Change, and Technology; USAID; and the U.S. Department of State, to utilize Earth observations to predict sea level rise impacts on coastal infrastructure. The team used a supervised classification algorithm within Google Earth Engine to create land use maps and time series analyses of nine islands and atolls using imagery from Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, Sentinel-2 Multispectral Instrument, and PlanetScope, covering a combined period of 2000 through 2023. Additionally, the team projected coastal inundation with a modified deterministic Bathtub model utilizing elevation data from CoastalDEM and 2050-2100 Shared Socioeconomic Pathway scenarios identified in the NASA Sea Level Rise Projection Tool. The team found that islands undergoing urban growth experienced a 23% decrease in vegetation between 2014 and 2022. Furthermore, the model predicted that 51–57% of the study area’s-built environment has a chance of inundation by 2100 under the low and high sea level scenarios. These analyses demonstrate how remote sensing can be used to both track land use changes over time and project how coastlines will be affected by sea level rise.

remote sensing↗

Multidimensional Data Aggregation in the Cloud with Application to Geostationary Satellite-based Air Quality Monitoring

Scientists use satellite data for studying Earth's systems, and the remote sensing data that these satellites collect are typically separated into files of a size small enough for efficient network transfer and storage. However, researchers usually prefer to analyze the data based on real-world dimensions like time, space, or elevation. To help with this, NASA's Atmospheric Science Data Center (ASDC) developed a new cloud-based tool that combines these smaller data chunks into larger, more useful datasets. The tool works on Network Common Data Form (netCDF4) and some HDF5 formatted files, and it is available as a service in NASA's Earthdata Cloud. In this presentation, we showcase this service using data from the Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. By combining TEMPO's continuous observations over time, we create longer and more informative analysis-ready time series to facilitate the study of air quality patterns. Insights gained will provide a more comprehensive understanding of pollution sources, transport patterns, and their effects on the environment and human health.

Daniel Kaufman↗

Trends and Solar Cycle Effects in Temperature Versus Altitude From the Halogen Occultation Experiment for the Mesosphere and Upper Stratosphere

Fourteen-year time series of mesospheric and upper stratospheric temperatures from the Halogen Occultation Experiment (HALOE) are analyzed and reported. The data have been binned according to ten-degree wide latitude zones from 40S to 40N and at 10 altitudes from 43 to 80 km-a total of 90 separate time series. Multiple linear regression (MLR) analysis techniques have been applied to those time series. This study focuses on resolving their 11-yr solar cycle (or SC-like) responses and their linear trend terms. Findings for T(z) from HALOE are compared directly with published results from ground-based Rayleigh lidar and rocketsonde measurements. SC-like responses from HALOE compare well with those from lidar station data at low latitudes. The cooling trends from HALOE also agree reasonably well with those from the lidar data for the concurrent decade. Cooling trends of the lower mesosphere from HALOE are not as large as those from rocketsondes and from lidar station time series of the previous two decades, presumably because the changes in the upper stratospheric ozone were near zero during the HALOE time period and did not affect those trends.

Remsberg, Ellis E.↗

Verification of interim simulated atmospheric turbulence

During horizontal and near-horizontal flight of the space shuttle orbiter, the effects of atmospheric turbulence on the vehicle are crucial in establishing the space shuttle design, control, and human pilot effects. The effects of both turbulent gusts and gust gradients (shears) must be taken into account. By means of a nonrecursive turbulence simulation model, twelve simulated turbulence time series for gusts and gust gradients were generated as part of a previous investigation. The current investigation was concerned with the spectral analysis of the time series based on the use of Fourier transform theory. A comparison between the computed spectra and the corresponding von Karman theoretical spectra is also included. A basic difference is explained between the computed and theoretical spectra which was identified as a result of the comparison. Conclusions and recommendations are presented.

Tatom, F. B.↗

Lyapunov exponent of magnetospheric activity from AL time series

A correlation dimension analysis of the AE index indicates that the magnetosphere behaves as a low-dimensional chaotic system with a dimension close to 4. Similar techniques are used to determine if the system's behavior is due to an intrinsic sensitivity to initial conditions and thus is truly chaotic. The quantity used to measure the sensitivity to initial conditions is the Liapunov exponent. Its calculation for AL shows that it is nonzero (0.11 + or - 0.05/min). This gives the exponential rate at which initially similar configurations of the magnetosphere evolve into completely different states. Also, predictions of deterministic nonlinear models are expected to deviate from the observed behavior at the same rate.

Vassiliadis, D.↗

Monitoring Global Sea Level: Eustatic Variations, Local Variations, and Solid Earth Effects

Project BIFROST (Baseline Inferences for Fennoscandian Rebound Observations. Sea-level and Tectonics) combines networks of continuously operating CPS receivers in Sweden and Finland to measure ongoing crustal deformation due to glacial isostatic adjustment, (CIA). We present an analysis of data collected in the years 1993-1998. We compare the CPS determinations of three-dimensional crustal motion to predictions calculated using the high resolution Fennoscandian deglaciation model recently proposed by Lambeck et al. We find that the the maximum observed uplift rate (approx. 10 mm/ yr) and the maximum predicted uplift rate agree to better than 1 mm/ yr. The patterns of uplift also agree quite well, although differences are discernible. The chi(exp 2) difference between predicted and GPS-observed radial rates is reduced by a factor of 5-6 compared to that for the "null" (no uplift) model, depending on whether a mean difference is first removed. The north components of velocity agree at about the same relative level. whereas the agreement for the east components is worse, a problem possibly related to the lack of bias fixing. We have also compared the values for the observed radial deformation rates to those based on sea-level rates from Baltic tide gauges. The weighted RMS difference between CPS and tide-gauge rates (after removing a mean) is 0.6 mm/ yr, giving an indication of the combined accuracy of the CPS and tide-gauge measurement systems. Spectral analysis of the time series of position estimates yields spectral indices in the range -1 to -2. An EOF analysis indicates, however, that much of this power is correlated among the sites. The correlation appears to be regional and falls off only slightly with distance. Some of this correlated noise is associated with snow accumulation on the antennas or, for those antennas with radomes, on the radomes. This problem has caused us to modify the radomes used several times, leading to one of our more significant sources of uncertainty.

Davis, James L.↗

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗