Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

The Seismic Experiment for Interior Structure (SEIS): Experiment Data Distribution

The six sensors of SEIS (The Seismic Experiment for Interior Structure) [- one of three primary instruments on NASA's Mars Lander Insight] cover a broad range of the seismic bandwidth, from 0.01 hertz to 50 hertz, with possible extension to longer periods. Data are transmitted in the form of three continuous VBB (Very Broad-Band) components at 2 samples per second (sps), an estimation of the short period (SP) energy content from the SP at 1 sps, and a continuous compound VBB/SP vertical axis at 10 sps. The continuous streams are augmented by requested event data with sample rates from 20 to 100 sps. SEIS data products are downlinked from the spacecraft in raw CCSDS (Consultative Committee for Space Data Systems) packets and converted to both the Standard for the Exchange of Earthquake Data (SEED) format files and ASCII tables (GeoCSV) for analysis and archiving. Metadata are available in dataless SEED and StionXML. Time series data (waveforms) are available in miniseed and GeoCSV. Data are distributed according to FDSN (Federation of Digital Seismograph Networks - http://www.fdsn.org) formats and interfaces. Wind, pressure and temperature data from the Auxiliary Payload Sensor Suite (APSS) will also be available in SEED format, and can be used for decorrelation and diagnostic purposes on SEIS.

Pardo, Constanza↗

Enchanced interference cancellation and telemetry reception in multipath environments with a single paraboic dish antenna using a focal plane array

An Advanced Focal Plane Array ("AFPA") for parabolic dish antennas that exploits spatial diversity to achieve better channel equalization performance in the presence of multipath (better than temporal equalization alone), and which is capable of receiving from two or more sources within a field-of-view in the presence of multipath. The AFPA uses a focal plane array of receiving elements plus a spatio-temporal filter that keeps information on the adaptive FIR filter weights, relative amplitudes and phases of the incoming signals, and which employs an Interference Cancelling Constant Modulus Algorithm (IC-CMA) that resolves multiple telemetry streams simultaneously from the respective aero-nautical platforms. This data is sent to an angle estimator to calculate the target's angular position, and then on to Kalman filters FOR smoothing and time series prediction. The resulting velocity and acceleration estimates from the time series data are sent to an antenna control unit (ACU) to be used for pointing control.

Mukai, Ryan↗

Kepler Planet Detection Metrics: Per-Target Flux-Level Transit Injection Tests of TPS for Data Release 25

Quantifying the ability of a transiting planet survey to recover transit signals has commonly been accomplished through Monte-Carlo injection of transit signals into the observed data and subsequent running of the signal search algorithm (Gilliland et al., 2000; Weldrake et al., 2005; Burke et al., 2006). In order to characterize the performance of the Kepler pipeline (Twicken et al., 2016; Jenkins et al., 2017) on a sample of over 200,000 stars, two complementary injection and recovery tests are utilized:1. Injection of a single transit signal per target into the image or pixel-level data, hereafter referred to as pixel-level transit injection (PLTI), with subsequent processing through the Photometric Analysis (PA), Presearch Data Conditioning (PDC), Transiting Planet Search (TPS), and Data Validation (DV) modules of the Kepler pipeline. The PLTI quantification of the Kepler pipeline's completeness has been described previously by Christiansen et al. (2015, 2016); the completeness of the final SOC 9.3 Kepler pipeline acting on the Data Release 25 (DR25) light curves is described by Christiansen (2017).2. Injection of multiple transit signals per target into the normalized flux time series data with a subsequent transit search using a stream-lined version of the Transiting Planet Search (TPS) module. This test, hereafter referred to as flux-level transit injection (FLTI), is the subject of this document. By running a heavily modified version of TPS, FLTI is able to perform many injections on selected targets and determine in some detail which injected signals are recoverable. Significant numerical efficiency gains are enabled by precomputing the data conditioning steps at the onset of TPS and limiting the search parameter space (i.e., orbital period, transit duration, and ephemeris zero-point) to a small region around each injected transit signal.The PLTI test has the advantage that it follows transit signals through all processing steps of the Kepler pipeline, and the recovered signals can be further classified as planet candidates or false positives in the exact same manner as detections from the nominal (i.e., observed) pipeline run (Twicken et al., 2016, Thompson et al., in preparation). To date, the PLTI test has been the standard means of measuring pipeline completeness averaged over large samples of targets (Christiansen et al., 2015, 2016; Christiansen, 2017). However, since the PLTI test uses only one injection per target, it does not elucidate individual-target variations in pipeline completeness due to differences in stellar properties or astrophysical variability. Thus, we developed the FLTI test to provide a numerically efficient way to fully map individual targets and explore the performance of the pipeline in greater detail. The FLTI tests thereby allow a thorough validation of the pipeline completeness models (such as window function (Burke and Catanzarite, 2017a), detection efficiency (Burke Catanzarite, 2017b), etc.) across the spectrum of Kepler targets (i.e., various astrophysical phenomena and differences in instrumental noise). Tests during development of the FLTI capability revealed that there are significant target-to-target variations in the detection efficiency.

DR25↗

Online Visualization and Value Added Services of MERRA-2 Data at GES DISC

NASA climate reanalysis datasets from MERRA-2, distributed at the Goddard Earth Sciences Data and Information Services Center (GES DISC), have been used in broad research areas, such as climate variations, extreme weather, agriculture, renewable energy, and air quality, etc. The datasets contain numerous variables for atmosphere, land, and ocean, grouped into 95 products. The total archived volume is approximately 337 TB ( approximately 562K files) at the end of October 2017. Due to the large number of products and files, and large data volumes, it may be a challenge for a user to find and download the data of interest. The support team at GES DISC, working closely with the MERRA-2 science team, has created and is continuing to work on value added data services to best meet the needs of a broad user community. This presentation, using aerosol over Asia Monsoon as an example, provides an overview of the MERRA-2 data services at GES DISC, including: How to find the data? How many data access methods are provided? What are the best data access methods for me? How do download the subsetted (parameter, spatial, temporal) data and save in preferred spatial resolution and data format? How to visualize and explore the data online? In addition, we introduce a future online analytic tool designed for supporting application research, focusing on long-term hourly time-series data access and analysis.

Shen, Suhung↗

Application of Machine Learning to Rotorcraft Health Monitoring

Machine learning is a powerful tool for data exploration and model building with large data sets. This project aimed to use machine learning techniques to explore the inherent structure of data from rotorcraft gear tests, relationships between features and damage states, and to build a system for predicting gear health for future rotorcraft transmission applications. Classical machine learning techniques are difficult, if not irresponsible to apply to time series data because many make the assumption of independence between samples. To overcome this, Hidden Markov Models were used to create a binary classifier for identifying scuffing transitions and Recurrent Neural Networks were used to leverage long distance relationships in predicting discrete damage states. When combined in a workflow, where the binary classifier acted as a filter for the fatigue monitor, the system was able to demonstrate accuracy in damage state prediction and scuffing identification. The time dependent nature of the data restricted data exploration to collecting and analyzing data from the model selection process. The limited amount of available data was unable to give useful information, and the division of training and testing sets tended to heavily influence the scores of the models across combinations of features and hyper-parameters. This work built a framework for tracking scuffing and fatigue on streaming data and demonstrates that machine learning has much to offer rotorcraft health monitoring by using Bayesian learning and deep learning methods to capture the time dependent nature of the data. Suggested future work is to implement the framework developed in this project using a larger variety of data sets to test the generalization capabilities of the models and allow for data exploration.

machine learning↗

Evaluation of Extreme Soil Moisture Patterns over the Sahel during the 2020 Growing Season

The African Sahel is an ecologically and climatically sensitive region, and thus is a valuable test case for examination of climate extremes. Above-average rainfall during the 2020 growing season (June-October) led to flooding in the West, Central and East Sahel, with implications for infrastructure, agriculture and disease outbreaks. In this study, we evaluate soil moisture patterns in the region during 2020 to assess and quantify the extremeness of the event. The primary tool is the NASA Soil Moisture Active Passive (SMAP) Level 4 surface soil moisture data. Daily, monthly, and seasonal anomalies are computed relative to SMAP’s long-term mean (2015-2021). Additional comparisons are made with longer-time-series data sets, including surface soil moisture from NASA’s Modern-Era Retrospective analysis for Research and Applications, Version 2(MERRA-2; 1981-present) and precipitation from the African Rainfall Climatology, Version 2 (ARC2; 1983-present).Possible drivers of the extreme wet event are examined, including potential links to the concurrent 2020-21 La Niña event. Finally, we explore the connections between the extreme soil moisture and vector-borne disease outbreaks in the region in2020, namely, Rift Valley Fever in Mauritania and Chikungunya in Chad.

Soil Moisture↗

Doppler radar echoes of lightning and precipitation at vertical incidence

Digital time series data at 16 heights within two storms were collected at vertical incidence with a 10-cm Doppler radar. On several occasions during data collection, lightning echoes were observed as increased reflectivity on an oscilloscope display. Simultaneously, lightning signals from nearby electric field change antennas were recorded on an analog recorder together with the radar echoes. Reflectivity, mean velocity, and Doppler spectra were examined by means of time series analysis for times during and after lightning discharges. Spectra from locations where lightning occurred show peaks, due to the motion of the lightning channel at the air speed. These peaks are considerably narrower than the ones due to precipitation. Besides indicating the vertical air velocity that can then be used to estimate hydrometeor-size distribution, the lightning spectra provide a convenient means to estimate the radar cross section of the channel. Subsequent to one discharge, we deduce that a rapid change in the orientation of hydrometeors occurred within the resolution volume.

Zrnic, D. S.↗

Field Model: An Object-Oriented Data Model for Fields

We present an extensible, object-oriented data model designed for field data entitled Field Model (FM). FM objects can represent a wide variety of fields, including fields of arbitrary dimension and node type. FM can also handle time-series data. FM achieves generality through carefully selected topological primitives and through an implementation that leverages the potential of templated C++. FM supports fields where the nodes values are paired with any cell type. Thus FM can represent data where the field nodes are paired with the vertices ("vertex-centered" data), fields where the nodes are paired with the D-dimensional cells in R(sup D) (often called "cell-centered" data), as well as fields where nodes are paired with edges or other cell types. FM is designed to effectively handle very large data sets; in particular FM employs a demand-driven evaluation strategy that works especially well with large field data. Finally, the interfaces developed for FM have the potential to effectively abstract field data based on adaptive meshes. We present initial results with a triangular adaptive grid in R(sup 2) and discuss how the same design abstractions would work equally well with other adaptive-grid variations, including meshes in R(sup 3).

Moran, Patrick J.↗

Application of GRACE to the Estimation of Groundwater Storage Change in a Data-poor Region: A Case Study of Ngadda Catchment in the Lake Chad Basin

The present study is to explore the feasibility of GRACE-based estimation of a groundwater storage change in a data-poor region using a case study of the Ngadda catchment in the Lake Chad Basin. Although the Ngadda catchment has only one set of in situ time series data of groundwater from 2006 to 2009 and a limited number of groundwater measurements in 2005 and 2009, GRACE-based groundwater storage change can be evaluated against thein situ groundwater measurements combined with specific yield data. The cross-correlation analysis in the Ngadda catchment shows that maximum rainfall reached in July and August, whereas both the maximum total water storage anomaly and the maximum groundwater storage anomaly occurred 2months later. Whereas the mean annual amplitude of total water storage anomaly is about 17cm from both the average total water storage anomaly from three mascon products and the one from three spherical harmonic products, the mean annual amplitude of soil moisture storage anomaly is substantially varied from5.58cm for CLM to about 14cm for NOAH and Mosaic. The goodness-of-fit tests show that CLM soil moisture produces the closest estimation of groundwater storage anomaly to thein situ groundwater measurements. The present study shows that GRACE-based estimation for groundwater storage anomaly can be a cost-effective and alternative tool to observe how groundwater changes in a basin scale under the limitation of modelling and in situ data availability.

GRACE↗

Digital time series analysis for flutter test data

An application of digital time series analysis to flutter test data processing was conducted. A numerical investigation was used to evaluate the method, as well as its sensitivity to noise and parameter variations. These parameters included those involved with data acquisition, as well as system response characteristics. This digital time series method was then used to predict flutter speed from subcritical response wind tunnel tests. Flutter speeds predicted from forced response, subcritical wind tunnel tests were compared to the experimental flutter speeds.

Batill, S. M.↗

Climate Sensitivity Studies of the Greenland Ice Sheet Using Satellite AVHRR, SMMR, SSM/I and in Situ Data

The feasibility of using satellite data for climate research over the Greenland ice sheet is discussed. In particular, we demonstrate the usefulness of Advanced Very High Resolution Radiometer (AVHRR) Local Area Coverage (LAC) and Global Area Coverage (GAC) data for narrow-band albedo retrieval. Our study supports the use of lower resolution AVHRR (GAC) data for process studies over most of the Greenland ice sheet. Based on LAC data time series analysis, we can resolve relative albedo changes on the order of 2-5%. In addition, we examine Scanning Multichannel Microwave Radiometer (SMMR) and Special Sensor Microwave Imager (SSM/I) passive microwave data for snow typing and other signals of climatological significance. Based on relationships between in situ measurements and horizontally polarized 19 and 37 GHz observations, wet snow regions are identified. The wet snow regions increase in aerial percentage from 9% of the total ice surface in June to a maximum of 26% in August 1990. Furthermore, the relationship between brightness temperatures and accumulation rates in the northeastern part of Greenland is described. We found a consistent increase in accumulation rate for the northeastern part of the ice sheet from 1981 to 1986.

Steffen, K.↗

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003-November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm H2O (1 cm H2O approx. 1 hPa), slightly lower than the 1.9 cmH2O estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cmH2O (1.1 and 0.6 cm H2O with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv (Sv equiv 10(exp 6)cu m/s) of barotropic transport variability per cm H2O of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40(deg)- 65(deg)S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

Gravity Recovery and Climate Experiment (GRACE)↗

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003 - November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm(sub H2O) (1 cm(sub H2O) similar to 1 hPa), slightly lower than the 1.9 cm(sub H2O) estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cm(sub H2O) (1.1 and 0.6 cm(sub H2O) with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv ( Sv equivalent to 10(exp 6) m(exp 3) s(exp -1)) of barotropic transport variability per cm(sub H2O) of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40 de - 65 deg S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

oceanographic regions↗

Monitoring vegetation using Nimbus-7 scanning mutichannel microwave radiometer's data

Field studies and radiative transfer model calculations have shown that brightness temperature at high microwave frequencies is strongly affected by vegetation. The daytime observations for six consecutive years (1979 to 1984) over the Sahara, Senegalese Sahel, Burkina Fasso (Upper Volta), and U.S. Southern Great Plains at 37 GHz frequency of the Sanning Multichannel Microwave Radiometer (SMMR) on board the Nimbus-7 satellite are analyzed, and a high correlation with the normalized difference vegetation index derived from the Advanced Very High Resolution Radiometer on board the NOAA-7 satellite is found. The SMMR data appear to provide a valuable new long-term global data set for monitoring vegetation. In particular, the differing responses of vegetation (for example, annual grasses versus woody plants) to drought and the stability of the desert/steppe boundary of northern Africa might be studied using the time series data.

Choudhury, B. J.↗

Alanna Conners and the Origins of Principled Data Analysis

Alanna was one of the most important pioneers in the development of not just sophisticated algorithms for analyzing astronomical data but more importantly an overall viewpoint emphasizing the use of statistically sound principles in place of blind application of cook-book recipes, or black boxes. I will outline some of the threads of this viewpoint, emphasizing time series data, with a focus on the importance of these developments for the Age of Digital Astronomy that we are entering.

age of digital astronomy↗

Spatiotemporal Characterization of Droughts and Vegetation Response in Northwest Africa From 1981 to 2020

Drought has become one of the most devastating natural risks of agricultural production and the environment in almost all climate regions. Thus, understanding the spatiotemporal characteristics of drought and its associated impacts is crucial in drought early warning management and adaptation efforts. In this study, we used the 3-month Standardized Precipitation Index (SPI-3) obtained from Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS) to investigate the space–time characteristics of drought conditions. Also, this study examined the impact of the SPI-based drought on vegetation health conditions using the Advanced Very High Resolution Radiometer (AVHRR) Normalized Difference Vegetation Index (NDVI) time-series data from 1981 to 2020. The results revealed that the region experiences drought primarily between July and September, with the most prolonged drought events lasting up to five months. Morocco suffered from more frequent droughts than other countries in the region. The Mann-Kendall test showed that the trend of drought became drier over the last decade, whereas the period from 1981 to 2010 witnessed either wetting or no trends. This study also found that the response of crops and grasslands showed higher correlation with the SPI-3 and that the response of vegetation to droughts was higher during the dry season. The findings of this study provide useful information to support local and regional drought planning and adaptation programs and enhance the understanding of drought development in the region.

Nguyen Quang Thi↗

Atmospheric pressure, density, temperature and wind variations between 50 and 200 km

Data on atmospheric pressure, density, temperature and winds between 50 and 200 km were collected from sources including Meteorological Rocket Network data, ROBIN falling sphere data, grenade release and pitot tube data, meteor winds, chemical release winds, satellite data, and others. These data were analyzed by a daily difference method and results on the distribution statistics, magnitude, and spatial structure of the irregular atmospheric variations are presented. Time structures of the irregular variations were determined by the analysis of residuals from harmonic analysis of time series data. The observed height variations of irregular winds and densities are found to be in accord with a theoretical relation between these two quantities. The latitude variations (at 50 - 60 km height) show an increasing trend with latitude. A possible explanation of the unusually large irregular wind magnitudes of the White Sands MRN data is given in terms of mountain wave generation by the Sierra Nevada range about 1000 km west of White Sands. An analytical method is developed which, based on an analogy of the irregular motion field with axisymmetric turbulence, allows measured or model correlation or structure functions to be used to evaluate the effective frequency spectra of scalar and vector quantities of a spacecraft moving at any speed and at any trajectory elevation angle.

Justus, C. G.↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗