Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Data management strategy to improve global use of ocean acidification data and information

Ocean acidification (OA) refers to the general decrease in pH of the global ocean as a result of absorbing anthropogenic CO 2 emitted in the atmosphere since preindustrial times (sabine et al., 2004). There is, however, considerable variability in ocean acidification, and many careful measurements need to be made and compared in order to obtain scientifically valid information for the assessment of patterns, trends, and impacts over a range of spatial and temporal scales, and to understand the process involved. A single country or institution cannot undertaken measurements of worldwide coastal and open ocean OA changes; therefore, international cooperation is needed to achieve that goal. Here, the OA data that have been, and are being, collected represent a significant public investment. To this end, it is critically important that researchers (and others) around the world are easily able to find and use reliable OA information that range from observing data (from time-series moorings, process studies, and research cruises), to biological response experiments (e.g., mesocosm), data products, and model output.

54 ENVIRONMENTAL SCIENCES↗

Stepwise Iterative Fourier Transform: The SIFT

A program, designed specifically to study the respective effects of some common data problems on results obtained through stepwise iterative Fourier transformation of synthetic data with known waveform composition, was outlined. Included in this group were the problems of gaps in the data, different time-series lengths, periodic but nonsinusoidal waveforms, and noisy (low signal-to-noise) data. Results on sinusoidal data were also compared with results obtained on narrow band noise with similar characteristics. The findings showed that the analytic procedure under study can reliably reduce data in the nature of (1) sinusoids in noise, (2) asymmetric but periodic waves in noise, and (3) sinusoids in noise with substantial gaps in the data. The program was also able to analyze narrow-band noise well, but with increased interpretational problems. The procedure was shown to be a powerful technique for analysis of periodicities, in comparison with classical spectrum analysis techniques. However, informed use of the stepwise procedure nevertheless requires some background of knowledge concerning characteristics of the biological processes under study.

Benignus, V. A.↗

Learning perturbation-inducible cell states from observability analysis of transcriptome dynamics

Abstract A major challenge in biotechnology and biomanufacturing is the identification of a set of biomarkers for perturbations and metabolites of interest. Here, we develop a data-driven, transcriptome-wide approach to rank perturbation-inducible genes from time-series RNA sequencing data for the discovery of analyte-responsive promoters. This provides a set of biomarkers that act as a proxy for the transcriptional state referred to as cell state. We construct low-dimensional models of gene expression dynamics and rank genes by their ability to capture the perturbation-specific cell state using a novel observability analysis. Using this ranking, we extract 15 analyte-responsive promoters for the organophosphate malathion in the underutilized host organism Pseudomonas fluorescens SBW25. We develop synthetic genetic reporters from each analyte-responsive promoter and characterize their response to malathion. Furthermore, we enhance malathion reporting through the aggregation of the response of individual reporters with a synthetic consortium approach, and we exemplify the library’s ability to be useful outside the lab by detecting malathion in the environment. The engineered host cell, a living malathion sensor, can be optimized for use in environmental diagnostics while the developed machine learning tool can be applied to discover perturbation-inducible gene expression systems in the compendium of host organisms.

59 BASIC BIOLOGICAL SCIENCES↗

Studies in astronomical time series analysis. III - Fourier transforms, autocorrelation functions, and cross-correlation functions of unevenly spaced data

This paper develops techniques to evaluate the discrete Fourier transform (DFT), the autocorrelation function (ACF), and the cross-correlation function (CCF) of time series which are not evenly sampled. The series may consist of quantized point data (e.g., yes/no processes such as photon arrival). The DFT, which can be inverted to recover the original data and the sampling, is used to compute correlation functions by means of a procedure which is effectively, but not explicitly, an interpolation. The CCF can be computed for two time series not even sampled at the same set of times. Techniques for removing the distortion of the correlation functions caused by the sampling, determining the value of a constant component to the data, and treating unequally weighted data are also discussed. FORTRAN code for the Fourier transform algorithm and numerical examples of the techniques are given.

Scargle, Jeffrey D.↗

System for kick detection during a drilling operation

The disclosure provides a kick detection system for use during a drilling operation where wellbore kick warnings are provided based on indications of standoff conditions in a compensated instrument system. The system provides a warning of a potential kick condition by analyzing a current instrument compensation against a time series of past compensations, in order to monitor whether conditions within the standoff region of the wellbore are unexpectedly changing. The system comprises a source, a short-spaced detector, and a long-spaced detector, and a processor receives the short-spaced signal and the long-spaced signal, compensates the long-spaced signal, and generates standoff data reflecting the corrections applied to the long-range signal. The processor determines and maintains the standoff data as a time series and periodically compares a recent data point to a moving average in order to evaluate indications of a potential well kick.

Rose, Kelly K.↗

Application of physical parameter identification to finite element models

A time domain technique for matching response predictions of a structural dynamic model to test measurements is developed. Significance is attached to prior estimates of physical model parameters and to experimental data. The Bayesian estimation procedure allows confidence levels in predicted physical and modal parameters to be obtained. Structural optimization procedures are employed to minimize an error functional with physical model parameters describing the finite element model as design variables. The number of complete FEM analyses are reduced using approximation concepts, including the recently developed convoluted Taylor series approach. The error function is represented in closed form by converting free decay test data to a time series model using Prony' method. The technique is demonstrated on simulated response of a simple truss structure.

Bronowicki, Allen J.↗

Variability in the Gulf of Alaska from Geosat altimetry data

Satellite altimetry was used to examine annual and interannual variability in the Gulf of Alaska region. Crossover data from the Geosat Geodetic Mission (GM) and collinear data from the Exact Repeat Mission (ERM) were processed separately to form sea surface height anomalies at grid points. The time series from the GM and ERM were then combined to produce a 3.75-year data set. The time series from the ERM data set agreed fairly well with hydrographic dynamic heights at several locations, with an average correlation of 0.70 between the two data sets. The combined and ERM altimetric data sets were analyzed using empirical orthogonal functions (EOFs). These revealed variability that occurs primarily on annual and interannual time scales. A comparison with EOF analysis of the atmospheric pressure field during the same time periods showed that the annual variation in pressure seemed to be reflected in both the combined and ERM altimetric data sets. The amplitude time series of the first mode in the combined data set was very similar to the North Pacific pressure index during the 1985-1989 time frame. The maximum correlation was at a lag of 250 days. Finally, an interannual mode was present in all three data sets which was closely linked to the baroclinic variations measured by the hydrographic data.

Bhaskaran, Shyam↗

Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series

Anomaly detection is a widely studied task for a broad variety of data types; among them, multiple time series appear frequently in applications, including for example, power grids and traffic networks. Detecting anomalies for multiple time series, however, is a challenging subject, owing to the intricate interdependencies among the constituent series. We hypothesize that anomalies occur in low density regions of a distribution and explore the use of normalizing flows for unsupervised anomaly detection, because of their superior quality in density estimation. Moreover, we propose a novel flow model by imposing a Bayesian network among constituent series. A Bayesian network is a directed acyclic graph (DAG) that models causal relationships; it factorizes the joint probability of the series into the product of easy-to-evaluate conditional probabilities. We call such a graph-augmented normalizing flow approach GANF and propose joint estimation of the DAG with flow parameters. We conduct extensive experiments on real-world datasets and demonstrate the effectiveness of GANF for density estimation, anomaly detection, and identification of time series distribution drift.

Dai, Enyan↗

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗

Enhancing e-waste estimates: Improving data quality by multivariate Input–Output Analysis

Highlights: • A multivariate Input–Output Analysis method for e-waste estimates is proposed. • Applying multivariate analysis to consolidate data can enhance e-waste estimates. • We examine the influence of model selection and data quality on e-waste estimates. • Datasets of all e-waste related variables in a Dutch case study have been provided. • Accurate modeling of time-variant lifespan distributions is critical for estimate. - Abstract: Waste electrical and electronic equipment (or e-waste) is one of the fastest growing waste streams, which encompasses a wide and increasing spectrum of products. Accurate estimation of e-waste generation is difficult, mainly due to lack of high quality data referred to market and socio-economic dynamics. This paper addresses how to enhance e-waste estimates by providing techniques to increase data quality. An advanced, flexible and multivariate Input–Output Analysis (IOA) method is proposed. It links all three pillars in IOA (product sales, stock and lifespan profiles) to construct mathematical relationships between various data points. By applying this method, the data consolidation steps can generate more accurate time-series datasets from available data pool. This can consequently increase the reliability of e-waste estimates compared to the approach without data processing. A case study in the Netherlands is used to apply the advanced IOA model. As a result, for the first time ever, complete datasets of all three variables for estimating all types of e-waste have been obtained. The result of this study also demonstrates significant disparity between various estimation models, arising from the use of data under different conditions. It shows the importance of applying multivariate approach and multiple sources to improve data quality for modelling, specifically using appropriate time-varying lifespan parameters. Following the case study, a roadmap with a procedural guideline is provided to enhance e-waste estimation studies.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Cloud-Based Time Series Analysis of Extremes: Use Cases and Applications

"Extreme weather events, such as hurricanes, tornadoes, floods, droughts, heatwaves, and blizzards, can cause widespread damage, disrupting ecosystems, agricultural production, and economies. The frequency and intensity of these events have been increasing, likely due to climate change, raising concerns and the need for more accurate analysis and predictions. NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) has migrated its long-term historical datasets, including precipitation data from MERRA-2 reanalysis, GLDAS land data assimilation, and IMERG satellite observations, to the cloud. This cloud-stored data enables scientists and researchers to utilize cloud computing for advanced modeling and forecasting of extreme weather events, eliminating the need to download large datasets. In this presentation, we will provide an overview of the cloud-based data and services managed by GES DISC; demonstrate methods for accessing and analyzing time series data stored in the cloud; and compare results across various datasets to address critical questions related to extreme precipitation. We will present use cases including: 1. Determining the average total precipitation in California during January and February from 2000 to 2024, and identifying anomalous precipitation in 2021. 2. Calculating the 10, 20, 50, and 100-year return periods for maximum daily rainfall based on 25 years of historical precipitation data (2000-2024) for Maryland.

time series↗

Seasonal Evolution and Interannual Variability of the Local Solar Energy Absorbed by the Arctic Sea Ice-Ocean System

The melt season of the Arctic sea ice cover is greatly affected by the partitioning of the incident solar radiation between reflection to the atmosphere and absorption in the ice and ocean. This partitioning exhibits a strong seasonal cycle and significant interannual variability. Data in the period 1998, 2000-2004 were analyzed in this study. Observations made during the 1997-1998 SHEBA (Surface HEat Budget of the Arctic Ocean) field experiment showed a strong seasonal dependence of the partitioning, dominated by a five-phase albedo evolution. QuikSCAT scatterometer data from the SHEBA region in 1999-2004 were used to further investigate solar partitioning in summer. The time series of scatterometer data were used to determine the onset of melt and the beginning of freezeup. This information was combined with SSM/I-derived ice concentration, TOVS-based estimates of incident solar irradiance, and SHEBA results to estimate the amount of solar energy absorbed in the ice-ocean system for these years. The average total solar energy absorbed in the ice-ocean system from April through September was 900 MJ m(sup -2). There was considerable interannual variability, with a range of 826 to 1044 MJ m(sup -2). The total amount of solar energy absorbed by the ice and ocean was strongly related to the date of melt onset, but only weakly related to the total duration of the melt season or the onset of freezeup. The timing of melt onset is significant because the incident solar energy is large and a change at this time propagates through the entire melt season, affecting the albedo every day throughout melt and freezeup.

Perovich, Donald K.↗

[MODIS Investigation]

The objective of the last six months were: (1) Continue analysis of Hawaii Ocean Time-series (HOT) bio-optical mooring data, and Southern Ocean bio-optical drifter data; (2) Complete development of documentation of MOCEAN algorithms and software for use by MOCEAN team and GLI team; (3) Deploy instrumentation during JGOFS cruises in the Southern Ocean; (4) Participate in test cruise for Fast Repetition Rate (FRR) fluorometer; (5) Continue chemostat experiments on the relationship of fluorescence quantum yield to environmental factors; and (6) Continue to develop and expand browser-based information system for in situ bio-optical data. We are continuing to analyze bio-optical data collected at the Hawaii Ocean Time Series mooring as well as data from bio-optical drifters that were deployed in the Southern Ocean. A draft manuscript has now been prepared and is being revised. A second manuscript is also in preparation that explores the vector wind fields derived from NSCAT measurements. The HOT bio-optical mooring was recovered in December 1997. After retrieving the data, the sensor package was serviced and redeployed. We have begun preliminary analysis of these data, but we have only had the data for 3 weeks. However, all of the data were recovered, and there were no obvious anomalies. We will add second sensor package to the mooring when it is serviced next spring. In addition, Ricardo Letelier is funded as part of the SeaWiFS calibration/validation effort (through a subcontract from the University of Hawaii, Dr. John Porter), and he will be collecting bio-optical and fluorescence data as part of the HOT activity. This will provide additional in situ measurements for MODIS validation. As noted in the previous quarterly report, we have been analyzing data from three bio-optical drifters that were deployed in the Southern Ocean in September 1996. We presented results on chlorophyll and drifter speed. For the 1998 Ocean Sciences meeting, a paper will be presented on this data set, focusing on the diel variations in fluorescence quantum yield. Briefly, there are systematic patterns in the apparent quantum yield of fluorescence (defined as the slope of the line relating fluorescence/chlorophyll and incoming solar radiation). These systematic variations appear to be related to changes in the circulation of the Antarctic Polar Front which force nutrients into the upper ocean. A more complete analysis will be provided in the next Quarterly report.

Abbott, Mark R.↗

Lineage frequency time series reveal elevated levels of genetic drift in SARS-CoV-2 transmission in England

Genetic drift in infectious disease transmission results from randomness of transmission and host recovery or death. The strength of genetic drift for SARS-CoV-2 transmission is expected to be high due to high levels of superspreading, and this is expected to substantially impact disease epidemiology and evolution. However, we don’t yet have an understanding of how genetic drift changes over time or across locations. Furthermore, noise that results from data collection can potentially confound estimates of genetic drift. To address this challenge, we develop and validate a method to jointly infer genetic drift and measurement noise from time-series lineage frequency data. Our method is highly scalable to increasingly large genomic datasets, which overcomes a limitation in commonly used phylogenetic methods. We apply this method to over 490,000 SARS-CoV-2 genomic sequences from England collected between March 2020 and December 2021 by the COVID-19 Genomics UK (COG-UK) consortium and separately infer the strength of genetic drift for pre-B.1.177, B.1.177, Alpha, and Delta. We find that even after correcting for measurement noise, the strength of genetic drift is consistently, throughout time, higher than that expected from the observed number of COVID-19 positive individuals in England by 1 to 3 orders of magnitude, which cannot be explained by literature values of superspreading. Our estimates of genetic drift suggest low and time-varying establishment probabilities for new mutations, inform the parametrization of SARS-CoV-2 evolutionary models, and motivate future studies of the potential mechanisms for increased stochasticity in this system.

60 APPLIED LIFE SCIENCES↗

TESS Data Release Notes: Sector 24, DR35

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). The data products included in this data release are full frame images (FFIs), target pixel fi les, light curve fi les, collateral pixel fi les, cotrending basis vectors (CBVs), and Data Validation (DV) reports, time series, and associated xml fi les. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD). The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2019).2 The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018) contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

TESS↗

A Few Thoughts on the E-Tunnel Discharge at Rainier Mesa, Nevada National Security Site

In reviewing the Quarterly Monitoring Reports assembled by Navarro for the Rainier Mesa E-Tunnel discharge for the past year (the “Navarro” data), Greg Raab of the Nevada Department of Environmental Proctection (NDEP) noticed a decreasing trend in the pH and was curious as to what was causing it. He noticed an upswing in the March 2016 data and speculated as to whether the trend would go up. Irene Farnham (Navarro) sent along the Navarro chemical and flow data from ETunnel, going back for some of the variables to 1997. Previously I was curious as to whether there was a trend in the discharge flow rates from E-Tunnel that corresponded to Greg Raab’s observations and comments about the decreasing trend in pH observed between 2015 and 2016. So, I plotted the two time series from the Navarro data over roughly the same time period that Greg looked at. There does not appear to be much of a correlation. (NB: The value of 7.1 for January 2016 differs from the value of ~6.55 in Greg’s data).

54 ENVIRONMENTAL SCIENCES↗

Using Wireless Power Meters to Measure Energy Use of Miscellaneous and Electronic Devices in Buildings

Miscellaneous and electronic devices consume about one-third of the primary energy used in U.S. buildings, and their energy use is increasing faster than other end-uses. Despite the success of policies, such as Energy Star, that promote more efficient miscellaneous and electronic products, much remains to be done to address the energy use of these devices if we are to achieve our energy and carbon reduction goals. Developing efficiency strategies for these products depends on better data about their actual usage, but very few studies have collected field data on the long-term energy used by a large sample of devices due to the difficulty and expense of collecting device-level energy data. This paper describes the development of an improved method for collecting device-level energy and power data using small, relatively inexpensive wireless power meters. These meters form a mesh network based on Internet standard protocols and can form networks of hundreds of metering points in a single building. Because the meters are relatively inexpensive and do not require manual data downloading, they can be left in the field for months or years to collect long time-series energy use data. In addition to the metering technology, we also describe a field protocol used to collect comprehensive, robust data on the miscellaneous and electronic devices in a building. The paper presents sample results from several case study buildings, in which all the plug-in devices for several homes were metered, and a representative sample of several hundred plug-in devices in a commercial office building were metered for several months.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Chlorophyll Algorithms for Ocean Color Sensors - OC4, OC5 and OC6

A high degree of consistency and comparability among chlorophyll algorithms is necessary to meet the goals of merging data from concurrent overlapping ocean color missions for increased coverage of the global ocean and to extend existing time series to encompass data from recently launched missions and those planned for the near future, such as PACE, OLCI, HawkEye, EnMAP and SABIA-MAR. To accomplish these goals, we developed 65 empirical ocean color (OC) chlorophyll algorithms for 25 satellite instruments using the largest available and most globally representative database of coincident in situ chlorophyll a and remote sensing reflectances. Excellent internal consistency was achieved across these OC ‘Version -7’ algorithms, as demonstrated by a median regression slope and coefficient of determination (R (sup 2)) of 0.985 and 0.859, respectively, among 903 pairwise comparisons of OC-modeled chlorophyll. SeaWiFS and MODIS-Aqua satellite-to-in situ match-up results indicated equivalent, and sometimes superior, performance to current heritage chlorophyll algorithms.

ocean color↗