Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Quantifying Surface Water Dynamics at 30 Meter Spatial Resolution in the North American High Northern Latitudes 1991-2011

The availability of a dense time series of satellite observations at moderate (30 m) spatial resolution is enabling unprecedented opportunities for understanding ecosystems around the world. A time series of data from Landsat was used to generate a series of three maps at decadal time step to show how surface water has changed from 1991 to 2011 in the high northern latitudes of North America. Previous attempts to characterize the change in surface water in this region have been limited in either spatial or temporal resolution, or both. This series of maps was generated for the NASA Arctic and Boreal Vulnerability Experiment (ABoVE), which began in fall 2015. These maps show a nominal extent of surface water by using multiple observations to make a single map for each time step. This increases the confidence that any detected changes are related to climate or ecosystem changes not simply caused by short duration weather events such as flood or drought. The methods and comparison to other contemporary maps of the region are presented here. Initial verification results indicate 96% producer accuracy and 54% user accuracy when compared to 2-m resolution World View-2 data. All water bodies that were omitted were one Landsat pixel or smaller, hence below detection limits of the instrument.

Carroll, Mark↗

A 40 Year Time Series of SBUV Observations: the Version 8.6 Processing

Under a NASA program to produce long term data records from instruments on multiple satellites (MEaSUREs), data from a series of eight SBUV and SBUV 12 instruments have been reprocessed to create a 40 year long ozone time series. Data from the Nimbus 4 BUV, Nimbus 7 SBUV, and SBUV/2 instruments on NOAA 9, 11, 14, 16, 17, and 18 were used covering the period 1970 to 1972 and 1979 to the present. In past analyses an ozone time series was created from these instruments by adjusting ozone itself, instrument by instrument, for consistency during overlap periods. In the version 8.6 processing adjustments were made to the radiance calibration of each instrument to maintain a consistent calibration over the entire time series. Data for all eight instruments were then reprocessed using the adjusted radiances. Reprocessing is necessary to produce an accurate latitude dependence. Other improvements incorporated in version 8.6 included the use of the ozone cross sections of Brion, Daumont, and Malicet, and the use of a cloud height climatology derived from Aura OMI measurements. The new cross sections have a more accurate temperature dependence than the cross sections previously used. The OMI-based cloud heights account for the penetration of UV into the upper layers of clouds. The consistency of the version 8.6 time series was evaluated by intra-instrument comparisons during overlap periods, comparisons with ground-based instruments, and comparisons with measurements made by instruments on other satellites such as SAGE II and UARS MLS. These comparisons show that for the instruments on NOAA 16, 17 and 18, the instrument calibrations were remarkably stable and consistent from instrument to instrument. The data record from the Nimbus 7 SBUV was also very stable, and SAGE and ground-based comparisons show that the' calibration was consistent with measurements made years laterby the NOAA 16 instrument. The calibrations of the SBUV/2 instruments on NOAA 9, 11, and 14 were more of a problem. The rapidly drifting orbits of these satellites resulted in relative time and altitude dependent differences that are significant. Despite these problems, total column ozone appears to be consistent to better than 1% over the entire time series, while the ozone vertical distribution is consistent to approximately 5%.

McPeters, Richard↗

Optimal Frequency-domain Analysis for Spacecraft Time Series: Introducing the Missing-data Multitaper Power Spectrum Estimator

While the Lomb–Scargle periodogram is foundational to astronomy, it has a significant shortcoming: the variance in the estimated power spectrum does not decrease as more data are acquired. Statisticians have a 60 yr history of developing variance-suppressing power spectrum estimators, but most are not used in astronomy because they are formulated for time series with uniform observing cadence and without seasonal or daily gaps. Here we demonstrate how to apply the missing-data multitaper power spectrum estimator to spacecraft data with uniform time intervals between observations but missing data during thruster fires or momentum dumps. The F-test for harmonic components may be applied to multitaper power spectrum estimates to identify statistically significant oscillations that would not rise above a white noise–based false alarm probability. Multitapering improves the dynamic range of the power spectrum estimate and suppresses spectral window artifacts. We show that the multitaper–F-test combination applied to Kepler observations of KIC 6102338 detects differential rotation without requiring iterative sinusoid fitting and subtraction. Significant signals reside at harmonics of both fundamental rotation frequencies and suggest an antisolar rotation profile. Next we use the missing-data multitaper power spectrum estimator to identify the oscillation modes responsible for the complex "scallop-shell" shape of the K2 light curve of EPIC 203354381. We argue that multitaper power spectrum estimators should be used for all time series with regular observing cadence.

79 ASTRONOMY AND ASTROPHYSICS↗

Feasibility of the detection of trace elements in particulate matter using online High-Resolution Aerosol Mass Spectrometry

The feasibility of using an online thermal-desorption electron-ionization high-resolution aerosol mass spectrometer (AMS) for the detection of particulate trace elements was investigated analyzing data from Mexico City obtained during the MILAGRO 2006 field campaign, where relatively high concentrations of trace elements have been reported. This potential application is of interest due to the real-time data provided by the AMS, its high sensitivity and time resolution, and the widespread availability and use of this instrument. High resolution mass spectral analysis, isotopic ratios, and ratios of different ions containing the same elements are used to constrain the chemical identity of the measured ions. The detection of Cu, Zn, As, Se, Sn, and Sb is reported. There was no convincing evidence for the detection of other trace elements commonly reported in PM. The elements detected tend to be those with lower melting and boiling points, as expected given the use of a vaporizer at 600oC in this instrument. Operation of the AMS vaporizer at higher temperatures is likely to improve trace element detection. The detection limit is estimated at approximately 0.3 ng m-3 for 5-min of data averaging. Concentration time series obtained from the AMS data were compared to concentration records determined from offline analysis of particle samples from the same times and locations by ICP (PM2.5) and PIXE (PM1.1 and PM0.3). The degree of correlation and agreement between the three instruments (AMS, ICP, and PIXE) varied depending on the element. The AMS shows promise for real-time detection of some trace elements, although additional work including laboratory calibrations with different chemical forms of these elements are needed to further develop this technique and to understand the differences with the ambient data from the other techniques. The trace elements peaked in the morning as expected for primary sources, and the many detected plumes suggest the presence of multiple point sources, probably industrial, in Mexico City which are variable in time and space, in agreement with previous studies.

99 GENERAL AND MISCELLANEOUS↗

Utah FORGE: Well 16B(78)-32 Pressure-Temperature Logs March - April 2024

This dataset consists of Baker Hughes Pressure-Temperature gauge readings on fiber optics in Utah FORGE Well 16B(78)-32. This gauge is at a measured depth of 7,056.67 feet. The true vertical depth can be determined from the well survey data, which is linked below. The data consists of time series pressure-temperature data and plots from March 26th - April 20th 2024.

15 GEOTHERMAL ENERGY↗

Meteorological, reference evapotranspiration and estimated transpiration data, July 2020-Dec 2021, Slate River Floodplain, Crested Butte, Colorado

This data package includes a time series of meteorological data (air temperature, relative humidity, barometric pressure, precipitation, wind speed, soil heat flux, incoming shortwave radiation, incoming longwave radiation, outgoing shortwave radiation and outgoing longwave radiation) from the Slate River floodplain outside Crested Butte, Colorado, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The package also includes reference evapotranspiration calculated via the Penman-Monteith equation and an estimate of willow (Salix spp.) evapotranspiration using the method of Irmak et al., J. Hydrology, 2013. Due to two malfunctioning sensors (incoming shortwave radiation from Oct 2020-May 2021 and incoming longwave radiation from May 2021-March 2022), observed net radiation and calculated evapotranspiration are only included from July-October 2020. However, users may be able to extend calculated evapotranspiration using estimates of these two parameters from other sources. Both sensors have been replaced and data beyond 2021 be uploaded to this repository when it is available.Within the data package, "FLMD.csv" describes file-level metadata and "dd.csv" defines column headers and universal terms across the dataset. The data package includes 3 "*data.csv" files, two for meteorological data for 2020 and 2021 and one for reference evapotranspiration and transpiration data from 2020 ("SLT_OBJ2_PenmanMonteith_2020_data.csv"). Each "*data.csv" file of meteorological data has a corresponding "*_InstallationMethods.csv" file that describes the location, sensor model, sensor serial number and other metadata corresponding to each measured parameter. We also include a Jupyter notebook ("PenmanMonteithET_Calculations.ipynb") that details the assumptions and equations used to calculate daily and hourly reference evapotranspiration and daily willow transpiration from raw meteorological data.

54 ENVIRONMENTAL SCIENCES↗

Downscaling Solar Power Output to 4-Seconds for Use in Integration Studies (Presentation)

High penetration renewable integration studies require solar power data with high spatial and temporal accuracy to quantify the impact of high frequency solar power ramps on the operation of the system. Our previous work concentrated on downscaling solar power from one hour to one minute by simulation. This method used clearness classifications to categorize temporal and spatial variability, and iterative methods to simulate intra-hour clearness variability. We determined that solar power ramp correlations between sites decrease with distance and the duration of the ramp, starting at around 0.6 for 30-minute ramps between sites that are less than 20 km apart. The sub-hour irradiance algorithm we developed has a noise floor that causes the correlations to approach ~0.005. Below one minute, the majority of the correlations of solar power ramps between sites less than 20 km apart are zero, and thus a new method to simulate intra-minute variability is needed. These intra-minute solar power ramps can be simulated using several methods, three of which we evaluate: a cubic spline fit to the one-minute solar power data; projection of the power spectral density toward the higher frequency domain; and average high frequency power spectral density from measured data. Each of these methods either under- or over-estimates the variability of intra-minute solar power ramps. We show that an optimized weighted linear sum of methods, dependent on the classification of temporal variability of the segment of one-minute solar power data, yields time series and ramp distributions similar to measured high-resolution solar irradiance data.

14 SOLAR ENERGY↗

Downscaling Solar Power Output to 4-Seconds for Use in Integration Studies: Preprint

High penetration renewable integration studies require solar power data with high spatial and temporal accuracy to quantify the impact of high frequency solar power ramps on the operation of the system. Our previous work concentrated on downscaling solar power from one hour to one minute by simulation. This method used clearness classifications to categorize temporal and spatial variability, and iterative methods to simulate intra-hour clearness variability. We determined that solar power ramp correlations between sites decrease with distance and the duration of the ramp, starting at around 0.6 for 30-minute ramps between sites that are less than 20 km apart. The sub-hour irradiance algorithm we developed has a noise floor that causes the correlations to approach ~0.005. Below one minute, the majority of the correlations of solar power ramps between sites less than 20 km apart are zero, and thus a new method to simulate intra-minute variability is needed. These intra-minute solar power ramps can be simulated using several methods, three of which we evaluate: a cubic spline fit to the one-minute solar power data; projection of the power spectral density toward the higher frequency domain; and average high frequency power spectral density from measured data. Each of these methods either under- or over-estimates the variability of intra-minute solar power ramps. We show that an optimized weighted linear sum of methods, dependent on the classification of temporal variability of the segment of one-minute solar power data, yields time series and ramp distributions similar to measured high-resolution solar irradiance data.

14 SOLAR ENERGY↗

Photometric Analysis in the Kepler Science Operations Center Pipeline

We describe the Photometric Analysis (PA) software component and its context in the Kepler Science Operations Center (SOC) pipeline. The primary tasks of this module are to compute the photometric flux and photocenters (centroids) for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) stellar targets from the calibrated pixels in their respective apertures. We discuss the science algorithms for long and short cadence PA: cosmic ray cleaning; background estimation and removal; aperture photometry; and flux-weighted centroiding. We discuss the end-to-end propagation of uncertainties for the science algorithms. Finally, we present examples of photometric apertures, raw flux light curves, and centroid time series from Kepler flight data. PA light curves, centroid time series, and barycentric timestamp corrections are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and are made available to the general public in accordance with the NASA/Kepler data release policy.

Twicken, Joseph D.↗

Photometric Analysis in the Kepler Science Operations Center Pipeline

We describe the Photometric Analysis (PA) software component and its context in the Kepler Science Operations Center (SOC) Science Processing Pipeline. The primary tasks of this module are to compute the photometric flux and photocenters (centroids) for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) stellar targets from the calibrated pixels in their respective apertures. We discuss science algorithms for long and short cadence PA: cosmic ray cleaning; background estimation and removal; aperture photometry; and flux-weighted centroiding. We discuss the end-to-end propagation of uncertainties for the science algorithms. Finally, we present examples of photometric apertures, raw flux light curves, and centroid time series from Kepler flight data. PA light curves, centroid time series, and barycentric timestamp corrections are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and are made available to the general public in accordance with the NASA/Kepler data release policy.

photocenter↗

Time series analysis of sferics rate data associated with severe weather patterns

Data obtained by an electronic transducer measuring the rate of occurrence of electrical disturbances in the atmosphere (the sferic rate in the form of a time series) over the life of electrical storms are analyzed. It is found that the sferic rate time series are not stationary. The sferics rate time series has a complete life cycle associated with a particular storm. The approach to recognition of a spectral pattern is somewhat similar to real-time recognition of the spoken word.

Wang, P. P.↗

ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new data products. Views of the output data products include an overlay of how the design meets ARM archive's data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Source record↗

ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new data products. Views of the output data products include an overlay of how the design meets ARM archive's data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Source record↗

A Time-Series Distribution Test System Based on Real Utility Data

In this paper, we provide a time-series distribution test system. This test system is a fully observable distribution grid in Midwest U.S. with smart meters (SM) installed at all end users. Our goal is to share a real U.S. distribution grid model without modification. This grid model is comprehensive and representative since it consists of both overhead lines and underground cables, and it has standard distribution grid components such as capacitor banks, line switches, substation transformers with load tap changer and secondary distribution transformers. An important uniqueness of this grid model is it has one-year smart meter measurements at all nodes, thus bridging the gap between existing test feeders and quasi-static time-series based distribution system analysis.

Bu, Fankun↗

Situational Awareness of Grid Anomalies (SAGA) for Visual Analytics—Near-Real-Time Cyber-Physical Resiliency Through Machine Learning

The Situational Awareness of Grid Anomalies (SAGA) project built upon foundational power system tools developed at the National Renewable Energy Laboratory (NREL) integrated with an ever-increasing set of Gridmetrics data extracted from the cable television (CATV) broadband network infrastructure while assimilating other time-series geospatial data and information, such as weather and cyber-physical phenomena, to demonstrate a disruptive technology for power system data analytics relying on existing infrastructure. Three research thrusts supported (1) visual analytics, (2) cyber-physical power system simulation, and (3) anomaly detection. SAGA created technology that leverages, couples, and fortifies two vastly different realms - power and broadband - to increase the resiliency of the power grid in the face of increasing cyberattacks and operational challenges related to integrating DERs. The exploration of potential synergies of broadband-enabled grids resulted in identifying a mutually beneficial symbiosis that can increase the resiliency of both power and broadband services. Broadband networks perform better with reliable power and are good at providing real-time measurements that identify where the grid is under attack, is failing, or is weak. Likewise, sensor-starved distribution grids perform better and can be more reliable when their operation is buttressed with observations of broadband-detected anomalies. Future research can explore broadband's contribution to continuing to improve grid resiliency, reliability, and cost-effective operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluating Production Implications of Pressure Maintenance in Unconventional Oil and Gas Wells using a Machine Learning Modeling Approach: Case Study in the Permian Basin

This study implements the proprietary machine learning-based model (model) developed under the 2022 study titled “Evaluating the Impact of Proprietary Oil & Gas Data on Machine Learning Model Performance Using a Quasi-Experimental Analytical Approach” for forecasting unconventional oil and gas production using well data from the Permian Basin. The model, developed using an exclusive dataset that includes time series production data from an operator in the Permian Basin, is designed to jointly predict daily oil, gas, and water production for horizontal wells as a function of bottomhole pressure drawdown, spatial placement across the study domain, and well-completion attributes. In this study, the model was explicitly applied to explore its utility to evaluate the impact of varying drawdown strategies on the production forecast of a well in the Permian Basin dataset. Managing pressure drawdown has been identified as a way to improve estimated ultimate recovery (EUR) from unconventional shale wells due to the stress-dependent nature of fractures in shale reservoirs. Research has shown that applying a lower pressure drawdown helps to maintain the reservoir conductivity, resulting in higher productivity over the life of a well. Historic bottomhole pressure data from the well over time was used as a benchmark from which to set more and less aggressive pressure decline rates as bounding modeling cases. All pressure decline rates/strategies were forecasted over 5 years, and the model was used to generate oil, water, and gas prediction over the same timeframe. This report presents the results from the production forecast and discusses potential operational and economic implications, with contrasting perspectives between well productivity and profitability given typical oil and gas economics and the volatility in the oil and gas market.

02 PETROLEUM↗

BASIN-3D: A brokering framework to integrate diverse environmental data

Diverse observational and simulation datasets are needed to understand and predict complex ecosystem behavior over seasonal to decadal and century time-scales. Integration of these datasets poses a major barrier towards advancing environmental science, particularly due to differences in the structure and formats of data provided by various sources. Here, we describe BASIN-3D (Broker for Assimilation, Synthesis and Integration of eNvironmental Diverse, Distributed Datasets), a data integration framework designed to dynamically retrieve and transform heterogeneous data from different sources into a common format to provide an integrated view. BASIN-3D enables users to adopt a standardized approach for data retrieval and avoid customizations for the data type or source. We demonstrate the value of BASIN-3D with two use cases that require integration of data from regional to watershed spatial scales. The first application uses the BASIN-3D Python library to integrate time-series hydrological and meteorological data to provide standardized inputs to analytical and machine learning codes in order to predict the impacts of hydrological disturbances on large river corridors of the United States. The second application uses the BASIN-3D Django framework to integrate diverse time-series data in a mountainous watershed in East River, Colorado, United States to enable scientific researchers to explore and download data through an interactive web portal. Thus, BASIN-3D can be used to support data integration for both web-based tools, as well as data analytics using Python scripting and extensions like Jupyter notebooks. The framework is expected to be transferable to and useful for many other field and modeling studies.

Varadharajan, C↗

Five-dimensional crystallography

Here it is demonstrated how five-dimensional crystallography can be used to determine a comprehensive chemical kinetic mechanism in concert with the atomic structures of transient intermediates that form and decay during the course of the reaction. A method for determining a comprehensive chemical kinetic mechanism in macromolecular reactions is presented. The method is based on five-dimensional crystallography, where, in addition to space and time, temperature is also taken into consideration and an analysis based on singular value decomposition is applied. First results of such a time-resolved crystallographic study are presented. Temperature-dependent time-resolved X-ray diffraction measurements were conducted on the newly upgraded BioCARS 14-ID-B beamline at the Advanced Photon Source and aimed at elucidating a comprehensive kinetic mechanism of the photoactive yellow protein photocycle. Extensive time series of crystallographic data were collected at two temperatures, 293 K and 303 K. Relaxation times of the reaction extracted from these time series exhibit measurable differences for the two temperatures, hence demonstrating that five-dimensional crystallography is feasible.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗