Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Constructing an AIRS Climatology for Data Visualization and Analysis to Serve the Climate Science and Application Communities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for NASA sounders: the present Aqua AIRS mission and the succeeding SNPP CrIS mission. The AIRS mission is entering its 15th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. The GES DISC, in collaboration with the AIRS Project, released product from the version 6 algorithm in early 2013. Giovanni, a Web-based application developed by the GES DISC, provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download the data. Most important variables from version 6 AIRS product are available in Giovanni. We are developing a climatology product using 14-year AIRS retrievals. The study can be a good start for the long term climatology from NASA sounders: the AIRS and the succeeding CrIS. This presentation will show the impacts to the climatology product from different aggregation methods. The climatology can serve climate science and application communities in data visualization and analysis, which will be demonstrated using a variety of functions in version 4 Giovanni. The highlights of these functions include user-defined monthly and seasonal climatology, inter annual seasonal time series, anomaly analysis.

AIRS↗
NASA NTRS1973

Short and long periodic atmospheric variations between 25 and 200 km

Previously collected data on atmospheric pressure, density, temperature and winds between 25 and 200 km from sources including Meteorological Rocket Network data, ROBIN falling sphere data, grenade release and pitot tube data, meteor winds, chemical release winds, satellite data, and others were analyzed by a daily difference method and results on the distribution statistics, magnitude, and spatial structure of gravity wave and planetary wave atmospheric variations are presented. Time structure of the gravity wave variations were determined by the analysis of residuals from harmonic analysis of time series data. Planetary wave contributions in the 25-85 km range were discovered and found to have significant height and latitudinal variation. Long period planetary waves, and seasonal variations were also computed by harmonic analysis. Revised height variations of the gravity wave contributions in the 25 to 85 km height range were computed. An engineering method and design values for gravity wave magnitudes and wave lengths are given to be used for such tasks as evaluating the effects on the dynamical heating, stability and control of spacecraft such as the space shuttle vehicle in launch or reentry trajectories.

Justus, C. G.↗
DOE OSTI2023

Topographic Correction of Optical Remote Sensing Images in Mountainous Areas: A systematic review

Rugged terrain distorts optical remote sensing observations and subsequently impacts land cover classification and biophysical and biochemical parameter retrieval over mountainous areas. Therefore, topographic correction (TC) is a prerequisite for many remote sensing applications. Although various TC methods have been explored over the past four decades to mitigate topographic effects, a systematic and global review of these studies is still lacking. Using a multicomponent bibliometric approach, we extracted bibliometric metadata from 426 publications identified by searching titles, keywords, and abstracts for research on “topographic correction” and “topographic effects” in Scopus and Web of Science (WoS) from 1980 to 2022. Here this systematic review revealed a rapid growth in the number of TC studies since the 1980s, primarily driven by the availability of decametric-resolution remote sensing observations and digital elevation models (DEMs). Most of the research has focused on relatively low-elevation regions, with increasing attention beyond American and European regions, particularly in China. The seasonal distribution of satellite acquisition for TC showed considerable imbalance, mainly concentrated in months with favorable solar illumination conditions (e.g., May to October). Important themes emerged from the keyword analysis, including satellite sensors, DEMs, TC methods, evaluation criteria, and applications.

58 GEOSCIENCES↗
NASA NTRS2016

Can Aerosol Direct Radiative Effects Account for Analysis Increments of Temperature in the Tropical Atlantic?

In the late 1990's, prior to the launch of the Terra satellite, atmospheric general circulation models (GCMs) did not include aerosol processes because aerosols were not properly monitored on a global scale and their spatial distributions were not known well enough for their incorporation in operational GCMs. At the time of the first GEOS Reanalysis (Schubert et al. 1993), long time series of analysis increments (the corrections to the atmospheric state by all available meteorological observations) became readily available, enabling detailed analysis of the GEOS-1 errors on a global scale. Such analysis revealed that temperature biases were particularly pronounced in the Tropical Atlantic region, with patterns depicting a remarkable similarity to dust plumes emanating from the African continent as evidenced by TOMS aerosol index maps. Yoram Kaufman was instrumental encouraging us to pursue this issue further, resulting in the study reported in Alpert et al. (1998) where we attempted to assess aerosol forcing by studying the errors of a the GEOS-1 GCM without aerosol physics within a data assimilation system. Based on this analysis, Alpert et al. (1998) put forward that dust aerosols are an important source of inaccuracies in numerical weather-prediction models in the Tropical Atlantic region, although a direct verification of this hypothesis was not possible back then. Nearly 20 years later, numerical prediction models have increased in resolution and complexity of physical parameterizations, including the representation of aerosols and their interactions with the circulation. Moreover, with the advent of NASA's EOS program and subsequent satellites, atmospheric aerosols are now monitored globally on a routine basis, and their assimilation in global models are becoming well established. In this talk we will reexamine the Alpert et al. (1998) hypothesis using the most recent version of the GEOS-5 Data Assimilation System with assimilation of aerosols. We will explicitly calculate the impact of aerosols on the temperature analysis increments in the tropical Atlantic and assess the extent to which inclusion of atmospheric aerosols have reduced these increments.

General Circulation Models↗
DOE OSTI2024

Accelerating particle-in-cell kinetic plasma simulations via reduced-order modeling of space-charge dynamics using dynamic mode decomposition

We present a data-driven reduced-order modeling of the space-charge dynamics for electromagnetic particle-in-cell (EMPIC) plasma simulations based on dynamic mode decomposition (DMD). The dynamics of the charged particles in kinetic plasma simulations such as EMPIC is manifested through the plasma current density defined along the edges of the spatial mesh. We showcase the efficacy of DMD in modeling the time evolution of current density through a low-dimensional feature space. Not only do such DMD based predictive reduced-order models help accelerate EMPIC simulations, they also have the potential to facilitate investigative analysis and control applications. Here, we demonstrate the proposed DMD-EMPIC scheme for reduced-order modeling of current density and speedup in EMPIC simulations involving electron beam under the influence of magnetic field, virtual cathode oscillations, and backward wave oscillator.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Finding Fast Transients in Real Time Using a Novel Light-curve Analysis Algorithm

The current data acquisition rate of astronomical transient surveys and the promise for significantly higher rates in the next decade necessitate the development of novel approaches to analyze astronomical data sets and promptly detect objects of interest. The Deeper, Wider, Faster (DWF) program is a survey focused on the identification of fast-evolving transients, such as fast radio bursts, gamma-ray bursts, and supernova shock breakouts. It employs multifrequency simultaneous coverage of the same part of the sky over several orders of magnitude. Using the Dark Energy Camera mounted on the 4 m Blanco telescope, DWF captures a 20 s g -band exposure every minute, at a typical seeing of ~1'' and an air mass of ~1.5. These optical data are collected simultaneously with observations conducted over the entire electromagnetic spectrum—from radio to γ -rays—as well as cosmic-ray observations. In this paper, we present a novel real-time light-curve analysis algorithm, designed to detect transients in the DWF optical data; this algorithm functions independently from, or in conjunction with, image subtraction. We present a sample of fast transients detected by our algorithm, as well as a false-positive analysis. Our algorithm is customizable and can be tuned to be sensitive to transients evolving over different timescales and flux ranges.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Extracting and Generating PV Soiling Profiles for Analysis, Forecasting, and Cleaning Optimization

The identification and prediction of the daily soiling profiles of a photovoltaic site is essential to plan the optimal cleaning schedule. In this article, we analyze and propose various methods to extract and generate photovoltaic soiling profiles, in order to improve the analysis and the forecast of the losses. New soiling rate extraction methods are proposed to reflect the seasonal variability of the soiling rates and, for this reason, are found to identify the most convenient cleaning day with the highest accuracy for the investigated sites. Also, we present an approach that could be used to predict future soiling losses through the implementation of stochastic weather generation algorithms whose ability to identify in advance the best cleaning schedule is also successfully tested. The methods presented in this article can optimize the operation and maintenance schedule and could make it possible, in the future, to predict soiling losses through analysis based only on environmental parameters, such as rainfall and particulate matter, without the need of long-term soiling data.

14 SOLAR ENERGY↗
NASA NTRS1987

The application of time series models to cloud field morphology analysis

A modeling method for the quantitative description of remotely sensed cloud field images is presented. A two-dimensional texture modeling scheme based on one-dimensional time series procedures is adopted for this purpose. The time series procedure used is the seasonal autoregressive, moving average (ARMA) process in Box and Jenkins. Cloud field properties such as directionality, clustering and cloud coverage can be retrieved by this method. It has been demonstrated that a cloud field image can be quantitatively defined by a small set of parameters and synthesized surrogates can be reconstructed from these model parameters. This method enables cloud climatology to be studied quantitatively.

Chin, Roland T.↗
DOE OSTI2026

Red Noise–based False Alarm Thresholds for Astrophysical Periodograms via Whittle’s Approximation to the Likelihood

Astronomers who search for periodic signals using Lomb–Scargle periodograms rely on false alarm level (FAL) estimates to identify statistically significant peaks. Although FALs are often calculated from white noise models, many astronomical time series suffer from red noise. Prewhitening is a statistical technique in which a continuum model is subtracted from the log power spectrum estimate, after which the observer can proceed with a white-noise treatment. Here we present a prewhitening-based method of calculating frequency-dependent FALs. We fit power laws and autoregressive models of order 1 to each Lomb–Scargle periodogram by minimizing the Whittle approximation to the negative log-likelihood (NLL), then calculate FALs based on the best-fit model power spectrum. Our technique is a novel extension of the Whittle NLL to datasets with uneven time sampling. We demonstrate FAL calculations using observations of α Cen B, GJ 581, HD 192310, synthetic data from the radial velocity (RV) fitting challenge, and Kepler observations of a differential rotator. The Kepler data analysis shows that only true rotation signals are detected by red noise FALs, while white noise FALs suggest all spurious peaks in the low-frequency range are significant. A high-frequency sinusoid injected into α Cen B logR$'$ HK observations exceeds the 1% red noise FAL despite having only 8.9% of the power of the dominant rotation signal. In a periodogram of HD 192310 RVs, peaks associated with differential rotation and planets are detected against the 5% red noise FAL without iterative model fitting or subtraction. The software for calculating red noise–based FALs is available on GitHub.

Astrostatistics (1882)↗
DOE OSTI2020

Dynamic hosting capacity analysis for distributed photovoltaic resources—Framework and case study

Distributed photovoltaic systems can cause adverse distribution system impacts, including voltage violations at customer locations and thermal overload of lines, transformers, and other equipment resulting from high current. The installed capacity at which violations first occur and above which would require system upgrades is called the hosting capacity. Current static methods for determining hosting capacity tend to either consider infrequent worst-case snapshots in time and/or capture coarse time and spatial resolution. Because the duration of violations cannot be captured with these traditional methods, the metric thresholds used in these studies conservatively use the strictest constraints given in operating standards, even though both worse voltage performance and higher overloads may be temporarily acceptable. However, assessing the full details requires accurately capturing time-dependence, voltage-regulating equipment operations, and performance of advanced controls-based mitigation techniques. In this paper, we propose a dynamic distributed photovoltaic hosting capacity methodology to address these issues by conducting power flow analysis for a full year. A key contribution is the formulation of time aware metrics to take these annual results and identify the hosting capacity. Through a case study, we show that this approach can more fully capture grid impacts of distributed photovoltaic than traditional methods and the dynamic hosting capacity was 60%–200% higher than the static hosting capacity in this case study.

14 SOLAR ENERGY↗
DOE OSTI2021

Unraveling the discontinuous plastic flow of a Co-Cr-Fe-Ni-Mo multiprincipal-element alloy at deep cryogenic temperatures

We report an analysis of the discontinuous plastic flow of a multiprincipal-element alloy, Co 17.5 Cr 12.5 Fe 55 Ni 10 Mo 5 (atomic percent, at. %), in the temperature range of 0.5–4.2 K showing serrated deformation curves. Using the analytical techniques, we studied the statistics of the stress drops associated with the unstable plastic flow. The analysis showed that the complexity and heterogeneity of a discontinuous plastic flow were reduced when the temperature was lowered. This behavior was associated with the effects of dynamic recovery and adiabatic heating on the dislocation-density evolution.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Variability and Diversity Load Model Tool [SWR-20-03]

The motivation for the development of this tool and the underlying algorithms and methods was to enable the development of high-temporal resolution, realistic time-series data for quasi-static time-series (QSTS) analysis of distribution systems. Often, aggregated load profile data for a distribution circuit is available (e.g. feeder loading data collected via SCADA at the utility substation) and, while this data is typically accurate it masks the considerable variability of the 100’s or 1000’s of individual loads connected on the circuit. This tool was developed to model both the increased variability expected for these individual loads (e.g. the load of a single distribution transformer connected to 8-12 houses) and the expected diversity between loads on the circuit. It is important to note that the difference in variability and diversity, in the context of this tool, is that variability modeling only adds representative variability due to disaggregated load characteristics (e.g. the presence in the load profile of loads turning off and on like an air conditioner/oven) while the average energy profile remains the same as the user supplied power profile. Diversity modeling generates multiple individual load profiles which, in aggregate, sum to the user supplied power profile. Diversity is effectively variability in the energy usage over longer periods of time than seen in the variability model. Put another way, variability modeling supplies the expected variability due to the operation of various end-use loads and diversity modeling supplies the usage differences due to human behavior, schedules, etc. This load modeling tool was developed for use in generating data for distribution systems. Modeling is summarized by two major functions: 1) taking low resolution load profiles and adding intra-seconds variability onto the profiles, and 2) taking a user supplied load profile and distribution factors and adding both diversity and variability to the user supplied profile.

Zhu, Xiangqi↗
DOE OSTI2021

Multi-Scale Temporal Patterns in Stream Biogeochemistry Indicate Linked Permafrost and Ecological Dynamics of Boreal Catchments

Temporal patterns in stream chemistry provide integrated signals describing the hydrological and ecological state of whole catchments. However, stream chemistry integrates multi-scale signals of processes occurring in both the catchment and stream. Deconvoluting these signals could identify mechanisms of solute transport and transformation and provide a basis for monitoring ecosystem change. Here, we applied trend analysis, wavelet decomposition, multivariate autoregressive state-space modeling, and analysis of concentration-discharge relationships to assess temporal patterns in high-frequency (15 min) stream chemistry from permafrost-influenced boreal catchments in Interior Alaska at diel, storm, and seasonal time scales. We compared catchments that varied in spatial extent of permafrost to identify characteristic biogeochemical signals. Catchments with higher spatial extents of permafrost were characterized by increasing nitrate concentration through the thaw season, an abrupt increase in nitrate and fluorescent dissolved organic matter (fDOM) and declining conductivity in late summer, and flushing of nitrate and fDOM during summer rainstorms. In contrast, these patterns were absent, of lower magnitude, or reversed in catchments with lower permafrost extent. Solute dynamics revealed a positive influence of permafrost on fDOM export and the role of shallow, seasonally dynamic flowpaths in delivering solutes from high-permafrost catchments to streams. Lower spatial extent of permafrost resulted in static delivery of nitrate and limited transport of fDOM to streams. Shifts in concentration-discharge relationships and seasonal trends in stream chemistry toward less temporally dynamic patterns might therefore indicate reorganized catchment hydrology and biogeochemistry due to permafrost thaw.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A bi-level data-driven framework for fault-detection and diagnosis of HVAC systems

Long-term operation of heating, ventilation, and air conditioning (HVAC) systems will eventually lead to a range of HVAC system failures, resulting in excessive energy consumption and maintenance costs. Here, to avoid HVAC malfunctioning, fault detection diagnostic (FDD) is utilized as a common practice. Machine learning methods have lately received considerable interest for FDD analysis of HVAC systems due to their high detection accuracy. Meanwhile, HVAC malfunctions are regarded as rare occurrences, hence normal operating data samples are much more accessible than data samples in faulty and malfunctioning conditions. The dominating frequency of normal operation in HVAC datasets has also led to heavily biased classification algorithms within the literature. Moreover, the focus of previous literature has been on increasing the accuracy of the models which leads to a high number of false positives (misleading alarms) in the system. In order to enhance the performance of diagnostic procedures and fill the mentioned gaps, this study proposes a novel data-driven framework. A bi-level machine learning framework is developed for diagnosing faults in air handling units (AHUs) and rooftop units (RTUs) based on principal component analysis (PCA), time series anomaly detection, and random forest (RF). It is shown that PCA can reduce the dataset dimension with one principal component accounting for 95% of data variance. Also, the random forest could classify the faults with 89% precision for single-zone AHU, 85% precision for RTU, and 79% for multi-zone AHU. By proposing this framework, three persistent challenges are addressed: (I) minimizing false positives; (II) accounting for data imbalance; and (III) normal condition monitoring of equipment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Using bursty announcements for detecting BGP routing anomalies

Despite the robust structure of the Internet, it is still susceptible to disruptive routing updates that prevent network traffic from reaching its destination. Our research shows that BGP announcements that are associated with disruptive updates tend to occur in groups of relatively high frequency, followed by periods of infrequent activity. We hypothesize that we may use these bursty characteristics to detect anomalous routing incidents. In this work, we use manually verified ground truth metadata and volume of announcements as a baseline measure, and propose a burstiness measure that detects prior anomalous incidents with high recall and better precision than the volume baseline. We quantify the burstiness of inter-arrival times around the date and times of four large-scale incidents: the Indosat hijacking event in April 2014, the Telecom Malaysia leak in June 2015, the Bharti Airtel Ltd. hijack in November 2015, and the MainOne leak in November 2018; and three smaller scale incidents that led to traffic interception: the Belarusian traffic direction in February 2013, the Icelandic traffic direction in July 2013, and the Russian telecom that hijacked financial services in April 2017. Our method leverages the burstiness of disruptive update messages to detect these incidents. We describe limitations, open challenges, and how this method can be used for routing anomaly detection.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of Recursive Estimation to Heat Tracing for Groundwater/Surface‐Water Exchange

Abstract We present and demonstrate a recursive‐estimation framework to infer groundwater/surface‐water exchange based on temperature time series collected at different vertical depths below the sediment/water interface. We formulate the heat‐transport problem as a state‐space model (SSM), in which the spatial derivatives in the convection/conduction equation are approximated using finite differences. The SSM is calibrated to estimate time‐varying specific discharge using the Extended Kalman Filter (EKF) and Extended Rauch‐Tung‐Striebel Smoother (ERTSS). Whereas the EKF is suited to real‐time (“online”) applications and uses only the past and current measurements for estimation (filtering), the ERTSS is intended for near‐real time or batch‐processing (“offline”) applications and uses a window of data for batch estimation (smoothing). The two algorithms are demonstrated with synthetic and field‐experimental data and are shown to be efficient and rapid for the estimation of time‐varying flux over seasonal periods; further, the recursive approaches are effective in the presence of rapidly changing flux and (or) nonperiodic thermal boundary conditions, both of which are problematic for existing approaches to heat tracing of time‐varying groundwater/surface‐water exchange.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

What CMIP6 Models Tell Us About the Impact of AMOC Variability on the Arctic

In this paper we address the question whether variability in the Atlantic Meridional Overturning Circulation (AMOC) and its associated heat transport at mid-latitudes impacts the Arctic Earth system. To that end, we perform coherence analysis on time series of ocean heat transport, AMOC strength, and Arctic climate metrics across a large number of models from the CMIP6 ensemble. We find that, on multidecadal timescales, the majority of CMIP6 models indeed display a statistically significant relationship between AMOC at mid-latitudes (45 °N) and metrics like Arctic surface air temperatures and sea ice. However, our results do not support the narrative that heat transport anomalies at lower latitudes propagate northward toward the Arctic. Instead, our results confirm that variability in meridional ocean heat transport arises in the subpolar North Atlantic and propagates southward and northward.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Non-autoregressive time-series methods for stable parametric reduced-order models

Advection-dominated dynamical systems, characterized by partial differential equations, are found in applications ranging from weather forecasting to engineering design where accuracy and robustness are crucial. There has been significant interest in the use of techniques borrowed from machine learning to reduce the computational expense and/or improve the accuracy of predictions for these systems. These rely on the identification of a basis that reduces the dimensionality of the problem and the subsequent use of time series and sequential learning methods to forecast the evolution of the reduced state. Often, however, machine-learned predictions after reduced-basis projection are plagued by issues of stability stemming from incomplete capture of multiscale processes as well as due to error growth for long forecast durations. To address these issues, we have developed a non-autoregressive time series approach for predicting linear reduced-basis time histories of forward models. In particular, we demonstrate that non-autoregressive counterparts of sequential learning methods such as long short-term memory (LSTM) considerably improve the stability of machine-learned reduced-order models. Further, we evaluate our approach on the inviscid shallow water equations and show that a non-autoregressive variant of the standard LSTM approach that is bidirectional in the principal component directions obtains the best accuracy for recreating the nonlinear dynamics of partial observations. Moreover-and critical for many applications of these surrogates-inference times are reduced by three orders of magnitude using our approach, compared with both the equation-based Galerkin projection method and the standard LSTM approach.

97 MATHEMATICS AND COMPUTING↗