Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data change”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Anomaly Detection, Localization and Classification using Drifting Synchrophasor Data Streams

With ongoing automation and digitization of the electric power system, several Phasor Measurement Units(PMUs) have been deployed for monitoring and control. PMU data can have multiple anomalies, and many of the researchers in the past have concentrated on training machine/deep learning algorithms offline for anomaly detection over PMU data (i.e., not in real time). These machine/deep learning algorithms, when trained offline on a sample rather than a population of the dataset, fail to consider the dynamic behavior of the power grid in real-time, resulting in low accuracy. Considering the dynamic behavior of the power grid (e.g., change in load, generation, distributed energy resources (DERs) switching, network, controls), the definition of data anomalies varies in time and requires online training. A fundamental challenge is to enable online (i.e., real-time) training of machine/deep learning algorithms for anomaly detection over streaming PMU data. While machine/deep learning is often desirable to manage data streams, training a deep learning algorithm over streaming PMU data is nontrivial due to changes in data statistics caused by dynamic streaming data. This paper proposes PMUNET: a novel device-level deep learning-based data-driven approach for anomaly detection, localization, and classification over streaming PMU data, using online learning and multivariate data-drift detection algorithm .Two variants of PMUNET, Dynamic data Change Driven Learning (DCDL) and Continuity Driven Learning (CDL), are proposed and compared. DCDL aims to train the deep learning algorithm whenever the definition of anomaly changes due to the power grid dynamics. On the other hand, CDL continuously trains the deep learning algorithm over the PMU data-stream. The experimental results verify that DCDL outperforms CDL and other efficient anomaly detection methods over multiple events such as faults and load/ generator/capacitor/DERs variations/switching for IEEE 14 and 39 Bus test system as well as real PMU industrial data. The result verifies that DCDL variant of PMUNET improves over existing approach with a gain of 2% - 10% in terms of accuracy, false-positive rate, and false-negative rate.

adversarial deep learning↗
DOE OSTI2022

SNAPSHOT USA 2020: A second coordinated national camera trap survey of the United States during the COVID-19 pandemic

Managing wildlife populations in the face of global change requires regular data on the abundance and distribution of wild animals, but acquiring these over appropriate spatial scales in a sustainable way has proven challenging. Here, in this study, we present the data from Snapshot USA 2020, a second annual national mammal survey of the USA. This project involved 152 scientists setting camera traps in a standardized protocol at 1485 locations across 103 arrays in 43 states for a total of 52,710 trap-nights of survey effort. Most (58) of these arrays were also sampled during the same months (September and October) in 2019, providing a direct comparison of animal populations in 2 years that includes data from both during and before the COVID-19 pandemic. All data were managed by the eMammal system, with all species identifications checked by at least two reviewers. In total, we recorded 117,415 detections of 78 species of wild mammals, 9236 detections of at least 43 species of birds, 15,851 detections of six domestic animals and 23,825 detections of humans or their vehicles. Spatial differences across arrays explained more variation in the relative abundance than temporal variation across years for all 38 species modeled, although there are examples of significant site-level differences among years for many species. Temporal results show how species allocate their time and can be used to study species interactions, including between humans and wildlife. These data provide a snapshot of the mammal community of the USA for 2020 and will be useful for exploring the drivers of spatial and temporal changes in relative abundance and distribution, and the impacts of species interactions on daily activity patterns. There are no copyright restrictions, and please cite this paper when using these data, or a subset of these data, for publication.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Contrasting Trends in Colorado Fire Weather Index from Reanalysis and Observations

Recent wildfires in Colorado raise the question of whether rising global temperatures have increased fire weather occurrences in Colorado. The U.S. National Weather Service defines fire weather as when “forecast weather conditions will result in a significant threat for the ignition and/or spread of wildfires.” We use two datasets to address the question: “How has the occurrence of fire weather changed in Colorado?” Using 22 years of observed weather conditions from a meteorological tower at the National Renewable Energy Laboratory and 67 years of ERA5 reanalysis data, we assess changing trends in Colorado fire weather as defined by hot, dry, and windy conditions. Additionally, we explore if the difference in recorded wind speeds between observational data and reanalysis data can be explained by differences in spatial and temporal resolution and what are the implications in the context of quantifying fire weather occurrences. The observational data are limited in temporal extent and spatial representativeness, but they capture exact real-world conditions at a location in complex terrain. The reanalysis data are available for an extended period of time and for the entire state, but the data are of relatively coarse spatial and temporal resolution and may fail to capture extremes. To quantify fire risk, we calculate the hot–dry–windy index (HDWI), which relies on wind speed and vapor pressure deficit. No statistically significant trend in the HDWI appears in the observational dataset. However, according to the reanalysis data, strong increasing trends in HDWI values emerge across all of Colorado. This apparent conflict between observational and reanalysis data suggests that reanalysis data may not be representative. Further, more long-term observational datasets are required to assess fire risk.

17 WIND ENERGY↗
DOE OSTI2020

Empirical estimates of regional carbon budgets imply reduced global soil heterotrophic respiration

Resolving regional carbon budgets is critical for informing land-based mitigation policy. For nine regions covering nearly the whole globe, we collected inventory estimates of carbon-stock changes complemented by satellite estimates of biomass changes where inventory data are missing. The net land–atmospheric carbon exchange (NEE) was calculated by taking the sum of the carbon-stock change and lateral carbon fluxes from crop and wood trade, and riverine-carbon export to the ocean. Summing up NEE from all regions, we obtained a global ‘bottom-up’ NEE for net land anthropogenic CO2 uptake of –2.2 ± 0.6 PgC yr -1 consistent with the independent top-down NEE from the global atmospheric carbon budget during 2000–2009. This estimate is so far the most comprehensive global bottom-up carbon budget accounting, which set up an important milestone for global carbon-cycle studies. By decomposing NEE into component fluxes, we found that global soil heterotrophic respiration amounts to a source of CO 2 of 39 PgC yr -1 with an interquartile of 33–46 PgC yr -1 —a much smaller portion of net primary productivity than previously reported.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Core Model Proposal #368: Adding fugitive CO2 emissions from fossil resources

This Core Model Proposal adds fugitive CO2 emissions from coal, crude oil, and natural gas resources to the data system. It also includes an improved method to replace outlier emissions factors for fossil resources. Lastly, it makes some minor changes to the data system and Model Interface headers to fix some inconsistencies in how resource technologies are named in the XMLs.

core model proposal↗
NASA NTRS1979

Senescent changes in the ribosomes of animal cells in vivo and in vitro

The paper examines RNA-ribosomal changes observed in protozoa and fixed postmitotic cells, as well as the characteristics of intermitotic cells. Attention is given to a discussion of the implications of the reported ribosomal changes as to the senescent deterioration of protein synthesis and physiological functions. A survey of the literature suggests that, while the data on ribosomal change in dividing cells both in vivo and in vitro are inconclusive, there is strong histological and biochemical evidence in favor of some degree of quantitative ribosomal loss in fixed postmitotic cells. Since these decreases in ribosomes are demonstrated in differential cells from nematodes, insects and mammals, they may represent a universal manifestation of cytoplasmic senescence in certain types of fixed postmitotic animal cells. The observed variability in ribosomal loss for cells belonging to the same type suggests that this involution phenomenon is rather related to the wear and tear suffered by a particular cell.

Miquel, J.↗
NASA NTRS2014

Landsat-8 Thermal Infrared Sensor (TIRS) Vicarious Radiometric Calibration

Launched in February 2013, the Landsat-8 carries on-board the Thermal Infrared Sensor (TIRS), a two-band thermal pushbroom imager, to maintain the thermal imaging capability of the Landsat program. The TIRS bands are centered at roughly 10.9 and 12 micrometers (Bands 10 and 11 respectively). They have 100 m spatial resolution and image coincidently with the Operational Land Imager (OLI), also on-board Landsat-8. The TIRS instrument has an internal calibration system consisting of a variable temperature blackbody and a special viewport with which it can see deep space; a two point calibration can be performed twice an orbit. Immediately after launch, a rigorous vicarious calibration program was started to validate the absolute calibration of the system. The two vicarious calibration teams, NASA/Jet Propulsion Laboratory (JPL) and the Rochester Institute of Technology (RIT), both make use of buoys deployed on large water bodies as the primary monitoring technique. RIT took advantage of cross-calibration opportunity soon after launch when Landsat-8 and Landsat-7 were imaging the same targets within a few minutes of each other to perform a validation of the absolute calibration. Terra MODIS is also being used for regular monitoring of the TIRS absolute calibration. The buoy initial results showed a large error in both bands, 0.29 and 0.51 W/sq m·sr·micrometers or -2.1 K and -4.4 K at 300 K in Band 10 and 11 respectively, where TIRS data was too hot. A calibration update was recommended for both bands to correct for a bias error and was implemented on 3 February 2014 in the USGS/EROS processing system, but the residual variability is still larger than desired for both bands (0.12 and 0.2 W/sq m·sr·micrometers or 0.87 and 1.67 K at 300 K). Additional work has uncovered the source of the calibration error: out-of-field stray light. While analysis continues to characterize the stray light contribution, the vicarious calibration work proceeds. The additional data have not changed the statistical assessment but indicate that the correction (particularly in band 11) is probably only valid for a subset of data. While the stray light effect is small enough in Band 10 to make the data useful across a wide array of applications, the effect in Band 11 is larger and the vicarious results suggest that Band 11 data should not be used where absolute calibration is required.

TIIRS↗
NASA NTRS2020

Empirical estimates of regional carbon budgets imply reduced global soil heterotrophic respiration

Resolving regional carbon budgets is critical for informing land-based mitigation policy. For nine regions covering nearly the whole globe, we collected inventory estimates of carbon-stock changes complemented by satellite estimates of biomass changes where inventory data are missing. The net land–atmospheric carbon exchange (NEE) was calculated by taking the sum of the carbon-stock change and lateral carbon fluxes from crop and wood trade, and riverine-carbon export to the ocean. Summing up NEE from all regions, we obtained a global ‘bottom-up’ NEE for net land anthropogenic CO2 uptake of –2.2±0.6 PgC/yr consistent with the independent top-down NEE from the global atmospheric carbon budget during 2000–2009. This estimate is so far the most comprehensive global bottom-up carbon budget accounting, which set up an important milestone for global carbon-cycle studies. By decomposing NEE into component fluxes, we found that global soil heterotrophic respiration amounts to a source of CO2 of 39 PgC/yr with an interquartile of 33–46 PgC/yr —a much smaller portion of net primary productivity than previously reported.

carbon budget↗
NASA NTRS2004

Making Antarctic Atmospheric Electricity Data Available to Living with a Star and Climate Change Investigators

This proposal requests support for making the nearly three decades of Antarctic atmospheric electricity data available to more workers. Measurements of the vertical electric field and air-earth current density made at the Earth's surface in Antarctica have recently been shown to be of considerable interest to scientists interested in monitoring short-term Sun-Earth connections and long term climate change. Such measurements have been made off and on for more than three decades, primarily at Vostok and South Pole stations. There is no single place where all of these data can be obtained via the Internet in a contemporary format. The work proposed here will attempt to remedy this deficiency as much as possible. Data we know to be presently available include data from South Pole, 1982-86 and 1991-1993, and Vostok station, 1997-present. Data were taken at South Pole and Vostok in the 60's and ~O'S, but these may prove difficult to obtain in digital form. At present, only the University of Houston's 1991-1993 data are available on the Web. Unfortunately, they are stored on a server slated for retirement. Also, they are written VAX binary floating point, using the UCLA/Stanford/Michigan flatfile format (FLATDBMS), which is obscure to some users. We propose to combine and reformat the three available data sets plus any others we can obtain onto a newer server. We will use a more common and comprehensible format. Archival copies will be burned onto CD and/or DVD-ROM media. Finally we will register these data with the appropriate NASA data systems.

Bering, Edgar↗
NASA NTRS1976

The effect of changes in the USF/NASA toxicity screening test method on data from some cellular polymers

Rankings of relative toxicity can be markedly affected by changes in test variables. Revision of the USF/NASA toxicity screening test procedure to eliminate the connecting tube and supporting floor and incorporate a 1.0 g sample weight, 200 C starting temperature, and 800 C upper limit temperature for pyrolysis, reversed the rankings of flexible polyurethane and polychloroprene foams, not only in relation to each other, but also in relation to cotton and red oak. Much of the change is attributed to reduction of the distance between the sample and the test animals, and reduction of the sample weight charged. Elimination of the connecting tube increased the relative toxicity of the polyurethane foams. The materials tested were flexible polyurethane foam, without and with fire retardant; rigid polyurethane foam with fire retardant; flexible polychloroprene foam; cotton, Douglas fir, red oak, hemlock, hardboard, particle board, polystyrene, and polymethyl methacrylate.

Hilado, C. J.↗
NASA NTRS2008

The NASA NEESPI Data Portal to Support Studies of Climate and Environmental Changes in Non-Boreal Europe

NASA NEESPI (Northern Eurasia Earth Science Partnership Initiative) data portal is a NASA funded project that focuses on collecting satellite remote sensing data, providing tools, information, and services in support of NEESPI scientific objectives (Leptoukh, et al., 2007). The data can be accessed online through anonymous ftp, through an advanced data searching and ordering system Mirador that uses keywords to find data quickly in a Google-like interface, and through the Goddard Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni). The portal provides preprocessed data from different satellite sensors and numerical models to the same spatial and temporal resolution and the same projection so that the data can be used easily to perform inter-comparison or relationship studies. In addition, it provides parameter and spatially subsetted data for regional studies. Studies of regional carbon, hydrology, aerosols in non-boreal Europe and their interactions with global climate are very challenging research topics. The NASA NEESPI data portal makes many satellite data available for such studies, including information on land cover types, fire, vegetation index, aerosols, land surface temperature, soil moisture, precipitation, snow/ice, and other parameters. This paper will introduce the features and products available in the system, focusing on the online data 1 tool, Giovanni NEESPI. An example that explores different data through Giovanni NEESPI in temperate region of non-boreal Europe will be presented.

Shen, Suhung↗
NASA NTRS2012

TRMM Version 7 Near-Realtime Data Products

The TRMM data system has been providing near-realtime data products to the community since late 1999. While the TRMM project never had near-realtime production requirements, the science and applications communities had a great interest in receiving TRMM data as quickly as possible. As a result these NRT data are provided under a best-effort scenario but with the objective of having the swath data products available within three hours of data collection 90% of the time. In July of 2011 the Joint Precipitation Measurement Missions Science Team (JPST) authorized the reprocessing of TRMM mission data using the new version 7 algorithms. The reprocessing of the 14+ years of the mission was concluded within 30 days. Version 7 algorithms had substantial changes in the data product file formats both for data and metadata. In addition, the algorithms themselves had major modifications and improvements. The general approach to versioning up the NRT is to wait for the regular production algorithms to have run for a while and shake out any issues that might arise from the new version before updating the NRT products. Because of the substantial changes in data/metadata formats as well as the algorithm improvements themselves, the update of NRT to V7 followed an even more conservative path than usual. This was done to ensure that applications agencies and other users of the TRMM NRT would not be faces with short-timeframes for conversion to the new format. This paper will describe the process by which the TRMM NRT was updated to V7 and the V7 data products themselves.

Tocker, Erich Franz↗
DOE OSTI2023

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

QA/QC-ed Groundwater Level Time Series in PLM-1 and PLM-6 Monitoring Wells, East River, Colorado (2016-2022)

This data set contains QA/QC-ed (Quality Assurance and Quality Control) water level data for the PLM1 and PLM6 wells. PLM1 and PLM6 are location identifiers used by the Watershed Function SFA project for two groundwater monitoring wells along an elevation gradient located along the lower montane life zone of a hillslope near the Pumphouse location at the East River Watershed, Colorado, USA. These wells are used to monitor subsurface water and carbon inventories and fluxes, and to determine the seasonally dependent flow of groundwater under the PLM hillslope. The downslope flow of groundwater in combination with data on groundwater chemistry (see related references) can be used to estimate rates of solute export from the hillslope to the floodplain and river. QA/QC analysis of measured groundwater levels in monitoring wells PLM-1 and PLM-6 included identification and flagging of duplicated values of timestamps, gap filling of missing timestamps and water levels, removal of abnormal/bad and outliers of measured water levels. The QA/QC analysis also tested the application of different QA/QC methods and the development of regular (5-minute, 1-hour, and 1-day) time series datasets, which can serve as a benchmark for testing other QA/QC techniques, and will be applicable for ecohydrological modeling. The package includes a Readme file, one R code file used to perform QA/QC, a series of 8 data csv files (six QA/QC-ed regular time series datasets of varying intervals (5-min, 1-hr, 1-day) and two files with QA/QC flagging of original data), and three files for the reporting format adoption of this dataset (InstallationMethods, file level metadata (flmd), and data dictionary (dd) files).QA/QC-ed data herein were derived from the original/raw data publication available at Williams et al., 2020 (DOI: 10.15485/1818367). For more information about running R code file (10.15485_1866836_QAQC_PLM1_PLM6.R) to reproduce QA/QC output files, see README (QAQC_PLM_readme.docx). This dataset replaces the previously published raw data time series, and is the final groundwater data product for the PLM wells in the East River. Complete metadata information on the PLM1 and PLM6 wells are available in a related dataset on ESS-DIVE: Varadharajan C, et al (2022). https://doi.org/10.15485/1660962. These data products are part of the Watershed Function Scientific Focus Area collection effort to further scientific understanding of biogeochemical dynamics from genome to watershed scales. 2022/09/09 Update: Converted data files using ESS-DIVE’s Hydrological Monitoring Reporting Format. With the adoption of this reporting format, the addition of three new files (v1_20220909_flmd.csv, V1_20220909_dd.csv, and InstallationMethods.csv) were added. The file-level metadata file (v1_20220909_flmd.csv) contains information specific to the files contained within the dataset. The data dictionary file (v1_20220909_dd.csv) contains definitions of column headers and other terms across the dataset. The installation methods file (InstallationMethods.csv) contains a description of methods associated with installation and deployment at PLM1 and PLM6 wells. Additionally, eight data files were re-formatted to follow the reporting format guidance (er_plm1_waterlevel_2016-2020.csv, er_plm1_waterlevel_1-hour_2016-2020.csv, er_plm1_waterlevel_daily_2016-2020.csv, QA_PLM1_Flagging.csv, er_plm6_waterlevel_2016-2020.csv, er_plm6_waterlevel_1-hour_2016-2020.csv, er_plm6_waterlevel_daily_2016-2020.csv, QA_PLM6_Flagging.csv). The major changes to the data files include the addition of header_rows above the data containing metadata about the particular well, units, and sensor description. 2023/01/18 Update: Dataset updated to include additional QA/QC-ed water level data up until 2022-10-12 for ER-PLM1 and 2022-10-13 for ER-PLM6. Reporting format specific files (v2_20230118_flmd.csv, v2_20230118_dd.csv, v2_20230118_InstallationMethods.csv) were updated to reflect the additional data. R code file (QAQC_PLM1_PLM6.R) was added to replace the previously uploaded HTML files to enable execution of the associated code. R code file (QAQC_PLM1_PLM6.R) and ReadMe file (QAQC_PLM_readme.docx) were revised to clarify where original data was retrieved from and to remove local file paths.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Open-source Tip-and-Cue for Change-Detection Tasking

Currently, no tool exists to detect daily change across the globe, let alone to do so cost- and resource-efficiently. The proposed tool will use open-source data to detect change in near-real-time to identify targets of interest for tasking, providing a unique capability for constant global situational awareness.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1974

Stochastic model of temporal changes of wind spectra in the free atmosphere

Data for wind profile spectra changes with respect to time from Cape Kennedy, Florida for the time period from 28 November 1964 to 11 May 1967 have been analyzed. A universal statistical distribution of the spectral change which encompasses all vertical wave numbers, wind speed categories, and elapsed time has been developed for the standard deviation of the time changes of detailed wind profile spectra as a function of wave number.

Huang, Y. H.↗
NASA NTRS2012

Test Plan for a Calibration Demonstration System for the Reflected Solar Instrument for the Climate Absolute Radiance and Refractivity Observatory

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) mission addresses the need to observe high-accuracy, long-term climate change trends and to use decadal change observations as the most critical method to determine the accuracy of climate change. One of the major objectives of CLARREO is to advance the accuracy of SI traceable absolute calibration at infrared and reflected solar wavelengths. This advance is required to reach the on-orbit absolute accuracy required to allow climate change observations to survive data gaps while remaining sufficiently accurate to observe climate change to within the uncertainty of the limit of natural variability. While these capabilities exist at NIST in the laboratory, there is a need to demonstrate that it can move successfully from NIST to NASA and/or instrument vendor capabilities for future spaceborne instruments. The current work describes the test plan for the Solar, Lunar for Absolute Reflectance Imaging Spectroradiometer (SOLARIS) which is the calibration demonstration system (CDS) for the reflected solar portion of CLARREO. The goal of the CDS is to allow the testing and evaluation of calibration approaches , alternate design and/or implementation approaches and components for the CLARREO mission. SOLARIS also provides a test-bed for detector technologies, non-linearity determination and uncertainties, and application of future technology developments and suggested spacecraft instrument design modifications. The end result of efforts with the SOLARIS CDS will be an SI-traceable error budget for reflectance retrieval using solar irradiance as a reference and methods for laboratory-based, absolute calibration suitable for climate-quality data collections. The CLARREO mission addresses the need to observe high-accuracy, long-term climate change trends and advance the accuracy of SI traceable absolute calibration. The current work describes the test plan for the SOLARIS which is the calibration demonstration system for the reflected solar portion of CLARREO. SOLARIS provides a test-bed for detector technologies, non-linearity determination and uncertainties, and application of future technology developments and suggested spacecraft instrument design modifications. The end result will be an SI-traceable error budget for reflectance retrieval using solar irradiance as a reference and methods for laboratory-based, absolute calibration suitable for climate-quality data collections.

Thome, Kurtis↗