Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data change”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗
NASA NTRS2005

The Challenges of Interoperable Data Discovery

The Global Change Master Directory (GCMD) assists the oceanographic community in data discovery and access through its online metadata directory. The directory also offers data holders a means to post and search their oceanographic data through the GCMD portals, i.e. online customized subset metadata directories. The Gulf of Maine Ocean Data Partnership (GoMODP) has expressed interest in using the GCMD portals to increase the visibility of their data holding throughout the Gulf of Maine region and beyond. The purpose of the Gulf of Maine Ocean Data Partnership (GoMODP) is to "promote and coordinate the sharing, linking, electronic dissemination, and use of data on the Gulf of Maine region". The participants have decided that a "coordinated effort is needed to enable users throughout the Gulf of Maine region and beyond to discover and put to use the vast and growing quantities of data in their respective databases". GoMODP members have invited the GCMD to discuss further collaborations in view of this effort. This presentation. will focus on the GCMD GoMODP Portal - demonstrating its content and use for data discovery, and will discuss the challenges of interoperable data discovery. interoperability among metadata standards and vocabularies will be discussed. A short overview of the lessons learned at the Marine Metadata Interoperability (MMI) metadata workshop held in Boulder, Colorado on August 9-11, 2005 will be given.

Meaux, Melanie F.↗
NASA NTRS2001

Studies of Antarctic Sea Ice Concentrations from Satellite Data and Their Applications

Large changes in the sea ice cover have been observed recently. Because of the relevance of such changes to climate change studies it is important that key ice concentration data sets used for evaluating such changes are interpreted properly. High and medium resolution visible and infrared satellite data are used in conjunction with passive microwave data to study the true characteristics of the Antarctic sea ice cover, assess errors in currently available ice concentration products, and evaluate the applications and limitations of the latter in polar process studies. Cloud-free high resolution data provide valuable information about the natural distribution, stage of formation, and composition of the ice cover that enables interpretation of the large spatial and temporal variability of the microwave emissivity of Antarctic sea ice. Comparative analyses of co-registered visible, infrared and microwave data were used to evaluate ice concentrations derived from standard ice algorithms (i.e., Bootstrap and Team) and investigate the 10 to 35% difference in derived values from large areas within the ice pack, especially in the Weddell Sea, Amundsen Sea, and Ross Sea regions. Landsat and OLS data show a predominance of thick consolidated ice in these areas and show good agreement with the Bootstrap Algorithm. While direct measurements were not possible, the lower values from the Team Algorithm results are likely due to layering within the ice and snow and/or surface flooding, which are known to affect the polarization ratio. In predominantly new ice regions, the derived ice concentration from passive microwave data is usually lower than the true percentage because the emissivity of new ice changes with age and thickness and is lower than that of thick ice. However, the product provides a more realistic characterization of the sea ice cover, and are more useful in polar process studies since it allows for the identification of areas of significant divergence and polynya activities. Also, heat and salinity fluxes are proportionately increased in these areas compared to those from the thicker ice areas. A slight positive trend in ice extent and area from 1978 through 2000 is observed consistent with slight continental cooling during the period. However, the confidence in this result is only moderate because the overlap period for key instruments is just one month and the sensitivity to changes in sensor characteristics, calibration and threshold for the ice edge is quite high.

Comiso, Josefino C.↗
DOE OSTI2022

Global Carbon Budget 2021

Abstract. Accurate assessment of anthropogenic carbon dioxide (CO2) emissions and their redistribution among the atmosphere, ocean, and terrestrial biosphere in a changing climate is critical to better understand the global carbon cycle, support the development of climate policies, and project future climate change. Here we describe and synthesize datasets and methodology to quantify the five major components of the global carbon budget and their uncertainties. Fossil CO2 emissions (EFOS) are based on energy statistics and cement production data, while emissions from land-use change (ELUC), mainly deforestation, are based on land use and land-use change data and bookkeeping models. Atmospheric CO2 concentration is measured directly, and its growth rate (GATM) is computed from the annual changes in concentration. The ocean CO2 sink (SOCEAN) is estimated with global ocean biogeochemistry models and observation-based data products. The terrestrial CO2 sink (SLAND) is estimated with dynamic global vegetation models. The resulting carbon budget imbalance (BIM), the difference between the estimated total emissions and the estimated changes in the atmosphere, ocean, and terrestrial biosphere, is a measure of imperfect data and understanding of the contemporary carbon cycle. All uncertainties are reported as ±1σ. For the first time, an approach is shown to reconcile the difference in our ELUC estimate with the one from national greenhouse gas inventories, supporting the assessment of collective countries' climate progress. For the year 2020, EFOS declined by 5.4 % relative to 2019, with fossil emissions at 9.5 ± 0.5 GtC yr−1 (9.3 ± 0.5 GtC yr−1 when the cement carbonation sink is included), and ELUC was 0.9 ± 0.7 GtC yr−1, for a total anthropogenic CO2 emission of 10.2 ± 0.8 GtC yr−1 (37.4 ± 2.9 GtCO2). Also, for 2020, GATM was 5.0 ± 0.2 GtC yr−1 (2.4 ± 0.1 ppm yr−1), SOCEAN was 3.0 ± 0.4 GtC yr−1, and SLAND was 2.9 ± 1 GtC yr−1, with a BIM of −0.8 GtC yr−1. The global atmospheric CO2 concentration averaged over 2020 reached 412.45 ± 0.1 ppm. Preliminary data for 2021 suggest a rebound in EFOS relative to 2020 of +4.8 % (4.2 % to 5.4 %) globally. Overall, the mean and trend in the components of the global carbon budget are consistently estimated over the period 1959–2020, but discrepancies of up to 1 GtC yr−1 persist for the representation of annual to semi-decadal variability in CO2 fluxes. Comparison of estimates from multiple approaches and observations shows (1) a persistent large uncertainty in the estimate of land-use changes emissions, (2) a low agreement between the different methods on the magnitude of the land CO2 flux in the northern extra-tropics, and (3) a discrepancy between the different methods on the strength of the ocean sink over the last decade. This living data update documents changes in the methods and datasets used in this new global carbon budget and the progress in understanding of the global carbon cycle compared with previous publications of this dataset (Friedlingstein et al., 2020, 2019; Le Quéré et al., 2018b, a, 2016, 2015b, a, 2014, 2013). The data presented in this work are available at https://doi.org/10.18160/gcp-2021 (Friedlingstein et al., 2021).

Friedlingstein, Pierre (ORCID:0000000333094739)↗
NASA NTRS1977

Change detection in coastal zone environments

A study was conducted with the objective to develop and evaluate various change detection techniques based upon computer-aided analysis of Landsat multispectral scanner (MSS) data to monitor coastal zone environments. The study site selected includes a portion of the Matagorda Bay estuarine system located along the Texas Coast. The principal data sources for the study were MSS data collected on November, 27, 1972 and February 25, 1975. The MSS data were processed and a multidata eight-channel data set at a scale of 1:24,000 was obtained. A description is presented of four change detection techniques which were designed and implented for evaluation, taking into account postclassification comparison change detection, delta data change detection, spectral/temporal change classification, and layered spectral/temporal approach. The results of the investigation are discussed.

Weismiller, R. A.↗
NASA NTRS1977

Evaluation of change detection techniques for monitoring coastal zone environments

Development of satisfactory techniques for detecting change in coastal zone environments is required before operational monitoring procedures can be established. In an effort to meet this need a study was directed toward developing and evaluating different types of change detection techniques, based upon computer aided analysis of LANDSAT multispectral scanner (MSS) data, to monitor these environments. The Matagorda Bay estuarine system along the Texas coast was selected as the study area. Four change detection techniques were designed and implemented for evaluation: (1) post classification comparison change detection, (2) delta data change detection, (3) spectral/temporal change classification, and (4) layered spectral/temporal change classification. Each of the four techniques was used to analyze a LANDSAT MSS temporal data set to detect areas of change of the Matagorda Bay region.

Weismiller, R. A.↗
DOE OSTI2023

Autonomous Inversion of In Situ Deformation Measurement Data for Injection-Induced Stress Change

Geologic carbon storage (GCS) is likely to play a key part of the global effort to dramatically reduce CO2 emissions and perhaps even reduce atmospheric CO2 concentrations through carbon negative operations. A critical part of effort to commercialize and widely deploy this technology is developing the capability to rapidly assimilate real-time monitoring data into a form that will enable site operators to make decisions to manage the safe and efficient operations. Two of the risks associate with GCS are the risk of inducing fractures in the sealing formations that can create leakage pathways and the risk of inducing earthquakes of sufficient magnitude to cause public concern, property damage, or safety risks. To properly manage these risks the site operator needs to know the initial state of stress, the change in stress induced by injection, and the relationship between operational parameters such as injection rate and pressure and the change in stress. Current methods of estimating the change in stress require choosing the type of constitutive model and the model parameters based on core, log, and geophysical data during the characterization phase, with little feedback from operational observations to validate or refine these choices. These characterization methods interrogate the geologic formations using length scales, loading rates or magnitudes that are quite different from those encountered by the actual storage system. It is shown that errors in the assumed constitutive response, even when informed by laboratory tests on core samples, are likely to be common, large, and underestimate the magnitude of stress change caused by injection. Recent advances in borehole-based strain instruments and borehole and surface-based tilt and displacement instruments have now enabled monitoring of the deformation of the storage system throughout its operational lifespan. This data can enable validation and refinement of the knowledge of the geomechanical properties and state of the system, but brings with it a challenge to transform the raw data into actionable knowledge. We demonstrate a method that uses automatic differentiation and a finite-element based geomechanical model perform a gradient-based deterministic inversion of geomechanical monitoring data. This approach allows autonomous integration of the instrument data without the need for time consuming manual interpretation and selection of updated model parameters. Furthermore, only isotropic linear elasticity is considered in this paper, the approach presented is very flexible as to what type of geomechanical constitutive response can be used. The approach is easily adaptable to nonlinear physics-based constitutive models to account for common rock behaviors such as creep and plasticity. The approach also enables training of machine learning-based constitutive models by allowing back propagation of errors through the finite element calculations. This enables strongly enforcing known physics, such as conservation of momentum and continuity, while allowing data-driven models to learn the truly unknown physics such as the constitutive or petrophysical responses.

Burghardt, Jeffrey A.↗
DOE OSTI2024

Robust errant beam prognostics with conditional modeling for particle accelerators

Abstract Particle accelerators are complex and comprise thousands of components, with many pieces of equipment running at their peak power. Consequently, they can fault and abort operations for numerous reasons, lowering efficiency and science output. To avoid these faults, we apply anomaly detection techniques to predict unusual behavior and perform preemptive actions to improve the total availability. Supervised machine learning (ML) techniques such as siamese neural network models can outperform the often-used unsupervised or semi-supervised approaches for anomaly detection by leveraging the label information. One of the challenges specific to anomaly detection for particle accelerators is the data’s variability due to accelerator configuration changes within a production run of several months. ML models fail at providing accurate predictions when data changes due to changes in the configuration. To address this challenge, we include the configuration settings into our models and training to improve the results. Beam configurations are used as a conditional input for the model to learn any cross-correlation between the data from different conditions and retain its performance. We employ conditional siamese neural network (CSNN) models and conditional variational auto encoder (CVAE) models to predict errant beam pulses at the spallation neutron source under different system configurations and compare their performance. We demonstrate that CSNNs outperform CVAEs in our application.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Data for Adapting C4 Photosynthesis to Atmospheric Change and Increasing Productivity by Elevating Rubisco Content in Sorghum and Sugarcane

This repository includes data sets and R scripts that were used to perform analysis and produce figures for the following publication: Salesse-Smith, C. E. et al. “Adapting C4 photosynthesis to atmospheric change and increasing productivity by elevating Rubisco content in sorghum and sugarcane.” Proceedings of the National Academy of Sciences 122, e2419943122 (2025) doi:10.1073/pnas.2419943122.

Biomass Analytics↗
NASA NTRS2020

Operations Concept for responding to Urgent Requests for NASA-ISRO Synthetic Aperture Radar (NISAR)

This mission is a collaboration between the National Aeronautics and Space Administration (NASA) and the Indian Space Research Organization (ISRO). This spacecraft will carry two instruments that will operate at radar wavelengths (L and S band) and will provide data for understanding changes in the Earth’s land surface. The scientific data from this mission will revolutionize our understanding of the causes and consequences of land surface changes on Earth.

Hammer, Brian↗
DOE OSTI2025

Global Carbon Budget 2024

Abstract. Accurate assessment of anthropogenic carbon dioxide (CO2) emissions and their redistribution among the atmosphere, ocean, and terrestrial biosphere in a changing climate is critical to better understand the global carbon cycle, support the development of climate policies, and project future climate change. Here we describe and synthesize datasets and methodologies to quantify the five major components of the global carbon budget and their uncertainties. Fossil CO2 emissions (EFOS) are based on energy statistics and cement production data, while emissions from land-use change (ELUC) are based on land-use and land-use change data and bookkeeping models. Atmospheric CO2 concentration is measured directly, and its growth rate (GATM) is computed from the annual changes in concentration. The global net uptake of CO2 by the ocean (SOCEAN, called the ocean sink) is estimated with global ocean biogeochemistry models and observation-based fCO2 products (fCO2 is the fugacity of CO2). The global net uptake of CO2 by the land (SLAND, called the land sink) is estimated with dynamic global vegetation models. Additional lines of evidence on land and ocean sinks are provided by atmospheric inversions, atmospheric oxygen measurements, and Earth system models. The sum of all sources and sinks results in the carbon budget imbalance (BIM), a measure of imperfect data and incomplete understanding of the contemporary carbon cycle. All uncertainties are reported as ±1σ. For the year 2023, EFOS increased by 1.3 % relative to 2022, with fossil emissions at 10.1 ± 0.5 GtC yr−1 (10.3 ± 0.5 GtC yr−1 when the cement carbonation sink is not included), and ELUC was 1.0 ± 0.7 GtC yr−1, for a total anthropogenic CO2 emission (including the cement carbonation sink) of 11.1 ± 0.9 GtC yr−1 (40.6 ± 3.2 GtCO2 yr−1). Also, for 2023, GATM was 5.9 ± 0.2 GtC yr−1 (2.79 ± 0.1 ppm yr−1; ppm denotes parts per million), SOCEAN was 2.9 ± 0.4 GtC yr−1, and SLAND was 2.3 ± 1.0 GtC yr−1, with a near-zero BIM (−0.02 GtC yr−1). The global atmospheric CO2 concentration averaged over 2023 reached 419.31 ± 0.1 ppm. Preliminary data for 2024 suggest an increase in EFOS relative to 2023 of +0.8 % (−0.2 % to 1.7 %) globally and an atmospheric CO2 concentration increase by 2.87 ppm, reaching 422.45 ppm, 52 % above the pre-industrial level (around 278 ppm in 1750). Overall, the mean of and trend in the components of the global carbon budget are consistently estimated over the period 1959–2023, with a near-zero overall budget imbalance, although discrepancies of up to around 1 GtC yr−1 persist for the representation of annual to semi-decadal variability in CO2 fluxes. Comparison of estimates from multiple approaches and observations shows the following: (1) a persistent large uncertainty in the estimate of land-use change emissions, (2) low agreement between the different methods on the magnitude of the land CO2 flux in the northern extra-tropics, and (3) a discrepancy between the different methods on the mean ocean sink. This living-data update documents changes in methods and datasets applied to this most recent global carbon budget as well as evolving community understanding of the global carbon cycle. The data presented in this work are available at https://doi.org/10.18160/GCP-2024 (Friedlingstein et al., 2024).

Friedlingstein, Pierre (ORCID:0000000333094739)↗
NASA NTRS2012

Utilizing Chamber Data for Developing and Validating Climate Change Models

Controlled environment chambers (e.g. growth chambers, SPAR chambers, or open-top chambers) are useful for measuring plant ecosystem responses to climatic variables and CO2 that affect plant water relations. However, data from chambers was found to overestimate responses of C fluxes to CO2 enrichment. Chamber data may be confounded by numerous artifacts (e.g. sidelighting, edge effects, increased temperature and VPD, etc) and this limits what can be measured accurately. Chambers can be used to measure canopy level energy balance under controlled conditions and plant transpiration responses to CO2 concentration can be elucidated. However, these measurements cannot be used directly in model development or validation. The response of stomatal conductance to CO2 will be the same as in the field, but the measured response must be recalculated in such a manner to account for differences in aerodynamic conductance, temperature and VPD between the chamber and the field.

Monje, Oscar↗
NASA NTRS1991

Data compression: The end-to-end information systems perspective for NASA space science missions

The unique characteristics of compressed data have important implications to the design of space science data systems, science applications, and data compression techniques. The sequential nature or data dependence between each of the sample values within a block of compressed data introduces an error multiplication or propagation factor which compounds the effects of communication errors. The data communication characteristics of the onboard data acquisition, storage, and telecommunication channels may influence the size of the compressed blocks and the frequency of included re-initialization points. The organization of the compressed data are continually changing depending on the entropy of the input data. This also results in a variable output rate from the instrument which may require buffering to interface with the spacecraft data system. On the ground, there exist key tradeoff issues associated with the distribution and management of the science data products when data compression techniques are applied in order to alleviate the constraints imposed by ground communication bandwidth and data storage capacity.

Tai, Wallace↗
NASA NTRS2018

Collaborative Data Curation to Support the Multi-Mission Algorithm and Analysis Platform (MAAP)

Upcoming space-borne missions will offer unprecedented data about Earth but will also feature exponentially high data volumes. These high data volumes will change the way the scientific community works with data and will also create a unique need for improved data sharing and collaboration. NASA and ESA are working together to address these issues by collaboratively developing the Multi-Mission Algorithm and Analysis Platform (MAAP) to improve the understanding of global aboveground terrestrial carbon dynamics. The MAAP will support ESA’s BIOMASS mission, NASA’s GEDI mission and NASA/ISRO’s NISAR mission. The MAAP will be developed in two phases: a pilot phase and a full production phase. The pilot phase will demonstrate collaboration and basic capabilities. The pilot phase will focus on biomass relevant airborne and field campaign data. Two NASA teams are supporting the development of the MAAP. The MAAP engineering team is responsible for the development, maintenance and operations of the MAAP system while the MAAP data team ensures the ongoing quality of the data, metadata and other information provided in the MAAP. The MAAP data team also supports the ingest and archive of identified data to the MAAP platform. This poster describes the use case development process for the pilot MAAP and the data curated in support of those use cases. Additionally, this presentation will outline the pilot MAAP data ingest process and metadata curation effort along with efforts to ensure interoperability between ESA and NASA data and metadata.

Bugbee, Kaylin↗
NASA NTRS2011

Functional Data Analysis of Spaceflight-Induced Changes in Coordination and Phase in Head Pitch Acceleration During Treadmill Walking

Astronauts returning from spaceflight experience neurovestibular disturbances during head movements and attempt to mitigate them by limiting head motion. Analyses to date of the head movements made during walking have concentrated on amplitude and variability measures extracted from ensemble averages of individual gait cycles. Phase shifts within each gait cycle can be determined by functional data analysis through the computation of time-warping functions. Large, localized variations in the timing of peaks in head kinematics may indicate changes in coordination. The purpose of this study was to determine timing changes in head pitch acceleration of astronauts during treadmill walking before and after flight. Six astronauts (5M/1F; age = 43.5+/-6.4yr) participated in the study. Subjects walked at 1.8 m/sec (4 mph) on a motorized treadmill while reading optotypes displayed on a computer screen 4 m in front of their eyes. Three-dimensional motion of the subject s head was recorded with an Inertial Measurement Unit (IMU) device. Data were recorded twice before flight and four times after landing. The head pitch acceleration was calculated by taking the time derivative of the pitch velocity data from the IMU. Data for each session with each subject were time-normalized into gait cycles, then registered to align significant features and create a mean curve. The mean curves of each postflight session for each subject were re-registered based on their preflight mean curve to create time-warping functions. The root mean squares (RMS) of these warping functions were calculated to assess the deviation of head pitch acceleration mean curves in each postflight session from the preflight mean curve. After landing, most crewmembers exhibited localized shifts within their head pitch acceleration regimes, with the greatest deviations in RMS occurring on landing day or 1 day after landing. These results show that the alteration of head pitch coordination due to spaceflight may be assessed using an analysis of time-warping functions.

Miller, Christopher↗
NASA NTRS2002

Changes in Earth 360 380 nm Reflectivity: 1980-2000

The TOMS (Total Ozone Mapping Spectrometer) reflectively time series 1980 to 1992 and 1997 to 2000 have been combined to estimate change that have occurred over a 21 year period. The relative calibration of the two TOMS (Nimbus-7, N7 and Earth-Probe, EP) has been validated using the measured reflectivity R over Hudson Bay, Canada and found to be within 1 RU (R=0.01). Some of the local trend features seen in the N7 time series (1980 to 1992) have been continued in the combined time series, but the overall zonal average and global trends have changed. The UV (ultraviolet) reflectivity data are compared with changes in the AVHRR outgoing long-wavelength radiation (OLR) and show an expected anti-correlation with cloud-cover changes over the same period for many, but not all, features. The key results include a continuing decrease in cloud cover over Europe and North America and an increase in reflectivity near Antarctica.

Herman, J. R.↗