Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scientific data change analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

Continuation of the NVAP Global Water Vapor Data Sets for Pathfinder Science Analysis

This annual report covers August 2000 - August 2001 under NASA contract NASW-0032, entitled "Continuation of the NVAP (NASA's Water Vapor Project) Global Water Vapor Data Sets for Pathfinder Science Analysis". NASA has created a list of Earth Science Research Questions which are outlined by Asrar, et al. Particularly relevant to NVAP are the following questions: (a) How are global precipitation, evaporation, and the cycling of water changing? (b) What trends in atmospheric constituents and solar radiation are driving global climate? (c) How well can long-term climatic trends be assessed or predicted? Water vapor is a key greenhouse gas, and an understanding of its behavior is essential in global climate studies. Therefore, NVAP plays a key role in addressing the above climate questions by creating a long-term global water vapor dataset and by updating the dataset with recent advances in satellite instrumentation. The NVAP dataset produced from 1988-1998 has found wide use in the scientific community. Studies of interannual variability are particularly important. A recent paper by Simpson, et al. that examined the NVAP dataset in detail has shown that its relative accuracy is sufficient for the variability studies that contribute toward meeting NASA's goals. In the past year, we have made steady progress towards continuing production of this high-quality dataset as well as performing our own investigations of the data. This report summarizes the past year's work on production of the NVAP dataset and presents results of analyses we have performed in the past year.

VonderHaar, Thomas H.↗
NASA NTRS2021

Missing the Reef for the Corals: Unexpected Trends Between Coral Reef Condition and the Environment at the Ecosystem Scale

It is incontrovertible that many coral reefs are in various stages of decline and may be unable to withstand the effects of global climate change, jeopardizing vital ecosystem goods and services to hundreds of millions of people around the world. An estimated 50% of the world's corals have already been lost, and those remaining may be lost by 2030 under the “business as usual” CO2 emissions scenario. However, the foundation of these predictions is a surprisingly sparse dataset, wherein ~0.01–0.1% of the world's reef area has been quantitatively surveyed. Further, the available data comprise observations at the 1–10 m scale, which are not evenly spaced across reefs, but often clustered in areas representing focused survey effort. This impedes modeling and predicting the impact of a changing environment at the ecosystem scale. Here we highlight deficiencies in our current understanding of the relationship between coral reefs and their environments. Specifically, we conduct a meta-analysis using estimates of coral cover from a variety of local surveys, quantitatively relating reef condition to a suite of biogeophysical forcing parameters. We find that readily available public data for coral cover exhibit unexpected trends (e.g., a positive correlation between coral cover and multi-year cumulative thermal stress), contrary to prevailing scientific expectations. We illustrate a significant gap in our current understanding, and thereby prediction, of coral reefs at the ecosystem scale that can only be remedied with uniform, high-density data across vast coral reef regions, such as that from remote sensing.

Eric J Hochberg↗
DOE OSTI2022

ThunderSecure: deploying real-time intrusion detection for 100G research networks by leveraging stream-based features and one-class classification network

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks (40/100G) across distributed sites for processing, storage, and analysis. Like general purpose networks, research networks experience intrusions. However, monitoring anomalies in such high-speed network traffics is challenging given current cyber-infrastructure. Moreover, traditional network intrusion detection systems (NIDS) are signature based. However, anomaly patterns are difficult to define and that rulesets are often not updated frequently enough to reflect the changes of attack behaviors. We present ThunderSecure, a high-throughput, unsupervised learning-based intrusions detection system for 100G research networks. ThunderSecure implements an efficient packet processing and detection pipeline using multi-cores and GPUs. It extracts statistical and temporal features from real-time network data streams and feeds them to a one-class anomaly detection network. A baseline of normal distribution will be created based on the training observation. Testing traffic deviated from the learned profile will be marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets mirrored from two 100G network connections at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. Results show that ThunderSecure can recognize science data traffic captured long after the training and made nearly certain detection on the segment of the streams where anomalous flows were injected.

100G research network↗
NASA NTRS2001

Earth Remote Sensing: A Column Closure Approach

Entering the new millennium, there is no doubt that scientists expand greatly their scientific knowledge of the Earth system by utilizing unique capabilities from the vantage points of space. These global satellite observations include the NASA/NOAA Pathfinder and other ongoing data analysis projects, the Earth Observing System (EOS) program, the Earth System Science Pathfinders (ESSP) small research satellite missions, multi-agency planning for the National Polar-orbiting Operational Environmental Satellite (NPOESS), and other international satellite missions. However, using satellite remotely sensed data alone cannot explore fully the physical processes and energetic balance involved in our changing climate. To close the loop, the ground-based remote sensing and airborne in situ measurements are required. This talk provides an overview of the general strategy of Earth remote sensing for a column closure approach and discusses necessary instrumentation.

Tsay, Si-Chee↗
NASA NTRS2026

Towards an improved understanding of the Antarctic coastal zone and its contribution to future global sea level

Understanding the coastal zone of the Antarctic Ice Sheet, where it interacts with the Southern Ocean and warmer air masses, is crucial for predicting Antarctica's influence on the global climate. This region has multiple tipping mechanisms that could trigger large, rapid, and potentially irreversible changes in the coming centuries. The Antarctic Ice Sheet remains the largest source of uncertainty in future sea-level projections. Insufficient knowledge of bed topography beneath the ice shelves and the coastal ice sheet is not yet well documented, but is a major source of this uncertainty. This review assesses current knowledge of the coastal zone and highlights methods to investigate it, including aerogeophysical surveys, ground- and ship-based measurements, satellite observations, and computer modeling. An ensemble analysis of published bed topography datasets identifies significant data gaps and their regional distribution, framed in the context of current ice-sheet behavior and potential instability. We propose scientific priorities and guidelines for future aerogeophysical surveys, advocating for a comprehensive, coordinated international effort to build a next-generation dataset of Antarctic bed properties. Such an initiative would significantly advance understanding of the role of coastal processes in ice-sheet dynamics, reducing uncertainties in sea-level rise projections and enhancing predictions of future ocean and climate changes.

Kenichi Matsuoka↗
DOE OSTI2025

Imaging Bragg Edge Analysis TooLs for Engineering Structures (iBeatles)

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL) provides pulsed neutrons with energies varying from epithermal to cold. In preparation for VENUS, the neutron imaging beamline to be located at beam port 10, we have performed a series of experiments focused on wavelength-dependent radiography and computed tomography for a broad range of applications, from materials science to biological tissues.One of the time-of-flight (TOF) techniques that is of interest to the scientific community is the 2-dimensional mapping of phases and average crystalline plane orientation in samples both ex-situ and during applied stresses such as tensile loading and heating. This technique is known as Bragg edgeimaging and relies on the identification of changes of transmission values, fitting of the edge to measure its displacement, and thus identify the shift in lattice parameter due to stresses. One of the challenges of TOF imaging measurements is the amount of data and the inability to observe Bragg edge shifts in real time during an experiment. Thus, we have been focusing on creating a Python-based interface that allows fast data processing and instantaneous mapping and fitting of the Bragg edges, and their evolution through time. Python libraries and Jupyter notebooks have been implemented to facilitate decision making during an experiment. The advantage of the notebooks is the possibility to guide an experiment as they can quickly process and display Bragg edge data. These notebooks can be used independently, or can be combined in a Python Graphical User Interface (GUI) tool called iBeatles. This interface permits visualization and fitting of the Bragg edges, and ultimately back-projects the fitting results onto the radiographs to display a strain map. Assuming data collection has sufficient statistics, the strain mapping analysis can be performed on a pixel-by-pixel basis. This development is a step forward toward a better user experience at the future VENUS beamline in terms of live feedback and productivity. Analysis that used to take days of switching between different applications can now be done in minutes within the

Bilheux, JeanChristophe [Oak Ridge National Labora↗
DOE OSTI2025

Optimization of distributed compute resources utilization in the CMS Global Pool

The CMS Submission Infrastructure is the primary system for managing computing resources for CMS workflows, including data processing, simulation, and analysis. It integrates geographically distributed resources from Grid, HPC, and cloud providers into federated pools managed by HTCondor and Glidein- WMS, for a total of around 500k CPU cores. This system dynamically manages workloads based on priorities defined by the collaboration. Additionally, CMS scheduling strategies must be flexible to handle multiple concurrent workloads while considering changing processing demands and resource availability from various providers.Efficient utilization of vast amounts of distributed compute resources is a key element for the success of the scientific programs of the LHC experiments. Optimizing the system is essential to maximize resource efficiency and fully utilize the distributed computing power. The CMS Submission Infrastructure team thus systematically investigates sources of inefficiency in workload scheduling to reduce their impact. In addition, a strategy of pilot overloading has been introduced to compensate for other inefficiency sources, thereby optimizing resource utilization and enhancing computational throughput.

Mascheroni, Marco [UC, San Diego (main)]↗
NASA NTRS2012

Bringing Together Users and Developers of Forest Biomass Maps

Forests store carbon and thus represent important sinks for atmospheric carbon dioxide. Reducing uncertainty in current estimates of the amount of carbon in standing forests will improve precision of estimates of anthropogenic contributions to carbon dioxide in the atmosphere due to deforestation. Although satellite remote sensing has long been an important tool for mapping land cover, until recently aboveground forest biomass estimates have relied mostly on systematic ground sampling of forests. In alignment with fiscal year 2010 congressional direction, NASA has initiated work toward a carbon monitoring system (CMS) that includes both maps of forest biomass and total carbon flux estimates. A goal of the project is to ensure that the products are useful to a wide community of scientists, managers, and policy makers, as well as to carbon cycle scientists. Understanding the needs and requirements of these data users is helpful not just to the NASA CMS program but also to the entire community working on carbon-related activities. To that end, this meeting brought together a small group of natural resource managers and policy makers who use information on forests in their work with NASA scientists who are working to create aboveground forest biomass maps. These maps, derived from combining remote sensing and ground plots, aim to be more accurate than current inventory approaches when applied at local and regional scales. Meeting participants agreed that users of biomass information will look to the CMS effort not only to provide basic data for carbon or biomass measurements but also to provide data to help serve a broad range of goals, such as forest watershed management for water quality, habitat management for biodiversity and ecosystem services, and potential use for developing payments for ecosystem service projects. Participants also reminded the CMS group that potential users include not only public sector agencies and nongovernmental organizations but also the private sector because much forest acreage in the United States is privately held and needs data for forest management. Additional key outcomes identified by meeting participants include the following: (1) Priority should be given to building into the biomass product ease of use and low costs (including costs of hardware, software, and analysis requirements), (2) CMS products should also be relevant to other biomass measures for forest watershed management, habitat protection for biodiversity, and assessment of markets for ecosystem services, (3) CMS leadership should engage with the Subsidiary Body for Scientific and Technological Advice of the United Nations Framework Convention on Climate Change as they establish measuring, reporting, and verification standards, and (4) CMS leadership should continue to keep sister agencies and other organizations informed as CMS develops, particularly via the agencies active in the U.S. Global Change Research Program Carbon Cycle Interagency Working Group (U.S. Geological Survey, U.S. Department of Agriculture, and National Oceanic and Atmospheric Administration) and nongovernmental organizations.

Forest↗
NASA NTRS1994

(abstract) Mount Rainier: New Remote Sensing Observations of a Decade Volcano

Mount Rainier was selected as a Decade Volcano by the International Association of Volcanology and Chemistry of the Earth's Interior. The purpose of this selection is to focus scientific and public attention on Mount Rainier during the current decade, the United Nations-designated International Decade of Natural Hazard Reduction. The Mount Rainier science plan calls for remote sensing surveys to monitor the volcano. To date, we have conducted airborne surveys with visible and near-infrared, thermal infrared, and interferometric radar instruments. Our preliminary analysis of some night-time time-series thermal infrared survey data sets of the summit suggests that, aside from seasonal variations in snow cover, there have been no qualitative changes in the size or pattern of the summit hot spots. Day-time airborne surveys were done to record the current surface appearance of the volcano and map hydrothermal alteration in the summit region. An interferometric radar survey yielded a high-resolution digital elevation model (DEM) which serves as a base for the registration of the other remote sensing data sets. More importantly, the DEM documents the current topography of glaciers and valleys. Planned biannual radar survey of mount rainier will produce a data set from which seasonal changes in glacier and valley topography can be characterized. Such characterization is essential if we are to recognize geothermally induced changes in snow and ice cover.

infrared radar interferometry glaciers seasonal va↗
NASA NTRS1991

Flight dynamics facility operational orbit determination support for the ocean topography experiment

The Ocean Topography Experiment (TOPEX/POSEIDON) mission is designed to determine the topography of the Earth's sea surface across a 3 yr period, beginning with launch in June 1992. The Goddard Space Flight Center Dynamics Facility has the capability to operationally receive and process Tracking and Data Relay Satellite System (TDRSS) tracking data. Because these data will be used to support orbit determination (OD) aspects of the TOPEX mission, the Dynamics Facility was designated to perform TOPEX operational OD. The scientific data require stringent OD accuracy in navigating the TOPEX spacecraft. The OD accuracy requirements fall into two categories: (1) on orbit free flight; and (2) maneuver. The maneuver OD accuracy requirements are of two types; premaneuver planning and postmaneuver evaluation. Analysis using the Orbit Determination Error Analysis System (ODEAS) covariance software has shown that, during the first postlaunch mission phase of the TOPEX mission, some postmaneuver evaluation OD accuracy requirements cannot be met. ODEAS results also show that the most difficult requirements to meet are those that determine the change in the components of velocity for postmaneuver evaluation.

Bolvin, D. T.↗
NASA NTRS2013

Climate Informatics

The impacts of present and potential future climate change will be one of the most important scientific and societal challenges in the 21st century. Given observed changes in temperature, sea ice, and sea level, improving our understanding of the climate system is an international priority. This system is characterized by complex phenomena that are imperfectly observed and even more imperfectly simulated. But with an ever-growing supply of climate data from satellites and environmental sensors, the magnitude of data and climate model output is beginning to overwhelm the relatively simple tools currently used to analyze them. A computational approach will therefore be indispensable for these analysis challenges. This chapter introduces the fledgling research discipline climate informatics: collaborations between climate scientists and machine learning researchers in order to bridge this gap between data and understanding. We hope that the study of climate informatics will accelerate discovery in answering pressing questions in climate science.

Climate change↗
NASA NTRS2020

NASA’s Carbon Monitoring System (CMS) and Arctic-Boreal Vulnerability Experiment (ABoVE) Social Network and Community of Practice

The NASA Carbon Monitoring System (CMS) and Arctic-Boreal Vulnerability Experiment (ABoVE) have been planned and funded by the NASA Earth Science Division. Both programs have a focus on engaging stakeholders and developing science useful for decision making. The resulting programs have funded significant scientific output and advancements in understanding how satellite remote sensing observations can be used to not just study how the Earth is changing, but also create data products that are of high utility to stakeholders and decisions makers. In this paper we focus on documenting thematic diversity of research themes and methods used, and how the CMS and ABoVE themes are related. We do this through developing a Correlated Topic Model on the 521 papers produced by the two programs and plotting the results in a network diagram. Through analysis of the themes in these papers, we document the relationships between researchers and institutions participating in CMS and ABoVE programs and the benefits from sustained engagement with stakeholders due to recurring funding. We note an absence of policy engagement in the papers and conclude that funded researchers need to be more ambitious and explicit in drawing the connection between their research and carbon policy implications in order to meet the stated goals of the CMS and ABoVE programs.

Molly E Brown↗
DOE OSTI2023

Validation of LOCA2 and STAR-ESDM Statistically Downscaled Products

The National Climate Assessment (NCA) is the preeminent national report examining current and future risks posed by climate change. Countless agencies, policymakers, stakeholders and other end-users rely upon guidance from the NCA to plan for an uncertain future. These groups all depend on modern curated data, provided alongside the NCA, to quantify the impact of climate change on metrics of relevance for their decision processes. In its fifth iteration (NCA5), two statistically downscaled ensemble products, each providing data at grid spacing of approximately 5km over the contiguous United States, were selected to accompany the report. These include LOCalized Analogs version 2 (LOCA2) and Seasonal Trends and Analysis of Residuals Empirical-Statistical Downscaling Model (STAR-ESDM). Both data products are produced through a process known as statistical downscaling, where relatively coarse Global Climate Model (GCM) data is refined to locally relevant scales through the application of scientifically-supported empirical and algorithmic relationships. In support of the NCA effort, this report provides an independent validation of these two products against historical observations, with a focus on precipitation and near-surface temperature variables. Based on the results of this validation, several recommendations are provided related to the use of these data products. The structure of this report is as follows: In section 2, we review three gridded observational products that are used as part of our intercomparison. In section 3, we describe the two statistical downscaling techniques and their corresponding datasets that are the focus of this study. In section 4, the methodology we employ for validation is described. Section 5 provides results of the validation, which in turn motivate our recommendations on the use of these data products. A brief summary is provided in section 6.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Examining Nuisance Aerosol Detections in Light of the Origin of the Screening Process (November 2021)

The evolution of philosophy and computations in the International Data Center (IDC) related to aerosol samples have had profound impacts on the number of recorded detections in the network since routine operations began in 2000. Key decisions from policymakers have been the list of triggering radionuclides, the scheme for categorizing these into interest levels 1-5, and an algorithm for determining when an anthropogenic isotope is seen so often that it is no longer interesting, known as the Exponential Weighted Moving Average (EWMA). These are described in the Operations Manual of the IDC. Key parameters that are controlled by the IDC but for which the IDC receives occasional input from policymakers include the constants in EWMA and the peak significance threshold for individual gamma rays, the latter of which directly leads to determination of the presence or absence of a radionuclide in a sample. There are also changes in computations which the IDC makes and informs policy makers about, such as changes in how background is computed, which could also affect the ease of detecting a peak – real or false. Rather than focus on the quantitative changes due to computation changes, this work records some thinking on how isotopes and peak significance levels were chosen, and the resulting detections seen over 18 years during the buildup of the International Monitoring System (IMS). These detections are considered on a global scale to try to determine the relative impact on monitoring, and in some cases, the nature of their existence. Repeated detections of 131I and 133I are the most troublesome, but they are not so frequent to be a major problem for the Verification Regime. These detections could probably be handled adequately using scientific methods currently under development for xenon backgrounds. It is also somewhat problematic that top-level analysis of aerosol backgrounds has not been reported previous to this. The steep increase in the rate of detections after 2016 are a concern, either in the actual backgrounds or from changes in the calculations methods used to generate the Reviewed Radionuclide Report (RRR.) Final conclusions of the authors are that the computational stability of the RRR is very important. With computational stability, changes can be usefully analyzed as being due to changes in radioactivity in Earth’s atmosphere This report is a distillation into text of a talk given in the Radionuclide Experts Group (RNEG) in Vienna during Working Group B (WGB) in February of 2019. This report does not directly contain any IDC data, only summaries by year, or by isotope, or by location. No specific IDC detection by time, location, or isotope is included.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2003

Shared Knowledge for Decision-making on Environment and Health Issues in the Arctic

This paper will describe a remote sensing and GIs-based system to bring indigenous traditional knowledge together with contemporary scientific knowledge to address impacts resulting from changes in climate, environment, weather and pollution in the Arctic. As scientists and policy-makers from both indigenous and non-indigenous communities continue to build closer partnerships to address common sustainability issues such as the health impacts of climate change and anthropogenic activities, it becomes increasingly important to create shared information management systems which integrate all relevant factors for optimal information sharing and decision-making. This system is being designed to bring together remotely sensed, indigenous and other data and observations for analysis, measuring, and monitoring parameters of interest (e.g., snow cover, rainfall, temperature, ice conditions, vegetation, infrastructure, fires). A description of the system and its components as well as a preliminary application of the system in the Arctic will be presented.

Maynard, Nancy G.↗
NASA NTRS2008

Food Security, Decision Making and the Use of Remote Sensing in Famine Early Warning Systems

Famine early warning systems use remote sensing in combination with socio-economic and household food economy analysis to provide timely and rigorous information on emerging food security crises. The Famine Early Warning Systems Network (FEWS NET) is the US Agency for International Development's decision support system in 20 African countries, as well as in Guatemala, Haiti and Afghanistan. FEWS NET provides early and actionable policy guidance for the US Government and its humanitarian aid partners. As we move into an era of climate change where weather hazards will become more frequent and severe, understanding how to provide quantitative and actionable scientific information for policy makers using biophysical data is critical for an appropriate and effective response.

Brown, Molly E.↗
NASA NTRS1985

Span graphics display utilities handbook, first edition

The Space Physics Analysis Network (SPAN) is a computer network connecting scientific institutions throughout the United States. This network provides an avenue for timely, correlative research between investigators, in a multidisciplinary approach to space physics studies. An objective in the development of SPAN is to make available direct and simplified procedures that scientists can use, without specialized training, to exchange information over the network. Information exchanges include raw and processes data, analysis programs, correspondence, documents, and graphite images. This handbook details procedures that can be used to exchange graphic images over SPAN. The intent is to periodically update this handbook to reflect the constantly changing facilities available on SPAN. The utilities described within reflect an earnest attempt to provide useful descriptions of working utilities that can be used to transfer graphic images across the network. Whether graphic images are representative of satellite servations or theoretical modeling and whether graphics images are of device dependent or independent type, the SPAN graphics display utilities handbook will be the users guide to graphic image exchange.

Gallagher, D. L.↗
NASA NTRS1992

State of the Data Union, 1992

This is the first report on the State of the Data Union (SDU) for the NASA Office of Space Science and Applications (OSSA). OSSA responsibilities include the collection, analysis, and permanent archival of data critical to space science research. The nature of how this is done by OSSA is evolving to keep pace with changes in space research. Current and planned missions have evolved to be more complex and multidisciplinary, and are generating much more data and lasting longer than earlier missions. New technologies enable global access to data, transfer of huge volumes of data, and increasingly complex analysis. The SDU provides a snapshot of this dynamic environment, identifying trends in capabilities and requirements. The current space science data environment is described and parameters which capture the pulse of key functions within that environment are presented. Continuous efforts of OSSA to improve the availability and quality of data provided to the scientific community are reported, highlighting efforts such as the Data Management Initiative.

Source record↗