Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

Earth Observing System: Global Observations to Study the Earth's Environment

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. During the last couple of years, four EOS science missions were launched, representing observations of (1) total solar irradiance, (2) Earth radiation budget, (3) land cover & land use change, (4) ocean processes (vector wind, sea surface temperature, and ocean color), (5) atmospheric processes (aerosol and cloud properties, water vapor, and temperature and moisture profiles), and (6) tropospheric chemistry. In succeeding years many more satellites will be launched that will contribute immeasurably to our understanding of the Earth's environment. In this presentation I will describe how scientists are using NASA's Earth science data to examine land use and natural hazards, environmental air quality, including dust storms over the world's deserts, cloud and radiation properties, sea surface temperature, and winds over the ocean.

King, Michael D.↗
NASA NTRS2002

Overview of Terra

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. During the last couple of years, seven EOS science missions were launched, representing observations of (i) total solar irradiance, (ii) Earth radiation budget, (iii) land cover & land use change, (iv) ocean processes (vector wind, sea surface temperature, ocean topography, and ocean color), (v) atmospheric processes (aerosol and cloud properties, water vapor, and temperature and moisture profiles), (v) tropospheric chemistry, (vi) sea ice concentration, and (viii) precipitation. In succeeding years many more satellites will be launched that will contribute immeasurably to our understanding of the Earth's environment. In this lecture I will describe how scientists are using NASA's Earth science data to examine land use and natural hazards, environmental air quality, including dust storms over the world's deserts, cloud and radiation properties, sea surface temperature, and tropospheric chemistry. This lecture will describe the Terra satellite, launched in December 1999 and still operating, and each of the five sensors onboard the spacecraft. This overview will highlight the goals and objectives of this mission, and describe the contributions and unique datasets provided by each sensor. This lecture will form the background for an extensive weeklong course on Terra and all the algorithms that have been developed and implemented to process the data from this spacecraft. This lecture will include a description of the Terra orbit, launch, data communication with the spacecraft, and data processing and archival of the data.

King, Michael D.↗
NASA NTRS2003

Earth Observing System: Global Observations to Study the Earth's Environment

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. During the last couple of years, four EOS science missions were launched, representing observations of (i) total solar irradiance, (ii) Earth radiation budget, (iii) land cover & land use change, (iv) ocean processes (vector wind, sea surface temperature, and ocean color), (v) atmospheric processes (aerosol and cloud properties, water vapor, and temperature and moisture profiles), and (vi) tropospheric chemistry. In succeeding years many more satellites will be launched that will contribute immeasurably to our understanding of the Earth's environment. In this presentation I will describe how scientists are using NASA's Earth science data to examine land use and natural hazards, environmental air quality, including: dust storms over the worlds deserts, cloud and radiation properties, sea surface temperature, and winds over the ocean, with a special emphasis on satellite observations available for studying the southern African environment.

King, Michael D.↗
NASA NTRS2003

Promise and Capability of NASA's Earth Observing System to Monitor Human-Induced Climate Variations

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. The Moderate Resolution Imaging Spectroradiometer (MODIS), developed as part of the Earth Observing System (EOS) and launched on Terra in December 1999 and Aqua in May 2002, is designed to meet the scientific needs for satellite remote sensing of clouds, aerosols, water vapor, and land and ocean surface properties. This sensor and multi-platform observing system is especially well suited to observing detailed interdisciplinary components of the Earth s surface and atmosphere in and around urban environments, including aerosol optical properties, cloud optical and microphysical properties of both liquid water and ice clouds, land surface reflectance, fire occurrence, and many other properties that influence the urban environment and are influenced by them. In this presentation I will summarize the current capabilities of MODIS and other EOS sensors currently in orbit to study human-induced climate variations.

King, M. D.↗
NASA NTRS2004

NASA's Earth Observing System (EOS): Observing the Atmosphere, Land, Oceans, and Ice from Space

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. During this year, the last of the first series of EOS missions, Aura, was launched. Aura is designed exclusively to conduct research on the composition, chemistry, and dynamics of the Earth's upper and lower atmosphere, employing multiple instruments on a single spacecraft. Aura is the third in a series of major Earth observing satellites to study the environment and climate change and is part of NASA's Earth Science Enterprise. The first and second missions, Terra and Aqua, are designed to study the land, oceans, atmospheric constituents (aerosols, clouds, temperature, and water vapor), and the Earth's radiation budget. The other seven EOS spacecraft include satellites to study (i) land cover & land use change, (ii) solar irradiance and solar spectral variation, (iii) ice volume, (iv) ocean processes (vector wind and sea surface topography), and (v) vertical variations of clouds, water vapor, and aerosols up to and including the stratosphere. Aura's chemistry measurements will also follow up on measurements that began with NASA's Upper Atmosphere Research Satellite and continue the record of satellite ozone data collected from the TOMS missions. In this presentation I will describe how scientists are using EOS data to examine the health of the earth's atmosphere, including atmospheric chemistry, aerosol properties, and cloud properties, with a special but not exclusive look at the latest earth observing mission, Aura.

King, Michael D.↗
NASA NTRS2005

NASA's Earth Observing System (EOS): Observing the Atmosphere, Land, Oceans, and Ice from Space

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by whch scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. During this year, the last of the first series of EOS missions, Aura, was launched. Aura is designed exclusively to conduct research on the composition, chemistry, and dynamics of the Earth's upper and lower atmosphere, employing multiple instruments on a single spacecraft. Aura is the third in a series of major Earth observing satellites to study the environment and climate change and is part of NASA's Earth Science Enterprise. The first and second missions, Terra and Aqua, are designed to study the land, oceans, atmospheric constituents (aerosols, clouds, temperature, and water vapor), and the Earth's radiation budget. The other seven EOS spacecraft include satellites to study (i) land cover & land use change, (ii) solar irradiance and solar spectral variation, (iii) ice volume, (iv) ocean processes (vector wind and sea surface topography), and (v) vertical variations of clouds, water vapor, and aerosols up to and including the stratosphere. Aura's chemistry measurements will also follow up on measurements that began with NASA's Upper Atmosphere Research Satellite and continue the record of satellite ozone data collected from the TOMS missions. In this presentation I will describe how scientists are using EOS data to examine the health of the earth's atmosphere, including atmospheric chemistry, aerosol properties, and cloud properties, with a special look at the latest earth observing mission, Aura.

King, Michael D.↗
NASA NTRS2012

Investigation into Cloud Computing for More Robust Automated Bulk Image Geoprocessing

Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.

Brown, Richard B.↗
NASA NTRS2013

Public Health Applications of Remotely-sensed Environmental Datasets for the Conterminous United States

NASA Marshall Space Flight Center is collaborating with the University of Alabama at Birmingham (UAB) School of Public Health and the Centers for Disease Control and Prevention (CDC) National Center for Public Health Informatics to address issues of environmental health and enhance public health decision-making using NASA remotely-sensed data and products. The objectives of this study are to develop high-quality spatial data sets of environmental variables, link these with public health data from a national cohort study, and deliver the linked data sets and associated analyses to local, state and federal end-user groups. Three daily environmental data sets were developed for the conterminous U.S. on different spatial resolutions for the period 2003-2008: (1) spatial surfaces of estimated fine particulate matter (PM2.5) exposures on a 10-km grid using the US Environmental Protection Agency (EPA) ground observations and NASA's MODerate-resolution Imaging Spectroradiometer (MODIS) data; (2) a 1-km grid of Land Surface Temperature (LST) using MODIS data; and (3) a 12-km grid of daily Incoming Solar Radiation (Insolation) and heat-related products using the North American Land Data Assimilation System (NLDAS) forcing data. These environmental data sets were linked with public health data from the UAB REasons for Geographic And Racial Differences in Stroke (REGARDS) national cohort study to determine whether exposures to these environmental risk factors are related to cognitive decline, stroke and other health outcomes. These environmental datasets and the results of the public health linkage analyses will be disseminated to end-users for decision-making through the CDC Wide-ranging Online Data for Epidemiologic Research (WONDER) system and through peer-reviewed publications respectively. The linkage of these data with the CDC WONDER system substantially expands public access to NASA data, making their use by a wide range of decision makers feasible. By successful completion of this research, decision-making activities, including policy-making and clinical decision-making, can be positively affected through utilization of the data products and analyses provided on the CDC WONDER system.

Al-Hamdan, Mohammad↗
NASA NTRS2020

The NASA Micro Pulse Lidar Network (MPLNET): Introduction of the New Version 3 Release

The NASA Micro-Pulse Lidar Network (MPLNET) is a global federated network of polarized Micro-Pulse Lidar (MPL) systems running continuously. MPLNET began in 2000, and there have been over 70 sites deployed worldwide, with 24 sites currently active and a few more planned over the next year. Seven of the long-term sites have 10+ years of data, and many more have 5+ years. Most sites are co-located with AERONET providing joint data on column and vertically resolved aerosol and cloud information. This presentation will introduce our new Version 3 MPLNET data. All sites in the network now feature eye-safe polarized backscatter MPL instruments, providing information on attenuated backscatter and particle shape. In addition to change with our signal data, we have an enhanced cloud product suite, a new PBL height product, and inclusion of the new AERONET lunar aerosol optical depth into MPLNET aerosol retrievals. A new quality flag process will be used to better describe all data products. Finally, a new data portal will provide near-real-time (NRT) access to all data products, including new quality assured NRT L1.5 products. Custom products developed for model specific applications will also be provided.

Welton, Ellsworth J.↗
DOE OSTI2023

Community threat intelligence and visibility for operational technology networks

Techniques are provided for community threat intelligence for operational technology networks. For a plurality of OT networks, at least one monitoring device processes OT network traffic and collects telemetry data, and a telemetry sanitization system applies a sanitization process to the telemetry data to generate sanitized telemetry data that does not include sensitive data. A computer system receives sanitized telemetry data from the telemetry sanitization systems provided for the plurality of OT networks, maintains threat intelligence data generated based on the sanitized telemetry data, and provides access to at least one of the threat intelligence data and the sanitized telemetry data to a plurality of users.

Bladow, Garrett↗
NASA NTRS2014

Use of Semantic Technology to Create Curated Data Albums

One of the continuing challenges in any Earth science investigation is the discovery and access of useful science content from the increasingly large volumes of Earth science data and related information available online. Current Earth science data systems are designed with the assumption that researchers access data primarily by instrument or geophysical parameter. Those who know exactly the data sets they need can obtain the specific files using these systems. However, in cases where researchers are interested in studying an event of research interest, they must manually assemble a variety of relevant data sets by searching the different distributed data systems. Consequently, there is a need to design and build specialized search and discover tools in Earth science that can filter through large volumes of distributed online data and information and only aggregate the relevant resources needed to support climatology and case studies. This paper presents a specialized search and discovery tool that automatically creates curated Data Albums. The tool was designed to enable key elements of the search process such as dynamic interaction and sense-making. The tool supports dynamic interaction via different modes of interactivity and visual presentation of information. The compilation of information and data into a Data Album is analogous to a shoebox within the sense-making framework. This tool automates most of the tedious information/data gathering tasks for researchers. Data curation by the tool is achieved via an ontology-based, relevancy ranking algorithm that filters out nonrelevant information and data. The curation enables better search results as compared to the simple keyword searches provided by existing data systems in Earth science.

Ramachandran, Rahul↗
NASA NTRS2014

Use of Semantic Technology to Create Curated Data Albums

One of the continuing challenges in any Earth science investigation is the discovery and access of useful science content from the increasingly large volumes of Earth science data and related information available online. Current Earth science data systems are designed with the assumption that researchers access data primarily by instrument or geophysical parameter. Those who know exactly the data sets they need can obtain the specific files using these systems. However, in cases where researchers are interested in studying an event of research interest, they must manually assemble a variety of relevant data sets by searching the different distributed data systems. Consequently, there is a need to design and build specialized search and discovery tools in Earth science that can filter through large volumes of distributed online data and information and only aggregate the relevant resources needed to support climatology and case studies. This paper presents a specialized search and discovery tool that automatically creates curated Data Albums. The tool was designed to enable key elements of the search process such as dynamic interaction and sense-making. The tool supports dynamic interaction via different modes of interactivity and visual presentation of information. The compilation of information and data into a Data Album is analogous to a shoebox within the sense-making framework. This tool automates most of the tedious information/data gathering tasks for researchers. Data curation by the tool is achieved via an ontology-based, relevancy ranking algorithm that filters out non-relevant information and data. The curation enables better search results as compared to the simple keyword searches provided by existing data systems in Earth science.

Ramachandran, Rahul↗
NASA NTRS2014

Hyperspectral Imager for the Coastal Ocean (HICO): Overview, Operational Updates, and Coastal Ocean Applications

The Hyperspectral Imager for the Coastal Ocean (HICO) was built to measure in‐water properties of complex coastal regions. HICO enables synoptic coverage; 100‐meter spatial resolution for sampling the variability and spatial irregularity of coastal waters; and high spectral resolution to untangle the signals from chlorophyll, colored dissolved organic matter, suspended sediments and varying bottom types. HICO was built by the Naval Research Laboratory, installed on the International Space Station (ISS) in September 2009, and operated for ONR for the first three years. In 2013, NASA assumed sponsorship of operations in order to leverage HICO's ability to address their Earth monitoring mission. This has opened up access of HICO data to the broad research community. Over 8000 images are now available on NASA's Ocean Color Website (http://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sen=hi). Oregon State University's HICO website (http://hico.coas.oregonstate.edu) remains the portal for researchers to request new collections and access their requested data. We will present updates on HICO's calibration and improvements in geolocation and show examples of the use of HICO data to address issues in the coastal ocean and Great Lakes.

Davis, Curtiss O.↗
NASA NTRS2018

Overcoming Pitfalls When Using HDF5 Compression

Compression of large datasets in S-NPP, JPSS and other HDF5 data files may substantially reduce their size, in turn reducing disk space requirements and file download time. However, mismatches between the layout of the files' datasets, the HDF5 instance's cache settings, choice of compression algorithm, and the access pattern of applications using the data can sometimes result in poor performance or exhausting machine resources when running the application. Whether designed in advance or modified in response to encountered problems, applications can be tuned to optimize efficiency of data access, avoid unnecessary repeated decompression, and reduce the amount of memory used. Examples will be given of problems that may be encountered, how to use available tools to diagnose or work around them, changing cache settings to conserve memory, and designing access strategies to avoid both performance and memory issues when creating or modifying applications.

performance↗
DOE OSTI2023

Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

Viability of S3 Object Storage for the ASC Program at Sandia

Recent efforts at Sandia such as DataSEA are creating search engines that enable analysts to query the institution’s massive archive of simulation and experiment data. The benefit of this work is that analysts will be able to retrieve all historical information about a system component that the institution has amassed over the years and make better-informed decisions in current work. As DataSEA gains momentum, it faces multiple technical challenges relating to capacity storage. From a raw capacity perspective, data producers will rapidly overwhelm the system with massive amounts of data. From an accessibility perspective, analysts will expect to be able to retrieve any portion of the bulk data, from any system on the enterprise network. Sandia’s Institutional Computing is mitigating storage problems at the enterprise level by procuring new capacity storage systems that can be accessed from anywhere on the enterprise network. These systems use the simple storage service, or S3, API for data transfers. While S3 uses objects instead of files, users can access it from their desktops or Sandia’s high-performance computing (HPC) platforms. S3 is particularly well suited for bulk storage in DataSEA, as datasets can be decomposed into object that can be referenced and retrieved individually, as needed by an analyst. In this report we describe our experiences working with S3 storage and provide information about how developers can leverage Sandia’s current systems. We present performance results from two sets of experiments. First, we measure S3 throughput when exchanging data between four different HPC platforms and two different enterprise S3 storage systems on the Sandia Restricted Network (SRN). Second, we measure the performance of S3 when communicating with a custom-built Ceph storage system that was constructed from HPC components. Overall, while S3 storage is significantly slower than traditional HPC storage, it provides significant accessibility benefits that will be valuable for archiving and exploiting historical data. There are multiple opportunities that arise from this work, including enhancing DataSEA to leverage S3 for bulk storage and adding native S3 support to Sandia’s IOSS library.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2026

ndi

The Nuclear Data Interface (NDI) is an application programming interface (API) that allows access to standard nuclear data parameters while hiding the underlying details of the data libraries and their storage. It allows access to multigroup transport data (neutron and gamma), thermonuclear burn data, dosimetry data, production/depletion chain data, radiochemistry data, and secondary neutron multiplicity data. The name NDI refers to both the code and data formats supported by the code.

Saller, Thomas↗
NASA NTRS2017

Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

NASA's Earth Observing System (EOS) is a coordinated series of satellites for long term global observations. NASA's Earth Observing System Data and Information System (EOSDIS) is a multi-petabyte-scale archive of environmental data that supports global climate change research by providing end-to-end services from EOS instrument data collection to science data processing to full access to EOS and other earth science data. On a daily basis, the EOSDIS ingests, processes, archives and distributes over 3 terabytes of data from NASA's Earth Science missions representing over 6000 data products ranging from various types of science disciplines. EOSDIS has continually evolved to improve the discoverability, accessibility, and usability of high-impact NASA data spanning the multi-petabyte-scale archive of Earth science data products. Reviewed and approved by Chris Lynnes.

Cumulus↗