SEARCH · Engineering Papers
Results for “data archive”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
GRACE/GRACE-FO science data archiving, distribution and user support at PO.DAAC
No abstract provided
Using Cloud Resources to Examine the Sampling Differences Among Boundary Layer Height Data Archived at the GES DISC
Explore the source record for details and available documents.
Operational and Archive Data Records: Surface Elevation Measurements of Lakes, Wetlands, and Rivers for Resources and Hazards
A NASA/USDA funded program offers satellite-derived products for lakes, reservoirs, river reaches, and wetland zones. These are currently being derived from the 10-day and monthly-resolution radar altimeter series. However, observational parameters from the laser based ICESat-2 mission, and the enhanced SWOT KaRIn instrument will also be integrated to meet various end user requirements. The resulting measurements will ultimately be a combination of surface water level and slope, surface water extent, water storage and basin bathymetry, plus a suite of Status Indicators which highlight deviations from long-term and seasonal averages. The main stakeholders are the USDA/Foreign Agricultural Service, the US Geological Survey, USACE/NGA, and various Wetland-related organizations. Applications centre on water and energy resources and fish-catch potential, and on natural hazards (floods and droughts). There is a demand for a global monitoring service, but primary focus is on regions where gauge measurement access is restricted or delayed, or where gauge deployment is hazardous. Ongoing surface acquisition checks and feedback to CNES focusses on the success or failure of the on-board DEM’s on a case-by-case basis. Multiple projects are also underway to improve the surface elevations measurements and the along track resolution (minimum water body width) via exploration of the high resolution (Doppler) Range estimates, the FF-SAR technique, and the high- resolution radiometer based wet tropospheric correction. And while Level3+4 surface water products are being directed by end user requirements, the overriding NASA objectives are the formation of high quality Earth Data Records with high accuracy and uniformity across multiple decades.
Automating Manual Quality Control (QC) of Tropospheric Doppler Radar Wind Profiler (TDRWP) Archive Data with Machine Learning
Explore the source record for details and available documents.
Using Cloud Resources to Examine the Sampling Differences Among Boundary Layer Height Data Archived at the GES DISC
Explore the source record for details and available documents.
Demystifying Kepler Data: A Primer for Systematic Artifact Mitigation
The Kepler spacecraft has collected data of high photometric precision and cadence almost continuously since operations began on 2009 May 2. Primarily designed to detect planetary transits and asteroseismological signals from solar-like stars, Kepler has provided high quality data for many areas of investigation. Unconditioned simple aperture time-series photometry are however affected by systematic structure. Examples of these systematics are differential velocity aberration, thermal gradients across the spacecraft, and pointing variations. While exhibiting some impact on Kepler's primary science, these systematics can critically handicap potentially ground-breaking scientific gains in other astrophysical areas, especially over long timescales greater than 10 days. As the data archive grows to provide light curves for 10(exp 5) stars of many years in length, Kepler will only fulfill its broad potential for stellar astrophysics if these systematics are understood and mitigated. Post-launch developments in the Kepler archive, data reduction pipeline and open source data analysis software have occurred to remove or reduce systematic artifacts. This paper provides a conceptual primer for users of the Kepler data archive to understand and recognize systematic artifacts within light curves and some methods for their removal. Specific examples of artifact mitigation are provided using data available within the archive. Through the methods defined here, the Kepler community will find a road map to maximizing the quality and employment of the Kepler legacy archive.
The data facility of the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS)
AVIRIS operations at the Jet Propulsion Laboratory include a significant data task. The AVIRIS data facility is responsible for data archiving, data calibration, quality monitoring and distribution. Since 1987, the data facility has archived over one terabyte of AVIRIS data and distributed these data to science investigators as requested. In this paper we describe recent improvements in the AVIRIS data facility.
Laying the Foundations for FAIR-er Science: ISA and the LSDA Data Submission Process in NASA's Evolving Data Management Environment
The Life Sciences Data Archive (LSDA) archives data resulting from research on the effects of spaceflight on humans and the development of countermeasures to mitigate spaceflight hazards. Archivists work with researchers to ensure that unique and high value data products and their metadata are preserved and managed to support current and future research. Currently, LSDA is updating its procedures and data submission requirements in response to the evolving data preservation environment at NASA. LSDA is implementing best practices for research data management through the establishment of clear data submission guidelines, integration of the FAIR (Findability, Accessibility, Interoperability, Reusability) principles, and use of the ISA (Investigation, Study, Assay) research metadata framework for data discoverability and transparency into the data management processes. These changes directly impact LSDA’s requirements for research data submissions. The newly revised Research Data Submission Agreement (RDSA), formerly the Data Submission Agreement (DSA), introduces ISA-compatible metadata collection standards to LSDA’s process. Adherence to LSDA’s data submission guidelines enhances the FAIR-ness of the repository’s collections for future users. This presentation will discuss (1) how submission of research data and associated metadata are impacted by current data management policies, (2) benefits of the adoption of FAIR principles and the ISA metadata framework for retrospective studies utilizing existing LSDA datasets and historic data collections, and (3) the support LSDA will provide to researchers during this transition.
Quantitative 3-D imaging topogrammetry for telemedicine applications
The technology to reliably transmit high-resolution visual imagery over short to medium distances in real time has led to the serious considerations of the use of telemedicine, telepresence, and telerobotics in the delivery of health care. These concepts may involve, and evolve toward: consultation from remote expert teaching centers; diagnosis; triage; real-time remote advice to the surgeon; and real-time remote surgical instrument manipulation (telerobotics with virtual reality). Further extrapolation leads to teledesign and telereplication of spare surgical parts through quantitative teleimaging of 3-D surfaces tied to CAD/CAM devices and an artificially intelligent archival data base of 'normal' shapes. The ability to generate 'topogrames' or 3-D surface numerical tables of coordinate values capable of creating computer-generated virtual holographic-like displays, machine part replication, and statistical diagnostic shape assessment is critical to the progression of telemedicine. Any virtual reality simulation will remain in 'video-game' realm until realistic dimensional and spatial relational inputs from real measurements in vivo during surgeries are added to an ever-growing statistical data archive. The challenges of managing and interpreting this 3-D data base, which would include radiographic and surface quantitative data, are considerable. As technology drives toward dynamic and continuous 3-D surface measurements, presenting millions of X, Y, Z data points per second of flexing, stretching, moving human organs, the knowledge base and interpretive capabilities of 'brilliant robots' to work as a surgeon's tireless assistants becomes imaginable. The brilliant robot would 'see' what the surgeon sees--and more, for the robot could quantify its 3-D sensing and would 'see' in a wider spectral range than humans, and could zoom its 'eyes' from the macro world to long-distance microscopy. Unerring robot hands could rapidly perform machine-aided suturing with precision micro-sewing machines, splice neural connections with laser welds, micro-bore through constricted vessels, and computer combine ultrasound, microradiography, and 3-D mini-borescopes to quickly assess and trace vascular problems in situ. The spatial relationships between organs, robotic arms, and end-effector diagnostic, manipulative, and surgical instruments would be constantly monitored by the robot 'brain' using inputs from its multiple 3-D quantitative 'eyes' remote sensing, as well as by contact and proximity force measuring devices. Methods to create accurate and quantitative 3-D topograms at continuous video data rates are described.
Mars Observer data production, transfer, and archival: The data production assembly line
This paper describes the data production, transfer, and archival process designed for the Mars Observer Flight Project. It addresses the developmental and operational aspects of the archive collection production process. The developmental aspects cover the design and packaging of data products for archival and distribution to the planetary community. Also discussed is the design and development of a data transfer and volume production process capable of handling the large throughput and complexity of the Mars Observer data products. The operational aspects cover the main functions of the process: creating data and engineering products, collecting the data products and ancillary products in a central repository, producing archive volumes, validating volumes, archiving, and distributing the data to the planetary community.
Integration of multi-discipline data processing for earth observing systems
The first steps taken to ensure the controlled evolution of existing facilities toward greater interoperability and sharing of resources among NASA-supported earth science and applications data systems (ESADS) are described. Recommendations made by the various panels during the 1987 ESADS Workshop are presented. The panels were concerned with directories and catalogs, data archives, data manipulation software, computational facilities, data storage media, database management, and networking. Consideration was also given to the tracking and tuning of overall development and management coordination issues.
The Isothermal Dendritic Growth Experiment (IDGE)
The Isothermal Dendritic Growth Experiment (IDGE) constituted a series of three NASA-supported microgravity experiments, all of which flew aboard the space shuttle, Columbia. This experimental space flight series was designed and operated to grow and record dendrite solidification in the absence of gravity-induced convective heat transfer, and thereby produce a wealth of benchmark-quality data for testing solidification scaling laws. The data and analysis performed on the dendritic growth speed and tip size in Succinontrie (SCN) demonstrates that although the theory yields predictions that are reasonably in agreement with experiment, there are significant discrepancies. However, some of these discrepancies can be explained by accurately describing the diffusion of heat. The key finding involves recognition that the actual three-dimensional shape of dendrites includes time-dependent side-branching and a tip region that is not a paraboloid of revolution. Thus, the role of heat transfer in dendritic growth is validated, with the caveat that a more realistic model of the dendrite then a paraboloid is needed to account for heat flow in an experimentally observed dendrite. We are currently conducting additional analysis to further confirm and demonstrate these conclusions. The data and analyses for the growth selection physics remain much less definitive. From the first flight, the data indicated that the selection parameter, sigma*, is not exactly a constant, but exhibits a slight dependence on the supercooling. Additional data from the second flight are being examined to investigate the selection of a unique dendrite speed, tip size and shape. The IDGE flight series is now complete. We are currently completing analyses and moving towards final data archiving. It is gratifying to see that the IDGE published results and archived data sets are being used actively by other scientists and engineers. In addition, we are also pleased to report that the techniques and IDGE hardware system that the authors developed with NASA, are being currently employed on both designated flight experiments, like EDSE, and on flight definition experiments, like TDSE.
Airborne Visible/Infrared Imaging Spectrometer (AVIRIS): Recent Improvements to the Sensor and Data Facility
AVIRIS operations at the Jet Propulsion Laboratory consist primarily of a sensor task and a data facility task. The sensor task is responsible for AVIRIS sensor meaintenance, laboratory calibration, and field operations. The AVIRIS data facility is responsible for data archiving, data calibration, quality monitoring and distribution. In this paper we describe recent improvements in these two primary AVIRIS tasks.
Laying The Foundations for FAIR-ER Science: ISA And LSDA Data Submission Process in NASA’s Evolving Data Management Environment
The Life Sciences Data Archive (LSDA) archives data resulting from research on the effects of spaceflight on humans and the development of countermeasures to mitigate spaceflight hazards. Archivists work with researchers to ensure that unique and high value data products and their metadata are preserved and managed to support current and future research. Currently, LSDA is updating its procedures and data submission requirements in response to the evolving data preservation environment at NASA. LSDA is implementing best practices for research data management through the establishment of clear data submission guidelines, integration of the FAIR (Findability, Accessibility, Interoperability, Reusability) principles, and use of the ISA (Investigation, Study, Assay) research metadata framework for data discoverability and transparency into the data management processes. These changes directly impact LSDA’s requirements for research data submissions. The newly revised Research Data Submission Agreement (RDSA), formerly the Data Submission Agreement (DSA), introduces ISA-compatible metadata collection standards to LSDA’s process. Adherence to LSDA’s data submission guidelines enhances the FAIR-ness of the repository’s collections for future users. This presentation will discuss (1) how submission of research data and associated metadata are impacted by current data management policies, (2) benefits of the adoption of FAIR principles and the ISA metadata framework for retrospective studies utilizing existing LSDA datasets and historic data collections, and (3) the support LSDA will provide to researchers during this transition.
A Robust, Low-Cost Virtual Archive for Science Data
Despite their expense tape silos are still often the only affordable option for petabytescale science data archives, particularly when other factors such as data reliability, floor space, power and cooling load are accounted for. However, the complexity, management software, hardware reliability and access latency of tape silos make online data storage ever more attractive. Drastic reductions in low-cost mass-market PC disk drivers help to make this more affordable (approx. 1$/GB), but are challenging to scale to the petabyte range and of questionable reliability for archival use, On the other hand, if much of the science archive could be "virtualized", i.e., produced on demand when requested by users, we would need store only a fraction of the data online, perhaps bringing an online-only system into in affordable range. Radiance data from the satellite-borne Moderate Resolution Imaging Spectroradiometer (MODIS) instrument provides a good opportunity for such a virtual archive: the raw data amount to 140 GB/day, but these are small relative to the 550 GB/day making up the radiance products. These data are routinely processed as inputs for geophysical parameter products and then archived on tape at the Goddard Earth Sciences Distributed Active Archive (GES DAAC) for distributing to users. Virtualizing them would be an immediate and signifcant reduction in the amount of data being stored in the tape archives and provide more customizable products. A prototype of such a virtual archive is being developed to prove the concept and develop ways of incorporating the robustness that a science data archive requires.