Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Science Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Real-Time On-Board Airborne Demonstration of High-Speed On-Board Data Processing for Science Instruments (HOPS)

The project called High-Speed On-Board Data Processing for Science Instruments (HOPS) has been funded by NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) program since April, 2012. The HOPS team recently completed two flight campaigns during the summer of 2014 on two different aircrafts with two different science instruments. The first flight campaign was in July, 2014 based at NASA Langley Research Center (LaRC) in Hampton, VA on the NASA's HU-25 aircraft. The science instrument that flew with HOPS was Active Sensing of CO2 Emissions over Nights, Days, and Seasons (ASCENDS) CarbonHawk Experiment Simulator (ACES) funded by NASA's Instrument Incubator Program (IIP). The second campaign was in August, 2014 based at NASA Armstrong Flight Research Center (AFRC) in Palmdale, CA on the NASA's DC-8 aircraft. HOPS flew with the Multifunctional Fiber Laser Lidar (MFLL) instrument developed by Excelis Inc. The goal of the campaigns was to perform an end-to-end demonstration of the capabilities of the HOPS prototype system (HOPS COTS) while running the most computationally intensive part of the ASCENDS algorithm real-time on-board. The comparison of the two flight campaigns and the results of the functionality tests of the HOPS COTS are presented in this paper.

Beyon, Jeffrey Y.↗
NASA NTRS1997

MISR photogrammetric data reduction for geophysical retrievals

The theoretical concept, based on modern photogrammetric methods, underlying the design of the MISR science data processing system responsible for the autonomous and continuous georectification of multi-angle imagery is the subject of this paper.

photogrammetric↗
NASA NTRS2015

Spacecube: A Family of Reconfigurable Hybrid On-Board Science Data Processors

SpaceCube is a family of Field Programmable Gate Array (FPGA) based on-board science data processing systems developed at the NASA Goddard Space Flight Center (GSFC). The goal of the SpaceCube program is to provide 10x to 100x improvements in on-board computing power while lowering relative power consumption and cost. SpaceCube is based on the Xilinx Virtex family of FPGAs, which include processor, FPGA logic and digital signal processing (DSP) resources. These processing elements are leveraged to produce a hybrid science data processing platform that accelerates the execution of algorithms by distributing computational functions to the most suitable elements. This approach enables the implementation of complex on-board functions that were previously limited to ground based systems, such as on-board product generation, data reduction, calibration, classification, eventfeature detection, data mining and real-time autonomous operations. The system is fully reconfigurable in flight, including data parameters, software and FPGA logic, through either ground commanding or autonomously in response to detected eventsfeatures in the instrument data stream.

reconfigurable computing↗
NASA NTRS2017

Framework for Processing Citizens Science Data for Applications to NASA Earth Science Missions

Citizen science (or crowdsourcing) has drawn much high-level recent and ongoing interest and support. It is poised to be applied, beyond the by-now fairly familiar use of, e.g., Twitter for natural hazards monitoring, to science research, such as augmenting the validation of NASA earth science mission data. This interest and support is seen in the 2014 National Plan for Civil Earth Observations, the 2015 White House forum on citizen science and crowdsourcing, the ongoing Senate Bill 2013 (Crowdsourcing and Citizen Science Act of 2015), the recent (August 2016) Open Geospatial Consortium (OGC) call for public participation in its newly-established Citizen Science Domain Working Group, and NASA's initiation of a new Citizen Science for Earth Systems Program (along with its first citizen science-focused solicitation for proposals). Over the past several years, we have been exploring the feasibility of extracting from the Twitter data stream useful information for application to NASA precipitation research, with both "passive" and "active" participation by the twitterers. The Twitter database, which recently passed its tenth anniversary, is potentially a rich source of real-time and historical global information for science applications. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. Mining the Twitter stream could augment these validation programs and, potentially, help tune existing algorithms. Our ongoing work, though exploratory, has resulted in key components for processing and managing tweets, including the capabilities to filter the Twitter stream in real time, to extract location information, to filter for exact phrases, and to plot tweet distributions. The key step is to process the "precipitation" tweets to be compatible with satellite-retrieved precipitation data. These key components for processing and managing "precipitation" tweets (and additional ones to be developed) are not limited to precipitation, nor are they limited to the Twitter social medium. Indeed, to maximize the value of our work for NASA earth science programs, these components should be generalized and be part of an overall framework for processing citizen science data for science research. In this paper, we outline such a framework.

earth science satellite data↗
NASA NTRS2018

Hyperspectral Data Processing: an Opportunity for End-To-End Processing

The evolution and improvements in hyperspectral instrumentation are being matched by information technology improvements in science data processing and analysis. Research has improved techniques in both onboard and ground-based processing to support other high data volume instruments. Algorithms and hardware have evolved, permitting faster access to the observations. Cloud computing is taking the algorithms to the data. Technologies are being specifically designed to address high volume data sets and are an investment in the improvement of hyperspectral data processing.

science data processing↗
NASA NTRS1993

Multimission image processing and science data visualization

The Operational Science Analysis (OSA) Functional area supports science instrument data display, analysis, visualization and photo processing in support of flight operations of planetary spacecraft managed by the Jet Propulsion Laboratory (JPL). This paper describes the data products generated by the OSA functional area, and the current computer system used to generate these data products. The objectives on a system upgrade now in process are described. The design approach to development of the new system are reviewed, including use of the Unix operating system and X-Window display standards to provide platform independence, portability, and modularity within the new system, is reviewed. The new system should provide a modular and scaleable capability supporting a variety of future missions at JPL.

Green, William B.↗
NASA NTRS2010

NASA's Earth Observing System (EOS): Delivering on the Dream, Today and Tomorrow

This paper describes the successful operations of NASA's Earth Observing System (EOS) satellites over the past 10 years and the plans for the future. Excellent operations performance has been a key factor in the overall success of EOS. The EOS Program was conceived in the 1980s and began to take shape in the early 1990s. EOS consists of a series of satellites that study the Earth as an interrelated system. It began with the launch of Terra in December 1999, followed by Aqua in May 2002, and Aura in July 2004. A key EOS goal is to provide a long-term continuous data set to enable the science community to develop a better understanding of land, ocean, and atmospheric processes and their interactions. EOS has produced unprecedented amounts of data which are used all over the world free of charge. Mission operations have resulted in data recovery for Terra, Aqua, and Aura that have consistently exceeded mission requirements. The paper describes the ground systems and organizations that control the EOS satellites, capture the raw data, and distribute the processed science data sets. The paper further describes how operations have evolved since 1999. Examples of this evolution include (a) the implementation of new mission safety requirements for orbital debris monitoring; (b) technology upgrades to keep facilities at the state of the art; (c) enhancements to meet changing security requirements; and (d) operations management of the 2 international Earth Observing Constellations of 11 satellites known as the "Morning Constellation" and the "A-Train". The paper concludes with a view into the future based on the latest spacecraft status, lifetime projections, and mission plans.

Kelly, Angelita C.↗
NASA NTRS2017

Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

NASA's Earth Observing System (EOS) is a coordinated series of satellites for long term global observations. NASA's Earth Observing System Data and Information System (EOSDIS) is a multi-petabyte-scale archive of environmental data that supports global climate change research by providing end-to-end services from EOS instrument data collection to science data processing to full access to EOS and other earth science data. On a daily basis, the EOSDIS ingests, processes, archives and distributes over 3 terabytes of data from NASA's Earth Science missions representing over 6000 data products ranging from various types of science disciplines. EOSDIS has continually evolved to improve the discoverability, accessibility, and usability of high-impact NASA data spanning the multi-petabyte-scale archive of Earth science data products. Reviewed and approved by Chris Lynnes.

Cumulus↗
NASA NTRS2011

Fault-Tolerant, Radiation-Hard DSP

Commercial digital signal processors (DSPs) for use in high-speed satellite computers are challenged by the damaging effects of space radiation, mainly single event upsets (SEUs) and single event functional interrupts (SEFIs). Innovations have been developed for mitigating the effects of SEUs and SEFIs, enabling the use of very-highspeed commercial DSPs with improved SEU tolerances. Time-triple modular redundancy (TTMR) is a method of applying traditional triple modular redundancy on a single processor, exploiting the VLIW (very long instruction word) class of parallel processors. TTMR improves SEU rates substantially. SEFIs are solved by a SEFI-hardened core circuit, external to the microprocessor. It monitors the health of the processor, and if a SEFI occurs, forces the processor to return to performance through a series of escalating events. TTMR and hardened-core solutions were developed for both DSPs and reconfigurable field-programmable gate arrays (FPGAs). This includes advancement of TTMR algorithms for DSPs and reconfigurable FPGAs, plus a rad-hard, hardened-core integrated circuit that services both the DSP and FPGA. Additionally, a combined DSP and FPGA board architecture was fully developed into a rad-hard engineering product. This technology enables use of commercial off-the-shelf (COTS) DSPs in computers for satellite and other space applications, allowing rapid deployment at a much lower cost. Traditional rad-hard space computers are very expensive and typically have long lead times. These computers are either based on traditional rad-hard processors, which have extremely low computational performance, or triple modular redundant (TMR) FPGA arrays, which suffer from power and complexity issues. Even more frustrating is that the TMR arrays of FPGAs require a fixed, external rad-hard voting element, thereby causing them to lose much of their reconfiguration capability and in some cases significant speed reduction. The benefits of COTS high-performance signal processing include significant increase in onboard science data processing, enabling orders of magnitude reduction in required communication bandwidth for science data return, orders of magnitude improvement in onboard mission planning and critical decision making, and the ability to rapidly respond to changing mission environments, thus enabling opportunistic science and orders of magnitude reduction in the cost of mission operations through reduction of required staff. Additional benefits of COTS-based, high-performance signal processing include the ability to leverage considerable commercial and academic investments in advanced computing tools, techniques, and infra structure, and the familiarity of the science and IT community with these computing environments.

Czajkowski, David↗
NASA NTRS2004

An Overview of the James Webb Space Telescope Project

The JWST project at the GSFC is responsible for the development, launch, operations and science data processing for the James Webb Space Telescope. The JWST project is currently in phase B with its launch scheduled for August 2011. The project is a partnership between NASA, ESA and CSA. The U.S. JWST team is in place with the selection of Northrop Grumman Space Technology (NGST) as the prime contractor for the telescope and the Space Telescope Science Institute (STScI) as the mission operations and science data processing lead. This paper will provide an overview of the current JWST architecture and mission status including technology developments and risks.

Sabelhaus, Phillip A.↗
NASA NTRS2005

An Overview of the James Webb Space Telescope (JWST) Project

The JWST project at the GSFC is responsible for the development, launch, operations and science data processing for the James Webb Space Telescope. The JWST project is currently in phase B with its launch scheduled for August 2011. The project is a partnership between NASA, ESA and CSA. The U.S. JWST team is now fully in place with the selection of Northrop Grumman Space Technology (NGST) as the prime contractor for the telescope and the Space Telescope Science Institute (STScI) as the mission operations and science data processing lead. This paper will provide an overview of the current JWST architecture and mission status including technology developments and risks.

Sabelhaus, Phillip A.↗
NASA NTRS2004

An Overview of the James Webb Space Telescope (JWST) Project

The JWST project at the GSFC is responsible for the development, launch, operations and science data processing for the James Webb Space Telescope. The JWST project is currently in phase B with its launch scheduled for August 2011. The project is a partnership between NASA, ESA and CSA. The U.S. JWST team is now fully in place with the recent selection of Northrop Grumman Space Technology (NGST) as the prime contractor for the telescope and the Space Telescope Science Institute (STScI) as the mission operations and science data processing lead. This paper will provide an overview of the current JWST architecture and mission status including technology developments and risks.

Sabelhaus, Phillip A.↗
NASA NTRS1991

ATMOS data processing and science analysis methods

The atmospheric trace molecule spectroscopy (ATMOS) instrument, a high-speed Fourier transform spectrometer operating in the middle IR (2.2-16 microns), recorded more than 1500 solar spectra at about 0.0105/cm resolution during its first mission onboard the shuttle Challenger in the spring of 1985. These spectra were acquired during high-sun conditions for studies of the solar atmosphere and during low-sun conditions for studies of the earth's upper atmosphere. This paper describes the steps by which the telemetry data were converted into spectra suitable for analysis, the analysis software and methods developed for the atmospheric and solar studies, and the ATMOS data analysis facility.

Norton, Robert H.↗
NASA NTRS2008

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗
NASA NTRS1996

High Performance Input/Output for Parallel Computer Systems

The goal of our project is to study the I/O characteristics of parallel applications used in Earth Science data processing systems such as Regional Data Centers (RDCs) or EOSDIS. Our approach is to study the runtime behavior of typical programs and the effect of key parameters of the I/O subsystem both under simulation and with direct experimentation on parallel systems. Our three year activity has focused on two items: developing a test bed that facilitates experimentation with parallel I/O, and studying representative programs from the Earth science data processing application domain. The Parallel Virtual File System (PVFS) has been developed for use on a number of platforms including the Tiger Parallel Architecture Workbench (TPAW) simulator, The Intel Paragon, a cluster of DEC Alpha workstations, and the Beowulf system (at CESDIS). PVFS provides considerable flexibility in configuring I/O in a UNIX- like environment. Access to key performance parameters facilitates experimentation. We have studied several key applications fiom levels 1,2 and 3 of the typical RDC processing scenario including instrument calibration and navigation, image classification, and numerical modeling codes. We have also considered large-scale scientific database codes used to organize image data.

Ligon, W. B.↗
NASA NTRS2019

Collecting and Processing Earth Science Data Metrics at NASA ESDIS

Since the launch of Terra satellite in 1999, the number of Earth Science remote sensing data products created and distributed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS) has increased from a few hundred to nearly ten thousand. NASA's Earth Science Data and Information System (ESDIS) Metrics System (EMS) collects metrics on data ingest, archive, and distribution by its Distributed Active Archive Centers (DAACs) and the Science Investigator-led Systems (SIPS), known as Data Providers. These metrics are critical in helping NASA management as well as data producers in resource planning and gaining a wide range of knowledge of data users and data usage.EMS receives flat files, or log files of data archive, ingest, and distribution either in their raw format, such as Apache web logs, or text files of log records formatted by the Data Providers. Tens of millions of records are processed each day to extract metrics on data products, user information, distribution protocols and services, and so on. The metrics are then made available to designated parties.This presentation provides an overview of the EMS processing workflow and improvement efforts made in recent years to handle ever-increasing number of data records and new metrics requirements, discusses several key steps including mapping log records to data products and identifying user communities along with geo-distribution, and demonstrates typical metrics capabilities produced by the EMS system. Challenges and potential approaches to improve the system are also discussed.

Pan, Jianfu↗
NASA NTRS2003

The Rondonia Lightning Detection Network: Network Description, Science Objectives, Data Processing Archival/Methodology, and Results

A four station Advanced Lightning Direction Finder (ALDF) network was established in the state of Rondonia in western Brazil in 1999 through a collaboration of U.S. and Brazilian participants from NASA, INPE, INMET, and various universities. The network utilizes ALDF IMPACT (Improved Accuracy from Combined Technology) sensors to provide cloud-to-ground lightning observations (i.e., stroke/flash locations, signal amplitude, and polarity) using both time-of- arrival and magnetic direction finding techniques. The observations are collected, processed and archived at a central site in Brasilia and at the NASA/Marshall Space Flight Center in Huntsville, Alabama. Initial, non-quality assured quick-look results are made available in near real-time over the Internet. The network, which is still operational, was deployed to provide ground truth data for the Lightning Imaging Sensor (LIS) on the Tropical Rainfall Measuring Mission (TRMM) satellite that was launched in November 1997. The measurements are also being used to investigate the relationship between the electrical, microphysical and kinematic properties of tropical convection. In addition, the long-time series observations produced by this network will help establish a regional lightning climatological database, supplementing other databases in Brazil that already exist or may soon be implemented. Analytic inversion algorithms developed at the NASA/Marshall Space Flight Center have been applied to the Rondonian ALDF lightning observations to obtain site error corrections and improved location retrievals. The data will also be corrected for the network detection efficiency. The processing methodology and the results from the analysis of four years of network operations will be presented.

Blakeslee, R. J.↗
NASA NTRSDate not supplied

Mission Overview and Status IGARSS Conference

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission is a strategic climate continuity mission that was defined in the 2010 document Responding to the Challenge of Climate and Environmental Change: NASA’s Plan for Climate-Centric Architecture for Earth Observations and Applications from Space (referred to as the “Climate Initiative”). Scheduled for launch in January 2024, the PACE mission represents NASA’s next investment in ocean biology, clouds, and aerosol data records [1]. PACE will extend the high quality ocean ecological, ocean biogeochemical, cloud, and aerosol particle data records begun by NASA in the 1990s, building on the exceptional heritages of the Sea-Viewing Wide Field-of-View Sensor (SeaWiFS), the Moderate Resolution Imaging Spectroradiometer (MODIS), the Multi-angle Imaging SpectroRadiometer (MISR), and the Visible Infrared Imaging Radiometer Suite (VIIRS). The PACE project office at NASA’s GSFC is responsible for the satellite development, launch and operations. The NASA Headquarters PACE Program Science office is responsible for supporting the science data processing system and assembling competed community science teams, which will include field-based vicarious calibration and data product validation efforts to support the PACE Project Science team. The mission is planned for launch into a Sun synchronous polar orbit at 676.5 km with an inclination of 98 degrees and a 1 pm local ascending node crossing time. The PACE observatory is comprised of three instruments, an Ocean Color Instrument (OCI) and two polarimeters, the Hyper-Angular Rainbow Polarimeter 2 (HARP2) and the Spectro-Polarimeter for Exploration (SPEXone). The OCI is the primary instrument on the observatory and is being developed at Goddard Space Flight Center (GSFC). The OCI is a hyperspectral scanning radiometer designed to measure spectral radiances from the ultraviolet to shortwave infrared (SWIR) to enable advanced ocean color and heritage cloud and atmospheric aerosol science [2]. The HARP2 and SPEXone are complimentary instruments on the PACE observatory, acquired outside of GSFC. The HARP2 is multi-spectral, wide swath (supporting atmospheric correction of OCI), and hyper-angular, with capabilities for cloud science that exceed what is capable from OCI alone. The SPEXone is narrow swath, multi-angular, and hyperspectral, with capabilities for atmospheric aerosol science that exceed what can be accomplished with OCI. NASA Headquarters directed the mission development to be guided by a Design-to-Cost (DTC) process. All elements of the mission, other than the cost, are in the DTC trade space. At the heart of the DTC process are the mission studies, performed across all the mission elements. The mission studies were used to define appropriate approaches within and across elements while maximizing science capabilities at a high cost confidence. Mission baseline requirements development is also embedded within the DTC process, as these requirements were not established at the onset of the mission concept development. Baseline mission requirements are a product of the mission studies and are defined by the project office as part of the DTC process. At the time of this writing, OCI, HARP2 and SPEXone are integrated onto the PACE spacecraft, creating the PACE observatory. The instruments and spacecraft subsystems are undergoing combined functional performance testing in preparation for observatory-level environmental testing prior to shipment to the launch site. Here, we will provide an update on science capabilities and observatory readiness for its early 2024 launch.

remote sensing↗