SEARCH · Engineering Papers

Results for “reprocessed data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2020

Back to the Future: Surveying the Northern Hemisphere and Reprocessing the Southern TESS Data Set

TESS launched 18 April 2018 to conduct a two-year, near all-sky survey for at least 50 small, nearby exoplanets for which masses can be ascertained and whose atmospheres can be characterized by ground- and space-based follow-on observations. TESS has completed its survey of the southern hemisphere and begun its survey of the northern hemisphere, identifying >1000 candidate exoplanets and unveiling a plethora of exciting non-exoplanet astrophysics results, such as asteroseismology, asteroids, and supernova. The TESS Science Processing Operations Center (SPOC) processes the data downlinked every two weeks to generate a range of data products hosted at the Mikulski Archive for Space Telescopes (MAST). For each sector (~1 month) of observations, the SPOC calibrates the image data for both 30-min Full Frame Images (FFIs) and up to 20,000 pre-selected 2-min target star postage stamps. Data products for the 2-min targets include simple aperture photometry and systematic error-corrected flux time series. The SPOC also conducts searches for transiting exoplanets in the 2-min data for each sector and generates Data Validation time series and associated reports for each transit-like feature identified in the search. Multi-sector searches for exoplanets are conducted periodically to discover longer period planets, including those in the James Webb Continuous Viewing Zone (CVZ), which are observed for up to one year. Starting with Sector 8, scattered light from the Earth and Moon contaminated significant portions of the data in each orbit. We have developed algorithms for automated identification of the scattered light features at the individual target level. Previously, data for all stars on a CCD affected by scattered light were manually excluded. The automated flagging will allow us to retain significantly more data for stars that are not affected by the scattered light even though it is occurring elsewhere on the CCD. We also discuss enhancements to the SPOC pipeline and the newly available FFI light curves. The TESS Mission is funded by NASA's Science Mission Directorate as an Astrophysics Explorer Mission.

Jenkins, Jon M.↗

NASA NTRS2022

An Assessment of SNPP and NOAA20 VIIRS RSB Calibration Performance in NASA SIPS Reprocessed Collection-2 L1B Data Products

Two VIIRS sensors onboard the SNPP and NOAA20 satellites have been successfully operating for over 10 and 4 years, respectively, providing the worldwide user community with high-quality imagery and radiometric measurements of the land, atmosphere, cryosphere, and oceans. This study provides a temporal radiometric stability and calibration consistency assessment of the SNPP and NOAA20 VIIRS reflective solar bands using the latest NASA SIPS C2 L1B products. Several independent vicarious approaches are used to examine the stability of SNPP VIIRS and consistency of the at-sensor reflectance between the two VIIRS instruments. These approaches include observations from simultaneous nadir overpasses, the Libya-4 desert and Dome C snow/ice sites, and deep convective clouds. The impact of existing band spectral differences on the reflectance measurements is accounted for utilizing scene-specific hyperspectral observations provided by the SCIAMACHY sensor onboard the ENVISAT platform. Results indicate that both SNPP and NOAA20 VIIRS reflectances are stable within 1% over their mission periods for all bands, except for a few bands in the visible range from SNPP VIIRS that show more upward drifts at high radiances. NOAA20 VIIRS reflectances are systematically lower than SNPP by 2 to 4% for most bands, with the exception of few short wavelength bands where it is seen to be up to 7%.

VIIRS↗

NASA NTRS2024

The CARMENES Search for Exoplanets Around M Dwarfs: Revisiting the GJ 581 Multi-Planetary System With New Doppler Measurements From CARMENES, HARPS, and HIRES

Context.GJ 581 is a nearby M dwarf known to host a packed multiple planet system composed of two super-Earths and a Neptune-mass planet. We present new orbital analyses of the GJ 581 system, utilizing recent radial velocity (RV) data obtained from the CARMENES spectrograph combined with newly reprocessed archival data from the HARPS and HIRES spectrographs. Aims.Our aim was to analyze the post-discovery spectroscopic data of GJ 581, which were obtained with CARMENES. In addition, we used publicly available HIRES and HARPS spectroscopic data to seek evidence of the known and disputed exoplanets in this system. We aimed to investigate the stellar activity of GJ 581 and update the planetary system’s orbital parameters using state-of-the-art numerical models and techniques. Methods.We performed a periodogram analysis of the available precise CARMENES, HIRES, and HARPS RVs and of stellar activity indicators. We conducted detailed orbital analyses by testing various orbital configurations consistent with the RV data. We studied the posterior probability distribution of the parameters fit to the data and we explored the long-term stability and overall orbital dynamics of the GJ 581 system. Results. We refined the orbital parameters of the GJ 581 system using the most precise and complete set of Doppler data available. Consistent with the existing literature, our analysis confirms that the system is unequivocally composed of only three planets detectable in the present data, dismissing the putative planet GJ 581 d as an artifact of stellar activity. Our N-body fit reveals that the system’s inclination is i=47.0+14.6−13.0deg, which implies that the planets could be up to 30% more massive than their previously reported minimum masses. Furthermore, we report that the GJ 581 system exhibits long-term stability, as indicated by the posterior probability distribution, characterized by secular dynamical interactions without the involvement of mean motion resonances.

Satellites↗

NASA NTRSDate not supplied

GLDAS-2 Land Surface Model Data and Data Services at NASA GES DISC

The goal of the NASA Global Land Data Assimilation System (GLDAS, https://ldas.gsfc.nasa.gov/gldas(https://ldas.gsfc.nasa.gov/gldas)) is to generate optimal fields of land surface states and fluxes by ingesting satellite- and ground-based observational data products, using advanced land surface modeling and data assimilation techniques (Rodell et al., 2004).The GLDAS dataset currently archived at and distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC, https://disc.gsfc.nasa.gov/ (https://disc.gsfc.nasa.gov/)) is GLDAS Version 2 (GLDAS-2). It contains a series of output fields from the upgraded Noah-3.6, Catchment-F2.5, and VIC-4.1.2 Land Surface Models (LSMs) in the Land Information System (LIS-V7, https://lis.gsfc.nasa.gov/ (https://lis.gsfc.nasa.gov/)). GLDAS-2 has three components:GLDAS-2.0, GLDAS-2.1, and GLDAS-2.2. GLDAS-2.0 is forced entirely with the upgraded Princeton Meteorological ForcingV2.2 Dataset and provides a temporally consistent series from 1948 through 2014. GLDAS-2.1 is forced with a combination of model and observation data, with data spanning from 2000 to the present. The GLDAS-2.2 product suite uses data assimilation(DA), whereas the GLDAS-2.0 and GLDAS-2.1 products are "open-loop" (i.e., no data assimilation). The choice of forcing data, as well as DA observation source, variable, and scheme, varies for different GLDAS-2.2 products. The currently availableGLDAS-2.2 data contain a daily 0.25-degree output from the Catchment-F2.5 LSM in LIS-V7. The data are forced with the meteorological analysis fields from the operational European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (ECMWF-IFS) and assimilated with GRACE and GRACE-FO data, ranging from February 1, 2003 to the present. The current GLDAS-2.0 and 2.1 Noah LSM data were reprocessed in November 2019 and January 2020 respectively and their data from Catchment and VIC LSMs are new to the GLDAS-2 collection. This presentation provides a summary of theGLDAS-2 data products, their land surface fields, and their related data services at the GES DISC; and a description of the majorGLDAS-2 climatological characteristics as well as the intercomparison with the data of the previous version.

Hydrology↗

NASA NTRS2016

Incorporating the TRMM Dataset into the GPM Mission Data Suite

In June 2015 the TRMM satellite came to its end. The 17 plus year of mission data that it provided has proven a valuable asset to a variety of science communities. This 17plus year data set does not, however, stagnate with the end of the mission itself. NASA/JAXA intend to integrate the TRMM data set into the data suite of the GPM mission. This will ensure the creation of a consistent, intercalibrated, accurate dataset within GPM that extends back to November of 1998. This paper describes the plans for incorporating the TRMM 17plus year data into the GPM data suite. These plans call for using GPM algorithms for both radiometer and radar to reprocess TRMM data as well as intercalibrating partner radiometers using GPM intercalibration techniques. This reprocessing will mean changes in content, logical format and physical format as well as improved geolocation, sensor corrections and retrieval techniques.

TRMM↗

DOE OSTI2018

Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey

The Gemini Planet Imager Exoplanet Survey (GPIES) is a multiyear direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines (DRPs) together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our DRPs. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizes our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2015

The Process of Bringing Dark Data to Light: The Rescue of the Early Nimbus Satellite Data

Myriad environmental satellite missions are currently orbiting the earth. The comprehensive monitoring by these sensors provide scientists, policymakers, and the public critical information on the earths weather and climate system. The state of the art technology of our satellite monitoring system is the legacy of the first environment satellites, the Nimbus systems launched by NASA in the mid-1960s. Such early data can extend our climate record and provide important context in longer-term climate changes. However, the data was stowed away and, over the years, largely forgotten. It was nearly lost before its value was recognized and attempts to recover the data were undertaken. This paper covers what it took the authors to recover, navigate and reprocess the data into modern formats so that it could be used as a part of the satellite climate record. The procedures to recover the Nimbus data, from both film and tape, could be used by other data rescue projects, however the algorithms presented will tend to be Nimbus specific. Data rescue projects are often both difficult and time consuming but the data they bring back to the science community makes these efforts worthwhile.

dark↗

DOE OSTI2023

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2018

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH4+) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH 4 + ) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2018

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH 4 + ) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH 4 + ) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1995

Recent chaqnges in the IUE spectrum of the very young planetary nebula He 3-1357 (=SAO 244567)

We obtained the first high-dispersion IUE spectrum, and an additional low-dispersion spectrum of the very young planetary nebula He 3-1357 and its central star SDAO 244567. In 1988, it showed a very strong C IV lambda-1549 P Cygni profile which diminished and has disappeared by 1994, but C IV absorptions are seen in a high-resolution spectrum. The electron density from the C III F(lambda 1907)/F(lambda 1909) emission ratio is log N(sub e) = 4.1/cc. The older IUE data were reprocessed, and emission-line fluxes vary greatly for the period 1988-1994. The high-dispersion data show a rich Fe V and Fe VI absorption spectrum.

Feibelman, Walter A.↗

NASA NTRS1986

Seven years of total ozone from the TOMS instrument - A report on data quality

Seven years of TOMS total ozone data are currently available. Recently a new ozone retrieval algorithm based on improved ozone absorption cross section was implemented that has introduced 6-7 percent discontinuity in the archived data sets at the end of the fifth year of instrument operation. Until all data are reprocessed with the new algorithm users can use a table of correction factors given in this paper to make the data set internally consistent. This paper also presents a comparison of TOMS results with Amundsen Scott Dobson station. Though the agrement in most years is good, in 1983-84 the Dobson station reported unusually high values of ozone while TOMS saw the very low ozone values associated with the Antarctica ozone hole.

Fleig, Albert J.↗

DOE OSTI2015

openPMD-viewer

Many simulation software produce data in the form of a set of field values or of a set of particle positions. (one such example is that of particle-in-cell codes, which produce data on the electromagnetic fields that they simulate.) However, each particular software uses its own particular format and layout, for the output data. This makes it difficult to compare the results of different simulation software, or to have a common visualization tool for these results. However, a standardized layout for fields and particles has recently been developed: the openPMD format ( HYPERLINK "http://www.openpmd.org/"www.openpmd.org) This format is open- source, and specifies a standard way in which field data and particle data should be written. The openPMD format is already implemented in the particle-in-cell code Warp (developed at LBL) and in PIConGPU (developed at HZDR, Germany). In this context, the proposed software (openPMD-viewer) is a Python package, which allows to access and visualize any data which has been formatted according to the openPMD standard. This package contains two main components: - a Python API, which allows to read and extract the data from a openPMD file, so as to be able to work with it within the Python environment. (e.g. plot the data and reprocess it with particular Python functions) - a graphical interface, which works with the ipython notebook, and allows to quickly visualize the data and browse through a set of openPMD files. The proposed software will be typically used when analyzing the results of numerical simulations. It will be useful to quickly extract scientific meaning from a set of numerical data.

Lehe, Remi↗

DOE OSTI2015

openPMD-viewer

Lehe, Remi↗

NASA NTRS1994

Optimizing the Galileo space communication link

The Galileo mission was originally designed to investigate Jupiter and its moons utilizing a high-rate, X-band (8415 MHz) communication downlink with a maximum rate of 134.4 kb/sec. However, following the failure of the high-gain antenna (HGA) to fully deploy, a completely new communication link design was established that is based on Galileo's S-band (2295 MHz), low-gain antenna (LGA). The new link relies on data compression, local and intercontinental arraying of antennas, a (14,1/4) convolutional code, a (255,M) variable-redundancy Reed-Solomon code, decoding feedback, and techniques to reprocess recorded data to greatly reduce data losses during signal acquisition. The combination of these techniques will enable return of significant science data from the mission.

Statman, J. I.↗

NASA NTRS1979

Data System Implications Derived from User Application Requirements for Satellite Data

An investigation of the data system needs as driven by users of space acquired Earth observation data is documented. Two major categories of users, operational and research, are identified. Limiting data acquisition alleviates some of the delays in processing thus improving timeliness of the delivered product. Trade offs occur between timeliness and data distribution costs, and between data storage and reprocessing. The complexity of the data system requirements to apply space data to users' needs is such that no single analysis suffices to design and implement the optimum system. A series of iterations is required with analyses of the salient problems in a general way, followed by a limited implementation of benefit to some users with a continual upgrade in system capacity, functions, and applications served. The resulting most important requirement for the data system is flexibility to accommodate changing requirements as the system is implemented.

Neiers, J.↗