Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reprocessed data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Use of Reference Frames for Interplanetary Navigation at JPL

Navigation of interplanetary spacecraft is typically based on range, Doppler, and differential interferometric measurements made by ground-based telescopes. Acquisition and interpretation of these observations requires accurate knowledge of the terrestrial reference frame and its orientation with respect to the celestial frame. Work is underway at JPL to reprocess historical VLBI and GPS data to improve realizations of the terrestrial and celestial frames. Improvements include minimal constraint alignment, improved tropospheric modeling, better orbit determination, and corrections for antenna phase center patterns.

International Celestial Reference Frame (ICRF)↗

Improving IPATS Channel-to-Channel Registration Assessment

The Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) is a primary tool for assessing INR performance of GOES-R series ABI images. IPATS assesses five INR metrics: navigation, channel-to-channel registration (CCR), frame-to-frame registration, within-frame registration, and swath-to-swath registration. It was discovered that CCR assessment results between Visible-Near-Infrared (VNIR) channels and Infrared (IR) channels exhibits an annual oscillation in the north-south (NS) direction and a diurnal oscillation in the east-west (EW) direction, with an amplitude of approximately 5 μrad and 2.5 μrad, respectively. However, differences of navigation assessment results between VNIR and IR channels do not exhibit the annual or diurnal oscillations observed in CCR results. This indicates that the observed oscillations are due to measurement errors. The characteristics of the oscillations imply that cloud shadows are a possible cause of these measurement errors. In this study, several methods are explored to minimize the impact of cloud shadows on VNIR to IR CCR assessments: a) assessment at landmark locations only; b) using navigation assessment results to filter CCR assessments; c) using the ABI clear-sky-ratio product as a cloud mask; and d) smaller CCR assessment windows. In this paper, each method and a combination of several methods are evaluated based on assessment accuracy and the number of successful assessments. The selected approach is then used to reprocess GOES-16 ABI CCR data to show reductions in the annual and diurnal measurement error oscillations.

INR↗

Space station data flow

The results of the space station data flow study are reported. Conceived is a low cost interactive data dissemination system for space station experiment data that includes facility and personnel requirements and locations, phasing requirements and implementation costs. Each of the experiments identified by the operating schedule is analyzed and the support characteristics identified in order to determine data characteristics. Qualitative and quantitative comparison of candidate concepts resulted in a proposed data system configuration baseline concept that includes a data center which combines the responsibility of reprocessing, archiving, and user services according to the various agencies and their responsibility assignments. The primary source of data is the space station complex which provides through the Tracking Data Relay Satellite System (TDRS) and by space shuttle delivery data from experiments in free flying modules and orbiting shuttles as well as from the experiments in the modular space station itself.

Source record↗

The Historical Greenland Climate Network (GC-Net) Curated and Augmented Level-1 Dataset

The Greenland Climate Network (GC-Net) consists of 31 automatic weather stations (AWSs) at 30 sites across the Greenland Ice Sheet. The first site was initiated in 1990, and the project has operated almost continuously since 1995 under the leadership of the late Konrad Steffen. The GC-Net AWS measured air temperature, relative humidity, wind speed, atmospheric pressure, downward and reflected shortwave irradiance, net radiation, and ice and firn temperatures. The majority of the GC-Net sites were located in the ice sheet accumulation area (17 AWSs), while 11 AWSs were located in the ablation area, and two sites (three AWSs) were located close to the equilibrium line altitude. Additionally, three AWSs of similar design to the GC-Net AWS were installed by Konrad Steffen's team on the Larsen C ice shelf, Antarctica. After more than 3 decades of operation, the GC-Net AWSs are being decommissioned and replaced by new AWSs operated by the Geological Survey of Denmark and Greenland (GEUS). Therefore, making a reassessment of the historical GC-Net AWS data is necessary. We present a full reprocessing of the historical GC-Net AWS dataset with increased attention to the filtering of erroneous measurements, data correction and derivation of additional variables: continuous surface height, instrument heights, surface albedo, turbulent heat fluxes, and 10 m ice and firn temperatures. This new augmented GC-Net level-1 (L1) AWS dataset is now available at https://doi.org/10.22008/FK2/VVXGUT (Steffen et al., 2023) and will continue to be refined. The processing scripts, latest data and a data user forum are available at https://github.com/GEUS-Glaciology-and-Climate/GC-Net-level-1-data-processing (last access: 30 November 2023). In addition to the AWS data, a comprehensive compilation of valuable metadata is provided: maintenance reports, yearly pictures of the stations and the station positions through time. This unique dataset provides more than 320 station years of high-quality atmospheric data and is available following FAIR (findable, accessible, interoperable, reusable) data and code practices.

Greenland Climate Network↗

Review of on-line and near real-time spectroscopic monitoring of processes relevant to nuclear material management

Spectroscopic chemometric based on-line monitoring of used nuclear fuel (UNF) reprocessing solutions and characterization of legacy nuclear waste (LNW) stored at Hanford is discussed in this manuscript. Using on-line and near real-time monitoring with spectroscopy, as opposed to traditional off-line monitoring, can significantly reduce the cost, risk and improve the efficiency of characterizing UNF reprocessing streams and LNW since the data can be collected non-destructively and analyzed nearly instantly. It can accurately quantify and qualify nuclear material in near-real time which can help to know the immediate UNF reprocessing stream and LNW conditions and detect the diversion of materials. The ability to be applied in a real reprocessing plant and in an actual Hanford waste tank/transfer pipe has been demonstrated by applying this technique to accurately quantify analytes in real UNF streams and LNW samples. Furthermore, the future development of spectroscopy based on-line monitoring is also discussed in this manuscript.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

TESS Science Processing Operations Center Pipeline Status and Updates

The past eighteen months have seen a number of important changes for the TESS Science Processing Operations Center (SPOC) and our archival data products as TESS embarked upon its first extended mission. First, the SPOC developed and deployed a new 20-sec cadence pipeline, promising to unveil exciting new astrophysics at these short timescales for up to 1000 targets per observing sector. We also developed an FFI light curve pipeline that creates light curves and associated data products for up to 160,000 targets in each sector and archive these as High-Level Science Products (HLSP) at the Mikulski Archive for Space Telescopes (MAST). Soon we plan to perform transiting planet searches on these light curves and to release Data Validation reports and associated data products to the MAST. We also present results from the first multi-year transiting planet search of sectors 1 through 36. Finally, we discuss major changes to the SPOC pipeline that motivated the reprocessing of the first year of data, including the application of target-and cadence-specific scattered light flags, and an update to the sky background correction algorithm to mitigate bias in the original algorithm for dim and/or severely crowded stars.

TESS↗

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Explore Information Content Efficiently from Current and Future Hyperspectral Satellite Missions using a Spectral Fingerprinting Method

Hyperspectral remote sensors from current and future missions provide measurements of the Top of Atmosphere (TOA) radiance or reflectance spectra with high information content. For example, the Atmospheric Infrared Sounder (AIRS), together with the Cross-track Infrared Sounder (CrIS), and the Infrared Atmospheric Sounding Interferometer (IASI) have provided more than 20 years radiance measurements with thousands of spectral channels. These measurements will be continued for the next two decades with the same or more advanced hyperspectral sensors. The upcoming missions such as NASA’s CLARREO Pathfinder (CPF) and ESA’s TRUTHS will provide unprecedented accurate TOA hyperspectral radiance measurements in solar spectral region. Traditional ways to derive Climate Data Records (CDRs) from these measurements are performing spatial and temporal averages of the retrieved Level-2 products. However, it is a time-consuming process to generate decades of Level-2 data from Level-1 data. Furthermore, the differences in Level-2 algorithms used for different satellite sensors will introduce errors in derived CDRs. In this presentation, we will describe a spectral fingerprinting method to generate high-quality CDRs directly from spatiotemporally averaged Level-1 data. By using consistent radiative kernels which contain the spectral information of various atmospheric and surface CDRs, we can reduce the errors due to algorithm inconsistency. Additionally, the spectral fingerprinting method reduces the time needed to generate CDRs by more than three orders of magnitude. This makes it easy to reprocess CDRs once the Level-1 data from different satellites have been improved via either re-calibrations or inter-satellite calibrations. We will present results of applying spectral fingerprinting method to 20-years of AIRS and CrIS data. The resulting CDRs include: 1) vertical profiles of atmospheric temperature and water vapor, 2) cloud properties such as optical depth, effective size, and height, 3) vertical profiles or column amounts for atmospheric trace gases such as O3 and CO, and 4) surface emissivity spectra and skin temperatures. These CDRs will be publicly available at NASA GES DISC in late 2024. The same fingerprinting method is planned to be applied to future CPF and TRUTHS data for solar spectral region.

hyperspectral remote sensing↗

Climatology 2011: An MLS and Sonde Derived Ozone Climatology for Satellite Retrieval Algorithms

The ozone climatology used as the a priori for the version 8 Solar Backscatter Ultraviolet (SBUV) retrieval algorithms has been updated. The Microwave Limb Sounder (MLS) instrument on Aura has excellent latitude coverage and measures ozone daily from the upper troposphere to the lower mesosphere. The new climatology consists of monthly average ozone profiles for ten degree latitude zones covering pressure altitudes from 0 to 65 km. The climatology was formed by combining data from Aura MLS (2004-2010) with data from balloon sondes (1988-2010). Ozone below 8 km (below 12 km at high latitudes) is based on balloons sondes, while ozone above 16 km (21 km at high latitudes) is based on MLS measurements. Sonde and MLS data are blended in the transition region. Ozone accuracy in the upper troposphere is greatly improved because of the near uniform coverage by Aura MLS, while the addition of a large number of balloon sonde measurements improves the accuracy in the lower troposphere, in the tropics and southern hemisphere in particular. The addition of MLS data also improves the accuracy of climatology in the upper stratosphere and lower mesosphere. The revised climatology has been used for the latest reprocessing of SBUV and TOMS satellite ozone data.

McPeters, Richard D.↗

A parallel data management system for large-scale NASA datasets

The past decade has experienced a phenomenal growth in the amount of data and resultant information generated by NASA's operations and research projects. A key application is the reprocessing problem which has been identified to require data management capabilities beyond those available today (PRAT93). The Intelligent Information Fusion (IIF) system (ROEL91) is an ongoing NASA project which has similar requirements. Deriving our understanding of NASA's future data management needs based on the above, this paper describes an approach to using parallel computer systems (processor and I/O architectures) to develop an efficient parallel database management system to address the needs. Specifically, we propose to investigate issues in low-level record organizations and management, complex query processing, and query compilation and scheduling.

Srivastava, Jaideep↗

Validation of GOSAT Data Products; Interim Report on the GOSAT/TANSO Project

The Orbiting Carbon Observatory-2 (OCO-2) Team has continued working closely with the Greenhouse Gases Observing Satellite (GOSAT) team to (i) conduct vicarious calibration experiments in Railroad Valley, NV, U.S.A., (ii) retrieve estimates of X CO2 from OCO-2 and GOSAT TANSO-FTS data, and (iii) validate these products using internationally recognized standards. The OCO-/GOSAT relationship was reinforced in March 2015 with the signing a new Memorandum of Understanding between NASA and the GOSAT and GOSAT-2 partners. Over the past year, while the GOSAT team has been finalizing the V201 product, the OCO-2 team has focused primarily on the delivery of the OCO-2 product, providing new opportunities for cross calibration of the OCO-2 and GOSAT instruments and cross validation of their products. These efforts are just now producing results. Members of the OCO-2 team have also continued the analysis of the GOSAT V161.161 data and the ACOS B3.5 products. Those efforts have produced 2 new refereed publications and several others in review. The OCO-2 now preparing to reprocess the entire GOSAT TANSO-FTS data record using the GOSAT V201 product and OCO-2 B7 algorithm to produce a 7-year, multi-satellite climate data record for X(sub CO2).

Wennberg, Paul↗

Evaluation of MODIS and VIIRS Cloud-Gap-Filled Snow-Cover Products for Production of an Earth Science Data Record

MODerate resolution Imaging Spectroradiometer (MODIS) cryosphere products have been available since 2000 – following the 1999 launch of the Terra MODIS and the 2002 launch of the Aqua MODIS – and include global snow-cover extent (SCE) (swath, daily, and 8 d composites) at 500 m and ∼5 km spatial resolutions. These products are used extensively in hydrological modeling and climate studies. Reprocessing of the complete snow-cover data record, from Collection 5 (C5) to Collection 6 (C6) and Collection 6.1 (C6.1), has provided improvements in the MODIS product suite. Suomi National Polar-orbiting Partnership (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) Collection 1 (C1) snow-cover products at a 375 m spatial resolution have been available since 2011 and are currently being reprocessed for Collection 2 (C2). Both the MODIS C6.1 and the VIIRS C2 products will be available for download from the National Snow and Ice Data Center beginning in early 2020 with the complete time series available in 2020. To address the need for a cloud-reduced or cloud-free daily SCE product for both MODIS and VIIRS, a daily cloud-gap-filled (CGF) snow-cover algorithm was developed for MODIS C6.1 and VIIRS C2 processing. MOD10A1F (Terra) and MYD10A1F (Aqua) are daily, 500 m resolution CGF SCE map products from MODIS. VNP10A1F is the daily, 375 m resolution CGF SCE map product from VIIRS. These CGF products include quality-assurance data such as cloud-persistence statistics showing the age of the observation in each pixel. The objective of this paper is to introduce the new MODIS and VIIRS standard CGF daily SCE products and to provide a preliminary evaluation of uncertainties in the gap-filling methodology so that the products can be used as the basis for a moderate-resolution Earth science data record (ESDR) of SCE. Time series of the MODIS and VIIRS CGF products have been developed and evaluated at selected study sites in the US and southern Canada. Observed differences, although small, are largely attributed to cloud masking and differences in the time of day of image acquisition. A nearly 3-month time-series comparison of Terra MODIS and S-NPP VIIRS CGF snow-cover maps for a large study area covering all or parts of 11 states in the western US and part of southwestern Canada reveals excellent correspondence between the Terra MODIS and S-NPP VIIRS products, with a mean difference of 11 070 sqkm, which is ∼0.45 % of the study area. According to our preliminary validation of the Terra and Aqua MODIS CGF SCE products in the western US study area, we found higher accuracy of the Terra product compared with the Aqua product. The MODIS CGF SCE data record beginning in 2000 has been extended into the VIIRS era, which should last at least through the early 2030s.

Hall, Dorothy K.↗

Seasonal and interannual variations in total ozone revealed by the Nimbus-4 backscattered ultraviolet experiment

The first two years of Backscattered Ultraviolet (BUV) ozone data from the Nimbus-4 spacecraft were reprocessed. The seasonal variations of total ozone for the period April 1970 to April 1972 are described using daily zonal means to 10 deg latitude zones and a time-latitude cross section. In addition, the BUV data are compared with analyzed Dobson data and with IRIS data also obtained from the Nimbus-4 spacecraft. A harmonic analysis was performed on the daily zonal means. Amplitudes, days of peaks, and percentage of variance were computed for annual and semi-annual waves and for higher harmonics of an annual period for the two years. Asymmetries are found in the annual waves in the two hemispheres, with a subtle interannual difference which may be due to changes in the general circulation. A significant semi-annual component is detected in the tropics for the first year, which appears to result from influences of the annual waves in the two hemispheres.

Hilsenrath, E.↗

Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory

The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will image the entire southern sky every three to four days and produce tens of petabytes of raw image data and associated calibration data over the course of the experiment’s run. More than 20 terabytes of data must be stored every night, and annual campaigns to reprocess the entire dataset since the beginning of the survey will be conducted over ten years. The Production and Distributed Analysis (PanDA) system was evaluated by the Rubin Observatory Data Management team and selected to serve the Observatory’s needs due to its demonstrated scalability and flexibility over the years, for its Directed Acyclic Graph (DAG) support, its support for multi-site processing, and its highly scalable complex workflows via the intelligent Data Delivery Service (iDDS). PanDA is also being evaluated for prompt processing where data must be processed within 60 seconds after image capture. This paper will briefly describe the Rubin Data Management system and its Data Facilities (DFs). Finally, it will describe in depth the work performed in order to integrate the PanDA system with the Rubin Observatory to be able to run the Rubin Science Pipelines using PanDA.

79 ASTRONOMY AND ASTROPHYSICS↗

Regression Analysis of Long-term Profile Ozone Data Set from BUV Instruments

We have produced a profile merged ozone data set (MOD) based on the SBUV/SBUV2 series of nadir-viewing satellite backscatter instruments, covering the period from November 1978 - December 2003. In 2004, data from the Nimbus 7 SBUV and NOAA 9,11, and 16 SBUV/2 instruments were reprocessed using the Version 8 (V8) algorithm and most recent calibrations. More recently, data from the Nimbus 4 BUV instrument, which operated from 1970 - 1977, were also reprocessed using the V8 algorithm. As part of the V8 profile calibration, the Nimbus 7 and NOAA 9 (1993-1997 only) instrument calibrations have been adjusted to match the NOAA 11 calibration, which was established from comparisons with SSBUV shuttle flight data. Given the level of agreement between the data sets, we simply average the ozone values during periods of instrument overlap to produce the MOD profile data set. We use statistical time-series analysis of the MOD profile data set (1978-2003) to estimate the change in profile ozone due to changing stratospheric chlorine levels. The Nimbus 4 BUV data offer an opportunity to test the physical properties of our statistical model. We extrapolate our statistical model fit backwards in time and compare to the Nimbus 4 data. We compare the statistics of the residuals from the fit for the Nimbus 4 period to those obtained from the 1978-2003 period over which the statistical model coefficients were estimated.

Frith, Stacey↗

A spectroscopic study of the extreme black widow PSR J1311–3430

We report on a series of spectroscopic observations of PSR J1311–3430, an extreme black-widow gamma-ray pulsar with a helium-star companion. In a previous study we estimated the neutron star mass as M{sub NS}=2.68±0.14 M{sub ⊙} (statistical error), based on limited spectroscopy and a basic (direct heating) light-curve model; however, much larger model-dependent systematics dominate the mass uncertainty. Our new spectroscopy reveals a range of complex source behavior. The variable He i companion wind emission lines can dominate broadband photometry, especially in red filters or near minimum brightness, and the wind flux should complete companion evaporation in a spin-down time. The heated companion face also undergoes dramatic flares, reaching ∼40,000 K over ∼20% of the star; this is likely powered by a magnetic field generated in the companion. The companion center-of-light radial velocity is now well measured with K{sub CoL}=615.4±5.1 km s{sup −1}. We detect non-sinusoidal velocity components due to the heated face flux distribution. Using our spectra to excise flares and wind lines, we generate substantially improved light curves for companion continuum fitting. We show that the inferred inclination and neutron star mass, however, remain sensitive to the poorly constrained heating pattern. The neutron star’s mass, M{sub NS}, is likely less than the direct heating value and could range as low as 1.8 M{sub ⊙} for extreme equatorial heating concentration. While we cannot yet pin down M{sub NS}, our data imply that an intrabinary shock reprocesses the pulsar emission and heats the companion. Improved spectra and, especially, models that include such shock heating are needed for precise parameter measurement.

79 ASTRONOMY AND ASTROPHYSICS↗

Structural Evolution of the Hogback Monocline and Its Tectonic Significance in the San Juan Basin

The San Juan Basin is recognized as a Laramide foreland basin. It is located within the Colorado Plateau, a broad tectonic province characterized by a thick sedimentary sequence that was segmented into smaller sub basins during the Late Cretaceous to Paleogene Laramide orogeny. The Hogback Monocline lies along the northwestern margin of the San Juan Basin and is considered a Laramide-age structure formed in response to compressional stress. In this study, we interpret surface and subsurface datasets to construct a structural geological model and evaluate its tectonic significance. Through seismic data, we identify key fault and fold geometries at depth. The seismic dataset used in this study was reprocessed in depth and constrained with well log velocity data to enhance seismic imaging quality. Additionally, we performed well log correlations to identify formation tops and assess variations in basin infill and thickness geometry. A series of structural cross-sections, constructed using seismic data and a high density of boreholes, are presented to evaluate geometric variations along the structure and its evolution during basin development. Furthermore, kinematic restoration and forward modeling analyses were conducted to validate our structural interpretation. This work suggests that the Hogback Monocline formed through fault-propagation folding and flexural slip affecting the pre-Laramide sedimentary sequence under compressional stresses associated with the Laramide orogeny. This structure is interpreted as a high-angle reverse fault that influenced the geometry of the late basin infill. Additionally, monocline bending along the structure may have been controlled by fault relay systems and, in some cases, influenced by strike-slip faulting.

Reyes, Martin [New Mexico Bureau o fGeology and Mi↗

Long fading mid-infrared emission in transient coronal line emitters: dust echo of a tidal disruption flare

The sporadic accretion following the tidal disruption of a star by a super-massive black hole (TDE) leads to a bright UV and soft X-ray flare in the galactic nucleus. The gas and dust surrounding the black hole responses to such a flare with an echo in emission lines and infrared emission. In this paper, we report the detection of long fading mid-IR emission lasting up to 14 years after the flare in four TDE candidates with transient coronal lines using the WISE public data release. We estimate that the reprocessed mid-IR luminosities are in the range between 4×10{sup 42} and 2×10{sup 43} erg s{sup −1} and dust temperature in the range of 570–800 K when WISE first detected these sources three to five years after the flare. Both luminosity and dust temperature decrease with time. We interpret the mid-IR emission as the infrared echo of the tidal disruption flare. We estimate the UV luminosity at the peak flare to be 1 to 30 times 10{sup 44} erg s{sup −1} and that for warm dust masses to be in the range of 0.05–1.3 M{sub ⊙} within a few parsecs. Our results suggest that the mid-infrared echo is a general signature of TDE in the gas-rich environment.

79 ASTRONOMY AND ASTROPHYSICS↗