Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data corruption”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

TOGA/COARE AMMR 1992 data processing

The complete set of Tropical Ocean and Global Atmosphere (TOGA)/Coupled Ocean Atmosphere Response Experiment (COARE) flight data for the 91.65 GHz Airborne Meteorological Radiometer (AMMR92) contains data from nineteen flights: two test flights, four transit flights, and thirteen experimental flights. The data flight occurred between December 16, 1992 and February 28, 1993. Data collection from the AMMR92 during the first ten flights of TOGA/COARE was performed using the executable code TSK30041. These are IBM PC/XT programs used by the NASA Goddard Space Flight Center (GSFC). During one flight, inconsistencies were found during the operation of the AMMR92 using the GSFC data acquisition system. Consequently, the Georgia Tech (GT) data acquisition system was used during all successive TOGA/COARE flights. These inconsistencies were found during the data processing to affect the recorded data as well. Errors are caused by an insufficient pre- and post-calibration setting period for the splash-plate mechanism. The splash-plate operates asynchronusly with the data acquisition system (there is no position feedback to the GSFC or GT data system). This condition caused both the calibration and the post-calibration scene measurement to be corrupted on a randomly occurring basis when the GSFC system was used. This problem did not occur with the GT data acquisition system due to sufficient allowance for splash-plate settling. After TOGA/COARE it was determined that calibration of the instrument was a function of the scene brightness temperature. Therefore, the orientation error in the main antenna beam of the AMMR92 is hypothesized to be caused by misalignment of the internal 'splash-plate' responsible for directing the antenna beam toward the scene or toward the calibration loads. Misalignment of the splash-plate is responsible for 'scene feedthrough' during calibration. Laboratory investigation at Georgia Tech found that each polarization is affected differently by the splash-plate alignment error. This is likely to cause significant and unique errors in the absolute calibration of each channel.

Kunkee, D. B.↗

Asi Nuclear Energy Sensors Data Portal Chatbot And Data Structuring Tool

The Idaho National Laboratory (INL) is advancing the development of an AI-powered chatbot and data structuring tool specifically designed to accelerate data mining processes for sensor-related information and seamlessly integrate the results into the ASI Sensors Data Portal (https://nes.energy.gov/). By doing so, the software aims to enhance the accessibility, usability, and organization of sensor data for nuclear energy applications. The software initial phase focuses on retrieving comprehensive datasets, prioritizing the past five years of publicly available information from the Office of Scientific and Technical Information (OSTI). These datasets will be meticulously processed to ensure compatibility, employing cleaning and preprocessing steps to eliminate irrelevant, incomplete, or corrupted information, thus establishing a robust foundation for subsequent AI use. The data will serve as the backbone for training an AI model and chatbot, which will act as an interactive tool enabling users to ask complex, context-specific questions and receive accurate, validated answers derived from constrained literature. In parallel, the project incorporates a data structuring process supported by AI to organize sensor information from multiple sources into a standardized format. This structured data will include detailed sensor specifications, such as measurement range, applications, accuracy, and operating conditions, generated and documented with AI. These specifications will be systematically integrated into the sensor portal. To maintain the highest levels of accuracy and relevance, all AI-generated outputs will be reviewed and validated by subject matter experts (SMEs), with additional fields or parameters added as needed. Future stages of the project aim to expand the dataset beyond OSTI to include other sources and potentially incorporate unclassified controlled information (UCI) with restricted access protocols to address security and confidentiality requirements.

Mapes, NormanJ. [Idaho National Laboratory (INL), ↗

Autonomous Navigation with Ground-to-Space Doppler Measurements Referenced to a Temperature-Compensated Crystal Oscillator

The National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) has spent several years developing operational Onboard Navigation Systems (ONS's) to provide real-time autonomous, high-accuracy navigation products for spacecraft using NASA's space and ground communication systems. The highly successful Tracking and Data Relay Satellite System (TDRSS) ONS (TONS) experiment on the Explorer Platform/Extreme Ultraviolet Explorer (EP/EUVE) spacecraft, launched June 7, 1992, flight-demonstrated the ONS for high-accuracy navigation using TDRSS forward- link communications services, In late 1994, the ground station ONS (GONS) experiment, using the same EP/EUVE flight hardware, flight-demonstrated the feasibility of high-accuracy autonomous navigation using ground station forward-link communication services, with an ultrastable oscillator (USO) as the frequency reference (1 part in 10(exp 10) over 24 hours). This paper provides a follow-on analysis of GONS performance to assess the navigation accuracy achievable if GONS uses the significantly less stable (5 parts in 10(exp 8) over 24 hours, compared with a specification of 1 part in 10(exp 6)) Temperature-Compensated Crystal Oscillator (TCXO), which is integral to the transponder, as a frequency reference rather than an external USO. The GONS TCXO experiment results from a 20-day period are used to project the expected performance of an operational system. The GONS processes Doppler data derived from nominally scheduled ground station forward-link communication services using a sequential estimation algorithm enhanced by a sophisticated process noise model to provide onboard orbit and frequency determination. To evaluate the navigation accuracies achievable if a TCXO were used, actual experiment data (which used the USO as the frequency reference) were corrupted with errors from real TDRSS one-way return tracking measurements taken from EP/EUVE's TCXO. Analysis of the GONS TCXO experiment performance indicates that real-time onboard position accuracies of better than 300 meters (1 sigma) are achievable with as few as two tracking contacts per day for the EP/EUVE 525-kilometer altitude, 28.5-degree inclination orbit, provided the TCXO is as stable as that in EP/EUVE's TDRSS transponder. GONS using a TCXO frequency reference provides a viable option for many upcoming spacecraft missions with moderate position accuracy requirements and an interest in reducing their operational costs with autonomous navigation.

Radomski, M. S.↗

Multi-reference evaluation of uncertainty in earth orientation parameter measurements

Uncertainties in polar motion and length-of-day measurements are evaluated empirically using several data series from the space-geodetic techniques of the global positioning system (GPS), satellite laser ranging (SLR), and very long baseline interferometry (VLBI) during 1997-2002. In the evaluation procedure employed here, known as the three-corner hat (TCH) technique, the signal common to each series is eliminated by forming pair-wise differences between the series, thus requiring no assumed values for the 'truth' signal. From the variances of the differenced series, the uncertainty of each series can be recovered when reasonable assumptions are made about the correlations between the series. In order to form the pair-wise differences, the series data must be given at the same epoch. All measurement data sets studied here were sampled at noon (UTC); except for the VLBI series, whose data are interpolated to noon and whose UT1 values are also numerically differentiated to obtain LOD. The numerical error introduced to the VLBI values by the interpolation and differentiation is shown to be comparable in magnitude to the values determined by the TCH method for the uncertainties of the VLBI series. The TCH estimates for the VLBI series are corrupted by such numerical errors mostly as a result of the relatively large data intervals. Of the remaining data sets studied here, it is found that the IGS Final combined series has the smallest polar motion and length-of-day uncertainties.

Combination↗

Bottom Pressure Tides Along a Line in the Southeast Atlantic Ocean and Comparisons with Satellite Altimetry

Seafloor pressure records, collected at 11 stations aligned along a single ground track of the Topex/Poseidon and Jason satellites, are analyzed for their tidal content. With very low background noise levels and approximately 27 months of high-quality records, tidal constituents can be estimated with unusually high precision. This includes many high-frequency lines up through the seventh-diurnal band. The station deployment provides a unique opportunity to compare with tides estimated from satellite altimetry, point by point along the satellite track, in a region of moderately high mesoscale variability. That variability can significantly corrupt altimeter-based tide estimates, even with 17 years of data. A method to improve the along-track altimeter estimates by correcting the data for nontidal variability is found to yield much better agreement with the bottom-pressure data. The technique should prove useful in certain demanding applications, such as altimetric studies of internal tides.

Ray, Richard D.↗

A design for a new catalog manager and associated file management for the Land Analysis System (LAS)

Due to the larger number of different types of files used in an image processing system, a mechanism for file management beyond the bounds of typical operating systems is necessary. The Transportable Applications Executive (TAE) Catalog Manager was written to meet this need. Land Analysis System (LAS) users at the EROS Data Center (EDC) encountered some problems in using the TAE catalog manager, including catalog corruption, networking difficulties, and lack of a reliable tape storage and retrieval capability. These problems, coupled with the complexity of the TAE catalog manager, led to the decision to design a new file management system for LAS, tailored to the needs of the EDC user community. This design effort, which addressed catalog management, label services, associated data management, and enhancements to LAS applications, is described. The new file management design will provide many benefits including improved system integration, increased flexibility, enhanced reliability, enhanced portability, improved performance, and improved maintainability.

Greenhagen, Cheryl↗

Enhancing the Cassini Mission Through FP Applications After Launch

Although rigorous pre-emptive measures are taken to preclude failures and anomalous conditions from occurring in JPL spacecraft missions prior to launch, unforeseeable problems can still surface after liftoff. In the case of the Cassini/Huygens Mission-to-Saturn spacecraft, several problems were observed post-launch: 1) immediately after takeoff, the collected engineering/science data stored on the Solid State Recorders (SSR) contained a significantly higher number of corrupted bits than was expected (considerably over spec) due to human error in the memory mapping of these devices, 2) numerous Solid State Power Switches (SSPS) sporadically tripped off throughout the mission due to cosmic ray bombardment from the unique space environment, and 3) false assumptions in the pressure regulator design in combination with missing heritage test data led to inaccurate design conclusions, causing the issuance of two waivers for the regulator to close properly (a potentially mission catastrophic single-point failure which occurred 24 days after launch) - amongst other problems. For Cassini, some of these anomalies led to arduous work-arounds or required continuous monitoring of telemetry variables by the ground-based Spacecraft Operations Flight Support (SOFS) team in order to detect and fix fault occurrences as they happened. Fortunately, sufficient funding and schedule margin allowed several Fault Protection (FP) solutions to be implemented into post-launch Flight Software (FSW) uploads to help resolve these issues autonomously, reducing SOFS ground support efforts while improving anomaly recovery time in order to preserve maximum science capture. This paper details the FP applications used to resolve the above issues as well as to optimize solutions for several other problems experienced by the Cassini spacecraft during its fight, in order to enhance the spacecraft's overall mission success throughout the 18 years of its 20 year expedition to and within the Saturnian system.

fault protection↗

Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks [Scargle 1998]-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piece- wise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by [Arias-Castro, Donoho and Huo 2003]. In the spirit of Reproducible Research [Donoho et al. (2008)] all of the code and data necessary to reproduce all of the figures in this paper are included as auxiliary material.

signal detection↗

Communication system with adaptive noise suppression

A signal-to-noise ratio dependent adaptive spectral subtraction process eliminates noise from noise-corrupted speech signals. The process first pre-emphasizes the frequency components of the input sound signal which contain the consonant information in human speech. Next, a signal-to-noise ratio is determined and a spectral subtraction proportion adjusted appropriately. After spectral subtraction, low amplitude signals can be squelched. A single microphone is used to obtain both the noise-corrupted speech and the average noise estimate. This is done by determining if the frame of data being sampled is a voiced or unvoiced frame. During unvoiced frames an estimate of the noise is obtained. A running average of the noise is used to approximate the expected value of the noise. Spectral subtraction may be performed on a composite noise-corrupted signal, or upon individual sub-bands of the noise-corrupted signal. Pre-averaging of the input signal's magnitude spectrum over multiple time frames may be performed to reduce musical noise.

Kozel, David↗

General Solution for Theoretical Packet Data Loss Rate

Communications systems which transfer blocks ("frames") of data must use a marker ("frame synchronization pattern") for identifying where a block begins. A technique ("frame synchronization strategy") is used to locate the start of each frame and maintain synchronization as additional blocks are processed. A device which strips out the frame synchronization pattern [FSP] and provides an "end of frame" pulse is called a frame synchronizer. As clock and data errors are introduced into the system, the start-of-block marker becomes displaced and/or corrupted. The capability of the frame synchronizer to stay locked to the pattern under these conditions is a figure of merit for the frame synchronization strategy. It is important to select a strategy which will stay locked nearly all the time at bit error rates where the data is usable. ("Bit error rate" [BER] is the fraction of binary bits which are inverted by passage through a communication system.) The fraction of frames that are discarded because the frame synchronizer is not locked is called "Percent Data Loss" or "Packet Data Loss rate" [PDL]. A general approach for accurately predicting PDL given BER was developed in Theoretical Percent Data Loss Calculation and Measurement Accuracy, T. P. Kelly, LESC-30554, December 1992. Kelly gave a solution in terms of matrix equations, and only addressed "level" channel encoding. This paper goes on to give a closed-form polynomial solution for the most common class of frame synchronizer strategies, and will also address "mark" and "space" (differential) channel encoding, and burst error environments. The paper is divided into four sections and follows a logically ordered presentation, with results developed before they are evaluated. However, most readers will derive the greatest benefit from this paper by treating the results as reference material. The result developed for differential encoding can be extended to other applications (like block codes) where the probability is needed that a block contains only a certain number of errors.

Lansdowne, Chatwin↗

Accuracy and resolution of Earth Radiation Budget Estimates

A numerical filter inversion technique that reduces wide-angle satellite measurements to top-of-the-atmosphere radiant exitances has been proposed for the Earth Radiation Budget Experiment (ERBE). The matrix formulation of this technique is presented, and the design of the numerical filter is discussed. The filter is smoothed with a singular value decomposition. The inversion process is simulated by generating synthetic measurements from a 24 degree spherical harmonic radiation field derived from Nimbus 6 ERB data. The numerical filter is applied to these measurements after they are corrupted with instrument error. The results are curves of expected error versus resolution area.

Green, R. N.↗

Performance Analysis of TCP Enhancements in Satellite Data Networks

This research examines two proposed enhancements to the well-known Transport Control Protocol (TCP) in the presence of noisy communication links. The Multiple Pipes protocol is an application-level adaptation of the standard TCP protocol, where several TCP links cooperate to transfer data. The Space Communication Protocol Standard - Transport Protocol (SCPS-TP) modifies TCP to optimize performance in a satellite environment. While SCPS-TP has inherent advantages that allow it to deliver data more rapidly than Multiple Pipes, the protocol, when optimized for operation in a high-error environment, is not compatible with legacy TCP systems, and requires changes to the TCP specification. This investigation determines the level of improvement offered by SCPS-TP's Corruption Mode, which will help determine if migration to the protocol is appropriate in different environments. As the percentage of corrupted packets approaches 5 %, Multiple Pipes can take over five times longer than SCPS-TP to deliver data. At high error rates, SCPS-TP's advantage is primarily caused by Multiple Pipes' use of congestion control algorithms. The lack of congestion control, however, limits the systems in which SCPS-TP can be effectively used.

Broyles, Ren H.↗

Satellite radar interferometry - Two-dimensional phase unwrapping

Interferometric synthetic aperture radar observations provide a means for obtaining high-resolution digital topographic maps from measurements of amplitude and phase of two complex radar images. The phase of the radar echoes may only be measured modulo 2 pi; however, the whole phase at each point in the image is needed to obtain elevations. An approach to 'unwrapping' the 2 pi ambiguities in the two-dimensional data set is presented. It is found that noise and geometrical radar layover corrupt measurements locally, and these local errors can propagate to form global phase errors that affect the entire image. It is shown that the local errors, or residues, can be readily identified and avoided in the global phase estimation. A rectified digital topographic map derived from the unwrapped phase values is presented.

Goldstein, Richard M.↗

Analysis of GPS Data Collected on the Greenland Ice Sheet

For several years, GPS observations have been made year round at the Swiss Camp, Greenland. The GPS data are recorded for 12 hours every 10-15 days; data are stored in memory and downloaded during the annual field season. Traditional GPS analysis techniques, where the receiver is assumed not to move within a 24 hour period, is not appropriate at the Swiss Camp, where horizontal velocities are on the order of 30 cm/day. Comparison of analysis strategies for these GPS data indicate that a random walk parameterization, with a constraint of 1-2 x 10(exp -7) km/sqrt(sec) minimizes noise due to satellite outages without corrupting the estimated ice velocity. Low elevation angle observations should be included in the analysis in order to increase the number of satellites viewed at each data epoch. Carrier phase ambiguity resolution is important for improving the accuracy of receiver coordinates.

Larson, K.↗

Corruption of radio metric Doppler due to solar plasma dynamics: S/X dual-frequency Doppler calibration for these effects

Doppler data from Mariner 6, 7, 9, and 10 and Pioneer 10 and 11 were discussed and the rms noise level for various sun-earth-probe angles were shown. The noise levels of both S- and X-band Doppler data for sun-earth-probe angles smaller than 20 deg were observed to be orders of magnitude greater than nominal. Such solar plasma-related Doppler degradation reduced the Mariner 10-Mercury 11 encounter navigation accuracy by nearly a factor of 10. Furthermore, this degradation was shown to be indirectly related to plasma dynamics and not a direct measure of the dynamics.

Winn, F. B.↗

Link Analysis for Space Communication Links Using ARQ Protocol

In space communications, standard link analysis assumes that messages are sent once. For a communication link that uses an error-correction coding scheme, bit-error-rate (BER) or frame-error-rate (FER), and link margins are common metrics that characterize the quality of a link, and they are used to determine the supportable data rate. With the advent of Automatic Repeat-reQuest (ARQ) protocols, when messages are corrupted during transmission, they can be resent multiple times automatically until they are correctly received and acknowledged. The concept of BER, FER, and link margin cannot be directly applied, and the link analysis approach for ARQ links needs to be re-examined.

Cheung, Kar-Ming↗

TESS Data Release Notes: Sector 60, DR85

TESS Sector 60 observations include physical orbits 127 and 128 of the spacecraft around the Earth. Data collection was paused for a total of 0.63 days to download data. Data were downloaded approximately every seven days, once near apogee of each orbit and once near perigee. At TJD 2949.99, the spacecraft entered into safe mode, resulting in instrument turn-off until TJD 2955.04. There are no FFIs, target pixel file data, or light curve data during this time. During these times (as well as when the spacecraft is transmitting data to ground systems) the data and timestamps in target-pixel files and light curve files are set to NULL. One FFI from Camera 1 in orbit 127 was corrupted prior to downlink from the spacecraft and could not be recovered. The FFIINDEX number is 00738895 (timestamp 2022358084201), and no FFI file for Camera 1 was produced for this cadence. In total, there are 20.01 days of science data collected in Sector 60.

TESS↗

An algorithm for extraction of periodic signals from sparse, irregularly sampled data

Temporal gaps in discrete sampling sequences produce spurious Fourier components at the intermodulation frequencies of an oscillatory signal and the temporal gaps, thus significantly complicating spectral analysis of such sparsely sampled data. A new fast Fourier transform (FFT)-based algorithm has been developed, suitable for spectral analysis of sparsely sampled data with a relatively small number of oscillatory components buried in background noise. The algorithm's principal idea has its origin in the so-called 'clean' algorithm used to sharpen images of scenes corrupted by atmospheric and sensor aperture effects. It identifies as the signal's 'true' frequency that oscillatory component which, when passed through the same sampling sequence as the original data, produces a Fourier image that is the best match to the original Fourier space. The algorithm has generally met with succession trials with simulated data with a low signal-to-noise ratio, including those of a type similar to hourly residuals for Earth orientation parameters extracted from VLBI data. For eight oscillatory components in the diurnal and semidiurnal bands, all components with an amplitude-noise ratio greater than 0.2 were successfully extracted for all sequences and duty cycles (greater than 0.1) tested; the amplitude-noise ratios of the extracted signals were as low as 0.05 for high duty cycles and long sampling sequences. When, in addition to these high frequencies, strong low-frequency components are present in the data, the low-frequency components are generally eliminated first, by employing a version of the algorithm that searches for non-integer multiples of the discrete FET minimum frequency.

Wilcox, J. Z.↗