Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Bad data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Synchronizing Heavily Encoded Data in Bad Weather

Deep space missions choose a data rate to ensure reliable communication under most conditions. Certain critical data can be more heavily encoded, to be decoded under particularly bad atmospheric conditions. It is shown that, in such a system, finding and synchronizing critical data will not be a problem.

Swanson, L.

State estimation for spacecraft power systems

A state estimator appropriate for spacecraft power systems is presented. Phasor voltage and current measurements are used to determine the system state. A weighted least squares algorithm with a multireference transmission cable model is used. Bad data are identified and resolved. Once the bad data have been identified, they are removed from the measurement set and the system state can be estimated from the remaining data. An observability analysis is performed on the remaining measurements to determine if the system state can be found from the reduced measurement set. An example of the algorithm for a sample spacecraft power system is presented.

Williamson, Susan H.

Explainable multi-fidelity Bayesian neural network for distribution system state estimation

Distribution System State Estimation (DSSE) is frequently constrained by limited real-time measurements, the uncertainties introduced by distributed energy resources, and the presence of bad data. To address them, this paper proposes an enhanced Multi-Fidelity Bayesian Neural Network (MFBNN) DSSE approach. A low-fidelity layer based on a Deep Neural Network (DNN) is first pre-trained on pseudo-measurement data to learn fundamental state features. Subsequently, a high-fidelity Bayesian Neural Network (BNN) layer leverages limited but high-quality real-time measurements to refine these features, thereby achieving accurate DSSE. Additionally, the deep SHapley Additive exPlanation (SHAP) is developed to quantify the influence of measurement data on DSSE through dual perspectives of global feature importance and local nodal contributions, establishing a hierarchical explainability framework for machine learning-based DSSE. Comparative studies conducted on the IEEE 13-bus system and a real-world 2135-node system from Dominion Energy demonstrate that the proposed method excels in estimation accuracy, even under situations of high noise levels, bad data, and missing data. Further comparisons with Weighted Least Squares (WLS) and other machine learning-based DSSE approaches verify that the proposed framework offers higher accuracy, improved interpretability, and enhanced robustness.

Bad data

Summary of Aqua, Aura, and Terra High Interest Events

Single-obs tracking Sparsely tracked objects are an unfortunate reality of CARA operations Terra vs. 32081: new track with bad data was included in OD solution for secondary object and risk became high CARA and JSpOC discussed tracking and OSAs threw out the bad data. Event no longer presented high risk based on new OD Improvement: CARA now sends JSpOC a flag indicating when a single obs is included, so OSAs can evaluate if manual update to OD is required. Missing ASW OCMsAura vs. 87178, TCA: 317 at 08:04 UTC. Post-maneuver risk (conjunction was identified in OO results)CARA confirmed with JSpOC that ASW OCMs should have been received in addition to OO OCMsJSpOC corrected the manual error in their script that prevented the data from being delivered to CARAJSpOC QAd their other scripts to ensure this error did not exist in other places.

Conjunction

Smart Sensor Node Development, Testing and Implementation for ISHM

A main design criterion for a robust Integrated Systems Health Management (ISHM) system is summed up best by the statement "No data is better than bad data". Traditional data acquisition systems are calibrated in a controlled environment and guaranteed to perform bounded by their tested conditions. To successfully design and implement a real world ISHM system, the data acquisition and signal conditioning needs to function in an uncontrolled environment. Development and testing focuses on a design with the ability to self check in order to extend calibration times, report internal faults and drifts and notify the overall system when the data acquisition is not performing as it should. All of this will be designed in a system that is flexible, requiring little redesign to be deployed on a wide variety of systems. Development progress and testing results will be reported.

Mengers, Timothy

Opinion: Aerosol Remote Sensing Over the Next Twenty Years

More than two decades ago, aerosol remote sensing underwent a revolution with the launch of the Terra and Aqua satellites. Advancement continued via additional launches carrying new passive and active sensors. Capable of retrieving parameters characterizing aerosol loading, rudimentary particle properties and in some cases aerosol layer height, the satellite view of Earth’s aerosol system came into focus.The modeling communities have made similar advances. Now the efforts have continued long enough that we can see developing trends in both remote sensing and modeling communities, allowing us to speculate about the future and how the community will approach aerosol remote sensing twenty years from now. We anticipate technology that will replace today’s standard multi-wavelength radiometers with hyperspectral and/or polarimetry all viewing in multiple angles.These will be supported by advanced active sensors with the ability to measure profiles of aerosol extinction in addition to backscatter. The result will be greater insight into aerosol particle properties. Algorithms will move from being primarily physically-based to include an increasing degree of Machine Learning methods, but physically-based techniques will not go extinct. However, the practice of applying algorithms to a single sensor will be in decline. Retrieval algorithms will encompass multiple sensors and all available ground measurements into a unifying framework, and these inverted products will be ingested directly into assimilation systems, becoming “cyborgs”: half observations, half model. In twenty years we will see a true democratization in space with nations large and small, private organizations and commercial entities of all sizes launching space sensors. With this increasing amount of data and aerosol products available, there will be a lot of bad data. User communities will organize to set standards and the large national space agencies will lead the effort to maintain quality by deploying and maintaining validation ground networks and focused field experiments. Through it all, interest will remain high in the global aerosol system and how that system affects climate, clouds, precipitation and dynamics, air quality, the environment and public health, transport of pathogens and fertilization of ecosystems, and how these processes are adapting to a changing climate.

aerosol remote sensing

Flight results from a study of aided inertial navigation applied to landing operations

An evaluation is presented of the approach and landing performance of a Kalman filter aided inertial navigation system using flight data obtained from a series of approaches and landings of the CV-340 aircraft at an instrumented test area. A description of the flight test is given, in which data recorded included: (1) accelerometer signals from the platform of an INS; (2) three ranges from the Ames-Cubic Precision Ranging System; and (3) radar and barometric altimeter signals. The method of system evaluation employed was postflight processing of the recorded data using a Kalman filter which was designed for use on the XDS920 computer onboard the CV-340 aircraft. Results shown include comparisons between the trajectories as estimated by the Kalman filter aided system and as determined from cinetheodolite data. Data start initialization of the Kalman filter, operation at a practical data rate, postflight modeling of sensor errors and operation under the adverse condition of bad data are illustrated.

Mcgee, L. A.

Data smoothing and error detection based on linear interpolation

A method is presented, based on linear interpolation, for detecting and correcting bad data points in a set of data without contaminating the good data points. The method used is not concerned with the small random errors usually attributed to a noisy system. It assumes that the data points which are in error are relatively isolated from each other and that the number of such points is small compared to the total number of data points.

Guerra, V. M.

DESSY: Making a real-time expert system robust and useful

As the complexity and expected life-span of modern space systems continue to increase, the need for real-time data monitoring and failure analysis becomes more critical to their successful operation. The DEcision Support SYstem (DESSY) is a joint effort by the Intelligent Systems Branch/ER2 and the Remote Manipulator System (RMS) Section/DF44 to develop an expert system for the monitoring of the Payload Deployment and Retrieval System (PDRS). DESSY users, the RMS flight controllers, are provided with user interface enhancements and automated monitoring of system state (physical orientation) and status (operational health). Currently, a DESSY prototype for the Manipulator Positioning Mechanism (MPM) and Manipulator Retention Latches (MRL) of the PDRS has been developed and successfully demonstrated during the STS-49 and STS-46 missions. Expert systems for monitoring real-time operations must not only accurately represent domain knowledge, but also address the challenges of using unfiltered real-time data as input. This paper describes the methods and design strategies developed to overcome problems with real-time data in the NASA Mission Control Center. Types of data problems addressed are as follows: (1) loss of data; (2) erratic data; and (3) data lags and irregularities during state transition. Methods used to handle data problems include rule disabling for ignoring data when data quality is uncertain, context-sensitive bounded pattern recognition for minimizing incorrect conclusions based on bad data, and graceful recovery through system correction when reliable data returns. This combination of methods with an object-based modular DESSY design assures a robust program capable of lengthy periods of uninterrupted use in operations.

Land, Sherry A.

Extended observability of linear time-invariant systems under recurrent loss of output data

Recurrent loss of sensor data in integrated control systems of an advanced aircraft may occur under different operating conditions that include detected frame errors and queue saturation in computer networks, and bad data suppression in signal processing. This paper presents an extension of the concept of observability based on a set of randomly selected nonconsecutive outputs in finite-dimensional, linear, time-invariant systems. Conditions for testing extended observability have been established.

Luck, Rogelio

PROCAMS - A second generation multispectral-multitemporal data processing system for agricultural mensuration

PROCAMS (Prototype Classification and Mensuration System) has been designed for the classification and mensuration of agricultural crops (specifically small grains including wheat, rye, oats, and barley) through the use of data provided by Landsat. The system includes signature extension as a major feature and incorporates multitemporal as well as early season unitemporal approaches for using multiple training sites. Also addressed are partial cloud cover and cloud shadows, bad data points and lines, as well as changing sun angle and atmospheric state variations.

Erickson, J. D.

Satellite Data Sets in the Polar Regions

We have generated about two decades of consistently derived geophysical parameters in the polar regions. The key parameters are sea ice concentration, surface temperature, albedo, and cloud cover statistics. Sea ice concentrations were derived from the Scanning Multichannel Microwave Radiometer (SMMR) data and the Special Scanning Cl Microwave Imager (SSM/I) data from several platforms using the enhanced Bootstrap Algorithm for the period 1978 through 1999. The new algorithm reduces the errors associated with spatial and temporal variations in the emissivity and surface temperatures of sea ice. Also, bad data at ocean/land interfaces are identified and deleted in an unsupervised manner. Surface ice temperature, albedo and cloud cover statistics are derived simultaneously from the Advanced Very High Resolution Radiometer (AVHRR) data from 1981 through 1999 and mapped at a higher resolution but the same format as the ice concentration data. The technique makes use these co-registered ice concentration maps to enable cloud masking to be done separately for open ocean, sea ice and land areas. The effect of inversion is minimized by taking into consideration the expected changes in the effect of inversion with altitude, especially in the Antarctic. A technique for ice type regional classification has also been developed using multichannel cluster analysis and a neural network. This provide a means to identify large areas of thin ice, first year ice, and older ice types. The data sets have been shown to be coherent with each other and provide a powerful tool for in depth studies of the currently changing Arctic and Antarctic environment.

Comiso, Josefino C.

A fast 3-D object recognition algorithm for the vision system of a special-purpose dexterous manipulator

A fast 3-D object recognition algorithm that can be used as a quick-look subsystem to the vision system for the Special-Purpose Dexterous Manipulator (SPDM) is described. Global features that can be easily computed from range data are used to characterize the images of a viewer-centered model of an object. This algorithm will speed up the processing by eliminating the low level processing whenever possible. It may identify the object, reject a set of bad data in the early stage, or create a better environment for a more powerful algorithm to carry the work further.

Hung, Stephen H. Y.

The Micro-Pulse Lidar Network (MPLNET): A Federated Network of Micro-pulse Lidars and AERONET Sunphotometers

We present the formation of a new global-ground based eye-safe lidar network, the NASA Micro-Pulse Lidar Network (MPLNET). The aim of MPLNET is to acquire long- term observations of aerosol and cloud vertical profiles at unique geographic sites within the NASA Aerosol Robotic Network (AERONET). MPLNET utilizes standard instrumentation and data processing algorithms for efficient network operations and direct comparison of data between each site. The micro-pulse lidar is eye-safe, compact, and commercially available, and most easily allows growth of the network without sacrificing standardized instrumentation goals. Network growth follows a federated approach, pioneered by AERONET, wherein independent research groups may join MPLNET with their own instrument and site. MPLNET sites produce not only vertical profile data, but also column-averaged products already available from AERONET (aerosol optical depth, sky radiance, size distributions). Algorithms are presented for each MPLNET data product. Real-time Level 1 data products (next-day) include daily lidar signal images from the surface to -2Okm, and Level 1.5 aerosol extinction profiles at times co-incident with AERONET observations. Quality assured Level 2 aerosol extinction profiles are generated after screening the Level 1.5 results and removing bad data. Level 3 products include continuous day/night aerosol extinction profiles, and are produced using Level 2 calibration data. Rigorous uncertainty calculations are presented for all data products. Analysis of MPLNET data show the MPL and our analysis routines are capable of successfully retrieving aerosol profiles, with the strenuous accounting of uncertainty necessary for accurate interpretation of the results.

Welton, Ellsworth J.

Data Assimilation Cycling for Weather Analysis

This software package runs the atmospheric model MM5 in data assimilation cycling mode to produce an optimized weather analysis, including the ability to insert or adjust a hurricane vortex. The program runs MM5 through a cycle of short forecasts every three hours where the vortex is adjusted to match the observed hurricane location and storm intensity. This technique adjusts the surrounding environment so that the proper steering current and environmental shear are achieved. MM5cycle uses a Cressman analysis to blend observation into model fields to get a more accurate weather analysis. Quality control of observations is also done in every cycle to remove bad data that may contaminate the analysis. This technique can assimilate and propagate data in time from intermittent and infrequent observations while maintaining the atmospheric field in a dynamically balanced state. The software consists of a C-shell script (MM5cycle.driver) and three FORTRAN programs (splitMM5files.F, comRegrid.F, and insert_vortex.F), and are contained in the pre-processor component of MM5 called "Regridder." The model is first initialized with data from a global model such as the Global Forecast System (GFS), which also provides lateral boundary conditions. These data are separated into single-time files using splitMM5.F. The hurricane vortex is then bogussed in the correct location and with the correct wind field using insert_vortex.F. The modified initial and boundary conditions are then recombined into the model fields using comRegrid.F. The model then makes a three-hour forecast. The three-hour forecast data from MM5 now become the analysis for the next short forecast run, where the vortex will again be adjusted. The process repeats itself until the desired time of analysis is achieved. This code can also assimilate observations if desired.

Tran, Nam

Onboard navigation of the Space Shuttle

This paper discusses the Kalman filter used in the navigation software of the Space Shuttle. The form of the filter will be discussed: the standard Kalman filter versus the square-root version of this filter. Both of these filters have severe nonlinearity problems. Two successful solutions of the nonlinearity problem are presented. A real-time program must have a good method of editing bad data. The data editing scheme is discussed. Those elements of the Kalman filter state vector which are random variables will be discussed.

Lear, W. M.

The High Resolution Spectrograph for the Space Telescope

The High Resoltuion Spectrograph (HRS) in conjunction with the Space Telescope (ST), extends ultraviolet astronomical spectroscopy to higher spectra, spatial, and time resolutions than previously achieved, as well as to fainter and more distant celestial objects. Other significant advances inherent in the instrument are high photometric accuracy and efficient operation via exposure meter control and real time rejection of bad data. These capabilities are provided to accomplish the scientific programs of the HRS investigation definition team, which concern the interstellar medium, stellar winds, and evolutionary aspects of stellar atmosphere studies; the determination of chemical abundances relevant to stellar evolution; the investigation of quasars and Seyfert galaxy nuclei; and the analysis of the atmospheres of solar system objects, including comets.

Brandt, J. C.

On the impact of the FGGE on tropical forecasts

It has become evident from operational experience that a good forecast requires, in general, a good analysis. This is as true in the tropics as it is in the extratropics. One can find many examples of bad data being accepted by the analysis scheme and significantly degrading the subsequent forecast. Equally, a lack of data may result in a forecast completely missing the early development of, for example, a midlatitude cyclone or tropical depression. Also, single level data may be misinterpreted by an analysis scheme. These problems are compounded in the tropics by our relative ignorance of the dynamics, the necessarily crude descriptions of many important physical processes, and fundamental in analysis. The impact of the FGGE on tropical analysis/forecasting is reviewed.

Heckley, W. A.