Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Noisy data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Sampling Technique for Robust Odorant Detection Based on MIT RealNose Data

This technique enhances the detection capability of the autonomous Real-Nose system from MIT to detect odorants and their concentrations in noisy and transient environments. The lowcost, portable system with low power consumption will operate at high speed and is suited for unmanned and remotely operated long-life applications. A deterministic mathematical model was developed to detect odorants and calculate their concentration in noisy environments. Real data from MIT's NanoNose was examined, from which a signal conditioning technique was proposed to enable robust odorant detection for the RealNose system. Its sensitivity can reach to sub-part-per-billion (sub-ppb). A Space Invariant Independent Component Analysis (SPICA) algorithm was developed to deal with non-linear mixing that is an over-complete case, and it is used as a preprocessing step to recover the original odorant sources for detection. This approach, combined with the Cascade Error Projection (CEP) Neural Network algorithm, was used to perform odorant identification. Signal conditioning is used to identify potential processing windows to enable robust detection for autonomous systems. So far, the software has been developed and evaluated with current data sets provided by the MIT team. However, continuous data streams are made available where even the occurrence of a new odorant is unannounced and needs to be noticed by the system autonomously before its unambiguous detection. The challenge for the software is to be able to separate the potential valid signal from the odorant and from the noisy transition region when the odorant is just introduced.

Duong, Tuan A.↗

An Innovative Method for Low Cost, Autonomous Navigation for Low Earth Orbit Satellites

An innovative approach to autonomous attitude, trajectory, and rate estimation is presented for low earth orbit (LEO) satellites which relies on magnetometers and sun sensors. These two sensors are reliable, inexpensive, and are used routinely in LEO missions for attitude determination and control. An extended Kalman filter (EKF) is developed from two existing systems, one which uses an EKF to estimate attitude and trajectory using magnetometer and gyro data and a second pseudo-linear filter which estimates rotation rate using magnetometer and sun sensor data. The theoretical background of the combined system is presented along with test results from noisy, simulated sensor data.

Deutschmann, Julie↗

MAGSAT anomaly profiles of the eastern Indian Ocean

Ground tracks from SEASAT were used in an effort to develop qualititative relationships between the gravity field and MAGSAT magnetic anomalies in the eastern Indian Ocean. Investigation of data quality led to analyses of the average value (over 80 vector data points, or approximately 36 km intervals) and of the standard deviation of this average, as a mean of identifying noisy portions of the data. It was discovered that the plots of the average value minus the individual (measured) point value are most useful for identifying noisy areas and data spikes. Spectrum analysis using edited (spikes removed) data show that the noise floor is less than 1 nT and the slope of the spectrum in the region of wavelengths between 1200 km and 250 km is approximately -3. Consequently the estimated resolution limit improved from approximately 360 km to approximately 250 km.

Sailor, R. V.↗

Clarifications on the "Comparison Between SMOS, VUA, ASCAT, and ECMWF Soil Moisture Products Over Four Watersheds in U.S."

In a recent paper, Leroux et al. compared three satellite soil moisture data sets (SMOS, AMSR-E, and ASCAT) and ECMWF forecast soil moisture data to in situ measurements over four watersheds located in the United States. Their conclusions stated that SMOS soil moisture retrievals represent "an improvement [in RMSE] by a factor of 2-3 compared with the other products" and that the ASCAT soil moisture data are "very noisy and unstable." In this clarification, the analysis of Leroux et al. is repeated using a newer version of the ASCAT data and additional metrics are provided. It is shown that the ASCAT retrievals are skillful, although they show some unexpected behavior during summer for two of the watersheds. It is also noted that the improvement of SMOS by a factor of 2-3 mentioned by Leroux et al. is driven by differences in bias and only applies relative to AMSR-E and the ECWMF data in the now obsolete version investigated by Leroux et al.

Scattering↗

An adaptive data-smoothing routine

An adaptive noise reduction algorithm that can be implemented on a microcomputer is developed. Smoothing polynomials are used where the polynomial coefficients are chosen such that the mean-square-error between the noisy and smoothed data is minimized. This approach is equivalent to the implementation of a low-pass finite impulse response filter. The noise reduction depends on the order of the smoothing polynomial. A whiteness test on the error sequence is incorporated to search for the optimal smoothing. Expansion coefficients may be computed via the fast Fourier transform, and the resulting smoothing process is the equivalent of the implementation of an adaptive ideal low-pass filter. Results are obtained for an analytical signal with added white Gaussian noise. The routine may be applied to any smooth signal with additive random noise.

Taylor, Clayborne D.↗

Signal processing of anthropometric data

The Anthropometric Measurements Laboratory has accumulated a large body of data from a number of previous experiments. The data is very noisy, therefore it requires the application of some signal processing schemes. Moreover, it was not regarded as time series measurements but as positional information; hence, the data is stored as coordinate points as defined by the motion of the human body. The accumulated data defines two groups or classes. Some of the data was collected from an experiment designed to measure the flexibility of the limbs, referred to as radial movement. The remaining data was collected from experiments designed to determine the surface of the reach envelope. An interactive signal processing package was designed and implemented. Since the data does not include time this package does not include a time series element. Presently the results is restricted to processing data obtained from those experiments designed to measure flexibility.

Zimmermann, W. J.↗

Synopsis of early field test results from the gravity gradiometer survey system

Although the amount of data yielded by the initial airborne and surface tests was modest, it was sufficient to demonstrate that the full gravity gradient tensor was successfully measured from moving platforms both in the air and on the surface. The measurements were effectively continuous with spatial along-track resolution limited only by choice of integration lengths taken to reduce noise. The airborne data were less noisy (800 E squared/Hz typical) than were the Gravity Gradiometer Survey System (GGSS) measurements taken at the surface (5000 E squared/Hz typical). Single tracks of surface gravity disturbances recovered from airborne data were accurate to 3 to 4 mgal in each component of gravity when compared to 5 x 5 mean gravity anomalies over a 90 km track. Multitrack processing yielded 2 to 3 mgal when compared to 5 x 5 mean anomalies. Deflection of the vertical recovery over a distance of 150 km was about one arcsecond.

Brzezowski, S.↗

Test-Signal Generator For SNR Calibration

Assembly of commercial and custom-made electronic equipment designed to generate noisy intermediate-frequency or baseband received phase-modulation data-communication signals with accurately known signal-to-noise ratios. Signals used to perform signal-to-noise-ratio calibrations and other tests of responses of data-communication receivers to noisy incoming signals. Underlying principle applicable to generation of test signals for other advanced data-communication receivers.

Gutierrez-Luaces, Benito O.↗

Error analysis for reducing noisy wide-gap concentric cylinder rheometric data for nonlinear fluids - Theory and applications

This work discusses the propagation of errors for the recovery of the shear rate from wide-gap concentric cylinder viscometric measurements of non-Newtonian fluids. A least-square regression of stress on angular velocity data to a system of arbitrary functions is used to propagate the errors for the series solution to the viscometric flow developed by Krieger and Elrod (1953) and Pawlowski (1953) ('power-law' approximation) and for the first term of the series developed by Krieger (1968). A numerical experiment shows that, for measurements affected by significant errors, the first term of the Krieger-Elrod-Pawlowski series ('infinite radius' approximation) and the power-law approximation may recover the shear rate with equal accuracy as the full Krieger-Elrod-Pawlowski solution. An experiment on a clay slurry indicates that the clay has a larger yield stress at rest than during shearing, and that, for the range of shear rates investigated, a four-parameter constitutive equation approximates reasonably well its rheology. The error analysis presented is useful for studying the rheology of fluids such as particle suspensions, slurries, foams, and magma.

Borgia, Andrea↗

Design of source coders and joint source/channel coders for noisy channels

A theory behind a proposed joint source/channel coding approach is developed and a variable rate design approach which provides substantial improvement over current joint source/channel coder designs is obtained. The Rice algorithm as applied to the output of the Gamma Ray Detector of the Mars Orbiter is evaluated. An alternative algorithm is obtained which outperforms the Rice both in terms of data compression and noisy channel performance. A high-fidelity low-rate image compression algorithm is developed which provides almost distortionless compression of high resolution images.

Sayood, Khalid↗

Ionospheric gravity wave measurements with the USU dynasonde

A method for the measurement of ionospheric Gravity Wave (GW) using the USU Dynasonde is outlined. This method consists of a series of individual procedures, which includes functions for data acquisition, adaptive scaling, polarization discrimination, interpolation and extrapolation, digital filtering, windowing, spectrum analysis, GW detection, and graphics display. Concepts of system theory are applied to treat the ionosphere as a system. An adaptive ionogram scaling method was developed for automatically extracting ionogram echo traces from noisy raw sounding data. The method uses the well known Least Mean Square (LMS) algorithm to form a stochastic optimal estimate of the echo trace which is then used to control a moving window. The window tracks the echo trace, simultaneously eliminating the noise and interference. Experimental results show that the proposed method functions as designed. Case studies which extract GW from ionosonde measurements were carried out using the techniques described. Geophysically significant events were detected and the resultant processed results are illustrated graphically. This method was also developed for real time implementation in mind.

Berkey, Frank T.↗

Estimating Confidence In Data Via Trend Analysis

Recursive equation defines probability-density function storing trends in noisy or potentially erroneous data. Part of algorithm for analysis of trends in data. Developed to determine reliability of data from sensor used to guide robot, and mathematical approach that it represents proves valuable in other applications. Enables computation of statistic (called "confidence statistic") indicating level of confidence in new datum. Generates confidence statistic high or low, depending on whether new datum consistent or inconsistent with previous trends.

Gutow, David A.↗

Building a 2.5D Digital Elevation Model from 2D Imagery

When projecting imagery into a georeferenced coordinate frame, one needs to have some model of the geographical region that is being projected to. This model can sometimes be a simple geometrical curve, such as an ellipse or even a plane. However, to obtain accurate projections, one needs to have a more sophisticated model that encodes the undulations in the terrain including things like mountains, valleys, and even manmade structures. The product that is often used for this purpose is a Digital Elevation Model (DEM). The technology presented here generates a high-quality DEM from a collection of 2D images taken from multiple viewpoints, plus pose data for each of the images and a camera model for the sensor. The technology assumes that the images are all of the same region of the environment. The pose data for each image is used as an initial estimate of the geometric relationship between the images, but the pose data is often noisy and not of sufficient quality to build a high-quality DEM. Therefore, the source imagery is passed through a feature-tracking algorithm and multi-plane-homography algorithm, which refine the geometric transforms between images. The images and their refined poses are then passed to a stereo algorithm, which generates dense 3D data for each image in the sequence. The 3D data from each image is then placed into a consistent coordinate frame and passed to a routine that divides the coordinate frame into a number of cells. The 3D points that fall into each cell are collected, and basic statistics are applied to determine the elevation of that cell. The result of this step is a DEM that is in an arbitrary coordinate frame. This DEM is then filtered and smoothed in order to remove small artifacts. The final step in the algorithm is to take the initial DEM and rotate and translate it to be in the world coordinate frame [such as UTM (Universal Transverse Mercator), MGRS (Military Grid Reference System), or geodetic] such that it can be saved in a standard DEM format and used for projection.

Padgett, Curtis W.↗

Software for Verifying Image-Correlation Tie Points

A computer program enables assessment of the quality of tie points in the image-correlation processes of the software described in the immediately preceding article. Tie points are computed in mappings between corresponding pixels in the left and right images of a stereoscopic pair. The mappings are sometimes not perfect because image data can be noisy and parallax can cause some points to appear in one image but not the other. The present computer program relies on the availability of a left- right correlation map in addition to the usual right left correlation map. The additional map must be generated, which doubles the processing time. Such increased time can now be afforded in the data-processing pipeline, since the time for map generation is now reduced from about 60 to 3 minutes by the parallelization discussed in the previous article. Parallel cluster processing time, therefore, enabled this better science result. The first mapping is typically from a point (denoted by coordinates x,y) in the left image to a point (x',y') in the right image. The second mapping is from (x',y') in the right image to some point (x",y") in the left image. If (x,y) and(x",y") are identical, then the mapping is considered perfect. The perfect-match criterion can be relaxed by introducing an error window that admits of round-off error and a small amount of noise. The mapping procedure can be repeated until all points in each image not connected to points in the other image are eliminated, so that what remains are verified correlation data.

Klimeck, Gerhard↗

Reduction of satellite magnetic anomaly data

Analysis of global magnetic anomaly maps derived from satellite data is facilitated by inversion to the equivalent magnetization in a constant thickness magnetic crust or, equivalently, by reduction to the pole. Previous inversions have proven unstable near the geomagnetic equator. The instability results from magnetic moment distributions which are admissible in the inversion solution but which make only small contribution to the computed values of anomaly field. Their admissibility in the solution could result from noisy or incomplete data or from small poorly resolved anomalies. The resulting magnetic moments are unrealistically large and oscillatory. Application of the method of principal components (e.g. eigenvalue decomposition and selective elimination of less significant eigenvectors) is proposed as a way of overcoming the instability and the method is demonstrated by applying it to the region around the Bangui anomaly in Central Africa.

Slud, E. V.↗

Optimum Cyclic Redundancy Codes for Noisy Channels

Capabilities and limitations of cyclic redundancy codes (CRC's) for detecting transmission errors in data sent over relatively noisy channels (e.g., voice-grade telephone lines or very-high-density storage media) discussed in 16-page report. Due to prevalent use of bytes in multiples of 8 bits data transmission, report primarily concerned with cases in which both block length and number of redundant bits (check bits for use in error detection) included in each block are multiples of 8 bits.

Posner, E. C.↗

Autoencoders for Denoising Atmospheric Profiles from ICESat-2

Abstract: The 2nd generation Ice, Cloud, and land Elevation Satellite (ICESat-2) is an altimetry mission designed primarily for measuring ice sheet elevation and sea ice thickness, provides atmospheric profiles of clouds and aerosols at 532 nm using a photo counting detection approach. While highly sensitive for the detection of tenuous aerosol and cloud features, during the day signal-to-noise-ratio (SNR) photon counting detectors are adversely impacted by solar contributions to the total signal. Averaging the data to coarser horizontal resolutions has been the standard way to increase SNR and thus allow clouds and aerosols to be more easily detectable. Recent work has demonstrated success in boosting SNR without decreasing resolution using advanced filtering techniques [Yorks et al., 2021], however, rapid advancements in Deep Learning based image denoising algorithms can further improve the SNR. Here, we present results using a state-of-the-art Deep Learning autoencoder applied to noisy ICESat-2 data to improve daytime SNR and discuss implications for atmospheric feature detection, classification, and optical property retrievals.

denoising↗