Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Statistical properties of filtered pseudorandom digital sequences formed from the sum of maximum-length sequences

The statistics of filtered pseudorandom digital sequences called hybrid-sum sequences, formed from the modulo-two sum of several maximum-length sequences, are analyzed. The results indicate that a relation exists between the statistics of the filtered sequence and the characteristic polynomials of the component maximum length sequences. An analysis procedure is developed for identifying a large group of sequences with good statistical properties for applications requiring the generation of analog pseudorandom noise. By use of the analysis approach, the filtering process is approximated by the convolution of the sequence with a sum of unit step functions. A parameter reflecting the overall statistical properties of filtered pseudorandom sequences is derived. This parameter is called the statistical quality factor. A computer algorithm to calculate the statistical quality factor for the filtered sequences is presented, and the results for two examples of sequence combinations are included. The analysis reveals that the statistics of the signals generated with the hybrid-sum generator are potentially superior to the statistics of signals generated with maximum-length generators. Furthermore, fewer calculations are required to evaluate the statistics of a large group of hybrid-sum generators than are required to evaluate the statistics of the same size group of approximately equivalent maximum-length sequences.

Wallace, G. R.

Evaluation of Various Radar Data Quality Control Algorithms Based on Accumulated Radar Rainfall Statistics

The primary function of the TRMM Ground Validation (GV) Program is to create GV rainfall products that provide basic validation of satellite-derived precipitation measurements for select primary sites. A fundamental and extremely important step in creating high-quality GV products is radar data quality control. Quality control (QC) processing of TRMM GV radar data is based on some automated procedures, but the current QC algorithm is not fully operational and requires significant human interaction to assure satisfactory results. Moreover, the TRMM GV QC algorithm, even with continuous manual tuning, still can not completely remove all types of spurious echoes. In an attempt to improve the current operational radar data QC procedures of the TRMM GV effort, an intercomparison of several QC algorithms has been conducted. This presentation will demonstrate how various radar data QC algorithms affect accumulated radar rainfall products. In all, six different QC algorithms will be applied to two months of WSR-88D radar data from Melbourne, Florida. Daily, five-day, and monthly accumulated radar rainfall maps will be produced for each quality-controlled data set. The QC algorithms will be evaluated and compared based on their ability to remove spurious echoes without removing significant precipitation. Strengths and weaknesses of each algorithm will be assessed based on, their abilit to mitigate both erroneous additions and reductions in rainfall accumulation from spurious echo contamination and true precipitation removal, respectively. Contamination from individual spurious echo categories will be quantified to further diagnose the abilities of each radar QC algorithm. Finally, a cost-benefit analysis will be conducted to determine if a more automated QC algorithm is a viable alternative to the current, labor-intensive QC algorithm employed by TRMM GV.

Robinson, Michael

Sampling Errors in Monthly Rainfall Totals for TRMM and SSM/I, Based on Statistics of Retrieved Rain Rates and Simple Models

Estimates from TRMM satellite data of monthly total rainfall over an area are subject to substantial sampling errors due to the limited number of visits to the area by the satellite during the month. Quantitative comparisons of TRMM averages with data collected by other satellites and by ground-based systems require some estimate of the size of this sampling error. A method of estimating this sampling error based on the actual statistics of the TRMM observations and on some modeling work has been developed. "Sampling error" in TRMM monthly averages is defined here relative to the monthly total a hypothetical satellite permanently stationed above the area would have reported. "Sampling error" therefore includes contributions from the random and systematic errors introduced by the satellite remote sensing system. As part of our long-term goal of providing error estimates for each grid point accessible to the TRMM instruments, sampling error estimates for TRMM based on rain retrievals from TRMM microwave (TMI) data are compared for different times of the year and different oceanic areas (to minimize changes in the statistics due to algorithmic differences over land and ocean). Changes in sampling error estimates due to changes in rain statistics due 1) to evolution of the official algorithms used to process the data, and 2) differences from other remote sensing systems such as the Defense Meteorological Satellite Program (DMSP) Special Sensor Microwave/Imager (SSM/I), are analyzed.

Bell, Thomas L.

Exact and Approximate Probabilistic Symbolic Execution

Probabilistic software analysis seeks to quantify the likelihood of reaching a target event under uncertain environments. Recent approaches compute probabilities of execution paths using symbolic execution, but do not support nondeterminism. Nondeterminism arises naturally when no suitable probabilistic model can capture a program behavior, e.g., for multithreading or distributed systems. In this work, we propose a technique, based on symbolic execution, to synthesize schedulers that resolve nondeterminism to maximize the probability of reaching a target event. To scale to large systems, we also introduce approximate algorithms to search for good schedulers, speeding up established random sampling and reinforcement learning results through the quantification of path probabilities based on symbolic execution. We implemented the techniques in Symbolic PathFinder and evaluated them on nondeterministic Java programs. We show that our algorithms significantly improve upon a state-of- the-art statistical model checking algorithm, originally developed for Markov Decision Processes.

Symbolic Execution

Spatial Statistics of Large Astronomical Databases: An Algorithmic Approach

In this AISRP, the we have demonstrated that the correlation function i) can be calculated for MAP in minutes (about 45 minutes for Planck) on a modest 500Mhz workstation ii) the corresponding method, although theoretically suboptimal, produces nearly optimal results for realistic noise and cut sky. This trillion fold improvement in speed over the standard maximum likelihood technique opens up tremendous new possibilities, which will be persued in the follow up.

Szapudi, Istvan

Analysis of sequencing and scheduling methods for arrival traffic

The air traffic control subsystem that performs scheduling is discussed. The function of the scheduling algorithms is to plan automatically the most efficient landing order and to assign optimally spaced landing times to all arrivals. Several important scheduling algorithms are described and the statistical performance of the scheduling algorithms is examined. Scheduling brings order to an arrival sequence for aircraft. First-come-first-served scheduling (FCFS) establishes a fair order, based on estimated times of arrival, and determines proper separations. Because of the randomness of the traffic, gaps will remain in the scheduled sequence of aircraft. These gaps are filled, or partially filled, by time-advancing the leading aircraft after a gap while still preserving the FCFS order. Tightly scheduled groups of aircraft remain with a mix of heavy and large aircraft. Separation requirements differ for different types of aircraft trailing each other. Advantage is taken of this fact through mild reordering of the traffic, thus shortening the groups and reducing average delays. Actual delays for different samples with the same statistical parameters vary widely, especially for heavy traffic.

Neuman, Frank

Software for Data Analysis with Graphical Models

Probabilistic graphical models are being used widely in artificial intelligence and statistics, for instance, in diagnosis and expert systems, as a framework for representing and reasoning with probabilities and independencies. They come with corresponding algorithms for performing statistical inference. This offers a unifying framework for prototyping and/or generating data analysis algorithms from graphical specifications. This paper illustrates the framework with an example and then presents some basic techniques for the task: problem decomposition and the calculation of exact Bayes factors. Other tools already developed, such as automatic differentiation, Gibbs sampling, and use of the EM algorithm, make this a broad basis for the generation of data analysis software.

Buntine, Wray L.

A covariance analysis algorithm for interconnected systems

A covariance analysis algorithm for propagation of signal statistics in arbitrarily interconnected nonlinear systems is presented which is applied to six-degree-of-freedom systems. The algorithm uses statistical linearization theory to linearize the nonlinear subsystems, and the resulting linearized subsystems are considered in the original interconnection framework for propagation of the signal statistics. Some nonlinearities commonly encountered in six-degree-of-freedom space-vehicle models are referred to in order to illustrate the limitations of this method, along with problems not encountered in standard deterministic simulation analysis. Moreover, the performance of the algorithm shall be numerically exhibited by comparing results using such techniques to Monte Carlo analysis results, both applied to a simple two-dimensional space-intercept problem.

Cheng, Victor H. L.

Nonlinear Curve-Fitting Program

Nonlinear optimization algorithm helps in finding best-fit curve. Nonlinear Curve Fitting Program, NLINEAR, interactive curve-fitting routine based on description of quadratic expansion of X(sup 2) statistic. Utilizes nonlinear optimization algorithm calculating best statistically weighted values of parameters of fitting function and X(sup 2) minimized. Provides user with such statistical information as goodness of fit and estimated values of parameters producing highest degree of correlation between experimental data and mathematical model. Written in FORTRAN 77.

Everhart, Joel L.

A New Ensemble Canonical Correlation Prediction Scheme for Seasonal Precipitation

Department of Mathematical Sciences, University of Alberta, Edmonton, Canada This paper describes the fundamental theory of the ensemble canonical correlation (ECC) algorithm for the seasonal climate forecasting. The algorithm is a statistical regression sch eme based on maximal correlation between the predictor and predictand. The prediction error is estimated by a spectral method using the basis of empirical orthogonal functions. The ECC algorithm treats the predictors and predictands as continuous fields and is an improvement from the traditional canonical correlation prediction. The improvements include the use of area-factor, estimation of prediction error, and the optimal ensemble of multiple forecasts. The ECC is applied to the seasonal forecasting over various parts of the world. The example presented here is for the North America precipitation. The predictor is the sea surface temperature (SST) from different ocean basins. The Climate Prediction Center's reconstructed SST (1951-1999) is used as the predictor's historical data. The optimally interpolated global monthly precipitation is used as the predictand?s historical data. Our forecast experiments show that the ECC algorithm renders very high skill and the optimal ensemble is very important to the high value.

Kim, Kyu-Myong

Seasat scanning multichannel microwave radiometer - Results of the Gulf of Alaska workshop

Scanning multichannel microwave radiometer results obtained by the Gulf of Alaska Seasat Experiment Workshop are reported. The Seasat SMMR provided data from five channels operating at 6.6, 10.7, 18, 21, and 37 GHz at vertical and horizontal polarizations. Two preliminary algorithms were used to retrieve geophysical parameters from the data: the Wentz algorithm (Bierman et al., 1978) based on a theoretically derived function for computing brightness temperatures and the Wilheit algorithm, based on statistical relationships between brightness temperatures and the geophysical parameters obtained from an ensemble of realistic sea-surface temperature values, wind speeds, atmospheric temperature profiles, water vapor profiles and cloud models. In spite of the immaturity of the data-processing algorithms, results are encouraging. For open ocean, rain-free cells of high-quality surface truth wind determinations display standard deviations of 3 m/sec about a bias of 1.5 m/sec. The sea-surface temperature exhibits a standard deviation of about 1.5 deg C about a bias of 3 to 5 deg C under a variety of meteorological conditions.

Lipes, R. G.

Exploring a Physically Based Tool for Lightning Cessation: A Preliminary Study

The University of Alabama in Huntsville (UA Huntsville) and NASA's Marshall Space Flight Center are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. The project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UA Huntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. A summary of preliminary results will be presented.

Schultz, Elise V.

Exploring a Physically Based Tool for Lightning Cessation: Preliminary Results

The University of Alabama in Huntsville (UAHuntsville) and NASA s Marshall Space Flight Center are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. The project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. A summary of preliminary results will be presented.

Schultz, Elsie V.

Exploring the Use of Radar for Physically-Based Nowcasting of Lightning Cessation

NASA's Marshall Space Flight Center and the University of Alabama in Huntsville (UAHuntsville) are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. This project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically-based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms driven primarily by trending in the actual total lightning flash rate, we believe that dual polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and ice-microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can propagation phase-based ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the NASA-MSFC North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. Thus far our case study results suggest that the negative differential phase shift signature weakens and disappears after the analyzed storms ceased lightning production (i.e., after the last lightning flash occurred). This is a key observation because it suggests that while strong electric fields may still have been present, the lightning cessation signature was encompassed in the period of the polarimetric negative phase shift signature. To the extent this behavior is repeatable in other cases, even if only in a substantial fraction of those cases, the analysis suggests that differential propagation phase may prove to be a useful parameter for future lightning cessation algorithms. Indeed, a preliminary analysis of 15+ cases has shown additional indications of the weakening and disappearance of this ice alignment signature with lightning cessation. A summary of these case-study results is presented.

Schultz, Elise V.

Exploring the Use of Radar for a Physically Based Lightning Cessation Nowcasting Tool

NASA s Marshall Space Flight Center (MSFC) and the University of Alabama in Huntsville (UAHuntsville) are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. This project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and hydrometeors. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the NASA-MSFC North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. Thus far, our case study results suggest that the negative differential phase shift signature weakens and disappears after the analyzed storms ceased lightning production (i.e., after the last lightning flash occurred). This is a key observation because it suggests that while strong electric fields may still have been present, the lightning cessation signature encompassed the period of the polarimetric negative phase shift signature. To the extent this behavior is repeatable in other cases, even if only in a substantial fraction of those cases, the case analyses suggests that differential propagation phase may prove to be a useful parameter for future lightning cessation algorithms. Indeed, analysis of 15+ cases has shown additional indications of the weakening and disappearance of this ice alignment signature with lightning cessation. A summary of results will be presented.

Schultz, Elise V.

Algorithm for Detection of Ground and Canopy Cover in Micropulse Photon-Counting Lidar Altimeter Data in Preparation for the ICESat-2 Mission

NASA's Ice, Cloud and Land Elevation Satellite-II (ICESat-2) mission is a decadal survey mission (2016 launch). The mission objectives are to measure land ice elevation, sea ice freeboard, and changes in these variables, as well as to collect measurements over vegetation to facilitate canopy height determination. Two innovative components will characterize the ICESat-2 lidar: 1) collection of elevation data by a multibeam system and 2) application of micropulse lidar (photon-counting) technology. A photon-counting altimeter yields clouds of discrete points, resulting from returns of individual photons, and hence new data analysis techniques are required for elevation determination and association of the returned points to reflectors of interest. The objective of this paper is to derive an algorithm that allows detection of ground under dense canopy and identification of ground and canopy levels in simulated ICESat-2 data, based on airborne observations with a Sigma Space micropulse lidar. The mathematical algorithm uses spatial statistical and discrete mathematical concepts, including radial basis functions, density measures, geometrical anisotropy, eigenvectors, and geostatistical classification parameters and hyperparameters. Validation shows that ground and canopy elevation, and hence canopy height, can be expected to be observable with high accuracy by ICESat-2 for all expected beam energies considered for instrument design (93.01%-99.57% correctly selected points for a beam with expected return of 0.93 mean signals per shot (msp), and 72.85%-98.68% for 0.48 msp). The algorithm derived here is generally applicable for elevation determination from photoncounting lidar altimeter data collected over forested areas, land ice, sea ice, and land surfaces, as well as for cloud detection.

Algorithms

Automated Conflict Resolution, Arrival Management and Weather Avoidance for ATM

The paper describes a unified solution to three types of separation assurance problems that occur in en-route airspace: separation conflicts, arrival sequencing, and weather-cell avoidance. Algorithms for solving these problems play a key role in the design of future air traffic management systems such as NextGen. Because these problems can arise simultaneously in any combination, it is necessary to develop integrated algorithms for solving them. A unified and comprehensive solution to these problems provides the foundation for a future air traffic management system that requires a high level of automation in separation assurance. The paper describes the three algorithms developed for solving each problem and then shows how they are used sequentially to solve any combination of these problems. The first algorithm resolves loss-of-separation conflicts and is an evolution of an algorithm described in an earlier paper. The new version generates multiple resolutions for each conflict and then selects the one giving the least delay. Two new algorithms, one for sequencing and merging of arrival traffic, referred to as the Arrival Manager, and the other for weather-cell avoidance are the major focus of the paper. Because these three problems constitute a substantial fraction of the workload of en-route controllers, integrated algorithms to solve them is a basic requirement for automated separation assurance. The paper also reviews the Advanced Airspace Concept, a proposed design for a ground-based system that postulates redundant systems for separation assurance in order to achieve both high levels of safety and airspace capacity. It is proposed that automated separation assurance be introduced operationally in several steps, each step reducing controller workload further while increasing airspace capacity. A fast time simulation was used to determine performance statistics of the algorithm at up to 3 times current traffic levels.

Erzberger, H.