Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “maximum likelihood”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

A New Estimator to Correct for Bias from Tag Rate Expansion on Natural-Origin Fish Attributes in Mixed-Stock Analysis Using Parentage-Based Tagging

Abstract In fisheries where hatchery- and natural-origin conspecifics occur as mixed stocks, it is often important to estimate both the natural-origin proportion of the mixture and the composition of attributes within the natural-origin portion (e.g., genetic stock, sex, and age-class). These estimates are facilitated by parentage-based tagging, which allows large numbers of hatchery fish to be efficiently tagged and later identified. When tag rates are less than 100%, the untagged fish in the mixture include both untagged hatchery fish and natural-origin fish. Unbiased estimation of the abundance and attribute composition of the natural-origin portion requires an estimator that accounts for tag rates. Two estimators are described: one “accounting-style” estimator similar to previously described approaches and one maximum likelihood method. These estimators were evaluated and compared using simulations mimicking estimation of the composition of fish migrating past a dam. The two estimators performed similarly at reducing bias when tag rates were high, but the maximum likelihood method had smaller mean square error when tag rates were low. We provide an R package to allow usage of this estimator in a wide variety of fisheries applications.

Delomas, Thomas A. (ORCID:000000015154759X)↗

Recursive estimation of prior probabilities using the mixture approach

The problem of estimating the prior probabilities q sub k of a mixture of known density functions f sub k(X), based on a sequence of N statistically independent observations is considered. It is shown that for very mild restrictions on f sub k(X), the maximum likelihood estimate of Q is asymptotically efficient. A recursive algorithm for estimating Q is proposed, analyzed, and optimized. For the M = 2 case, it is possible for the recursive algorithm to achieve the same performance with the maximum likelihood one. For M 2, slightly inferior performance is the price for having a recursive algorithm. However, the loss is computable and tolerable.

Kazakos, D.↗

Aircraft parameter estimation

The aircraft parameter estimation problem is used to illustrate the utility of parameter estimation, which applies to many engineering and scientific fields. Maximum likelihood estimation has been used to extract stability and control derivatives from flight data for many years. This paper presents some of the basic concepts of aircraft parameter estimation and briefly surveys the literature in the field. The maximum likelihood estimator is discussed, and the basic concepts of minimization and estimation are examined for a simple simulated aircraft example. The cost functions that are to be minimized during estimation are defined and discussed. Graphic representations of the cost functions are given to illustrate the minimization process. Finally, the basic concepts are generalized, and estimation from flight data is discussed. Some of the major conclusions for the simulated example are also developed for the analysis of flight data from the F-14, highly maneuverable aircraft technology (HiMAT), and space shuttle vehicles.

Kenneth W Iliff↗

Aircraft parameter estimation

The aircraft parameter estimation problem is used to illustrate the utility of parameter estimation, which applies to many engineering and scientific fields. Maximum likelihood estimation has been used to extract stability and control derivatives from flight data for many years. This paper presents some of the basic concepts of aircraft parameter estimation and briefly surveys the literature in the field. The maximum likelihood estimator is discussed, and the basic concepts of minimization and estimation are examined for a simple simulated aircraft example. The cost functions that are to be minimized during estimation are defined and discussed. Graphic representations of the cost functions are given to illustrate the minimization process. Finally, the basic concepts are generalized, and estimation from flight data is discussed. Some of the major conclusions for the simulated examples are also developed for the analysis of flight data from the F-14, highly maneuverable aircraft technology (HiMAT), and Space Shuttle vehicles.

Iliff, Kenneth W.↗

Aircraft parameter estimation in frequency domain

The algorithms for the equation error and output error methods, the two basic procedures for the extraction of aircraft parameters from flight data, are formulated in the frequency domain. The output error method includes the maximum likelihood estimation technique. This is further extended to those cases where the measured data is in the form of frequency response curves and the model of an aircraft includes elastic degrees of freedom and unsteady aerodynamics. Then the generalized maximum likelihood method, which can be applied to the identification of an aircraft subjected to external disturbances, is introduced. Next, all estimation methods mentioned are discussed with emphasis on advantages of the frequency domain analysis. The paper concludes with an example using real flight data.

Klein, V.↗

Extraction of aerodynamic parameters for aircraft at extreme flight conditions

The maximum likelihood estimator has been used to extract stability and control derivatives from flight data for many years. Most of the literature on aircraft estimation concentrates on new developments and applications, assuming familiarity with basic concepts. This paper briefly discusses the maximum likelihood estimator and the aircraft equations of motion that the estimator uses. The current strength and limitations associated with obtaining flight-determined aerodynamic coefficients in extreme flight conditions is assessed. The importance of the careful combining of wind tunnel results (or calculations) and flight results and the thorough evaluation of the mathematical model is emphasized. The basic concepts of minimization and estimation are examined for a simple computed aircraft example, and the cost functions that are to be minimized during estimation are defined and discussed. Graphic representations of the cost functions are given to help illustrate the minimization process. Finally, the basic concepts are generalized, and estimation of stability and control derivatives from flight data is discussed.

Iliff, K. W.↗

Performance of neutron spectrum unfolding using deuterated liquid scintillator

The performance of the maximum likelihood expectation maximization method for unfolding neutron energy spectra using deuterated liquid scintillator is evaluated for future utilization with rare isotope beams. High-resolution neutron energy spectra as well as the detector response matrix were measured at the Edwards Accelerator Laboratory at Ohio University. Maximum-likelihood expectation maximization (MLEM) unfolded neutron spectra are compared with spectra from neutron time-of-flight. In conclusion, the effects of the MLEM stopping criteria and spectrum statistics are also investigated.

47 OTHER INSTRUMENTATION↗

Probabilities and statistics for backscatter estimates obtained by a scatterometer with applications to new scatterometer design data

The values of the Normalized Radar Backscattering Cross Section (NRCS), sigma (o), obtained by a scatterometer are random variables whose variance is a known function of the expected value. The probability density function can be obtained from the normal distribution. Models for the expected value obtain it as a function of the properties of the waves on the ocean and the winds that generated the waves. Point estimates of the expected value were found from various statistics given the parameters that define the probability density function for each value. Random intervals were derived with a preassigned probability of containing that value. A statistical test to determine whether or not successive values of sigma (o) are truly independent was derived. The maximum likelihood estimates for wind speed and direction were found, given a model for backscatter as a function of the properties of the waves on the ocean. These estimates are biased as a result of the terms in the equation that involve natural logarithms, and calculations of the point estimates of the maximum likelihood values are used to show that the contributions of the logarithmic terms are negligible and that the terms can be omitted.

Pierson, Willard J., Jr.↗

Identification of M2/F3 stability and control derivatives from flight data containing gust effects

The application of the maximum likelihood identification technique to M2/F3 lifting body flight data containing wind gust effects is discussed. With the objective of this effort being the identification of the stability and control derivatives, it is shown first that the output error technique (or modified Newton-Raphson) fails to fit the recorded data accurately. The means of applying the maximum likelihood technique to this problem are then discussed and the results given which indicate an accurate fit to the data. The question of derivative signs opposite to the wind tunnel values is then addressed and the results of three techniques for dealing with this problem are presented. These techniques are a priori weighting, fixing parameter values, and rank deficient inverses.

Stepner, D. E.↗

A statistical technique for processing radio interferometer data

The output of a radio interferometer is the Fourier transform of the object under investigation. Due to the limited coverage of the Fourier plane, the reconstruction of the image of the source is blurred by the beam of the synthesized array. A maximum-likelihood processing technique is described which uses the statistical properties of the received noise-like signals. This technique has been used extensively in the processing of large-aperture seismic arrays. This inversion method results in a synthesized beam that is more uniform, has lower sidelobes, and higher resolution than the normal Fourier transform methods. The maximum-likelihood method algorithm was applied successfully to very long baseline and short baseline interferometric data.

Papadopoulos, G. D.↗

A Residuals Approach to Filtering, Smoothing and Identification for Static Distributed Systems

An approach for state estimation and identification of spatially distributed parameters embedded in static distributed (elliptic) system models is advanced. The method of maximum likelihood is used to find parameter values that maximize a likelihood functional for the system model, or equivalently, that minimize the negative logarithm of this functional. To find the minimum, a Newton-Raphson search is conducted that from an initial estimate generates a convergent sequence of parameter estimates. For simplicity, a Gauss-Markov approach is used to approximate the Hessian in terms of products of first derivatives. The gradient and approximate Hessian are computed by first arranging the negative log likelihood functional into a form based on the square root factorization of the predicted covariance of the measurement process. The resulting data processing approach, referred to here by the new term of predicted data covariance square root filtering, makes the gradient and approximate Hessian calculations very simple. A closely related set of state estimates is also produced by the maximum likelihood method: smoothed estimates that are optimal in a conditional mean sense and filtered estimates that emerge from the predicted data covariance square root filter.

Rodriguez, G.↗

A Hybrid Method for Tensor Decompositions that Leverages Stochastic and Deterministic Optimization

In this paper, we propose a hybrid method that uses stochastic and deterministic search to compute the maximum likelihood estimator of a low-rank count tensor with Poisson loss via state-of-theart local methods. Our approach is inspired by Simulated Annealing for global optimization and allows for fine-grain parameter tuning as well as adaptive updates to algorithm parameters. We present numerical results that indicate our hybrid approach can compute better approximations to the maximum likelihood estimator with less computation than the state-of-the-art methods by themselves.

97 MATHEMATICS AND COMPUTING↗

Forecast for a growth-rate measurement using peculiar velocities from LSST supernovae

We investigate whether the cosmic growth-rate parameter fσ 8 can be measured using peculiar velocities (PVs) derived from type Ia supernovae (SNe Ia) in the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST). We produced simulations of different SN types using a realistic LSST observing strategy that incorporated noise, a photometric detection from the difference-image analysis (DIA) pipeline, and a PV field modeled from the Uchuu universe machine simulations. We tested three different observational scenarios that ranged from ideal conditions with spectroscopic host galaxy redshifts and spectroscopic SN typing to realistic photometric typing that resulted in a contamination with non-Ia SNe. Using a maximum likelihood technique, we showed that the LSST can measure fσ 8 with a precision of 10% in the redshift range 0.02 < z < 0.14 for our most realistic scenario. In three tomographic bins, the LSST will be able to constrain the growth-rate parameter with errors below 18% up to redshift z = 0.14. We also tested the contamination effect on the maximum likelihood method and found that for a contamination fraction below ∼2%, we recovered unbiased measurements. The results of this analysis highlight that the LSST SN sample is expected to complement traditional redshift-space distortion measurements at high redshift. This will provide a novel avenue for testing general relativity and different dark energy models.

Rosselli, D↗

Combining Ratio Estimation for Low Density Parity Check (LDPC) Coding

The Low Density Parity Check (LDPC) Code decoding algorithm make use of a scaled receive signal derived from maximizing the log-likelihood ratio of the received signal. The scaling factor (often called the combining ratio) in an AWGN channel is a ratio between signal amplitude and noise variance. Accurately estimating this ratio has shown as much as 0.6 dB decoding performance gain. This presentation briefly describes three methods for estimating the combining ratio: a Pilot-Guided estimation method, a Blind estimation method, and a Simulation-Based Look-Up table. The Pilot Guided Estimation method has shown that the maximum likelihood estimates of signal amplitude is the mean inner product of the received sequence and the known sequence, the attached synchronization marker (ASM) , and signal variance is the difference of the mean of the squared received sequence and the square of the signal amplitude. This method has the advantage of simplicity at the expense of latency since several frames worth of ASMs. The Blind estimation method s maximum likelihood estimator is the average of the product of the received signal with the hyperbolic tangent of the product combining ratio and the received signal. The root of this equation can be determined by an iterative binary search between 0 and 1 after normalizing the received sequence. This method has the benefit of requiring one frame of data to estimate the combining ratio which is good for faster changing channels compared to the previous method, however it is computationally expensive. The final method uses a look-up table based on prior simulated results to determine signal amplitude and noise variance. In this method the received mean signal strength is controlled to a constant soft decision value. The magnitude of the deviation is averaged over a predetermined number of samples. This value is referenced in a look up table to determine the combining ratio that prior simulation associated with the average magnitude of the deviation. This method is more complicated than the Pilot-Guided Method due to the gain control circuitry, but does not have the real-time computation complexity of the Blind Estimation method. Each of these methods can be used to provide an accurate estimation of the combining ratio, and the final selection of the estimation method depends on other design constraints.

Mahmoud, Saad↗

Estimation of Time-Varying Pilot Model Parameters

Human control behavior is rarely completely stationary over time due to fatigue or loss of attention. In addition, there are many control tasks for which human operators need to adapt their control strategy to vehicle dynamics that vary in time. In previous studies on the identification of time-varying pilot control behavior wavelets were used to estimate the time-varying frequency response functions. However, the estimation of time-varying pilot model parameters was not considered. Estimating these parameters can be a valuable tool for the quantification of different aspects of human time-varying manual control. This paper presents two methods for the estimation of time-varying pilot model parameters, a two-step method using wavelets and a windowed maximum likelihood estimation method. The methods are evaluated using simulations of a closed-loop control task with time-varying pilot equalization and vehicle dynamics. Simulations are performed with and without remnant. Both methods give accurate results when no pilot remnant is present. The wavelet transform is very sensitive to measurement noise, resulting in inaccurate parameter estimates when considerable pilot remnant is present. Maximum likelihood estimation is less sensitive to pilot remnant, but cannot detect fast changes in pilot control behavior.

Zaal, Peter M. T.↗

Software models: A Bayesian approach to parameter estimation in the Jelenski-Moranda software reliability model

Maximum likelihood estimation procedures for the Jelinski-Moranda software reliability model often give misleading answers. A reparameterization and a Bayesian analysis eliminate some of the problems incurred by MLE methods and often give better predictions on sets of real and simulated data. Practical difficulties in estimating the initial number of errors N and the failure rate of each error phi by the method of maximum likelihood are: N, the MLE of N, is occasionally infinite (i.e., the routines for calculating N and phi do not converge). It is shown that N is finite sub i only if the regression line of the interevent times t sub i vs. i has positive slope. A serious problem is that often N approximates n, the sample size, and sometimes N = n. Thus the MLE predicts that the program is perfect even when it is far from being so. Only when almost all failures have been removed can N and phi be trusted near the end of debugging.

Littlewood, B.↗

On-line methods for rotorcraft aeroelastic mode identification

The requirements for the on-line identification of rotorcraft aeroelastic blade modes from random response test data are presented. A recursive maximum likelihood (RML) technique is used in conjunction with a bandpass filter to identify isolated blade mode damping and frequency. The RML technique is demonstrated to have excellent convergence characteristics in random measurement noise and random process noise excitation. The RML identification technique uses an ARMA representation for the aeroelastic stochastic system and requires virtually no user interaction while providing accurate confidence bands on the parameter estimates. Comparisons are made with an off-line Newton type maximum likelihood algorithm which uses a state variable model representation. Results are presented from simulation random response data which quantify the identifed parameter convergence behavior for various levels of random excitation which is typical of wind tunnel turbulence levels. The RML technique is applied to hingless rotor test data from the NASA Langley Research Center Helicopter Hover Facility.

Molusis, J. A.↗

A Machine Learning Method for the Forensics Attribution of Separated Plutonium

Plutonium (Pu) source attribution would be a powerful tool to support nuclear nonproliferation efforts. This capability to find the source of a Pu sample would act as a deterrent to smuggling efforts, and also help regulatory agencies verify declared nuclear activities. Work at Texas A&M University yielded a nuclear forensics methodology, which is capable of determining separated Pu’s reactor of origin, fuel burnup, and the time since irradiation (TSI)—three parameters of interest. The methodology used a set of ten intra-element isotopic ratios found in separated Pu, which was compared to a library of isotopic ratio values produced using neutronics simulations for reactors of interest. By calculating the probability that unknown Pu sample’s isotopic ratio set matched a set in the library, the methodology could predict the three parameters of interest of the sample. One shortcoming of this methodology was an inability to correctly attribute spoofed Pu, where Pu sourced from two different reactors or two different fuel burnup levels are mixed. A new methodology to rectify this vulnerability using machine learning (ML) technique is developed, instead of the maximum likelihood calculation previously used and the results are satisfactory. The ML approach leverages the existing simulated data for training the algorithm, but use them efficiently by only using intra-element isotope ratios that contribute to the attribution one of the three parameters at a time. Previously, all isotope ratios were used to attribute all three parameters together. The new methodology attributes the Pu parameters in three steps, one for each parameter, rather than resolving all of the three parameters simultaneously like the previous maximum likelihood approach. First, a support vector machine classifier with a set of seven isotopic ratios finds the reactor of origin and a set of regression models trained using gaussian process predicts the burnup with a different set of seven isotopes. Finally, TSI is calculated analytically using decay equations. Thus far, the new methodology is capable of attributing pure Pu samples and has been validated using experimental data. The next step will to be augment the classifier training data set with spoofed Pu data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗