Engineering PapersSearch

SEARCH · Engineering Papers

Results for “count data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]

Bayesian Blocks: A New Method to Analyze Photon Counting Data

A Bayesian analysis of photon-counting data leads to a new time-domain algorithm for detecting localized structures (bursts), revealing pulse shapes, and generally characterizing intensity variations. The raw counting data -- time-tag events (TTE), time-to-spill (TTS) data, or binned counts -- is converted to a maximum likelihood segmentation of the observation into time intervals during which the photon arrival rate is perceptibly constant -- i.e. has a fixed intensity without statistically significant variations. The resulting structures, Bayesian Blocks, can be thought of as bins with arbitrary spacing determined by the data. The method itself sets no lower limit to the time scale on which variability can be detected. We have applied the method to RXTE data on Cyg X-1, yielding information on this source's short-time-scale variability.

Scargle, Jeffrey D.

Performance of a Discrete Wavelet Transform for Compressing Plasma Count Data and its Application to the Fast Plasma Investigation on NASA's Magnetospheric Multiscale Mission

Plasma measurements in space are becoming increasingly faster, higher resolution, and distributed over multiple instruments. As raw data generation rates can exceed available data transfer bandwidth, data compression is becoming a critical design component. Data compression has been a staple of imaging instruments for years, but only recently have plasma measurement designers become interested in high performance data compression. Missions will often use a simple lossless compression technique yielding compression ratios of approximately 2:1, however future missions may require compression ratios upwards of 10:1. This study aims to explore how a Discrete Wavelet Transform combined with a Bit Plane Encoder (DWT/BPE), implemented via a CCSDS standard, can be used effectively to compress count information common to plasma measurements to high compression ratios while maintaining little or no compression error. The compression ASIC used for the Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale mission (MMS) is used for this study. Plasma count data from multiple sources is examined: resampled data from previous missions, randomly generated data from distribution functions, and simulations of expected regimes. These are run through the compression routines with various parameters to yield the greatest possible compression ratio while maintaining little or no error, the latter indicates that fully lossless compression is obtained. Finally, recommendations are made for future missions as to what can be achieved when compressing plasma count data and how best to do so.

Particles

Tensor decompositions for count data that leverage stochastic and deterministic optimization

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank, nonnegative CPD model to Poisson-distributed count data is of particular interest. Several popular algorithms use local search methods to approximate the maximum likelihood estimator (MLE) of the Poisson CPD model. Here, this work presents two new algorithms that extend state-of-the-art local methods for Poisson CPD. Hybrid GCP-CPAPR combines Generalized Canonical Decomposition (GCP) with stochastic optimization and CP Alternating Poisson Regression (CPAPR), a deterministic algorithm, to increase the probability of converging to the MLE over either method used alone. Restarted CPAPR with SVDrop uses a heuristic based on the singular values of the CPD model unfoldings to identify convergence toward optimizers that are not the MLE and restarts within the feasible domain of the optimization problem, thus reducing overall computational cost when using a multi-start strategy. We provide empirical evidence that indicates our approaches outperform existing methods with respect to converging to the Poisson CPD MLE.

CPAPR

Performance of a Space-Based Wavelet Compressor for Plasma Count Data on the MMS Fast Plasma Investigation

Data compression has been a staple of imaging instruments for years. Recently, plasma measurements have utilized compression with relatively low compression ratios. The Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale (MMS) mission generates data roughly 100 times faster than previous plasma instruments, requiring a higher compression ratio to fit within the telemetry allocation. This study investigates the performance of a space-based compression standard employing a Discrete Wavelet Transform and a Bit Plane Encoder (DWT/BPE) in compressing FPI plasma count data. Data from the first 6 months of FPI operation are analyzed to explore the error modes evident in the data and how to adapt to them. While approximately half of the Dual Electron Spectrometer (DES) maps had some level of loss, it was found that there is little effect on the plasma moments and that errors present in individual sky maps are typically minor. The majority of Dual Ion Spectrometer burst sky maps compressed in a lossless fashion, with no error introduced during compression. Because of induced compression error, the size limit for DES burst images has been increased for Phase 1B. Additionally, it was found that the floating point compression mode yielded better results when images have significant compression error, leading to floating point mode being used for the fast survey mode of operation for Phase 1B. Despite the suggested tweaks, it was found that wavelet-based compression, and a DWT/BPE algorithm in particular, is highly suitable to data compression for plasma measurement instruments and can be recommended for future missions.

plasma

The equivalence of three techniques for estimating ground reflectance from LANDSAT digital count data

The equivalence of three separate investigations that related LANDSAT digital count (DC) to ground measured reflectance (R) was demonstrated. One investigator related DC data to the cosZ, where Z is the solar zenith angle, for surfaces of constant R. The second investigator corrected the DC data to the solar zenith angle of 39 degrees before relating to surface R. Both of these investigators used LANDSAT 1 and 2 data from overpass dates 1972 through 1977. A third investigator calculated the relation between DC and R based on atmospheric radiative transfer theory. The equation coefficients obtained from these three investigators for all four LANDSAT MSS bands were shown to be equivalent although differences in ground reflectance measurement procedures have created coefficient variations among the three investigations. These relations should be useful for testing atmospheric radiative transfer theory.

Richardson, A. J.

Digital first order hold circuit

There is provided a digitally controlled first order hold circuit and waveform synthesizer for digitally controlling the representation of a function over an approximation interval. In accordance with the operation of the invention, the first order hold circuit and waveform generator receives a digital data input signal which contains initial condition data, up/down data, and slope data for the approximation interval. The initial condition data is loaded into an up/down counter which is incremented using counting data at a rate depending on the value of the slope data and in a direction depending on the value of the up-down data. In order to minimize delays arising from data acquistion, two frequency synthesizer circuits are provided such that one frequency synthesizer provides counting data while the other frequency synthesizer receives slope data. During alternating intervals, the other frequency synthesizer circuit provides counting data while the other circuit receives slope data. In addition, long length data input signals covering a plurality of approximation intervals are provided to reduce the demands on a main system central processing unit.

Chan, Fred N.

Multiparameter linear least-squares fitting to Poisson data one count at a time

A standard problem in gamma-ray astronomy data analysis is the decomposition of a set of observed counts, described by Poisson statistics, according to a given multicomponent linear model, with underlying physical count rates or fluxes which are to be estimated from the data. Despite its conceptual simplicity, the linear least-squares (LLSQ) method for solving this problem has generally been limited to situations in which the number n(sub i) of counts in each bin i is not too small, conventionally more than 5-30. It seems to be widely believed that the failure of the LLSQ method for small counts is due to the failure of the Poisson distribution to be even approximately normal for small numbers. The cause is more accurately the strong anticorrelation between the data and the wieghts w(sub i) in the weighted LLSQ method when square root of n(sub i) instead of square root of bar-n(sub i) is used to approximate the uncertainties, sigma(sub i), in the data, where bar-n(sub i) = E(n(sub i)), the expected value of N(sub i). We show in an appendix that, avoiding this approximation, the correct equations for the Poisson LLSQ (PLLSQ) problems are actually identical to those for the maximum likelihood estimate using the exact Poisson distribution. We apply the method to solve a problem in high-resolution gamma-ray spectroscopy for the JPL High-Resolution Gamma-Ray Spectrometer flown on HEAO 3. Systematic error in subtracting the strong, highly variable background encountered in the low-energy gamma-ray region can be significantly reduced by closely pairing source and background data in short segments. Significant results can be built up by weighted averaging of the net fluxes obtained from the subtraction of many individual source/background pairs. Extension of the approach to complex situations, with multiple cosmic sources and realistic background parameterizations, requires a means of efficiently fitting to data from single scans in the narrow (approximately = 1.2 keV, HEAO 3) energy channels of a Ge spectrometer, where the expected number of counts obtained per scan may be very low. Such an analysis system is discussed and compared to the method previously used.

Wheaton, Wm. A.

Performance Analysis of Airborne Photon-Counting Lidar Data in Preparation for the ICESat-2 Mission

Two airborne photon-counting laser altimeters have been deployed in direct support of National Aeronautics and Space Adminsitration (NASA's) upcoming Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission. Multiple Altimeter Beam Experimental Lidar (MABEL) was developed specifically for ICESat-2 testing and development. MABEL data are used to simulate key aspects of the ICESat-2 measurement strategy and are critical to the development of the algorithms for geophysical data-product generation. Slope Imaging Multipolarization Photon-counting Lidar (SIMPL) is a NASA Goddard Space Flight Center instrument that has also been deployed in support of ICESat-2 performance discovery. Both instruments are photon-counting, small footprint laser altimeters that sample in both the 532- and 1064-nm wavelengths. And both instruments serve as a proxy for ICESat-2 operational performance and error assessment and a basis for the development of potential validation strategies. This paper provides an overview of how data from MABEL and SIMPL overflights have specifically provided the foundation for understanding the quality of ICESat-2 data and how we can plan to evaluate ICESat-2 products through comparison with other modalities of lidar data and/or groundtruth locations using ground fiducials.

MABEL

Evolution of Combustion-Generated Particles at Tropospheric Conditions

This paper describes particle evolution measurements taken in the Particulate Aerosol Laboratory (PAL). The PAL consists of a burner capable of burning jet fuel that exhausts into an altitude chamber that can simulate temperature and pressure conditions up to 13,700 m. After presenting results from initial temperature distributions inside the chamber, particle count data measured in the altitude chamber are shown. Initial particle count data show that the sampling system can have a significant effect on the measured particle distribution: both the value of particle number concentration and the shape of the radial distribution of the particle number concentration depend on whether the measurement probe is heated or unheated.

Tacina, Kathleen M.

A Frequency Analysis Approach for Categorizing Air Traffic Behavior

A method of analyzing National Air Space (NAS) air traffic that uses the Discrete Fourier Transform (DFT) is presented. The DFT is used to transform time domain traffic count data into the frequency domain where the sources of traffic in air spaces can be identified and characterized more easily. It is shown in simulation that individual traffic flows within Air Route Traffic Control Centers can be distinguished by their periodicity in the DFT plot. Next, three Traffic Management Initiatives (playbook rerouting, metered flows, and Ground Delay Programs) are implemented in simulations and their signature effects on the traffic are identified using the DFT. Finally, historical flight data is studied and the DFT is applied to sector traffic count data. It is found that in many cases, variations in traffic due to rerouting and convective weather disturbances are better highlighted in the frequency domain than in the original time domain data. Initial results of the DFT show it has potential as a tool for measuring and/or predicting NAS behavior for daily tactical planning and control purposes.

fourier transform

Characterizing the System Impulse Response Function from Photon-Counting LiDAR Data

NASA's Multiple Altimeter Beam Experimental LiDAR (MABEL) is an aircraft-based photon-counting laser altimeter designed as a simulator to test measurement techniques and algorithms for Advanced Topographic Laser Altimeter System (ATLAS), the sole instrument on NASA's Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission. By measuring the time of flight, pointing angle, and absolute position for individual photons, ICESat-2 provides detailed elevation measurements of earth's surface. Calculating accurate and precise elevations requires an understanding of how photons interact with surfaces, and characterization of the photon distribution after returning from surfaces. Neither MABEL nor ATLAS records the transmitted laser pulse shape, relying instead on aggregating several pulses worth of photons, often using histograms, to characterize the pulse shape. In this paper, we assess the limitations of using histograms and propose a more robust method to describe MABEL's system impulse-response function using an exponentially modified Gaussian distribution. We also provide standard error estimates for the arithmetic mean and standard deviation calculations, and for exponentially modified Gaussian parameters using a Monte Carlo sensitivity analysis. We apply this method to photon returns from a sea ice lead and from a dry salt lake bed as case studies for estimating the standard error associated with sample size for the arithmetic mean and standard deviation, and for the exponentially modified Gaussian parameters. We use these standard errors to calculate the minimum number of photons required to find both Gaussian and exponentially modified Gaussian distribution parameters within 3 cm of their parent population values.

photoncounting