Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sampling algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Model Analysis ToolKit

MATK provides basic functionality to facilitate model analysis within the Python computational environment. Model analysis setup within MATK includes: - define parameters - define observations - define model (python function) - define samplesets (sets of parameter combinations) Currently supported functionality includes: - forward model runs - Latin-Hypercube sampling of parameters - multi-dimensional parameter studies - parallel execution of parameter samples - model calibration using internal Levenberg-Marquardt algorithm - model calibration using lmfit package - model calibration using levmar package - Markov Chain Monte Carlo using pymc package MATK facilitates model analysis using: - scipy - calibration (scipy.optimize) - rpy2 - Python interface to R

Harp, DylanR.↗

Real-Time Dynamic Brake Assessment Proof of Concept Final Report

This proof-of-concept research was performed to explore the feasibility of using real-world braking data from commercial motor vehicles to make a diagnosis of brake condition similar to that of the performance-based brake tester (PBBT). This was done by determining the relationship between pressure and brake force (P-BF), compensating for the gross vehicle weight (GVW). The nature of this P-BF relationship (e.g., low braking force for a given brake application pressure) may indicate brake system problems. In order to determine the relationship between brake force and brake application pressure, a few key parameters of duty cycle information were collected. Because braking events are often brief, spanning only a few seconds, a sample rate of 10 Hz was needed. The algorithm under development required brake application pressure and speed (from which deceleration was calculated). Accurate weight estimation was also needed to properly derive the braking force from the deceleration. In order to ensure that braking force was the predominant factor in deceleration for the segments of data used in analysis, the data was screened for grade as well. Also, the analysis needed to be based on pressures above the crack pressure. The crack pressure is the pressure below which the individual brakes are not applied due the nature of the mechanical system. This value, which may vary somewhat from one wheel end to another, is approximately 10 psi. Therefore, only pressures 15 psi and above were used in the analysis. The Department of Energy s Medium Truck Duty Cycle research has indicated that under the real-world circumstances of the test vehicle brake pressures of up to approximately 30 psi can be expected. Several different types of data were collected during the testing task of this project. Constant-pressure stopping tests were conducted at several combinations of brake application pressure (15, 20, 25, and 30 psi), load conditions (moderately and fully laden), and speeds (20 and 30 mph). Data was collected at 10 Hz. Standard and stepped-pressure performance-based brake tests with brake pressure transducers were performed for each loading condition. The stepped-pressure test included the constant-pressure intervals of brake application at 15, 20, 25, and 30 psi. The PBBT data files included 10 Hz streaming data collected during the testing of each axle. Two weeks of real-world duty cycle (driving and braking) data was also collected at 10 Hz. Initial analysis of the data revealed that the data collected in the field (i.e., day-to-day operations) provided the same information as that obtained from the controlled tests. Analysis of the data collected revealed a strong linear relationship between brake application pressure and deceleration for given GVWs. As anticipated, initial speed was not found to be a significant factor in the deceleration-pressure relationship, unlike GVW. The positive results obtained from this proof of concept test point to the need for further research to expand this concept. A second phase should include testing over a wider range of speeds and include medium brake application pressures in addition to the low pressures tested in this research. Testing on multiple vehicles would also be of value. This future phase should involve testing to determine how degradation of braking performance affects the pressure-deceleration relationship.

99 GENERAL AND MISCELLANEOUS↗

Deep PDF parsing to extract features for detecting embedded malware.

The number of PDF files with embedded malicious code has risen significantly in the past few years. This is due to the portability of the file format, the ways Adobe Reader recovers from corrupt PDF files, the addition of many multimedia and scripting extensions to the file format, and many format properties the malware author may use to disguise the presence of malware. Current research focuses on executable, MS Office, and HTML formats. In this paper, several features and properties of PDF Files are identified. Features are extracted using an instrumented open source PDF viewer. The feature descriptions of benign and malicious PDFs can be used to construct a machine learning model for detecting possible malware in future PDF files. The detection rate of PDF malware by current antivirus software is very low. A PDF file is easy to edit and manipulate because it is a text format, providing a low barrier to malware authors. Analyzing PDF files for malware is nonetheless difficult because of (a) the complexity of the formatting language, (b) the parsing idiosyncrasies in Adobe Reader, and (c) undocumented correction techniques employed in Adobe Reader. In May 2011, Esparza demonstrated that PDF malware could be hidden from 42 of 43 antivirus packages by combining multiple obfuscation techniques [4]. One reason current antivirus software fails is the ease of varying byte sequences in PDF malware, thereby rendering conventional signature-based virus detection useless. The compression and encryption functions produce sequences of bytes that are each functions of multiple input bytes. As a result, padding the malware payload with some whitespace before compression/encryption can change many of the bytes in the final payload. In this study we analyzed a corpus of 2591 benign and 87 malicious PDF files. While this corpus is admittedly small, it allowed us to test a system for collecting indicators of embedded PDF malware. We will call these indicators features throughout the rest of this report. The features are extracted using an instrumented PDF viewer, and are the inputs to a prediction model that scores the likelihood of a PDF file containing malware. The prediction model is constructed from a sample of labeled data by a machine learning algorithm (specifically, decision tree ensemble learning). Preliminary experiments show that the model is able to detect half of the PDF malware in the corpus with zero false alarms. We conclude the report with suggestions for extending this work to detect a greater variety of PDF malware.

99 GENERAL AND MISCELLANEOUS↗

Probabilistic Look-ahead Contingency Analysis Integrated with GE EMS Tool

This report documents implementation of the smart sampling-based probabilistic look-ahead contingency analysis algorithm, the integration with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool, and the case study results using real world data from the Bonneville Power Administration (BPA).The probabilistic look-ahead contingency analysis algorithm incorporates forecast errors of renewable energy and load into contingency analysis functions to enable a predictive capability with a more complete picture, revealing the potential violations that are not normally detected by traditional deterministic approaches. To test its performance under practical environments, the probabilistic look-ahead contingency analysis algorithm has been integrated with the dominant GE EMS tool as a proof-of-concept for a seamless integration. To meet the output format of GE EMS tool, an extreme value distribution (EVD) algorithm is newly adapted to analyze the GE EMS’s violation-only output. Real world data from BPA are used to test its performance, and the results clearly show the effectiveness of the developed algorithm and improved situational awareness. This effort is an example of successful technology transition and cooperation under a real-world environment because it is a joint effort from department of energy, a national laboratory, a commercial vendor, and a large utility.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Multi-Mission Maximum Likelihood framework (3ML)

The age of multi-wavelength and multi-messenger astronomy has arrived and with it, new tools are needed to analyze data from multiple instruments properly and with ease. The Multi-Mission Maximum Likelihood framework (3ML) provides this functionality via the novel use of instrument plugins which allow for every instrument’s unique data to be treated independently with an appropriate likelihood. Under the 3ML framework, users can design plugins that handle instrument specific data routines transparently in the background. When multiple instruments are used together, their independent likelihoods are treated under a common minimization or Bayesian sampling framework. 3ML provides a multitude of minimization algorithm for maximum likelihood estimation (MLE) as well as several popular Bayesian posterior samplers. The entire framework is provided via a modern Python interface providing the user with a modern and easily transportable analysis framework well suited for modern astronomy. New models can be added easily. It is also possible to perform time-energy modeling. We present the framework and its main functionalities.

79 ASTRONOMY AND ASTROPHYSICS↗

A programmable microcomputer for real time speech processing

The implementation of a programmable microprocessor for real time speech processing is described. The design of a fast special-purpose computer operating at 150 nsec per instruction time reduces the problem of speech encoding and decoding to a software problem. Each instruction is a twelve-bit word, and the information conveyed by a word is explained. The microprocessor is controlled by two clocks - the A/D clock, or input sampling clock, which loads the digital input into the input register and presets the counter to a value set by the external switches; and the instruction clock, or system clock, which operates at 6 MHz. At this system clock rate and a sampling clock rate of 30 KHz, 200 instructions can be executed between samples, and for many speech encoding and decoding algorithms, 200 instructions are more than enough. The microcomputer is being used to test various delta modulator encoding algorithms.

Apelewicz, T.↗

Evaluation of the procedure 1A component of the 1980 US/Canada wheat and barley exploratory experiment

Several techniques which use clusters generated by a new clustering algorithm, CLASSY, are proposed as alternatives to random sampling to obtain greater precision in crop proportion estimation: (1) Proportional Allocation/relative count estimator (PA/RCE) uses proportional allocation of dots to clusters on the basis of cluster size and a relative count cluster level estimate; (2) Proportional Allocation/Bayes Estimator (PA/BE) uses proportional allocation of dots to clusters and a Bayesian cluster-level estimate; and (3) Bayes Sequential Allocation/Bayesian Estimator (BSA/BE) uses sequential allocation of dots to clusters and a Bayesian cluster level estimate. Clustering in an effective method in making proportion estimates. It is estimated that, to obtain the same precision with random sampling as obtained by the proportional sampling of 50 dots with an unbiased estimator, samples of 85 or 166 would need to be taken if dot sets with AI labels (integrated procedure) or ground truth labels, respectively were input. Dot reallocation provides dot sets that are unbiased. It is recommended that these proportion estimation techniques are maintained, particularly the PA/BE because it provides the greatest precision.

Chapman, G. M.↗

Identification of hydrothermal alteration assemblages using airborne imaging spectrometer data

Airborne Imaging Spectrometer (AIS) data, field and laboratory spectra and samples for X-ray diffraction analysis were collected in argillically altered Tertiary volcanic rocks in the Hot Creek Range, Nevada. From laboratory and field spectral measurements in the 2.0 to 2.4 micron range and using a spectroradiometer with a 4 nm sampling interval, the absorption band centers for kaolinite were loacted at 2.172 and 2.215 microns, for montmorillonite at 2.214 micron and for illite at 2.205. Based on these values and the criteria for resolution and separtion of spectral features, a spectral sampling interval of less than 4 nm is necessary to separate the clays. With an AIS spectral sampling interval of 9.3 nm, a spectral matching algorithm is more effective for separating kaolinite, montmorillonite, ad illite in Hot Creek Range than using the location of absorption minima alone.

Feldman, S. C.↗

A simplified wind vector algorithm for satellite scatterometers

A simplified algorithm is derived for retrieving wind vectors from microwave scatterometer observations. The azimuthal dependence of the sea-surface radar cross section is modeled by a double-cosine function, rather than the traditional second-order cosine expansion. The algorithm is tested using the aircraft scatterometer observations obtained during the AAFE-RADSCAT Experiment in 1975 and 1976. There is little difference between the performance of the simplified algorithm and the more involved least-squares searching algorithm. The AAFE-RADSCAT aircraft observations are sampled so as to simulate the three-look satellite scatterometer NSCAT that will be launched on the Japanese Advanced Earth Observing Satellite. The results of the retrievals indicate that it is probably not possible to uniquely determine the wind direction using just NSCAT observations because of a 180 degree ambiguity. However, if forecast models can predict the wind direction to an accuracy of +/- 90 deg, thereby eliminating the ambiguity, then the results indicate that NSCAT can determine the wind direction to an accuracy of about +/- 20 deg. Better performance is obtained when the three observations are the same polarization (either v-pol or h-pol), as compared to using a mix of v-pol and h-pol observations.

Wentz, Frank J.↗

Imaging spectrometer measurement of water vapor in the 400 to 2500 nm spectral region

The Airborne Visible-Infrared Imaging Spectrometer (AVIRIS) measures the total upwelling spectral radiance from 400 to 2500 nm sampled at 10 nm intervals. The instrument acquires spectral data at an altitude of 20 km above sea level, as images of 11 by up to 100 km at 17x17 meter spatial sampling. We have developed a nonlinear spectral fitting algorithm coupled with a radiative transfer code to derive the total path water vapor from the spectrum, measured for each spatial element in an AVIRIS image. The algorithm compensates for variation in the surface spectral reflectance and atmospheric aerosols. It uses water vapor absorption bands centered at 940 nm, 1040 nm, and 1380 nm. We analyze data sets with water vapor abundances ranging from 1 to 40 perceptible millimeters. In one data set, the total path water vapor varies from 7 to 21 mm over a distance of less than 10 km. We have analyzed a time series of five images acquired at 12 minute intervals; these show spatially heterogeneous changes of advocated water vapor of 25 percent over 1 hour. The algorithm determines water vapor for images with a range of ground covers, including bare rock and soil, sparse to dense vegetation, snow and ice, open water, and clouds. The precision of the water vapor determination approaches one percent. However, the precision is sensitive to the absolute abundance and the absorption strength of the atmospheric water vapor band analyzed. We have evaluated the accuracy of the algorithm by comparing several surface-based determinations of water vapor at the time of the AVIRIS data acquisition. The agreement between the AVIRIS measured water vapor and the in situ surface radiometer and surface interferometer measured water vapor is 5 to 10 percent.

Green, Robert O.↗

NASA's Scientific Agenda for GPM Mission

The objectives of the Global Precipitation Measurement (GPM) Mission are to: 1) Understand the horizontal and vertical structure of rainfall, its macro- and micro-physical nature, and its associated latent heating, 2) Train and calibrate retrieval algorithms for constellation radiometers, 3) Provide sufficient global sampling to significantly reduce uncertainties in short-term rainfall accumulations, and 4) Extend scientific and societal applications. The GPM mission design consists of a core satellite, constellation satellties, precipitation validation sites for error characterization, and a precipitation processing center. This viewgraph presentation profiles the science goals of the mission, and its capability for producing climate data and weather predictions.

Smith, Eric A.↗

Status of the L2 and Lunar Charged Particle Environment Models

The L2 Charged Particle Environment (L2-CPE) model is an engineering tool which provides free field charged particle environments for distant magnetotail, magnetosheath, and solar wind environments. L2-CPE is intended for use in assessing contributions from low energy radiation environments (4.1 keV to few MeV) to radiation dose in thin materials used in construction of spacecraft to be placed in orbit about the Sun-Earth L2 point. This paper describes the status of the current version of the L2-CPE model including structure of the model used to organize plasma environments into solar wind, magnetosheath, and magnetotail environments, the algorithms used to estimate radiation fluence in sparsely sampled environments, the updated graphical user interface, and output options for flux and fluence environments. In addition, we describe the status and plans for updating the model to include environments relevant to lunar programs.

Minow, Joseph I.↗

Laboratory Reflectance Spectra of 160 Minerals, 0.4 to 2.5 Micrometers

This reports provides reflectance spectra of 160 minerals in both digital and printed form. In order to demonstrate the effect of particle size on reflectance, the spectral data for 135 of the minerals are presented at three different grain sizes. These are 125-500 microns, 45-125 microns and less than 45 microns. Ancillary information is provided with each mineral spectrum, which includes the mineral name, minerology, supplier, sampling locality and our designated sample number. The purity of every mineral sample was evaluated by X-ray diffraction (XRD). The composition of certain minerals known to deviate strongly from idealized end-member compositions was determined by electron microprobe analysis. The compositional information obtained by microbe analysis and accessory minerals identified by XRD are noted with the ancillary information. In addition, the spectrum acquired from the coarsest grain size available for each sample was processed with a feature-finding algorithm to quantify the characteristics of the spectral absorption features. All the reflectance spectra presented here are provided in digital form on IBM-compatible 3.5" diskettes. Also included on diskette is a program for displaying the spectral data and searching for spectral features that runs on an IBM-compatible PC with standard VCA graphics.

reflectance spectra↗

Estimating Random Errors Due to Shot Noise in Backscatter Lidar Observations

In this paper, we discuss the estimation of random errors due to shot noise in backscatter lidar observations that use either photomultiplier tube (PMT) or avalanche photodiode (APD) detectors. The statistical characteristics of photodetection are reviewed, and photon count distributions of solar background signals and laser backscatter signals are examined using airborne lidar observations at 532 nm using a photon-counting mode APD. Both distributions appear to be Poisson, indicating that the arrival at the photodetector of photons for these signals is a Poisson stochastic process. For Poisson-distributed signals, a proportional, one-to-one relationship is known to exist between the mean of a distribution and its variance. Although the multiplied photocurrent no longer follows a strict Poisson distribution in analog-mode APD and PMT detectors, the proportionality still exists between the mean and the variance of the multiplied photocurrent. We make use of this relationship by introducing the noise scale factor (NSF), which quantifies the constant of proportionality that exists between the root-mean-square of the random noise in a measurement and the square root of the mean signal. Using the NSF to estimate random errors in lidar measurements due to shot noise provides a significant advantage over the conventional error estimation techniques, in that with the NSF uncertainties can be reliably calculated from/for a single data sample. Methods for evaluating the NSF are presented. Algorithms to compute the NSF are developed for the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) lidar and tested using data from the Lidar In-space Technology Experiment (LITE). OCIS Codes:

Liu, Zhaoyan↗

Development of an AQUA Based Near-Surface Parameter Retrieval

The production of a satellite based turbulent surface flux product relies critically upon the near-surface input parameters. Development of retrieval algorithms for the necessary near-surface variables of wind speed, specific humidity, air temperature, and sea surface temperature has proceeded relatively independent of each another until recently. The use of a neural network approach using Special Sensor Microwave/Imager (SSM/I) data in conjunction with a first guess sea surface temperature has led to successful retrieval of all parameters simultaneously. However, SSM/I frequencies lack inherent sensitivity to the sea surface temperature (SST). Recent studies have found improved air temperature and humidity retrievals can be obtained via inclusion of microwave sounding channels weighted in the lower troposphere. The inclusion of SSM/I-like frequencies as well as SST-sensitive microwave channels on AMSR-E along with AMSU-A sounding data onboard the AQUA platform provides an unique opportunity. That is the ability to provide near-simultaneous (in space and time) measurements allowing the retrieval of all the near-surface variables, including SST. This study shows results of a new algorithm designed to take advantage of the unique sampling ability of AQUA based sensors. Results from a neural network based methodology will be shown as compared to in-situ based observations of near-surface variables. Implications for creation of an AQUA based turbulent surface product are also discussed.

Roberts, Brent↗

An Overview of Atmospheric Composition OSSE Activities at NASA's Global Modeling and Assimilation Office

A model-based Observing System Simulation Experiment (OSSE) is a framework for numerical experimentation in which observables are simulated from fields generated by an earth system model, including a parameterized description of observational error characteristics. Simulated observations can be used for sampling studies, quantifying errors in analysis or retrieval algorithms, and ultimately being a planning tool for designing new observing missions. While this framework has traditionally been used to assess the impact of observations on numerical weather prediction, it has a much broader applicability, in particular to aerosols and chemical constituents. In this talk we will give a general overview of Observing System Simulation Experiments (OSSE) activities at NASA's Global Modeling and Assimilation Office, with focus on its emerging atmospheric composition component.

daSilva, Arlinda↗

Mapping Impervious Surface Expansion using Medium-resolution Satellite Image Time Series: A Case Study in the Yangtze River Delta, China

Cities have been expanding rapidly worldwide, especially over the past few decades. Mapping the dynamic expansion of impervious surface in both space and time is essential for an improved understanding of the urbanization process, land-cover and land-use change, and their impacts on the environment. Landsat and other medium-resolution satellites provide the necessary spatial details and temporal frequency for mapping impervious surface expansion over the past four decades. Since the US Geological Survey opened the historical record of the Landsat image archive for free access in 2008, the decades-old bottleneck of data limitation has gone. Remote-sensing scientists are now rich with data, and the challenge is how to make best use of this precious resource. In this article, we develop an efficient algorithm to map the continuous expansion of impervious surface using a time series of four decades of medium-resolution satellite images. The algorithm is based on a supervised classification of the time-series image stack using a decision tree. Each imerpervious class represents urbanization starting in a different image. The algorithm also allows us to remove inconsistent training samples because impervious expansion is not reversible during the study period. The objective is to extract a time series of complete and consistent impervious surface maps from a corresponding times series of images collected from multiple sensors, and with a minimal amount of image preprocessing effort. The approach was tested in the lower Yangtze River Delta region, one of the fastest urban growth areas in China. Results from nearly four decades of medium-resolution satellite data from the Landsat Multispectral Scanner (MSS), Thematic Mapper (TM), Enhanced Thematic Mapper plus (ETM+) and China-Brazil Earth Resources Satellite (CBERS) show a consistent urbanization process that is consistent with economic development plans and policies. The time-series impervious spatial extent maps derived from this study agree well with an existing urban extent polygon data set that was previously developed independently. The overall mapping accuracy was estimated at about 92.5% with 3% commission error and 12% omission error for the impervious type from all images regardless of image quality and initial spatial resolution.

Gao, Feng↗