Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Wildfires Risk Evaluation of the System (WiRES) Framework Tool

The invention is a set of algorithms and calculations for a performance-based model to translate wildfire burn potential to actual transmission line outages in real-time in an interactive application that uses geospatial data sets on the wildfire burn potential as well as detailed grid topographical datasets.

Chalishazar, Vishvas↗

Evaluation of the Impacts of Biomass Burning Aerosols on the NASA GEOS Sub-Seasonal Climate Forecasts

Emission sources of trace gases and aerosol particles in the South American (SA)and African (Af) continents have a strong seasonal and space variability associated with the extensive vegetation fires activities. In both continents, during the austral winter, the fires affect mainly tropical forest and savannah-type biomes and are mostly associated with deforestation and agricultural/pasture land management. Smoke aerosol particles, on average, contribute to at least 90% of the total aerosol optical depth (AOD) in the visible spectrum in the case of the South America regional smoke. Smoke aerosols also act as cloud condensation nuclei affecting cloud microphysics properties and therefore, changing the radiation budget, hydrological cycle and global circulation patterns over disturbed areas (Kaufman, 1995; Rosenfeld, 1999; Andreae,et al., 2004; Koren et al., 2004, Zhang, 2008; Ott et al., 2010; Randles et al., 2013). This study aims to evaluate and quantify the impact of including a comprehensive emission field of biomass burning aerosol on the performance of a seasonal climate forecast system, not only regarding the AOD itself but mainly on the meteorological state variable (e.g., precipitation and temperature). To address the questions put above, we designed two numerical experiments: 1- named"AERO_CTL" which applies the Quick Fire Emissions Dataset (QFED) emissions estimated with intra-diurnal variation (hereafter, BBE), and 2- named "AERO_CLM" where the sourcee mission is based on a climatology of the QFED emissions, with only monthly variation(hereafter, BBCLIM). Hindcast simulations were produced using the Goddard Earth ObservingSystem global circulation model, version 5, sub-seasonal to seasonal (GEOS5-S2S) system with a nominal spatial resolution of 56km (Rienecker et al., 2008). In both experiments, the aerosol feedbacks from cloud developments and radiation interactions were accounted. The two experiments consisted of 4 members each and ran from June to November spanning over the years 2000 to 2015. Model performance was evaluated by calculating statistical metrics on the mean area of SA and Af. Our results demonstrated that the skill model in predicting AOD is significantly improve when BBE source emission is applied over SA, but not over the Afcontinent. Over SA, the correlation between the AERO_CTL model configuration and MERRA-2 is 0.93 (R2= 0.86, RMS=0.02, BIAS=0.01), while the AERO_CLM model presents a value of0.81 (R2= 0.65, RMS=0.04, BIAS=0.06). However, the AERO_CTL experiment better represents the inter-annual variability of the AOS in both regions. The gain of the skill in predicting the AOD by the AERO_CTL experiment is also seen in some meteorological variables. We observed an increase in the model skill in predicting the 2-meter temperature and precipitation of up to 0.3 for the AERO_CTL experiment in comparison to the AERO_CLM. AERO_CLM. According to the analyzed hindcast, we inferred that representing the BBE more realistically implies in a significant gain of skills in the seasonal climate forecasting over SA and Af continents.

Aerosol↗

A 30+ Year AVHRR Land Surface Reflectance Climate Data Record and Its Application to Wheat Yield Monitoring

The Advanced Very High Resolution Radiometer (AVHRR) sensor provides a unique global remote sensing dataset that ranges from the 1980's to the present. Over the years, several efforts have been made on the calibration of the different instruments to establish a consistent land surface reflectance time-series and to augment the AVHRR data record with data from other sensors such as the Moderate Resolution Imaging Spectroradiometer (MODIS). In this paper, we present a summary of all the corrections applied to the AVHRR Surface Reflectance and NDVI Version 4 Product, developed in the framework of the National Oceanic and Atmospheric Administration (NOAA) Climate Data Record (CDR) program. These corrections result from assessment of the geo-location, improvement of the cloud masking and calibration monitoring. Additionally, we evaluate the performance of the surface reflectance over the AERONET sites by a cross-comparison with MODIS, which is an already validated product, and evaluation of a downstream Leaf Area Index (LAI) product. We demonstrate the utility of this long time-series by estimating the winter wheat yield over the USA. The methods developed by [1] and [2] are applied to both the MODIS and AVHRR data. Comparison of the results from both sensors during the MODIS-era shows the consistency of the dataset with similar errors of 10%. When applying the methods to AVHRR historical data from the 1980's, the results have errors equivalent to those derived from MODIS.

AVHRR↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Computer-aided design of stability enhanced nicotinamide cofactor biomimetics for cell-free biocatalysis

Cell-free biocatalysis (CFB) is an efficient and environmentally friendly method to synthesize molecules such as pharmaceuticals, biochemicals, and biofuels through the in vitro use of enzyme cascades. These enzymes often require redox cofactors to drive chemical reactions. Natural redox cofactors (NAD(P)H) are expensive to isolate, motivating synthetic nicotinamide cofactor biomimetics (NCBs) as a cost-effective solution. A select handful of NCBs have been identified as potential NAD(P)H alternatives with comparable or improved redox capabilities, however, they display a tendency to degrade in common buffers. In this study, a library of 132 NCB candidates is systematically generated, over 85% of which have not been characterized in the literature, to expand the diversity of currently explored NCBs. The decomposition mechanism of NCBs in phosphate is evaluated using density functional theory (DFT), revealing protonation at the nicotinamide C5 position as a reporter of cofactor stability. Based on this result, we trained a linear regression model on DFT calculated descriptors to predict NCB stability in phosphate buffer, achieving mean absolute error (MAE) and root mean squared error (RMSE) values within computational accuracy. Analysis of key atomic descriptors and qualitative trends in our dataset informed the design of novel NCB candidates we propose with optimized stability. This work enables researchers to predict the relative stability of NCBs before synthesis, thereby streamlining the process to make CFB more affordable and viable at industry scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluating the sustainability of the 2017 US biofuel industry with an integrated techno-economic analysis and life cycle assessment

The United States produced more than 66.2 billion Liters of biofuel, primarily in the form of corn ethanol (61 billion Liters) and soybean biodiesel (6 billion Liters), for the transportation industry in 2017. No work currently exists that evaluates both the economic and environmental outcomes of this industry with adequate geospatial resolution and national scope. In this study, a model framework is constructed to perform Techno-Economic Analysis and Life Cycle Assessment using high-resolution input datasets to provide a granular estimation of corn ethanol and soybean biodiesel sustainability performance in most counties in the United States in 2017 (the most recent year for which data is available). Results show a total life cycle, greenhouse gas emission volume of 99.5 million Mg CO 2-eq produced in 2017 by these two biofuels (94.8 million Mg from corn ethanol, and 4.7 million Mg from soybean biodiesel), excluding indirect land use change emissions. Further, this volume corresponds to a combined carbon intensity of 65.3 gCO 2-eq /MJ, which is a greenhouse gas improvement compared to petroleum-based gasoline (the carbon intensity of conventional gasoline is 93.0 gCO 2-eq /MJ). However, these biofuels are produced at an additional economic cost ($1.8 billion over the displaced gas/diesel). Additionally, these biofuels generate unfavorable impacts in other environmental categories when compared to petroleum-based fuels, particularly in areas of water, land, and nitrogen intensity. This work enables stakeholders to assess the specific value of biofuels as a means of emission reduction and determine if the attained improvements are worth the associated opportunity costs.

09 BIOMASS FUELS↗

Self-absorption correction on 2D X-ray fluorescence maps

Abstract X-ray fluorescence mapping (XRF) is a highly efficient and non-invasive technique for quantifying material composition with micro and nanoscale spatial resolutions. Quantitative XRF analysis, however, confronts challenges from the long-lasting problem called self-absorption. Moreover, correcting two-dimensional XRF mapping datasets is particularly difficult because it is an ill-posed inverse problem. Here we report a semi-empirical method that can effectively correct 2D XRF mapping data. The correction error is generally less than 10% from a comprehensive evaluation of the accuracy in various configurations. The proposed method was applied to quantify the composition distribution around the grain boundaries in an electrochemically corroded stainless steel sample. Highly localized Cr enrichment was found around the crack sites, which was invisible before the absorption correction.

36 MATERIALS SCIENCE↗

Which Plant Traits Increase Soil Carbon Sequestration? Empirical Evidence From a Long‐Term Poplar Genetic Diversity Trial

Plants play a key role in mediating soil response to global change, and breeding or engineering crops to increase soil organic carbon (SOC) storage is a potential route to land-based carbon dioxide removal in agricultural systems. However, due to limited observational datasets plus shifting paradigms of SOC stabilization, it is unclear which plant traits are most important for enhancing different types of soil organic matter. Existing long-term common gardens of genetically diverse plant populations may provide an opportunity to evaluate biological controls on SOC, separate from environmental or management variability. Here we report on soil and root chemical data collected for 24 genotypes within a 13-year-old common garden in northwestern Oregon planted with a large natural variant population of Populus trichocarpa. Fractionating surface soil (0–15 cm) revealed substantial variation in stocks of mineral-associated organic matter (MAOM; 18–67 t C/ha) and particulate organic matter (POM; 2–22 t C/ha). Tree genotype explained 24% and 26% of the MAOM and POM stock variability, respectively, after controlling for background variability. We found minimal association between SOC concentration and either aboveground tree productivity or root biomass recalcitrance (C/N ratios and lignin content). In contrast, root elemental content appeared influential for MAOM-C concentration, which showed a strong positive association with root aluminum (Al) and a strong negative association with root boron (B) and magnesium (Mg). Furthermore, root concentrations of these elements were highly heritable (57%–78%) and not simply a reflection of background variation in soil elemental concentrations. We estimate that surface SOC stocks under these 24 genotypes have diverged at rates of up to 1.2–4.3 t C/ha/year. These results suggest that long-term genetic diversity trials have value for elucidating biological controls on soil organic matter dynamics, and that traits associated with root elemental content may be a useful target for enhancing biosequestration.

biomass recalcitrance↗

Machine Learning-based Intrusion Detection for Smart Grid Computing: A Survey

Machine learning (ML)-based intrusion detection system (IDS) approaches have been significantly applied and advanced the state-of-the-art system security and defense mechanisms. In smart grid computing environments, security threats have been significantly increased as shared networks are commonly used, along with the associated vulnerabilities. However, compared to other network environments, ML-based IDS research in a smart grid is relatively unexplored, although the smart grid environment is facing serious security threats due to its unique environmental vulnerabilities. In this article, we conducted an extensive survey on ML-based IDS in smart grids based on the following key aspects: (1) The applications of the ML-based IDS in transmission and distribution side power components of a smart power grid by addressing its security vulnerabilities; (2) dataset generation process and its usage in applying ML-based IDSs in the smart grid; (3) a wide range of ML-based IDSs used by the surveyed papers in the smart grid environment; (4) metrics, complexity analysis, and evaluation testbeds of the IDSs applied in the smart grid; and (5) lessons learned, insights, and future research directions.

SCADA↗

Code Description for "Brief Communication: Monitoring snow depth using small, cheap, and easy-to-deploy ground surface temperature sensors"

Temporally continuous snow depth estimates are vital for understanding changing snow patterns and impacts on permafrost in the Arctic. We train a random forest machine learning model to predict snow depth from variability in ground surface temperature. To our knowledge, this is the first time that small ground surface temperature sensors have been used to estimate snow depth. The model performs well at sites where the model was trained and at pan-arctic evaluation sites (RMSE <= 0.15 m). Small temperature sensors are cheap and easy-to-deploy, so this technique enables spatially distributed and temporally continuous snowpack monitoring to an extent previously infeasible. The model is flexible and can be applied to datasets retroactively to retrieve snow depth estimates at additional sites. This code package includes a *.joblib file of the trained random forest model and a *.ipynb file showing how to clean input data, train the random forest model, and apply the model.

Bachand, Claire↗

Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization

Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.

09 BIOMASS FUELS↗

Building Model Calibration: Validation of GridLAB-D Thermal Dynamics Modeling

This report investigates how well GridLAB-D’s house model characterizes the thermal dynamics of buildings given the overpredicted diurnal electric load swing observed in the Distribution System Operation with Transactive (DSO+T) study. This study seeks to validate GridLAB-D’s house model by calibrating it to data from the well-instrumented Pacific Northwest National Laboratory Lab Homes in Richland, WA. The datasets chosen included multiple pre-cooling and pre-heating testing periods where the indoor air temperature was allowed to float over a multi-hour length of time to mimic diurnal behavior. The multi-season calibrations were evaluated by comparing the heating/cooling electric power, indoor air temperature, and the rise/decay time during temperature float periods with Lab Homes data. The default GridLAB-D assumptions for latent load fraction, air heat capacity, mass heat capacity, window-to-wall-ratio, overall envelope conductance (assumed as NORMAL thermal integrity level), and solar heat gain coefficient were compared with the calibrated model to confirm when the default assumptions were adequate and the impact of calibration on the accuracy of modeling the thermal dynamics of homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

WFIP3

The Wind Forecasting Improvement Project 3 (WFIP-3) is the first offshore-based wind resource characterization project within the WFIP construct, funded by the U.S. Department of Energy. WFIP-3 will provide a unique field study that will deliver the comprehensive suite of data needed to inform a series of modeling efforts that will develop and evaluate parameterization schemes suited to offshore environments and improved industry-targeted applications. The field study has two goals: (1) detailed sampling of the vertical structure of the Marine Atmospheric Boundary Layer (MABL) at key observational areas, creating a rich dataset that will be used to refine and validate parameterization schemes, and (2) wide-area sampling of the MABL to create a multi-scale array of observations informing and guiding models of resource characterization. We will deploy a multi-platform array of measurements that span the MABL and create a multi-scale observational array stretching south from Marth’s Vineyard across the wind energy areas.

17 WIND ENERGY↗

A Tool for Furthering GNSS Security Research: The Oak Ridge Spoofing and Interference Test Battery (OAKBAT)

A new global navigation satellite system (GNSS) dataset of digitized RF signals named Oak Ridge Spoofing and Interference Test Battery (OAKBAT) has been created. OAKBAT contains digitized spoofing signals that serve as both a supporting “sibling” and an advancement to the widely used Texas Spoofing Test Battery (TEXBAT) dataset [1]. OAKBAT at its core was developed to 1) allow for 100% reproducibility of the data, 2) provided more detailed metadata and contextual information about each dataset such as the precise moment that the spoofing and/or interference signals begins, positions used, constellations visible, etc., and 3) to provide datasets generated using the same key parameters as the TEXBAT ds1 through ds6 datasets. Through these “sibling” datasets it will now be possible to determine if the behavior of algorithms and designs developed using these datasets are being affected by possible intrinsic behavior and properties of the equipment used in the generation and digitization of the two datasets. The end goal of OAKBAT is to be a new resource for the community of researchers and developers working in the field of GNSS. This additional source of data provides a GNSS “playground” on which to experiment, explore, and evaluate new ideas.

Albright, Austin P.↗

Multi-Mission Terrain Classifier for Safe Rover Navigation and Automated Science

We previously presented Soil Property and Object Classification (SPOC), a machine learning-based terrain classifier for Mars rovers, for automatically segmenting rover images by its surface type such as sand and bedrock. This paper presents a number of practical improvements to pave the way for potential future onboard deployment. First, we achieved 97.0% overall pixel accuracy, evaluated against the classification generated by human experts on images from Mars Science Laboratory (MSL) missions. The substantial increase in accuracy was primarily enabled by the sheer volume of data used for training; we created a new large-scale dataset of Martian terrain labels, namely AI4Mars, which contains more than 400k labels contributed by citizen scientists for 50k images taken by the Mars Exploration Rovers (MER) and Mars Science Laboratory (MSL) rover. Second, we demonstrated that SPOC can quickly adapt to a new mission landed on a previously unseen site. Specifically, we pretrained a model with MER and MSL data from the AI4Mars dataset and then adapted to the Mars 2020 Rover (M2020) by feeding a small volume of data between Sol 0 and 157; the adapted model was tested on Sol 200-203 and resulted in 84.2% overall pixel accuracy and 93.4% reliability (recall) for detecting sand, the most concerning class for rover’s traversability. Third, we found that pretraining can substantially mitigate the decline of accuracy over time. We showed that the performance of a SPOC model pretrained with the ImageNet dataset and then trained by MSL images only up to Sol 390 remains comparable to a model trained by images up to Sol 1689 on the test data after Sol 1689. Fourth, we reimplemented SPOC with a light-weight convolutional neural network (CNN), MobileNetV2, which typically runs within tens of milliseconds (ms) on mobile processors such as Qualcomm’s Snapdragon. Finally, we released the AI4Mars dataset to the public to encourage open innovation.

Ono, Masahiro↗

Drop Size Distribution Measurements Supporting the NASA Global Precipitation Measurement Mission: Infrastructure and Preliminary Results

Global Precipitation Measurement Mission (GPM) retrieval algorithm validation requires datasets that characterize the 4-D structure, variability, and correlation properties of hydrometeor particle size distributions (PSD) and accumulations over satellite fields of view (5 -- 50 km). Key to this process is the combined use of disdrometer and polarimetric radar platforms. Here the disdrometer measurements serve as a reference for up-scaling dual-polarimetric radar observations of the PSD to the much larger volumetric sampling domain of the radar. The PSD observations thus derived provide a much larger data set for assessing DSD variability, and satellite-based precipitation retrieval algorithm assumptions, in all three spatial dimensions for a range of storm types and seasons. As one component of this effort, the GPM Ground Validation program recently acquired five 3rd generation 2D Video disdrometers as part of its Disdrometer and Radar Observations of Precipitation Facility (DROP), currently hosted in northern Alabama by the NASA Marshall Space Flight Center and the University of Alabama in Huntsville. These next-generation 2DVDs were operated and evaluated in different phases of data collection under the scanning domain of the UAH ARMOR C-band dual-polarimetric radar. During this period approximately 7500 minutes of PSD data were collected and processed to create gamma size distribution parameters using a truncated method of moments approach. After creating the gamma parameter datasets the DSDs were then used as input to T-matrix code for computation of polarimetric radar moments at C-band. The combined dataset was then analyzed with two basic objectives in mind: 1) the investigation of seasonal variability in the rain PSD parameters as observed by the 2DVDs; 2) the use of combined polarimetric moments and observed gamma distribution parameters in a functional form to retrieve PSD parameters in 4-D using the ARMOR radar for precipitation occurring in different seasons and for different rain system types. Preliminary results suggest that seasonal variations in the DSD parameters do occur, but are most pronounced when comparing tropical PSDs to either winter or summer convective precipitation. For example the previously documented shift to relatively smaller drop diameters in higher number concentrations for equivalent rain rate bins was observed in tropical storm rainbands occurring over Huntsville. On a more inter seasonal basis empirical fits between parameters such as D0 and ZDR do not appear to exhibit robust seasonal biases- i.e., one fit seems to work for all seasons within acceptable standard error (O[10%]) for estimates of D0. In polarimetric retrievals of the vertical variability in PSD (rain layer) for a tropical rainband we find that the Do varies with height when partitioned by specified precipitation categories (e.g., convective or stratiform, heavy and light stratiform etc.) but this variation is of order 10-20% and is smaller than the difference in D0 observed between the basic delineation of convective and stratiform precipitation types. Currently we are expanding our analysis of the vertical structure of the PSD to include several seasonally and/or dynamically-different storm system types (e.g., winter convection and stratiform events; summer mid-latitude convective etc.) sampled by ARMOR. The study will present the results of our combined analyses.

Petersen, Walter A.↗

Dimensionality Reduction Through Classifier Ensembles

In data mining, one often needs to analyze datasets with a very large number of attributes. Performing machine learning directly on such data sets is often impractical because of extensive run times, excessive complexity of the fitted model (often leading to overfitting), and the well-known "curse of dimensionality." In practice, to avoid such problems, feature selection and/or extraction are often used to reduce data dimensionality prior to the learning step. However, existing feature selection/extraction algorithms either evaluate features by their effectiveness across the entire data set or simply disregard class information altogether (e.g., principal component analysis). Furthermore, feature extraction algorithms such as principal components analysis create new features that are often meaningless to human users. In this article, we present input decimation, a method that provides "feature subsets" that are selected for their ability to discriminate among the classes. These features are subsequently used in ensembles of classifiers, yielding results superior to single classifiers, ensembles that use the full set of features, and ensembles based on principal component analysis on both real and synthetic datasets.

Oza, Nikunj C.↗

Proceedings of the 2004 High Spatial Resolution Commercial Imagery Workshop

Topics covered include: NASA Applied Sciences Program; USGS Land Remote Sensing: Overview; QuickBird System Status and Product Overview; ORBIMAGE Overview; IKONOS 2004 Calibration and Validation Status; OrbView-3 Spatial Characterization; On-Orbit Modulation Transfer Function (MTF) Measurement of QuickBird; Spatial Resolution Characterization for QuickBird Image Products 2003-2004 Season; Image Quality Evaluation of QuickBird Super Resolution and Revisit of IKONOS: Civil and Commercial Application Project (CCAP); On-Orbit System MTF Measurement; QuickBird Post Launch Geopositional Characterization Update; OrbView-3 Geometric Calibration and Geopositional Accuracy; Geopositional Statistical Methods; QuickBird and OrbView-3 Geopositional Accuracy Assessment; Initial On-Orbit Spatial Resolution Characterization of OrbView-3 Panchromatic Images; Laboratory Measurement of Bidirectional Reflectance of Radiometric Tarps; Stennis Space Center Verification and Validation Capabilities; Joint Agency Commercial Imagery Evaluation (JACIE) Team; Adjacency Effects in High Resolution Imagery; Effect of Pulse Width vs. GSD on MTF Estimation; Camera and Sensor Calibration at the USGS; QuickBird Geometric Verification; Comparison of MODTRAN to Heritage-based Results in Vicarious Calibration at University of Arizona; Using Remotely Sensed Imagery to Determine Impervious Surface in Sioux Falls, South Dakota; Estimating Sub-Pixel Proportions of Sagebrush with a Regression Tree; How Do YOU Use the National Land Cover Dataset?; The National Map Hazards Data Distribution System; Recording a Troubled World; What Does This-Have to Do with This?; When Can a Picture Save a Thousand Homes?; InSAR Studies of Alaska Volcanoes; Earth Observing-1 (EO-1) Data Products; Improving Access to the USGS Aerial Film Collections: High Resolution Scanners; Improving Access to the USGS Aerial Film Collections: Phoenix Digitizing System Product Distribution; System and Product Characterization: Issues Approach; Innovative Approaches to Analysis of Lidar Data for the National Map; Changes in Imperviousness near Military Installations; Geopositional Accuracy Evaluations of QuickBird and OrbView-3: Civil and Commercial Applications Project (CCAP); Geometric Accuracy Assessment: OrbView ORTHO Products; QuickBird Radiometric Calibration Update; OrbView-3 Radiometric Calibration; QuickBird Radiometric Characterization; NASA Radiometric Characterization; Establishing and Verifying the Traceability of Remote-Sensing Measurements to International Standards; QuickBird Applications; Airport Mapping and Perpetual Monitoring Using IKONOS; OrbView-3 Relative Accuracy Results and Impacts on Exploitation and Accuracy Improvement; Using Remotely Sensed Imagery to Determine Impervious Surface in Sioux Falls, South Dakota; Applying High-Resolution Satellite Imagery and Remotely Sensed Data to Local Government Applications: Sioux Falls, South Dakota; Automatic Co-Registration of QuickBird Data for Change Detection Applications; Developing Coastal Surface Roughness Maps Using ASTER and QuickBird Data Sources; Automated, Near-Real Time Cloud and Cloud Shadow Detection in High Resolution VNIR Imagery; Science Applications of High Resolution Imagery at the USGS EROS Data Center; Draft Plan for Characterizing Commercial Data Products in Support of Earth Science Research; Atmospheric Correction Prototype Algorithm for High Spatial Resolution Multispectral Earth Observing Imaging Systems; Determining Regional Arctic Tundra Carbon Exchange: A Bottom-Up Approach; Using IKONOS Imagery to Assess Impervious Surface Area, Riparian Buffers and Stream Health in the Mid-Atlantic Region; Commercial Remote Sensing Space Policy Civil Implementation Update; USGS Commercial Remote Sensing Data Contracts (CRSDC); and Commercial Remote Sensing Space Policy (CRSSP): Civil Near-Term Requirements Collection Update.

Source record↗