Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Misclassification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

101 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

An Integrated Architecture for Aircraft Engine Performance Monitoring and Fault Diagnostics: Engine Test Results

This paper presents a model-based architecture for performance trend monitoring and gas path fault diagnostics designed for analyzing streaming transient aircraft engine measurement data. The technique analyzes residuals between sensed engine outputs and model predicted outputs for fault detection and isolation purposes. Diagnostic results from the application of the approach to test data acquired from an aircraft turbofan engine are presented. The approach is found to avoid false alarms when presented nominal fault-free data. Additionally, the approach is found to successfully detect and isolate gas path seeded-faults under steady-state operating scenarios although some fault misclassifications are noted during engine transients. Recommendations for follow-on maturation and evaluation of the technique are also presented.

propulsion system performance↗
NASA NTRS2015

An Integrated Architecture for Aircraft Engine Performance Monitoring and Fault Diagnostics: Engine Test Results

This paper presents a model-based architecture for performance trend monitoring and gas path fault diagnostics designed for analyzing streaming transient aircraft engine measurement data. The technique analyzes residuals between sensed engine outputs and model predicted outputs for fault detection and isolation purposes. Diagnostic results from the application of the approach to test data acquired from an aircraft turbofan engine are presented. The approach is found to avoid false alarms when presented nominal fault-free data. Additionally, the approach is found to successfully detect and isolate gas path seeded-faults under steady-state operating scenarios although some fault misclassifications are noted during engine transients. Recommendations for follow-on maturation and evaluation of the technique are also presented.

systems health monitoring↗
NASA NTRS2014

In-Situ and Remote-Sensing Data Fusion Using Machine Learning Techniques to Infer Urban and Fire Related Pollution Plumes

Airmass type characterization is key in understanding the relative contribution of various emission sources to atmospheric composition and air quality and can be useful in bottom-up model validation and emission inventories. However, classification of pollution plumes from space is often not trivial. Sub-orbital campaigns, such as SEAC4RS (Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys) give us a unique opportunity to study atmospheric composition in detail, by using a vast suite of in-situ instruments for the detection of trace gases and aerosols. These measurements allow identification of spatial and temporal atmospheric composition changes due to various pollution plumes resulting from urban, biogenic and smoke emissions. Nevertheless, to transfer the knowledge gathered from such campaigns into a global spatial and temporal context, there is a need to develop workflow that can be applicable to measurements from space. In this work we rely on sub-orbital in-situ and total column remote sensing measurements of various pollution plumes taken aboard the NASA DC-8 during 2013 SEAC4RS campaign, linking them through a neural-network (NN) algorithm to allow inference of pollution plume types by input of columnar aerosol and trace-gas measurements. In particular, we use the 4STAR (Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research) airborne measurements of wavelength dependent aerosol optical depth (AOD), particle size proxies, O3, NO2 and water vapor to classify different pollution plumes. Our method relies on assigning a-priori ground-truth labeling to the various plumes, which include urban pollution, different fire types (i.e. forest and agriculture) and fire stage (i.e. fresh and aged) using cluster analysis of aerosol and trace-gases in-situ and auxiliary (e.g. trajectory) data and the training of a NN scheme to fit the best prediction parameters using 4STAR measurements as input. We explore our misclassification rates as related to our ground-truth labels, and with multi-layered pollution plume cases. The next step in our analysis is to optimize parameter selection for a scheme that can be applied to space-borne aerosol and trace-gas observation platforms such as OMI, and future geostationary satellites such as TEMPO and GEO-CAPE.

Neural-network↗
NASA NTRS2019

EARLINET Evaluation of the CATS L2 Aerosol Backscatter Coefficient Product

We present the evaluation activity of the European Aerosol Research Lidar Network (EARLINET) for the quantitative assessment of the Level 2 aerosol backscatter coefficient product derived by the Cloud-Aerosol Transport System (CATS) onboard the International Space Station (ISS). The study employs correlative CATS and EARLINET backscatter measurements within 50km distance between the ground station and the ISS overpass and as close in time as possible, typically within 90min, from February 2015 to September 2016. The results demonstrate the good agreement of CATS Level 2 backscatter coefficient and EARLINET. Three ISS overpasses close to the EARLINET stations of Leipzig-Germany, Évora-Portugal and Dushanbe-Tajikistan are analysed here to demonstrate the performance of CATS lidar system under different conditions. The results show that under cloud-free, relative homogeneous aerosol conditions CATS is in good agreement with EARLINET, independently of daytime/nighttime conditions. CATS low negative biases, partially attributed to the deficiency of lidar systems to detect tenuous aerosol layers of backscatter signal below the minimum detection thresholds, may lead to systematic deviations and slight underestimations of the total Aerosol Optical Depth (AOD) in climate studies. In addition, CATS misclassification of aerosol layers as clouds, and vice versa, in cases of coexistent and/or adjacent aerosol and cloud features, may lead to non-representative, unrealistic and cloud contaminated aerosol profiles. The distributions of backscatter coefficient biases show the relatively good agreement between the CATS and EARLINET measurements, although on average underestimations are observed, 22.3% during daytime and 6.1% during nighttime.

EARLINET/CATS evaluation↗
NASA NTRS2019

Characterization and Application of Artificial Light Sources for Nighttime Aerosol Optical Depth Retrievals using the Visible Infrared Imager Radiometer Suite Day/Night Band

Using nighttime observations from Visible Infrared Imager Radiometer Suite (VIIRS) Day/Night band (DNB), the characteristics of artificial light sources are evaluated as functions of observation conditions, and incremental improvements are documented on nighttime aerosol retrievals using VIIRS DNB data on a regional scale. We find that the standard deviation of instantaneous radiance for a given artificial light source is strongly dependent upon the satellite viewing angle but is weakly dependent on lunar fraction and lunar angle. Retrieval of nighttime aerosol optical thickness (AOT) based on the novel use of these artificial light sources is demonstrated for three selected regions (United States, Middle East and India) during 2015. Reason-able agreement is found between nighttime AOTs from the VIIRS DNB and temporally adjacent daytime AOTs from the AErosol RObotic NETwork (AERONET) as well as from coincident nighttime AOT retrievals from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), indicating the potential of this method to begin filling critical gaps in diurnal AOT information at both regional and global scales. Issues related to cloud, snow and ice contamination during the winter season, as well as data loss due to the misclassification of thick aerosol plumes as clouds, must be addressed to make the algorithm operationally robust.

Jianglong Zhang↗
NASA NTRS2020

EARLINET evaluation of the CATS Level 2 aerosol backscatter coefficient product

We present the evaluation activity of the European Aerosol Research Lidar Network (EARLINET) for the quantitative assessment of the Level 2 aerosol backscatter coefficient product derived by the Cloud-Aerosol Transport System (CATS) aboard the International Space Station (ISS; Rodier et al., 2015). The study employs correlative CATS and EARLINET backscatter measurements within a 50 km distance between the ground station and the ISS overpass and as close in time as possible, typically with the starting time or stopping time of the EARLINET performed measurement time window within 90 min of the ISS overpass, for the period from February 2015 to September 2016. The results demonstrate the good agreement of the CATS Level 2 backscatter coefficient and EARLINET. Three ISS overpasses close to the EARLINET stations of Leipzig, Germany; Évora, Portugal; and Dushanbe, Tajikistan, are analyzed here to demonstrate the performance of the CATS lidar system under different conditions. The results show that under cloud-free, relative homogeneous aerosol conditions, CATS is in good agreement with EARLINET, independent of daytime and nighttime conditions. CATS low negative biases are observed, partially attributed to the deficiency of lidar systems to detect tenuous aerosol layers of backscatter signal below the minimum detection thresholds; these are biases which may lead to systematic deviations and slight underestimations of the total aerosol optical depth (AOD) in climate studies. In addition, CATS misclassification of aerosol layers as clouds, and vice versa, in cases of coexistent and/or adjacent aerosol and cloud features, occasionally leads to non-representative, unrealistic, and cloud-contaminated aerosol profiles. Regarding solar illumination conditions, low negative biases in CATS backscatter coefficient profiles, of the order of 6.1 %, indicate the good nighttime performance of CATS. During daytime, a reduced signal-to-noise ratio by solar background illumination prevents retrievals of weakly scattering atmospheric layers that would otherwise be detectable during nighttime, leading to higher negative biases, of the order of 22.3 %.

Emmanouil Proestakis↗
NASA NTRS2021

Quantifying Uncertainties in Nighttime Light Retrievals From Suomi-NPP and NOAA-20 VIIRS Day/Night Band Data

Satellite observations of nighttime lights (NTL) from Suomi-NPP and NOAA-20 VIIRS Day/Night Band data have been widely used to estimate human activities. Long-term changes such as urban development and abrupt short-term changes such as power outages have been monitored from temporal NTL acquired by satellites. While high temporal NTL variation has been found across NTL data of varying temporal scale (e.g., daily, monthly, and annual composites), the sources of measurement error and uncertainty are poorly understood. This paper quantifies the sources of VIIRS-derived NTL uncertainty due to view-illumination geometry, surface Bidirectional Reflectance Distribution Function (BRDF)/albedo, and the effects of snow cover, lunar irradiance, aerosol loading, cloud mask, vegetation, geometry, and ephemeral artifacts (e.g., the Aurora Borealis). Based on this current assessment of NASA Black Marble retrievals (VNP46, Collection V001), we found that angular and atmospheric effects dominate retrieval uncertainty. Errors introduced by upstream data inputs (e.g., a coarser nighttime snow cover flag and misclassification errors in the existing VIIRS nighttime cloud mask) were also found to impact retrieval quality. Despite these challenges, a consistent daily NTL time series record can be routinely generated from top-of-atmosphere VNP46 radiances. Key recommendations include: (1) the use of lunar-BRDF adjusted and atmospherically corrected NTL (i.e., as identified as high-quality retrievals in the VNP46 QA fields), (2) development and improvement to the VIIRS snow cover and cloud masks algorithms to accurately reflect NTL retrieval conditions, (3) characterizing seasonal variations in NTL due to vegetation and snow, (4) reducing geometric effects due to the spatial mismatch of gridded pixel and observation footprint, (5) employing angularly-consistent NTL observations from multiple VIIRS instruments (i.e., Suomi-NPP and NOAA-20) to reduce pixel-based uncertainties and address persistent data gaps, and (6) being mindful of surface-reflected radiance from aurora events at mid-to-high latitudes.

Zhuosen Wang↗
NASA NTRS2021

Assessment of ICESat-2 Sea Ice Surface Classification with Sentinel-2 Imagery: Implications for Freeboard and New Estimates of Lead and Floe Geometry

NASA's Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) mission launched in September 2018 and is now providing high-resolution surface elevation profiling across the entire globe, including the sea ice cover of the Arctic and Southern Oceans. For sea ice applications, successfully discriminating returns between sea ice and open water is key for accurately determining freeboard (the extension of sea ice above local sea level) and new information regarding the geometry of sea ice floes and leads. We take advantage of near-coincident optical imagery obtained from the European Space Agency (ESA) Sentinel-2 (S-2) satellite over the Western Weddell Sea of the Southern Ocean in March 2019 and the Lincoln Sea of the Arctic Ocean in May 2019 to evaluate the surface classification scheme in the ICESat-2 ATL07 and ATL10 sea ice products. We find a high level of agreement between the ATL07 (specular) lead classification and visible leads in the S-2 imagery in these two coincident images across all six ICESat-2 beams, increasing our confidence in the freeboard products and deriving new estimates of the sea ice state. The S-2 overlays provide additional, albeit limited, evidence of the misclassification of dark leads due to clouds. Dark leads are no longer used to derive sea surface and thus freeboard as of the third release (r003) of the ICESat-2 sea ice products. We show estimates of lead fraction and more preliminary estimates of chord length (a proxy for floe size) using two metrics for classifying sea surface (lead) segments across both the Arctic and Southern Ocean for the first winter season of data collection.

A. A. Petty↗
NASA NTRS2022

Identifying Chemical Aerosol Signatures Using Optical Suborbital Observations: How Much Can Optical Properties Tell us about Aerosol Composition?

Improvements in air quality and Earth’s climate predictions require improvements of the aerosol speciation in chemical transport models, using observational constraints. Aerosol speciation (e.g., organic aerosols, black carbon, sulfate, nitrate, ammonium, dust or sea salt) is typically determined using in situ instrumentation. Continuous, routine surface network aerosol composition measurements are not uniformly widespread over the globe. Satellites, on the other hand, can provide a maximum coverage of the horizontal and vertical atmosphere but observe aerosol optical properties (and not aerosol speciation) based on remote sensing instrumentation. Combinations of satellite-derived aerosol optical properties can inform on air mass aerosol types (AMTs e.g., clean marine, dust, polluted continental). However, these AMTs are subjectively defined, might often be misclassified and are hard to relate to the critical parameters that need to be refined in models. In this paper, we derive AMTs that are more directly related to sources and hence to speciation. They are defined, characterized, and derived using simultaneous in situ gas-phase, chemical and optical instruments on the same aircraft during the Study of Emissions and Atmospheric Composition, Clouds, and Climate Coupling by Regional Surveys (SEAC4RS, US, summer of 2013). First, we prescribe well-informed AMTs that display distinct aerosol chemical and optical signatures to act as a training AMT dataset. These in situ observations reduce the errors and ambiguities in the selection of the AMT training dataset. We also investigate the relative skill of various combinations of aerosol optical properties to define AMTs and how much these optical properties can capture dominant aerosol speciation. We find distinct optical signatures for biomass burning (from agricultural or wildfires), biogenic and dust-influence AMTs. Useful aerosol optical properties to characterize these signatures are the extinction angstrom exponent (EAE), the single scattering albedo, the difference of single scattering albedo in two wavelengths, the absorption coefficient, the absorption angstrom exponent (AAE), and the real part of the refractive index (RRI). We find that all four AMTs studied when prescribed using mostly airborne in situ gas measurements, can be successfully extracted from at least three combinations of airborne in situ aerosol optical properties (e.g., EAE, AAE and RRI) over the US during SEAC4RS. However, we find that the optically based classifications for BB from agricultural fires and polluted dust include a large percentage of misclassifications that limit the usefulness of results relating to those classes. The technique and results presented in this study are suitable to develop a representative, robust and diverse source-based AMT database. This database could then be used for widespread retrievals of AMTs using existing and future remote sensing suborbital instruments/networks. Ultimately, it has the potential to provide a much broader observational aerosol data set to evaluate chemical transport and air quality models than is currently available by direct in situ measurements. This study illustrates how essential it is to explore existing airborne datasets to bridge chemical and optical signatures of different AMTs, before the implementation of future spaceborne missions (e.g., the next generation of Earth Observing System (EOS) satellites addressing Aerosol, Cloud, Convection and Precipitation (ACCP) designated observables).

Meloe S F Kacenelenbogen↗
NASA NTRS2026

Incremental Learning for Passive Microwave Precipitation Retrievals using Advanced Technology Microwave Sounder

Spaceborne passive microwave (PMW) radiometry is central to global precipitation monitoring, yet retrieval uncertainties remain substantial, particularly for cross-track sounders whose variable footprints and channel configurations are optimized for atmospheric temperature and moisture profiling rather than precipitation. Consequently, existing operational products often exhibit angular-dependent biases, limited effective swath utilization, unrealistic rainfall probability distributions, and systematic misclassification of precipitation phase. These limitations are further compounded by the scarcity of globally accurate and representative precipitation observations, as training data from the Dual-frequency Precipitation Radar (DPR) and the Cloud Profiling Radar (CPR) are spatially sparse, lack uniform global coverage, and exhibit heterogeneous error characteristics across precipitation regimes. To address these challenges, this study presents a supervised retrieval algorithm that incrementally trains an ensemble of extreme gradient-boosted decision trees by augmenting base learners with pre-training on reanalysis data and post-training on coincident DPR and CPR observations matched with the Advanced Technology Microwave Sounder (ATMS). By transferring prior information from reanalysis to posterior constraints from radar observations and adopting a sequential detection–estimation strategy for precipitation phase and rate retrieval, the proposed approach yields retrievals across the full ATMS swath that are largely free from persistent deficiencies in current Global Precipitation Measurement (GPM) passive microwave operational products. In particular, the method resolves bimodal artifacts in rainfall retrievals and mitigates systematic high-latitude snowfall biases, including overestimation across the Arctic and underestimation across the Antarctic. Validation against independent Multi-Radar Multi-Sensor (MRMS) data over the Contiguous United States (CONUS) further demonstrates improved performance in precipitation phase detection and rate estimation relative to both reanalysis and current GPM PMW products.

Mahyar Garshasbi↗
DOE OSTI2026

Open Set Recognition for Unknown Waveform Classification

This presentation applies open set recognition to classify unknown waveforms, enabling systems to not only identify known types but also reliably detect when waveforms fall outside the training distribution. This approach enhances robustness by avoiding forced misclassification of novel or anomalous signals.

99 - GENERAL AND MISCELLANEOUS↗