Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “outlier detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Secure Mass Measurements From Transit Timing: 10 Kepler Exoplanets Between 3 and 8M⊕ with Diverse Densities and Incident Fluxes

We infer dynamical masses in eight multiplanet systems using transit times measured from Keplerʼs complete dataset, including short-cadence data where available. Of the 18 dynamical masses that we infer, 10 pass multiple tests for robustness. These are in systems Kepler-26 (KOI-250), Kepler-29 (KOI-738), Kepler-60 (KOI-2086), Kepler-105 (KOI-115), and Kepler-307 (KOI-1576). Kepler -105 c has a radius of 1.3R⊕ and a density consistent with an Earth-like composition. Strong transit timing variation (TTV) signals were detected from additional planets, but their inferred masses were sensitive to outliers or consistent solutions could not be found with independently measured transit times, including planets orbiting Kepler-49 (KOI-248), Kepler-57 (KOI-1270), Kepler-105 (KOI-115), and Kepler-177 (KOI-523). Nonetheless, strong upper limits on the mass of Kepler-177 cimply an extremely low density of 0.1 g cm−3. In most cases, individual orbital eccentricities were poorly constrained owing to degeneracies in TTV inversion. For five planet pairs in our sample, strong secular interactions imply a moderate to high likelihood of apsidal alignment over a wide range of possible eccentricities. We also find solutions for the three planets known to orbit Kepler-60 in a Laplace-like resonance chain. However, nonlibrating solutions also match the transit timing data. For six systems, we calculate more precise stellar parameters than previously known, enabling useful constraints on planetary densities where we have secure mass measurements. Placing these exoplanets on the mass–radius diagram, we find that a wide range of densities is observed among sub-Neptune-mass planets and that the range in observed densities is anticorrelated with incident flux.

Stars individual↗
NASA NTRS2016

Secure Mass Measurements From Transit Timing: 10 Kepler Exoplanets Between 3 and 8 M⊕ With Diverse Densities and Incident Fluxes

We infer dynamical masses in eight multiplanet systems using transit times measured from Keplerʼs complete data set, including short-cadence data where available. Of the 18 dynamical masses that we infer, 10 pass multiple tests for robustness. These are in systems Kepler-26 (KOI-250), Kepler-29 (KOI-738), Kepler-60 (KOI-2086), Kepler-105 (KOI-115), and Kepler-307 (KOI-1576). Kepler-105 c has a radius of 1.3 R(sub ⨁) and a density consistent with an Earth-like composition. Strong transit timing variation (TTV) signals were detected from additional planets, but their inferred masses were sensitive to outliers or consistent solutions could not be found with independently measured transit times, including planets orbiting Kepler-49 (KOI-248), Kepler-57 (KOI-1270), Kepler-105 (KOI-115), and Kepler-177 (KOI-523). Nonetheless, strong upper limits on the mass of Kepler-177 c imply an extremely low density of ∽0.1 g cm(exp −3). In most cases, individual orbital eccentricities were poorly constrained owing to degeneracies in TTV inversion. For five planet pairs in our sample, strong secular interactions imply a moderate to high likelihood of apsidal alignment over a wide range of possible eccentricities. We also find solutions for the three planets known to orbit Kepler-60 in a Laplace-like resonance chain. However, nonlibrating solutions also match the transit timing data. For six systems, we calculate more precise stellar parameters than previously known, enabling useful constraints on planetary densities where we have secure mass measurements. Placing these exoplanets on the mass–radius diagram, we find that a wide range of densities is observed among sub-Neptune-mass planets and that the range in observed densities is anticorrelated with incident flux.

Individual stars↗
DOE OSTI2023

Optical/X-ray/radio view of Abell 1213: A galaxy cluster with anomalous diffuse radio emission

Context. Abell 1213, a low-richness galaxy system, is known to host an anomalous radio halo detected in data of the Very Large Array (VLA). It is an outlier with regard to the relation between the radio halo power and the X-ray luminosity of the parent clusters. Aims. Our aim is to analyze the cluster in the optical, X-ray, and radio bands to characterize the environment of its diffuse radio emission and to shed new light on its nature. Methods. We used optical data from the Sloan Digital Sky Survey to study the internal dynamics of the cluster. We also analyzed archival XMM-Newton X-ray data to unveil the properties of its hot intracluster medium. Finally, we used recent data from the LOw Frequency ARray (LOFAR) at 144 MHz, together with VLA data at 1.4 GHz, to study the spectral behavior of the diffuse radio source. Results. Both our optical and X-ray analysis reveal that this low-mass cluster exhibits disturbed dynamics. In fact, it is composed of several galaxy groups in the peripheral regions and, in particular, in the core, where we find evidence of substructures oriented in the NE–SW direction, with hints of a merger nearly along the line of sight. The analysis of the X-ray emission adds further evidence that the cluster is in an unrelaxed dynamical state. At radio wavelengths, the LOFAR data show that the diffuse emission is ~510 kpc in size. Moreover, there are hints of low-surface-brightness emission permeating the cluster center. Conclusions. The environment of the diffuse radio emission is not what we would expect for a classical halo. The spectral index map of the radio source is compatible with a relic interpretation, possibly due to a merger in the N–S or NE–SW directions, in agreement with the substructures detected through the optical analysis. The fragmented, diffuse radio emissions at the cluster center could be attributed to the surface brightness peaks of a faint central radio halo.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A Novel Machine Learning Algorithm for Cloud Detection Using AERI Measurement Data

Infrared hyperspectral remote sensing has been widely used in the field of meteorology. Many scientists have carried out research on inversion methods of meteorological elements such as thermodynamic profile, boundary layer height, cloud base height, etc. In this study, a method based on machine learning for cloud detection using ground-based infrared hyperspectral radiation data is proposed. The features of outliers, the cloudy and cloud-free data of Atmospheric Emitted Radiance Interferometer (AERI) radiation are extracted. The “reference values” of cloudy and cloud-free are determined based on the observation data of Vaisala CL31 ceilometer within the time range of 8 min before the corresponding time of AERI. A support vector machine (SVM) algorithm is used for training. The dataset comes from the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site and North Slope Alaska (NSA) site from 2015 to 2017, and the ARM West Antarctic Radiation Experiment (AWARE) site in 2016 is also analyzed. The instruments used in this paper include AERI, ceilometer, etc. The experimental results reveal that the agreement of cloud detection results between the proposed algorithm and ceilometer is about 93% at each site. However, for high clouds or optically thin clouds, the agreement will decrease.

47 OTHER INSTRUMENTATION↗
NASA NTRS2017

Land Surface Temperature Product Validation Best Practice Protocol Version 1.0 - October, 2017

The Global Climate Observing System (GCOS) has specified the need to systematically generate andvalidate Land Surface Temperature (LST) products. This document provides recommendations on goodpractices for the validation of LST products. Internationally accepted definitions of LST, emissivity andassociated quantities are provided to ensure the compatibility across products and reference data sets. Asurvey of current validation capabilities indicates that progress is being made in terms of up-scaling and insitu measurement methods, but there is insufficient standardization with respect to performing andreporting statistically robust comparisons.Four LST validation approaches are identified: (1) Ground-based validation, which involvescomparisons with LST obtained from ground-based radiance measurements; (2) Scene-based intercomparisonof current satellite LST products with a heritage LST products; (3) Radiance-based validation,which is based on radiative transfer calculations for known atmospheric profiles and land surface emissivity;(4) Time series comparisons, which are particularly useful for detecting problems that can occur during aninstrument's life, e.g. calibration drift or unrealistic outliers due to undetected clouds. Finally, the need foran open access facility for performing LST product validation as well as accessing reference LST datasets isidentified.

best practice↗
DOE OSTI2020

Photometric Redshifts with the LSST. II. The Impact of Near-infrared and Near-ultraviolet Photometry

Accurate photometric redshift (photo-z) estimates are essential to the cosmological science goals of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). In this work, we use simulated photometry for mock galaxy catalogs to explore how LSST photo-z estimates can be improved by the addition of near-infrared (NIR) and/or ultraviolet (UV) photometry from the Euclid, Wide-Field InfrarRed Survey Telescope (WFIRST), and/or Cosmological Advanced Survey Telescope for Optical and ultraviolet Research (CASTOR) space telescopes. Generally, we find that deeper optical photometry can reduce the standard deviation of the photo-z estimates more than adding NIR or UV filters but that additional filters are the only way to significantly lower the fraction of galaxies with catastrophically under- or overestimated photo-z. For Euclid, we find that the addition of JH 5σ photometric detections can reduce the standard deviation for galaxies with z > 1 (z > 0.3) by ∼20% (∼10%), and the fraction of outliers by ∼40% (∼25%). For WFIRST, we show how the addition of deep YJHK photometry could reduce the standard deviation by ≳50% at z > 1.5 and drastically reduce the fraction of outliers to just ∼2% overall. For CASTOR, we find that the addition of its UV- and u-band photometry could reduce the standard deviation by ∼30% and the fraction of outliers by ∼50% for galaxies with z < 0.5. We also evaluate the photo-z results within sky areas that overlap with both the NIR and UV surveys and when spectroscopic training sets built from the surveys’ small-area deep fields are used.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Hubble Frontier Field Clusters and Their Parallel Fields: Photometric and Photometric Redshift Catalogs

We present a multiband analysis of the six Hubble Frontier Field clusters and their parallel fields, producing catalogs with measurements of source photometry and photometric redshifts. We release these catalogs to the public along with maps of intracluster light and models for the brightest galaxies in each field. This rich data set covers a wavelength range from 0.2 to 8 μm, utilizing data from the Hubble Space Telescope, Keck Observatories, Very Large Telescope array, and Spitzer Space Telescope. We validate our products by injecting into our fields and recovering a population of synthetic objects with similar characteristics to those in real extragalactic surveys. The photometric catalogs contain a total of over 32,000 entries, with 50% completeness at a threshold of mag AB ~ 29.1 for unblended sources and magAB ~ 29 for blended ones, in the IR-weighted detection band. Photometric redshifts were obtained by means of template fitting and have an average outlier fraction of 10.3% and scatter σ = 0.067 when compared to spectroscopic estimates. The software we devised, after being tested in the present work, will be applied to new data sets from ongoing and future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2009

Gear Fault Detection Effectiveness as Applied to Tooth Surface Pitting Fatigue Damage

A study was performed to evaluate fault detection effectiveness as applied to gear tooth pitting fatigue damage. Vibration and oil-debris monitoring (ODM) data were gathered from 24 sets of spur pinion and face gears run during a previous endurance evaluation study. Three common condition indicators (RMS, FM4, and NA4) were deduced from the time-averaged vibration data and used with the ODM to evaluate their performance for gear fault detection. The NA4 parameter showed to be a very good condition indicator for the detection of gear tooth surface pitting failures. The FM4 and RMS parameters performed average to below average in detection of gear tooth surface pitting failures. The ODM sensor was successful in detecting a significant amount of debris from all the gear tooth pitting fatigue failures. Excluding outliers, the average cumulative mass at the end of a test was 40 mg.

Lewicki, David G.↗
NASA NTRS2010

Gear Fault Detection Effectiveness as Applied to Tooth Surface Pitting Fatigue Damage

A study was performed to evaluate fault detection effectiveness as applied to gear-tooth-pitting-fatigue damage. Vibration and oil-debris monitoring (ODM) data were gathered from 24 sets of spur pinion and face gears run during a previous endurance evaluation study. Three common condition indicators (RMS, FM4, and NA4 [Ed. 's note: See Appendix A-Definitions D were deduced from the time-averaged vibration data and used with the ODM to evaluate their performance for gear fault detection. The NA4 parameter showed to be a very good condition indicator for the detection of gear tooth surface pitting failures. The FM4 and RMS parameters perfomu:d average to below average in detection of gear tooth surface pitting failures. The ODM sensor was successful in detecting a significant 8lDOunt of debris from all the gear tooth pitting fatigue failures. Excluding outliers, the average cumulative mass at the end of a test was 40 mg.

Lewicki, David G.↗
DOE OSTI2024

CIRCLEZ : Reliable photometric redshifts for active galactic nuclei computed solely using photometry from Legacy Survey Imaging for DESI

Photometric redshifts for galaxies hosting an accreting supermassive black hole in their center, known as active galactic nuclei (AGNs), are notoriously challenging. At present, they are most optimally computed via spectral energy distribution (SED) fittings, assuming that deep photometry for many wavelengths is available. However, for AGNs detected from all-sky surveys, the photometry is limited and provided by a range of instruments and studies. This makes the task of homogenizing the data challenging, presenting a dramatic drawback for the millions of AGNs that wide surveys such as SRG/eROSITA are poised to detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGNs using only one dataset that covers a large area: the tenth data release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures over the footprint of the eROSITA-DE survey, which avoids issues related to the cross-calibration of surveys. We present the results from CIRCLEZ, a machine-learning algorithm based on a fully connected neural network. CIRCLEZ is built on a training sample of 14 000 X-ray-detected AGNs and utilizes multi-aperture photometry, mapping the light distribution of the sources. The accuracy (σNMAD) and the fraction of outliers (η) reached in a test sample of 2913 AGNs are equal to 0.067 and 11.6%, respectively. The results are comparable to (or even better than) what was previously obtained for the same field, but with much less effort in this instance. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching a comparable accuracy as in eFEDS when limiting the magnitude of the counterparts to the depth of LS10. The method can be applied to fainter samples of AGNs using deeper optical data from future surveys (for example, LSST, Euclid), granting LS10-like information on the light distribution beyond the morphological type. Along with this paper, we have released an updated version of the photometric redshifts (including errors and probability distribution functions) for eROSITA/eFEDS.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2020

Object and Gas Source Detection with Robotic Platforms in Perceptually-Degraded Environments

In exploration-oriented robotic missions for disaster relief in unknown subterranean environments, it is of prime importance for a human supervisor to rapidly gain situational awareness of salient objects within the environment. In this paper we present an automated object detection pipeline that is adaptable to heterogeneous robots with arbitrary sensor configurations. It has been deployed in time-critical scenarios with multiple collaborative robots in a variety of demanding underground environments. For visually observable objects, detections are made in both the visible and thermal spectra using a state-of-the-art machine learning framework for object detection and classification. Our pipeline can be rapidly adapted to a specific task by using a small, structured dataset to fine-tune a pre-trained convolutional neural network (CNN). Relative localization is separated from the CNN for speed of operation. A robust architecture for localization is used with outlier rejection and a hierarchy of fall-back distance measurement methods. Point-source objects such as gas and WiFi hotspots can also be detected, by tracking signal strength over time and presenting an intuitive visualization on a map. Observations of each object types are presented to the operator in ranked confidence order for final evaluation.

Agha-mohammadi, Ali-akbar↗
NASA NTRS2010

In Situ and Lidar Observations of Tropopause Subvisible Cirrus Clouds During TC4

During the Tropical Composition, Clouds, and Climate Coupling (TC4) experiment in July-August 2007, the NASA WB-57F and ER-2 aircraft made coordinated flights through a tropopause subvisible cirrus (SVC) layer off the Pacific Coast of Central America. The ER-2 aircraft was equipped with a remote sensing payload that included the cloud physics lidar (CPL). The WB-57F payload included cloud microphysical and trace gas measurements, and the aircraft made four vertical profiles through the SVC layer shortly after the ER-2 flew over. The in situ and remotely sensed data are used to quantify the meteorological and microphysical properties of the SVC layer, and these data are compared to the limited set of SVC measurements that have previously been made. It is found that the layer encountered was particularly tenuous, with optical depths (tau) between about 10(exp -4) and 10(exp -3). From the in situ and other meteorological data, radiative heating rate perturbations of approx.0.05-0.1 K/day are calculated. These heating rates are smaller than previous estimates for tropopause SVC, consistent with the smaller tau in the present study. Coverage statistics based on CPL data from other TC4 flights indicate that this cloud was not an outlier among the sampled population. SVC with properties similar to the one presented here are below the detection limit of space \based lidars such as CALIPSO, and a comparison with the TC4 statistics suggests that a majority (>50%) of tropopause SVC (with tau < 0.01) could be unaccounted for in studies using CALIPSO data.

Davis, Sean↗
NASA NTRSDate not supplied

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗
NASA NTRS2025

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗
DOE OSTI2022

Photometry on Structured Backgrounds: Local Pixel-wise Infilling by Regression

Photometric pipelines struggle to estimate both the flux and flux uncertainty for stars in the presence of structured backgrounds such as filaments or clouds. However, it is exactly stars in these complex regions that are critical to understanding star formation and the structure of the interstellar medium. We develop a method, similar to Gaussian process regression, which we term local pixel-wise infilling (LPI). Using a local covariance estimate, we predict the background behind each star and the uncertainty of that prediction in order to improve estimates of flux and flux uncertainty. We show the validity of our model on synthetic data and real dust fields. We further demonstrate that the method is stable even in the crowded field limit. While we focus on optical-IR photometry, this method is not restricted to those wavelengths. We apply this technique to the 34 billion detections in the second data release of the Dark Energy Camera Plane Survey. In addition to removing many >3σ outliers and improving uncertainty estimates by a factor of ~2–3 on nebulous fields, we also show that our method is well behaved on uncrowded fields. The entirely post-processing nature of our implementation of LPI photometry allows it to easily improve the flux and flux uncertainty estimates of past as well as future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Cy-Phy ADS: Cyber Physical Anomaly Detection Framework for EV Charging Systems

Today’s large-scale Electric Vehicle (EV) infrastructures are heavily dependent on information communication technologies to maintain their operation and to support communication within sub-system components as well as the outside world. These technologies are vulnerable to various cyber and physical threats. Timely identification and mitigation of these threats are critical for improving human safety, avoiding economic losses, and preventing catastrophic system failures. By addressing this, our work presents a ResNet Autoencoder (AE) based Cyber-Physical Anomaly Detection System (Cy-Phy ADS) for detecting anomalies in EV Controller Area Network (CAN) protocol communication. It consists of four main components: Cyber-Physical Feature Extractor, ResNet AE-based Anomaly Detection Framework, Cyber-Physical Health Metric (CPHM), and Visualization Dashboard. The presented framework was trained and tested using CAN data collected from the EV charging system testbed at the Idaho National Laboratory. The presented Cy-Phy ADS compared against six widely used unsupervised anomaly detection algorithms: One Class Support Vector Machine (OCSVM), Variational Autoencoder (VAE), LSTM Autoencoder (LSTM AE), Isolation Forest (IForest), Principle Component Analysis (PCA) and Local Outlier Factor (LOF). Here the presented approach showed the highest accuracy among the compared methods. Further, the proposed approach showed comparable performance in terms of precision, F1, and False positive rate. It also showed the lowest training and inference time compared to the neural network-based baseline algorithms compared against with. Additionally, the Cy-Phy ADS has advantages such as unsupervised training, the ability to provide a holistic metric for system health characterization, and non-linear feature extraction.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Atmospheric condition identification in multivariate data through a metric for total variation

Identification of atmospheric conditions within a multivariable atmospheric data set is a necessary step in the validation of emerging and existing high-fidelity models used to simulate wind plant flows and operation.Atmospheric conditions relevant for wind energy research include stationary conditions, given the need for well-converged statistics for model validation, as well as conditions observed less frequently, such as extreme atmospheric events, which are used in wind turbine and wind plant design.Aggregation of observations without regard to covariance between time series discounts the dynamical nature of the atmosphere and is not sufficiently representative of atmospheric conditions.Identification and characterization of continuous time periods with atmospheric conditions that have a high value for analysis or simulation set the stage for more advanced model validation and the development of real-time control and operational strategies.The current work explores a single metric for variation in a multivariate data sample that quantifies variability within each channel as well as covariance between channels.The total variation is used to identify conditions of interest that conform to desired objective functions, such as stationary conditions, ramps or waves of wind speed, and changes in wind direction.Total variation is somewhat sensitive to the presence of outliers in the input data, and the method is best complemented by quality-control procedures to ensure reliable results.The direct detection and classification of events or conditions of interest within atmospheric data sets is vital to developing our understanding of wind plant response and to the formulation of forecasting and control models.

17 WIND ENERGY↗
DOE OSTI2023

Fast and efficient identification of anomalous galaxy spectra with neural density estimation

ABSTRACT Current large-scale astrophysical experiments produce unprecedented amounts of rich and diverse data. This creates a growing need for fast and flexible automated data inspection methods. Deep learning algorithms can capture and pick up subtle variations in rich data sets and are fast to apply once trained. Here, we study the applicability of an unsupervised and probabilistic deep learning framework, the probabilistic auto-encoder, to the detection of peculiar objects in galaxy spectra from the SDSS survey. Different to supervised algorithms, this algorithm is not trained to detect a specific feature or type of anomaly, instead it learns the complex and diverse distribution of galaxy spectra from training data and identifies outliers with respect to the learned distribution. We find that the algorithm assigns consistently lower probabilities (higher anomaly score) to spectra that exhibit unusual features. For example, the majority of outliers among quiescent galaxies are E+A galaxies, whose spectra combine features from old and young stellar population. Other identified outliers include LINERs, supernovae, and overlapping objects. Conditional modelling further allows us to incorporate additional information. Namely, we evaluate the probability of an object being anomalous given a certain spectral class, but other information such as metrics of data quality or estimated redshift could be incorporated as well. We make our code publicly available.

Böhm, Vanessa↗