SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2022

Evaluating Approaches Relating Ecosystem Productivity with DESIS Spectral Information

Data from the DLR Earth Sensing Imaging Spectrometer (DESIS), mounted on the International Space Station (ISS), were used to develop and test algorithms for remotely retrieving ecosystem productivity. Twenty DESIS images were used from three widely separated forested study sites representing deciduous and conifer forests. Gross primary production (GPP) values from eddy covariance flux towers at the sites were matched with DESIS spectral reflectances collected on the same days. Multiple algorithms were successful relating spectral reflectance with GPP, including: spectral vegetation indices (SVI) sensitive to chlorophyll content, SVI used in a photosynthetic light-use efficiency model framework, spectral shape characteristics through spectral derivatives and absorption feature analysis, and statistical models leading to multiband hyperspectral indices from partial least squares regression. Successful algorithms were able to achieve R2 better than 0.7 using a diverse set of observations combining data from different sites from multiple years and at multiple times during the year. The demonstrated robustness of the algorithms provides some confidence in using DESIS imagery to map spatial patterns of GPP.

Gross Primary Productivity (GPP)↗

NASA NTRS1988

Angle of attack estimation using an inertial reference platform

This paper presents the mathematical development and flight test results of an angle of attack estimation system based on inertial navigation system inputs. The estimator uses these inputs to determine the coefficient of lift required at any instant inflight. Angle of attack is then modeled through a regression analysis based on coefficient of lift, altitude and Mach. Overall correlation of the estimator as tested was generally within 0.5 degrees through 17 degrees angle of attack on an F-15A aircraft. A robustness analysis indicates that the system can be used adequately in maneuvering flight.

Zeis, Joseph E., Jr.↗

NASA NTRS2002

Comparison of Total Solar Irradiance with NASA/NSO Spectromagnetograph Data in Solar Cycles 22 and 23

An earlier study compared NASA/NSO Spectromagnetograph (SPM) data with spacecraft measurements of total solar irradiance (TSI) variations over a 1.5 year period in the declining phase of solar cycle 22. This paper extends the analysis to an eight-year period which also spans the rising and early maximum phases of cycle 23. The conclusions of the earlier work appear to be robust: three factors (sunspots, strong unipolar regions, and strong mixed polarity regions) describe most of the variation in the SPM record, but only the first two are associated with TSI. Additionally, the residuals of a linear multiple regression of TSI against SPM observations over the entire eight-year period show an unexplained, increasing, linear time variation with a rate of about 0.05 W m(exp -2) per year. Separate regressions for the periods before and after 1996 January 01 show no unexplained trends but differ substantially in regression parameters. This behavior may reflect a solar source of TSI variations beyond sunspots and faculae but more plausibly results from uncompensated non-solar effects in one or both of the TSI and SPM data sets.

Jones, Harrison P.↗

NASA NTRSDate not supplied

Statistical Classification of Biosignature Information using Multiple Instrument Observations

The accurate identification of biosignatures (indications of life) from data taken from remote or in situ planetary exploration is one of the most important challenges in astrobiology, the interdisciplinary field examining habitability and the potential for extraterrestrial life. This study employs machine learning algorithms to optimize the identification of biosignatures, with an emphasis on those which are agnostic to a specific biochemical basis. We exploit the wealth of terrestrial data available from biogenic and abiogenic systems to enhance efficient feature prioritization. Our dataset, pulled from public databases and laboratory recorded measurements, includes elemental abundance, isotopic fractionation, and VNIR/Raman spectra The data curation process included standardization for detection limits and ranges. Subsequent feature extraction yielded detailed inputs for machine learning, including combinations of elemental content, isotopic ratios, and parameters of spectral peaks and troughs. Feature significance was evaluated across diverse machine learning methodologies, such as k-nearest neighbors, logistic regression, Random Forest, support vector machines, and Gaussian Naïve Bayes, along with a combined voting classifier. We utilized Receiver Operating Characteristic Area Under the Curve (ROC AUC) across 2,000 50% test-train splits as a robust metric of model performance. Results revealed a promising ROC AUC of 0.853 for the combined voting classifier. Removing elemental abundance data notably reduced model accuracy (13% decrease in AUC), highlighting its critical role in biosignature detection. Several other individual data features exhibited significance within their respective data types, offering additional granularity. This research fortifies the relevance of machine learning to astrobiology, potentially enhancing life detection missions by allowing algorithmic prioritization of high-interest samples for further investigation. Future work will refine data standardization, expand the dataset to include more terrestrial systems, and incorporate convolutional neural networks for spectral feature extraction. The potential for public data sharing is also under exploration, reinforcing our commitment to collective scientific advancement.

Statistical↗

NASA NTRS2013

Integrating Solar Induced Fluorescence and the Photochemical Reflectance Index for Estimating Gross Primary Production in a Cornfield

The utilization of remotely sensed observations for light use efficiency (LUE) and tower-based gross primary production (GPP) estimates was studied in a USDA cornfield. Nadir hyperspectral reflectance measurements were acquired at canopy level during a collaborative field campaign conducted in four growing seasons. The Photochemical Reflectance Index (PRI) and solar induced chlorophyll fluorescence (SIF), were derived. SIF retrievals were accomplished in the two telluric atmospheric oxygen absorption features centered at 688 nm (O2-B) and 760 nm (O2-A). The PRI and SIF were examined in conjunction with GPP and LUE determined by flux tower-based measurements. All of these fluxes, environmental variables, and the PRI and SIF exhibited diurnal as well as day-to-day dynamics across the four growing seasons. Consistent with previous studies, the PRI was shown to be related to LUE (r2 = 0.54 with a logarithm fit), but the relationship varied each year. By combining the PRI and SIF in a linear regression model, stronger performances for GPP estimation were obtained. The strongest relationship (r2 = 0.80, RMSE = 0.186 mg CO2/m2/s) was achieved when using the PRI and SIF retrievals at 688 nm. Cross-validation approaches were utilized to demonstrate the robustness and consistency of the performance. This study highlights a GPP retrieval method based entirely on hyperspectral remote sensing observations.

cornfield↗

NASA NTRS1990

Health monitoring system for the SSME - Program overview

This paper considers the design of a health management system (HMS) program for enhancement of the safety of SSME operations during ground tests and space missions. The fault detection techniques based on time series, nonlinear regression, and clustering algorithms were developed and were demonstrated based on data from SSME ground test failures. The fault detection algorithms of the HMS system exhibited 100 percent detection of faults and an extremely low fault alarm rate, and were robust to sensor loss. A preliminary design of hardware architecture capable of supporting real-time operation of the HMS functions is described.

Hawman, Michael W.↗

NASA NTRSDate not supplied

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗

NASA NTRSDate not supplied

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

When performing symbolic regression using genetic programming, overfitting and bloat can negatively impact generalizability and interpretability of the resulting equations as well as increase computation times. A Bayesian fitness metric is introduced and its impact on bloat and overfitting during population evolution is studied and compared to common alternatives in the literature. The proposed approach was found to be more robust to noise and data sparsity in numerical experiments, guiding evolution to a level of complexity appropriate to the dataset. Further evolution of the population resulted not in overfitting or bloat, but rather in slight simplifications in model form. The ability to identify an equation of complexity appropriate to the scale of noise in the training data was also demonstrated. In general, the Bayesian model selection algorithm was shown to be an effective means of regularization which resulted in less bloat and overfitting when any amount of noise was present in the training data.

Uncertainty quantification↗

NASA NTRS1988

A nonparametric software reliability growth model

Miller and Sofer have presented a nonparametric method for estimating the failure rate of a software program. The method is based on the complete monotonicity property of the failure rate function, and uses a regression approach to obtain estimates of the current software failure rate. This completely monotone software model is extended. It is shown how it can also provide long-range predictions of future reliability growth. Preliminary testing indicates that the method is competitive with parametric approaches, while being more robust.

Miller, Douglas R.↗

NASA NTRS2004

NASA Experimental Program to Stimulate Competitive Research: South Carolina

The use of an appropriate relationship model is critical for reliable prediction of future urban growth. Identification of proper variables and mathematic functions and determination of the weights or coefficients are the key tasks for building such a model. Although the conventional logistic regression model is appropriate for handing land use problems, it appears insufficient to address the issue of interdependency of the predictor variables. This study used an alternative approach to simulation and modeling urban growth using artificial neural networks. It developed an operational neural network model trained using a robust backpropagation method. The model was applied in the Myrtle Beach region of South Carolina, and tested with both global datasets and areal datasets to examine the strength of both regional models and areal models. The results indicate that the neural network model not only has many theoretic advantages over other conventional mathematic models in representing the complex urban systems, but also is practically superior to the logistic model in its capability to predict urban growth with better - accuracy and less variation. The neural network model is particularly effective in terms of successfully identifying urban patterns in the rural areas where the logistic model often falls short. It was also found from the area-based tests that there are significant intra-regional differentiations in urban growth with different rules and rates. This suggests that the global modeling approach, or one model for the entire region, may not be adequate for simulation of a urban growth at the regional scale. Future research should develop methods for identification and subdivision of these areas and use a set of area-based models to address the issues of multi-centered, intra- regionally differentiated urban growth.

Sutton, Michael A.↗

NASA NTRS1990

Estimation of multidimensional precipitation parameters by areal estimates of oceanic rainfall

The parameters of the multidimensional precipitation model proposed by Waymire et al. (1984) are estimated using the areal-averaged radar measurements of precipitation of the Global Atlantic Tropical Experiment (GATE) data set. The procedure followed was the fitting of the first- and second-order moments at different aggregation scales by nonlinear regression techniques. The numerical estimates of the parameters using different subsets of GATE information were reasonably stable, i.e., they were not affected by changes of the area-averaging size, temporal length of the records, and percentage of areal coverage of rainfall. This suggests that the estimation procedure is relatively robust and suitable to estimate the parameters of the multidimensional model in areas of sparse density of rain gages. The use of the space-time spectrum of rainfall to help in the determination of sampling errors due to intermittent visits of future space-borne low-altitude sensors of precipitation is also discussed.

Valdes, J. B.↗

NASA NTRS2003

Advancing Glaciological Applications of Remote Sensing with EO-1: (1) Mapping Snow Grain Size and Albedo on the Greenland Ice Sheet Using an Imaging Spectrometer, and (2) ALI Evaluation for Subtle Surface Topographic Mapping via Shape-from Shading

The Hyperion sensor, onboard NASA's Earth Observing-1 (EO-1) satellite,is an imaging spectroradiometer with 220 spectral bands over the spectral range from 0.4 - 2.5 microns. Over the course of summer 2001, the instrument acquired numerous images over the Greenland ice sheet. Our main motivation is to develop an accurate and robust approach for measuring the broadband albedo of snow from satellites. Satellite-derived estimates of broadband have typically been plagued with three problems: errors resulting from inaccurate atmospheric correction, particularly in the visible wavelengths from the conversion of reflectance to albedo (accounting for snow BRDE); and errors resulting from regression-based approaches used to convert narrowband albedo to broadband albedo. A typerspectral method has been developed that substantially reduces these three main sources of error and produces highly accurate estimates of snow albedo. This technique uses hyperspectral data from 0.98 - 1.06 microns, spanning a spectral absorption feature centered at 1.03 microns. A key aspect of this work is that this spectral range is within an atmospheric transmission window and reflectances are largely unaffected by atmospheric aerosols, water vapor, or ozone. In this investigation, we make broadband albedo measurements at four sites on the Greenland ice sheet: Summit, a high altitude station in central Greenland; the ETH/CU camp, a camp on the equilibrium line in western Greenland; Crawford Point, a site located between Summit and the ETH/CU camp; and Tunu, a site located in northeastern Greenland at 2000 m. altitude. Each of these sites has an automated weather station (AWS) that continually measures broadband albedo thereby providing validation data.

Source record↗

NASA NTRS2018

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

NASA NTRSDate not supplied

Case Study: Analysis of Autonomous Center line Tracking Neural Networks

Deep neural networks have gained widespread usage in a number of applications. However, limitations such as lack of explainability and robustness inhibit building trust in their behavior, which is crucial in safety critical applications such as autonomous driving. Therefore, techniques which aid in understanding and providing guarantees for neural network behavior are the need of the hour. In this paper, we present a case study applying a recently proposed technique, Prophecy, to analyze the behavior of a neural network model, provided by our industry partner and used for autonomous guiding of airplanes on taxi runways. This regression model takes as input an image of the runway and produces two outputs, cross-track error and heading error, which represent the position of the plane relative to the center line. We use the Prophecy tool to extract neuron activation patterns for the correctness and safety properties of the model. We show the use of these patterns to identify features of the input that explain correct and incorrect behavior. We also use the patterns to provide guarantees of consistent behavior. We explore a novel idea of using sequences of images (instead of single images) to obtain good explanations and identify regions of consistent behavior.

Deep Neural Networks↗

NASA NTRS1980

Steady (robust) conditionally effective estimation of parameters

The concept of conditionally-effective estimation which provides optimum estimates for a given criterion in cases of given limitations is examined. The concept has the best accuracy for given limitation on the suitability of the algorithm concerning the deviation of the law governing error distribution from the proposed law. It is concluded that there must be a greater difference between individual algorithms in terms of difficulty, and that for the linear regression problem algorithms based on excluding lost points should be studied.

Gurin, L. S.↗

NASA NTRS2012

Can Selforganizing Maps Accurately Predict Photometric Redshifts?

We present an unsupervised machine-learning approach that can be employed for estimating photometric redshifts. The proposed method is based on a vector quantization called the self-organizing-map (SOM) approach. A variety of photometrically derived input values were utilized from the Sloan Digital Sky Survey's main galaxy sample, luminous red galaxy, and quasar samples, along with the PHAT0 data set from the Photo-z Accuracy Testing project. Regression results obtained with this new approach were evaluated in terms of root-mean-square error (RMSE) to estimate the accuracy of the photometric redshift estimates. The results demonstrate competitive RMSE and outlier percentages when compared with several other popular approaches, such as artificial neural networks and Gaussian process regression. SOM RMSE results (using delta(z) = z(sub phot) - z(sub spec)) are 0.023 for the main galaxy sample, 0.027 for the luminous red galaxy sample, 0.418 for quasars, and 0.022 for PHAT0 synthetic data. The results demonstrate that there are nonunique solutions for estimating SOM RMSEs. Further research is needed in order to find more robust estimation techniques using SOMs, but the results herein are a positive indication of their capabilities when compared with other well-known methods

Way, Michael J.↗

NASA NTRSDate not supplied

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

G F Bomarito↗

NASA NTRS1987

The empirical accuracy of uncertain inference models

Uncertainty is a pervasive feature of the domains in which expert systems are designed to function. Research design to test uncertain inference methods for accuracy and robustness, in accordance with standard engineering practice is reviewed. Several studies were conducted to assess how well various methods perform on problems constructed so that correct answers are known, and to find out what underlying features of a problem cause strong or weak performance. For each method studied, situations were identified in which performance deteriorates dramatically. Over a broad range of problems, some well known methods do only about as well as a simple linear regression model, and often much worse than a simple independence probability model. The results indicate that some commercially available expert system shells should be used with caution, because the uncertain inference models that they implement can yield rather inaccurate results.

Vaughan, David S.↗