Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Aircraft Anomaly Detection Using Performance Models Trained on Fleet Data

This paper describes an application of data mining technology called Distributed Fleet Monitoring (DFM) to Flight Operational Quality Assurance (FOQA) data collected from a fleet of commercial aircraft. DFM transforms the data into aircraft performance models, flight-to-flight trends, and individual flight anomalies by fitting a multi-level regression model to the data. The model represents aircraft flight performance and takes into account fixed effects: flight-to-flight and vehicle-to-vehicle variability. The regression parameters include aerodynamic coefficients and other aircraft performance parameters that are usually identified by aircraft manufacturers in flight tests. Using DFM, the multi-terabyte FOQA data set with half-million flights was processed in a few hours. The anomalies found include wrong values of competed variables, (e.g., aircraft weight), sensor failures and baises, failures, biases, and trends in flight actuators. These anomalies were missed by the existing airline monitoring of FOQA data exceedances.

Gorinevsky, Dimitry↗

Modeling approaches to estimate community annoyance due to sonic booms using data from repeated surveys

In an on-going project for NASA, we are developing a modeling approach to analyze the relationship between the noise level of sonic booms from an experimental supersonic plane and the level of annoyance measured through community response surveys. The goal of the project is to obtain a quantitative relationship between noise level and annoyance that is representative for the affected population. Particular modeling challenges include multiple annoyance measurements per survey respondent and very few occurrences of annoyance overall. To address these challenges, we propose a two-stage model for the presence of high annoyance, with the first stage modeling the probability that a respondent is ever highly annoyed and the second stage a multilevel logistic regression model for high annoyance based on noise level and demographic characteristics. We use a variation of Multilevel Regression and Poststratification (Gelman and Little, 1997) to obtain an overall representative noise-annoyance curve for the population. The approach is applied to data from a NASA pilot study.

Robyn Ferg↗

Modeling Approaches to Estimate Community Annoyance Due to Sonic Booms Using Data from Repeated Surveys

In an on-going project for NASA, we are developing a modeling approach to analyze the relationship between the noise level of sonic booms from an experimental supersonic plane and the level of annoyance measured through community response surveys. The goal of the project is to obtain a quantitative relationship between noise level and annoyance that is representative for the affected population. Particular modeling challenges include multiple annoyance measurements per survey respondent and very few occurrences of annoyance overall. To address these challenges, we propose a two-stage model for the presence of high annoyance, with the first stage modeling the probability that a respondent is ever highly annoyed and the second stage a multilevel logistic regression model for high annoyance based on noise level and demographic characteristics. We use a variation of Multilevel Regression and Poststratification (Gelman and Little, 1997) to obtain an overall representative noise-annoyance curve for the population. The approach is applied to data from a NASA pilot study.

Robyn Ferg↗

Temporal covariance structure of multi-spectral phenotypes and their predictive ability for end-of-season traits in maize

Vegetation indices (VIs) derived from multi-spectral imaging (MSI) platforms can be used to study properties of crop canopy, providing non-destructive phenotypes that could be used to better understand growth curves throughout the growing season. To investigate the amount of variation present in several VIs and their relationship with important end-of-season traits, genetic and residual (co)variances for VIs, grain yield and moisture were estimated using data collected from maize hybrid trials. The VIs considered were Normalized Difference Vegetation Index (NDVI), Green NDVI, Red Edge NDVI, Soil-Adjusted Vegetation Index, Enhanced Vegetation Index and simple Ratio of Near Infrared to Red (Red) reflectance. Genetic correlations of VIs with grain yield and moisture were used to fit multi-trait models for prediction of end-of-season traits and evaluated using within site/year cross-validation. To explore alternatives to fitting multiple phenotypes from MSI, random regression models with linear splines were fit using data collected in 2016 and 2017. Heritability estimates ranging from (0.10 to 0.82) were observed, indicating that there exists considerable amount of genetic variation in these VIs. Furthermore, strong genetic and residual correlations of the VIs, NDVI and NDRE, with grain yield and moisture were found. Considerable increases in prediction accuracy were observed from the multi-trait model when using NDVI and NDRE as a secondary trait. Finally, random regression with a linear spline function shows potential to be used as an alternative to mixed models to fit VIs from multiple time points.

59 BASIC BIOLOGICAL SCIENCES↗

A simplified integrated framework for predicting the economic impacts of feedstock variations in a catalytic fast pyrolysis conversion process

Feedstock attributes of lignocellulosic biomass, such as particle size, compositional makeup, and moisture content, can vary substantially even within pre-processed materials and have a significant effect on conversion in fast pyrolysis-based processes. However, the economic impacts of these attributes are not well understood. To address this, biomass deconstruction phenomena captured with a versatile particle-scale simulation were linked to techno-economic impacts via reduced-order models. Parametric analysis of the particle-scale model, which was validated using literature data, was used in combination with multiple linear regression models to develop correlations between feedstock attributes and yields of pyrolysis oil, gas, and char. Yields were then correlated with the minimum fuel selling price (MFSP) using a techno-economic model, bridging the gap between physics-based biomass conversion simulations and predictions of MFSP for a catalytic fast-pyrolysis process. Empirical correlations derived from the literature regarding the impact of mineral matter (ash) on oil yield were also considered. The model correlations deployed in the integrated framework capture the impacts of variation in feedstock attributes on the MFSP. Variations in ash were shown to have the biggest impact, varying MFSP by -13%/+22% due to catalytic effects and lower relative amounts of convertible lignocellulosic material. It was also found that, if ash can be controlled to low levels, the increased extractives in forest residues can help compensate for some yield losses associated with increased ash. As a result, other inputs considered (particle size, moisture content, and reactor temperature) had relatively negligible effects on process economics within the ranges analyzed considering particle-scale effects alone.

BIOMASS FUELS↗

A data-driven approach to real-time vertical position estimation for NSTX-U vertical stability control

In this paper, a database of 77 996 plasma equilibrium reconstructions from 727 discharges during the initial operation of the NSTX-U spherical tokamak is analyzed to develop a statistically robust model of the plasma vertical position for real-time control. A variety of regression models are developed and tested, ranging in complexity from linear models to deep neural networks, and including input signals ranging from the four pairs of flux loops used historically on NSTX-U up to the full set of 389 real-time signals available to the plasma control system. A linear model based on 140 real-time magnetics signals is found to offer excellent accuracy, with a coefficient of determination R 2 = 0.906. The robustness of this model to limited training data, new operating scenarios, and signal errors is tested, and a procedure is demonstrated to tune the model parameters to optimize its robustness. A time-dependent plasma equilibrium solver, TokaMaker, is used to simulate vertical stability control in NSTX-U, demonstrating that it should be possible to iteratively tune the parameters of a linear vertical position model to stabilize both positive and negative triangularity plasmas in future experiments.

magnetic diagnostics↗

Heuristic Area Cost Estimation for Observational Coverage Schedulers

This paper presents a comparison of heuris- tics used to estimate the amount of time it would take for a spacecraft to image an area using Boustrophedon decomposition (Choset and Pignon 1998). Machine learning tech- niques are used to characterize algorithmic performance of coverage algorithms. It is shown that an ordinary least-squares linear model is among the most accurate in a set of constant and linear order regression models both in terms of memory consumption and schedule duration. These are demonstrated using the ASPEN planning system (Fukunaga et al. 1997) on the Eagle Eye domain.

Knight, Russell↗

Predicting the Activity and Selectivity of Bimetallic Metal Catalysts for Ethanol Reforming using Machine Learning

Machine learning is ideally suited for the pattern detection in large uniform datasets, but consistent experimental datasets on catalyst studies are often small. Here we demonstrate how a combination of machine learning and first-principles calculations can be used to extract knowledge from a relatively small set of experimental data. The approach is based on combining a complex machine-learning model trained on an extensive computational library of transition-state energies with simple linear regression models of experimental catalytic activities and selectivities from the literature. Using the combined model, we identify the key C–C bond scission reactions involved in ethanol reforming and perform a computational screening for ethanol reforming on monolayer bimetallic catalysts with architectures TM-Pt-Pt(111) and Pt-TM-Pt(111) (TM = 3d transition metals). The model also predicts four promising catalyst compositions for future experimental studies. In conclusion, the approach is not limited to ethanol reforming but is of general use for the interpretation of experimental observations as well as for the computational discovery of novel catalytic materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

MSFC solar activity predictions for satellite orbital lifetime estimation

The procedure to predict solar activity indexes for use in upper atmosphere density models is given together with an example of the performance. The prediction procedure employs a least square linear regression model to generate the predicted smoothed vinculum R sub 13 and geomagnetic vinculum A sub p(13) values. Linear regression equations are then employed to compute corresponding vinculum F sub 10.7(13) solar flux values from the predicted vinculum R sub 13 values. The output is issued principally for satellite orbital lifetime estimations.

Fuler, H. C.↗

Online LIBS–ML Framework for Dynamic Characterization of Heterogeneous Waste-Derived Gasification Feedstocks

LIBS−ML framework for real time feedstock characterization during continuous conveyor transport Heterogeneous waste derived feedstocks (e.g., waste coal, biomass and blends) introduce rapid variability in heating value and ash chemistry that affect gasifier operation, yet conventional laboratory characterization techniques are too slow to support proactive control. To address this gap, this study reports on an online, in situ, dynamic characterization framework that couple’s laser-induced breakdown spectroscopy (LIBS) with leakage safe machine learning (ML) regression to deliver real time, decision quality predictions of gasifier relevant properties. A controlled sample matrix spanning two different waste coals, two different biomasses, and engineered blends under two particle size conditions were constructed and benchmarked using standardized laboratory analyses for proximate/ultimate properties and ash composition. LIBS spectra were acquired dynamically as material flowed on a conveyor belt, using high energy 1064 nm laser ablation and shot averaging to improve repeatability and precision. Supervised regression models (multi layer perceptron (MLP) /artificial neural network (ANN), random forest (RF), and support vector regression (SVR)) and an optimized weighted ensemble were trained on emission line feature sets using nested cross validation with Bayesian hyperparameter tuning and validated against an independent hold out set. The proposed LIBS−ML workflow achieves near laboratory predictive fidelity across parametric targets (including higher heating value (HHV), ash content, fixed carbon, sulfur, major ash forming oxides, and initial deformation temperature (IDT)), with the weighted ensemble providing a robust default predictor under dynamic measurement conditions. These results demonstrate a practical pathway for real time feedstock characterization that can enable feedforward adjustments and more resilient gasifier operation for variable quality waste derived fuels.

Biomass↗

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evaluation of spatial, radiometric and spectral Thematic Mapper performance for coastal studies

The effect different wetland plant canopies have upon observed reflectance in Thematic Mapper bands is studied. The three major vegetation canopy types (broadleaf, gramineous and leafless) produce unique spectral responses for a similar quantity of live biomass. The spectral biomass estimate of a broadleaf canopy is most similar to the harvest biomass estimate when a broadleaf canopy radiance model is used. All major wetland vegetation species can be identified through TM imagery. Simple regression models are developed equating the vegetation index and the infrared index with biomass. The spectral radiance index largely agreed with harvest biomass estimates.

Klemas, V.↗

CDF and PDF Comparison Between Humacao, Puerto Rico and Florida

The knowledge of the atmospherics phenomenon is an important part in the communication system. The principal factor that contributes to the attenuation in a Ka band communication system is the rain attenuation. We have four years of tropical region observations. The data in the tropical region was taken in Humacao, Puerto Rico. Previous data had been collected at various climate regions such as desserts, template area and sub-tropical regions. Figure 1 shows the ITU-R rain zone map for North America. Rain rates are important to the rain attenuation prediction models. The models that predict attenuation generally are of two different kinds. The first one is the regression models. By using a data set these models provide an idea of the observed attenuation and rain rates distribution in the present, past and future. The second kinds of models are physical models which use the probability density functions (PDF).

Gonzalez-Rodriguez, Rosana↗

Comparison of Likelihood Methods for Generalized Linear Mixed Models with Application to Quiet Supersonic Flights 2018 Data

Repeated measurement will be a feature of the survey data collected during the Quesst missionX-59 community response tests (CRT). Since each participant will report his or her categorical level of annoyance in response to multiple events, the responses from any single individual may be correlated with one another. Several models within the class of generalized linear mixed models (GLMM) are pertinent to the analysis of correlated categorical outcomes; the random intercept logistic regression model is one example. Both Bayesian and frequentist methods for fitting these models are available, with frequentist methods relying on some form of approximation (of either an integral or the integrand) that appears in the marginal likelihood function. Given several anticipated similarities of the X-59 CRT data to data collected during a past risk reduction, Quiet Supersonic Flights 2018 (QSF18), this short note is intended to create awareness. It documents an instance in which a reported population average dose-response relationship derived from QSF18 single event data was distorted by the integral approximation applied in likelihood-based methods. We review some of the available literature on the topic, compare the outputs of several different computational approaches implemented in available statistical software, and present simple corrective actions that may be useful during the Quesst mission.

dose-response model↗

Multi-Axis Identifiability Using Single-Surface Parameter Estimation Maneuvers on the X-48B Blended Wing Body

The problem of parameter estimation on hybrid-wing-body type aircraft is complicated by the fact that many design candidates for such aircraft involve a large number of aero- dynamic control effectors that act in coplanar motion. This fact adds to the complexity already present in the parameter estimation problem for any aircraft with a closed-loop control system. Decorrelation of system inputs must be performed in order to ascertain individual surface derivatives with any sort of mathematical confidence. Non-standard control surface configurations, such as clamshell surfaces and drag-rudder modes, further complicate the modeling task. In this paper, asymmetric, single-surface maneuvers are used to excite multiple axes of aircraft motion simultaneously. Time history reconstructions of the moment coefficients computed by the solved regression models are then compared to each other in order to assess relative model accuracy. The reduced flight-test time required for inner surface parameter estimation using multi-axis methods was found to come at the cost of slightly reduced accuracy and statistical confidence for linear regression methods. Since the multi-axis maneuvers captured parameter estimates similar to both longitudinal and lateral-directional maneuvers combined, the number of test points required for the inner, aileron-like surfaces could in theory have been reduced by 50%. While trends were similar, however, individual parameters as estimated by a multi-axis model were typically different by an average absolute difference of roughly 15-20%, with decreased statistical significance, than those estimated by a single-axis model. The multi-axis model exhibited an increase in overall fit error of roughly 1-5% for the linear regression estimates with respect to the single-axis model, when applied to flight data designed for each, respectively.

Ratnayake, Nalin A.↗

The impact of kidney function on Alzheimer’s disease blood biomarkers: implications for predicting amyloid-β positivity

Impaired kidney function has a potential confounding effect on blood biomarker levels, including biomarkers for Alzheimer’s disease (AD). Given the imminent use of certain blood biomarkers in the routine diagnostic work-up of patients with suspected AD, knowledge on the potential impact of comorbidities on the utility of blood biomarkers is important. We aimed to evaluate the association between kidney function, assessed through estimated glomerular filtration rate (eGFR) calculated from plasma creatinine and AD blood biomarkers, as well as their influence over predicting Aβ-positivity. We included 242 participants from the Translational Biomarkers in Aging and Dementia (TRIAD) cohort, comprising cognitively unimpaired individuals (CU; n = 124), mild cognitive impairment (MCI; n = 58), AD dementia (n = 34), and non-AD dementia (n = 26) patients all characterized by [ 18 F] AZD-4694. Plasma samples were analyzed for Aβ42, Aβ40, glial fibrillary acidic protein (GFAP), neurofilament light chain (NfL), tau phosphorylated at threonine 181 (p-tau181), 217 (p-tau217), 231 (p-tau231) and N-terminal containing tau fragments (NTA-tau) using Simoa technology. Kidney function was assessed by eGFR in mL/min/1.73 m 2 , based on plasma creatinine levels, age, and sex. Participants were also stratified according to their eGFR-indexed stages of chronic kidney disease (CKD). We evaluated the association between eGFR and blood biomarker levels with linear models and assessed whether eGFR provided added predictive value to determine Aβ-positivity with logistic regression models. Biomarker concentrations were highest in individuals with CKD stage 3, followed by stages 2 and 1, but differences were only significant for NfL, Aβ42, and Aβ40 (not Aβ42/Aβ40). All investigated biomarkers showed significant associations with eGFR except plasma NTA-tau, with stronger relationships observed for Aβ40 and NfL. However, after adjusting for either age, sex or Aβ-PET SUVr, the association with eGFR was no longer significant for all biomarkers except Aβ40, Aβ42, NfL, and GFAP. When evaluating whether accounting for kidney function could lead to improved prediction of Aβ-positivity, we observed no improvements in model fit (Akaike Information Criterion, AIC) or in discriminative performance (AUC) by adding eGFR to a base model including each plasma biomarker, age, and sex. While covariates like age and sex improved model fit, eGFR contributed minimally, and there were no significant differences in clinical discrimination based on AUC values. We found that kidney function seems to be associated with AD blood biomarker concentrations. However, these associations did not remain significant after adjusting for age and sex, except for Aβ40, Aβ42, NfL, and GFAP. While covariates such as age and sex improved prediction of Aβ-positivity, including eGFR in the models did not lead to improved prediction for any biomarker. Our findings indicate that renal function, within the normal to mild impairment range, does not seem to have a clinically relevant impact when using highly accurate blood biomarkers, such as p-tau217, in a biomarker-supported diagnosis.

60 APPLIED LIFE SCIENCES↗

Mapping tree canopy cover and canopy height with L-band SAR using LiDAR data and Random Forests

Light detection and ranging (LiDAR) data can provide direct measurements of vegetation structures but are limited by the sparse spatial coverage. Polarimetric synthetic aperture radar (SAR) can perform large-scale high-resolution mapping without weather constraints but the information about vegetation and ground subsurface are mixed in the backscatter data. In this paper, we adopted the Random Forests algorithm to train an upscaling function using tree canopy cover (TCC) and canopy height model (CHM) derived from Goddard’s LiDAR, Hyperspectral and Thermal Imager (G-LiHT) data. The regression model is then applied to the L-band Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR) data acquired during the 2017 Arctic-Boreal Vulnerability Experiment (ABoVE) airborne campaign to map the TCC and CHM over the Delta Junction area in interior Alaska.

Moghaddam, Mahta↗

Validity of VO(2 max) in predicting blood volume: implications for the effect of fitness on aging

A multiple regression model was constructed to investigate the premise that blood volume (BV) could be predicted using several anthropometric variables, age, and maximal oxygen uptake (VO(2 max)). To test this hypothesis, age, calculated body surface area (height/weight composite), percent body fat (hydrostatic weight), and VO(2 max) were regressed on to BV using data obtained from 66 normal healthy men. Results from the evaluation of the full model indicated that the most parsimonious result was obtained when age and VO(2 max) were regressed on BV expressed per kilogram body weight. The full model accounted for 52% of the total variance in BV per kilogram body weight. Both age and VO(2 max) were related to BV in the positive direction. Percent body fat contributed <1% to the explained variance in BV when expressed in absolute BV (ml) or as BV per kilogram body weight. When the model was cross validated on 41 new subjects and BV per kilogram body weight was reexpressed as raw BV, the results indicated that the statistical model would be stable under cross validation (e.g., predictive applications) with an accuracy of +/- 1,200 ml at 95% confidence. Our results support the hypothesis that BV is an increasing function of aerobic fitness and to a lesser extent the age of the subject. The results may have implication as to a mechanism by which aerobic fitness and activity may be protective against reduced BV associated with aging.

NASA Discipline Cardiopulmonary↗