Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “nonlinear regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Does the high–tech industry consistently reduce CO{sub 2} emissions? Results from nonparametric additive regression model

China is currently the world's largest carbon dioxide (CO{sub 2}) emitter. Moreover, total energy consumption and CO{sub 2} emissions in China will continue to increase due to the rapid growth of industrialization and urbanization. Therefore, vigorously developing the high–tech industry becomes an inevitable choice to reduce CO{sub 2} emissions at the moment or in the future. However, ignoring the existing nonlinear links between economic variables, most scholars use traditional linear models to explore the impact of the high–tech industry on CO{sub 2} emissions from an aggregate perspective. Few studies have focused on nonlinear relationships and regional differences in China. Based on panel data of 1998–2014, this study uses the nonparametric additive regression model to explore the nonlinear effect of the high–tech industry from a regional perspective. The estimated results show that the residual sum of squares (SSR) of the nonparametric additive regression model in the eastern, central and western regions are 0.693, 0.054 and 0.085 respectively, which are much less those that of the traditional linear regression model (3.158, 4.227 and 7.196). This verifies that the nonparametric additive regression model has a better fitting effect. Specifically, the high–tech industry produces an inverted “U–shaped” nonlinear impact on CO{sub 2} emissions in the eastern region, but a positive “U–shaped” nonlinear effect in the central and western regions. Therefore, the nonlinear impact of the high–tech industry on CO{sub 2} emissions in the three regions should be given adequate attention in developing effective abatement policies. - Highlights: • The nonlinear effect of the high–tech industry on CO{sub 2} emissions was investigated. • The high–tech industry yields an inverted “U–shaped” effect in the eastern region. • The high–tech industry has a positive “U–shaped” nonlinear effect in other regions. • The linear impact of the high–tech industry in the eastern region is the strongest.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Non-intrusive data-driven model reduction for differential–algebraic equations derived from lifting transformations

In this paper we present a non-intrusive data-driven approach for model reduction of nonlinear systems. The approach considers the particular case of nonlinear partial differential equations (PDEs) that form systems of partial differential–algebraic equations (PDAEs) when lifted to polynomial form. Such systems arise, for example, when the governing equations include Arrhenius reaction terms (e.g., in reacting flow models) and thermodynamic terms (e.g., the Helmholtz free energy terms in a phase-field solidification model). Using the known structured form of the lifted algebraic equations, the approach computes the reduced operators for the algebraic equations explicitly, using straightforward linear algebra operations on the basis matrices. The reduced operators for the differential equations are inferred from lifted snapshot data using operator inference, which solves a linear least squares regression problem. The approach is illustrated for the nonlinear model of solidification of a pure material. The lifting transformations reformulate the solidification PDEs as a system of PDAEs that have cubic structure. The operators of the lifted system for this solidification example have affine dependence on key process parameters, permitting us to learn a parametric reduced model with operator inference. Numerical experiments show the effectiveness of the resulting reduced models in capturing key aspects of the solidification dynamics.

42 ENGINEERING↗
DOE OSTI2015

Modern sensitivity analysis - 15651

Sensitivity analysis has been applied to complex models, such as performance assessment models, since at least the advent of computational tools to support such an approach to model evaluation. Initially, sensitivity analysis methods were applied to deterministic models and focused on changing one input variable at a time. Probabilistic modeling opened the door to evaluating changes in all input variables simultaneously. Standardized rank regression methods were primarily used in the last century to evaluate probabilistic models. These methods assume linearity in the rank response of the model to the inputs. At the very least this assumes monotonicity in the response, but for the most part the response needs to be near-linear. This is highly unlikely for performance assessment models that are based on differential equations, multiplication and division of variables that are usually not correlated, and conservatism that is not well understood. There are better statistical methods for evaluating highly non-linear and dynamic probabilistic models. Some of these methods were founded in the data mining industry. This century has seen a rapid development of the internet that led directly to the development of data mining techniques for massive databases. Although the goals were different, these techniques can be adapted to sensitivity analysis for complex probabilistic models, which, also, form large, or even massive, databases. These modern sensitivity analysis procedures assess the importance of every explanatory variable (input parameters) used in a probabilistic model. In practice, this means that for each endpoint of interest, every explanatory variable in the model is associated with a quantitative measure of importance. For a given explanatory variable, the importance value depends on the endpoint of interest. This global approach to sensitivity analysis allows all levels of interactions to be evaluated, so that the variation in the output can be measured at every level of possible interaction. The effects are collected together during sensitivity analysis processing, and then separated out to attribute the overall contribution of each input parameter to the model output. These global sensitivity analysis procedures have the ability to characterize non-linear and non-monotonic relationships between explanatory variables and endpoints of interest. This is critically important because of the need to characterize complex interactions among multiple explanatory variables in PA models that often have non-linear and non-monotonic effects. The options for sensitivity analysis are fully explored, including an evaluation of several methods when applying them to a well-known complex non-linear non-monotonic model. The results clearly demonstrate the relative benefit of using data mining methods over simple statistical approaches such as standardized rank regression. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Identification of Rate, Extent, and Mechanisms of Hot Metal Resulfurization with CaO-SiO{sub 2}-Na{sub 2}O Slag Systems

The resulfurization of hot metal has not been comprehensively studied in literature. This study presents an experimental and mathematical modeling study of resulfurization in thermodynamic and kinetic point of view. The rate, extent, and mechanisms of resulfurization were evaluated by analyzing concurrently the physical properties and sulfur-extracting ability of the slag. Experiments were conducted in a chamber furnace in an argon atmosphere, and the hot metal was sampled with pre-defined basis. The experiments were continued until the metal–slag system reached an apparent thermodynamic equilibrium. To obtain a quantitative measure on the effect of system properties on the rate and extent of resulfurization, the results of this study were combined with previous studies handling the sulfide capacities of Na{sub 2}O-SiO{sub 2} and CaO-SiO{sub 2}-Na{sub 2}O slag systems. The sulfide capacities of the slag and corresponding metal–slag sulfur partition ratios were mathematically modeled with data-driven techniques such as multiple linear and non-linear regression and artificial neural networks. Finally, with the help of these, to study the kinetics of resulfurization, a simple mechanistic reaction model was derived. The results suggest that resulfurization of hot metal follows 1st-order kinetics and that the rate and extent can be regulated through the control of the associated thermodynamic driving force and by modifying the physical properties of the slag. The rate-limiting factor was found to be determined by the morphology of the slag phase.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Landsat 8 monitoring of multi-depth suspended sediment concentrations in Lake Erie’s Maumee River using machine learning

Satellite remote sensing has been widely used to map suspended sediment concentration (SSC) in waterbodies. However, due to the complexity of sediment-water interactions, it has been difficult to derive linear and non-linear regression equations to reliably predict SSC, especially when trying to estimate depth of integrated sediment. Herein, this study uses Landsat 8 OLI (Operational Land Imager) sensor to map SSC within the Maumee River in Ohio, USA, at multiple depth intervals (15, 61, 91, and 182 cm). Simple linear least squares regression (LLSR), and three common machine learning models: random forest (RF), support vector regression (SVR), and model averaged neural network (MANN) were used to estimate SSC at the depth intervals. All machine learning models significantly outperformed LLSR while RF performed the best. In both RF and MANN, R2 (coefficient of determination) increases with depth with a maximum R2 of 0.89 and 0.83, respectively, at a depth of 0–182 cm. The results show that machine learning models can implement nonlinear relationships that produce better predictions than traditional linear regression methods in estimating depth integrated SSC, especially when samples are limited.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Challenges in integrating dissolved organic matter chemodiversity into kinetic models of soil respiration

The chemodiversity of dissolved organic matter (DOM) in soil has been proposed to influence the microbial metabolism and fate of belowground organic carbon (C). However, integrating DOM chemistry into soil C cycle models to improve predictions of C stocks and fluxes—beyond simply considering DOM pool size—remains a challenge. While recent research suggests that incorporating DOM chemodiversity into models can improve predictions of microbial respiration, there is still a lack of mechanistic understanding describing how DOM chemodiversity affects microbial metabolism and soil respiration. Here, we evaluated whether DOM chemodiversity was a determinant of soil respiration using paired measurements of high-resolution DOM chemistry, obtained from Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS), and potential soil respiration rates from across the United States (U.S.), all data provided by the Molecular Observation Network. Our objectives were to (1) assess statistical relationships between DOM chemodiversity and microbial respiration, and (2) evaluate the ability of kinetic models to leverage DOM chemistry to explain empirical relationships found in statistical models. Statistical regressions revealed that DOM chemodiversity (alpha diversity) was nonlinearly related to potential soil respiration rates, both independently and through its interactions with DOM and total C concentrations. In soils with relatively high DOM but low total C concentrations, potential soil respiration rates were negatively correlated with DOM alpha diversity, whereas in soils with relatively low DOM and high total C concentrations showed the opposite trend. However, when metabolic transition theory kinetic models were modified to include chemodiversity, their performance was comparable to traditional Monod kinetics approaches, which simulate respiration rates as a function of DOM concentration. The inability to account for nonlinearities in DOM chemodiversity–respiration relationships highlight an opportunity to advance substrate uptake kinetics by establishing causal links between DOM chemodiversity, microbial metabolism trade-offs, and potential interactions under varied environmental conditions.

Bioenergetic model↗
DOE OSTI2024

Modeling of the metal–insulator transition temperature in alio-valently doped VO 2 through symbolic regression

The correlated semiconductor vanadium dioxide (VO 2 ) exhibits an insulator–metal transition (IMT) near room temperature, which is of interest in various device applications. Precise IMT temperature control is crucial to determine the use cases across technologies such as thermochromic windows, actuators for robots or neuronal oscillators. Doping the cation or anion sites can modulate the IMT by several tens of degrees and control hysteresis. However, modeling the effects of control parameters (e.g., doping concentration, type of dopants) is challenging due to complex experimental procedures and limited data, hindering the use of traditional data-driven machine learning approaches. Symbolic regression (SR) can bridge this gap by identifying nonlinear expressions connecting key input parameters to target properties, even with small data sets. In this work, we develop SR models to capture the IMT trends in VO 2 influenced by different dopant parameters. Using experimental data from the literature, our study reveals a dual nature of the IMT temperature with varying tungsten (W) doping concentrations. The symbolic model captures data trends and accounts for experimental variability, providing a complementary approach to first-principles calculations. Our feature-driven analysis across a broader class of dopants informs selectivity and provides qualitative insights into tuning phase transition properties valuable for neuromorphic computing and thermochromic windows.

36 MATERIALS SCIENCE↗
DOE OSTI2018

CHiPBETA

High-accuracy water level data are needed to resolve the temporal and spatial hydraulic response to pumping in aquifers. However, the water-level data are typically affected by physical process unrelated to the aquifer pumping such as barometric pressure changes, tides, earthquakes, {\etc}. We have developed a computational framework to correct for barometric and Earth tide effects using linear regression deconvolution, as an initial guess for a nonlinear residual minimization to account for pumping effects. The pumping effects are predicted using the Theis equation with initialization by Jacob's method. After minimizing the residuals between the observed data and Theis predicted pumping effects, the algorithm estimates storativity and transmissivity of the aquifer. The algorithm also provides information about the measurement accuracy of the collected water-level data. The computational framework CHiPBETA is developed in Python and demonstrated to analyze synthetic and real data.

Banner, Eric↗
NASA NTRS2004

Neural network uncertainty assessment using Bayesian statistics: a remote sensing application

Neural network (NN) techniques have proved successful for many regression problems, in particular for remote sensing; however, uncertainty estimates are rarely provided. In this article, a Bayesian technique to evaluate uncertainties of the NN parameters (i.e., synaptic weights) is first presented. In contrast to more traditional approaches based on point estimation of the NN weights, we assess uncertainties on such estimates to monitor the robustness of the NN model. These theoretical developments are illustrated by applying them to the problem of retrieving surface skin temperature, microwave surface emissivities, and integrated water vapor content from a combined analysis of satellite microwave and infrared observations over land. The weight uncertainty estimates are then used to compute analytically the uncertainties in the network outputs (i.e., error bars and correlation structure of these errors). Such quantities are very important for evaluating any application of an NN model. The uncertainties on the NN Jacobians are then considered in the third part of this article. Used for regression fitting, NN models can be used effectively to represent highly nonlinear, multivariate functions. In this situation, most emphasis is put on estimating the output errors, but almost no attention has been given to errors associated with the internal structure of the regression model. The complex structure of dependency inside the NN is the essence of the model, and assessing its quality, coherency, and physical character makes all the difference between a blackbox model with small output errors and a reliable, robust, and physically coherent model. Such dependency structures are described to the first order by the NN Jacobians: they indicate the sensitivity of one output with respect to the inputs of the model for given input data. We use a Monte Carlo integration procedure to estimate the robustness of the NN Jacobians. A regularization strategy based on principal component analysis is proposed to suppress the multicollinearities in order to make these Jacobians robust and physically meaningful.

Neural Networks (Computer)↗
NASA NTRS2021

Moisture and Temperature Influences on Nonlinear Vegetation Trends in Serengeti National Park

While long-term vegetation greening trends have appeared across large land areas over the late 20th century, uncertainty remains in identifying and attributing finer-scale vegetation changes and trends, particularly across protected areas. Serengeti National Park (SNP) is a critical East African protected area, where seasonal vegetation cycles support vast populations of grazing herbivores and a host of ecosystem dynamics. Previous work has shown how non-climate drivers (e.g. land use) shape the SNP ecosystem, but it is still unclear to what extent changing climate conditions influence SNP vegetation, particularly at finer spatial and temporal scales. We fill this research gap by evaluating long-term (1982–2016) changes in SNP leaf area index (LAI) in relation to both temperature and moisture availability using Ensemble Empirical Mode Decomposition and Principal Component Analysis with regression techniques. We find that SNP LAI trends are nonlinear, display high sub-seasonal variation, and are influenced by lagged changes in both moisture and temperature variables and their interactions. LAI during the long rains (e.g. March) exhibits a greening-to-browning trend reversal starting in the early 2000s, partly due to antecedent precipitation declines. In contrast, LAI during the short rains (e.g. November, December) displays browning-to-greening alongside increasing moisture availability. Rising temperature trends also have important, secondary interactions with moisture variables to shape these SNP vegetation trends. Our findings show complex vegetation-climate interactions occurring at important temporal and spatial scales of the SNP, and our rigorous statistical approaches detect these complex climate-vegetation trends and interactions, while guarding against spurious vegetation signals.

Moisture↗
NASA NTRS2016

Sensitivity Analysis of the Integrated Medical Model for ISS Programs

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Standardized Rank Regression Coefficient (SRRC) are methods of conducting sensitivity analysis on nonlinear simulation models like the Integrated Medical Model (IMM). The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The partial part is so named because adjustments are made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. In SRRC, standardized regression-based coefficients measure the sensitivity of each input, adjusted for all the other inputs, on each output. Because the relative ranking of each of the inputs and outputs is used, as opposed to the values themselves, both methods accommodate the nonlinear relationship of the underlying model. As part of the IMM v4.0 validation study, simulations are available that predict 33 person-missions on ISS and 111 person-missions on STS. These simulated data predictions feed the sensitivity analysis procedures. The inputs to the sensitivity procedures include the number occurrences of each of the one hundred IMM medical conditions generated over the simulations and the associated IMM outputs: total quality time lost (QTL), number of evacuations (EVAC), and number of loss of crew lives (LOCL). The IMM team will report the results of using PRCC and SRRC on IMM v4.0 predictions of the ISS and STS missions created as part of the external validation study. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMM v4.0.

medical equipment↗
DOE OSTI2017

Sparse Bayesian Regression with Integrated Feature Selection for Nuclear Reactor Analysis

High-dimensional, nonlinear function estimation using large datasets is a current area of interest in the machine learning community, and applications may be found throughout the analytical sciences, where ever-growing datasets are making more information available to the analyst. In this paper, we leverage the existing relevance vector machine, a sparse Bayesian version of the well-studied support vector machine, and expand the method to include integrated feature selection and automatic function shaping. These innovations produce an algorithm that is able to distinguish variables that are useful for making predictions of a response from variables that are unrelated or confusing. We test the technology using synthetic data, conduct initial performance studies, and develop a model capable of making position-independent predictions of the coreaveraged burnup using a single specimen drawn randomly from a nuclear reactor core.

Dayman, Ken J↗
DOE OSTI2019

Materials data analytics for 9% Cr family steel

A materials data analytics (MDA) methodology was developed in this study to evaluate publicly available information on 9% Cr family steel and to handle nonlinear relationships and the sparsity in materials data for this alloy class. The overarching goal is to accelerate the design process as well as to reduce the time and expense associated with qualification testing of new alloys for fossil energy applications. Data entries in the analyzed data set for 82 iron–base alloy compositions, several processing parameters, and results of tensile mechanical tests selected for this study were arranged in 34 columns by 915 rows. While detailed microstructural information was not available, it is assumed that the compositional space for the 9 to 12% Cr steels is limited such that all data entries have a tempered martensitic microstructure during service. Establishing a hierarchy of first–order trends in the publicly available data requires the MDA to filter out the biases. Complexity of the phase transformations and microstructure evolution in the multicomponent alloys (using 21 chemical elements) with major influence on mechanical properties, leads to inefficiency in direct application of unbiased linear regression across the entire data space. To address the nonlinearity, analyses of tensile data were performed in composition–based clusters. Clusters corresponding to moderately frequent patterns and maximized information gain were further refined by using p–norm distance measures, matching the alloy classification groups adopted by industry. Lastly, the evolutionary method of propagating an ensemble of competing cluster–based models proved to be a viable option in dealing with scarce, multidimensional data.

36 MATERIALS SCIENCE↗
NASA NTRS1984

Applications of model structure determination to flight test data

Several statistical and information criteria need to be considered when selecting an adequate model. Incorrect stability and control derivates result from inadequate aerodynamic model structure. Stepwise regression is used to determine the structure for an adequate model. Flight data which covers a nonlinear aerodynamic model range may be analyzed as a single data set or partitioned into several distinct sets. Stepwise regression for model structure detemination and parameter estimation was successfully applied to three aircraft types (single engine general aviation, unaugmented modern jet fighter, jet transport).

Batterson, J. G.↗
NASA NTRSDate not supplied

The Added Value of SMAP Soil Moisture in Crop Yield Forecasting Over Argentina

Argentina is one of the major producers and exporter of soybeans, corn, and wheat to the world market; therefore, the accurate and timely forecasting of those crops yield is crucial to national crop management and global food security. Previous studies have mainly focused on developing forecasting models for a specific crop type and location using a single source of data (e.g., vegetation indices), thus providing little insight into the forecasting models' performance on different crop types and regions. Besides, these models are based on traditional statistical regression algorithms, while more advanced machine learning approaches have not been explored. This study investigated the estimation of crop yields of three major crops (corn, soybean, and winter wheat) using Multiple Linear Regression (MLR) and Support Vector Machine (SVM), over major growing provinces in Argentina. Our models were trained and evaluated on data from 2015 to 2020, where three remote sensing products (Normalized difference vegetation index (NDVI), SMAP soil moisture, and MODIS evapotranspiration) were used as predictors. Our results indicated that accurate crop yield forecasts using the developed regression models could be made one to two months before harvest. The MLR and SVM model performance varied among different crop types, where soybean and corn exhibited better predictability compare to the wheat. In most cases, the SVM outperformed the multiple linear regression model due to its ability to capture the nonlinear and complex features of the crop-production process. The forecasted model that combines data from multiple sources outperformed single-source satellite data. The highest accuracy was obtained when the three data sources were all considered in the model development. Results also indicated that the inclusion of SMAP soil moisture improved crop yield forecasting in most provinces, and the most significant improvements occurred in the drier region.

Nazmus Shams Sazib↗
NASA NTRS2001

Atlantic Tropical Cyclone Monitoring with AMSU-A: Estimation of Maximum Sustained Wind Speeds

The first Advanced Microwave Sounding Unit temperature sounder (AMSU-A) was launched on the NOAA-15 satellite on 13 May 1998. The AMSU-A's higher spatial and radiometric resolutions provide more useful information on the strength of the middle- and upper-tropospheric warm cores associated with tropical cyclones than have previous microwave temperature sounders. The gradient wind relationship suggests that the temperature gradient near the core of tropical cyclones increases nonlinearly with wind speed. The gradient wind equation is recast to include AMSU-A-derived variables, Stepwise regression is used to determine which of these variables is most closely related to maximum sustained winds (V(sub max)). The satellite variables investigated include the radially averaged gradients at two spatial resolutions of AMSU-A channels 1-10 T(sub b) data (delta(sub r)T(sub B)), the squares of these gradients, a channel-15-based scattering index (SI(sub 89)), and area-averaged T(sub B). Calculations of T(sub B) and delta(sub r)T(sub B) from mesoscale model simulations of Andrew reveal the effects of the AMSU spatial sampling on the cyclone warm core presentation. Stepwise regression of 66 AMSU-A terms against National Hurricane Center V(sub max) estimates from the 1998 and 1999 Atlantic hurricane season confirms the existence of a nonlinear relationship between wind speed and radially averaged temperature gradients near the cyclone warm core. Of six regression terms, four are dominated by temperature information, and two are interpreted as correcting for hydrometeor contamination. Jackknifed regressions were performed to estimate the algorithm performance on independent data. For the 82 cases that had in situ measurements of V(sub max), the average error standard deviation was 4.7 m/s. For 108 cases without in situ wind data, the average error standard deviation was 7.5 m/s Operational considerations, including the detection of weak cyclones and false alarm reduction, are also discussed.

Spencer, Roy W.↗
DOE OSTI2026

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗