Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Linear Regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to outbred mice data

Accurately quantifying the differences in radiation quality between space and terrestrial environments is important for predicting health risks for astronauts.Recently, Edmundson et al. 2020[1] provided valuable new results from out-bred mice linking tumor induction and genetic background aer exposure to low and high-LET radiation. The goal of the current study is to more rigorously estimate a relative biological effectiveness (RBE) factor by leveraging the solid tumor data from Edmundson et al. 2020. Excess relative risk (ERR) models and excess absolute risk (EAR) models were fit using Poisson regression similar to the models that the Radiation Effects Research Foundation uses to fit atomic bomb survivor data. Linear ERR and EAR slopes were simulated usingBayesian analyses, and RBE values were calculated from the ratio of the heavy ion linear slope to the gamma linear slope using the full posterior distribution.

Lori J. Chappell↗

Time-reversal symmetry breaking in two-dimensional nonequilibrium viscous fluids

In this work, we study the rheological signatures of departure from equilibrium in two-dimensional viscous fluids with and without internal spin. Under the assumption of isotropy, we provide the most general linear constitutive relations for stress and couple stress in terms of the velocity and spin fields. Invoking Onsager's regression hypothesis for fluctuations about steady states, we derive the Green-Kubo formulas relating the transport coefficients to time-correlation functions of the fluctuating stress. In doing so, we show that one of the nonequilibrium transport coefficients, the odd viscosity, requires time-reversal symmetry breaking in the case of systems without internal spin. However, the Green-Kubo relations for systems with internal spin also show that there is a possibility for nonvanishing odd viscosity even when time-reversal symmetry is preserved. Furthermore, we find that breakdown of equipartition in nonequilibrium steady states results in the decoupling of the two rotational viscosities relating the vorticity and the internal spin.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Advancing the quantification of aerosol-cloud interactions with the CALIPSO-CloudSat-Aqua/MODIS record

Aerosol-cloud-precipitation interactions are assessed over the non-polar ocean using more than 11 years of combined Aqua-MODIS, CALIPSO-CALIOP, and CloudSat products. The analysis first shows the benefit of incorporating vertically resolved aerosol extinction coefficient (σext) in aerosol-cloud interactions (ACI) assessments, demonstrating that: σext vertically collocated with the cloud layer () correlates best with cloud droplet number concentration (Nd), column-integrated aerosol optical depth (AOD) cannot explain the Nd variability in the extratropics, and the S-shape of the AOD-Nd relationship reported in previous studies is not replicated when using instead of AOD, with a Nd- linearity more consistent with in-situ studies over the ocean. ACI metric, estimated as the log-scale regression between CALIOP and MODIS Nd reveals that the eastern Pacific is the region with the strongest ACI, followed by the Southern Ocean. The susceptibility of clouds to changes in their liquid water path (LWP) and frequency of precipitation followed a 2-step calculation by combining the Nd- regression (ACI) with the regression between these macrophysical variables and Nd. LWP susceptibility is negative (LWP decreases with aerosol loading) and statistically significant over the eastern Pacific, eastern Atlantic, and extratropics. In contrast, vast areas of the tropical and subtropical ocean feature negligible changes in LWP with aerosol. Precipitation frequency susceptibility is negative, but the values are only significant over the coastal eastern Pacific and Atlantic. The findings suggest that previous modeling assessments relying on AOD may need to be revisited by taking advantage of the synergy between passive and active sensors.

Li, Zhujun↗

On three dimensional object recognition and pose-determination: An abstraction based approach

A method of computing reliable Gaussian and mean curvature sign-map descriptors from the polynomial approximation of surfaces was demonstrated. Such descriptors which are invariant under perspective variation are suitable for hypothesis generation. A means for determining the pose of constructed geometric forms whose algebraic surface descriptors are nonlinear in terms of their orienting parameters was developed. This was done by means of linear functions which are capable of approximating nonlinear forms and determining their parameters. It was shown that biquadratic surfaces are suitable companion linear forms for cylindrical approximation and parameter estimation. The estimates provided the initial parametric approximations necessary for a nonlinear regression stage to fine tune the estimates by fitting the actual nonlinear form to the data. A hypothesis-based split-merge algorithm for extraction and pose determination of cylinders and planes which merge smoothly into other surfaces was developed. It was shown that all split-merge algorithms are hypothesis-based. A finite-state algorithm for the extraction of the boundaries of run-length regions was developed. The computation takes advantage of the run list topology and boundary direction constraints implicit in the run-length encoding.

Quek, Kok How Francis↗

Adding In-Plane Flexibility to the Equations of Motion of a Single Rotor Helicopter

This report describes a way to add the effects of main rotor blade flexibility in the in- plane or lead-lag direction to a large set of non-linear equations of motion for a single rotor helicopter with rigid blades(l). Differences between the frequency of the regressing lag mode predicted by the equations of (1) and that measured in flight (2) for a UH-60 helicopter indicate that some element is missing from the analytical model of (1) which assumes rigid blades. A previous study (3) noted a similar discrepancy for the CH-53 helicopter. Using a relatively simple analytical model in (3), compared to (1), it was shown that a mechanical lag damper increases significantly the coupling between the rigid lag mode and the first flexible mode. This increased coupling due to a powerful lag damper produces an increase in the lowest lag frequency when viewed in a frame rotating with the blade. Flight test measurements normally indicate the frequency of this mode in a non-rotating or fixed frame. This report presents the additions necessary to the full equations of motion, to include main rotor blade lag flexibility. Since these additions are made to a very complex nonlinear dynamic model, in order to provide physical insight, a discussion of the results obtained from a simplified set of equations of motion is included. The reduced model illustrates the physics involved in the coupling and should indicate trends in the full model.

Curtiss, H. C., Jr.↗

Optical properties of intact leaves for estimating chlorophyll concentration

Changes in leaf chlorophyll content can serve as relative indicators of plant vigor and environmental quality. This study identified reflectance, transmittance, and absorptance wavebands and band ratios within the 400- to 850-nm range for intact leaves that could be used to estimate extracted leaf chlorophyll per unit leaf area (areal concentration) with minimal error. Leaf optical properties along with chlorophyll a, b, and a + b concentrations were measured for the planar-leaved sweetgum (Liquidambar styraciflua L.), red maple (Acer rubrum L.), wild grape (Vitis rotundifolia Michx.), and switchcane [Arundinaria gigantea (Walter) Muhl.], and for needles of longleaf pine (Pinus palustris Miller). Generally, reflectance, transmittance, and absorptance corresponded most precisely with chlorophyll concentrations at wavelengths near 700 nm, although regressions were also strong in the 550- to 625-nm range. A power function was superior to a simple linear function in yielding low standard deviations of the estimate (s). When data were combined among the planar-leaved species, s values were low at approximately 50 mumol/m2 out of a 940 mumol/m2 range in chlorophyll a + b at best-fit wavelengths of 707 to 709 nm. Minimal s values for chlorophyll a + b ranged from 32 to 62 mumol/m2 across species when band ratios having numerator wavelengths of 693 to 720 nm were used with the application of a power function. Optimal denominator wavelengths for the band ratios were 850 nm for reflectance and transmittance and 400 nm for absorptance. This information can be applied in designing field portable chlorophyll meters and in the landscape-scale remote sensing of plant responses to the environment.

Chlorophyll/analysis↗

Regression Model Optimization for the Analysis of Experimental Data

A candidate math model search algorithm was developed at Ames Research Center that determines a recommended math model for the multivariate regression analysis of experimental data. The search algorithm is applicable to classical regression analysis problems as well as wind tunnel strain gage balance calibration analysis applications. The algorithm compares the predictive capability of different regression models using the standard deviation of the PRESS residuals of the responses as a search metric. This search metric is minimized during the search. Singular value decomposition is used during the search to reject math models that lead to a singular solution of the regression analysis problem. Two threshold dependent constraints are also applied. The first constraint rejects math models with insignificant terms. The second constraint rejects math models with near-linear dependencies between terms. The math term hierarchy rule may also be applied as an optional constraint during or after the candidate math model search. The final term selection of the recommended math model depends on the regressor and response values of the data set, the user s function class combination choice, the user s constraint selections, and the result of the search metric minimization. A frequently used regression analysis example from the literature is used to illustrate the application of the search algorithm to experimental data.

Ulbrich, N.↗

A method for nonlinear exponential regression analysis

A computer-oriented technique is presented for performing a nonlinear exponential regression analysis on decay-type experimental data. The technique involves the least squares procedure wherein the nonlinear problem is linearized by expansion in a Taylor series. A linear curve fitting procedure for determining the initial nominal estimates for the unknown exponential model parameters is included as an integral part of the technique. A correction matrix was derived and then applied to the nominal estimate to produce an improved set of model parameters. The solution cycle is repeated until some predetermined criterion is satisfied.

Junkin, B. G.↗

Unsteady hovering wake parameters identified from dynamic model tests, part 1

The development of a 4-bladed model rotor is reported that can be excited with a simple eccentric mechanism in progressing and regressing modes with either harmonic or transient inputs. Parameter identification methods were applied to the problem of extracting parameters for linear perturbation models, including rotor dynamic inflow effects, from the measured blade flapping responses to transient pitch stirring excitations. These perturbation models were then used to predict blade flapping response to other pitch stirring transient inputs, and rotor wake and blade flapping responses to harmonic inputs. The viability and utility of using parameter identification methods for extracting the perturbation models from transients are demonstrated through these combined analytical and experimental studies.

Hohenemser, K. H.↗

Evaluation of the CEAS model for barley yields in North Dakota and Minnesota

The CEAS yield model is based upon multiple regression analysis at the CRD and state levels. For the historical time series, yield is regressed on a set of variables derived from monthly mean temperature and monthly precipitation. Technological trend is represented by piecewise linear and/or quadriatic functions of year. Indicators of yield reliability obtained from a ten-year bootstrap test (1970-79) demonstrated that biases are small and performance as indicated by the root mean square errors are acceptable for intended application, however, model response for individual years particularly unusual years, is not very reliable and shows some large errors. The model is objective, adequate, timely, simple and not costly. It considers scientific knowledge on a broad scale but not in detail, and does not provide a good current measure of modeled yield reliability.

Barnett, T. L.↗

Estimating Volume, Biomass, and Carbon in Hedmark County, Norway Using a Profiling LiDAR

A profiling airborne LiDAR is used to estimate the forest resources of Hedmark County, Norway, a 27390 square kilometer area in southeastern Norway on the Swedish border. One hundred five profiling flight lines totaling 9166 km were flown over the entire county; east-west. The lines, spaced 3 km apart north-south, duplicate the systematic pattern of the Norwegian Forest Inventory (NFI) ground plot arrangement, enabling the profiler to transit 1290 circular, 250 square meter fixed-area NFI ground plots while collecting the systematic LiDAR sample. Seven hundred sixty-three plots of the 1290 plots were overflown within 17.8 m of plot center. Laser measurements of canopy height and crown density are extracted along fixed-length, 17.8 m segments closest to the center of the ground plot and related to basal area, timber volume and above- and belowground dry biomass. Linear, nonstratified equations that estimate ground-measured total aboveground dry biomass report an R(sup 2) = 0.63, with an regression RMSE = 35.2 t/ha. Nonstratified model results for the other biomass components, volume, and basal area are similar, with R(sup 2) values for all models ranging from 0.58 (belowground biomass, RMSE = 8.6 t/ha) to 0.63. Consistently, the most useful single profiling LiDAR variable is quadratic mean canopy height, h (sup bar)(sub qa). Two-variable models typically include h (sup bar)(sub qa) or mean canopy height, h(sup bar)(sub a), with a canopy density or a canopy height standard deviation measure. Stratification by productivity class did not improve the nonstratified models, nor did stratification by pine/spruce/hardwood. County-wide profiling LiDAR estimates are reported, by land cover type, and compared to NFI estimates.

Nelson, Ross↗

Perspectives on the Calibration of CNN Energy Reconstruction in Highly Granular Calorimeters

We present a study which shows encouraging stability of the response linearity for a simulated high granularity calorimeter module reconstructed by a CNN model to miscalibration, bias, and noise effects. Our results also show an intuitive, quantifiable relationship between these factors and the calibration parameters. We trained a CNN model to reconstruct energy in the calorimeter module using simulated single-pion events; we then observed the response of the model under various miscalibration, bias, and noise conditions that affected the model input. From these data, we estimated linear response models to calibrate the CNN. We also quantified the relationship between these factors and the calibration parameters by regression analysis.

Akchurin, Nural↗

Red and photographic infrared linear combinations for monitoring vegetation

The relationships between various linear combinations of red and photographic infrared radiances and vegetation parameters are investigated. In situ spectrometers are used to measure the relationships between linear combinations of red and IR radiances, their ratios and square roots, and biomass, leaf water content and chlorophyll content of a grass canopy in June, September and October. Regression analysis shows red-IR combinations to be more significant than green-red combinations. The IR/red ratio, the square root of the IR/red ratio, the vegetation index (IR-red difference divided by their sum) and the transformed vegetation index (the square root of the vegetation index + 0.5) are found to be sensitive to the amount of photosynthetically active vegetation. The accumulation of dead vegetation over the year is found to have a linearizing effect on the various vegetation measures.

Tucker, C. J.↗

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

Improved Linear Algebra Methods for Redshift Computation from Limited Spectrum Data - II

Given photometric broadband measurements of a galaxy, Gaussian processes may be used with a training set to solve the regression problem of approximating the redshift of this galaxy. However, in practice solving the traditional Gaussian processes equation is too slow and requires too much memory. We employed several methods to avoid this difficulty using algebraic manipulation and low-rank approximation, and were able to quickly approximate the redshifts in our testing data within 17 percent of the known true values using limited computational resources. The accuracy of one method, the V Formulation, is comparable to the accuracy of the best methods currently used for this problem.

Foster, Leslie↗

Bi-Level Adaptive Storage Expansion Strategy for Microgrids Using Deep Reinforcement Learning

Battery energy storage (BES) is a versatile resource for the secure and economic operation of microgrids (MGs). Prevailing stochastic optimization-based approaches for BES expansion planning for MGs are computationally complicated. This work proposes a data-driven bi-level multi-period BES expansion planning framework to determine the siting, sizing, and timing of BES installations. The proposed planning framework unifies deep reinforcement learning (DRL) and linear programming, thereby decoupling the determinations for the integer and continuous decision variables in two time scales, respectively. In the upper level, a rainbow DRL agent with quantile regression is trained to provide dynamic planning policies to accommodate stochastic renewable energy resources (RESs), load, and battery price changes efficiently. Further, the lower level computes the optimal operation of MGs with frequency constraints to hedge the islanding contingency. The two levels communicate with one another by exchanging storage configuration and operating expenses in order to accomplish the shared goal of minimizing investment and operation costs. Comparative case studies on an MG are carried out to demonstrate the superiority of the proposed DRL-based solution to the mixed-integer linear programming counterpart on efficiency, scalability, and adaptability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Machine learning and deep learning for mineralogy interpretation and CO 2 saturation estimation in geological carbon Storage: A case study in the Illinois Basin

Carbon capture and storage (CCS) is a promising approach to simultaneously maintaining energy security and reducing carbon dioxide (CO 2 ) emissions under the current energy portfolio that is dominated by fossil fuel energy. Pre-injection formation characterization and post-injection CO 2 monitoring are two critical tasks to guarantee storage efficiency in CCS. The CCS projects in the Illinois Basin, the first large-scale CO 2 injection into saline aquifers in the United States, employed conventional and the latest pulsed neutron logging (PNL) tools for mineralogy interpretation and CO 2 saturation estimation, which provide valuable references for future CCS projects. Because of the inherent fuzziness of petrophysical measurements and complex subsurface heterogeneity, interpreting well-logging data is time-consuming, and its accuracy can be user-biased. In recent years, data-driven methods have been widely used to capture the non-linear patterns between input features and interpretation results. This work applied and evaluated four commonly used machine learning (ML) models, including ridge regression (RR), random forest (RF), gradient boosting regression (GBR), support vector regression (SVR), and one deep learning (DL) model, the artificial neural network (ANN). We optimized the hyperparameters of the four ML models and the DL model using the simulated annealing algorithm and the grid search strategy, respectively. The input features of the mineralogy interpretation models were eleven conventional well-logging parameters, and the label data (i.e., ground truth) were the porosity and volumetric fractions of six minerals, including quartz, feldspar, dolomite, calcite, clay, and iron minerals. The results demonstrated that the GBR and RF models were superior in predicting volumetric fractions of minerals and porosity; label data with low coefficient of variation (CV) values tended to yield better performance. For CO 2 saturation estimation, the RF was the best-performing model, followed by SVR, ANN, GBR, and RR. Furthermore, we conducted feature importance ranking using the permutation importance algorithm and found that the formation sigma and well pressure were the most important features in this study. In conclusion, the study of CCS projects in the Illinois Basin bridges the gap between the limited knowledge and understanding of geological carbon storage and the increasing demand for reliable, cost-effective, and sustainable energy solutions.

58 GEOSCIENCES↗