Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Linear Regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Solid Rocket Motor Combustion Instability Modeling in COMSOL Multiphysics

Combustion instability modeling of Solid Rocket Motors (SRM) remains a topic of active research. Many rockets display violent fluctuations in pressure, velocity, and temperature originating from the complex interactions between the combustion process, acoustics, and steady-state gas dynamics. Recent advances in defining the energy transport of disturbances within steady flow-fields have been applied by combustion stability modelers to improve the analysis framework [1, 2, 3]. Employing this more accurate global energy balance requires a higher fidelity model of the SRM flow-field and acoustic mode shapes. The current industry standard analysis tool utilizes a one dimensional analysis of the time dependent fluid dynamics along with a quasi-three dimensional propellant grain regression model to determine the SRM ballistics. The code then couples with another application that calculates the eigenvalues of the one dimensional homogenous wave equation. The mean flow parameters and acoustic normal modes are coupled to evaluate the stability theory developed and popularized by Culick [4, 5]. The assumption of a linear, non-dissipative wave in a quiescent fluid remains valid while acoustic amplitudes are small and local gas velocities stay below Mach 0.2. The current study employs the COMSOL multiphysics finite element framework to model the steady flow-field parameters and acoustic normal modes of a generic SRM. The study requires one way coupling of the CFD High Mach Number Flow (HMNF) and mathematics module. The HMNF module evaluates the gas flow inside of a SRM using St. Robert's law to model the solid propellant burn rate, no slip boundary conditions, and the hybrid outflow condition. Results from the HMNF model are verified by comparing the pertinent ballistics parameters with the industry standard code outputs (i.e. pressure drop, thrust, ect.). These results are then used by the coefficient form of the mathematics module to determine the complex eigenvalues of the Acoustic Velocity Potential Equation (AVPE). The mathematics model is truncated at the nozzle sonic line, where a zero flux boundary condition is self-satisfying. The remaining boundaries are modeled with a zero flux boundary condition, assuming zero acoustic absorption on all surfaces. The results of the steady-state CFD and AVPE analyses are used to calculate the linear acoustic growth rate as is defined by Flandro and Jacob [2, 3]. In order to verify the process implemented within COMSOL we first employ the Culick theory and compare the results with the industry standard. After the process is verified, the Flandro/Jacob energy balance theory is employed and results displayed.

Fischbach, Sean R.↗
DOE OSTI2023

Multilevel-in-width training for deep neural network regression

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible solutions so as to discourage overfitting while still enabling good solutions, and different regularization strategies impose different types of restrictions. In this paper, we present a multilevel regularization strategy that constructs and trains a hierarchy of neural networks, each of which has layers that are wider versions of the previous network's layers. Here, we draw intuition and techniques from the field of Algebraic Multigrid (AMG), traditionally used for solving linear and nonlinear systems of equations, and specifically adapt the Full Approximation Scheme (FAS) for nonlinear systems of equations to the problem of deep learning. Training through V-cycles then encourage the neural networks to build a hierarchical understanding of the problem. We refer to this approach as multilevel-in-width to distinguish from prior multilevel works which hierarchically alter the depth of neural networks. The resulting approach is a highly flexible framework that can be applied to a variety of layer types, which we demonstrate with both fully connected and convolutional layers. We experimentally show with PDE regression problems that our multilevel training approach is an effective regularizer, improving the generalize performance of the neural networks studied.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Parsimonious Potential Energy Surface Expansions Using Dictionary Learning with Multipass Greedy Selection

Potential energy surfaces fit with basis set expansions have been shown to provide accurate representations of electronic energies and have enabled a variety of high-accuracy dynamics, kinetics, and spectroscopy applications. The number of terms in these expansions scales poorly with system size, a drawback that challenges their use for systems with more than similar to 10 atoms. A solution is presented here using dictionary learning. Subsets of the full set of conventional basis functions are optimized using a newly developed multipass greedy regression method inspired by forward and backward selection methods from the statistics, signal processing, and machine learning literatures. Here, the optimized representations have accuracies comparable to the full set but are 1 or more orders of magnitude smaller, and notably, the number of terms in the optimized multipass greedy expansions scales approximately linearly with the number of atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Unveiling the effect of composition on nuclear waste immobilization glasses’ durability by nonparametric machine learning

Abstract Ensuring the long-term chemical durability of glasses is critical for nuclear waste immobilization operations. Durable glasses usually undergo qualification for disposal based on their response to standardized tests such as the product consistency test or the vapor hydration test (VHT). The VHT uses elevated temperature and water vapor to accelerate glass alteration and the formation of secondary phases. Understanding the relationship between glass composition and VHT response is of fundamental and practical interest. However, this relationship is complex, non-linear, and sometimes fairly variable, posing challenges in identifying the distinct effect of individual oxides on VHT response. Here, we leverage a dataset comprising 654 Hanford low-activity waste (LAW) glasses across a wide compositional envelope and employ various machine learning techniques to explore this relationship. We find that Gaussian process regression (GPR), a nonparametric regression method, yields the highest predictive accuracy. By utilizing the trained model, we discern the influence of each oxide on the glasses’ VHT response. Moreover, we discuss the trade-off between underfitting and overfitting for extrapolating the material performance in the context of sparse and heterogeneous datasets.

36 MATERIALS SCIENCE↗
NASA NTRS1974

Predicting soil moisture and wheat vegetative growth from ERTS-1 imagery

The author has identified the following significant results. Study results indicate: (1) Vegetative growth was best predicted by a linear relationship between leaf area index and the radio of band 4 to band 5. All significant soil moisture effects were cancelled by the ratio. (2) Soil moisture at a depth of 0 to 15 cm, with specific soil factors, was predicted by band 4 and leaf area index with a high regression coefficient. (3) Vegetative growth, measured by leaf area index, was one of the necessary inputs in evaluating the winter wheat crop coefficient from March to maturity.

Krupp, J. W.↗
NASA NTRS1974

Effects of porosity on weld-joint tensile strength of aluminum alloys

Tensile properties in defect-free weldments of aluminum alloys 2014-T6 and 2219-T87 (sheet and plate) are shown to be related to the level or concentration of induced simulated porosity. The scatter diagram shows that the ultimate tensile strength of the weldments displays the most pronounced linear relationship with the level of porosity. The relationships between yield strength or elongation and porosity are either trivial or inconsequential in the lower and intermediate levels of porosity content. In highly concentrated levels of porosity, both yield strength and elongation values decrease markedly. Correlation coefficients were obtained by simple straight line regression analysis between the variables of ultimate tensile strength and pore level. The coefficients were greater, indicating a better correlation, using a pore area accumulation concept or pore volume accumulation than the accumulation of the pore diameters. These relationships provide a useful tool for assessing the existing aerospace radiographic acceptance standards with respect to permissible porosity. In addition, these relationships, in combination with known design load requirements, will serve as an engineering guideline in determining when a weld repair is necessary based on accumulative pore level as detected by radiographic techniques.

Lovoy, C. V.↗
NASA NTRS1994

Trend analysis of the long-term Swiss ozone measurements

Trend analyses, assuming a linear trend which started at 1970, were performed from total ozone measurements from Arosa (Switzerland, 1926-1991). Decreases in monthly mean values were statistically significant for October through April showing decreases of about 2.0-4 percent per decade. For the period 1947-91, total ozone trends were further investigated using a multiple regression model. Temperature of a mountain peak in Switzerland (Mt. Santis), the F10.7 solar flux series, the QBO series (quasi biennial oscillation), and the southern oscillation index (SOI) were included as explanatory variables. Trends in the monthly mean values were statistically significant for December through April. The same multiple regression model was applied to investigate the ozone trends at various altitudes using the ozone balloon soundings from Payerne (1967-1989) and the Umkehr measurements from Arosa (1947-1989). The results show four different vertical trend regimes: On a relative scale changes were largest in the troposphere (increase of about 10 percent per decade). On an absolute scale the largest trends were obtained in the lower stratosphere (decrease of approximately 6 per decade at an altitude of about 18 to 22 km). No significant trends were observed at approximately 30 km, whereas stratospheric ozone decreased in the upper stratosphere.

Staehelin, Johannes↗
DOE OSTI2024

Exploring limitations in the induced polarization versus surface conductivity relationship in the case of wetland soils

Recent induced polarization studies suggest that the real part of surface conductivity (σ' surf ) scales linearly with the imaginary conductivity (σ'' = σ'' surf ) or normalized chargeability (Mn) for a range of soil types. The coefficients of this relationship l and l_Mn ( l = σ''/σ' surf or l_Mn = Mn/σ' surf ) allow the separation of the surface and electrolytic conductivities from the bulk conductivity. However, the dependence of these constants on varying soil physicochemical properties, including under unsaturated conditions, is yet to be assessed. Using estimates of σ' surf from 18 undisturbed soil samples from a restored wetland and σ'' measured over a frequency range of 0.01 Hz to 10 kHz, the σ' surf and σ'' were compared with the laboratory measurements of soil properties. Also, l and l_Mn were calculated for each soil sample and regressed them against the soil properties. We find an apparent dependence of l on soil texture, bulk density, organic matter, and moisture contents, with coefficients of determination (R 2 ) ranging from 0.5 to 0.65 at low frequencies (e.g., 1 Hz) but not at high frequencies (e.g., 936 Hz). This dependence of l on soil texture results from the insensitivity of σ'' at low frequency to σ' surf and, by implication, to the soil properties controlling σ' surf . In contrast, l_Mn indicates no correlation with the soil properties because Mn is linearly correlated with σ' surf and correlated with the soil properties controlling σ' surf . Finally, our results call for caution on the application of σ'' at a single frequency as a proxy of σ' surf because σ'' is not necessarily correlated with σ' surf across all soil types. Although using l_Mn derived from multifrequency measurements overcomes this limitation, field acquisition of spectral information (e.g., up to 1000 Hz) remains a challenge.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1994

Canopy reflectance modelling of semiarid vegetation

Three different types of remote sensing algorithms for estimating vegetation amount and other land surface biophysical parameters were tested for semiarid environments. These included statistical linear models, the Li-Strahler geometric-optical canopy model, and linear spectral mixture analysis. The two study areas were the National Science Foundation's Jornada Long Term Ecological Research site near Las Cruces, NM, in the northern Chihuahuan desert, and the HAPEX-Sahel site near Niamey, Niger, in West Africa, comprising semiarid rangeland and subtropical crop land. The statistical approach (simple and multiple regression) resulted in high correlations between SPOT satellite spectral reflectance and shrub and grass cover, although these correlations varied with the spatial scale of aggregation of the measurements. The Li-Strahler model produced estimated of shrub size and density for both study sites with large standard errors. In the Jornada, the estimates were accurate enough to be useful for characterizing structural differences among three shrub strata. In Niger, the range of shrub cover and size in short-fallow shrublands is so low that the necessity of spatially distributed estimation of shrub size and density is questionable. Spectral mixture analysis of multiscale, multitemporal, multispectral radiometer data and imagery for Niger showed a positive relationship between fractions of spectral endmembers and surface parameters of interest including soil cover, vegetation cover, and leaf area index.

Franklin, Janet↗
DOE OSTI2021

Removing the Effects of Tropical Dynamics from North Pacific Climate Variability

Teleconnections from the Tropics energize variations of the North Pacific climate, but detailed diagnosis of this relationship has proven difficult. Simple univariate methods, such as regression on El Niño-Southern Oscillation (ENSO) indices, may be inadequate since the key dynamical processes involved -- including ENSO diversity in the Tropics, re-emergence of mixed layer thermal anomalies, and oceanic Rossby wave propagation in the North Pacific -- have a variety of overlapping spatial and temporal scales. Here we use a multivariate Linear Inverse Model to quantify tropical and extra-tropical multi-scale dynamical contributions to North Pacific variability, in both observations and CMIP6 models. In observations, we find that the Tropics are responsible for almost half of the seasonal variance, and almost three quarters of the decadal variance, along the North American coast and within the subtropical front region northwest of Hawaii. SST anomalies that are generated by local dynamics within the Northeast Pacific have much shorter time scales, consistent with transient weather forcing by Aleutian low anomalies. Variability within the Kuroshio-Oyashio Extension (KOE) region is considerably less impacted by the Tropics, on all time scales. Consequently, without tropical forcing the dominant pattern of North Pacific variability would be a KOE pattern, rather than the Pacific Decadal Oscillation (PDO). In contrast to observations, most CMIP6 historical simulations produce North Pacific variability that maximizes in the KOE region, with amplitude significantly higher than observed. Correspondingly, the simulated North Pacific in all CMIP6 models is shown to be relatively insensitive to the Tropics, with a dominant spatial pattern generally resembling the KOE pattern, not the PDO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Patch2Self2: Self-supervised Denoising on Coresets via Matrix Sketching

Diffusion MRI (dMRI) non-invasively maps brain white matter yet necessitates denoising due to low signal-to-noise ratios. Patch2Self (P2S) employing self-supervised techniques and regression on a Casorati matrix effectively denoises dMRI images and has become the new de-facto standard in this field. P2S however is resource intensive both in terms of running time and memory usage as it uses all voxels (n) from all-but-one held-in volumes (d-1) to learn a linear mapping Phi : \mathbb R ^ n x(d-1) \mapsto \mathbb R ^ n for denoising the held-out volume. The increasing size and dimensionality of higher resolution dMRI acquisitions can make P2S infeasible for large-scale analyses. This work exploits the redundancy imposed by P2S to alleviate its performance issues and inspect regions that influence the noise disproportionately. Specifically this study makes a three-fold contribution: (1) We present Patch2Self2 (P2S2) a method that uses matrix sketching to perform self-supervised denoising. By solving a sub-problem on a smaller sub-space so called coreset we show how P2S2 can yield a significant speedup in training time while using less memory. (2) We present a theoretical analysis of P2S2 focusing on determining the optimal sketch size through rank estimation a key step in achieving a balance between denoising accuracy and computational efficiency. (3) We show how the so-called statistical leverage scores can be used to interpret the denoising of dMRI data a process that was traditionally treated as a black-box. Experimental results on both simulated and real data affirm that P2S2 maintains denoising quality while significantly enhancing speed and memory efficiency achieved by training on a reduced data subset.

Fadnavis, Shreyas↗
DOE OSTI2023

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗
NASA NTRS1987

An experimental and analytical investigation of stall effects on flap-lag stability in forward flight

Experiments have been performed with a 1.62 m diameter hingeless rotor in a wind tunnel to investigate flap-lag stability of isolated rotors in forward flight. The three-bladed rotor model closely approaches the simple theoretical concept of a hingeless rotor as a set of rigid, articulated flap-lag blades with offset and spring restrained flap and lag hinges. Lag regressing mode stability data was obtained for advance ratios as high as 0.55 for various combinations of collective pitch and shaft angle. The prediction includes quasi-steady stall effects on rotor trim and Floquet stability analyses. Correlation between data and prediction is presented and is compared with that of an earlier study based on a linear theory without stall effects. While the results with stall effects show marked differences from the linear theory results, the stall theory still falls short of adequate agreement with the experimental data.

Nagabhushanam, J.↗
DOE OSTI2022

Power counting energy flow polynomials

Power counting is a systematic strategy for organizing collider observables and their associated theoretical calculations. In this paper, we use power counting to characterize a class of jet substructure observables called energy flow polynomials (EFPs). EFPs provide an overcomplete linear basis for infrared-and-collinear safe jet observables, but it is known that in practice, a small subset of EFPs is often sufficient for specific jet analysis tasks. By applying power counting arguments, we obtain linear relationships between EFPs that hold for quark and gluon jets to a specific order in the power counting. We test these relations in the parton shower generator Pythia, finding excellent agreement. Power counting allows us to truncate the basis of EFPs without affecting performance, which we corroborate through a study of quark-gluon tagging and regression.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2015

The Use of Absolute-Value Terms in Regression Modeling of Multi-Piece Force Balances

Different aspects of the use of absolute-value terms in regression models of the electrical outputs of multi-piece force balance calibration data are discussed. First, characteristics of a variety of regression model term combinations with absolute-value terms are reviewed that are currently used in the aerospace testing community to fit the gage outputs of a balance. Then, a semi-empirical test is presented that quantifies bidirectional characteristics of the balance bridge outputs. Several diagnostic methods are discussed to assess the severity of near-linear dependencies between regressors of models with absolute-value terms. In particular, connections between the linear, absolute-value, quadratic, signed quadratic, and cubic terms are studied in greater detail. Data from an automated calibration of NASAs MK29B force balance are used to illustrate the most important observations and results. Rules of thumb that variance-inflation factors be less than 10 must be relaxed when using absolute-value terms to describe bidirectional balances.

calibration analysis↗
NASA NTRS1973

Models of subjective response to in-flight motion data

Mathematical relationships between subjective comfort and environmental variables in an air transportation system are investigated. As a first step in model building, only the motion variables are incorporated and sensitivities are obtained using stepwise multiple regression analysis. The data for these models have been collected from commercial passenger flights. Two models are considered. In the first, subjective comfort is assumed to depend on rms values of the six-degrees-of-freedom accelerations. The second assumes a Rustenburg type human response function in obtaining frequency weighted rms accelerations, which are used in a linear model. The form of the human response function is examined and the results yield a human response weighting function for different degrees of freedom.

Rudrapatna, A. N.↗
NASA NTRS1979

Temperature profile retrievals with extended Kalman-Bucy filters

The Extended Kalman-Bucy Filter is a powerful technique for estimating non-stationary random parameters in situations where the received signal is a noisy non-linear function of those parameters. A practical causal filter for retrieving atmospheric temperature profiles from radiances observed at a single scan angle by the Scanning Microwave Spectrometer (SCAMS) carried on the Nimbus 6 satellite typically shows approximately a 10-30% reduction in rms error about the mean at almost all levels below 70 mb when compared with a regression inversion.

Ledsham, W. H.↗
DOE OSTI2025

Image-Driven Hybrid Structural Analysis Based on Continuum Point Cloud Method with Boundary Capturing Technique

Conventional approaches for the structural health monitoring of infrastructures often rely on physical sensors or targets attached to structural members, which require considerable preparation, maintenance, and operational effort, including continuous on-site adjustments. This paper presents an image-driven hybrid structural analysis technique that combines digital image processing (DIP) and regression analysis with a continuum point cloud method (CPCM) built on a particle-based strong formulation. Polynomial regressions capture the boundary shape change due to the structural loading and precisely identify the edge and corner coordinates of the deformed structure. The captured edge profiles are transformed into essential boundary conditions. This allows the construction of a strongly formulated boundary value problem (BVP), classified as the Dirichlet problem. Capturing boundary conditions from the digital image is novel, although a similar approach was applied to the point cloud data. It was shown that the CPCM is more efficient in this hybrid simulation framework than the weak-form-based numerical schemes. Unlike the finite element method (FEM), it can avoid aligning boundary nodes with regression points. A three-point bending test of a rubber beam was simulated to validate the developed technique. The simulation results were benchmarked against numerical results by ANSYS and various relevant numerical schemes. The technique can effectively solve the Dirichlet-type BVP, yielding accurate deformation, stress, and strain values across the entire problem domain when employing a linear strain model and increasing the number of CPCM nodes. In addition, comparative analysis with conventional displacement tracking techniques verifies the developed technique’s robustness. The proposed technique effectively circumvents the inherent limitations of traditional monitoring methods resulting from the reliance on physical gauges or target markers so that a robust and non-contact solution for remote structural health monitoring in real-scale infrastructures can be provided, even in unfavorable experimental environments.

Chemistry↗