Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Local regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Predicting molecular dipole moments by combining atomic partial charges and atomic dipoles

The molecular dipole moment ( μ ) is a central quantity in chemistry. It is essential in predicting infrared and sum-frequency generation spectra as well as induction and long-range electrostatic interactions. Furthermore, it can be extracted directly—via the ground state electron density—from high-level quantum mechanical calculations, making it an ideal target for machine learning (ML). Here, we choose to represent this quantity with a physically inspired ML model that captures two distinct physical effects: local atomic polarization is captured within the symmetry-adapted Gaussian process regression framework which assigns a (vector) dipole moment to each atom, while the movement of charge across the entire molecule is captured by assigning a partial (scalar) charge to each atom. The resulting “MuML” models are fitted together to reproduce molecular μ computed using high-level coupled-cluster theory and density functional theory (DFT) on the QM7b dataset, achieving more accurate results due to the physics-based combination of these complementary terms. The combined model shows excellent transferability when applied to a showcase dataset of larger and more complex molecules, approaching the accuracy of DFT at a small fraction of the computational cost. We also demonstrate that the uncertainty in the predictions can be estimated reliably using a calibrated committee model. The ultimate performance of the models—and the optimal weighting of their combination—depends, however, on the details of the system at hand, with the scalar model being clearly superior when describing large molecules whose dipole is almost entirely generated by charge separation. These observations point to the importance of simultaneously accounting for the local and non-local effects that contribute to μ ; furthermore, they define a challenging task to benchmark future models, particularly those aimed at the description of condensed phases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Forecasting Lightning at Kennedy Space Center/Cape Canaveral Air Force Station, Florida

The Applied Meteorology Unit (AMU) developed a set of statistical forecast equations that provide a probability of lightning occurrence on Kennedy Space Center (KSC) I Cape Canaveral Air Force Station (CCAFS) for the day during the warm season (May September). The 45th Weather Squadron (45 WS) forecasters at CCAFS in Florida include a probability of lightning occurrence in their daily 24-hour and weekly planning forecasts, which are briefed at 1100 UTC (0700 EDT). This information is used for general scheduling of operations at CCAFS and KSC. Forecasters at the Spaceflight Meteorology Group also make thunderstorm forecasts for the KSC/CCAFS area during Shuttle flight operations. Much of the current lightning probability forecast at both groups is based on a subjective analysis of model and observational data. The objective tool currently available is the Neumann-Pfeffer Thunderstorm Index (NPTI, Neumann 1971), developed specifically for the KSCICCAFS area over 30 years ago. However, recent studies have shown that 1-day persistence provides a better forecast than the NPTI, indicating that the NPTI needed to be upgraded or replaced. Because they require a tool that provides a reliable estimate of the daily thunderstorm probability forecast, the 45 WS forecasters requested that the AMU develop a new lightning probability forecast tool using recent data and more sophisticated techniques now possible through more computing power than that available over 30 years ago. The equation development incorporated results from two research projects that investigated causes of lightning occurrence near KSCICCAFS and over the Florida peninsula. One proved that logistic regression outperformed the linear regression method used in NPTI, even when the same predictors were used. The other study found relationships between large scale flow regimes and spatial lightning distributions over Florida. Lightning, probabilities based on these flow regimes were used as candidate predictors in the equation development. Fifteen years (1 989-2003) of warm season data were used to develop the forecast equations. The data sources included a local network of cloud-to-ground lightning sensors called the Cloud-to-Ground Lightning Surveillance System (CGLSS), 1200 UTC Florida synoptic soundings, and the 1000 UTC CCAFS sounding. Data from CGLSS were used to determine lightning occurrence for each day. The 1200 UTC soundings were used to calculate the synoptic-scale flow regimes and the 1000 UTC soundings were used to calculate local stability parameters, which were used as candidate predictors of lightning occurrence. Five logistic regression forecast equations were created through careful selection and elimination of the candidate predictors. The resulting equations contain five to six predictors each. Results from four performance tests indicated that the equations showed an increase in skill over several standard forecasting methods, good reliability, an ability to distinguish between non-lightning and lightning days, and good accuracy measures and skill scores. Given the overall good performance the 45 WS requested that the equations be transitioned to operations and added to the current set of tools used to determine the daily lightning probability of occurrence.

Lambert, Winfred↗

Heat and mass transfer rates during flow of dissociated hydrogen gas over graphite surface

To improve upon the performance of chemical rockets, the nuclear reactor has been applied to a rocket propulsion system using hydrogen gas as working fluid and a graphite-composite forming a part of the structure. Under the boundary layer approximation, theoretical predictions of skin friction coefficient, surface heat transfer rate and surface regression rate have been made for laminar/turbulent dissociated hydrogen gas flowing over a flat graphite surface. The external stream is assumed to be frozen. The analysis is restricted to Mach numbers low enough to deal with the situation of only surface-reaction between hydrogen and graphite. Empirical correlations of displacement thickness, local skin friction coefficient, local Nusselt number and local non-dimensional heat transfer rate have been obtained. The magnitude of the surface regression rate is found low enough to ensure the use of graphite as a linear or a component of the system over an extended period without loss of performance.

Nema, V. K.↗

Random projection using random quantum circuits

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the “quantum supremacy era.” This has definitely shed some light on the power of random quantum circuits in this abstract task of sampling outputs from the (pseudo)random circuits. In this paper, we explore a practical near-term use of local random quantum circuits in dimensional reduction of large low-rank data sets. We make use of the well-studied dimensionality reduction technique called the random projection method. This method has been extensively used in various applications such as image processing, logistic regression, entropy computation of low-rank matrices, etc. We prove that the matrix representations of local random quantum circuits with sufficiently shorter depths [ ∼ O ( n ) ] serve as good candidates for random projection. We demonstrate numerically that their projection abilities are not far off from the computationally expensive classical principal components analysis on MNIST and CIFAR-100 image datasets. We also benchmark the performance of quantum random projection against the commonly used classical random projection in the tasks of dimensionality reduction of image data sets and computing von Neumann entropies of large low-rank density matrices. And finally, using variational quantum singular value decomposition, we demonstrate a near-term implementation of extracting the singular vectors with dominant singular values after quantum random projecting a large low-rank matrix to lower dimensions. All such numerical experiments unequivocally demonstrate the ability of local random circuits to randomize a large Hilbert space at sufficiently shorter depths with robust retention of properties of large data sets in reduced dimensions. Published by the American Physical Society 2024

Kumaran, Keerthi (ORCID:0009000949125721)↗

Cross-national analysis of food security drivers: comparing results based on the Food Insecurity Experience Scale and Global Food Security Index

Abstract The second UN Sustainable Development Goal establishes food security as a priority for governments, multilateral organizations, and NGOs. These institutions track national-level food security performance with an array of metrics and weigh intervention options considering the leverage of many possible drivers. We studied the relationships between several candidate drivers and two response variables based on prominent measures of national food security: the 2019 Global Food Security Index (GFSI) and the Food Insecurity Experience Scale’s (FIES) estimate of the percentage of a nation’s population experiencing food security or mild food insecurity (FI ). We compared the contributions of explanatory variables in regressions predicting both response variables, and we further tested the stability of our results to changes in explanatory variable selection and in the countries included in regression model training and testing. At the cross-national level, the quantity and quality of a nation’s agricultural land were not predictive of either food security metric. We found mixed evidence that per-capita cereal production, per-hectare cereal yield, an aggregate governance metric, logistics performance, and extent of paid employment work were predictive of national food security. Household spending as measured by per-capita final consumption expenditure (HFCE) was consistently the strongest driver among those studied, alone explaining a median of 92% and 70% of variation (based on out-of-sample R 2 ) in GFSI and FI , respectively. The relative strength of HFCE as a predictor was observed for both response variables and was independent of the countries used for model training, the transformations applied to the explanatory variables prior to model training, and the variable selection technique used to specify multivariate regressions. The results of this cross-national analysis reinforce previous research supportive of a causal mechanism where, in the absence of exceptional local factors, an increase in income drives increase in food security. However, the strength of this effect varies depending on the countries included in regression model fitting. We demonstrate that using multiple response metrics, repeated random sampling of input data, and iterative variable selection facilitates a convergence of evidence approach to analyzing food security drivers.

42 ENGINEERING↗

Evaluation of fuzzy inference systems using fuzzy least squares

Efforts to develop evaluation methods for fuzzy inference systems which are not based on crisp, quantitative data or processes (i.e., where the phenomenon the system is built to describe or control is inherently fuzzy) are just beginning. This paper suggests that the method of fuzzy least squares can be used to perform such evaluations. Regressing the desired outputs onto the inferred outputs can provide both global and local measures of success. The global measures have some value in an absolute sense, but they are particularly useful when competing solutions (e.g., different numbers of rules, different fuzzy input partitions) are being compared. The local measure described here can be used to identify specific areas of poor fit where special measures (e.g., the use of emphatic or suppressive rules) can be applied. Several examples are discussed which illustrate the applicability of the method as an evaluation tool.

Barone, Joseph M.↗

Studies in Software Cost Model Behavior: Do We Really Understand Cost Model Performance?

While there exists extensive literature on software cost estimation techniques, industry practice continues to rely upon standard regression-based algorithms. These software effort models are typically calibrated or tuned to local conditions using local data. This paper cautions that current approaches to model calibration often produce sub-optimal models because of the large variance problem inherent in cost data and by including far more effort multipliers than the data supports. Building optimal models requires that a wider range of models be considered while correctly calibrating these models requires rejection rules that prune variables and records and use multiple criteria for evaluating model performance. The main contribution of this paper is to document a standard method that integrates formal model identification, estimation, and validation. It also documents what we call the large variance problem that is a leading cause of cost model brittleness or instability.

data mining↗

Simple Heat Transfer Model for Film Cooling Applications

This report describes the development of a simple engineering model for film cooling. This model is used to derive a relationship between local wall temperature variations and key cooling performance parameters like local heat transfer coefficients and film effectiveness. This relation and method new and different from previously published models. The scope of this report includes the derivation of regression model equations for a flat plate with and without film cooling. The model equation for a flat plate without film cooling can be used to estimate local heat transfer coefficients using surface temperatures measured from infrared thermography. The model equation for the flat plate with film cooling can be used to estimate film cooling effectiveness, $η_f$, and heat transfer augmentation from the film cooling jet(s).

42 ENGINEERING↗

Uncertainty quantification of the virial black hole mass with conformal prediction

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an indirect method using the single-epoch virial black hole mass estimation is used for objects at high redshifts. However, this method is subjected to biases and uncertainties as it is reliant on the scaling relation from a small sample of local active galactic nuclei. In this study, we propose the application of conformalized quantile regression (CQR) to quantify the uncertainties of the black hole predictions in a machine learning setting. We compare CQR with various prediction interval techniques and demonstrated that CQR can provide a more useful prediction interval indicator. In contrast to baseline approaches for prediction interval estimation, we show that the CQR method provides prediction intervals that adjust to the black hole mass and its related properties. That is it yields a tighter constraint on the prediction interval (hence more certain) for a larger black hole mass, and accordingly, bright and broad spectral line width source. Using a combination of neural network model and CQR framework, the recovered virial black hole mass predictions and uncertainties are comparable to those measured from the Sloan Digital Sky Survey. The code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Projecting the Local Impacts of Climate Change on a Central American Montane Avian Community

Significant changes in the climates of Central America are expected over the next century. Lowland rainforests harbor high alpha diversity on local scales (<1 km2), yet montane landscapes often support higher beta diversity on 10-100 km2 scales. Climate change will likely disrupt the altitudinal zonation of montane communities that produces such landscape diversity. Projections of biotic response to climate change have often used broad-scale modelling of geographical ranges, but understanding likely impacts on population viability is also necessary for anticipating local and global extinctions. We model species abundances and estimate range shifts for birds in the Tilaran Mountains of Costa Rica, asking whether projected changes in temperature and rainfall could be sufficient to imperil high-elevation endemics and whether these variables will likely impact communities similarly. We find that nearly half of 77 forest bird species can be expected to decline in the next century. Almost half of species projected to decline are endemic to Central America, and seven of eight species projected to become locally extinct are endemic to the highlands of Costa Rica and Panam . Logistic-regression modelling of distributions and similarity in projections produced by temperature and rainfall models suggest that changes in both variables will be important. Although these projections are probably conservative because they do not explicitly incorporate biological or climate variable interactions, they provide a starting point for incorporating more realistic biological complexity into community-change models. Prudent conservation planning for tropical mountains should focus on regions with room for altitudinal reorganization of communities comprised of ecological specialists.

Gasner, Matthew R.↗

Snow Cover and Precipitation Impacts on Dry Season Streamflow in the Lower Mekong Basin

Climate change impacts on dry season streamflow in the Mekong River are relatively understudied, despite the fact that water availability during this time is critically important for agricultural and ecological systems. Analyses of two gauging stations (Vientiane and Kratie) in the Lower Mekong Basin (LMB) show significant positive correlations between dry season (March through May, MAM) discharge and upper basin snow cover and local precipitation. Using snow cover, precipitation, and upstream discharge as predictors, we develop skillful regression models for MAM streamflow at Vientiane and Kratie, and force these models with output from a suite of general circulation model (GCM) experiments for the twentieth and twenty-first centuries. The GCM simulations predict divergent trends in snow cover (decreasing) and precipitation (increasing) over the twenty-first century, driving overall negligible long-term trends in dry season streamflow. Our study demonstrates how future changes in dry season streamflow in the LMB will depend on changes in snow cover and precipitation, factors that will need to be considered when assessing the full basin response to other climatic and non-climatic drivers.

Cook, Benjamin I.↗

Resolving the fast ion distribution from imaging neutral particle analyzer measurements

A recently developed imaging neutral particle analyzer (INPA) on the DIII-D tokamak (Du 2018 Nucl. Fusion 58 082006) enables fast ion velocity-space tomography of high fidelity at the interrogated phase space. To accomplish this, the spatial and energy depending fast ( E < 80 keV) neutral flux towards the INPA stripping foils is calculated with FIDASIM and a newly developed code INPASIM simulates the INPA instrumental response to this neutral flux. Included in INPASIM is the neutral-foil interaction, the Larmor orbit tracing between the foil and the phosphor, the phosphor response to the incident ion flux as well as camera focusing. Benefiting from heavy, localized velocity-space weights and excellent signal to noise, computed tomography using the Ridge regression method is able to successfully reconstruct fine-scale velocity-space structures produced by multiple neutral beams separated by as small as ~3 keV in tests. Applying the inversion method to a sawtooth crash event reveals a significant profile flattening of confined passing particles across q = 1 flux surface, as well as a redistribution of fast ions into the trapped orbits at the plasma edge close to the last closed flux surface.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗

Using automated machine learning for the upscaling of gross primary productivity

Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗

Spectrometric Estimation of Total Nitrogen Concentration in Douglas-Fir Foliage

Spectral measurements of fresh and dehydrated Douglas-fir foliage, from trees cultivated under three fertilization treatments, were acquired with a laboratory spectrophotometer. The slope (first-derivative) of the fresh- and dry-leaf absorbance spectra at locations near known protein absorption features was strongly correlated with total nitrogen (TN) concentration of the foliage samples. Particularly strong correlation was observed between the first-derivative spectra in the 2150-2170 nm region and TN, reaching a local maximum in the fresh-leaf spectra of -0.84 at 2 160 nm. Stepwise regression was used to generate calibration equations relating first derivative spectra from fresh, dry/intact, and dry/ground samples to TN concentration. Standard errors of calibration were 1.52 mg g-1 (fresh), 1.33 (dry/intact), and 1.20 (dry/ground), with goodness-of-fit 0.94 and greater. Cross-validation was performed with the fresh-leaf dataset to examine the predictive capability of the regression method; standard errors of prediction ranged from 1.47 - 2.37 mg g(exp -1) across seven different validation sets, prediction goodness of fit ranged from .85-.94, and wavelength selection was fairly insensitive to the membership of the calibration set. All regressions in this study tended to select wavelengths in the 2100-2350 nm region, with the primary selection in the 2142-2172 nm region. The study provides positive evidence concerning the feasibility of assessing TN status of fresh-leaf samples by spectrometric means. We assert that the ability to extract biochemical information from fresh-leaf spectra is a necessary but insufficient condition regarding the use of remote sensing for canopy-level biochemical estimation.

Johnson, Lee F.↗

Impact of Dose-Escalated Chemoradiation on Quality of Life in Patients With Locally Advanced Rectal Cancer: 2-Year Follow-Up of the Randomized RECTAL-BOOST Trial

Dose-escalated chemoradiation (CRT) for locally advanced rectal cancer did not result in higher complete response rates but initiated more tumor regression in the randomized RECTAL-BOOST trial (Clinicaltrials.gov NCT01951521). This study compared patient reported outcomes between patients who received dose-escalated CRT (5 × 3 gray boost + CRT) or standard CRT for 2 years after randomization.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Seasonal Variation of Martian Polar Caps: 1999 and 2001 MOC Data

The seasonal Martian polar caps wax and wane in response to condensation and sublimation of carbon dioxide resulting from seasonal insolation changes on Mars. Numerous data exist on observations of the recession or sublimation phases in the visible portion of the spectrum for the last two centuries. William Herschel published the first quantitative observations of the seasonal recession of the Martian polar caps in 1784. During the next 180 years, ground based observers used a variety of techniques to observe recessions; Slipher summarized these observations in 1962, on the eve of the first space exploration of Mars. Portions of the seasonal cycles of the surface caps that were observed by Mariners 7 and 9 and by Viking as well as ground based studies from 1971-1988 by the International Planetary Patrol were summarized in a review article following the Fourth International Conference on Mars in 1989. Hubble Space Telescope observed points in the seasonal recessions of the south and north caps during the 1990 s. Differences between different Martian regressions have been reported in the past; but, because many of the relevant data sets are localized in longitude, at least some of these results could be an artifact introduced by the considerable longitudinal asymmetry that observed during recessions.

P B James↗

Learning Symbolic Expressions: Mixed-Integer Formulations, Cuts, and Heuristics

Here, in this paper, we consider the problem of learning a regression function without assuming its functional form. This problem is referred to as symbolic regression. An expression tree is typically used to represent a solution function, which is determined by assigning operators and operands to the nodes. Cozad and Sahinidis propose a nonconvex mixed-integer nonlinear program (MINLP), in which binary variables are used to assign operators and nonlinear expressions are used to propagate data values through nonlinear operators, such as square, square root, and exponential. We extend this formulation by adding new cuts that improve the solution of this challenging MINLP. We also propose a heuristic that iteratively builds an expression tree by solving a restricted MINLP. We perform computational experiments and compare our approach with a mixed-integer program–based method and a neural network–based method from the literature.

97 MATHEMATICS AND COMPUTING↗