Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “functional regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Probabilistic partition of unity networks for high–dimensional regression problems

We explore the probabilistic partition of unity network (PPOU-Net) model in the context of high-dimensional regression problems and propose a general framework focusing on adaptive dimensionality reduction. With the proposed framework, the target function is approximated by a mixture of experts model on a low-dimensional manifold, where each cluster is associated with a fixed-degree polynomial. We present a training strategy that leverages the expectation maximization (EM) algorithm. During the training, we alternate between (i) applying gradient descent to update the DNN coefficients; and (ii) using closed-form formulae derived from the EM algorithm to update the mixture of experts model parameters. Under the probabilistic formulation, step (ii) admits the form of embarrassingly paralleliazable weighted least-squares solves. The PPOU-Nets consistently outperform the baseline fully-connected neural networks of comparable sizes in numerical experiments of various data dimensions. Here, we also explore the proposed model in applications of quantum computing, where the PPOU-Nets act as surrogate models for cost landscapes associated with variational quantum circuits.

97 MATHEMATICS AND COMPUTING↗

Gastrointestinal Dose-Histogram Effects in the Context of Dose-Volume–Constrained Prostate Radiation Therapy: Analysis of Data From the RADAR Prostate Radiation Therapy Trial

Purpose: To use a high-quality multicenter trial dataset to determine dose-volume effects for gastrointestinal (GI) toxicity following radiation therapy for prostate carcinoma. Influential dose-volume histogram regions were to be determined as functions of dose, anatomical location, toxicity, and clinical endpoint. Methods and Materials: Planning datasets for 754 participants in the TROG 03.04 RADAR trial were available, with Late Effects of Normal Tissues (LENT) Subjective, Objective, Management, and Analytic (SOMA) toxicity assessment to a median of 72 months. A rank sum method was used to define dose-volume cut-points as near-continuous functions of dose to 3 GI anatomical regions, together with a comprehensive assessment of significance. Univariate and multivariate ordinal regression was used to assess the importance of cut-points at each dose. Results: Dose ranges providing significant cut-points tended to be consistent with those showing significant univariate regression odds-ratios (representing the probability of a unitary increase in toxicity grade per percent relative volume). Ranges of significant cut-points for rectal bleeding validated previously published results. Separation of the lower GI anatomy into complete anorectum, rectum, and anal canal showed the impact of mid-low doses to the anal canal on urgency and tenesmus, completeness of evacuation and stool frequency, and mid-high doses to the anorectum on bleeding and stool frequency. Derived multivariate models emphasized the importance of the high-dose region of the anorectum and rectum for rectal bleeding and mid- to low-dose regions for diarrhea and urgency and tenesmus, and low-to-mid doses to the anal canal for stool frequency, diarrhea, evacuation, and bleeding. Conclusions: Results confirm anatomical dependence of specific GI toxicities. They provide an atlas summarizing dose-histogram effects and derived constraints as functions of anatomical region, dose, toxicity, and endpoint for informing future radiation therapy planning.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DYNA3D/ParaDyn Regression Test Suite Inventory

The following table constitutes an initial assessment of feature coverage across the regression test suite used for DYNA3D and ParaDyn. It documents the regression test suite at the time of preliminary release 16.1 in September 2016. The columns of the table represent groupings of functionalities, e.g., material models. Each problem in the test suite is represented by a row in the table. All features exercised by the problem are denoted by a check mark (√) in the corresponding column. The definition of “feature” has not been subdivided to its smallest unit of user input, e.g., algorithmic parameters specific to a particular type of contact surface. This represents a judgment to provide code developers and users a reasonable impression of feature coverage without expanding the width of the table by several multiples. All regression testing is run in parallel, typically with eight processors, except problems involving features only available in serial mode. Many are strictly regression tests acting as a check that the codes continue to produce adequately repeatable results as development unfolds; compilers change and platforms are replaced. A subset of the tests represents true verification problems that have been checked against analytical or other benchmark solutions. Users are welcomed to submit documented problems for inclusion in the test suite, especially if they are heavily exercising, and dependent upon, features that are currently underrepresented.

97 MATHEMATICS AND COMPUTING↗

Study on the dynamic recrystallization model and mechanism of nuclear grade 316LN austenitic stainless steel

In this study, the dynamic recrystallization behaviors of a nuclear grade 316LN austenitic stainless steel were researched through hot compression experiment performed on a Gleeble-1500 simulator at temperatures of 900–1250 °C and strain rates of 0.01–1 s{sup −1}. By multiple linear regressions of the flow stress-strain data, the dynamic recrystallization mathematical models of this steel as functions of strain rate, strain and temperature were developed. Then these models were verified in a real experiment. Furthermore, the dynamic recrystallization mechanism of the steel was determined. The results indicated that the subgrains in this steel are formed through dislocations polygonization and then grow up through subgrain boundaries migration towards high density dislocation areas and subgrain coalescence mechanism. Dynamic recrystallization nucleation performs in grain boundary bulging mechanism and subgrain growth mechanism. The nuclei grow up through high angle grain boundaries migration. - Highlights: •Establish the DRX mathematical models of nuclear grade 316LN stainless steel •Determine the DRX mechanism of this steel •Subgrains are formed through dislocations polygonization. •Subgrains grow up through subgrain boundaries migration and coalescence mechanism. •DRX nucleation performs in grain boundary bulging mechanism and subgrain growth mechanism.

36 MATERIALS SCIENCE↗

Quantification of uncertainties in thermoelectric properties of materials from a first-principles prediction method: An approach based on Gaussian process regression

We present the electron-phonon averaged via Gaussian process regression (EPA-GPR) method, in which the electron-phonon coupling matrix is represented as a function of two energies and is in turn modeled as a Gaussian process. The EPA-GPR method can be used as an efficient method to estimate thermoelectric properties of materials for fast-screening applications, comparable to the original electron-phonon averaged (EPA) method and the electron-phonon averaged via moving-least-squares (EPA-MLS) method. The EPA-GPR method does not require specification of any open parameter, unlike the other EPA-related methods, since all the hyperparameters in the model can be unambiguously estimated within the type II maximum likelihood (ML-II) approximation. Thus, the EPA-GPR method is a parameter-free estimation method. Additionally, the concept of Gaussian processes in the EPA-GPR method allows us to quantify the uncertainty in estimated properties of thermoelectric materials. One can randomly realize the electron-phonon coupling coefficients from the identified Gaussian process, and those realized samples can be further analyzed in the solution process of the semiclassical Boltzmann transport equation for charge carriers. The results of the semiclassical Boltzmann transport equation provide the statistical properties of the thermoelectric properties of interest. The means, standard deviations, histograms, and confidence intervals of the Seebeck coefficient, the electrical conductivity, and the power factor can be constructed and analyzed. Furthermore the proposed EPA-GPR method is applied to a p-type half-Heusler compound, i.e., HfCoSb, as a case example, the results of which clearly present the advantages of the method.

30 DIRECT ENERGY CONVERSION↗

SU-E-T-144: Bayesian Inference of Local Relapse Data Using a Poisson-Based Tumour Control Probability Model

Purpose: The purpose of this project is to develop a robust method of parameter estimation for a Poisson-based TCP model using Bayesian inference. Methods: Bayesian inference was performed using the PyMC3 probabilistic programming framework written in Python. A Poisson-based TCP regression model that accounts for clonogen proliferation was fit to observed rates of local relapse as a function of equivalent dose in 2 Gy fractions for a population of 623 stage-I non-small-cell lung cancer patients. The Slice Markov Chain Monte Carlo sampling algorithm was used to sample the posterior distributions, and was initiated using the maximum of the posterior distributions found by optimization. The calculation of TCP with each sample step required integration over the free parameter α, which was performed using an adaptive 24-point Gauss-Legendre quadrature. Convergence was verified via inspection of the trace plot and posterior distribution for each of the fit parameters, as well as with comparisons of the most probable parameter values with their respective maximum likelihood estimates. Results: Posterior distributions for α, the standard deviation of α (σ), the average tumour cell-doubling time (Td), and the repopulation delay time (Tk), were generated assuming α/β = 10 Gy, and a fixed clonogen density of 10{sup 7} cm−{sup 3}. Posterior predictive plots generated from samples from these posterior distributions are in excellent agreement with the observed rates of local relapse used in the Bayesian inference. The most probable values of the model parameters also agree well with maximum likelihood estimates. Conclusion: A robust method of performing Bayesian inference of TCP data using a complex TCP model has been established.

60 APPLIED LIFE SCIENCES↗

Surface recession characteristics of a cryogenic insulation subjected to arc-tunnel heating

Specimens of a cryogenic insulation, proposed for use on the space shuttle external tank, were tested in an arc tunnel over a range of heating rates, pressures, and enthalpies corresponding to the shuttle ascent environment. A regression analysis was used to correlate the test data. Correlation equations involving surface recession rate as a function of heating rate, pressure, and enthalpy were developed. These equations can be used to make total surface recession predictions for shuttle ascent flight environments.

Pittman, C. M.↗

Development of an empirically based dynamic biomechanical strength model

The focus here is on the development of a dynamic strength model for humans. Our model is based on empirical data. The shoulder, elbow, and wrist joints are characterized in terms of maximum isolated torque, position, and velocity in all rotational planes. This information is reduced by a least squares regression technique into a table of single variable second degree polynomial equations determining the torque as a function of position and velocity. The isolated joint torque equations are then used to compute forces resulting from a composite motion, which in this case is a ratchet wrench push and pull operation. What is presented here is a comparison of the computed or predicted results of the model with the actual measured values for the composite motion.

Pandya, A.↗

Impairment of Human Ocular Tracking with Low-Dose Alcohol

Previous studies have documented adverse effects of alcohol on oculomotor performance. For example, moderate-dose alcohol (yielding a Blood Alcohol Concentration or BAC of 0.04-0.1%) has been shown to decrease steady-state pursuit gain (Fransson et al., 2010, Clin Neurophysiol, 121(12): 2134; Moser et al., 1998, J Neurol, 245(8): 542; Roche & King, 2010, Psychopharmacology, 212(1): 33), to increase saccade latency (Moser et al., 1998, J Neurol, 245(8): 542; Roche & King, 2010, Psychopharmacology, 212(1): 33), to decrease peak saccadic velocity (Fransson et al., 2010, Clin Neurophysiol, 121(12): 2134; Roche & King, 2010, Psychopharmacology, 212(1): 33), and to increase the frequency of catch-up saccades (Moser et al., 1998, J Neurol, 245(8): 542). Here, we administered two doses of ethanol on different days, yielding moderate (0.06%) and low (0.02%) levels of initial BAC, to examine the effects on human ocular tracking over BACs ranging from 0.00 to 0.07%. Twelve subjects (8 females) participated in a 5-day study. Three days of at-home measurements of daily activity and sleep were monitored, followed by two laboratory days where, ~5 hours after awakening, we administered one of the two possible single doses of alcohol. Using a previously published paradigm (Liston & Stone, 2014, J Vis, 14(14): 12), we measured oculomotor performance multiple times throughout the day with three pre-dosing baseline runs and bi-hourly post-dosing test runs until the subject recorded a BAC of 0.00% for two hours. BAC was measured before each run using an Alco-Sensor IV breathalyzer (Intoximeters, Inc., St. Louis, MO). For each of the oculometric measures, for each subject, we computed the within-subject % deviation for each test run from their baseline averaged across their three pre-dosing runs. We then averaged the data across subjects in 0.01% BAC bins. Finally, we used linear regression to compute the slope and x-intercept (threshold) of the mean binned % deviation as a function of BAC. We found that pursuit initiation was impaired at very low BAC levels, with significant (p < 0.002) linear trends in latency (+1.3%/0.01%BAC) and initial acceleration (-4.6%/0.01%BAC) with extrapolated absolute thresholds at or below 0.01% BAC. We also found that steady-state tracking was impaired showing significant (p < 0.002) linear trends in gain (- 3.8%/0.01%BAC) and catch-up saccade amplitude (+9.1%/0.01%BAC), again with extrapolated absolute thresholds around 0.01% BAC. We also found a significant (p < 0.02) increase in pursuit direction noise (+9.8%/0.01%BAC) with an extrapolated absolute threshold below 0.01% BAC. Many aspects of ocular tracking are impaired in a dose-dependent manner beginning at a BAC level around 0.01%, with significant effects at levels lower than previously reported and up to 8-times lower than the legal limit for driving in most states.

human performance↗

Modeling Measurement Error in Dose-Response Models of Community Annoyance to Low-Noise Supersonic Flight

The primary research goal of the forthcoming NASA Quesst mission community test campaign is to collect representative community response data in support of the development of supersonic overflight noise certification standards. Beginning in 2026, NASA will fly the novel X-59 demonstrator aircraft over select communities in United States in order to demonstrate the possibility of low-noise supersonic flight over land and to collect objective measurements and subjective data on the perceptual experience of this new noise source. It is believed that a regression of a binary perceptual response (‘highly annoyed’ or ‘not’) on estimated noise levels (doses, measured in decibels) will provide a useful dose-response relationship for regulators. However, as these estimated doses will be subject to measurement error, naïve estimators of regression coefficients are inconsistent and slopes may be subject to attenuation bias. In this presentation, I contrast functional modeling of measurement error via simulation extrapolation (SIMEX) with structural Bayesian measurement error models. These methods are applied to available data collected during two NASA risk reduction studies in California in 2011 and Texas in 2018. I’ll conclude noting that in the presence of nonnegligible measurement errors, probabilities of annoyance may be overpredicted for low noise levels and underpredicted for high noise levels, therefore, methods of correcting for measurement error will be necessary to improve the utility of the dose-response relationship for policy-making purposes.

simulation↗

Using diverse potentials and scoring functions for the development of improved machine-learned models for protein–ligand affinity and docking pose prediction

The advent of computational drug discovery holds the promise of significantly reducing the effort of experimentalists, along with monetary cost. More generally, predicting the binding of small organic molecules to biological macromolecules has far-reaching implications for a range of problems, including metabolomics. However, problems such as predicting the bound structure of a protein–ligand complex along with its affinity have proven to be an enormous challenge. In recent years, machine learning-based methods have proven to be more accurate than older methods, many based on simple linear regression. Nonetheless, there remains room for improvement, as these methods are often trained on a small set of features, with a single functional form for any given physical effect, and often with little mention of the rationale behind choosing one functional form over another. Moreover, it is not entirely clear why one machine learning method is favored over another. Here, we endeavor to undertake a comprehensive effort towards developing high-accuracy, machine-learned scoring functions, systematically investigating the effects of machine learning method and choice of features, and, when possible, providing insights into the relevant physics using methods that assess feature importance. Here, we show synergism among disparate features, yielding adjusted R 2 with experimental binding affinities of up to 0.871 on an independent test set and enrichment for native bound structures of up to 0.913. When purely physical terms that model enthalpic and entropic effects are used in the training, we use feature importance assessments to probe the relevant physics and hopefully guide future investigators working on this and other computational chemistry problems.

59 BASIC BIOLOGICAL SCIENCES↗

Multitask methods for predicting molecular properties from heterogeneous data

Data generation remains a bottleneck in training surrogate models to predict molecular properties. We demonstrate that multitask Gaussian process regression overcomes this limitation by leveraging both expensive and cheap data sources. In particular, we consider training sets constructed from coupled-cluster (CC) and density functional theory (DFT) data. We report that multitask surrogates can predict at CC-level accuracy with a reduction in data generation cost by over an order of magnitude. Of note, our approach allows the training set to include DFT data generated by a heterogeneous mix of exchange–correlation functionals without imposing any artificial hierarchy on functional accuracy. More generally, the multitask framework can accommodate a wider range of training set structures—including the full disparity between the different levels of fidelity—than existing kernel approaches based on Δ-learning although we show that the accuracy of the two approaches can be similar. Consequently, multitask regression can be a tool for reducing data generation costs even further by opportunistically exploiting existing data sources.

Chemistry↗

Computer-aided design of stability enhanced nicotinamide cofactor biomimetics for cell-free biocatalysis

Cell-free biocatalysis (CFB) is an efficient and environmentally friendly method to synthesize molecules such as pharmaceuticals, biochemicals, and biofuels through the in vitro use of enzyme cascades. These enzymes often require redox cofactors to drive chemical reactions. Natural redox cofactors (NAD(P)H) are expensive to isolate, motivating synthetic nicotinamide cofactor biomimetics (NCBs) as a cost-effective solution. A select handful of NCBs have been identified as potential NAD(P)H alternatives with comparable or improved redox capabilities, however, they display a tendency to degrade in common buffers. In this study, a library of 132 NCB candidates is systematically generated, over 85% of which have not been characterized in the literature, to expand the diversity of currently explored NCBs. The decomposition mechanism of NCBs in phosphate is evaluated using density functional theory (DFT), revealing protonation at the nicotinamide C5 position as a reporter of cofactor stability. Based on this result, we trained a linear regression model on DFT calculated descriptors to predict NCB stability in phosphate buffer, achieving mean absolute error (MAE) and root mean squared error (RMSE) values within computational accuracy. Analysis of key atomic descriptors and qualitative trends in our dataset informed the design of novel NCB candidates we propose with optimized stability. This work enables researchers to predict the relative stability of NCBs before synthesis, thereby streamlining the process to make CFB more affordable and viable at industry scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Iterative HOMER with uncertainties

We present iHOMER, an iterative version of the HOMER method to extract Lund fragmentation functions from experimental data. Through iterations, we address the information gap between latent and observable phase spaces and systematically remove bias. To quantify uncertainties on the inferred weights, we use a combination of Bayesian neural networks and uncertainty-aware regression. We find that the combination of iterations and uncertainty quantification produces well-calibrated weights that accurately reproduce the data distribution. A parametric closure test shows that the iteratively learned fragmentation function is compatible with the true fragmentation function.

Butter, Anja [Heidelberg Univ. (Germany); Sorbonne↗

Status Report on IES Plug-and-Play Framework

This report discusses the status of the flexible plug-and-play framework development currently ongoing that aims to integrate Modelica/Dymola with the Risk Analysis and Virtual ENviroment (RAVEN) software in terms of both Functional Mock-Up Interface (FMI)/Functional Mock-Up Unit (FMU) construction and repository structures that aim to ease the sharing and simulation of complex dynamic models. This report provides discusses the FMI/FMU adaptors that have been created within the HYBRID repository to allow users to quickly export models as FMUs. Several examples are shown that highlight the step-by-step process of converting an existing Modelica model into an FMU for use within the Dymola platform. Simulation results demonstrate that, while minor differences may occur, the overall control, trends, and solution integrity is maintained between standard Modelica simulation and FMU simulation results. However, it is worth noting that, for small systems, the FMU results have a slower simulation time than the Modelica only simulation. Using this process, a company can provide models that contain proprietary information to entities without disclosing any of the information about the model that could be considered business sensitive. Such an ability would allow institutions to bypass the necessity of “whitewashing” data. In addition to the investigative work being conducted on FMUs and FMIs, a series of updates to the hybrid repository has been completed. These updates include the addition of Modelica system-level regression tests and software quality assurance documentation that ensure that modifications to the Modelica models do not alter system-level model results. Overall, extensive work has been completed on developing FMUs and FMIs from existing models, understanding the requirements and limitations of FMUs, and opensourcing the HYBRID repository with an integrated regression system.

99 GENERAL AND MISCELLANEOUS↗

Causal correlation of foliar biochemical concentrations with AVIRIS spectra using forced entry linear regression

A major goal of airborne imaging spectrometry is to estimate the biochemical composition of vegetation canopies from reflectance spectra. Remotely-sensed estimates of foliar biochemical concentrations of forests would provide valuable indicators of ecosystem function at regional and eventually global scales. Empirical research has shown a relationship exists between the amount of radiation reflected from absorption features and the concentration of given biochemicals in leaves and canopies (Matson et al., 1994, Johnson et al., 1994). A technique commonly used to determine which wavelengths have the strongest correlation with the biochemical of interest is unguided (stepwise) multiple regression. Wavelengths are entered into a multivariate regression equation, in their order of importance, each contributing to the reduction of the variance in the measured biochemical concentration. A significant problem with the use of stepwise regression for determining the correlation between biochemical concentration and spectra is that of 'overfitting' as there are significantly more wavebands than biochemical measurements. This could result in the selection of wavebands which may be more accurately attributable to noise or canopy effects. In addition, there is a real problem of collinearity in that the individual biochemical concentrations may covary. A strong correlation between the reflectance at a given wavelength and the concentration of a biochemical of interest, therefore, may be due to the effect of another biochemical which is closely related. Furthermore, it is not always possible to account for potentially suitable waveband omissions in the stepwise selection procedure. This concern about the suitability of stepwise regression has been identified and acknowledged in a number of recent studies (Wessman et al., 1988, Curran, 1989, Curran et al., 1992, Peterson and Hubbard, 1992, Martine and Aber, 1994, Kupiec, 1994). These studies have pointed to the lack of a physical link between wavelengths chosen by stepwise regression and the biochemical of interest, and this in turn has cast doubts on the use of imaging spectrometry for the estimation of foliar biochemical concentrations at sites distant from the training sites. To investigate this problem, an analysis was conducted on the variation in canopy biochemical concentrations and reflectance spectra using forced entry linear regression.

Dawson, Terence P.↗

Probabilistic assessment of cloud fraction using Bayesian blending of independent datasets: Feasibility study of a new method

We describe and evaluate a novel method to blend two observed cloud fraction (CF) datasets through Bayesian posterior estimation. The research reported here is a feasibility study designed to explore the method. In this proof‐of‐concept study, we illustrate the approach using specific observational datasets from the U. S. Department of Energy Atmospheric Radiation Measurement Program's Southern Great Plains site in the central United States, but the method is quite general and is readily applicable to other datasets. The total sky image (TSI) camera observations are used to determine the prior distribution. A regression model and the active remote sensing of clouds (ARSCL) radar/lidar observations are used to determine the likelihood function. The posterior estimate is a probability density function (pdf) of the CF whose mean is taken to be the optimal blend of the two observations. The data at hourly, daily, 5‐day, monthly, and annual time scales are considered. Some physical and probabilistic properties of the CFs are explored from radar/lidar, camera, and satellite observations and from simulations using the Community Atmosphere Model (CAM5). Our results imply that (a) the Beta distribution is a reasonable model for CF for both short‐ and long‐time means, the 5‐day data are skewed right, and the annual data are almost normally distributed, and (b) the Bayesian method developed successfully yields a pdf of CF, rather than a deterministic CF value, and it is feasible to blend the TSI and ARSCL data with a capability for bias correction.

58 GEOSCIENCES↗

Turbulent transport regimes and the scrape-off layer heat flux width

Understanding the responsible mechanisms and resulting scaling of the scrape-off layer (SOL) heat flux width is important for predicting viable operating regimes in future tokamaks, and for seeking possible mitigation schemes. Here in this paper, we present a qualitative and conceptual framework for understanding various regimes of edge/SOL turbulence and the role of turbulent transport as the mechanism for establishing the SOL heat flux width. Relevant considerations include the type and spectral characteristics of underlying instabilities, the location of the gradient drive relative to the SOL, the nonlinear saturation mechanism, and the parallel heat transport regime. We find a heat flux width scaling with major radius R that is generally positive, consistent with previous findings [J. W. Connor et al., Nucl. Fusion 39, 169 (1999)]. The possible relationship of turbulence mechanisms to the neoclassical orbit width or heuristic drift mechanism in low (L) -mode and high (H) -mode plasmas is considered, together with implications for future experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗