Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Molecular dipole moment learning via rotationally equivariant derivative kernels in molecular-orbital-based machine learning

This study extends the accurate and transferable molecular-orbital-based machine learning (MOB-ML) approach to modeling the contribution of electron correlation to dipole moments at the cost of Hartree–Fock computations. A MOB pairwise decomposition of the correlation part of the dipole moment is applied, and these pair dipole moments could be further regressed as a universal function of MOs. The dipole MOB features consist of the energy MOB features and their responses to electric fields. An interpretable and rotationally equivariant derivative kernel for Gaussian process regression (GPR) is introduced to learn the dipole moment more efficiently. The proposed problem setup, feature design, and ML algorithm are shown to provide highly accurate models for both dipole moments and energies on water and 14 small molecules. To demonstrate the ability of MOB-ML to function as generalized density-matrix functionals for molecular dipole moments and energies of organic molecules, we further apply the proposed MOB-ML approach to train and test the molecules from the QM9 dataset. The application of local scalable GPR with Gaussian mixture model unsupervised clustering GPR scales up MOB-ML to a large-data regime while retaining the prediction accuracy. In addition, compared with the literature results, MOB-ML provides the best test mean absolute errors of 4.21 mD and 0.045 kcal/mol for dipole moment and energy models, respectively, when training on 110 000 QM9 molecules. The excellent transferability of the resulting QM9 models is also illustrated by the accurate predictions for four different series of peptides.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multitask methods for predicting molecular properties from heterogeneous data

Data generation remains a bottleneck in training surrogate models to predict molecular properties. We demonstrate that multitask Gaussian process regression overcomes this limitation by leveraging both expensive and cheap data sources. In particular, we consider training sets constructed from coupled-cluster (CC) and density functional theory (DFT) data. We report that multitask surrogates can predict at CC-level accuracy with a reduction in data generation cost by over an order of magnitude. Of note, our approach allows the training set to include DFT data generated by a heterogeneous mix of exchange–correlation functionals without imposing any artificial hierarchy on functional accuracy. More generally, the multitask framework can accommodate a wider range of training set structures—including the full disparity between the different levels of fidelity—than existing kernel approaches based on Δ-learning although we show that the accuracy of the two approaches can be similar. Consequently, multitask regression can be a tool for reducing data generation costs even further by opportunistically exploiting existing data sources.

Chemistry↗

Online quantitative analysis of multispectral images of human body tissues

A method is developed for online monitoring of structural and morphological parameters of biological tissues (haemoglobin concentration, degree of blood oxygenation, average diameter of capillaries and the parameter characterising the average size of tissue scatterers), which involves multispectral tissue imaging, image normalisation to one of its spectral layers and determination of unknown parameters based on their stable regression relation with the spectral characteristics of the normalised image. Regression is obtained by simulating numerically the diffuse reflectance spectrum of the tissue by the Monte Carlo method at a wide variation of model parameters. The correctness of the model calculations is confirmed by the good agreement with the experimental data. The error of the method is estimated under conditions of general variability of structural and morphological parameters of the tissue. The method developed is compared with the traditional methods of interpretation of multispectral images of biological tissues, based on the solution of the inverse problem for each pixel of the image in the approximation of different analytical models. (biomedical optics)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Isotopically nonstationary 13 C flux analysis of changes in Arabidopsis thaliana leaf metabolism due to high light acclimation

Improving plant productivity is an important aim for metabolic engineering. There are few comprehensive methods that quantitatively describe leaf metabolism, although such information would be valuable for increasing photosynthetic capacity, enhancing biomass production, and rerouting carbon flux toward desirable end products. Isotopically nonstationary metabolic flux analysis (INST-MFA) has been previously applied to map carbon fluxes in photoautotrophic bacteria, which involves model-based regression of transient 13 C-labeling patterns of intracellular metabolites. However, experimental and computational difficulties have hindered its application to terrestrial plant systems. Here, we performed in vivo isotopic labeling of Arabidopsis thaliana rosettes with 13 CO 2 and estimated fluxes throughout leaf photosynthetic metabolism by INST-MFA. Plants grown at 200 µmol m $-$2 s $-$1 light were compared with plants acclimated for 9 d at an irradiance of 500 µmol∙m $-$2 ∙s $-$1 . Approximately 1,400 independent mass isotopomer measurements obtained from analysis of 37 metabolite fragment ions were regressed to estimate 136 total fluxes (54 free fluxes) under each condition. The results provide a comprehensive description of changes in carbon partitioning and overall photosynthetic flux after long-term developmental acclimation of leaves to high light. Despite a doubling in the carboxylation rate, the photorespiratory flux increased from 17 to 28% of net CO 2 assimilation with high-light acclimation (Vc/Vo: 3.5:1 vs. 2.3:1, respectively). In conclusion, this study highlights the potential of 13 C INST-MFA to describe emergent flux phenotypes that respond to environmental conditions or plant physiology and cannot be obtained by other complementary approaches.

13C-labeling↗

Coupled laboratory and field investigations resolve microbial interactions that underpin persistence in hydraulically fractured shales

Hydraulic fracturing is one of the industrial processes behind the surging natural gas output in the United States. This technology inadvertently creates an engineered microbial ecosystem thousands of meters below Earth’s surface. Here, we used laboratory reactors to perform manipulations of persisting shale microbial communities that are currently not feasible in field scenarios. Metaproteomic and metabolite findings from the laboratory were then corroborated using regression based modeling performed on metagenomic and metabolite data from more than 40 produced fluids from five hydraulically fractured shale wells. Collectively, our findings show that Halanaerobium, Geotoga, and Methanohalophilius strain abundances predict a significant fraction of nitrogen and carbon metabolites in the field. Our laboratory findings also exposed cryptic predatory, cooperative, and competitive interactions that impact microorganisms across fractured shales. Scaling these results from the laboratory to the field identified mechanisms underpinning biogeochemical reactions, yielding knowledge that can be harnessed to potentially increase energy yields and inform management practices in hydraulically fractured shales.

hydraulic fracturing, metaproteomics, methanogenes↗

Metalearners for estimating heterogeneous treatment effects using machine learning

There is growing interest in estimating and analyzing heterogeneous treatment effects in experimental and observational studies. We describe a number of metaalgorithms that can take advantage of any supervised learning or regression method in machine learning and statistics to estimate the conditional average treatment effect (CATE) function. Metaalgorithms build on base algorithms—such as random forests (RFs), Bayesian additive regression trees (BARTs), or neural networks—to estimate the CATE, a function that the base algorithms are not designed to estimate directly. We introduce a metaalgorithm, the X-learner, that is provably efficient when the number of units in one treatment group is much larger than in the other and can exploit structural properties of the CATE function. For example, if the CATE function is linear and the response functions in treatment and control are Lipschitz-continuous, the X-learner can still achieve the parametric rate under regularity conditions. We then introduce versions of the X-learner that use RF and BART as base learners. In extensive simulation studies, the X-learner performs favorably, although none of the metalearners is uniformly the best. In two persuasion field experiments from political science, we demonstrate how our X-learner can be used to target treatment regimes and to shed light on underlying mechanisms. A software package is provided that implements our methods.

42 ENGINEERING↗

Multi-depth suspended sediment estimation using high-resolution remote-sensing UAV in Maumee River, Ohio

Satellite remote-sensing has been widely used to map suspended sediment concentration (SSC) in waterbodies. Current development of the unmanned aerial vehicle (UAV) technology allows mapping of SSC at finer spatial resolution providing high flexibility in terms of cost and acquisition time. However, the technology is immature and transfer of empirical algorithms from existing remote-sensing technologies to UAV still has to be explored. Here, this study uses the MicaSense Sequoia sensor with four bands (green, red, red edge, and near-infrared [NIR]) mounted on-board a fixed-wing UAV to map SSC within the Maumee River in Ohio, USA, at multiple depth intervals (15, 61, 91, and 182 cm). The simple linear and stepwise regression models show the advantage of multiple bands and band ratios over single bands in mapping SSC. The findings show a limited performance of the Sequoia sensor when compared to field spectroradiometer measurements. In all cases but one, the adjusted coefficient of determination (R$2\atop{adj}$) values is lower for the UAV data. The regression equations become similar at and below a depth of 0–61 cm, and R$2\atop{adj}$ become constant at and below a depth of 0–91 cm. While the spectroradiometer-related equations are sensitive to a wider spectral range (from green at the surface to NIR wavelength at 182 cm depth), the UAV-related equations are insensitive to green spectrum and they include a narrower spectral range (from red to NIR) over all depth increments. Field spectroradiometer measurements exhibit a strong relationship with cumulative SSC at 182 cm depth (0–182 cm) (R$2\atop{adj}$ = 0.71) whereas UAV reflectance data show the best relationship with SSC at 91 cm (0–91 cm) (R$2\atop{adj}$ = 0.56) suggesting that ~91 cm may be an optimal depth for UAV under given conditions. In conclusion, the results show that UAVs can be a practical but somewhat limited tool to monitor SSC in small- to medium-sized rivers.

47 OTHER INSTRUMENTATION↗

Sparse-Data Deep Learning Strategies for Radiographic Non-Destructive Testing

Radiography is an imaging technique used in a variety of applications, such as medical diagnosis, airport security, and nondestructive testing. We present a deep learning system for extracting information from radiographic images. We perform various prediction tasks using our system, including material classification and regression on the dimensions of a given object that is being radiographed. Our system is designed to address the sparse-data issue for radiographic nondestructive testing applications. It uses a radiographic simulation tool for synthetic data augmentation, and it uses transfer learning with a pre-trained convolutional neural network model. Using this system, our preliminary results indicate that the object geometry regression task saw an improvement of 70% in the R-squared value when using a multi-regime model. In addition, we increase the performance of the object material classification tasks by utilizing data from different imaging systems. In particular, using neutron imaging improved the material classification accuracy by 20% when compared to x-ray imaging.

convolutional neural networks↗

Quantifying CTFE content in FK-800 using ATR-FTIR and time to peak crystallization

The chlorotrifluoroethylene (CTFE) content in vinylidene fluoride (VDF)-CTFE copolymers greatly influences the chemical and physical properties and ultimately determines the application. The copolymer known as FK-800 has a VDF:CTFE ratio of ~1:3 and is used almost exclusively as the binder in the insensitive high explosive (HE) formulation PBX 9502. Due to the dangerous nature of HE work and the effect CTFE content variations have, the ability to quickly and easily quantify CTFE content is of interest. Two techniques, attenuated total reflectance-Fourier transform infrared spectroscopy (ATR-FTIR) and time to peak crystallization measured by heat flow calorimetry, were evaluated here as potential means for quantifying CTFE content. Based on the certificate of analyses (COAs), FK-800 lots with varied CTFE content encompassing the range historically used in HE applications were used as standards for both methodologies. For FTIR, a linear regression was performed on the peak area of the C-Cl IR stretch and the CTFE content; the methodology was then demonstrated on four samples, two lots of unadulterated material and material recovered from two HE samples. The calculated CTFE content and COAs were in good agreement for all four samples. Heat flow calorimetry revealed the relationship between time to peak crystallization and CTFE content was best fit by a power regression; the methodology was then tested on two different FK-800 lots. Only one sample showed good agreement between the calculated CTFE content and the COA. This discrepancy indicates the method developed is not suitable for quantifying CTFE, but provides valuable insight regarding the crystallization behavior of VDF-CTFE copolymers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Discovering Active Subspaces for High-Dimensional Computer Models

Dimension reduction techniques have long been an important topic in statistics, and active subspaces (AS) have received much attention this past decade in the computer experiments literature. The most common approach towards estimating the AS is to use Monte Carlo with numerical gradient evaluation. While sensible in some settings, this approach has obvious drawbacks. Recent research has demonstrated that active subspace calculations can be obtained in closed form, conditional on a Gaussian process (GP) surrogate, which can be limiting in high-dimensional settings for computational reasons. In this paper, we produce the relevant calculations for a more general case when the model of interest is a linear combination of tensor products. These general equations can be applied to the GP, recovering previous results as a special case, or applied to the models constructed by other regression techniques including multivariate adaptive regression splines (MARS). Furthermore, using a MARS surrogate has many advantages including improved scaling, better estimation of active subspaces in high dimensions and the ability to handle a large number of prior distributions in closed form. In one real-world example, we obtain the active subspace of a radiation-transport code with 240 inputs and 9,372 model runs in under half an hour.

97 MATHEMATICS AND COMPUTING↗

Estimating Air Chemical Emissions from Research Activities Using Stack Measurement Data

Current methods of estimating air emissions from research and development (R&D) activities use a wide range of release fractions or emission factors with bases ranging from empirical to semi-empirical. Although considered conservative, the uncertainties and confidence levels of the existing methods have not been reported. Chemical emissions were estimated from sampling data taken from four research facilities over ten years. The approach was to use a Monte Carlo technique to create distributions of annual emission estimates for target compounds detected in source test samples. Distributions were created for each year and building sampled for compounds with sufficient detection frequency to qualify for the analysis. The results using the Monte Carlo technique without applying a filter to remove negative emission values showed almost all distributions spanning zero, and forty percent of the distributions having a negative mean. This indicates that emissions are so low as to be indistinguishable from building background. Application of a filter to allow only positive values in the distribution provided a more realistic value for emissions and increased the distribution mean by an average of sixteen percent. Release fractions were calculated by dividing the emission estimates by a building chemical inventory quantity. Two variations were used for this quantity: chemical usage, and chemical usage plus one-half standing inventory. Filters were applied so that only release fraction values from zero to one were included in the resulting distributions. Release fractions had a wide range among chemicals and among data sets for different buildings and/or years for a given chemical. Regressions of release fractions to molecular weight and vapor pressure showed weak correlations. Similarly, regressions of mean emissions to chemical usage, chemical inventory, molecular weight and vapor pressure also gave weak correlations. These results highlight the difficulties in estimating emissions from R&D facilities using chemical inventory data.

air chemical sampling, air emissions, research and↗

Development of a metamodelling framework for building energy models with application to fifth-generation district heating and cooling networks

Fully defined physics-based building energy models can accurately represent building systems; however, generating models based on high-level parameters is time consuming and simulation time of complex models can be slow. This article discusses the development of a Metamodelling Framework to create metamodels from a building energy modelling dataset. The framework generates metamodels using either linear regression, random forests, or support vector regressions. A fifth-generation district heating and cooling system analysis use case was used to motivate the development of the framework. The use case required quick and accurate representations of annual building loads reported hourly. Typical annual building modelling approaches can result in a runtime of 10 min. The metamodels runtime was reduced to less than 10 s to load and run an annual simulation with user-defined covariates. The results of the metamodel performance and an abbreviated topology analysis based on the motivating use case will be presented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluation of scenario-specific modeling approaches to predict plane of array solar irradiation

The two main objectives of this study are to evaluate the extent to which the prediction of plane of array irradiance is improved when diffuse radiation is predicted using location-specific regression models developed from onsite measured data as against using generalized models and to estimate the expected uncertainties associated with plane of array irradiance predictions under different data collection scenarios likely to be encountered in practical situations.

Moslehi, Salim↗

ON THE THREE-DIMENSIONAL STRUCTURE OF THE MASS, METALLICITY, AND STAR FORMATION RATE SPACE FOR STAR-FORMING GALAXIES

We demonstrate that the space formed by the star formation rate (SFR), gas-phase metallicity (Z), and stellar mass (M {sub *}) can be reduced to a plane, as first proposed by Lara-Lopez et al. We study three different approaches to find the best representation of this 3D space, using a principal component analysis (PCA), a regression fit, and binning of the data. The PCA shows that this 3D space can be adequately represented in only two dimensions, i.e., a plane. We find that the plane that minimizes the {chi}{sup 2} for all variables, and hence provides the best representation of the data, corresponds to a regression fit to the stellar mass as a function of SFR and Z, M {sub *}= f(Z, SFR). We find that the distribution resulting from the median values in bins for our data gives the highest {chi}{sup 2}. We also show that the empirical calibrations to the oxygen abundance used to derive the Fundamental Metallicity Relation have important limitations, which contribute to the apparent inconsistencies. The main problem is that these empirical calibrations do not consider the ionization degree of the gas. Furthermore, the use of the N2 index to estimate oxygen abundances cannot be applied for 12 + log(O/H) {approx}> 8.8 because of the saturation of the [N II] {lambda}6584 line in the high-metallicity regime. Finally, we provide an update of the Fundamental Plane derived by Lara-Lopez et al.

79 ASTRONOMY AND ASTROPHYSICS↗

THE MASS DEPENDENCE BETWEEN PROTOPLANETARY DISKS AND THEIR STELLAR HOSTS

We present a substantial extension of the millimeter (mm) wave continuum photometry catalog for circumstellar dust disks in the Taurus star-forming region, based on a new ''snapshot'' {lambda} = 1.3 mm survey with the Submillimeter Array. Combining these new data with measurements in the literature, we construct a mm-wave luminosity distribution, f(L{sub mm}), for Class II disks that is statistically complete for stellar hosts with spectral types earlier than M8.5 and has a 3{sigma} depth of roughly 3 mJy. The resulting census eliminates a longstanding selection bias against disks with late-type hosts, and thereby demonstrates that there is a strong correlation between L{sub mm} and the host spectral type. By translating the locations of individual stars in the Hertzsprung-Russell diagram into masses and ages, and adopting a simple conversion between L{sub mm} and the disk mass, M{sub d} , we confirm that this correlation corresponds to a statistically robust relationship between the masses of dust disks and the stars that host them. A Bayesian regression technique is used to characterize these relationships in the presence of measurement errors, data censoring, and significant intrinsic scatter: the best-fit results indicate a typical 1.3 mm flux density of {approx}25 mJy for 1 M{sub Sun} hosts and a power-law scaling L{sub mm}{proportional_to}M{sub *}{sup 1.5-2.0}. We suggest that a reasonable treatment of dust temperature in the conversion from L{sub mm} to M{sub d} favors an inherently linear M{sub d} {proportional_to}M{sub *} scaling, with a typical disk-to-star mass ratio of {approx}0.2%-0.6%. The measured rms dispersion around this regression curve is {+-}0.7 dex, suggesting that the combined effects of diverse evolutionary states, dust opacities, and temperatures in these disks imprint a full width at half-maximum range of a factor of {approx}40 on the inferred M{sub d} (or L{sub mm}) at any given host mass. We argue that this relationship between M{sub d} and M{sub *} likely represents the origin of the inferred correlation between giant planet frequency and host star mass in the exoplanet population, and provides some basic support for the core accretion model for planet formation. Moreover, we caution that the effects of incompleteness and selection bias must be considered in comparative studies of disk evolution, and illustrate that fact with statistical comparisons of f(L{sub mm}) between the Taurus catalog presented here and incomplete subsamples in the Ophiuchus, IC 348, and Upper Sco young clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Statistical properties of multi-epoch spectral variability of SDSS stripe 82 quasars

We investigate the UV-optical (longward of Lyα 1216 Å) spectral variability of nearly 9000 quasars (0 < z < 4) using multi-epoch photometric data within the SDSS Stripe 82 region. The regression slope in the flux-flux space of a quasar light curve directly measures the color of the flux difference spectrum, then the spectral shape of the flux difference spectra can be derived by taking a careful look at the redshift dependence of the regression slopes. First, we confirm that the observed quasar spectrum becomes bluer when the quasar becomes brighter. We infer the spectral index of the composite difference spectrum as α{sub ν}{sup dif}∼+1/3 (in the form of f{sub ν}∝ν{sup α{sub ν}}), which is significantly bluer than that of the composite spectrum α{sub ν}{sup com}∼−0.5. We also show that the continuum variability cannot be explained by accretion disk models with varying mass accretion rates. Second, we examine the effects of broad emission line variability on the color-redshift space. The variability of the 'Small Blue Bump' is extensively discussed. We show that the low-ionization lines of Mg II and Fe II are less variable compared to Balmer emission lines and high-ionization lines, and the Balmer continuum is the dominant variable source around ∼3000 Å. These results are compared with previous studies, and the physical mechanisms of the variability of the continuum and emission lines are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Faint X-ray binaries and their optical counterparts in M31

X-ray binaries (XRBs) are probes of both star formation and stellar mass, but more importantly remain one of the only direct tracers of the compact object population. To investigate the XRB population in M31, we utilized all 121 publicly available observations of M31 totalling over 1 Ms from Chandra's ACIS instrument. We studied 83 star clusters in the bulge using the year 1 star cluster catalogue from the Panchromatic Hubble Andromeda Treasury Survey. We found 15 unique star clusters that matched to 17 X-ray point sources within 1'' (3.8 pc). This population is composed predominantly of globular cluster low-mass XRBs, with one previously unidentified star cluster X-ray source. Star clusters that were brighter and more compact preferentially hosted an X-ray source. Specifically, logistic regression showed that the F475W magnitude was the most important predictor followed by the effective radius, while color (F475W–F814W) was not statistically significant. We also completed a matching analysis of 1566 H II regions and found 10 unique matches to 9 X-ray point sources within 3'' (11 pc). The H II regions hosting X-ray point sources were on average more compact than unmatched H II regions, but logistic regression concluded that neither the radius nor Hα luminosity was a significant predictor. Four matches have no previous classification and thus are high-mass XRB candidates. A stacking analysis of both star clusters and H II regions resulted in non-detections, giving typical upper limits of ≈10{sup 32} erg s{sup –1}, which probes the quiescent XRB regime.

79 ASTRONOMY AND ASTROPHYSICS↗

SIMULATED PERFORMANCE OF TIMESCALE METRICS FOR APERIODIC LIGHT CURVES

Aperiodic variability is a characteristic feature of young stars, massive stars, and active galactic nuclei. With the recent proliferation of time-domain surveys, it is increasingly essential to develop methods to quantify and analyze aperiodic variability. We develop three timescale metrics that have been little used in astronomy—Δm-Δt plots, peak-finding, and Gaussian process regression—and present simulations comparing their effectiveness across a range of aperiodic light curve shapes, characteristic timescales, observing cadences, and signal to noise ratios. We find that Gaussian process regression is easily confused by noise and by irregular sampling, even when the model being fit reflects the process underlying the light curve, but that Δm-Δt plots and peak-finding can coarsely characterize timescales across a broad region of parameter space. We make public the software we used for our simulations, both in the spirit of open research and to allow others to carry out analogous simulations for their own observing programs.

79 ASTRONOMY AND ASTROPHYSICS↗