SEARCH · Engineering Papers

Results for “simple linear regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

40 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Adapting Secure MultiParty Computation to Support Machine Learning in Radio Frequency Sensor Networks

In this project we developed and validated algorithms for privacy-preserving linear regression using a new variant of Secure Multiparty Computation (MPC) we call "Hybrid MPC" (hMPC). Our variant is intended to support low-power, unreliable networks of sensors with low-communication, fault-tolerant algorithms. In hMPC we do not share training data, even via secret sharing. Thus, agents are responsible for protecting their own local data. Only the machine learning (ML) model is protected with information-theoretic security guarantees against honest-but-curious agents. There are three primary advantages to this approach: (1) after setup, hMPC supports a communication-efficient matrix multiplication primitive, (2) organizations prevented by policy or technology from sharing any of their data can participate as agents in hMPC, and (3) large numbers of low-power agents can participate in hMPC. We have also created an open-source software library named "Cicada" to support hMPC applications with fault-tolerance. The fault-tolerance is important in our applications because the agents are vulnerable to failure or capture. We have demonstrated this capability at Sandia's Autonomy New Mexico laboratory through a simple machine-learning exercise with Raspberry Pi devices capturing and classifying images while flying on four drones.

42 ENGINEERING↗

DOE OSTI2020

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

DOE OSTI2020

Machine learning Frenkel Hamiltonian parameters to accelerate simulations of exciton dynamics

In this manuscript, we develop multiple machine learning (ML) models to accelerate a scheme for parameterizing site-based models of exciton dynamics from all-atom configurations of condensed phase sexithiophene systems. This scheme encodes the details of a system’s specific molecular morphology in the correlated distributions of model parameters through the analysis of many single-molecule excited-state electronic-structure calculations. These calculations yield excitation energies for each molecule in the system and the network of pair-wise intermolecular electronic couplings. In this work, we demonstrate that the excitation energies can be accurately predicted using a kernel ridge regression (KRR) model with Coulomb matrix featurization. We present two ML models for predicting intermolecular couplings. The first one utilizes a deep neural network and bi-molecular featurization to predict the coupling directly, which we find to perform poorly. The second one utilizes a KRR model to predict unimolecular transition densities, which can subsequently be analyzed to compute the coupling. We find that the latter approach performs excellently, indicating that an effective, generalizable strategy for predicting simple bimolecular properties is through the indirect application of ML to predict higher-order unimolecular properties. Such an approach necessitates a much smaller feature space and can incorporate the insight of well-established molecular physics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Data from: "Warming and the dependence of limber pine (Pinus flexilis) establishment on summer soil moisture within and above its current elevation range"

This data package contains data that were used for analysis in “Warming and the dependence of limber pine (Pinus flexilis) establishment on summer soil moisture within and above its current elevation range”, by Moyes et al. 2013. All data collection and field research were completed on Niwot Ridge, Colorado, USA.This data package contains nine comma-separated-values (.csv) files, one text (.txt) file, and two zipped seedling folders that were used for leaf area analysis. One zipped folder contains 468 .jpg photographs of seedlings, and the second contains 468 corresponding Image J-processed .jpg images that include silhouette leaf area values. .csv and .txt files can be opened using any compatible simple text-editor software such as TextEdit (Mac) and Notepad (Windows); .csv’s can also be opened using R and Microsoft Excel. Image files can be opened using Preview (Mac) and Photos (Windows). In addition, there are a total of 31 Microsoft Excel files: three .xlsx files, and 28 raw Li-Cor output .xls files. This data user’s guide is available in .pdf format, and can be opened using Adobe Acrobat Reader, or any other compatible file viewing software. Geospatial data showing field site locations are also included in the archive for use and reference. There are two geospatial formats in this archive: ESRI shapefiles (.shp) and keyhole markup-language (.kml) files. Both file types contain bounding box information, with the former being polygons, and the latter containing corner coordinates for each site. ESRI shapefiles can be opened using any geospatial software compatible with the file type (such as ESRI’s ArcGIS suite and QGIS), and .kml files are compatible with Google Earth and Google Maps.--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Continued changes in climate are projected to alter the geographic distributions of plant species, in part by affecting where individuals can establish from seed. We tested the hypothesis that warming promotes uphill redistribution of subalpine tree populations by reducing cold limitation at high elevation and enhancing drought stress at low elevation. We seeded limber pine (Pinus flexilis) into plots with combinations of infrared heating and water addition treatments, at sites positioned in lower subalpine forest, the treeline ecotone, and alpine tundra. In 2010, first-year seedlings were assessed for physiological performance and survival over the snow-free growing season. Seedlings emerged in midsummer, about 5–8 weeks after snowmelt. Low temperature was not observed to limit seedling photosynthesis or respiration between emergence and October, and thus experimental warming did not appear to reduce cold limitation at high elevation. Instead, gas exchange and water potential from all sites indicated a prevailing effect of summer moisture stress on photosynthesis and carbon balance. Infrared heaters raised soil growing degree days (base 5 °C, p < 0.001) and August–September mean soil temperature (p < 0.001). Despite marked differences in vegetation cover and meteorological conditions across sites, volumetric soil moisture content (θ) at 5–10 cm below 0.16 and 0.08 m^3 m^(−3) consistently corresponded with moderate and severe indications of drought stress in midday stem water potential, stomatal conductance, photosynthesis, and respiration. Seedling survival was greater in watered plots than in heated plots (p = 0.01), and negatively related to soil growing degree days and duration of exposure to θ < 0.08 m^3 m^(−3) in a stepwise linear regression model (p < 0.0001). We concluded that seasonal moisture stress and high soil surface temperature imposed a strong limitation to limber pine seedling establishment across a broad elevation gradient, including at treeline, and that these limitations are likely to be enhanced by further climate warming.--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Maintenance log:Amended file name error in Data User's Guide May 19 2022

54 ENVIRONMENTAL SCIENCES↗