Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Machine Learning the COSMO Model for Predicting Thermodynamics of Electrolyte Mixtures

Bottom-up design of electrolyte mixtures for battery systems requires predicting macro thermodynamic properties from molecular constituents. For instance, molten salt electrolyte batteries require conditions far above room temperature to operate. Therefore, discovering mixtures with increasingly lower eutectic melting points is desirable. A model that can approximate chemical activity is a valuable tool to search through the vast compositional design space. Machine learning can predict properties of materials such as vibrational free energies, electronic energy gaps, and thermal conductivities. Moreover, they can learn physical models such as interatomic potentials. The COSMO-SAC model uses theory and empirical parameterization to predict liquid-vapor and liquid-solid properties using first-principles calculations. However, obtaining activity coefficients required for parameterizing the COSMO-SAC model is costly and limited to a select chemical space. In this work, we explored if machine learning methods could improve the COSMO-SAC model and bridge density functional theory calculations to liquid phase thermodynamic properties. Our data-driven approach uses existing databases for sigma-profiles of organic solvents and reconciles their methodological differences via ensemble averaging. First, an optimal machine learning model is constructed for each dataset. Our machine learning algorithms use the sigma-profile as an input feature to predict binary mixtures' activity coefficients using multi-output regression. Each dataset uses different choices of functionals, methods, and basis sets. Therefore, our ensemble model attempts to predict corrected activity coefficients given the combination of all the model outputs. The activity coefficients used for training are generated using the COSMO-SAC model. This approach enables the extraction of meaningful information from the existing datasets to improve the COSMO-SAC model for obtaining thermodynamic properties of electrolyte mixtures. With the liquid phase activities, we can identify electrolyte mixtures that meet desired phase equilibria conditions.

Thermodynamics↗

Predicting nepheline precipitation in waste glasses using ternary submixture model and machine learning

Nepheline precipitation in nuclear waste glasses during vitrification can be detrimental due to its negative effect on chemical durability. Developing models to accurately predict nepheline precipitation from compositions is important to increase waste loading since existing models can be overly conservative. In this study, an expanded dataset containing 955 glasses was compiled from literature data, where 355 glasses are for high-level waste (HLW). Previously developed submixture models were refitted using the new dataset, where a misclassification rate of 7.8% was achieved. Nine machine learning (ML) algorithms (e.g., k-nearest neighbor, Gaussian process regression, artificial neural network, support vector machine, decision tree, etc.) were applied to evaluate their ability of predicting nepheline precipitation from compositions. Model accuracy, precision, recall/sensitivity, and F1 score were systemically compared between different ML algorithms and modeling protocols. Good model prediction with an accuracy ~0.9 (misclassification rate of ~10%) was observed with different algorithms under certain protocol. This study evaluated various ML models to predict nepheline precipitations in waste glasses, highlighting the importance of data preparation, modeling protocol, and their effect on model stability and reproducibility. The results provide insights into applying ML to predict glass properties and suggest areas for future research on modeling nepheline precipitations.

Lu, Xiaonan↗

Expanding the application of soil moisture monitoring systems through regression-based transformation

Relative to other geophysical variables, soil moisture (SM) estimates derived from land surface models (LSMs) and land data assimilation systems (LDAS) are difficult to transfer between platforms and applications. This difficulty stems from the highly model-dependent nature of LSM SM estimates and differences in the vertical support of discretized SM values. As a result, operational SM estimates generated by one LSM (or LDAS) cannot generally be directly applied to a hydrologic monitoring or forecast system designed around a second LSM. This lack of transferability is particularly problematic for LDAS applications, where the time, expertise, and computational resources required to generate an operational LDAS analysis cannot be practically duplicated for every LSM-specific application. Here, we develop a set of simple regression tools for translating SM estimates between LSMs and multiple LDAS analyses. Results demonstrate that simple multivariate linear regression - utilizing independent variables based on multi-layer and temporally lagged SM estimates - can significantly improve upon baseline transformation approaches using direct percentile matching. The proposed regression approaches are effective for both the LSM-to-LSM and LDAS-to-LDAS transformation of multi-layer SM percentiles. Application of this approach will expand the utility of existing, high-quality (but LSM-specific) operational sources of SM information like the NASA Soil Moisture Active Passive Level-4 Soil Moisture product.

Soil Moisture↗

Accelerated screening of functional atomic impurities in halide perovskites using high-throughput computations and machine learning

The pressing need for novel materials that can serve rising demands in solar cell and optoelectronic technologies makes the nexus of halide perovskites, high-throughput computations, and machine learning, very promising. Ever increasing amounts of data on the structure, fundamental properties, and device performance of halide perovskites provide opportunities for learning chemical rules and design principles that make these materials attractive, and applying them across wide chemical spaces. In this work, we show that impurity properties of halide perovskites computed using density functional theory (DFT) can be combined with machine learning (ML) to deliver predictive models and quick identification of optoelectronically active impurity atoms. Our computation lead to the largest reported dataset of the formation energies and charge transition levels of Pb-site impurities in methylammonium lead halide (MAPbX 3 ) perovskites. Descriptors are defined to uniquely represent any impurity atom in any MAPbX 3 compound and mapped to the computed impurity properties using regression techniques such as Gaussian process regression, neural networks, and random forests. We use the best optimized predictive models to make predictions for hundreds of impurities across 9 MAPbX 3 compounds and create lists of dominating impurities, that is, impurities that can shift the equilibrium Fermi level in the perovskite as determined by native point defects. Finally, this accelerated screening powered by computations and machine learning can guide the identification of problematic impurities that may cause undesired recombination of charge carriers, as well as impurities that can be deliberately introduced to tune the perovskite conductivity and resulting photovoltaic absorption.

36 MATERIALS SCIENCE↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗

Lattice QCD estimates of thermal photon production from the QGP

Thermal photons produced in heavy-ion collision experiments are an important observable for understanding quark-gluon plasma (QGP). The thermal photon rate from the QGP at a given temperature can be calculated from the spectral function of the vector current correlator. Extraction of the spectral function from the lattice correlator is known to be an ill-conditioned problem, as there is no unique solution for a spectral function for a given lattice correlator with statistical errors. The vector current correlator, on the other hand, receives a large ultraviolet contribution from the vacuum, which makes the extraction of the thermal photon rate difficult from this channel. We therefore consider the difference between the transverse and longitudinal part of the spectral function, only capturing the thermal contribution to the current correlator, simplifying the reconstruction significantly. The lattice correlator is calculated for light quarks in quenched QCD at T = 470 MeV ( ∼ 1.5 T c ), as well as in 2 + 1 flavor QCD at T = 220 MeV ( ∼ 1.2 T p c ) with m π = 320 MeV . In order to quantify the nonperturbative effects, the lattice correlator is compared with the corresponding NLO + LPM LO estimate of correlator. The reconstruction of the spectral function is performed in several different frameworks, ranging from physics-informed models of the spectral function to more general models in the Backus-Gilbert method and Gaussian process regression. We find that the resulting photon rates agree within errors. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Flash Heating of a Hollow Rod to Determine Thermal Properties

In a nuclear reactor, prolonged exposure to high neutron flux levels can change material properties of reactor components. Due to the danger posed to personnel by highly radioactive components such as spent fuel, noncontact methods must be used to determine these properties. The objective of the current research is to test the viability of using a flash-heating method to determine the thermal diffusivity of a silicon carbide (SiC) tube, which could be used as cladding for a nuclear fuel rod. The flash-heating experiment was conducted at Oak Ridge National Laboratory and temperature results were analyzed as a two-Dimensional cross section which assumed axial symmetry. The model was fitted iteratively to the temperature measurements using nonlinear regression which required values for thermal diffusivity, Biot number and a term to determine the magnitude of the heat absorbed by the flash. The method could be expanded in the future to estimate the thermal diffusivity of spent nuclear fuel rods in an effort to increase the certainty of new reactor designs using precise thermal properties throughout the core life. A statistical analysis of the results of this work is provided as part of the analysis.

McMasters, Robert L [Virginia Military Institute, ↗

MSU Disentanglement Analysis Software

This software is used to disentangle the forced-versus-unforced components of tropospheric temperature change over the satellite era (after 1979) using maps of surface temperature change as a predictor. In general, the software assembles training datasets (from pre-computed surface temperature trend maps and domain averaged tropospheric warming rates), trains statistical/machine learning (ML) algorithms, applies the trained statistical/ML model to climate model data and observations, and then saves the results. A leave-one-out approach is used in which the statistical/ML models are iteratively trained on (N- 1) climate model and then applied to the remaining climate model (and observations). Each model includes a large ensemble (i.e., >10) of model simulations. The software relies on scikit-learn ridge regression, PLS regression, and neural network algorithms.

Po-Chedley, StephenD↗

Proposal and application of ROM-Lasso method for sensitivity coefficient evaluation

We propose a novel method for evaluating sensitivity coefficients of neutronics parameters to cross sections, so-called the reduced-order modeling technique ROM-Lasso. In this method, cross sections of interest are randomly sampled, and corresponding perturbed core analyses are performed. Then, the sensitivity coefficient vector of the higher-level model is expanded via the active subspace bases obtained with the lower-level model whose dimensional complexity is smaller than that of the higher-level model, and the expansion coefficients are estimated by the Lasso regression. A unique feature of the ROM-Lasso method allows the use of different bases optimized for each neutronics parameter. We conducted a verification calculation for an accelerator-driven system and demonstrated that the ROM-Lasso method can reproduce the sensitivity coefficients with a much smaller number of forward calculations than the direct method. The proposed method can be used to practically evaluate sensitivity coefficients. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Active layer depth and soil properties impact specific leaf area variation and ecosystem productivity in a boreal forest

Specific leaf area (SLA, leaf area per unit dry mass) is a key canopy structural characteristic, a measure of photosynthetic capacity, and an important input into many terrestrial process models. Although many studies have examined SLA variation, relatively few data exist from high latitude, climate-sensitive permafrost regions. We measured SLA and soil and topographic properties across a boreal forest permafrost transition, in which dominant tree species changed as permafrost deepened from 54 to >150 cm over 75 m hillslope transects in Caribou-Poker Creeks Research Watershed, Alaska. We characterized both linear and threshold relationships between topographic and edaphic variables and SLA and developed a conceptual model of these relationships. We found that the depth of the soil active layer above permafrost was significantly and positively correlated with SLA for both coniferous and deciduous boreal tree species. Intraspecific SLA variation was associated with a fivefold increase in net primary production, suggesting that changes in active layer depth due to permafrost thaw could strongly influence ecosystem productivity. While this is an exploratory study to begin understanding SLA variation in a non-contiguous permafrost system, our results indicate the need for more extensive evaluation across larger spatial domains. These empirical relationships and associated uncertainty can be incorporated into ecosystem models that use dynamic traits, improving our ability to predict ecosystem-level carbon cycling responses to ongoing climate change.

59 BASIC BIOLOGICAL SCIENCES↗

Concepts for a theoretical and experimental study of lifting rotor random loads and vibrations. Phase 6-B: Experiments with progressing/regressing forced rotor flapping modes

A two bladed 16-inch hingeless rotor model was built and tested outside and inside a 24 by 24 inch wind tunnel test section at collective pitch settings up to 5 deg and rotor advance ratios up to .4. The rotor model has a simple eccentric mechanism to provide progressing or regressing cyclic pitch excitation. The flapping responses were compared to analytically determined responses which included flap-bending elasticity but excluded rotor wake effects. Substantial systematic deviations of the measured responses from the computed responses were found, which were interpreted as the effects of interaction of the blades with a rotating asymmetrical wake.

Hohenemser, K. H.↗

Unsteady wake effects on progressing/regressing forced rotor flapping modes.

A two bladed 16 inch hingeless rotor model was built and tested outside and inside a 24 by 24 inch wind tunnel test section at collective pitch settings up to 5 deg and rotor advance ratios up to .4. The rotor model has a simple excentric mechanism to provide progressing or regressing cyclic pitch excitation. The flapping responses were compared to analytically determined responses which included flap-bending elasticity but excluded rotor wake effects. Substantial systematic deviations of the measured responses from the computed responses were found, which were interpreted as the effects of interaction of the blades with a rotating asymmetrical wake.

Hohenemser, K. H.↗

OAO battery data analysis

Summary, consolidation and analysis of specifications, manufacturing process and test controls, and performance results for OAO-2 and OAO-3 lot 20 Amp-Hr sealed nickel cadmium cells and batteries are reported. Correlation of improvements in control requirements with performance is a key feature. Updates for a cell/battery computer model to improve performance prediction capability are included. Applicability of regression analysis computer techniques to relate process controls to performance is checked.

Gaston, S.↗

A method for diagnosing surface parameters using geostationary satellite imagery and a boundary-layer model

A method for diagnosing surface parameters on a regional scale via geosynchronous satellite imagery is presented. Moisture availability, thermal inertia, atmospheric heat flux, and total evaporation are determined from three infrared images obtained from the Geostationary Operational Environmental Satellite (GOES). Three GOES images (early morning, midafternoon, and night) are obtained from computer tape. Two temperature-difference images are then created. The boundary-layer model is run, and its output is inverted via cubic regression equations. The satellite imagery is efficiently converted into output-variable fields. All computations are executed on a PDP 11/34 minicomputer. Output fields can be produced within one hour of the availability of aligned satellite subimages of a target area.

Polansky, A. C.↗

The Three-Dimensional Combustion of Heterogeneous Propellants

A numerical framework is described which permits the calculation of the 3-D combustion field supported by a heterogeneous propellant, allowing for complete coupling between the condensed phase physics, the gas-phase physics, and the unsteady, uneven, regressing surface. A random packing algorithm is used to construct models of ammonium-perchlorate in hydroxyl-terminated-polybutadiene propellants which mimic experimental propellants designed by R. Miller, and these are numerically burnt. Mean burning rates are compared with experimental data for four packs, over a pressure range of 7-200atm.

Massa, L.↗

Self Validation of Radiance Measurements from the CERES (TRMM)Instrument

Eight continuous months of earth-nadir-viewing radiance measurements from the 3-channel Tropical Rainfall Measuring Mission (TRMM,) Clouds and the Earth's Radiant Energy System (CERES) scanning radiometric measurement instrument, have been analyzed. While previous remote sensing satellites, such as the Earth Radiation Budget Experiment (ERBE) covered all subsets of the broadband radiance spectrum (total, longwave and shortwave.) CERES has two subset channels (window and shortwave) which do not give continuous frequency coverage over the total band. Previous experience with ERBE indicated the need for us to model the equivalent daytime longwave radiance using a window channel regression, which will allow us to validate the performance of the instrument using a three-channel inter-comparison. Limiting our consideration to the fixed azimuth plane, cross-track, scanning mode (FAPS), each nadir-viewing measurement was averaged into three subjective categories called daytime, nighttime, and twilight. Daytime was defined as any measurement taken when the solar zenith angle (SZA) was less than 90 ; nighttime was taken to be any measurement where the SZA was greater than 117 ; and twilight was everything else. Our analysis indicates that there are only two distinct categories of nadir-view data; daytime, and non-daytime (i.e., the union of the nighttime and twilight sets); and that the CERES longwave radiance is predictable to an accuracy of 1%, based on the SZA, and window channel measurements.

Paden, Jack↗

Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83-0.97) and William's index values (range 0.37-0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.

NASA Discipline Cardiopulmonary↗