Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Forecasting Megaelectron-Volt Electrons Inside Earth's Outer Radiation Belt: PreMevE 2.0 Based on Supervised Machine Learning Algorithms

We present the recent progress in upgrading a predictive model for megaelectron-volt (MeV) electrons inside the Earth's outer Van Allen belt. This updated model, called PreMevE 2.0, provides improved forecasts, particularly at outer L-shells, by adding upstream solar wind speeds to the model's input parameter list that originally includes precipitating electrons observed at low Earth orbits and MeV electron fluxes in situ measured by a geosynchronous satellite. Furthermore, based on several kinds of linear and artificial neural networks algorithms, a list of models was constructed, trained, validated, and tested with 42-month MeV electron observations from Van Allen Probes. Out-of-sample test results from these models show that, with optimized model hyperparameters and input parameter combinations, the top performer from each category of models has the similar capability of making reliable 1-day (2-day) forecasts of 1-MeV electron flux distributions with performance efficiency values ~0.87 (~0.82) averaged over the L-shell range of 2.8–6.6, significantly outperforming the previous version of PreMevE particularly at L-shells > ~4.5. Interestingly, the linear regression model is often the most successful when compared to other models, which suggests the relationship between dynamics of trapped 1-MeV electrons and precipitating electrons is dominated by linear components. Results also show that PreMevE 2.0 can reasonably well predict the onsets of MeV electron events in 2-day forecasts. PreMevE 2.0 is designed to be driven by observations from longstanding space infrastructure to make high-fidelity forecasts for MeV electrons, thus can be an invaluable space weather forecasting tool for the future.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Comparative Analysis of HEATNETS for Geothermal Network Performance: Preprint

Thermal energy networks (TENs), also known as 5th generation district energy systems, or more specifically geothermal networks when exchanging heat with geothermal boreholes, are an important technology for decarbonization. In these networks an ambient loop connects buildings and thermal sources, such as a borehole field, to exchange energy and maintain a desired loop temperature. Water-source heat pumps are used at the buildings to connect to the ambient or thermal loop to meet to the building heating and cooling loads and maintain comfort. A semi-transient, reduced-order technical model and techno-economic model, called HEATNETS, has been developed at NREL that captures the flow of energy around a TEN. In this work, a comparison of the HEATNETS technical model and a well-known coding platform used for modeling geothermal networks, TRNSYS, has been completed for a proposed geothermal network as a verification process. Hourly data provided from the TRNSYS simulation included building loads, pumping power, heat pump power, temperature entering and leaving the borehole field, and mass flow rates. The hourly borehole temperatures were used to create a linear regression model utilized in HEATNETS to estimate the borehole field heat exchange. The building loads and mass flow rates were direct inputs to HEATNETS while the pumping power, heat pump power, borehole temperatures, and coefficients of performance were all simulated and calculated by HEATNETS, allowing for direct comparison of the thermal energy transfer, rather than also comparing control systems responses. HEATNETS considers the full process from design inputs to economic outputs and can provide modeling options for high-level initial system design and operational optimization. This study shows that HEATNETS, while not intended to replace other modeling tools, can be a unique modeling tool for the performance of a full geothermal network system.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Predicting critical heat flux with uncertainty quantification and domain generalization using conditional variational autoencoders and deep neural networks

Deep generative models (DGMs) can generate synthetic data samples that closely resemble the original dataset, addressing data scarcity. In this work, we developed a conditional variational autoencoder (CVAE) to augment critical heat flux (CHF) data used for the 2006 Groeneveld lookup table. To compare with traditional methods, a fine-tuned deep neural network (DNN) regression model was evaluated on the same dataset. Both models achieved small mean absolute relative errors, with the CVAE showing more favorable results. Uncertainty quantification (UQ) was performed using repeated CVAE sampling and DNN ensembling. The DNN ensemble improved performance over the baseline, while the CVAE maintained consistent results with less variability and higher confidence. Both models achieved small errors inside and outside the training domain, with slightly larger errors outside. Altogether, the CVAE performed better than the DNN in predicting CHF and exhibited better uncertainty behavior.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Predicting partner fitness based on spatial structuring in a light-driven microbial community

Microbial communities have vital roles in systems essential to human health and agriculture, such as gut and soil microbiomes, and there is growing interest in engineering designer consortia for applications in biotechnology ( e . g ., personalized probiotics, bioproduction of high-value products, biosensing). The capacity to monitor and model metabolite exchange in dynamic microbial consortia can provide foundational information important to understand the community level behaviors that emerge, a requirement for building novel consortia. Where experimental approaches for monitoring metabolic exchange are technologically challenging, computational tools can enable greater access to the fate of both chemicals and microbes within a consortium. In this study, we developed an in-silico model of a synthetic microbial consortia of sucrose-secreting Synechococcus elongatus PCC 7942 and Escherichia coli W. Our model was built on the NUFEB framework for Individual-based Modeling (IbM) and optimized for biological accuracy using experimental data. We showed that the relative level of sucrose secretion regulates not only the steady-state support for heterotrophic biomass, but also the temporal dynamics of consortia growth. In order to determine the importance of spatial organization within the consortium, we fit a regression model to spatial data and used it to accurately predict colony fitness. We found that some of the critical parameters for fitness prediction were inter-colony distance, initial biomass, induction level, and distance from the center of the simulation volume. We anticipate that the synergy between experimental and computational approaches will improve our ability to design consortia with novel function.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Comparative Analysis of HEATNETS for Geothermal Network Performance

Thermal energy networks (TENs), also known as 5th generation district energy systems, or more specifically geothermal networks when exchanging heat with geothermal boreholes, are an important technology for decarbonization. In these networks an ambient loop connects buildings and thermal sources, such as a borehole field, to exchange energy and maintain a desired loop temperature. Water-source heat pumps are used at the buildings to connect to the ambient or thermal loop to meet to the building heating and cooling loads and maintain comfort. A semi-transient, reduced-order technical model and techno-economic model, called HEATNETS, has been developed at NREL that captures the flow of energy around a TEN. In this work, a comparison of the HEATNETS technical model and a well-known coding platform used for modeling geothermal networks, TRNSYS, has been completed for a proposed geothermal network as a verification and validation process. Hourly data provided from the TRNSYS simulation included building loads, pumping power, heat pump power, temperature entering and leaving the borehole field, and mass flow rates. The hourly borehole temperatures were used to create a linear regression model utilized in HEATNETS to estimate the borehole field heat exchange. The building loads and mass flow rates were direct inputs to HEATNETS while the pumping power, heat pump power, borehole temperatures, and coefficients of performance were all simulated and calculated by HEATNETS, allowing for direct comparison of the thermal energy transfer HEATNETS considers the full process from design inputs to economic outputs and can provide modeling options for high-level initial system design and operational optimization. This study focuses on a validation of HEATNETS using results from TRNSYS. HEATNETS is not intended to replace other modeling tools, but this work demonstrates, via a comparison with an industry standard code, that HEATNETS can be a unique, high-level and rapid modeling tool for estimating the performance of a full geothermal network system.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Understanding and control of Zener pinning via phase field and ensemble learning

Zener pinning refers to the dispersion of fine particles which influences grain size distribution via movement of grain boundaries in a polycrystalline material. Grain size distribution in polycrystals has a significant impact on their properties including physical, chemical, mechanical, and optical to name a few. We explore the use of Phase-field modeling and machine-learning techniques to understand and improve the control of grain size distribution via Zener pinning in polycrystalline materials. We develop a machine learning model that determines the relative importance of various parameters to exercise microstructure control via Zener pinning. Our workflow combines high-throughput phase-field simulations and machine learning to address the computational bottlenecks associated with large-scale simulations as well as identify features necessary for microstructure control in polycrystals. A random forest (RF) regression model was developed to predict grain sizes based on five Phase-field model parameters, achieving an average prediction error of 0.72 nm for the training data and 1.44 nm for the test data. The importance of the input parameters is analyzed using the SHapley Additive exPlanations (SHAP) approach which reveals that diffusivity, volume fraction, and particle diameter are the most important parameters in determining the final grain size. These findings will allow us to select the best second-phase particles, optimize grain size distributions and thus design microstructures with the desired properties. The developed method is a highly versatile and generalizable approach that can be used to assess the combined effects of individual features in the presence of multiple variables.

36 MATERIALS SCIENCE↗
NASA NTRS2011

Advanced Electrocardiography Can Identify Occult Cardiomyopathy in Doberman Pinschers

Recently, multiple advanced resting electrocardiographic (A-ECG) techniques have improved the diagnostic value of short-duration ECG in detection of dilated cardiomyopathy (DCM) in humans. This study investigated whether 12-lead A-ECG recordings could accurately identify the occult phase of DCM in dogs. Short-duration (3-5 min) high-fidelity 12-lead ECG recordings were obtained from 31 privately-owned, clinically healthy Doberman Pinschers (5.4 +/- 1.7 years, 11/20 males/females). Dogs were divided into 2 groups: 1) 19 healthy dogs with normal echocardiographic M-mode measurements: left ventricular internal diameter in diastole (LVIDd . 47mm) and in systole (LVIDs . 38mm) and normal 24-hour ECG recordings (<50 ventricular premature complexes, VPCs); and 2) 12 dogs with occult DCM: 11/12 dogs had increased M-mode measurements (LVIDd . 49mm and/or LVIDs . 40mm) and 5/11 dogs had also >100 VPCs/24h; 1/12 dogs had only abnormal 24-hour ECG recordings (>100 VPCs/24h). ECG recordings were evaluated via custom software programs to calculate multiple parameters of high-frequency (HF) QRS ECG, heart rate variability, QT variability, waveform complexity and 3-D ECG. Student's t-tests determined 19 ECG parameters that were significantly different (P < 0.05) between groups. Principal component factor analysis identified a 5-factor model with 81.4% explained variance. QRS dipolar and non-dipolar voltages, Cornell voltage criteria and QRS waveform residuum were increased significantly (P < 0.05), whereas mean HF QRS amplitude was decreased significantly (P < 0.05) in dogs with occult DCM. For the 5 selected parameters the prediction of occult DCM was performed using a binary logistic regression model with Chi-square tested significance (P < 0.01). ROC analyses showed that the five selected ECG parameters could identify occult ECG with sensitivity 89% and specificity 83%. Results suggest that 12-lead A-ECG might improve diagnostic value of short-duration ECG in earlier detection of canine DCM as five selected ECG parameters can with reasonable accuracy identify occult DCM in Doberman Pinschers. Future extensive clinical studies need to clarify if 12-lead A-ECG could be useful as an additional screening test for canine DCM.

Spiljak, M.↗
NASA NTRS2017

Daily Kilometer-Scale MODIS Satellite Maps of PM2.5 Describe Wintertime Episodes

The San Joaquin Valley (SJV) suffers from severe health-endangering episodes of PM2.5 aerosol loadings in wintertime; episodes last approximately 5 days and differ in geographical distribution and composition. PM2.5 stations are scattered; consequently the use of remote sensing to map variable regional patterns of these varying respirable aerosol concentrations is desirable. High-precision AOT retrievals can capture column particulate loading. However,PM2.5 mapping is challenging due to several reasons: particularly thin mixed layers (ML) and thus relatively low aerosol optical thickness (AOT) close to current measurement limits, variable and a typical composition of the aerosols, and complex surface bidirectional reflectance. However, the West does present some advantages in analysis. Air basins are isolated from long-distance transport, and experience predominant strong meteorological subsidence. Thus these Western basin regions have fewer problematic cases of overriding aerosol layers detached from the surface. To counter such local overriding, Chu et al. have described an approach for the Eastern US, and He et al have described a synoptic classification approach useful in Shanghai. The Bay Area Air Quality Management District (BAAQMD) expands our experience with the use of AOT, with lower PM2.5 and several isolated sub-basins. We have prepared daily maps of episodes in each region. We present also a sequence of increasingly detailed statistical models, AOT initially appears to contribute little information; however, inclusion of weather information reveals its utility. Lyapustin and Wang's MultiAngle Implementation of Atmospheric Correction (MAIAC) retrieval for AOT provided the most useful operational remote sensing information for these regions. It provides high (1-km) spatial resolution maps and a high percentage of availability. Empirical regression methods have found that random effects regression models (aka mixed effects models, ME) employing AOT provide good estimates of ground PM2.5 concentrations.Here, we attempt to extend these methods and evaluate the usefulness of AOT with greater physical analysis, based on DISCOVER-AQ4 experience.

Chatfield, Robert B.↗
DOE OSTI2025

Remote sensing of Pu in uranyl nitrate crystals using reflectance spectroscopy and chemometrics

Remote quantification of Pu(VI) (0–5 mol%) co-crystallized with U in uranyl nitrate hexahydrate (UNH) crystals was achieved in a glove box using reflectance spectroscopy coupled with chemometric modeling. Reflectance spectra were also acquired for Pu(IV) and Np(VI) (0–5 mol%) crystallized with UNH; revealing spectral features consistent with their solution-phase analogs. Principal component analysis revealed Pu(IV/VI) and Np(VI) concentrations as the primary source of variation in the data, informing the development of a supervised partial least squares regression model for Pu(VI). The resulting calibration demonstrated robust performance, with replicate root mean square errors near 10% and quantifiable limits near 0.2 mol% Pu(VI) relative to U. The Pu(VI) remained stable in the crystalline UNH matrix for at least one week with minimal reduction to Pu(IV). Notably, Pu(VI) and Np(VI) incorporation in UNH quenched U(VI) fluorescence while Pu(IV) did not. This study presents a noninvasive, spectroscopic approach for solid-state Pu quantification, with direct implications for material accountability and nuclear nonproliferation monitoring.

Sadergaski, Luke R. [Oak Ridge National Laboratory↗
NASA NTRS1992

The effect of differences in time to detection of circulating microbubbles on the risk of decompression sickness

Circulating microbubbles (CMB) are frequently detected prior to the appearance of symptoms of Decompression Sickness (DCS). It is difficult to analyze the effect of CMB on symptoms due to differences in the time to detection of CMB. This paper uses survival analysis models to evaluate the risk of symptoms in the presence of CMB. Methods: Information on 81 exposures to an altitude of 6,400 m (6.5 psi) for a period of three hours, with simulated extravehicular activities, was examined. The presence or absence of CMB was included as a time dependent covariate of the Cox proportional hazards regression model. Using this technique, the subgroup of exposures with CMB was analyzed further. Mean (S.D.) time in minutes to onset of CMB and symptoms were 125 (63) and 165 (33) respectively, following the three hours exposure. The risk of symptoms (17/81) increased 14 times in the presence of CMB, after controlling for variations in time to detection of CMB. Further, the risk was lower when time to detection of CMB was greater than 60 minutes (risk ratio = 0.96; 95 percent confidence intervals = 0.94 - 0.99 0.99 P less than 0.01) compared to CMB before 60 minutes at altitude. Conclusions: Survival analysis showed that individual risk of DCS changes significantly due to variations in time to detection of CMB. This information is important in evaluating the risk of DCS in the presence of CMB.

Kumar, K. V.↗
DOE OSTI2021

Using Machine Learning for Quantum Annealing Accuracy Prediction

Quantum annealers, such as the device built by D-Wave Systems, Inc., offer a way to compute solutions of NP-hard problems that can be expressed in Ising or quadratic unconstrained binary optimization (QUBO) form. Although such solutions are typically of very high quality, problem instances are usually not solved to optimality due to imperfections of the current generations quantum annealers. In this contribution, we aim to understand some of the factors contributing to the hardness of a problem instance, and to use machine learning models to predict the accuracy of the D-Wave 2000Q annealer for solving specific problems. We focus on the maximum clique problem, a classic NP-hard problem with important applications in network analysis, bioinformatics, and computational chemistry. By training a machine learning classification model on basic problem characteristics such as the number of edges in the graph, or annealing parameters, such as the D-Wave’s chain strength, we are able to rank certain features in the order of their contribution to the solution hardness, and present a simple decision tree which allows to predict whether a problem will be solvable to optimality with the D-Wave 2000Q. We extend these results by training a machine learning regression model that predicts the clique size found by D-Wave.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The Evolving Distribution of Relative Humidity Conditional Upon Daily Maximum Temperature in a Warming Climate

Abstract The impacts of heat waves in a warming climate depend not only on changing temperatures but also on changing humidity. Using 35 simulations from the Community Earth System Model Large Ensemble (CESM LENS), we investigate the long‐term evolution of the joint distribution of summer relative humidity (RH) and daily maximum temperature ( Tmax ) near four U.S. cities (New York City, Chicago, Phoenix, and New Orleans) under the high‐emissions Representative Concentration Pathway (RCP) 8.5. We estimate the conditional quantiles of RH given Tmax with quantile regression models, using functions of temperature for each city in July for three time periods (1990–2005, 2026–2035, and 2071–2080). Quality‐of‐fit diagnostics indicate that these models accurately estimate conditional quantiles for each city. As expected, each quantile of Tmax increases from 1990–2005 to 2071–2080, while mean RH decreases modestly. Conditional upon a fixed quantile of Tmax , the median and high quantiles of RH decrease, while those of the Heat Index (HI) and dew point both increase. This result suggests that, despite a modest decrease in median relative humidity, heat stress measured by metrics considering both humidity and temperature in a warming climate will increase faster than that measured by temperatures alone would indicate. For a fixed Tmax , the high quantiles of RH (and thus of HI and dew point) increase from 1990–2005 to 2071–2080 in all four cities. This result suggests that the heat stress of a day at a given Tmax will increase in a warming climate due to the increase of RH.

Yuan, Jiacan↗
DOE OSTI2023

Uncertainty-aware molecular dynamics from Bayesian active learning for phase transformations and thermal transport in SiC

Abstract Machine learning interatomic force fields are promising for combining high computational efficiency and accuracy in modeling quantum interactions and simulating atomistic dynamics. Active learning methods have been recently developed to train force fields efficiently and automatically. Among them, Bayesian active learning utilizes principled uncertainty quantification to make data acquisition decisions. In this work, we present a general Bayesian active learning workflow, where the force field is constructed from a sparse Gaussian process regression model based on atomic cluster expansion descriptors. To circumvent the high computational cost of the sparse Gaussian process uncertainty calculation, we formulate a high-performance approximate mapping of the uncertainty and demonstrate a speedup of several orders of magnitude. We demonstrate the autonomous active learning workflow by training a Bayesian force field model for silicon carbide (SiC) polymorphs in only a few days of computer time and show that pressure-induced phase transformations are accurately captured. The resulting model exhibits close agreement with both ab initio calculations and experimental measurements, and outperforms existing empirical models on vibrational and thermal properties. The active learning workflow readily generalizes to a wide range of material systems and accelerates their computational understanding.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Predicting Elastic Constants of Refractory Complex Concentrated Alloys Using Machine Learning Approach

Refractory complex concentrated alloys (RCCAs) have drawn increasing attention recently owing to their balanced mechanical properties, including excellent creep resistance, ductility, and oxidation resistance. The mechanical and thermal properties of RCCAs are directly linked with the elastic constants. However, it is time consuming and expensive to obtain the elastic constants of RCCAs with conventional trial-and-error experiments. The elastic constants of RCCAs are predicted using a combination of density functional theory simulation data and machine learning (ML) algorithms in this study. The elastic constants of several RCCAs are predicted using the random forest regressor, gradient boosting regressor (GBR), and XGBoost regression models. Based on performance metrics R-squared, mean average error and root mean square error, the GBR model was found to be most promising in predicting the elastic constant of RCCAs among the three ML models. Additionally, GBR model accuracy was verified using the other four RHEAs dataset which was never seen by the GBR model, and reasonable agreements between ML prediction and available results were found. The present findings show that the GBR model can be used to predict the elastic constant of new RHEAs more accurately without performing any expensive computational and experimental work.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quantifying neptunium oxidation states in nitric acid through spectroelectrochemistry and chemometrics

Controlled-potential in situ thin-layer spectropotentiometry was leveraged to generate visible/near-infrared (VIS/NIR) absorption spectral data sets for the development of chemometric models to quantify Np(III/IV/V/VI) oxidation states in HNO 3 . This technology would be valuable in laboratory studies and when monitoring process solutions to guide feed adjustments for radiochemical separations—the performance of which depends on oxidation state. This approach successfully isolated and stabilized Np species in pure (~99%) oxidation states without compromising solution optical properties. Multivariate curve resolution–alternating least squares models were evaluated to resolve spectral and component concentrations from a scan that sequentially produced Np(VI), Np(V), Np(IV), and Np(III) spectra with mixtures of two valences at a time. Although it provided a useful approximation, the method was not able to quantitively resolve each component likely because of rotational ambiguity. Additionally, partial least squares regression models were built from artificial and electrochemically generated VIS/NIR spectral training sets to study the effect of interionic interactions on spectral characteristics. Models built with true Bi-chemical mixtures of coexisting Np oxidation states and spectra generated from additive combinations of pure end points had similar prediction performance. This methodology can be used to directly quantify Np concentration and the ratio of Np oxidation states and other actinides in remote settings such as hot cells.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗
NASA NTRSDate not supplied

Effects of Dose Error and Sample Size on Sonic Boom Dose-Response Curves

NASA will soon be collecting noise-annoyance community survey data as the X-59 aircraft flies supersonically over several communities in the USA. Sparse measurements of the X-59 sonic thumps will be used together with physics-based simulations to estimate noise doses at survey participant locations. These dose estimates have associated error that affects the accuracy of modeled dose-response curves, which can result in misestimation of annoyance. The precision in dose-response curves is also a consideration in selecting the number of survey participants. To enable pretest studies of dose error and precision, simulated dose-response data were generated based on NASA’s Quiet Supersonic Flights 2018 test. The data included various degrees of dose error and sample size. Frequentist multilevel logistic regression models were fit to the true and perturbed dose-response data. Simple proportional relationships were identified between the model parameters and the perturbation standard deviation. The summary dose-response curves illustrate the impact on accuracy if dose error is not accounted for in the model. The precision in the dose-response curves is also shown as the number of participants and degree of participation is varied. Finally, sampling variability is illustrated by showing the dose-response curves for several replicates with random draws of participants and errors.

X-59↗