Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

UNCERTAINTY-AWARE DEEP LEARNING FRAMEWORK FOR FORECASTING COASTAL WATER LEVEL IN VIRGINIA BEACH

Coastal areas like Virginia Beach, USA, are increasingly vulnerable to flooding. To mitigate the impact of flooding, it is crucial for the City of Virginia Beach to have reliable 72-hour-ahead (3 days) forecasts of water levels at key gauge locations. To support this effort, several sensors have been installed throughout the city to monitor water levels and other environmental parameters such as wind speed, precipitation, and atmospheric pressure. Leveraging sensor data from one of these locations, we developed an uncertainty-aware deep learning model to forecast water levels. We employed deep quantile regression (DQR) to quantify variability in the predictions and examined the performance of three different model architectures. In addition to exclusively including historical data, we investigated the improvement wind forecasts provide to the accuracy of 72-hour-ahead water level predictions. The results show a twelvefold improvement in the flood forecast for a real flooding event.

Hasan, Mahmud [Thomas Jefferson National Accelerat↗
DOE OSTI2022

Peak Rain Rate Sensitivity to Observed Cloud Condensation Nuclei and Turbulence in Continental Warm Shallow Clouds During CACTI

Abstract Warm clouds strongly affect Earth's energy budget but remain imperfectly represented in climate models, partly due to the complexity and covariability of relevant processes influencing warm rain. This work presents a detailed analysis of different factors affecting rain rate peak intensity (RR) in continental warm clouds. Clouds were identified with vertically pointing radar and lidar observations and categorized via a temperature‐based cloud type classification algorithm from which warm clouds were isolated. Observations and retrievals of liquid water path (LWP), cloud condensation nuclei concentration (N CCN ), cloud depth, and cloud duration of more than 3,000 separate warm clouds sampled during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign are analyzed in this work. Multiple linear regression (MLR) and random forest (RF) models are applied to assess the relative impact of these variables on RR. Overall, RR tends to increase as cloud depth, LWP, and cloud duration increase, or N CCN decreases. Cloud depth affects RR the most while N CCN impacts it the least. When considering over 170 warm clouds observed at least 1 hr in which in‐cloud turbulence is retrieved, the effect of N CCN on RR remains most likely suppressive, but it is not significant at a 75% level for MLR and is highly uncertain for RF. The impact of in‐cloud turbulence depends on the moment and location it is sampled. Cloud base turbulence around the time of RR suppresses RR, while cloud top turbulence effects are inconclusive. Possible difficulties in isolating robust CCN and turbulence effects on RR are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A neural network for beam background decomposition in Belle II at SuperKEKB

Here, we describe a neural network for predicting the background hit rate in the Belle II detector produced by the SuperKEKB electron-positron collider. The neural network, BGNet, learns to predict the individual contributions of different physical background sources, such as beam-gas scattering or continuous top-up injections into the collider, to Belle II sub-detector rates. The samples for learning are archived 1 Hz time series of diagnostic variables from the SuperKEKB collider subsystems and measured hit rates of Belle II used as regression targets. We test the learned model by predicting detector hit rates on archived data from different run periods not used during training. We show that a feature attribution method can help interpret the source of changes in the background level over time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Modeling ethanol/water adsorption in all-silica zeolites using the real adsorbed solution theory

A comprehensive set of single-component and binary isotherms were collected for ethanol/water adsorption into the siliceous forms of 185 known zeolites using grand-canonical Monte Carlo simulations. Using these data, a systematic analysis of ideal/real adsorbed-solution theory (IAST/RAST) was conducted and activity coefficients were derived for ethanol/water mixtures adsorbed in different zeolites based on RAST. It was found that activity coefficients of ethanol are close to unity while activity coefficients of water are larger in most zeolites, indicating a positive excess free energy of the mixture. This observation can be attributed to water/ethanol interactions being less favorable than water/water interactions in the single-component adsorption of water at comparable loadings. The deviation from ideal behavior can be highly structure-dependent but no clear correlation with pore diameters was identified. Furthermore, our analysis also demonstrates the following: (1) accurate unary isotherms in the low-loading regime are critical for obtaining physically sensible activity coefficients; (2) the global regression scheme to solve for activity model parameters performs better than fitting activity models to activity coefficients calculated locally at each binary state point; and (3) including the dependence on adsorption potential offers only a minor benefit for describing binary adsorption at the lowest fugacities. Finally, the Margules activity model was found incapable of capturing the non-ideal adsorption behavior over the entire range of fugacities and compositions in all zeolites, but for conditions typical of solution-phase adsorption, RAST predictions using zeolite-specific or even bulk Margules parameters provide an improved description compared to IAST.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Uncertain characterization of reservoir fluids due to brittleness of equation of state regression

Equations of state (EoS) play a central role in modeling the phase equilibrium of fluid mixtures. Their parameterization involves fitting a model to experimental data, i.e., solving a nonlinear, non-convex, multivariate optimization problem. The latter requires one to select design variables, domains of definition for each variable, and weights assigned to individual measurements. We demonstrate that subjective choices of an optimization algorithm and an initial guess also impact the regression process. Consequently, EoS predictions are fundamentally uncertain even after the EoS tuning to a limited set of experimental data points. We demonstrate this observation for two hydrocarbon reservoir fluids, in which five properties of the heaviest carbon fraction are treated as design variables. While all the optimization algorithms and initial guesses match experimental data for the gas and liquid properties, the resulting EoS parameterizations lead to dramatically different predictions of the fluid’s thermophysical behavior in the unsampled pressure and temperature regions. In conclusion, we propose the probabilistic treatment of design variables to quantify the predictive uncertainty of the resulting fluid models.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Circuit Modelling of the Mechanical-Motion-Rectifier for Electrical Simulation of Ocean Wave Power Take-off

As is the case with several other mechanical power takeoffs (PTOs), the mechanical-motion-rectifier (MMR) based PTO consists of components such as one-way clutches, gears, a ball screw, mechanical couplings, and a generator. Equivalent circuit models have been created in this paper to describe the dry frictions, viscous damping, and mechanical compliances in these components, so the non-ideal efficiency and nonlinear force of the PTO can be predicted in electrical simulations by integrating these sub-circuit models. The circuit model is simplified, and its parameters are categorized as dc and ac unknowns. The dc and ac tests on the PTO are performed sequentially to extract two sets of parameters through linear regression or nonlinear curve fitting. Then, the model is validated through its prediction capability over 25 test conditions on input forces, output voltages, and efficiencies, with correlation coefficients of 0.9, 0.98, and 0.981, respectively.

42 ENGINEERING↗
DOE OSTI2020

Clinically applicable 53-Gene prognostic assay predicts chemotherapy benefit in gastric cancer: A multicenter study

BACKGROUND:We previously established a 53-gene prognostic signature for overall survival (OS) of gastric cancer patients. This retrospective multi-center study aimed to develop a clinically applicable gene expression detection assay and to investigate the prognostic value of this signature. METHODS:A TCGA gastric adenocarcinoma cohort (TCGA-STAD) was used for comparing 53-gene signature with other gene signatures. A high-throughput mRNA hybridization gene expression assay was developed to quantify the expression of 53-genes in formalin-fixed paraffin-embedded tissues of 540 patients enrolled from three hospitals. 180 patents were randomly selected from two hospitals to build a prognostic prediction model based on the 53-gene signature using leave-p-out (one-third out) cross-validation method together with Cox regression and Kaplan-Meier analysis, and the model was assessed on three validation cohorts. FINDINGS:In the evaluation phase, studies based on TCGA-STAD showed that the 53-gene signature was significantly superior to other three prognostic signatures and was independent of TCGA molecular subtypes and clinical factors. For clinical validation and utility, the prognostic scores were generated using the newly developed assay, which was reliable and sensitive, in 100 sampling training sets and were significantly associated with OS in 100 sampling validation sets. The scores were significantly associated with OS in three independent and combined validation cohorts, and in patients with stages II and III/IV. The multivariate Cox regression demonstrated that the prognostic power of the score was independent of clinical factors, consistent with those findings in the TCGA dataset. Finally, patients with good prognostic scores exhibited significantly a better 5-year OS rate from adjuvant FOLFOX chemotherapy after surgery than from other chemotherapies. INTERPRETATION:The 53-gene prognostic score system is clinically applicable for predicting the OS of patients independent of clinical factors in gastric cancers, which could also be a promising predictive biomarker for FOLFOX regimen. FUNDING:Chinese National Science and Technology, National Natural Science Foundation and Natural Science Foundation of Jiangsu Province.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Detection Limits of Low-mass, Long-period Exoplanets Using Gaussian Processes Applied to HARPS-N Solar Radial Velocities

Radial velocity (RV) searches for Earth-mass exoplanets in the habitable zone around Sun-like stars are limited by the effects of stellar variability on the host star. In particular, suppression of convective blueshift and brightness inhomogeneities due to photospheric faculae/plage and starspots are the dominant contribution to the variability of such stellar RVs. Gaussian process (GP) regression is a powerful tool for statistically modeling these quasi-periodic variations. We investigate the limits of this technique using 800 days of RVs from the solar telescope on the High Accuracy Radial velocity Planet Searcher for the Northern hemisphere (HARPS-N) spectrograph. These data provide a well-sampled time series of stellar RV variations. Into this data set, we inject Keplerian signals with periods between 100 and 500 days and amplitudes between 0.6 and 2.4 m s{sup −1}. We use GP regression to fit the resulting RVs and determine the statistical significance of recovered periods and amplitudes. We then generate synthetic RVs with the same covariance properties as the solar data to determine a lower bound on the observational baseline necessary to detect low-mass planets in Venus-like orbits around a Sun-like star. Our simulations show that discovering planets with a larger mass (∼0.5 m s{sup −1}) using current-generation spectrographs and GP regression will require more than 12 yr of densely sampled RV observations. Furthermore, even with a perfect model of stellar variability, discovering a true exo-Venus (∼0.1 m s{sup −1}) with current instruments would take over 15 yr. Therefore, next-generation spectrographs and better models of stellar variability are required for detection of such planets.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Field-scale dynamics of planting dates in the US Corn Belt from 2000 to 2020

Crop planting dates are a dynamic feature of agricultural systems that respond to short- and long-term climate signals, crop and cultivar selection, and technology changes. Planting date records are essential for yield gap analyses, accurate crop modeling, and tracking farmer adaptations to weather and climate change. Although planting dates have high variation at local scales due to heterogeneity in farm resources and decision-making, available long-term data on planting dates is largely restricted to aggregated regional statistics or, at best, satellite-derived datasets with limited spatiotemporal extent and at resolutions unable to distinguish individual fields (> 250 m). Here, we generated retrospective annual field-scale (30 m) planting date maps for both maize and soybeans spanning 2000-2020 across a 12 state region in the United States Corn Belt based on Landsat satellite data and a large ground sample of over 28,000 maize and soybean fields. Using training data from 2015-2020 for model selection, we found that planting date predictions improved with harmonic regression of Landsat data and additional annual weather covariates. The preferred random forests model approximately doubled performance compared to a null model based on state median planting dates, capturing 47% of field-level variation for maize (mean absolute error, MAE = 7.4 days) and 44% for soybeans (MAE = 7.5 days) against held-out ground truth test data for 2008-2014. We also evaluated the full 2000-2020 dataset with state agricultural statistics, finding strong agreement with median planting dates for maize (R 2 = 0.76, MAE = 4.4 days) and slightly lower agreement for soybeans (R 2 = 0.65, MAE = 5.4 days) when aggregated to the state level. We then used this new dataset to analyze environmental determinants of planting dates at a finer-scale than previously possible, controlling for unobserved variation at the sub-state district level. We found that during 2000-2020, each standard deviation increase in rainfall delayed planting by ~ 2.5 days, and fields with higher soil productivity ratings tended to be planted earlier. We did not find meaningful trends over the last two decades in planting dates for maize or soybeans, in contrast to trends towards earlier planting dates late last century and predicted for this period in climate adaptation studies. We hypothesize increases in early season rainfall may have inhibited these shifts towards earlier planting. Remotely sensed planting dates will be a useful tool for yield gap analyses, crop simulation modeling, and ongoing assessment of climate adaptation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Construction of Women’s All-Around Speed Skating Event Performance Prediction Model and Competition Strategy Analysis Based on Machine Learning Algorithms

Introduction Accurately predicting the competitive performance of elite athletes is an essential prerequisite for formulating competitive strategies. Women’s all-around speed skating event consists of four individual subevents, and the competition system is complex and challenging to make accurate predictions on their performance. Objective The present study aims to explore the feasibility and effectiveness of machine learning algorithms for predicting the performance of women’s all-around speed skating event and provide effective training and competition strategies. Methods The data, consisting of 16 seasons of world-class women’s all-around speed skating competition results, used in the present study came from the International Skating Union (ISU). According to the competition rules, distinct features are filtered using lasso regression, and a 5,000 m race model and a medal model are built using a fivefold cross-validation method. Results The results showed that the support vector machine model was the most stable among the 5,000 m race and the medal models, with the highest AUC (0.86, 0.81, respectively). Furthermore, 3,000 m points are the main characteristic factors that decide whether an athlete can qualify for the final. The 11th lap of the 5,000 m, the second lap of the 500 m, and the fourth lap of the 1,500 m are the main characteristic factors that affect the athlete’s ability to win medals. Conclusion Compared with logistic regression, random forest, K-nearest neighbor, naive Bayes, neural network, support vector machine is a more viable algorithm to establish the performance prediction model of women’s all-around speed skating event; excellent performance in the 3,000 m event can facilitate athletes to advance to the final, and athletes with outstanding performance in the 500 m event are more likely competitive for medals.

Liu, Meng↗
DOE OSTI2026

Identifying Differential Equations in Fourier Domain (FourierIdent)

We investigate identifying differential equations in the frequency domain. Fourier analysis is an important tool in theoretical analysis and numerical solvers of differential equations, yet there is limited work in exploring this connection in the identification of differential equations. This paper aims to identify the underlying differential equation in the frequency domain, from a given single realization of the differential equation perturbed by noise. Such setting imposes difficulties which are different from other identification methods where computation is carried out in the physical domain. We propose several ways to mitigate the challenges arising from noise in data and large differences in the magnitudes of frequency responses. The main takeaways are that identifying differential equations solely in the frequency domain is challenging, the method we propose is based on a form of domain partitions in the frequency domain, and this method shows benefits for complex data even with high level of noise. We introduce a Fourier feature denoising, and define the meaningful data region and the core regions of features to reduce the effect of noise in the frequency domain and to enhance the accuracy in coefficient identification. The proposed method is tested on various differential equations with linear, nonlinear, and high-order derivative feature terms, and shows advantages on complex data with many frequency modes, even under high level of noise.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Hedonic Price Estimates of Lake Water Quality: Valued Attribute, Instrumental Variables, and Ecological-Economic Benefits

We estimate the effect of lake water quality on residential housing prices using cross-sectional data on water clarity from 113 lakes across the United States. An instrumental-variables approach is developed to address potential endogeneity bias in the water-clarity variable. Three lake-based physical variables serve as instrumental variables: total nitrogen concentration in lake water, total phosphorus concentration in lake water, and water temperature near the lake surface. The econometric results include three methodological findings: the instruments are valid and strong; the ordinary-least-squares estimate of the coefficient on the water-clarity variable is unbiased; and water clarity is the attribute of water quality valued in the housing market. The estimated water-clarity effect shows that a one-tenth of a meter change in water clarity leads to a one-percent change in housing price, or an elasticity of 0.20 at mean clarity. Coupling this effect with estimates of an ecological production function, a lake-specific benefit index is developed that shows the effect on housing values of bringing lakes into compliance with the US Environmental Protection Agency's regional recommendations for phosphorous concentration in lake waters.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Development of real-time density feedback control on MAST-U in L-mode

In this paper we report on the development and demonstration of density feedback control for MAST-U. Sinusoidal perturbations are used to measure the frequency response from a deuterium gas valve (actuator) to line-integrated core electron density measured by the interferometer (sensor). In the frequency range relevant for control design, only two system-identification experiments were needed to regress a first-order dynamic model. This control-oriented model informs the offline design of a proportional integral controller with the established loop-shaping controller design method. After offline verification of the controller implementation, control is demonstrated by experimentally tracking a staircase reference for the line-integrated electron density. This paper demonstrates the efficiency of controller design using system-identification and loop-shaping, providing reliable density control for MAST-U.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Analysis of biokinetic parameters reveals patterns in mercury accumulation across aquatic species

Mercury (Hg) is a potent neurotoxicant and poses a risk to human health through the ingestion of Hg-contaminated fish. Mercury, especially in its organic form methylmercury (MeHg), biomagnifies up food chains such that even small aqueous concentrations of Hg can result in significant concentrations of total Hg in fish. Understanding the ecological and human health risks associated with Hg and MeHg exposure requires an understanding of the factors that affect its bioaccumulation in aquatic species. We compiled estimates of three biokinetic parameters: uptake rate (k u ), assimilation efficiency (AE), and efflux rate (k e ). These parameters describe contaminant uptake from aqueous (k u ) and dietary (AE) exposure and the rate of excretion (k e ). We found parameter values for 38 and 34 different species of fish and aquatic invertebrates, respectively, and collected 502 parameter values in total. Here, we used a machine learning technique to establish the relationships between experimental and physiological variables and these parameter values. We found differences in which variables were associated with biokinetic parameter values for fish and aquatic invertebrates. The form of Hg was the most impactful variable, influencing values of all parameters except k u for invertebrates, for which aqueous exposure time was the only significant predicator variable. The parameter k e were the only values significantly influenced by more than one variable, with water type (freshwater, brackish, or marine), organism weight, and form of Hg significantly impacting parameter values for fish and/or invertebrates. To our knowledge, this study represents the most extensive review of biokinetic parameters of Hg and MeHg accumulation in aquatic organisms. Environmental parameters found to significantly impact Hg and MeHg bioaccumulation in past studies were not identified as important in our analyses across aquatic ecosystems and species. Our dataset and analysis reveal novel patterns that may help us better understand and manage Hg bioaccumulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Discovery of Pyridopyrimidinones that Selectively Inhibit the H1047R PI3Kα Mutant Protein

The H1047R mutation of PIK3CA is highly prevalent in breast cancers and other solid tumors. Selectively targeting PI3Kα H1047R over PI3Kα WT is crucial due to the role that PI3Kα WT plays in normal cellular processes, including glucose homeostasis. Currently, only one PI3Kα H1047R -selective inhibitor has progressed into clinical trials, while three pan mutant (H1047R, H1047L, H1047Y, E542K, and E545K) selective PI3Kα inhibitors have also reached the clinical stage. Herein, we report the design and discovery of a series of pyridopyrimidinones that inhibit PI3Kα H1047R with high selectivity over PI3Kα WT , resulting in the discovery of compound 17. When dosed in the HCC1954 tumor model in mice, 17 provided tumor regressions and a clear pharmacodynamic response. X-ray cocrystal structures from several PI3Kα inhibitors were obtained, revealing three distinct binding modes within PI3Kα H1047R including a previously reported cryptic pocket in the C-terminus of the kinase domain wherein we observe a ligand-induced interaction with Arg1047.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Rapid quantitative analysis of trace elements in plutonium alloys using a handheld laser-induced breakdown spectroscopy (LIBS) device coupled with chemometrics and machine learning

Here, we present the first reported quantification of trace elements in plutonium via a portable laser-induced breakdown spectroscopy (LIBS) device and demonstrate the use of chemometric analysis to enhance the handheld device's sensitivity and precision. Quantification of trace elements such as iron and nickel in plutonium metal via LIBS is a challenging problem due to the complex nature of the plutonium optical emission spectra. While rapid analysis of plutonium alloys has been demonstrated using portable LIBS devices, such as the SciAps Z300, their detection limits for trace elements are severely constrained by their achievable pulse power and length, light collection optics, and detectors. In this paper, analytical methods are evaluated as a means to circumvent the detection constraints. Three chemometric methods often used in analytical spectroscopy are evaluated; principal component regression, partial least-squares regression, and artificial neural networks. These models are evaluated based on goodness-of-fit metrics, root mean-squared error, and their achievable limits of detection (LoDs). Partial least squares proved superior for determining content of iron and nickel in plutonium metal, yielding LoDs of 15 and 20 ppm, respectively. These results of identifying the undesirable trace elements in plutonium components are critical for applications such as fabricating radioisotope thermoelectric generators or nuclear fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗