Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Predicting the evolution of biomass bulk density through feedstock preprocessing: Discrete element modeling, regression analysis, and pilot-scale validation

Bulk density is an important material property of biomass feedstocks, influencing handling, storage, transport costs, and conversion efficiency. In this study, predictive regression models for loose and tapped bulk densities of Alamo and Cave-in-Rock switchgrass are developed using a comprehensive dataset generated via calibrated bonded-sphere discrete element method (DEM) simulations. Here, a key contribution of this study is the use of a DEM-based approach, which correlates density with moisture content and particle size distribution parameters and enables analysis across a continuous particle size range, overcoming limitations of purely experimental data. For comparison, regression models are also developed using only experimental data from pilot-scale runs at the Biomass Feedstock National User Facility at Idaho National Laboratory. Validation against pilot-scale data showed reasonable prediction accuracy for both model types, particularly for smaller particle sizes (post-secondary grinding). While the experimental model showed slightly better performance matching the validation data in some cases, the DEM-based model benefits from a much larger dataset, reduced predictor multicollinearity, and continuous parameter coverage, highlighting the utility of validated simulation models for developing robust predictive tools for biomass preprocessing applications.

09 - BIOMASS FUELS↗

A nonparametric software reliability growth model

Miller and Sofer have presented a nonparametric method for estimating the failure rate of a software program. The method is based on the complete monotonicity property of the failure rate function, and uses a regression approach to obtain estimates of the current software failure rate. This completely monotone software model is extended. It is shown how it can also provide long-range predictions of future reliability growth. Preliminary testing indicates that the method is competitive with parametric approaches, while being more robust.

Miller, Douglas R.↗

NASA Experimental Program to Stimulate Competitive Research: South Carolina

The use of an appropriate relationship model is critical for reliable prediction of future urban growth. Identification of proper variables and mathematic functions and determination of the weights or coefficients are the key tasks for building such a model. Although the conventional logistic regression model is appropriate for handing land use problems, it appears insufficient to address the issue of interdependency of the predictor variables. This study used an alternative approach to simulation and modeling urban growth using artificial neural networks. It developed an operational neural network model trained using a robust backpropagation method. The model was applied in the Myrtle Beach region of South Carolina, and tested with both global datasets and areal datasets to examine the strength of both regional models and areal models. The results indicate that the neural network model not only has many theoretic advantages over other conventional mathematic models in representing the complex urban systems, but also is practically superior to the logistic model in its capability to predict urban growth with better - accuracy and less variation. The neural network model is particularly effective in terms of successfully identifying urban patterns in the rural areas where the logistic model often falls short. It was also found from the area-based tests that there are significant intra-regional differentiations in urban growth with different rules and rates. This suggests that the global modeling approach, or one model for the entire region, may not be adequate for simulation of a urban growth at the regional scale. Future research should develop methods for identification and subdivision of these areas and use a set of area-based models to address the issues of multi-centered, intra- regionally differentiated urban growth.

Sutton, Michael A.↗

Evidence of Progress - Measurement of Impacts of Australia's S&L Program from 1990-2010

Australia first put categorical energy efficiency labels on residential appliances in the mid-1980s, and the first Minimum Energy Performance Standards (MEPS) for refrigerators was implemented in 1999. Updated in 2005, these MEPS were aligned with US 2001 levels. Considered together, these actions set Australia apart as having one of the most aggressive appliance efficiency programs in the world. For these reasons, together with good data on product sales over time, Australia represents a potentially fruitful case study for understanding the dynamics energy efficiency standards and labeling (EES&L) programs impacts on appliance markets. This analysis attempts to distinguish between the impacts of labeling alone as opposed to MEPS, and to probe the time-dependency of such impacts. Fortunately, in the Australian case, detailed market sales data and a comprehensive registration system provides a solid basis for the empirical evaluation of these questions. This paper analyzes Australian refrigerator efficiency data covering the years 1993-2009. Sales data was purchased from a commercial market research organization (in this case, the GfK Group) and includes sales and average price in each year for each appliance model; this can be used to understand broader trends by product class and star rating category, even where data is aggregated. Statistical regression analysis is used to model market introduction and adoption of high efficiency refrigerators according to logistic adoption model formalism, and parameterizes the way in which the Australian programs accelerated adoption of high-efficiency products and phased out others. Through this analysis, the paper presents a detailed, robust and quantitative picture of the impacts of EES&L in the Australian case, but also demonstrates a methodology of the evaluation of program impacts that could form the basis of an international evaluation framework for similar programs in other countries.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Evidence of progress. Measurement of impacts of Australia's S and L program from 1990-2010

Australia first put categorical energy efficiency labels on residential appliances in the mid-1980s, and the first Minimum Energy Performance Standards (MEPS) for refrigerators was implemented in 1999. Updated in 2005, these MEPS were aligned with US 2001 levels. Considered together, these actions set Australia apart as having one of the most aggressive appliance efficiency programs in the world. For these reasons, together with good data on product sales over time, Australia represents a potentially fruitful case study for understanding the dynamics energy efficiency standards and labeling (EES and L) programs impacts on appliance markets. This analysis attempts to distinguish between the impacts of labeling alone as opposed to MEPS, and to probe the time-dependency of such impacts. Fortunately, in the Australian case, detailed market sales data and a comprehensive registration system provides a solid basis for the empirical evaluation of these questions. This paper analyzes Australian refrigerator efficiency data covering the years 1993-2009. Sales data was purchased from a commercial market research organization (in this case, the GfK Group) and includes sales and average price in each year for each appliance model – this can be used to understand broader trends by product class and star rating category, even where data is aggregated. Statistical regression analysis is used to model market introduction and adoption of high efficiency refrigerators according to logistic adoption model formalism, and parameterizes the way in which the Australian programs accelerated adoption of high-efficiency products and phased out others. Through this analysis, the paper presents a detailed, robust and quantitative picture of the impacts of EES and L in the Australian case, but also demonstrates a methodology of the evaluation of program impacts that could form the basis of an international evaluation framework for similar programs in other countries.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Robust and Efficient Deep Learning Method for Dynamical Mass Measurements of Galaxy Clusters

We demonstrate the ability of convolutional neural networks (CNNs) to mitigate systematics in the virial scaling relation and produce dynamical mass estimates of galaxy clusters with remarkably low bias and scatter. We present two models, CNN 1D and CNN 2D , which leverage this deep learning tool to infer cluster masses from distributions of member galaxy dynamics. Our first model, CNN 1D , infers cluster mass directly from the distribution of member galaxy line-of-sight velocities. Our second model, CNN 2D , extends the input space ofCNN 1D to learn on the joint distribution of galaxy line-of-sight velocities and projected radial distances. We train each model as a regression over cluster mass using a labeled catalog of realistic mock cluster observations generated from the MultiDark simulation and UniverseMachine catalog. We then evaluate the performance of each model on an independent set of mock observations selected from the same simulated catalog. The CNN models produce cluster mass predictions with lognormal residuals of scatter as low as 0.132 dex, greater than a factor of 2 improvement over the classical M–σ power-law estimator. Furthermore, the CNN model reduces prediction scatter relative to similar machinelearning approaches by up to 17% while executing in drastically shorter training and evaluation times (by a factor of 30) and producing considerably more robust mass predictions (improving prediction stability under variations in galaxy sampling rate by 30%).

79 ASTRONOMY AND ASTROPHYSICS↗

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

Prediction of electric and magnetic fields from spectral data using machine learning algorithms for Doppler-free saturation spectroscopy diagnostics

The prediction of electric and magnetic field amplitudes from atomic spectral data is critical for plasma control in fusion devices such as tokamaks. Conventional approaches that rely on physics-based models are computationally expensive and unsuitable for real-time applications. In this work, we develop and benchmark three machine learning algorithms—simulation-based inference (SBI), fully connected neural networks (FCNN), and histogram-based gradient boosting regression (GBR-Hist)—to infer field intensities directly from Doppler-free saturation spectroscopy (DFSS) spectra. Synthetic datasets of spectra were generated using the EZSSS code and evaluated both with and without added Poisson noise to mimic experimental conditions. We find that SBI achieves the highest accuracy and robustness, FCNN provides a strong balance of accuracy and computational efficiency for real-time applications, and GBR-Hist offers the fastest inference but is more sensitive to noise. Furthermore, these results demonstrate the potential of machine learning to accelerate DFSS analysis and enhance its utility for plasma diagnostics and control.

Doppler-free saturation spectroscopy↗

Strategies and Software for Machine Learning Accelerated Discovery in Transition Metal Chemistry

Machine learning the electronic structure of open shell transition metal complexes presents unique challenges, including robust and automated data set generation. In this report we introduce tools that simplify data acquisition from density functional theory (DFT) and validation of trained machine learning models using the molSimplify automatic design (mAD) workflow. We demonstrate this workflow by training and comparing the performance of LASSO, kernel ridge regression (KRR), and artificial neural network (ANN) models using heuristic, topological revised autocorrelation (RAC) descriptors we have recently introduced for machine learning inorganic chemistry. On a series of open shell transition metal complexes, we evaluate set aside test errors of these models for predicting the HOMO level and HOMO–LUMO gap. The best performing models are ANNs, which show 0.15 and 0.25 eV test set mean absolute errors on the HOMO level and HOMO–LUMO gap, respectively. Poor performing KRR models using the full 153-feature RAC set are improved to nearly the same performance as the ANNs when trained on down-selected subsets of 20–30 features. Analysis of the essential descriptors for HOMO level and HOMO–LUMO gap prediction as well as comparison to subsets previously obtained for other properties reveal the paramount importance of nonlocal, steric properties in determining frontier molecular orbital energetics. We demonstrate our model performance on diverse complexes and in the discovery of molecules with target HOMO–LUMO gaps from a large 15,000 molecule design space in minutes rather than days that full DFT evaluation would require.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Low-Scaling Algorithm for Nudged Elastic Band Calculations Using a Surrogate Machine Learning Model

We present the incorporation of a surrogate Gaussian process regression (GPR) atomistic model to greatly accelerate the rate of convergence of classical nudged elastic band (NEB) calculations. In our surrogate model approach, the cost of converging the elastic band no longer scales with the number of moving images on the path. This provides a far more efficient and robust transition state search. In contrast to a conventional NEB calculation, the algorithm presented here eliminates any need for manipulating the number of images to obtain a converged result. This is achieved by inventing a new convergence criteria that exploits the probabilistic nature of the GPR to use uncertainty estimates of all images in combination with the force in the saddle point in the target model potential. In conclusion, our method is an order of magnitude faster in terms of function evaluations than the conventional NEB method with no accuracy loss for the converged energy barrier values.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Observations of Coastal Wind Momentum Flux: Dependence on Fetch and Waves with Comparisons to COARE

Here, using observations from the Martha’s Vineyard Coastal Observatory, this paper investigates how momentum flux in the marine atmospheric surface layer over the coastal ocean varies with fetch, wave age, and wave slope and assesses the performance of the COARE 3.5 bulk parameterization. Long-fetch (at least 300 km) and short-fetch (3–6 km away from land) conditions have very similar momentum flux, with the latter being just 15% higher. The COARE 3.5 wind speed–dependent formulation closely matches the observations. The sea state dependence of wave age and wave slope is analyzed by considering both peak frequency and mean frequency in a wave spectrum. The slope of regression lines between normalized roughness and wave age is sensitive to wind speed ranges and the scatter of momentum flux, potentially explaining why earlier studies did not find a universal formula to characterize the wave dependence. Although the observed momentum flux exhibits an obvious dependence on wave age, a robust quadratic fit between momentum flux and the 10-m neutral wind speed exists only for young waves. For the short-fetch conditions, the momentum flux does not increase as wave slope increases. This may be because waves generated by local wind are still weak and swell that propagates from other areas dominates the wave spectra. In other words, the wave slope computed by considering the spectra does not properly reflect the local wind–wave interaction.

Air-sea interaction↗

Application of a convolutional neural network in permeability prediction: A case study in the Jacksonburg-Stringtown oil field, West Virginia, USA

Permeability is a critical parameter for understanding subsurface fluid flow behavior, managing reservoirs, enhancing hydrocarbon recovery, and sequestering carbon dioxide. In general, permeability is measured in the laboratory based on subsurface core samples, calculated from well logs or estimated from well tests. However, laboratory measurements and well tests are expensive, time-consuming, and usually limited to a few core samples or wells in a hydrocarbon field or carbon storage site. Machine-learning techniques are good options for generating a rapid, robust, and cost-effective permeability prediction model because of their strengths to recognize the potential interrelationships between input and output variables. Convolutional neural networks (CNN), as a good pattern recognition algorithm, are widely used in image processing, natural language processing, and speech recognition, but are rarely used with regression problems and even less often in reservoir characterization. We have developed a CNN regression model to estimate the permeability in the Jacksonburg-Stringtown oil field, West Virginia, which is a potential carbon storage site and enhanced oil recovery operations field. We also evaluate the concept of the geologic feature image, which is converted from geophysical well logs. Five variables, including two commonly available conventional well logs (the gamma rays [GRs] and bulk density) and three well-log-derived variables (the slopes of the GR and bulk density curves, and shale content), are used to generate a geologic feature image. The CNN treats the geologic feature image as the input and the permeability as the desired output. In addition, the permeability predicted using traditional backpropagation artificial neural networks, which are optimized by genetic algorithms and particle swarm optimization, is compared with the permeability estimated using our CNN. Our results indicate that the CNN regression model provides more accurate permeability predictions than the traditional neural network.

Geochemistry & Geophysics↗

Performance of a dynamic single bubbler in single and two-phase immiscible liquids

Ensuring nonproliferation and safeguards of special nuclear materials (SNM) is a critical aspect of advancing the nuclear fuel cycle. Traditional bubbler systems used to estimate liquid levels and densities in nuclear recycling processes have limitations, particularly in harsh environments where dip-tube corrosion and buildup necessitate frequent maintenance and recalibration. This study explores the Dynamic Single Bubbler (DSB) method, which utilizes a single dip-tube attached to a linear actuator to estimate liquid properties dynamically. This approach is extended to estimate liquid-liquid interfaces in immiscible liquids and employs a linear regression method to reduce uncertainties and improve accuracy. The DSB method achieved density estimate uncertainties of less than 0.5% and surface level estimate uncertainties typically under 0.5%, across various fluids including water, acetone, methanol, mineral oil, glycerol, and aqueous salt solutions. Results indicate that the DSB method provides accurate and robust estimates of liquid density and surface levels with minimal maintenance and without the need for calibration. Additionally, the method's applicability to immiscible liquids and various dip-tube geometries was demonstrated, showing promise for widespread use in nuclear and other industrial applications.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

Estimation of multidimensional precipitation parameters by areal estimates of oceanic rainfall

The parameters of the multidimensional precipitation model proposed by Waymire et al. (1984) are estimated using the areal-averaged radar measurements of precipitation of the Global Atlantic Tropical Experiment (GATE) data set. The procedure followed was the fitting of the first- and second-order moments at different aggregation scales by nonlinear regression techniques. The numerical estimates of the parameters using different subsets of GATE information were reasonably stable, i.e., they were not affected by changes of the area-averaging size, temporal length of the records, and percentage of areal coverage of rainfall. This suggests that the estimation procedure is relatively robust and suitable to estimate the parameters of the multidimensional model in areas of sparse density of rain gages. The use of the space-time spectrum of rainfall to help in the determination of sampling errors due to intermittent visits of future space-borne low-altitude sensors of precipitation is also discussed.

Valdes, J. B.↗

Accurate Accumulation of Dose for Improved Understanding of Radiation Effects in Normal Tissue

The actual distribution of radiation dose accumulated in normal tissues over the complete course of radiation therapy is, in general, poorly quantified. Differences in the patient anatomy between planning and treatment can occur gradually (e.g., tumor regression, resolution of edema) or relatively rapidly (e.g., bladder filling, breathing motion) and these undermine the accuracy of the planned dose distribution. Current efforts to maximize the therapeutic ratio require models that relate the true accumulated dose to clinical outcome. The needed accuracy can only be achieved through the development of robust methods that track the accumulation of dose within the various tissues in the body. Specific needs include the development of segmentation methods, tissue-mapping algorithms, uncertainty estimation, optimal schedules for image-based monitoring, and the development of informatics tools to support subsequent analysis. These developments will not only improve radiation outcomes modeling but will address the technical demands of the adaptive radiotherapy paradigm. The next 5 years need to see academia and industry bring these tools into the hands of the clinician and the clinical scientist.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Fundamental Insights into Cathode Stability: Linking Compositional Tuning and Local Coordination in Complex Metal Oxides under Aqueous Transformations

Compositional tuning of complex metal oxides in Li-ion battery materials influences their performance as well as their end-of-life behavior, in particular, the tendency to release toxic metal cations in aqueous solution. We modeled ternary variants of a parent LiCoO 2 delafossite structure by varying the metal identity and relative amounts. This yielded ten model formulations of Li(A 4/6 B 1/6 C 1/6 )O 2 , where the material is enriched with the A metal and doped with B and C, with Ni, Mn, Co, Fe, Al, V, and Ti as constituent metals. To assess their stability in aqueous conditions, metal release energetics were calculated using a combination of Density Functional Theory calculations and thermodynamics. Metal release in ternary oxides is dictated by subtle variations in the coordination environment of the leaving group. To identify governing chemical features across diverse compositions with varying local coordination environments, we leverage random forest regression and descriptor importance analysis. A key result is that metal–oxygen orbital hybridization, quantified using a projected density-of-states-derived descriptor, H d/p , provides a physically grounded measure of interaction strength that governs metal release energetics. This refined perspective goes beyond conventional oxidation state considerations and offers more robust insights for materials science. Finally, we model defect surface-bound O 2 dimer formation as a proxy for reactive oxygen species (ROS) generation. The results show that Ni-rich compositions more readily stabilize spin-polarized O 2 dimers, corroborating experimental reports of an increased ROS-driven biological response. In conclusion, our results establish a compositional and electronic basis for metal release and surface oxygen reactivity that form a rationale for complex metal oxide design principles.

36 MATERIALS SCIENCE↗

Discovering equations that govern experimental materials stability under environmental stress using scientific machine learning

Abstract While machine learning (ML) in experimental research has demonstrated impressive predictive capabilities, extracting fungible knowledge representations from experimental data remains an elusive task. In this manuscript, we use ML to infer the underlying differential equation (DE) from experimental data of degrading organic-inorganic methylammonium lead iodide (MAPI) perovskite thin films under environmental stressors (elevated temperature, humidity, and light). Using a sparse regression algorithm, we find that the underlying DE governing MAPI degradation across a broad temperature range of 35 to 85 °C is described minimally by a second-order polynomial. This DE corresponds to the Verhulst logistic function, which describes reaction kinetics analogous to self-propagating reactions. We examine the robustness of our conclusions to experimental variance and Gaussian noise and describe the experimental limits within which this methodology can be applied. Our study highlights the promise and challenges associated with ML-aided scientific discovery by demonstrating its application in experimental chemical and materials systems.

36 MATERIALS SCIENCE↗