Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Biochemical methane potential (BMP) tests: Reducing test time by early parameter estimation

Highlights: • Early parameters prediction of BMP model is achieved by using sensitivity functions. • Minimum testing time for early parameter estimation is related to kinetic constant. • Balanced regression improves the accuracy of estimated parameters. - Abstract: Biochemical methane potential (BMP) test is a key analytical technique to assess the implementation and optimisation of anaerobic biotechnologies. However, this technique is characterised by long testing times (from 20 to >100 days), which is not suitable for waste utilities, consulting companies or plants operators whose decision-making processes cannot be held for such a long time. This study develops a statistically robust mathematical strategy using sensitivity functions for early prediction of BMP first-order model parameters, i.e. methane yield (B{sub 0}) and kinetic constant rate (k). The minimum testing time for early parameter estimation showed a potential correlation with the k value, where (i) slowly biodegradable substrates (k ≤ 0.1 d{sup −1}) have a minimum testing times of ≥15 days, (ii) moderately biodegradable substrates (0.1 −1 ) have a minimum testing times between 8 and 15 days, and (iii) rapidly biodegradable substrates (k ≥ 0.2 d{sup −1}) have testing times lower than 7 days.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Better Method to Calculate Fuel Burnup in Pebble Bed Reactors Using Machine Learning

Burnup measurement is an important step in material control and accountancy (MC&A) at nuclear reactors, and may be done by examining gamma spectra of fuel samples. Traditional approaches rely on known correlations to specific photopeaks (e.g. 137 Cs) and operate via a standard linear regression method. However, the quality of these regression methods is limited even in the best case, and is significantly poorer at short fuel cool-down times, due to the elevated radiation background by short life-time isotopes, and self-shielding effect of the fuel. For practical operation of pebble bed reactors (PBRs), quick measurements (in minutes) and short cooling times (in hours) are required from a safety and security perspective. We investigated the efficacy and performance of machine learning (ML) methods to predict the burnup of the pebble fuel from full gamma spectra (rather than specific discrete photopeaks) and found a full-spectrum ML approach to far outperform baseline regression predictions in all measurement and cooling conditions - including in operational-like measurement conditions. We also performed model and data ablation experiments to determine the relative performance impact of our ML methods' capacity to model data nonlinearities and the inherent additional information in full spectra. Applying our ML methods, we found a number of surprising results, including improved accuracy at shorter fuel cooling times (the opposite of the norm), remarkable robustness to spectrum compression (via rebinning), and competitive burnup predictions even when using background signal only (i.e. explicitly omitting known isotope photopeaks).

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Designing Monte Carlo Simulation and an Optimal Machine Learning to Optimize and Model Space Missions

This paper investigates applying artificial intelligence (AI) algorithms to attitude control system of satellites to optimally tune the controller using high performance computing. This methodology is applied to the Virtual Telescope for X-ray Observation mission, which is a precise formation of two separate spacecraft observing multiple objects in the space in the X-ray domain. The mission is divided into phases based on the instrumentation and the mission goal. To reach an stable precise formation robust to stochastic slew and slew rate (i.e., Euler angles and angular velocities) in a minimal constrained time T , consumed energy of the attitude control system, denoted as E, and root-mean-square state error of attitude control system, denoted as e, are minimized. Monte-Carlo simulation is used for the sensitivity analysis of optimization and designing a controller. Deep neural networks (DNN), Gaussian processes (GP), and support vector regression (SVR) learn this optimization as a surrogate model, while their hyperparameters are optimized in a novel approach. THETA supercomputer at Argonne Leadership Computing Facility (ALCF) is used for optimizing the hyperparameters of DNN. The surrogate model meets the requirements of the mission, and it shows a better performance over the optimization and Monte-Carlo. The optimal DNN can satisfy the mission requirements e and T while reducing E for 90% compared to the other given methods.

42 ENGINEERING↗

The Role of Climate Covariability on Crop Yields in the Conterminous United States

The covariability of temperature (T), precipitation (P) and radiation (R) is an important aspect in understanding the climate influence on crop yields. Here in this paper, we analyze county-level corn and soybean yields and observed climate for the period 1983–2012 to understand how growing-season (June, July and August) mean T, P and R influence crop yields jointly and in isolation across the CONterminous United States (CONUS). Results show that nationally averaged corn and soybean yields exhibit large interannual variability of 21% and 22%, of which 35% and 32% can be significantly explained by T and P, respectively. By including R, an additional of 5% in variability can be explained for both crops. Using partial regression analyses, we find that studies that ignore the covariability among T, P, and R can substantially overestimate the sensitivity of crop yields to a single climate factor at the county scale. Further analyses indicate large spatial variation in the relative contributions of different climate variables to the variability of historical corn and soybean yields. Finally, the structure of the dominant climate factors did not change substantially over 1983–2012, confirming the robustness of the findings, which have important implications for crop yield prediction and crop model validations.

54 ENVIRONMENTAL SCIENCES↗

Fracture Characterization in Enhanced Geothermal Systems by Wellbore and Reservoir Analysis

This report highlights the work that was done to characterize fractured geothermal reservoirs using production data. That includes methods that were developed to infer characteristic functions from production data and models that were designed to optimize reinjection scheduling into geothermal reservoirs, based on these characteristic functions. The characterization method provides a robust way of interpreting tracer and flow rate data from fractured reservoirs. The flow-rate data are used to infer the interwell connectivity, which describes how injected fluids are divided between producers in the reservoir. The tracer data are used to find the tracer kernel for each injector-producer connection. The tracer kernel describes the volume and dispersive properties of the interwell flow path. A combination of parametric and nonparametric regression methods were developed to estimate the tracer kernels for situations where data is collected at variable flow-rate or variable injected concentration conditions. The characteristic functions can be used to calibrate thermal transport models, which can in turn be used to predict the productivity of geothermal systems. This predictive model can be used to optimize injection scheduling in a geothermal reservoir, as is illustrated in this report.

15 GEOTHERMAL ENERGY↗

Cluster, classify, regress: A general method for learning discontinuous functions

This paper presents a method for solving the supervised learning problem in which the output is highly nonlinear and discontinuous. Here, it is proposed to solve this problem in three stages: (i) cluster the pairs of input-output data points, resulting in a label for each point; (ii) classify the data, where the corresponding label is the output; and finally (iii) perform one separate regression for each class, where the training data corresponds to the subset of the original input-output pairs which have that label according to the classifier. It has not yet been proposed to combine these 3 fundamental building blocks of machine learning in this simple and powerful fashion. This can be viewed as a form of deep learning, where any of the intermediate layers can itself be deep. The utility and robustness of the methodology is illustrated on some toy problems, including one example problem arising from simulation of plasma fusion in a tokamak.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Data-Efficient Methods for Determining Flory–Huggins χ Parameters in Multicomponent Polymer Formulations

Polymer formulations are essential in diverse applications including personal care products, coatings, paints, adhesives, and plastic materials. Designing these formulations requires navigating large, complex design spaces, where phase and self-assembly behavior critically impact performance. The Flory–Huggins χ parameter, which quantifies segmental miscibility, is widely used to parametrize the excess free energy of mixing in formulation models. In this work, we introduce two data-efficient, top-down methods for estimating χ parameters using the Random Phase Approximation (RPA): (i) Boundary Nonlinear Regression (Boundary-NLR), which fits theoretical spinodal boundaries to experimental phase boundaries, and (ii) Surrogate Model Inverse Parameter Estimation (SMIPE), which uses a Gaussian Process Classifier to fit sparse phase maps via a surrogate model. Both methods allow rapid parametrization of polymer field-theoretic models without the need for additional experiments. We evaluate these approaches on data sets involving polymer–solvent–nonsolvent ternary mixtures and block copolymer–solvent systems, demonstrating their robustness to experimental noise and their relevance for real-world formulation design.

copolymers↗

Machine learning applied to wind turbine blades impact detection

The significant development of wind power generation worldwide brings, together with environmental benefits, wildlife concerns, especially for volant species vulnerability to interactions with wind energy facilities. For surveying such events, an automatic system for continuous monitoring of blade collisions is critical. An onboard multi-senor system capable of providing real-time collision detection using integrated vibration sensors is developed and successfully tested. However, to detect low signal-to-noise ratio impact can be challenging; hence, an advanced impact detection method has been developed and presented in this article. A robust automated detection algorithm based on support vector machine is proposed. After a preliminary signal pre-processing, geometric features specifically selected for their sensitivity to impact signals are extracted from raw vibration signal and energy distribution graph. The predictive model is formulated by training conventional support vector machine using extracted features for impact identification. Finally, the performance of the predictive model is evaluated by accuracy, precision, and recall. Results indicate a linear regression relationship between signal-to-noise ratio and model overall performance. Here, the proposed method is much reliable on higher signal-to-noise ratio (SNR≥6), but it shows to be ineffective at lower signal-to-noise ratio (SNR<2).

17 WIND ENERGY↗

PyTREES

PyTREES (Python tool for Training/Testing Robust Explainable Ensembles on Spectra) is software that implements a data-driven approach to predicting the amount of specific oxides present in materials samples of laser-induced breakdown spectroscopy (LIBS); such as from the ChemCam instrument suite onboard the NASA Curiosity rover. PyTREES is designed to input LIBS data in the format provided by the ChemCam team [1]. PyTREES then applies appropriate pre-processing to this data [2], and implements several regression methods for predicting oxides from spectra. The regression methods include: ensemble methods (random forest, extra trees, and gradient boosting regression) and blended submodels using the “double blending” technique. PyTREES additionally implements methods for quantifying the importance of features in regression model: (1) mean decrease in impurity (MDI) and (2) permutation importance to investigate the wavelengths used by the regression methods. [1] Gasda et al. (2021). Spectrochim Acta B, 181, 106223. [2] Clegg et al. (2017). Spectrochim Acta B , 129, 64–85.

Oyen, Diane↗

Differential credibility assessment for statistical downscaling

Climate science is increasingly using (i) ensembles of climate projections from multiple models derived using different assumptions and/or scenarios and (ii) process-oriented diagnostics of model fidelity. Efforts to assign differential credibility to projections and/or models are also rapidly advancing. A framework to quantify and depict the credibility of statistically downscaled model output is presented and demonstrated. Here, the approach employs transfer functions in the form of robust and resilient generalized linear models applied to downscale daily minimum and maximum temperature anomalies at 10 locations using predictors drawn from ERA-Interim reanalysis and two global climate models (GCM; GFDL-ESM2M and MPI-ESM-LR). The downscaled time series are used to derive several impact relevant CLIMDEX temperature indices that are assigned credibility based on (1) the reproduction of relevant large-scale predictors by the GCMs (i.e. fraction of regression beta-weights derived from predictors that are well-reproduced) and (2) the degree of variance in the observations reproduced in the downscaled series following application of a new variance inflation technique. Credibility of the downscaled predictands varies across locations, between the two GCM and is generally higher for minimum temperature than maximum temperature. The differential credibility assessment framework demonstrated here is easy to use and flexible. It can be applied as is to inform decision makers regarding projection confidence, and/or extended to include other components of the transfer functions, and/or used to weight members of a statistically downscaled ensemble.

54 ENVIRONMENTAL SCIENCES↗

Relation between the Variations in the Mg iiλ2798 Emission Line and 3000 Å Continuum

We investigate the relationship between the Mg II λ2798 emission line and the 3000 Å continuum variations using a sample of 68 intermediate-redshift (z∼0.65--1.50) broad-line quasars spanning a bolometric luminosity range of 44.49 erg s{sup −1}⩽logL{sub bol}⩽46.31 erg s{sup −1} (Eddington ratio from ∼0.026 to 0.862). This sample is constructed from SDSS-DR7Q and BOSS-DR12Q, each with at least two spectroscopic epochs in SDSS-I/II/III surveys. In addition, we adopt the following signal-to-noise ratio (S/N) selection criteria: (a) for Mg II and the 3000 Å continuum, S/N ⩾ 10; and (b) for narrow lines, S/N ⩾ 5. All our quasar spectra are recalibrated based on the assumption of constant narrow emission-line fluxes. In an analysis of spectrum-to-spectrum variations, we find a fairly close correlation (Spearman ρ=0.593) between the variations in broad Mg II and in the continuum. This is consistent with the idea that Mg II is varying in response to the continuum emission variations. Adopting the modified weighted least squares regression method, we statistically constrain the slopes (i.e., the responsivity α of the broad Mg II) between the variations in both components for the sources in different luminosity bins after eliminating intrinsic biases introduced by the rescaling process itself. It is shown that the responsivity is quite small (average α-bar ≈0.464) and anti-correlates with the quasar luminosity. Our results indicate that high signal-to-noise flux measurements are required to robustly detect the intrinsic variability and the time lag of the Mg II line.

79 ASTRONOMY AND ASTROPHYSICS↗

The empirical accuracy of uncertain inference models

Uncertainty is a pervasive feature of the domains in which expert systems are designed to function. Research design to test uncertain inference methods for accuracy and robustness, in accordance with standard engineering practice is reviewed. Several studies were conducted to assess how well various methods perform on problems constructed so that correct answers are known, and to find out what underlying features of a problem cause strong or weak performance. For each method studied, situations were identified in which performance deteriorates dramatically. Over a broad range of problems, some well known methods do only about as well as a simple linear regression model, and often much worse than a simple independence probability model. The results indicate that some commercially available expert system shells should be used with caution, because the uncertain inference models that they implement can yield rather inaccurate results.

Vaughan, David S.↗

Constraining primordial non-Gaussianity from DESI quasar targets and Planck CMB lensing

We detect the cross-correlation between 2.7 million DESI quasar targets across 14,700 deg 2 (180 quasars deg -2 ) and Planck 2018 CMB lensing at ~30σ. We use the cross-correlation on very large scales to constrain local primordial non-Gaussianity via the scale dependence of quasar bias. The DESI quasar targets lie at an effective redshift of 1.51 and are separated into four imaging regions of varying depth and image quality. We select quasar targets from Legacy Survey DR9 imaging, apply additional flux and photometric redshift cuts to improve the purity and reduce the fraction of unclassified redshifts, and use early DESI spectroscopy of 194,000 quasar targets to determine their redshift distribution and stellar contamination fraction (2.6%). Due to significant excess large-scale power in the quasar autocorrelation, we apply weights to mitigate contamination from imaging systematics such as depth, extinction, and stellar density. We use realistic contaminated mocks to determine the greatest number of systematic modes that we can fit, before we are biased by overfitting and spuriously remove real power. We find that linear regression with one to seven imaging templates removed per region accurately recovers the input cross-power, f NL and linear bias. As in previous analyses, our fNL constraint depends on the linear primordial non-Gaussianity bias parameter, b Φ = 2(b - p)δ c assuming universality of the halo mass function. We measure f NL = -26 +45 -40 with p = 1.6 (f NL = -18 +29 -27 with p = 1.0), and find that this result is robust under several systematics tests. Future spectroscopic quasar cross-correlations with Planck lensing can tighten the f NL constraints by a factor of 2 if they can remove the excess power on large scales in the quasar auto power spectrum.

79 ASTRONOMY AND ASTROPHYSICS↗

Gila Water Resources III - Modeling the Impacts of Post-fire Restoration Methods on Vegetation Recovery in the Gila National Forest

In recent years, wildfires in New Mexico’s Gila National Forest have become increasingly common and more severe. Wildfires can have powerful impacts on hydrology and soil stability, including erosion, flooding, and debris-flows that threaten lives and infrastructure downstream. Vegetation restoration treatments like seeding and mulching can mitigate these effects and facilitate ecosystem recovery. Understanding the effectiveness of various restoration methods is vital to planning a cost-effective and successful post-fire recovery strategy. The immediate response to a fire on US Forest Service land is coordinated by a Burned Area Emergency Response (BAER) team, a group responsible for mitigating immediate post-fire risks to human life, property, and critical natural and cultural resources. This study created a proof-of-concept methodology for a decision-support tool designed to help BAER teams identify the restoration treatments most likely to succeed in a given burned area. Leveraging random forest regression, Google Earth Engine, and Landsat 7 and 8 Earth observations, this study modeled vegetation recovery after the 2013 Silver Fire for seeded areas, seeded/mulched areas, and untreated areas. Treatment type and initial burn severity were the largest drivers of vegetation recovery across the landscape. Seeded/mulched areas showed higher recovery levels than untreated areas three months post-fire, but by four years post-fire, treated and untreated areas displayed similar recovery levels. To produce a robust predictive tool for the Gila National Forest, the model should be trained on many more fires and incorporate post-fire weather conditions into the process. Such a model will help partners ensure efficient resource use and plan effective post-fire restoration strategies.

DEVELOP Project Summary↗

Interactive prostate segmentation using atlas-guided semi-supervised learning and adaptive feature selection

Purpose: Accurate prostate segmentation is necessary for maximizing the effectiveness of radiation therapy of prostate cancer. However, manual segmentation from 3D CT images is very time-consuming and often causes large intra- and interobserver variations across clinicians. Many segmentation methods have been proposed to automate this labor-intensive process, but tedious manual editing is still required due to the limited performance. In this paper, the authors propose a new interactive segmentation method that can (1) flexibly generate the editing result with a few scribbles or dots provided by a clinician, (2) fast deliver intermediate results to the clinician, and (3) sequentially correct the segmentations from any type of automatic or interactive segmentation methods. Methods: The authors formulate the editing problem as a semisupervised learning problem which can utilize a priori knowledge of training data and also the valuable information from user interactions. Specifically, from a region of interest near the given user interactions, the appropriate training labels, which are well matched with the user interactions, can be locally searched from a training set. With voting from the selected training labels, both confident prostate and background voxels, as well as unconfident voxels can be estimated. To reflect informative relationship between voxels, location-adaptive features are selected from the confident voxels by using regression forest and Fisher separation criterion. Then, the manifold configuration computed in the derived feature space is enforced into the semisupervised learning algorithm. The labels of unconfident voxels are then predicted by regularizing semisupervised learning algorithm. Results: The proposed interactive segmentation method was applied to correct automatic segmentation results of 30 challenging CT images. The correction was conducted three times with different user interactions performed at different time periods, in order to evaluate both the efficiency and the robustness. The automatic segmentation results with the original average Dice similarity coefficient of 0.78 were improved to 0.865–0.872 after conducting 55–59 interactions by using the proposed method, where each editing procedure took less than 3 s. In addition, the proposed method obtained the most consistent editing results with respect to different user interactions, compared to other methods. Conclusions: The proposed method obtains robust editing results with few interactions for various wrong segmentation cases, by selecting the location-adaptive features and further imposing the manifold regularization. The authors expect the proposed method to largely reduce the laborious burdens of manual editing, as well as both the intra- and interobserver variability across clinicians.

07 ISOTOPE AND RADIATION SOURCES↗

Machine learning assisted phase and size-controlled synthesis of iron oxide particles

Synthesis of iron oxides with specific phases and particle sizes is a crucial challenge in various fields, including materials science, energy storage, biomedical applications, environmental science, and earth science. However, despite significant advances in this area, much of the current palette of particle outcomes has been based on time-consuming trial-and-error exploration of synthesis conditions. The present study was designed to explore a very different approach to 1) predict the outcome of synthesis from specified reaction parameters based on using machine learning (ML) techniques, and 2) correlate sets of parameters to obtain products with desired outcomes by a newly designed recommendation algorithm. To achieve this, four ML algorithms were tested, namely random forest, logistic regression, support vector machine, and k-nearest neighbor. Among the models, random forest outperformed the others, attaining 96% and 81% accuracy when predicting the phase and size of iron oxide particles in the test dataset. Surprisingly, the permutation feature importance analysis revealed that volume, which may strongly relate to pressure, was one of the important features, along with precursor concentration, pH, temperature, and time, influencing the phase and size of iron oxide particles during synthesis. To verify the robustness of the random forest models, prediction and experimental results were compared based on 24 randomly generated methods in additive and non-additive systems not included in the datasets. The predictions of product phase and particle size from the models agreed well with the experimental results. Furthermore, a searching and ranking algorithm was developed to recommend potential synthesis parameters for obtaining iron oxide products with the desired phase and particle size from previous studies in the dataset. Furthermore, this study lays the foundation for a closed-loop approach in materials synthesis and preparation, beginning with suggesting potential reaction parameters from the dataset and predicting potential outcomes, followed by conducting experiments and analyses, and ultimately enriching the dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Characterize traction–separation relation and interfacial imperfections by data-driven machine learning models

Abstract Interfacial mechanical properties are important in composite materials and their applications, including vehicle structures, soft robotics, and aerospace. Determination of traction–separation (T–S) relations at interfaces in composites can lead to evaluations of structural reliability, mechanical robustness, and failures criteria. Accurate measurements on T–S relations remain challenging, since the interface interaction generally happens at microscale. With the emergence of machine learning (ML), data-driven model becomes an efficient method to predict the interfacial behaviors of composite materials and establish their mechanical models. Here, we combine ML, finite element analysis (FEA), and empirical experiments to develop data-driven models that characterize interfacial mechanical properties precisely. Specifically, eXtreme Gradient Boosting (XGBoost) multi-output regressions and classifier models are harnessed to investigate T–S relations and identify the imperfection locations at interface, respectively. The ML models are trained by macroscale force–displacement curves, which can be obtained from FEA and standard mechanical tests. The results show accurate predictions of T–S relations ( R 2 = 0.988) and identification of imperfection locations with 81% accuracy. Our models are experimentally validated by 3D printed double cantilever beam specimens from different materials. Furthermore, we provide a code package containing trained ML models, allowing other researchers to establish T–S relations for different material interfaces.

97 MATHEMATICS AND COMPUTING↗

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗