Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Using gap-filled MAIAC AOD and WRF-Chem to estimate daily PM 2.5 concentrations at 1 km resolution in the Eastern United States

To link short-term exposures of air pollutants to health outcomes, scientists must use high temporal and spatial resolution estimates of PM 2.5 concentrations. We develop a daily PM 2.5 product at 1 × 1 km 2 spatial resolution across the eastern United States (east of 90° W) with the aid of 1 × 1 km 2 MAIAC aerosol optical depth (AOD) data, 36 × 36 km 2 WRF-Chem output, 1 × 1 km 2 land-use type from the National Land Cover Database, and 0.125° × 0.125° ERA-Interim re-analysis meteorology. A gap-filling technique is applied to MAIAC AOD data to construct robust daily estimates of AOD when the satellite data are missing (e.g., areas obstructed by clouds or snow cover). The input data are incorporated into a multiple-linear regression model trained to surface observations of PM 2.5 from the EPA Air Quality System (AQS) monitoring network. The model generates a high-fidelity estimate (r 2 = 0.75 using a 10-fold random cross-validation) of daily PM 2.5 throughout the eastern United States. Of the inputs to the statistical model, WRF-Chem output (r 2 = 0.66) is the most important contributor to the skill of the model. MAIAC AOD is also a strong contributor (r 2 = 0.52). Daily PM 2.5 output from our statistical model can be easily integrated into county-level epidemiological studies. The novelty of this project is that we are able to simulate PM 2.5 in a computationally efficient manner that is constrained to ground monitors, satellite data, and chemical transport model output at high spatial resolution (1 × 1 km 2 ) without sacrificing the temporal resolution (daily) or spatial coverage (>2,000,000 km 2 ).

47 OTHER INSTRUMENTATION↗

Measurement‐based correlation approach for power system dynamic response estimation

Understanding power system dynamics is essential for online stability assessment and control applications. Global positioning system‐synchronised phasor measurement units and frequency disturbance recorders (FDRs) make power system dynamics visible and deliver an accurate picture of the overall operation condition to system operators. However, in the actual field implementations, some measurement data can be inaccessible for various reasons, for example, most notably failure of communication. In this study, a measurement‐based approach is proposed to estimate the missing power system dynamics. Specifically, a correlation coefficient index is proposed to describe the correlation relationship between different measurements. Then, the auto‐regressive with exogenous input identification model is employed to estimate the missing system dynamic response. The US Eastern Interconnection is utilised in this study as a case study. The robustness of the correlation approach is verified by a wide variety of case studies as well. Finally, the proposed correlation approach is applied to the real FDR data for power system dynamic response estimation. The results indicate that the correlation approach could help select better input locations and thus improve the response estimation accuracy.

Bai, Feifei↗

Fragment-based {sup 13}C nuclear magnetic resonance chemical shift predictions in molecular crystals: An alternative to planewave methods

We assess the quality of fragment-based ab initio isotropic {sup 13}C chemical shift predictions for a collection of 25 molecular crystals with eight different density functionals. We explore the relative performance of cluster, two-body fragment, combined cluster/fragment, and the planewave gauge-including projector augmented wave (GIPAW) models relative to experiment. When electrostatic embedding is employed to capture many-body polarization effects, the simple and computationally inexpensive two-body fragment model predicts both isotropic {sup 13}C chemical shifts and the chemical shielding tensors as well as both cluster models and the GIPAW approach. Unlike the GIPAW approach, hybrid density functionals can be used readily in a fragment model, and all four hybrid functionals tested here (PBE0, B3LYP, B3PW91, and B97-2) predict chemical shifts in noticeably better agreement with experiment than the four generalized gradient approximation (GGA) functionals considered (PBE, OPBE, BLYP, and BP86). A set of recommended linear regression parameters for mapping between calculated chemical shieldings and observed chemical shifts are provided based on these benchmark calculations. Statistical cross-validation procedures are used to demonstrate the robustness of these fits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Leveraging Artificial Intelligence to Predict Novel Eutectic Alloys

The goal of this project was to train an artificial neural network (ANN) to predict the fractional composition and melting point of eutectic alloys using fundamental atomic properties as inputs. The fundamental properties considered include atomic number, atomic weight, atomic radius, valence electron concentration, electronegativity, and electron affinity. The project involved several phases, starting with data preparation, where phase diagram data was harvested from the ASM International database. Approximately 1300 binary eutectics were collected and cleaned to ensure relevance and accuracy. A regression model was selected for training, utilizing a rectified linear unit as the activation function. Various model configurations were evaluated for predictive accuracy, with validation techniques employed to ensure robustness. The model demonstrated predictive capabilities above random guessing and was able to achieve up to 11% accuracy under certain conditions. An ablative test identified atomic radius and valence electron concentration as critical inputs for model performance. Incorporating the melting point of atomic constituents improved accuracy significantly, although ultimately the model’s predictive capability still fell short of the 80% target. This report details the methodology, results, and implications of the research, contributing to the understanding of employing artificial intelligence to predict the phase transition behavior of eutectic alloys.

36 MATERIALS SCIENCE↗

SU-E-T-144: Bayesian Inference of Local Relapse Data Using a Poisson-Based Tumour Control Probability Model

Purpose: The purpose of this project is to develop a robust method of parameter estimation for a Poisson-based TCP model using Bayesian inference. Methods: Bayesian inference was performed using the PyMC3 probabilistic programming framework written in Python. A Poisson-based TCP regression model that accounts for clonogen proliferation was fit to observed rates of local relapse as a function of equivalent dose in 2 Gy fractions for a population of 623 stage-I non-small-cell lung cancer patients. The Slice Markov Chain Monte Carlo sampling algorithm was used to sample the posterior distributions, and was initiated using the maximum of the posterior distributions found by optimization. The calculation of TCP with each sample step required integration over the free parameter α, which was performed using an adaptive 24-point Gauss-Legendre quadrature. Convergence was verified via inspection of the trace plot and posterior distribution for each of the fit parameters, as well as with comparisons of the most probable parameter values with their respective maximum likelihood estimates. Results: Posterior distributions for α, the standard deviation of α (σ), the average tumour cell-doubling time (Td), and the repopulation delay time (Tk), were generated assuming α/β = 10 Gy, and a fixed clonogen density of 10{sup 7} cm−{sup 3}. Posterior predictive plots generated from samples from these posterior distributions are in excellent agreement with the observed rates of local relapse used in the Bayesian inference. The most probable values of the model parameters also agree well with maximum likelihood estimates. Conclusion: A robust method of performing Bayesian inference of TCP data using a complex TCP model has been established.

60 APPLIED LIFE SCIENCES↗

Machine learning without a processor: Emergent learning in a nonlinear analog network

Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic contrastive local learning networks (CLLNs) offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here, we introduce a nonlinear CLLN—an analog electronic network made of self-adjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR (exclusive or) and nonlinear regression, without a computer. We find our decentralized system reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.

Science & Technology - Other Topics↗

When does global attention help: a unified empirical study on atomistic graph learning

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable the modeling of complex physics. While most recent GNNs combine more traditional message passing neural networks (MPNNs) layers to model short-range interactions with more advanced graph transformers (GTs) with global attention mechanisms to model long-range interactions, it is still unclear when global attention mechanisms provide real benefits over well-tuned MPNN layers due to inconsistent implementations, features, or hyperparameter tuning. We introduce the first unified, reproducible benchmarking framework–built on HydraGNN–that enables seamless switching among four controlled model classes: MPNN, MPNN with chemistry/topology encoders, GPS-style hybrids of MPNN with global attention, and fully fused localglobal models with encoders. Using seven diverse open-source datasets for benchmarking across regression and classification tasks, we systematically isolate the contributions of message passing, global attention, and encoder-based feature augmentation. Our study shows that encoder-augmented MPNNs form a robust baseline, while fused localglobal models yield the clearest benefits for properties governed by long-range interaction effects. We further quantify the accuracycompute trade-offs of attention, reporting its overhead in memory. Together, these results establish the first controlled evaluation of global attention in atomistic graph learning and provide a reproducible testbed for future model development.

Equivariant graph neural networks↗

Archaeological applications of laser-induced breakdown spectroscopy: an example from the Coso Volcanic Field, California, using advanced statistical signal processing analysis

Over the past quarter century, multielement chemical analysis has become a common means for attributing the provenance of archaeological materials. The Coso Volcanic Field (CVF) in California, USA, contains at least 38 high-silica rhyolite domes, many of which contain obsidian glass that has been quarried for tools by the indigenous population for more than 12,000 years. Artifacts made from CVF obsidian are found throughout the southwestern United States and geochemical sourcing of CVF obsidian has been an important tool in understanding prehistoric Native American trading patterns. Laser-induced breakdown spectroscopy (LIBS) is a simple atomic emission spectroscopic technique that has the potential for real-time man-portable chemical analysis in the field. Because LIBS is simultaneously sensitive to all elements, a single laser shot can be used to record the broadband emission spectra, which provides a ''chemical fingerprint'' of a material. Single-shot broadband LIBS spectra were collected using a commercial benchtop LIBS system for 27 obsidian samples from major sites across the CVF and four additional sites in California and western Nevada outside of CVF. Classification of the samples was performed using partial least-squares discriminant analysis (PLSDA), a common chemometric technique suitable for performing regression on high-dimensional data. Provenance identification for the obsidian samples was evaluated for three separate labeling frameworks. The first framework consisted of a binary classification problem to distinguish CVF samples from non-CVF samples. The second approach focused on the CVF samples with labels that corresponded to the eight separate Coso sites encompassed by the 27 samples. In the third analysis, non-CVF samples were excluded, and the remaining 27 CVF samples were labeled based on groupings defined from previous major and trace element chemical studies, which reduces the number of possible classes from eight to four. Different aspects of the classifier setup considered in this study include the training/testing routine (a 27-fold leave-one-sample-out setup versus a simple split of the data into separate sets for training and evaluation), the number of latent variables used in the regression model, and whether PLSDA operating on the entire broadband LIBS spectrum is superior to that using only a selected subset of LIBS emission lines. The results point to the robustness of the PLSDA technique and suggest that LIBS analysis combined with the appropriate statistical signal processing has the potential to be a useful tool for chemical analysis of archaeological artifacts and geological specimens.

74 ATOMIC AND MOLECULAR PHYSICS↗

A Robust Neural Network for Extracting Dynamics from Electrostatic Force Microscopy Data

Advances in scanning probe microscopy (SPM) methods such as time-resolved electrostatic force microscopy (trEFM) now permit the mapping of fast local dynamic processes with high resolution in both space and time, but such methods can be time-consuming to analyze and calibrate. Here, we design and train a regression neural network (NN) that accelerates and simplifies the extraction of local dynamics from SPM data directly in a cantilever-independent manner, allowing the network to process data taken with different cantilevers. We validate the NN’s ability to recover local dynamics with a fidelity equal to or surpassing conventional, more time-consuming, calibrations using both simulated and real microscopy data. We apply this method to extract accurate photoinduced carrier dynamics on n = 1 butylammonium lead iodide, a halide perovskite semiconductor film that is of interest for applications in both solar photovoltaics and quantum light sources. Lastly, we use SHapley Additive exPlanations to evaluate the robustness of the trained model, confirm its cantilever-independence, and explore which parts of the trEFM signal are important to the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Near-Infrared Spectroscopy can Predict Anatomical Abundance in Corn Stover

Feedstock heterogeneity is a key challenge impacting the deconstruction and conversion of herbaceous lignocellulosic biomass to biobased fuels, chemicals, and materials. Upstream processing to homogenize biomass feedstock streams into their anatomical components via air classification allows for a more tailored approach to subsequent mechanical and chemical processing. Here, we show that differing corn stover anatomical tissues respond differently to pretreatment and enzymatic hydrolysis and therefore, a one-size-fits-all approach to chemical processing biomass is inappropriate. To inform on-line downstream processing, a robust and high-throughput analytical technique is needed to quantitatively characterize the separated biomass. Predictive correlation of near-infrared spectra to biomass chemical composition is such a technique. Here, we demonstrate the capability of models developed using an “off-the-shelf,” industrially relevant spectrometer with limited spectral range to make strong predictions of both cell wall chemical composition and the relative abundance of anatomical components of the corn stover, the latter for the first time ever. Gaussian process regression (GPR) yields stronger correlations (average R 2 v = 88% for chemical composition and 95% for anatomical relative abundance) than the more commonly used partial least squares (PLS) regression (average R 2 v = 84% for chemical composition and 92% for anatomical relative abundance). In nearly all cases, both GPR and PLS outperform models generated using neural networks. These results highlight the potential for coupling NIRS with predictive models based on GPR due to the potential to yield more robust correlations.

09 BIOMASS FUELS↗

Single Gaussian process method for arbitrary tokamak regimes with a statistical analysis

Abstract Gaussian process regression is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including intrinsic uncertainty quantification and robustness to over-fitting. This work investigates the use of a new method, the change-point method, for handling the varying length scales found in different tokamak regimes. The use of the Student’s t-distribution for the Bayesian likelihood probability is also investigated and shown to be advantageous in providing good fits in profiles with many outliers. To compare different methods, synthetic data generated from analytic profiles is used to create a database enabling a quantitative statistical comparison of which methods perform the best. Using a full Bayesian approach with the change-point method, Matérn kernel for the prior probability, and Student’s t-distribution for the likelihood is shown to give the best results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Postradiation Metabolic Tumor Volume Predicts Outcome in Head-and-Neck Cancer

Purpose: To explore the prognostic value of metabolic tumor volume measured on postradiation {sup 18}F-fluorodeoxyglucose positron emission tomography (PET) imaging in patients with head-and-neck cancer. Methods and Materials: Forty-seven patients with head-and-neck cancer who received pretreatment and posttreatment PET/computed tomography (CT) imaging along with definitive chemoradiotherapy were included in this study. The PET/CT parameters evaluated include the maximum standardized uptake value, metabolic tumor volume (MTV{sub 2.0}-MTV{sub 4.0}; where MTV{sub 2.0} refers to the volume above a standardized uptake value threshold of 2.0), and integrated tumor volume. Kaplan-Meier and Cox regression models were used to test for association between PET endpoints and disease-free survival and overall survival. Results: Multiple postradiation PET endpoints correlated significantly with outcome; however, the most robust predictor of disease progression and death was MTV{sub 2.0}. An increase in MTV{sub 2.0} of 21cm{sup 3} (difference between 75th and 25th percentiles) was associated with an increased risk of disease progression (hazard ratio [HR]= 2.5, p = 0.0001) and death (HR = 2.0, p = 0.003). In patients with nonnasopharyngeal carcinoma histology (n = 34), MTV{sub 2.0} <18 cm{sup 3} and MTV{sub 2.0} {>=}18 cm{sup 3} yielded 2-year disease-free survival rates of 100% and 63%, respectively (p = 0.006) and 2-year overall survival rates of 100% and 81%, respectively (p = 0.009). There was no correlation between MTV{sub 2.0} and disease-free survival or overall survival with nasopharyngeal carcinoma histology (n = 13). On multivariate analysis, only postradiation MTV{sub 2.0} was predictive of disease-free survival (HR = 2.47, p = 0.0001) and overall survival (HR = 1.98, p = 0.003). Conclusions: Postradiation metabolic tumor volume is an adverse prognostic factor in head-and-neck cancer. Biomarkers such as MTV are important for risk stratification and will be valuable in the future with risk-adapted therapies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Statistical-learning strategies generate only modestly performing predictive models for urinary symptoms following external beam radiotherapy of the prostate: A comparison of conventional and machine-learning methods

Purpose: Given the paucity of available data concerning radiotherapy-induced urinary toxicity, it is important to ensure derivation of the most robust models with superior predictive performance. This work explores multiple statistical-learning strategies for prediction of urinary symptoms following external beam radiotherapy of the prostate. Methods: The performance of logistic regression, elastic-net, support-vector machine, random forest, neural network, and multivariate adaptive regression splines (MARS) to predict urinary symptoms was analyzed using data from 754 participants accrued by TROG03.04-RADAR. Predictive features included dose-surface data, comorbidities, and medication-intake. Four symptoms were analyzed: dysuria, haematuria, incontinence, and frequency, each with three definitions (grade ≥ 1, grade ≥ 2 and longitudinal) with event rate between 2.3% and 76.1%. Repeated cross-validations producing matched models were implemented. A synthetic minority oversampling technique was utilized in endpoints with rare events. Parameter optimization was performed on the training data. Area under the receiver operating characteristic curve (AUROC) was used to compare performance using sample size to detect differences of ≥0.05 at the 95% confidence level. Results: Logistic regression, elastic-net, random forest, MARS, and support-vector machine were the highest-performing statistical-learning strategies in 3, 3, 3, 2, and 1 endpoints, respectively. Logistic regression, MARS, elastic-net, random forest, neural network, and support-vector machine were the best, or were not significantly worse than the best, in 7, 7, 5, 5, 3, and 1 endpoints. The best-performing statistical model was for dysuria grade ≥ 1 with AUROC ± standard deviation of 0.649 ± 0.074 using MARS. For longitudinal frequency and dysuria grade ≥ 1, all strategies produced AUROC>0.6 while all haematuria endpoints and longitudinal incontinence models produced AUROC<0.6. Conclusions: Logistic regression and MARS were most likely to be the best-performing strategy for the prediction of urinary symptoms with elastic-net and random forest producing competitive results. The predictive power of the models was modest and endpoint-dependent. New features, including spatial dose maps, may be necessary to achieve better models.

60 APPLIED LIFE SCIENCES↗

A generalized machine learning workflow to visualize mechanical discontinuity

Accurate detection and mapping of mechanical discontinuity in materials has widespread industrial and research applications. Herein, we developed a generalized machine-learning framework for visualizing single mechanical discontinuity embedded in material of any composition, velocity, density, porosity, and size with limited data. The proposed visualization of discontinuity requires accurate estimations of the length, location, and orientation of the embedded discontinuity by processing multipoint wave-transmission measurements. k-Wave simulator is used to create a large dataset of elastic waveforms recorded during multi-point wave-transmission measurements through materials containing single mechanical discontinuity. k-Wave simulator considers the wave attenuation, dispersion, and mode conversion in wave motion. Discrete wavelet transform (DWT) and statistical feature extraction are essential for data preprocessing prior to the data-driven model development. DWT also minimizes the effect of noise. Using hyper-parameter tuning and cross validation, gradient boosting regression can visualize the mechanical discontinuity with an accuracy of 0.85, in terms of coefficient of determination. A double-layered neural network-based regression has better performance with an accuracy of 0.95. Use of convolutional neural network converts the predictive task from a waveform processing to an image processing problem. Convolutional neural network achieved a generalization performance of 0.91. The proposed generalized workflow requires robust simulation of wave propagation, signal processing, feature engineering, and model evaluation. Sensors closest to the source and those located opposite the source are the most significant for the desired visualization. Notably, the sensors closest to the source capture the non-linear associations, whereas the sensor on the border opposite to the source capture the linear associations between the measured waveforms and the properties of the mechanical discontinuity.

42 ENGINEERING↗

Discovery of structure–property relations for molecules via hypothesis-driven active learning over the chemical space

The discovery of the molecular candidates for application in drug targets, biomolecular systems, catalysts, photovoltaics, organic electronics, and batteries necessitates the development of machine learning algorithms capable of rapid exploration of chemical spaces targeting the desired functionalities. Here, we introduce a novel approach for active learning over the chemical spaces based on hypothesis learning. We construct the hypotheses on the possible relationships between structures and functionalities of interest based on a small subset of data followed by introducing them as (probabilistic) mean functions for the Gaussian process. This approach combines the elements from the symbolic regression methods, such as SISSO and active learning, into a single framework. The primary focus of constructing this framework is to approximate physical laws in an active learning regime toward a more robust predictive performance, as traditional evaluation on hold-out sets in machine learning does not account for out-of-distribution effects which may lead to a complete failure on unseen chemical space. Here, we demonstrate it for the QM9 dataset, but it can be applied more broadly to datasets from both domains of molecular and solid-state materials sciences.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cascade Optimization Strategy with Neural Network and Regression Approximations Demonstrated on a Preliminary Aircraft Engine Design

A preliminary aircraft engine design methodology is being developed that utilizes a cascade optimization strategy together with neural network and regression approximation methods. The cascade strategy employs different optimization algorithms in a specified sequence. The neural network and regression methods are used to approximate solutions obtained from the NASA Engine Performance Program (NEPP), which implements engine thermodynamic cycle and performance analysis models. The new methodology is proving to be more robust and computationally efficient than the conventional optimization approach of using a single optimization algorithm with direct reanalysis. The methodology has been demonstrated on a preliminary design problem for a novel subsonic turbofan engine concept that incorporates a wave rotor as a cycle-topping device. Computations of maximum thrust were obtained for a specific design point in the engine mission profile. The results (depicted in the figure) show a significant improvement in the maximum thrust obtained using the new methodology in comparison to benchmark solutions obtained using NEPP in a manual design mode.

Hopkins, Dale A.↗

Ozone Observations by the Gas and Aerosol Measurement Sensor during SOLVE II

The Gas and Aerosol Measurement Sensor (GAMS) was deployed aboard the NASA DC-8 aircraft during the second SAGE III Ozone Loss and Validation Experiment (SOLVE II). GAMS acquired line-of-sight (LOS) direct solar irradiance spectra during the sunlit portions of ten science flights of the DC-8 between 12 January and 4 February 2003. Differential line-of-sight (DLOS) optical depth spectra are produced from the GAMS raw solar irradiance spectra. Then, DLOS ozone number densities are retrieved from the GAMS spectra using a multiple linear regression spectral fitting technique. Both the DLOS optical depth spectra and retrieved ozone data are compared with coincident measurements from two other solar instruments aboard the DC-8 platform to demonstrate the robustness and stability of the GAMS data. The GAMS ozone measurements are then utilized to evaluate the quality of the Wulf band ozone cross sections, a critical component of the SAGE III aerosol, water vapor, and temperature/pressure retrievals. Results suggest the ozone cross section compilation of Shettle and Anderson currently used operationally in SAGE III data processing may be in error by as much as 10-20% in theWulf bands, and their lack of reported temperature dependence is a significant deficiency. A second, more recent, cross section database compiled for the SCIAMACHY satellite mission appears to be of much better quality in the Wulf bands, but still may have errors as large as 5% near the Wulf band absorption peaks, which is slightly larger than their stated uncertainty. Additional laboratory measurements of the Wulf band cross sections should be pursued to further reduce their uncertainty and better quantify their temperature dependence.

Pitts, M. C.↗