Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Identifying an efficient, thermally robust inorganic phosphor host via machine learning

Abstract Rare-earth substituted inorganic phosphors are critical for solid state lighting. New phosphors are traditionally identified through chemical intuition or trial and error synthesis, inhibiting the discovery of potential high-performance materials. Here, we merge a support vector machine regression model to predict a phosphor host crystal structure’s Debye temperature, which is a proxy for photoluminescent quantum yield, with high-throughput density functional theory calculations to evaluate the band gap. This platform allows the identification of phosphors that may have otherwise been overlooked. Among the compounds with the highest Debye temperature and largest band gap, NaBaB 9 O 15 shows outstanding potential. Following its synthesis and structural characterization, the structural rigidity is confirmed to stem from a unique corner sharing [B 3 O 7 ] 5– polyanionic backbone. Substituting this material with Eu 2+ yields UV excitation bands and a narrow violet emission at 416 nm with a full-width at half-maximum of 34.5 nm. More importantly, NaBaB 9 O 15 :Eu 2+ possesses a quantum yield of 95% and excellent thermal stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

Pathologic Validation of a Model Based on Diffusion-Weighted Imaging and Dynamic Contrast-Enhanced Magnetic Resonance Imaging for Tumor Delineation in the Prostate Peripheral Zone

Purpose: For focal boost strategies in the prostate, the robustness of magnetic resonance imaging-based tumor delineations needs to be improved. To this end we developed a statistical model that predicts tumor presence on a voxel level (2.5 Multiplication-Sign 2.5 Multiplication-Sign 2.5 mm3) inside the peripheral zone. Furthermore, we show how this model can be used to derive a valuable input for radiotherapy treatment planning. Methods and Materials: The model was created on 87 radiotherapy patients. For the validation of the voxelwise performance of the model, an independent group of 12 prostatectomy patients was used. After model validation, the model was stratified to create three different risk levels for tumor presence: gross tumor volume (GTV), high-risk clinical target volume (CTV), and low-risk CTV. Results: The model gave an area under the receiver operating characteristic curve of 0.70 for the prediction of tumor presence in the prostatectomy group. When the registration error between magnetic resonance images and pathologic delineation was taken into account, the area under the curve further improved to 0.89. We propose that model outcome values with a high positive predictive value can be used to define the GTV. Model outcome values with a high negative predictive value can be used to define low-risk CTV regions. The intermediate outcome values can be used to define a high-risk CTV. Conclusions: We developed a logistic regression with a high diagnostic performance for voxelwise prediction of tumor presence. The model output can be used to define different risk levels for tumor presence, which in turn could serve as an input for dose planning. In this way the robustness of tumor delineations for focal boost therapy can be greatly improved.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Long-term changes in the seasonality of Baltic sea level

The seasonal cycle accounts for about 40% of the total sea level variability in the Baltic Sea. In a climate change context, changes are expected to occur, not only in mean levels but also in the seasonal characteristics of sea level. The present study addresses the quantification of changes in the seasonal cycle of sea level from a set of century-long tide gauge records in the Baltic Sea. In order to obtain robust estimates of the changes in amplitude and phase of the seasonal cycle, we apply different methods, including continuous wavelet filtering, multi-resolution decomposition based on the maximal overlap discrete wavelet transform, auto-regressive-based decomposition, singular spectrum analysis and empirical mode decomposition. The results show that all methods generally trace a similar long-term variability of the annual cycle amplitudes, and we focus on discrete wavelet analysis as the natural counterpart of classical moving Fourier analysis. In contrast to previous studies suggesting the existence of long-term changes in the seasonal cycle, in particular an increase of the annual amplitude, we find alternating periods of high and low amplitudes without any clear indication of systematic long-term trends. The derived seasonal patterns are spatially coherent, discriminating the stations in the Baltic entrance from the remaining stations in the Baltic basin, for which zonal wind accounts for typically more than 40% of the variations in amplitude.

54 ENVIRONMENTAL SCIENCES↗

Angle of attack estimation using an inertial reference platform

This paper presents the mathematical development and flight test results of an angle of attack estimation system based on inertial navigation system inputs. The estimator uses these inputs to determine the coefficient of lift required at any instant inflight. Angle of attack is then modeled through a regression analysis based on coefficient of lift, altitude and Mach. Overall correlation of the estimator as tested was generally within 0.5 degrees through 17 degrees angle of attack on an F-15A aircraft. A robustness analysis indicates that the system can be used adequately in maneuvering flight.

Zeis, Joseph E., Jr.↗

THE ORTHOGONAL FITTING PROCEDURE FOR DETERMINATION OF THE EMPIRICAL {Sigma}-D RELATIONS FOR SUPERNOVA REMNANTS: APPLICATION TO STARBURST GALAXY M82

The radio surface brightness-to-diameter ({Sigma}-D) relation for supernova remnants (SNRs) in the starburst galaxy M82 is analyzed in a statistically more robust manner than in the previous studies that mainly discussed sample quality and related selection effects. The statistics of data fits in the log {Sigma}-log D plane are analyzed by using vertical (standard) and orthogonal regressions. As the parameter values of D-{Sigma} and {Sigma}-D fits are invariant within the estimated uncertainties for orthogonal regressions, slopes of the empirical {Sigma}-D relations should be determined by using the orthogonal regression fitting procedure. Thus obtained {Sigma}-D relations for samples which are not under severe influence of the selection effects could be used for estimating SNR distances. Using the orthogonal regression fitting procedure, the {Sigma}-D slope {beta} {approx} 3.9 is obtained for the sample of 31 SNRs in M82. The results of implemented Monte Carlo simulations show that the sensitivity selection effect does not significantly influence the slope of the M82 relation. This relation could be used for estimating distances to SNRs that evolve in a denser interstellar environment, with number density up to 1000 particles per cm{sup 3}.

79 ASTRONOMY AND ASTROPHYSICS↗

Robust global detection of forced changes in mean and extreme precipitation despite observational disagreement on the magnitude of change

Detection and attribution (D&A) of forced precipitation change are challenging due to internal variability, limited spatial, and temporal coverage of observational records and model uncertainty. These factors result in a low signal-to-noise ratio of potential regional and even global trends. Here, we use a statistical method – ridge regression – to create physically interpretable fingerprints for the detection of forced changes in mean and extreme precipitation with a high signal-to-noise ratio. The fingerprints are constructed using Coupled Model Intercomparison Project phase 6 (CMIP6) multi-model output masked to match coverage of three gridded precipitation observational datasets – GHCNDEX, HadEX3, and GPCC – and are then applied to these observational datasets to assess the degree of forced change detectable in the real-world climate in the period 1951–2020. We show that the signature of forced change is detected in all three observational datasets for global metrics of mean and extreme precipitation. Forced changes are still detectable from changes in the spatial patterns of precipitation even if the global mean trend is removed from the data. This shows the detection of forced change in mean and extreme precipitation beyond a global mean trend is robust and increases confidence in the detection method's power as well as in climate models' ability to capture the relevant processes that contribute to large-scale patterns of change. We also find, however, that detectability depends on the observational dataset used. Not only coverage differences but also observational uncertainty contribute to dataset disagreement, exemplified by the times of emergence of forced change from internal variability ranging from 1998 to 2004 among datasets. Furthermore, different choices for the period over which the forced trend is computed result in different levels of agreement between observations and model projections. These sensitivities may explain apparent contradictions in recent studies on whether models under- or overestimate the observed forced increase in mean and extreme precipitation. Lastly, the detection fingerprints are found to rely primarily on the signal in the extratropical Northern Hemisphere, which is at least partly due to observational coverage but potentially also due to the presence of a more robust signal in the Northern Hemisphere in general.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian framework for adsorption energy prediction on bimetallic alloy catalysts

Abstract For high-throughput screening of materials for heterogeneous catalysis, scaling relations provides an efficient scheme to estimate the chemisorption energies of hydrogenated species. However, conditioning on a single descriptor ignores the model uncertainty and leads to suboptimal prediction of the chemisorption energy. In this article, we extend the single descriptor linear scaling relation to a multi-descriptor linear regression models to leverage the correlation between adsorption energy of any two pair of adsorbates. With a large dataset, we use Bayesian Information Criteria (BIC) as the model evidence to select the best linear regression model. Furthermore, Gaussian Process Regression (GPR) based on the meaningful convolution of physical properties of the metal-adsorbate complex can be used to predict the baseline residual of the selected model. This integrated Bayesian model selection and Gaussian process regression, dubbed as residual learning, can achieve performance comparable to standard DFT error (0.1 eV) for most adsorbate system. For sparse and small datasets, we propose an ad hoc Bayesian Model Averaging (BMA) approach to make a robust prediction. With this Bayesian framework, we significantly reduce the model uncertainty and improve the prediction accuracy. The possibilities of the framework for high-throughput catalytic materials exploration in a realistic setting is illustrated using large and small sets of both dense and sparse simulated dataset generated from a public database of bimetallic alloys available in Catalysis-Hub.org.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparison of Total Solar Irradiance with NASA/NSO Spectromagnetograph Data in Solar Cycles 22 and 23

An earlier study compared NASA/NSO Spectromagnetograph (SPM) data with spacecraft measurements of total solar irradiance (TSI) variations over a 1.5 year period in the declining phase of solar cycle 22. This paper extends the analysis to an eight-year period which also spans the rising and early maximum phases of cycle 23. The conclusions of the earlier work appear to be robust: three factors (sunspots, strong unipolar regions, and strong mixed polarity regions) describe most of the variation in the SPM record, but only the first two are associated with TSI. Additionally, the residuals of a linear multiple regression of TSI against SPM observations over the entire eight-year period show an unexplained, increasing, linear time variation with a rate of about 0.05 W m(exp -2) per year. Separate regressions for the periods before and after 1996 January 01 show no unexplained trends but differ substantially in regression parameters. This behavior may reflect a solar source of TSI variations beyond sunspots and faculae but more plausibly results from uncompensated non-solar effects in one or both of the TSI and SPM data sets.

Jones, Harrison P.↗

Statistical Classification of Biosignature Information using Multiple Instrument Observations

The accurate identification of biosignatures (indications of life) from data taken from remote or in situ planetary exploration is one of the most important challenges in astrobiology, the interdisciplinary field examining habitability and the potential for extraterrestrial life. This study employs machine learning algorithms to optimize the identification of biosignatures, with an emphasis on those which are agnostic to a specific biochemical basis. We exploit the wealth of terrestrial data available from biogenic and abiogenic systems to enhance efficient feature prioritization. Our dataset, pulled from public databases and laboratory recorded measurements, includes elemental abundance, isotopic fractionation, and VNIR/Raman spectra The data curation process included standardization for detection limits and ranges. Subsequent feature extraction yielded detailed inputs for machine learning, including combinations of elemental content, isotopic ratios, and parameters of spectral peaks and troughs. Feature significance was evaluated across diverse machine learning methodologies, such as k-nearest neighbors, logistic regression, Random Forest, support vector machines, and Gaussian Naïve Bayes, along with a combined voting classifier. We utilized Receiver Operating Characteristic Area Under the Curve (ROC AUC) across 2,000 50% test-train splits as a robust metric of model performance. Results revealed a promising ROC AUC of 0.853 for the combined voting classifier. Removing elemental abundance data notably reduced model accuracy (13% decrease in AUC), highlighting its critical role in biosignature detection. Several other individual data features exhibited significance within their respective data types, offering additional granularity. This research fortifies the relevance of machine learning to astrobiology, potentially enhancing life detection missions by allowing algorithmic prioritization of high-interest samples for further investigation. Future work will refine data standardization, expand the dataset to include more terrestrial systems, and incorporate convolutional neural networks for spectral feature extraction. The potential for public data sharing is also under exploration, reinforcing our commitment to collective scientific advancement.

Statistical↗

Robust Adaptive Decentralized Dynamic State Estimation with Unknown Control Inputs using Field PMU Measurements

This paper proposes a robust adaptive decentralized dynamic state estimation method for power system with unknown inputs of the highly detailed synchronous machine model. The temporal and spatial correlations among the unknown inputs are used to derive a vector auto-regressive model. The latter is further integrated together with state transition and measurement models for joint state and unknown inputs estimation. Thanks to the consideration of implicit cross-correlations between the states and the unknown inputs, only generator terminal voltage and current phasors are needed. Test results on the US WECC system using the field PMU measurements show that the proposed method is able to track both the system dynamic states and unknown controller inputs. These information could significantly benefit the validation and calibration of generator controller parameters.

Zhao, Junbo↗

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An Improved Coefficient Calculator for the California Energy Commission 6 Parameter Photovoltaic Module Model

This paper describes an improved algorithm for calculating the six parameters required by the California Energy Commission (CEC) photovoltaic (PV) Calculator module model. Rebate applications in California require results from the CEC PV model, and thus depend on an up-to-date database of module characteristics. Currently, adding new modules to the database requires calculating operational coefficients using a general purpose equation solver - a cumbersome process for the 300+ modules added on average every month. The combination of empirical regressions and heuristic methods presented herein achieve automated convergence for 99.87% of the 5487 modules in the CEC database and greatly enhance the accuracy and efficiency by which new modules can be characterized and approved for use. The added robustness also permits general purpose use of the CEC/6 parameter module model by modelers and system analysts when standard module specifications are known, even if the module does not exist in a preprocessed database.

14 SOLAR ENERGY↗

In Situ Inference for Earth System Predictability

An understanding of future evolution in precipitation extremes is critical to numerous DOE mission questions. Extreme events are by nature short time-scale events that are difficult to diagnose in available model data. Accurate modeling of extreme events necessarily requires high spatial resolution at the storm scale locally. However, the environment in which storms grow is dependent on global, remote, processes. These complex spatiotemporal relationships are impossible to diagnose at resolutions required to accurately model storms responsible for extreme precipitation. At exascale, climate simulations will produce results at fine enough resolution to investigate these relationships. However, the resulting data from these simulations will be far too large to save for post-simulation analysis. We advocate for fitting statistical models inside the simulations as they run, a context known as in situ, which will facilitate scientific investigations using the full fine-scale data stream. Figure 1 shows an example of the type of model we could consider, a Bayesian hierarchical spatial regression model. Precipitation extremes at each grid cell are modeled using extreme value distributions. Since extremes are rare, fitting models to individual grid cells can result in high variance and poor estimates. Instead, the model can be made more robust by smoothing the parameters of the extreme value model across space. Additionally, the parameters themselves can be functionally linked to other variables elsewhere in the simulation. Thus, we can use the fine-scale data to build more robust models for extremes that link extreme behavior to other climate patterns.

54 ENVIRONMENTAL SCIENCES↗

In Situ Inference for Earth System Predictability

Focal Area: Focal Area 3: Insight gleaned from complex simulated data using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: An understanding of future evolution in precipitation extremes is critical to numerous DOE mission questions. Extreme events are by nature short time-scale events that are difficult to diagnose in available model data. Accurate modeling of extreme events necessarily requires high spatial resolution at the storm scale locally. However, the environment in which storms grow is dependent on global, remote, processes. These complex spatiotemporal relationships are impossible to diagnose at resolutions required to accurately model storms responsible for extreme precipitation. At exascale, climate simulations will produce results at fine enough resolution to investigate these relationships. However, the resulting data from these simulations will be far too large to save for post-simulation analysis. We advocate for fitting statistical models inside the simulations as they run, a context known as in situ, which will facilitate scientific investigations using the full fine-scale data stream. Figure 1 shows an example of the type of model we could consider, a Bayesian hierarchical spatial regression model. Precipitation extremes at each grid cell are modeled using extreme value distributions. Since extremes are rare, fitting models to individual grid cells can result in high variance and poor estimates. Instead, the model can be made more robust by smoothing the parameters of the extreme value model across space. Additionally, the parameters themselves can be functionally linked to other variables elsewhere in the simulation. Thus, we can use the fine-scale data to build more robust models for extremes that link extreme behavior to other climate patterns.

54 ENVIRONMENTAL SCIENCES↗

Integrating Solar Induced Fluorescence and the Photochemical Reflectance Index for Estimating Gross Primary Production in a Cornfield

The utilization of remotely sensed observations for light use efficiency (LUE) and tower-based gross primary production (GPP) estimates was studied in a USDA cornfield. Nadir hyperspectral reflectance measurements were acquired at canopy level during a collaborative field campaign conducted in four growing seasons. The Photochemical Reflectance Index (PRI) and solar induced chlorophyll fluorescence (SIF), were derived. SIF retrievals were accomplished in the two telluric atmospheric oxygen absorption features centered at 688 nm (O2-B) and 760 nm (O2-A). The PRI and SIF were examined in conjunction with GPP and LUE determined by flux tower-based measurements. All of these fluxes, environmental variables, and the PRI and SIF exhibited diurnal as well as day-to-day dynamics across the four growing seasons. Consistent with previous studies, the PRI was shown to be related to LUE (r2 = 0.54 with a logarithm fit), but the relationship varied each year. By combining the PRI and SIF in a linear regression model, stronger performances for GPP estimation were obtained. The strongest relationship (r2 = 0.80, RMSE = 0.186 mg CO2/m2/s) was achieved when using the PRI and SIF retrievals at 688 nm. Cross-validation approaches were utilized to demonstrate the robustness and consistency of the performance. This study highlights a GPP retrieval method based entirely on hyperspectral remote sensing observations.

cornfield↗

Bayesian Design of Experiments for Logistic Regression to Evaluate Multiple Forensic Algorithms

When evaluating the performance of several forensic classification algorithms, it is desirable to construct a design that considers a variety of performance levels for each of the algorithms. We describe a strategy to use Bayesian design of experiments with multiple prior estimates to capture anticipated performance. Our goal is to characterize results from the different classification algorithms as a function of multiple explanatory variables and use this to choose a design about which units to test. Bayesian design of experiments has been successful for generalized linear models, including logistic regression models. Here, we develop methodology for the case where there are several potentially nonoverlapping priors for anticipated performance under consideration. The weighted priors method performs well for a broad range of true underlying model parameter choices and is more robust when compared to other candidate design choices. Additionally, we show how this can be applied in the multivariate input case and provide some useful summary measures. The shared information plot is used to evaluate design point allocation, and the D-value difference plot allows for the comparison of design performance across multiple potential parameter values in higher dimensions. Here, we illustrate the methods with several examples.

97 MATHEMATICS AND COMPUTING↗

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗