Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A leaf-level spectral library to support high-throughput plant phenotyping: predictive accuracy and model transfer

Abstract Leaf-level hyperspectral reflectance has become an effective tool for high-throughput phenotyping of plant leaf traits due to its rapid, low-cost, multi-sensing, and non-destructive nature. However, collecting samples for model calibration can still be expensive, and models show poor transferability among different datasets. This study had three specific objectives: first, to assemble a large library of leaf hyperspectral data (n=2460) from maize and sorghum; second, to evaluate two machine-learning approaches to estimate nine leaf properties (chlorophyll, thickness, water content, nitrogen, phosphorus, potassium, calcium, magnesium, and sulfur); and third, to investigate the usefulness of this spectral library for predicting external datasets (n=445) including soybean and camelina using extra-weighted spiking. Internal cross-validation showed satisfactory performance of the spectral library to estimate all nine traits (mean R2=0.688), with partial least-squares regression outperforming deep neural network models. Models calibrated solely using the spectral library showed degraded performance on external datasets (mean R2=0.159 for camelina, 0.337 for soybean). Models improved significantly when a small portion of external samples (n=20) was added to the library via extra-weighted spiking (mean R2=0.574 for camelina, 0.536 for soybean). The leaf-level spectral library greatly benefits plant physiological and biochemical phenotyping, whilst extra-weight spiking improves model transferability and extends its utility.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2020

Statistical Analysis of Factors Riving Surface Ozone Variability over Continental South Africa

Statistical relationships between surface ozone (O3) concentration, precursor species and meteorological conditions in continental South Africa were examined from data obtained from measurement stations in north-eastern South Africa. Three multivariate statistical methods were applied in the investigation, i.e. multiple linear regression (MLR), principal component analysis (PCA) and –regression (PCR), and generalised additive model (GAM) analysis. The daily maximum 8-h moving average O3 concentrations were considered in these statistical models (dependent variable). MLR models indicated that meteorology and precursor species concentrations are able to explain ~50% of the variability in daily maximum O3 levels. MLR analysis revealed that atmospheric carbon monoxide (CO), temperature and relative humidity were the strongest factors affecting the daily O3 variability. In summer, daily O3 variances were mostly associated with relative humidity, while winter O3 levels were mostly linked to temperature and CO. PCA indicated that CO, temperature and relative humidity were not strongly collinear. GAM also identified CO, temperature and relative humidity as the strongest factors affecting the daily variation of O3. Partial residual plots found that temperature, radiation and nitrogen oxides most likely have a non-linear relationship with O3,while the relationship with relative humidity and CO is probably linear. An inter-comparison between O3 levels modelled with the three statistical models compared to measured O3 concentrations showed that the GAM model offered a slight improvement over the MLR model. These findings emphasise the critical role of regional-scale O3 precursors coupled with meteorological conditions in daily variances of O3 levels in continental South Africa.

multiple linear regression (MLR)↗
DOE OSTI2025

Developing a robust strength model using physically-informed genetic programming

The strength of materials is influenced by a range of external conditions, such as temperature and deformation rate. Consequently, materials that demonstrate substantial variations in their mechanical behavior due to fluctuations in temperature and strain rate require complex strength models to accurately predict material performance in real-world applications. To predict such complex behavior, a robust and flexible strength model is necessary. In this work, we utilize genetic programming-based symbolic regression (GPSR) to develop data-driven strength models that accurately represent the measured stress–strain responses of tin across a wide range of strain, strain rate and temperature regimes. The GPSR models are constrained by physically-informed conditions, which leads to significant improvement in extrapolation. The best model is integrated into a multi-physics code to perform Taylor impact simulations, validating the model’s accuracy and robustness. In conclusion, the model predictions showed excellent agreement with experimental results, particularly when compared to predictions using traditional strength models.

Genetic programming↗
DOE OSTI2021

Can Simple Machine Learning Tools Extend and Improve Temperature-Based Methods to Infer Streambed Flux?

Temperature-based methods have been developed to infer 1D vertical exchange flux between a stream and the subsurface. Current analyses rely on fitting physically based analytical and numerical models to temperature time series measured at multiple depths to infer daily average flux. These methods have seen wide use in hydrologic science despite strong simplifying assumptions including a lack of consideration of model structural error or the impacts of multidimensional flow or the impacts of transient streambed hydraulic properties. We performed a “perfect-model experiment” investigation to examine whether regression trees, with and without gradient boosting, can extract sufficient information from model-generated subsurface temperature time series, with and without added measurement error, to infer the corresponding exchange flux time series at the streambed surface. Using model-generated, synthetic data allowed us to assess the basic limitations to the use of machine learning; further examination of real data is only warranted if the method can be shown to perform well under these ideal conditions. We also examined whether the inherent feature importance analyses of tree-based machine learning methods can be used to optimize monitoring networks for exchange flux inference.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1995

Integrated design and manufacturing for the high speed civil transport (a combined aerodynamics/propulsion optimization study)

This report documents the efforts of a Georgia Tech High Speed Civil Transport (HSCT) aerospace student design team in completing a design methodology demonstration under NASA's Advanced Design Program (ADP). Aerodynamic and propulsion analyses are integrated into the synthesis code FLOPS in order to improve its prediction accuracy. Executing the integrated product and process development (IPPD) methodology proposed at the Aerospace Systems Design Laboratory (ASDL), an improved sizing process is described followed by a combined aero-propulsion optimization, where the objective function, average yield per revenue passenger mile ($/RPM), is constrained by flight stability, noise, approach speed, and field length restrictions. Primary goals include successful demonstration of the application of the response surface methodolgy (RSM) to parameter design, introduction to higher fidelity disciplinary analysis than normally feasible at the conceptual and early preliminary level, and investigations of relationships between aerodynamic and propulsion design parameters and their effect on the objective function, $/RPM. A unique approach to aircraft synthesis is developed in which statistical methods, specifically design of experiments and the RSM, are used to more efficiently search the design space for optimum configurations. In particular, two uses of these techniques are demonstrated. First, response model equations are formed which represent complex analysis in the form of a regression polynomial. Next, a second regression equation is constructed, not for modeling purposes, but instead for the purpose of optimization at the system level. Such an optimization problem with the given tools normally would be difficult due to the need for hard connections between the various complex codes involved. The statistical methodology presents an alternative and is demonstrated via an example of aerodynamic modeling and planform optimization for a HSCT.

Baecher, Juergen↗
NASA NTRS1996

Calbindins decreased after space flight

Exposure of the body to microgravity during space flight causes a series of well-documented changes in Ca2+ metabolism, yet the cellular and molecular mechanisms leading to these changes are poorly understood. Calbindins, vitamin D-dependent Ca2+ binding proteins, are believed to have a significant role in maintaining cellular Ca2+ homeostasis. In this study, we used biochemical and immunocytochemical approaches to analyze the expression of calbindin-D28k and calbindin-D9k in kidneys, small intestine, and pancreas of rats flown for 9 d aboard the space shuttle. The effects of microgravity on calbindins in rats from space were compared with synchronous Animal Enclosure Module controls, modeled weightlessness animals (tail suspension), and their controls. Exposure to microgravity resulted in a significant and sustained decrease in calbindin-D28k content in the kidney and calbindin-D9k in the small intestine of flight animals, as measured by enzyme-linked immunosorbent assay (ELISA). Modeled weightlessness animals exhibited a similar decrease in calbindins by ELISA. Immunocytochemistry (ICC) in combination with quantitative computer image analysis was used to measure in situ the expression of calbindins in the kidney and the small intestine, and the expression of insulin in pancreas. There was a large decrease of immunoreactivity in renal distal tubular cell-associated calbindin-D28k and in intestinal absorptive cell-associated calbindin-D9k of space flight and modeled weightlessness animals compared with matched controls. No consistent difference in pancreatic insulin immunoreactivity between space flight, modeled weightlessness, and controls was observed. Regression analysis of results obtained by quantitative ICC and ELISA for space flight, modeled weightlessness animals, and their controls demonstrated a significant correlation. These findings after a short-term exposure to microgravity or modeled weightlessness suggest that a decreased expression of calbindins may contribute to the disorders of Ca2+ metabolism induced by space flight.

Non-NASA Center↗
NASA NTRS2022

A Deep Learning Approach to Fast Radiative Transfer

Due to the sheer volume of data, leveraging satellite instrument observations effectively in a data assimilation context for numerical weather prediction or for remote sensing requires a radiative transfer model as an observation operator that is both fast and accurate at the same time. Physics-based line-by-line radiative transfer (RT) models fulfil the requirement for accuracy, but are too slow and too costly in computational terms for operational applications. Therefore, fast methods were developed to be able to perform fast RT calculations using techniques such as spectral sampling or pre-computed look-up tables. The operational fast models currently calculate the absorption and scattering coefficients from the pre-computed regression coefficients and atmospheric state and cloud profiles. As a novel solution to this problem, this work investigates a deep learning approach to replace the regression coefficients in the fast RT models. A selection of hidden-layer neural network configurations is trained against atmospheric transmittance profile data computed by an accurate line-by-line model and their performance is evaluated and their advantages and disadvantages are discussed.

Machine learning↗
DOE OSTI2025

Rate expressions and kinetic parameters for metal ferrites in relation to applications of fossil fuel conversion to hydrogen: Part 1 of 2

Here, the goal of the present work was to provide the necessary reaction emulation information to enable detailed process simulation of a chemical looping H 2 production system from fossil fuels using CaFe 2 O 4 . This specifically pertained to the necessary kinetic data, reaction model development, and model rate parameters required for reaction emulation in both reducing and oxidizing environments. A logical methodology was defined, which included discretization of the reaction network, establishing a core model for reaction emulation that could be adapted based on the system phenomena, and development of a rate parameter regression tool designed around the core model. An extensive array of data sets was acquired by which parametric regressions were performed. The work presented and tabulated a comprehensive set of rate parameters for the reduction and oxidation reactions of CaFe 2 O 4 and descendent phases of Ca 2 Fe 2 O 5 , FeO, Fe 3 O 4 , Fe, and CaO to emulate reaction behavior in a looping-based process environment. This included direct reduction using CH 4 , H 2 , and CO, and direct oxidation reactions with steam, CO 2 and O 2 . Dynamic equilibrium was quantified for reactions that could utilize H 2 O and CO 2 as soft oxidants to re-saturate lattice oxygen in the depleted structure/phases. The kinetics associated with the oxidative mechanisms with the soft oxidants were quantified and compared to those of the reducing counterparts. The analysis provided critical insight to emulate reactions for a process that seeks to use natural gas (NG) or other fossil fuels as a direct reductant for the end goal of H 2 production.

calcium ferrite oxygen carriers↗
DOE OSTI2026

Taming nuclear mass models with Gaussian processes

We propose a new set of nuclear mass predictions based on multiple theoretical mass models. By employing Gaussian process regression with the Matérn kernel, we achieved root-mean-square (rms) deviations below 100 keV for the training dataset. The best-performing mass models achieved rms deviations below 150 keV for the new precise mass data from AME2020, whereas the ensemble average showed robust performance across the nuclear chart. Our approach uniquely combines: (1) systematic refinement of eight mass models through their residuals, (2) physics-informed features, including magic numbers, nucleon parity numbers, neutron excess, and nuclear collectivity, and (3) theory-to-theory validation demonstrating robust extrapolation capability. We find that the Matérn kernel provides superior uncertainty quantification compared to the RBF kernel, with a length-scale analysis revealing enhanced inter-nuclei correlations. We provide complete mass predictions for all unknown nuclides in AME2020, offering valuable constraints for nuclear structure studies and astrophysical modeling when used with proper uncertainty propagation.

Gaussian processes↗
DOE OSTI2021

Mechanical Loads on Spent Nuclear Fuel in the General 30 cm Package Drop Scenario

The U.S. Department of Energy Office of Nuclear Energy (DOE-NE) Spent Fuel and Waste Science & Technology (SFWST) research program is guided by the high-level goal of closing prioritized knowledge gaps related to spent nuclear fuel (SNF) storage and transportation, which are summarized by Saltzstein et al. (2020). One of the high-priority knowledge gaps is the identification and quantification of mechanical loads that are expected to affect SNF during normal conditions of transportation and storage to inform the range of physical SNF test programs. This report uses modeling and analysis methods to estimate the mechanical loads on spent nuclear fuel (SNF) in the general 30 cm package drop scenario. The drop scenario assumes impact limiters are in place in the transportation configuration and the impact surface is perfectly rigid. The goal of this analysis is to consider the universe of potential mechanical loading conditions that can happen to SNF and present the results in a manner that is useful for materials testing, decision making, and regulatory rule making purposes. This study uses validated finite element models and methods to perform a broad parametric study of key variables that can affect the mechanical loads on SNF during a hypothetical package free drop scenario. Physical drop test data from a cask and fuel assembly drop test campaign is the basis for model validation. Additionally, the results of the parametric study are used to inform a damage model, which uses multiple nonlinear regression to estimate the relationships between input variables and output response. The parametric finite element analyses consider thousands of input variable combinations, while the damage model estimates millions of combinations. The breadth of this study provides confidence that the potential range of mechanical loads that SNF might experience during the general 30 cm package drop scenario are characterized well enough to consider this knowledge gap closed. While this report documents the overall peak values calculated in this study, the 95 th percentile values, the histograms, and the observed trends are equally important. This study covered a large range of SNF temperatures, room temperature to 300°C, and burnups, 10 GWd/MTU to 62 GWd/MTU. Each temperature and burnup combination has a different cladding yield strain, so it is more meaningful to summarize the calculated cladding strain response as its factor of safety, which is defined relative to the yield strain. The factor of safety is calculated as the yield strain divided by the peak cladding strain. A factor of safety greater than unity indicates that the cladding remains below yield, whereas a value less than unity is indicative of plastic deformation. In all cases of this study a safety factor over 1.0 was calculated, although in the most limiting case at 300°C the safety factor was only 1.01, which suggests that yielding could occur when additional loads like rod internal pressure are included. When the temperature is restricted to 200°C the limiting safety factor increases to 1.28, which has significant margin to accommodate internal pressure and potential local cladding defects that could cause a local stress concentration. An important trend in the calculated fuel rod mechanical loads is that the 2 nd highest loaded fuel rod in an assembly tends to be significantly lower than the highest loaded rod. The implication is that even if one rod in an assembly experiences a failure the loads would have to be significantly higher to cause two or more rods to fail.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model

Foundation models for astronomical surveys offer powerful learned representations that can be transferred to downstream regression tasks such as galaxy property estimation. However, point predictions alone are insufficient for scientific inference; reliable uncertainty quantification (UQ) is essential. We compare seven UQ methods on galaxy property regression using frozen AION-1 foundation-model embeddings, predicting redshift, stellar mass, stellar-population age, gas-phase metallicity, and specific star-formation rate, from Legacy Survey photometry/imaging and DESI spectra, with PROVABGS-derived labels. Distribution-free conformal methods achieve marginal coverage within $\sim$1 pp of the nominal 90% across all properties, while non-conformal baselines (Deep Ensembles, MC~Dropout) fail to calibrate reliably. Among conformal approaches, Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions. More importantly, only the Locally Valid and Discriminative (LVD) framework -- particularly when operating on AION-1 embeddings -- also provides finite-sample \emph{local validity}, producing intervals that adapt to each galaxy's local prediction difficulty rather than relying on marginal guarantees alone. These results establish conformal prediction, and LVD in particular, as the preferred UQ framework for uncertainty-aware inference on foundation-model embeddings in astrophysics.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
DOE OSTI2023

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Foliar functional traits from imaging spectroscopy across biomes in eastern North America

Summary Foliar functional traits are widely used to characterize leaf and canopy properties that drive ecosystem processes and to infer physiological processes in Earth system models. Imaging spectroscopy provides great potential to map foliar traits to characterize continuous functional variation and diversity, but few studies have demonstrated consistent methods for mapping multiple traits across biomes. With airborne imaging spectroscopy data and field data from 19 sites, we developed trait models using partial least squares regression, and mapped 26 foliar traits in seven NEON (National Ecological Observatory Network) ecoregions (domains) including temperate and subtropical forests and grasslands of eastern North America. Model validation accuracy varied among traits (normalized root mean squared error, 9.1–19.4%; coefficient of determination, 0.28–0.82), with phenolic concentration, leaf mass per area and equivalent water thickness performing best across domains. Across all trait maps, 90% of vegetated pixels had reasonable values for one trait, and 28–81% provided high confidence for multiple traits concurrently. Maps of 26 traits and their uncertainties for eastern US NEON sites are available for download, and are being expanded to the western United States and tundra/boreal zone. These data enable better understanding of trait variations and relationships over large areas, calibration of ecosystem models, and assessment of continental‐scale functional diversity.

Wang, Zhihui↗
NASA NTRS1974

Chain pooling to minimize prediction error in subset regression

Monte Carlo studies using population models intended to represent response surface applications are reported. Simulated experiments were generated by adding pseudo random normally distributed errors to population values to generate observations. Model equations were fitted to the observations and the decision procedure was used to delete terms. Comparison of values predicted by the reduced models with the true population values enabled the identification of deletion strategies that are approximately optimal for minimizing prediction errors.

Holms, A. G.↗
NASA NTRS2006

Studies in Software Cost Model Behavior: Do We Really Understand Cost Model Performance?

While there exists extensive literature on software cost estimation techniques, industry practice continues to rely upon standard regression-based algorithms. These software effort models are typically calibrated or tuned to local conditions using local data. This paper cautions that current approaches to model calibration often produce sub-optimal models because of the large variance problem inherent in cost data and by including far more effort multipliers than the data supports. Building optimal models requires that a wider range of models be considered while correctly calibrating these models requires rejection rules that prune variables and records and use multiple criteria for evaluating model performance. The main contribution of this paper is to document a standard method that integrates formal model identification, estimation, and validation. It also documents what we call the large variance problem that is a leading cause of cost model brittleness or instability.

data mining↗
NASA NTRS2010

Modeling Fire Severity in Black Spruce Stands in the Alaskan Boreal Forest Using Spectral and Non-Spectral Geospatial Data

Biomass burning in the Alaskan interior is already a major disturbance and source of carbon emissions, and is likely to increase in response to the warming and drying predicted for the future climate. In addition to quantifying changes to the spatial and temporal patterns of burned areas, observing variations in severity is the key to studying the impact of changes to the fire regime on carbon cycling, energy budgets, and post-fire succession. Remote sensing indices of fire severity have not consistently been well-correlated with in situ observations of important severity characteristics in Alaskan black spruce stands, including depth of burning of the surface organic layer. The incorporation of ancillary data such as in situ observations and GIS layers with spectral data from Landsat TM/ETM+ greatly improved efforts to map the reduction of the organic layer in burned black spruce stands. Using a regression tree approach, the R2 of the organic layer depth reduction models was 0.60 and 0.55 (pb0.01) for relative and absolute depth reduction, respectively. All of the independent variables used by the regression tree to estimate burn depth can be obtained independently of field observations. Implementation of a gradient boosting algorithm improved the R2 to 0.80 and 0.79 (pb0.01) for absolute and relative organic layer depth reduction, respectively. Independent variables used in the regression tree model of burn depth included topographic position, remote sensing indices related to soil and vegetation characteristics, timing of the fire event, and meteorological data. Post-fire organic layer depth characteristics are determined for a large (N200,000 ha) fire to identify areas that are potentially vulnerable to a shift in post-fire succession. This application showed that 12% of this fire event experienced fire severe enough to support a change in post-fire succession. We conclude that non-parametric models and ancillary data are useful in the modeling of the surface organic layer fire depth. Because quantitative differences in post-fire surface characteristics do not directly influence spectral properties, these modeling techniques provide better information than the use of remote sensing data alone.

Barrett, K.↗
NASA NTRS2001

An Analysis of Simulated and Observed Global Mean Near-Surface Air Temperature Anomalies from 1979 to 1999: Trends and Attribution of Causes

The 1979 - 1999 response of the climate system to variations in solar spectral irradiance is estimated by comparing the global averaged surface temperature anomalies simulated by a 2D (two dimensional) energy balance climate model to observed temperature anomalies. We perform a multiple regression of southern oscillation index and the individual model responses to solar irradiance variations, stratospheric and tropospheric aerosol loading, stratospheric ozone trends, and greenhouse gases onto each of five near-surface temperature anomaly data sets. We estimate the observed difference in global mean near surface air temperature attributable to the solar irradiance difference between solar maximum and solar minimum to be between 0.06 and 0.11 K, and that 1.1 - 3.8% of the total variance in monthly mean near-surface air temperature data is attributable to nations in solar spectral irradiance. For the five temperature data sets used in our analysis, the trends in raw monthly mean temperature anomaly data have a large range, spanning a factor of 3 from 0.06 to 0.17 K/decade. However. our analysis suggests that trends in monthly temperature anomalies attributable to the combination of greenhouse gas, stratospheric ozone, and tropospheric sulfate aerosol variations are much more consistent among data sets, ranging from 0.16 to 0.24 K/decade. Our model results suggest that roughly half of the warming from greenhouse gases is cancelled by the cooling from changes in stratospheric ozone. Tropospheric sulfate aerosol loading in the present day atmospheric contributes significantly to the net radiative forcing of the present day climate system. However, because the change in magnitude and latitudinal distribution of tropospheric sulfate aerosol has been small over the past 20 years, the change in the direct radiative forcing attributable to changes in aerosol loading over this time is also small.

MacKay, R. M.↗