SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

All sources NASA NTRS DOE OSTI

NASA NTRS1988

Production of Be-10 in stony meteorites - Composition dependence

The relationship between the production rate of Be-10 in stony meteorites and its element composition was investigated by measuring the contents of Be-10 in 21 samples from 17 meteorites with known major-element composition, and comparing the experimental Be-10 values with those obtained by the regression analysis. The Be-10 production was modeled by the equation of Stauffer (1962). The measured Be-10 contents were found to range from 16 dpm/kg in the oxygen- and magnesium-poor eucrites and the Indarch meteorite to 28 dpm/kg in the oxygen- and magnesium-rich aubrites and the mineral separates from Bruderheim. Using the regression analyses and taking in account various corrections, an equation was obtained which reproduces the measured Be-10 content with an accuracy of about 10 percent.

Moniot, R. K.↗

DOE OSTI2022

Effect of vaccination on the case fatality rate for COVID-19 infections 2020–2021: multivariate modelling of data from the US Department of Veterans Affairs

Objectives: To evaluate the benefits of vaccination on the case fatality rate (CFR) for COVID-19 infections. Design, setting and participants: The US Department of Veterans Affairs has 130 medical centres. We created multivariate models from these data—339 772 patients with COVID-19—as of 30 September 2021. Outcome measures: The primary outcome for all models was death within 60 days of the diagnosis. Logistic regression was used to derive adjusted ORs for vaccination and infection with Delta versus earlier variants. Models were adjusted for confounding factors, including demographics, comorbidity indices and novel parameters representing prior diagnoses, vital signs/baseline laboratory tests and outpatient treatments. Patients with a Delta infection were divided into eight cohorts based on the time from vaccination to diagnosis. A common model was used to estimate the odds of death associated with vaccination for each cohort relative to that of unvaccinated patients. Results: 9.1% of subjects were vaccinated. 21.5% had the Delta variant. 18 120 patients (5.33%) died within 60 days of their diagnoses. The adjusted OR for a Delta infection was 1.87±0.05, which corresponds to a relative risk (RR) of 1.78. The overall adjusted OR for prior vaccination was 0.280±0.011 corresponding to an RR of 0.291. Raw CFR rose steadily after 10–14 weeks. The OR for vaccination remained stable for 10–34 weeks. Conclusions: Our CFR model controls for the severity of confounding factors and priority of vaccination, rather than solely using the presence of comorbidities. Our results confirm that Delta was more lethal than earlier variants and that vaccination is an effective means of preventing death. After adjusting for major selection biases, we found no evidence that the benefits of vaccination on CFR declined over 34 weeks. We suggest that this model can be used to evaluate vaccines designed for emerging variants.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2005

A Note on the Relationship between Temperature and Water Vapor in Quasi-Equilibrium and Climate States

An ideal and simple formulation is successfully derived that well represents a quasi-linear relationship found between the domain-averaged water vapor, q (mm), and temperature, T (K), fields obtained from a series of quasi-equilibrium (long-term) simulations for the Tropics using the two-dimensional Goddard Cumulus Ensemble (GCE) model. Earlier model work showed that the forced maintenance of two different wind profiles in the Tropics leads to two different equilibrium states. Investigating this finding required investigation of the slope of the moisture-temperature relations, which turns out to be linear in the Tropics. The extra-tropical climate equilibriums become more complex, but insight on modeling sensitivity can be obtained by linear stepwise regression of the integrated temperature and humidity. A globally curvilinear moisture-temperature distribution, similar to the famous Clausius-Clapeyron curve (i.e., saturated water vapor pressure versus temperature), is then found in this study. Such a genuine finding clarifies that the dynamics are crucial to the climate (shown in the earlier work) but the thermodynamics adjust. The range of validity of this result is further examined herein. The GCE-modeled tropical domain-averaged q and T fields form a linearly-regressed "q-T" slope that genuinely resides within an ideal range of slopes obtained from the aforementioned formulation. A quantity (denoted as dC2/dC1) representing the derivative between the static energy densities due to temperature (C2) and water vapor (C1) for various quasi-equilibrium states can also be obtained. A dC2/dC1 value near unity obtained for the GCE-modeled tropical simulations implies that the static energy densities due to moisture and temperature only differ by a pure constant for various equilibrium states. An overall q-T relation also including extra-tropical regions is, however, found to have a curvilinear relationship. Accordingly, warm/moist regions favor change in water vapor faster than temperature, while cold/dry regions favor an increase in temperature quicker than water vapor.

Shie, C.-L.↗

DOE OSTI2022

A Comparative Study of Machine Learning Algorithms for Industry-Specific Freight Generation Model

According to Bureau of Transportation Statistics, the U.S. transportation system handled 14,329 million ton-miles of freight per day in 2020. Understanding the generation of these freight shipments is crucial for transportation researchers, planners, and policymakers to design and plan for a more efficient and connected freight transportation system. Traditionally, the freight generation modeling has been based on Ordinary Least Square (OLS) regression, although more advanced Machine Learning (ML) algorithms have been evaluated and proven to have excellent performance in various transportation applications in recent years. Furthermore, one modeling approach applied for one industry might not always be applicable for another as their freight generation logics can be quite different. The objective of this study is to apply and evaluate alternative ML algorithms in the estimation of freight generation for each of 45 industry types. Seven alternative ML algorithms, along with the base OLS regression, were evaluated and compared. In addition, the study considered different combinations of variables in both the original and logarithmic form as well as hyperparameters of those ML algorithms in the model selection for each industry type. The results showed statistically significant improvements in the root mean square error reduction by the alternative ML algorithms over the OLS for over 80% of cases. The study suggests utilizing the alternative ML algorithms can reduce the root mean square error by about 30%, depending on industry types.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

How analytic choices can affect the extraction of electromagnetic form factors from elastic electron scattering cross section data

Scientists often try to incorporate prior knowledge into their regression algorithms, such as a particular analytic behavior or a known value at a kinematic endpoint. Unfortunately, there is often no unique way to make use of this prior knowledge, and thus, different analytic choices can lead to very different regression results from the same set of data. In this paper, to illustrate this point in the context of the proton electromagnetic form factors, we use the Mainz elastic data with its 1422 cross section points and 31 normalization parameters. Starting with a complex unbound non-linear regression, we will show how the addition of a single theory-motivated constraint removes an oscillation from the magnetic form factor and shifts the extracted proton charge radius. We then repeat both regressions using the same algorithm, but with a rebinned version of the Mainz dataset. These examples illustrate how analytic choices, such as the function that is being used or even the binning of the data, can dramatically affect the results of a complex regression. These results also demonstrate why it is critical when using regression algorithms to have either a physical model in mind or a firm mathematical basis

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems With High Levels of Inverter-Based Resources

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression-based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power-hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗

DOE OSTI2025

Convolutional Neural Networks Trained on Internal Variability Predict Forced Response of TOA Radiation by Learning the Pattern Effect

Abstract Predicting forced, long‐term radiative feedbacks from internal climate variability has been a decades‐long quest in climate science. We train a convolutional neural network (CNN) to predict annual‐ and global‐mean top of the atmosphere radiation anomalies from time‐varying maps of near‐surface temperature in climate models. Trained on internal variability alone, the nonlinear CNN can predict radiation under strong climate change, outperforms a regularized linear regression approach, and works within and across different climate models. We show with explainable artificial intelligence methods that the CNN draws predictive skill from physically meaningful regions but at much smaller spatial scales than currently assumed.

Rugenstein, Maria [Colorado State University Fort ↗

DOE OSTI2020

Little influence of Arctic amplification on mid-latitude climate

Observations and model simulations show enhanced warming in the Arctic under increasing greenhouse gases, a phenomenon known as the Arctic amplification (AA), that is likely caused by sea-ice loss. AA reduces meridional temperature gradients linked to circulation, thus mid-latitude weather and climate changes have been attributed to AA, often on the basis of regression analysis and atmospheric simulations. However, other modelling studies show only a weak link. This inconsistency may result from deficiencies in separating the effects of AA from those of natural variability or background warming. In this work, using coupled model simulations with and without AA, we show that cold-season precipitation, snowfall and circulation changes over northern mid-latitudes come mostly from background warming. AA and sea-ice loss increase precipitation and snowfall above ~60° N and reduce meridional temperature gradients above ~45° N in the lower–mid troposphere. However, minimal impact on the mean climate is seen below ~60° N, with weak reduction in zonal wind over 50°–70° N and 150–700 hPa, mainly over the North Atlantic and northern central Asia. These results suggest that the climatic impacts of AA are probably small outside the high latitudes, thus caution is needed in attributing mid-latitude changes to AA and sea-ice loss on the basis of statistical analyses that cannot distinguish the impact of AA from other correlated changes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Regressing Nuclear Reactor Power Level Using Low-Cost Sensor Network Data

Multisensor networks deployed at nuclear facilities can be leveraged to collect data used as inputs to machine learning models predicting nuclear safeguard relevant information. This work demonstrates an application of this idea by regressing nuclear reactor power levels, a key indicator for nuclear safeguard verification, at the McClellan Nuclear Research Center using data collected by five Merlyn multisensor platforms with LASSO and LSTM models. This work also demonstrates the use of Leave One Node Out to measure the importance of each multisensor for this regression problem providing insight into model explainability and allowing inferential hypotheses about the nuclear facility to be made. This work can be used as a starting point for future development of methods for regression on reactor power levels at nuclear facilities using multisensor network data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2026

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]↗

DOE OSTI2020

Model independent comparison of supernova and strong lensing cosmography: Implications for the Hubble constant tension

We use supernovae measurements, calibrated by the local determination of the Hubble constant $H_0$ by SH0ES, to interpolate the distance-redshift relation using Gaussian process regression. We then predict, independent of the cosmological model, the distances that are measured with strong lensing time delays to test their mutual agreement. In this work we find excellent agreement between these predictions and the measurements. The agreement holds when we consider only the redshift dependence of the distance-redshift relation, independent of the value of $H_0$. Our results disfavor the possibility that lens mass modeling contributes a 10% bias or uncertainty in the strong lensing analysis, as suggested recently in the literature. In general our analysis strengthens the case that residual systematic errors in both measurements are below the level of the current discrepancy with the CMB determination of $H_0$, and supports the possibility of new physical phenomena on cosmological scales. With additional data our methodology can provide more stringent tests of unaccounted for systematics in the determinations of the distance-redshift relation in the late universe.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Non-destructive measurement and real-time monitoring of apple hardness during ultrasonic contact drying via portable NIR spectroscopy and machine learning

Portable near-infrared spectrometer in the spectral range of 900–1700 nm was evaluated for the first time to assess and monitor apple hardness in real-time during ultrasonic drying. Calibration models were developed using PLS and ANN, and their performances were evaluated by internal leave-one-out cross-validation and an external dataset. Several pre-treatments including standard normal variate (SNV), multiplicative scatter correction (MSC), Savitzky–Golay first and second derivatives were employed to examine the effects of spectral variations in hardness prediction. Seven important wavelengths were selected using weighted regression coefficients to develop a simple MLR model to facilitate the model interpretation and circumvent noise. The models using PLS, MLR, and ANN with selected wavelengths predicted the apple hardness with R 2 p of 0.91, 0.91, 0.95, and RMSEP of 14.78, 14.85, and 12.46 N, respectively. Finally, the results indicate that portable NIR spectrometers are quite promising for real-time monitoring of apple hardness during ultrasonic drying.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Robust Design Under Uncertainty in Quantum Error Mitigation

Error mitigation techniques are crucial to achieving near-term quantum advantage. Classical postprocessing of quantum computation outcomes is a popular approach for error mitigation, which includes methods, such as zero noise extrapolation, virtual distillation, and learning-based error mitigation. However, these techniques have limitations due to the propagation of uncertainty resulting from the finite shot number of a quantum measurement. In this work, we introduce general and unbiased methods for quantifying the uncertainty and error of error-mitigated observables based on the strategic sampling of error mitigation outcomes. We then extend our approach to demonstrate the optimization of performance and robustness of error mitigation under uncertainty. To illustrate our methods, we apply them to zero noise extrapolation and Clifford date regression in the ground state of the XY model simulated using depolarizing and International Business Machines Corporation (IBM) Toronto noise models, respectively. In particular, we optimize the choice of noise levels and the allocation of shots for zero noise extrapolation and the distribution of the training circuits for Clifford data regression. While our methods are readily applicable to any postprocessing-based error mitigation approach, in practice they must not be prohibitively expensive—even though they perform optimizations of the error mitigation hyperparameters requiring sampling of a statistical distribution of error mitigation outcomes. By leveraging surrogate-based optimization, we show that our methods can efficiently perform optimal design for a zero noise extrapolation implementation. We then further demonstrate the transferability of learned zero noise extrapolation hyperparameters to other similar circuits.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Aerodynamic parameters of High-Angle-of attack Research Vehicle (HARV) estimated from flight data

Aerodynamic parameters of the High-Angle-of-Attack Research Aircraft (HARV) were estimated from flight data at different values of the angle of attack between 10 degrees and 50 degrees. The main part of the data was obtained from small amplitude longitudinal and lateral maneuvers. A small number of large amplitude maneuvers was also used in the estimation. The measured data were first checked for their compatibility. It was found that the accuracy of air data was degraded by unexplained bias errors. Then, the data were analyzed by a stepwise regression method for obtaining a structure of aerodynamic model equations and least squares parameter estimates. Because of high data collinearity in several maneuvers, some of the longitudinal and all lateral maneuvers were reanalyzed by using two biased estimation techniques, the principal components regression and mixed estimation. The estimated parameters in the form of stability and control derivatives, and aerodynamic coefficients were plotted against the angle of attack and compared with the wind tunnel measurements. The influential parameters are, in general, estimated with acceptable accuracy and most of them are in agreement with wind tunnel results. The simulated responses of the aircraft showed good prediction capabilities of the resulting model.

Klein, Vladislav↗

NASA NTRS2004

Analysis of Wind Tunnel Lateral Oscillatory Data of the F-16XL Aircraft

Static and dynamic wind tunnel tests were performed on an 18% scale model of the F-16XL aircraft. These tests were performed over a wide range of angles of attack and sideslip with oscillation amplitudes from 5 deg. to 30 deg. and reduced frequencies from 0.073 to 0.269. Harmonic analysis was used to estimate Fourier coefficients and in-phase and out-of-phase components. For frequency dependent data from rolling oscillations, a two-step regression method was used to obtain unsteady models (indicial functions), and derivatives due to sideslip angle, roll rate and yaw rate from in-phase and out-of-phase components. Frequency dependence was found for angles of attack between 20 deg. and 50 deg. Reduced values of coefficient of determination and increased values of fit error were found for angles of attack between 35 deg. and 45 deg. An attempt to estimate model parameters from yaw oscillations failed, probably due to the low number of test cases at different frequencies.

Klein, Vladislav↗

DOE OSTI2025

Recent evolution of risk analyses in atomic bomb survivor studies: new methods and applications

Abstract Several decades ago a dramatic leap forward occurred in the development and application of statistical methods for modeling radiation risk at the Radiation Effects Research Foundation (RERF). Poisson regression analysis for grouped person-year cohort data and the linear excess relative risk model were introduced, and subsequently a devoted software system, Epicure® (https://www.hirosoft.com), was developed by researchers at RERF and at the U.S. National Cancer Institute. Numerous advancements in understanding radiation effects on humans were made possible with these methods, which are still the state-of-the-art for risk assessment at RERF and have remained part of the standard toolbox for radiation—and other environmental—epidemiological studies worldwide. Nevertheless, as our understanding of radiation risk has increased, so have the breadth and depth of questions that require answers based on emerging data that are not amenable to these conventional methods. This overview briefly recounts the conventional methods and then describes our recent diversification into the use or development of new statistical approaches to meet the challenges of burgeoning biological data and emerging mechanistic information. We briefly discuss the development and application of new methods, current and planned, that are part of the RERF Statistics Department’s role in supporting institution-wide research, especially in our collaborations involving the Life Span Study, Adult Health Study, and First-generation Offspring Clinical Study. Some approaches to modeling and assessing radiation risk with newer methods mentioned herein have already been published, while some are still in development or are only beginning at the proposal stage.

Oncology↗

DOE OSTI2021

Learning the structure of wind: A data-driven nonlocal turbulence model for the atmospheric boundary layer

In this work, we develop a novel data-driven approach to modeling the atmospheric boundary layer. This approach leads to a nonlocal, anisotropic synthetic turbulence model which we refer to as the deep rapid distortion (DRD) model. Our approach relies on an operator regression problem that characterizes the best fitting candidate in a general family of nonlocal covariance kernels parameterized in part by a neural network. This family of covariance kernels is expressed in Fourier space and is obtained from approximate solutions to the Navier–Stokes equations at very high Reynolds numbers. Each member of the family incorporates important physical properties such as mass conservation and a realistic energy cascade. The DRD model can be calibrated with noisy data from field experiments. After calibration, the model can be used to generate synthetic turbulent velocity fields. To this end, we provide a new numerical method based on domain decomposition which delivers scalable, memory-efficient turbulence generation with the DRD model as well as others. We demonstrate the robustness of our approach with both filtered and noisy data coming from the 1968 Air Force Cambridge Research Laboratory Kansas experiments. Using these data, we witness exceptional accuracy with the DRD model, especially when compared to the International Electrotechnical Commission standard.

17 WIND ENERGY↗

DOE OSTI2023

Younger facial looks are associate with a lower likelihood of several age-related morbidities in the middle-aged to elderly

Abstract Background Looking older for one’s chronological age is associated with a higher mortality rate. Yet it remains unclear how perceived facial age relates to morbidity and the degree to which facial ageing reflects systemic ageing of the human body. Objectives To investigate the association between ΔPA and age-related morbidities of different organ systems, where ΔPA represents the difference between perceived age (PA) and chronological age. Methods We performed a cross-sectional analysis on data from the Rotterdam Study, a population-based cohort study in the Netherlands. High-resolution facial photographs of 2679 men and women aged 51.5–87.8 years of European descent were used to assess PA. PA was estimated and scored in 5-year categories using these photographs by a panel of men and women who were blinded for chronological age and medical history. A linear mixed model was used to generate the mean PAs. The difference between the mean PA and chronological age was calculated (ΔPA), where a higher (positive) ΔPA means that the person looks younger for their age and a lower (negative) ΔPA that the person looks older. ΔPA was tested as a continuous variable for association with ageing-related morbidities including cardiovascular, pulmonary, ophthalmological, neurocognitive, renal, skeletal and auditory morbidities in separate regression analyses, adjusted for age and sex (model 1) and additionally for body mass index, smoking and sun exposure (model 2). Results We observed 5-year higher ΔPA (i.e. looking younger by 5 years for one’s age) to be associated with less osteoporosis [odds ratio (OR) 0.76, 95% confidence interval (CI) 0.62–0.93], less chronic obstructive pulmonary disease (OR 0.85, 95% CI 0.77–0.95), less age-related hearing loss (model 2; B = −0.76, 95% CI −1.35 to −0.17) and fewer cataracts (OR 0.84, 95% CI 0.73–0.97), but with better global cognitive functioning (g-factor; model 2; B = 0.07, 95% CI 0.04–0.10). Conclusions PA is associated with multiple morbidities and better cognitive function, suggesting that systemic ageing and cognitive ageing are, to an extent, externally visible in the human face.

Mekić, Selma↗