Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Peak Rain Rate Sensitivity to Observed Cloud Condensation Nuclei and Turbulence in Continental Warm Shallow Clouds During CACTI

Abstract Warm clouds strongly affect Earth's energy budget but remain imperfectly represented in climate models, partly due to the complexity and covariability of relevant processes influencing warm rain. This work presents a detailed analysis of different factors affecting rain rate peak intensity (RR) in continental warm clouds. Clouds were identified with vertically pointing radar and lidar observations and categorized via a temperature‐based cloud type classification algorithm from which warm clouds were isolated. Observations and retrievals of liquid water path (LWP), cloud condensation nuclei concentration (N CCN ), cloud depth, and cloud duration of more than 3,000 separate warm clouds sampled during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign are analyzed in this work. Multiple linear regression (MLR) and random forest (RF) models are applied to assess the relative impact of these variables on RR. Overall, RR tends to increase as cloud depth, LWP, and cloud duration increase, or N CCN decreases. Cloud depth affects RR the most while N CCN impacts it the least. When considering over 170 warm clouds observed at least 1 hr in which in‐cloud turbulence is retrieved, the effect of N CCN on RR remains most likely suppressive, but it is not significant at a 75% level for MLR and is highly uncertain for RF. The impact of in‐cloud turbulence depends on the moment and location it is sampled. Cloud base turbulence around the time of RR suppresses RR, while cloud top turbulence effects are inconclusive. Possible difficulties in isolating robust CCN and turbulence effects on RR are discussed.

54 ENVIRONMENTAL SCIENCES↗

A neural network for beam background decomposition in Belle II at SuperKEKB

Here, we describe a neural network for predicting the background hit rate in the Belle II detector produced by the SuperKEKB electron-positron collider. The neural network, BGNet, learns to predict the individual contributions of different physical background sources, such as beam-gas scattering or continuous top-up injections into the collider, to Belle II sub-detector rates. The samples for learning are archived 1 Hz time series of diagnostic variables from the SuperKEKB collider subsystems and measured hit rates of Belle II used as regression targets. We test the learned model by predicting detector hit rates on archived data from different run periods not used during training. We show that a feature attribution method can help interpret the source of changes in the background level over time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗

Analytical learning and term-rewriting systems

Analytical learning is a set of machine learning techniques for revising the representation of a theory based on a small set of examples of that theory. When the representation of the theory is correct and complete but perhaps inefficient, an important objective of such analysis is to improve the computational efficiency of the representation. Several algorithms with this purpose have been suggested, most of which are closely tied to a first order logical language and are variants of goal regression, such as the familiar explanation based generalization (EBG) procedure. But because predicate calculus is a poor representation for some domains, these learning algorithms are extended to apply to other computational models. It is shown that the goal regression technique applies to a large family of programming languages, all based on a kind of term rewriting system. Included in this family are three language families of importance to artificial intelligence: logic programming, such as Prolog; lambda calculus, such as LISP; and combinatorial based languages, such as FP. A new analytical learning algorithm, AL-2, is exhibited that learns from success but is otherwise quite different from EBG. These results suggest that term rewriting systems are a good framework for analytical learning research in general, and that further research should be directed toward developing new techniques.

Laird, Philip↗

Development of the Ames Global Hyperspectral Synthetic Dataset

This study develops the surface BRDF (bidirectional reflectance distribution function) product of the Ames Global Hyperspectral Synthetic Dataset (AGHSD), based on the corresponding MODIS products, to support the NASA Surface Biology and Geology mission development. A main challenge in deriving a hyperspectral dataset from the multi-band satellite products is how to identify a succinct yet robust algorithm that allow us to infer BRDF at unobserved wavelengths based on the few observed bands. Using the theories of radiative transfer in vegetation canopies, we arrive at a simple equation that accurately approximates hyperspectral surface BRDF as the weighted sum of components from the soil and the vegetation. Each of the components is modeled by the product of the spectrally-dependent optical properties of a surface element (the spectra of the soil surface reflectance, the leaf single albedo, or the canopy scattering coefficient) and a spectrally-independent bidirectional scattering function. The optical properties of the soil and the vegetation can be obtained from existing spectral libraries or model simulations. The bidirectional scattering functions are represented by the Ross-Thick-Li-Sparse BRDF model, where the linear coefficients are estimated with regression analysis from the multi-band MODIS data. We validate the algorithm with simulations by Monte Carlo Ray Tracing model experiments, and the results are highly consistent with the theoretic derivation. We apply the algorithm to generate the AGHSD BRDF product at 1km and 8-day resolutions for the year of 2019. The results are biogeochemically and physically coherent and consistent, and thus serve the goal to support the science and application development of the SBG community.

Hyperspectral↗

Modeling ethanol/water adsorption in all-silica zeolites using the real adsorbed solution theory

A comprehensive set of single-component and binary isotherms were collected for ethanol/water adsorption into the siliceous forms of 185 known zeolites using grand-canonical Monte Carlo simulations. Using these data, a systematic analysis of ideal/real adsorbed-solution theory (IAST/RAST) was conducted and activity coefficients were derived for ethanol/water mixtures adsorbed in different zeolites based on RAST. It was found that activity coefficients of ethanol are close to unity while activity coefficients of water are larger in most zeolites, indicating a positive excess free energy of the mixture. This observation can be attributed to water/ethanol interactions being less favorable than water/water interactions in the single-component adsorption of water at comparable loadings. The deviation from ideal behavior can be highly structure-dependent but no clear correlation with pore diameters was identified. Furthermore, our analysis also demonstrates the following: (1) accurate unary isotherms in the low-loading regime are critical for obtaining physically sensible activity coefficients; (2) the global regression scheme to solve for activity model parameters performs better than fitting activity models to activity coefficients calculated locally at each binary state point; and (3) including the dependence on adsorption potential offers only a minor benefit for describing binary adsorption at the lowest fugacities. Finally, the Margules activity model was found incapable of capturing the non-ideal adsorption behavior over the entire range of fugacities and compositions in all zeolites, but for conditions typical of solution-phase adsorption, RAST predictions using zeolite-specific or even bulk Margules parameters provide an improved description compared to IAST.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertain characterization of reservoir fluids due to brittleness of equation of state regression

Equations of state (EoS) play a central role in modeling the phase equilibrium of fluid mixtures. Their parameterization involves fitting a model to experimental data, i.e., solving a nonlinear, non-convex, multivariate optimization problem. The latter requires one to select design variables, domains of definition for each variable, and weights assigned to individual measurements. We demonstrate that subjective choices of an optimization algorithm and an initial guess also impact the regression process. Consequently, EoS predictions are fundamentally uncertain even after the EoS tuning to a limited set of experimental data points. We demonstrate this observation for two hydrocarbon reservoir fluids, in which five properties of the heaviest carbon fraction are treated as design variables. While all the optimization algorithms and initial guesses match experimental data for the gas and liquid properties, the resulting EoS parameterizations lead to dramatically different predictions of the fluid’s thermophysical behavior in the unsampled pressure and temperature regions. In conclusion, we propose the probabilistic treatment of design variables to quantify the predictive uncertainty of the resulting fluid models.

15 GEOTHERMAL ENERGY↗

Comparison of U.S. and Russian Slow Crack Growth Data and Models

Both the US and Russian space programs use similar predictive models for design of fused silica windows on the International space station. The Russian model can be derived from the power expression for slow crack growth (SCG) or “static fatigue.” The US uses both power and exponential models. Despite the similarity of models and data fitting approach (linear regression and right censoring), different SCG parameters have been derived by US and Russian parties for the same material (Russian fused silica) tested in a similar manner. The difference appears to be related to the use of short-term strength data along with the longer-term static fatigue data, with the power law parameter n being very sensitive to the conversion of strength data into equivalent static data. This hybrid approach is feasible if strength data is measured with a constant stress rate and is appropriately converted to a static equivalent. More research into the approach is needed. However, because of the nonlinear behavior of fused silica in log(v) – log(K(I) ) space and the sensitivity of parameter estimation to fit range, the exponential model is a better choice regardless of test method. Functions are given to convert parameters from the Russian model to those in the US model. However, accurate conversion is hampered by the lack of inert strength data. When the same test technique is used, US and Russian materials exhibit very similar parameters.

Silica, strength, impact, crack growth, windows, I↗

A Subsonic Aircraft Design Optimization With Neural Network and Regression Approximators

The Flight-Optimization-System (FLOPS) code encountered difficulty in analyzing a subsonic aircraft. The limitation made the design optimization problematic. The deficiencies have been alleviated through use of neural network and regression approximations. The insight gained from using the approximators is discussed in this paper. The FLOPS code is reviewed. Analysis models are developed and validated for each approximator. The regression method appears to hug the data points, while the neural network approximation follows a mean path. For an analysis cycle, the approximate model required milliseconds of central processing unit (CPU) time versus seconds by the FLOPS code. Performance of the approximators was satisfactory for aircraft analysis. A design optimization capability has been created by coupling the derived analyzers to the optimization test bed CometBoards. The approximators were efficient reanalysis tools in the aircraft design optimization. Instability encountered in the FLOPS analyzer was eliminated. The convergence characteristics were improved for the design optimization. The CPU time required to calculate the optimum solution, measured in hours with the FLOPS code was reduced to minutes with the neural network approximation and to seconds with the regression method. Generation of the approximators required the manipulation of a very large quantity of data. Design sensitivity with respect to the bounds of aircraft constraints is easily generated.

Patnaik, Surya N.↗

STEP and STEPSPL: Computer programs for aerodynamic model structure determination and parameter estimation

The successful parametric modeling of the aerodynamics for an airplane operating at high angles of attack or sideslip is performed in two phases. First the aerodynamic model structure must be determined and second the associated aerodynamic parameters (stability and control derivatives) must be estimated for that model. The purpose of this paper is to document two versions of a stepwise regression computer program which were developed for the determination of airplane aerodynamic model structure and to provide two examples of their use on computer generated data. References are provided for the application of the programs to real flight data. The two computer programs that are the subject of this report, STEP and STEPSPL, are written in FORTRAN IV (ANSI l966) compatible with a CDC FTN4 compiler. Both programs are adaptations of a standard forward stepwise regression algorithm. The purpose of the adaptation is to facilitate the selection of a adequate mathematical model of the aerodynamic force and moment coefficients of an airplane from flight test data. The major difference between STEP and STEPSPL is in the basis for the model. The basis for the model in STEP is the standard polynomial Taylor's series expansion of the aerodynamic function about some steady-state trim condition. Program STEPSPL utilizes a set of spline basis functions.

Batterson, J. G.↗

Estimation of Unsteady Aerodynamic Models from Dynamic Wind Tunnel Data

Demanding aerodynamic modelling requirements for military and civilian aircraft have motivated researchers to improve computational and experimental techniques and to pursue closer collaboration in these areas. Model identification and validation techniques are key components for this research. This paper presents mathematical model structures and identification techniques that have been used successfully to model more general aerodynamic behaviours in single-degree-of-freedom dynamic testing. Model parameters, characterizing aerodynamic properties, are estimated using linear and nonlinear regression methods in both time and frequency domains. Steps in identification including model structure determination, parameter estimation, and model validation, are addressed in this paper with examples using data from one-degree-of-freedom dynamic wind tunnel and water tunnel experiments. These techniques offer a methodology for expanding the utility of computational methods in application to flight dynamics, stability, and control problems. Since flight test is not always an option for early model validation, time history comparisons are commonly made between computational and experimental results and model adequacy is inferred by corroborating results. An extension is offered to this conventional approach where more general model parameter estimates and their standard errors are compared.

Murphy, Patrick↗

Circuit Modelling of the Mechanical-Motion-Rectifier for Electrical Simulation of Ocean Wave Power Take-off

As is the case with several other mechanical power takeoffs (PTOs), the mechanical-motion-rectifier (MMR) based PTO consists of components such as one-way clutches, gears, a ball screw, mechanical couplings, and a generator. Equivalent circuit models have been created in this paper to describe the dry frictions, viscous damping, and mechanical compliances in these components, so the non-ideal efficiency and nonlinear force of the PTO can be predicted in electrical simulations by integrating these sub-circuit models. The circuit model is simplified, and its parameters are categorized as dc and ac unknowns. The dc and ac tests on the PTO are performed sequentially to extract two sets of parameters through linear regression or nonlinear curve fitting. Then, the model is validated through its prediction capability over 25 test conditions on input forces, output voltages, and efficiencies, with correlation coefficients of 0.9, 0.98, and 0.981, respectively.

42 ENGINEERING↗

Modeling the effects of exercise during 100% oxygen prebreathe on the risk of hypobaric decompression sickness

BACKGROUND: Several previous studies indicated that exercise during prebreathe with 100% O2 decreased the incidence of hypobaric decompression sickness (DCS). We report a meta-analysis of these investigations combined with a new study in our laboratory to develop a statistical model as a predictive tool for DCS. HYPOTHESIS: Exercise during prebreathe increases N2 elimination in a theoretical 360-min half-time compartment decreasing the incidence of DCS. METHODS: A dose-response probability tissue ratio (TR) model with 95% confidence limits was created for two groups, prebreathe with exercise (n = 113) and resting prebreathe (n = 113), using nonlinear regression analysis with maximum likelihood optimization. RESULTS: The model predicted that prebreathe exercise would reduce the residual N2 in a 360-min half-time compartment to a level analogous to that in a 180-min compartment. This finding supported the hypothesis. The incidence of DCS for the exercise prebreathe group was significantly decreased (Chi-Square = 17.1, p < 0.0001) from the resting prebreathe group. CONCLUSIONS: The results suggested that exercise during prebreathe increases tissue perfusion and N2 elimination approximately 2-fold and markedly lowers the risk of DCS. Based on the model, the prebreathe duration may be reduced from 240 min to a predicted 91 min for the protocol in our study, but this remains to be verified. The model provides a useful planning tool to develop and test appropriate prebreathe exercise protocols and to predict DCS risks for astronauts.

NASA Program Environmental Health↗

Neural Network and Regression Methods Demonstrated in the Design Optimization of a Subsonic Aircraft

The neural network and regression methods of NASA Glenn Research Center s COMETBOARDS design optimization testbed were used to generate approximate analysis and design models for a subsonic aircraft operating at Mach 0.85 cruise speed. The analytical model is defined by nine design variables: wing aspect ratio, engine thrust, wing area, sweep angle, chord-thickness ratio, turbine temperature, pressure ratio, bypass ratio, fan pressure; and eight response parameters: weight, landing velocity, takeoff and landing field lengths, approach thrust, overall efficiency, and compressor pressure and temperature. The variables were adjusted to optimally balance the engines to the airframe. The solution strategy included a sensitivity model and the soft analysis model. Researchers generated the sensitivity model by training the approximators to predict an optimum design. The trained neural network predicted all response variables, within 5-percent error. This was reduced to 1 percent by the regression method. The soft analysis model was developed to replace aircraft analysis as the reanalyzer in design optimization. Soft models have been generated for a neural network method, a regression method, and a hybrid method obtained by combining the approximators. The performance of the models is graphed for aircraft weight versus thrust as well as for wing area and turbine temperature. The regression method followed the analytical solution with little error. The neural network exhibited 5-percent maximum error over all parameters. Performance of the hybrid method was intermediate in comparison to the individual approximators. Error in the response variable is smaller than that shown in the figure because of a distortion scale factor. The overall performance of the approximators was considered to be satisfactory because aircraft analysis with NASA Langley Research Center s FLOPS (Flight Optimization System) code is a synthesis of diverse disciplines: weight estimation, aerodynamic analysis, engine cycle analysis, propulsion data interpolation, mission performance, airfield length for landing and takeoff, noise footprint, and others.

Hopkins, Dale A.↗

Estimation of Aircraft Nonlinear Unsteady Parameters From Wind Tunnel Data

Aerodynamic equations were formulated for an aircraft in one-degree-of-freedom large amplitude motion about each of its body axes. The model formulation based on indicial functions separated the resulting aerodynamic forces and moments into static terms, purely rotary terms and unsteady terms. Model identification from experimental data combined stepwise regression and maximum likelihood estimation in a two-stage optimization algorithm that can identify the unsteady term and rotary term if necessary. The identification scheme was applied to oscillatory data in two examples. The model identified from experimental data fit the data well, however, some parameters were estimated with limited accuracy. The resulting model was a good predictor for oscillatory and ramp input data.

Klein, Vladislav↗

Clinically applicable 53-Gene prognostic assay predicts chemotherapy benefit in gastric cancer: A multicenter study

BACKGROUND:We previously established a 53-gene prognostic signature for overall survival (OS) of gastric cancer patients. This retrospective multi-center study aimed to develop a clinically applicable gene expression detection assay and to investigate the prognostic value of this signature. METHODS:A TCGA gastric adenocarcinoma cohort (TCGA-STAD) was used for comparing 53-gene signature with other gene signatures. A high-throughput mRNA hybridization gene expression assay was developed to quantify the expression of 53-genes in formalin-fixed paraffin-embedded tissues of 540 patients enrolled from three hospitals. 180 patents were randomly selected from two hospitals to build a prognostic prediction model based on the 53-gene signature using leave-p-out (one-third out) cross-validation method together with Cox regression and Kaplan-Meier analysis, and the model was assessed on three validation cohorts. FINDINGS:In the evaluation phase, studies based on TCGA-STAD showed that the 53-gene signature was significantly superior to other three prognostic signatures and was independent of TCGA molecular subtypes and clinical factors. For clinical validation and utility, the prognostic scores were generated using the newly developed assay, which was reliable and sensitive, in 100 sampling training sets and were significantly associated with OS in 100 sampling validation sets. The scores were significantly associated with OS in three independent and combined validation cohorts, and in patients with stages II and III/IV. The multivariate Cox regression demonstrated that the prognostic power of the score was independent of clinical factors, consistent with those findings in the TCGA dataset. Finally, patients with good prognostic scores exhibited significantly a better 5-year OS rate from adjuvant FOLFOX chemotherapy after surgery than from other chemotherapies. INTERPRETATION:The 53-gene prognostic score system is clinically applicable for predicting the OS of patients independent of clinical factors in gastric cancers, which could also be a promising predictive biomarker for FOLFOX regimen. FUNDING:Chinese National Science and Technology, National Natural Science Foundation and Natural Science Foundation of Jiangsu Province.

60 APPLIED LIFE SCIENCES↗

A Group Increment Scheme for Infrared Absorption Intensities of Greenhouse Gases

A molecule's absorption in the atmospheric infrared (IR) window (IRW) is an indicator of its efficiency as a greenhouse gas. A model for estimating the absorption of a fluorinated molecule within the IRW was developed to assess its radiative impact. This model will be useful in comparing different hydrofluorocarbons and hydrofluoroethers contribution to global warming. The absorption of radiation by greenhouse gases, in particular hydrofluoroethers and hydrofluorocarbons, was investigated using ab initio quantum mechanical methods. Least squares regression techniques were used to create a model based on this data. The placement and number of fluorines in the molecule were found to affect the absorption in the IR window and were incorporated into the model. Several group increment models are discussed. An additive model based on one-carbon groups is found to work satisfactorily in predicting the ab initio calculated vibrational intensities.

Kokkila, Sara I.↗

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗