Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Combining Emergent Constraints for Climate Sensitivity

A method is proposed for combining information from several emergent constraints into a probabilistic estimate for a climate sensitivity proxy Y such as equilibrium climate sensitivity (ECS). The method is based on fitting a multivariate Gaussian PDF for Y and the emergent constraints using an ensemble of global climate models (GCMs); it can be viewed as a form of multiple linear regression of Y on the constraints. The method accounts for uncertainties in sampling this multidimensional PDF with a small number of models, for observational uncertainties in the constraints, and for overconfidence about the correlation of the constraints with the climate sensitivity. Its general form (Method C) accounts for correlations between the constraints. Method C becomes less robust when some constraints are too strongly related to each other; this can be mitigated using regularization approaches such as ridge regression. An illuminating special case, Method U, neglects any correlations between constraints except through their mutual relationship to the climate proxy; it is more robust to small GCM sample size and is appealingly interpretable. These methods are applied to ECS and the climate feedback parameter using a previously published set of 11 possible emergent constraints derived from climate models in the Coupled Model Intercomparison Project (CMIP). The ±2σ posterior range of ECS for Method C with no overconfidence adjustment is 4.3 ± 0.7 K. For Method U with a large overconfidence adjustment, it is 4.0 ± 1.3 K. This study adds confidence to past findings that most constraints predict higher climate sensitivity than the CMIP mean.

54 ENVIRONMENTAL SCIENCES↗

Development, Verification and Use of Gust Modeling in the NASA Computational Fluid Dynamics Code FUN3D

This paper presents the implementation of gust modeling capability in the CFD code FUN3D. The gust capability is verified by computing the response of an airfoil to a sharp edged gust. This result is compared with the theoretical result. The present simulations will be compared with other CFD gust simulations. This paper also serves as a users manual for FUN3D gust analyses using a variety of gust profiles. Finally, the development of an Auto-Regressive Moving-Average (ARMA) reduced order gust model using a gust with a Gaussian profile in the FUN3D code is presented. ARMA simulated results of a sequence of one-minus-cosine gusts is shown to compare well with the same gust profile computed with FUN3D. Proper Orthogonal Decomposition (POD) is combined with the ARMA modeling technique to predict the time varying pressure coefficient increment distribution due to a novel gust profile. The aeroelastic response of a pitch/plunge airfoil to a gust environment is computed with a reduced order model, and compared with a direct simulation of the system in the FUN3D code. The two results are found to agree very well.

Bartels, Robert E.↗

Shielding Considerations for CubeSat Structures During Solar Maximum

The purpose of this lessons learned paper is to communicate the utility of shielding in small spacecraft planning for the support of mission assurance and reliability. Numerous SmallSats have been flying in polar low Earth orbit for science, communications, technology demonstrations, and imaging with academic, commercial, and government interests. Shielding has been part of mission assurance and reliability from the advent of long duration spacecraft missions. The Shields-1 CubeSat has been operating in polar low Earth orbit since 16 December 2018 with atomic number (Z)-grade radiation shielding and demonstrates shielding effectiveness. Shields-1 has collected a representative example of solar minimum data in 2019 with eight Teledyne µDosimeters over varying shielding effectivenesses. It serves as current experimental data and has been compared with NOVICE Shielding estimates using the AP8 – AE8 trapped radiation model with the Shields-1 CAD and generic CubeSat three unit (3U) models. Using NOVICE model radiation analysis coding, the shielding effectivenesses, based on a generic CubeSat 3U structure with four electronic boards, were estimated for aluminum wall thicknesses ranging from 0.204 cm to 4.44 cm (0.550 g/cm 2 to 12.0 g/cm 2 ). For modeled polar orbiting spacecraft, solar maximum total ionizing dose (TID) increases by nearly a magnitude for thin-walled aluminum 0.550-g/cm 2 - 0.686-g/cm 2 (0.204-cm – 0.254-cm) typical CubeSat structures. The shielding effectiveness estimated by NOVICE Sigma, which is a shielding sphere approximation around a detector, showed a linear relationship with wall thickness, which increased over the wall thickness by a ratio of 1.43 determined by linear regression analysis. Using NOVICE Adjoint Monte-Carlo Modeling of solar minimum and solar maximum with the inclusion of a worst-case solar particle event over a one-year mission without geomagnetic shielding, the TID for minimum and maximum conditions for a generic 3U with a wall thickness of 0.254 cm is 158 RAD and 1540 RAD, respectively. The modeled total solar maximum TID is over estimated, because at low orbital latitudes a spacecraft will have shielding from the Earth’s magnetic field. However, TID will still be significant at high latitudes over the poles, where a spacecraft is exposed in a solar particle event. In contrast to a thin-walled generic 3U CubeSat, the Shields-1 electronics enclosure has a shielding effectiveness of 21.3 g/cm 2 from NOVICE Sigma modeling and is expected to show reduced total ionizing dose increases during the present active Solar Cycle 25 period. Because solar particle events during solar maximum increase TID on electronic parts with thin-walled shielding in short periods of time, it is a mission assurance and reliability consideration on the mission value of the spacecraft versus adding shielding for risk reduction of premature spacecraft or instrument payload loss. Since the volumes of many instruments and system electronics have reduced with small spacecraft, shielding material costs and weight penalties have diminished. A small spacecraft project budget and schedule may limit traditional radiation-hardened part use and radiation testing requirements, where shielding can contribute to mission assurance and reliability with reduced costs.

Shields-1↗

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗

Regression of exchangeable relational arrays

Relational arrays represent measures of association between pairs of actors, often in varied contexts or over time. Trade flows between countries, financial transactions between individuals, contact frequencies between school children in classrooms and dynamic protein-protein interactions are all examples of relational arrays. Elements of a relational array are often modelled as a linear function of observable covariates. Uncertainty estimates for regression coefficient estimators, and ideally the coefficient estimators themselves, must account for dependence between elements of the array, e.g., relations involving the same actor. Existing estimators of standard errors that recognize such relational dependence rely on estimating extremely complex, heterogeneous structure across actors. This paper develops a new class of parsimonious coefficient and standard error estimators for regressions of relational arrays. Here we leverage an exchangeability assumption to derive standard error estimators that pool information across actors, and are substantially more accurate than existing estimators in a variety of settings. This exchangeability assumption is pervasive in network and array models in the statistics literature, but not previously considered when adjusting for dependence in a regression setting with relational data. We demonstrate improvements in inference theoretically, via a simulation study, and by analysis of a dataset involving international trade.

97 MATHEMATICS AND COMPUTING↗

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗

Determination of the key parameters affecting historic communications satellite trends

Data representing 13 series of commercial communications satellites procured between 1968 and 1982 were analyzed to determine the factors that have contributed to the general reduction over time of the per circuit cost of communications satellites. The model by which the data were analyzed was derived from a general telecommunications application and modified to be more directly applicable for communications satellites. In this model satellite mass, bandwidth-years, and technological change were the variable parameters. A linear, least squares, multiple regression routine was used to obtain the measure of significance of the model. Correlation was measured by coefficient of determination (R super 2) and t-statistic. The results showed that no correlation could be established with satellite mass. Bandwidth-year however, did show a significant correlation. Technological change in the bandwidth-year case was a significant factor in the model. This analysis and the conclusions derived are based on mature technologies, i.e., satellite designs that are evolutions of earlier designs rather than the first of a new generation. The findings, therefore, are appropriate to future satellites only if they are a continuation of design evolution.

Namkoong, D.↗

Creep fatigue life prediction for engine hot section materials (isotropic)

The Hot Section Technology (HOST) program, creep fatigue life prediction for engine hot section materials (isotropic), is reviewed. The program is aimed at improving the high temperature crack initiation life prediction technology for gas turbine hot section components. Significant results include: (1) cast B1900 and wrought IN 718 selected as the base and alternative materials respectively; (2) fatigue test specimens indicated that measurable surface cracks appear early in the specimen lives, i.e., 15% of total life at 871 C and 50% of life at 538 c; (3) observed crack initiation sites are all surface initiated and are associated with either grain boundary carbides or local porosity, transgrannular cracking is observed at the initiation site for all conditions tested; and (4) an initial evaluation of two life prediction models, representative of macroscopic (Coffin-Mason) and more microscopic (damage rate) approaches, was conducted using limited data generated at 871 C and 538 C. It is found that the microscopic approach provides a more accurate regression of the data used to determine crack initiation model constants, but overpredicts the effect of strain rate on crack initiation life for the conditions tested.

Moreno, V.↗

Applying Machine Learning to Predict Alaskan Ionospheric Irregularities

In this work several machine-learning (ML) techniques for predicting ionospheric irregularities in the northern auroral zone were tested. The techniques include Ridge Regression, Long Short-Term Memory Neural Network (LSTM), Classification Neural Network (CNN), Autoencoder Classification Neural Network (ACNN), and LSTM Autoencoder Classification Neural Network (LACNN). These techniques were tested with the rate of total electron content (TEC) index (ROTI) data collected during 2008 and 2009 from a geodetic station in Fairbanks, Alaska (64.98°N, 147.50°W), which is in the auroral zone. Using ROTI data with the ML techniques, experiments were conducted to reach two goals: (1) examine what space weather measurements present good correlation with ROTI so that they may be helpful in ML-based prediction of ionospheric irregularities in the polar region; (2) predict ROTI hours and days ahead by training the neural network models with historical ROTI data alone. The Ridge Regression experiments indicate that a combination of measurements of local geomagnetic horizontal components, geomagnetic SYM-H index, 3-hour Kp and ap indices, and F10.7 solar flux index appears to be more correlated to the single-site ROTI measurements than other parameters. The neural network (NN) experiments show that although the LACNN model allows for predictions of non-irregularity and irregularity conditions defined by ROTI levels up to 3 hours in advance, with an overall accuracy ≥ 92%, a number of irregularity events can still be missed. Hence, further development is needed to reduce the number of missed events. In this paper, the models, data processing, model performance, prediction results, and potential applications are presented.

Pi, Xiaoqing↗

Environmental and Socio-Demographic Determinants of Dengue Fever in Colombo City, Sri Lanka

Dengue fever has increased exponentially in Sri Lanka, from 24.4 cases per 100,000 in 2003 to 165.3 per 100,000 population in 2013. Although early warning systems using predictor models have been previously developed in other settings, it is important to develop such models in each local setting. Further, the ability of these models to be applicable at smaller geographic units will enhance current vector control and disease surveillance measures. The aim of this paper was to identify environmental and socio-economic status (SES) risk factors that may predict dengue fever at the Gram Niladhari Divisions (GND) level (smallest administrative unit) in Colombo city, Sri Lanka. These factors included landcover classes, amount of vegetation, population density, water access and neighborhood SES as determined by roof type. A geographically weighted regression (GWR) was used to develop the prediction model. A total 55 GND units covering an area of 37 sq km were investigated. We found that GND units with decreased vegetation, higher built-up area, higher population density and poor access to tap-water supply were associated with high risk of dengue; the pertinent GND units were concentrated in the center of the city. This is the first study in Sri Lanka to include both environmental and socio-demographic factors in prediction models for dengue fever. The methodology may be useful in enhancing ongoing dengue fever control measures in the country, and to be extended to other countries in the region that have an increasing incidence of dengue fever.

Tipre, Meghan↗

Gaining Perspective on Unconventional Well Design Choices through Play-level Application of Machine Learning Modeling

The recent development of unconventional oil and gas (O&G) reservoirs has led to an abundant hydrocarbon supply, both domestically and globally. However, there is a continued push to develop new and innovative approaches to improve exploration and extraction efficiencies and overall well productivity moving forward. Substantial improvements in unconventional O&G development are expected through optimized well completion and stimulation strategies aimed at maximizing well productivity. Optimizing well designs will require tailoring to the distinctive geologic conditions present for any newly placed well. To better evaluate the impact of well design attributes and their associated interactions on productivity in a major unconventional play, multivariate machine learning-based models that use empirical datasets were developed. A gradient boosted regression tree (GBRT) algorithm was applied. GBRT has been narrowly investigated for O&G applications but enables straightforward parametric importance and influence evaluation, as well as assessment of parameter interaction effects. Models were trained on well design and locational parameters that serve as a proxy for variable geologic conditions to estimate two types of productivity indicator response variables strongly correlated to estimated ultimate recovery (EUR). The dataset utilized consists of over 7,000 well observations that cover the majority of the productive region of the Marcellus Shale. Model performance was evaluated and algorithm parameters tuned by analyzing the goodness-of-fit for simulated results against observed data in a cross-validation approach. Models were found capable of 73–79 percent prediction accuracy on held out testing data of gas equivalent production and can be used to inform future well design and placement decisions for increasing EUR per well and improving overall field-level recovery. Study results indicate that Marcellus well performance improves most with upscaling perforated interval lengths and water and proppant volumes per foot; but relative productivity improvements are spatially dependent across the play. Finally, optimal combinations of water and proppant on well performance were found to vary depending on well location, emphasizing the utility of data-driven models capable of broad application across a play of interest for informing tailored well design approaches prior to their field deployment.

04 OIL SHALES AND TAR SANDS↗

Development of a metamodelling framework for building energy models with application to fifth-generation district heating and cooling networks

Fully defined physics-based building energy models can accurately represent building systems; however, generating models based on high-level parameters is time consuming and simulation time of complex models can be slow. This article discusses the development of a Metamodelling Framework to create metamodels from a building energy modelling dataset. The framework generates metamodels using either linear regression, random forests, or support vector regressions. A fifth-generation district heating and cooling system analysis use case was used to motivate the development of the framework. The use case required quick and accurate representations of annual building loads reported hourly. Typical annual building modelling approaches can result in a runtime of 10 min. The metamodels runtime was reduced to less than 10 s to load and run an annual simulation with user-defined covariates. The results of the metamodel performance and an abbreviated topology analysis based on the motivating use case will be presented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The nature of the residual Martian polar caps

A model of the behavior of the Martian polar caps is described which incorporates the heating effects of the atmosphere, as well as insolation and conduction. This model is used to try to match the observed regression curves of the polar caps, and it predicts that all the seasonally condensed CO2 will be lost by around the summer solstice. The implication is that the residual caps are composed of water ice which, it is found by further modeling, should be stable during the Martian summers. However, it is also argued that this model may be too simplistic, and that the effects of wind in redistributing the seasonal condensate may lead to sufficient thicknesses of CO2 in the central polar region to allow the year-long existence of CO2 without significantly changing the retreat characteristics of the cap, and it is, therefore, concluded that at the present, the nature of the residual caps cannot be reliably determined.

Briggs, G. A.↗

Designing Monte Carlo Simulation and an Optimal Machine Learning to Optimize and Model Space Missions

This paper investigates applying artificial intelligence (AI) algorithms to attitude control system of satellites to optimally tune the controller using high performance computing. This methodology is applied to the Virtual Telescope for X-ray Observation mission, which is a precise formation of two separate spacecraft observing multiple objects in the space in the X-ray domain. The mission is divided into phases based on the instrumentation and the mission goal. To reach an stable precise formation robust to stochastic slew and slew rate (i.e., Euler angles and angular velocities) in a minimal constrained time T , consumed energy of the attitude control system, denoted as E, and root-mean-square state error of attitude control system, denoted as e, are minimized. Monte-Carlo simulation is used for the sensitivity analysis of optimization and designing a controller. Deep neural networks (DNN), Gaussian processes (GP), and support vector regression (SVR) learn this optimization as a surrogate model, while their hyperparameters are optimized in a novel approach. THETA supercomputer at Argonne Leadership Computing Facility (ALCF) is used for optimizing the hyperparameters of DNN. The surrogate model meets the requirements of the mission, and it shows a better performance over the optimization and Monte-Carlo. The optimal DNN can satisfy the mission requirements e and T while reducing E for 90% compared to the other given methods.

42 ENGINEERING↗

Clumped isotope constraints on changes in latest Pleistocene hydroclimate in the northwestern Great Basin: Lake Surprise, California

Abstract During the Last Glacial Maximum (LGM) and subsequent deglaciation, the Great Basin in the southwestern United States was covered by numerous extensive closed-basin lakes, in stark contrast with the predominately arid climate observed today. This transition from lakes in the Late Pleistocene to modern aridity implies large changes in the regional water balance. Whether these changes were driven by increased precipitation rates due to changes in atmospheric dynamics, decreased evaporation rates resulting from temperature depression and summer insolation changes, or some combination of the two remains uncertain. The factors contributing to these large-scale changes in hydroclimate are critical to resolve, given that this region is poised to undergo future anthropogenic-forced climate changes with large uncertainties in model simulations for the 21st century. Furthermore, there are ambiguous constraints on the magnitude and even the sign of changes in key hydroclimate variables between the Last Glacial Maximum and the present day in both proxy reconstructions and climate model analyses of the region. Here we report thermodynamically derived estimates of changes in temperature, precipitation, and evaporation rates, as well as the isotopic composition of lake water, using clumped isotope data from an ancient lake in the northwestern Great Basin, Lake Surprise (California). Compared to modern climate, mean annual air temperature at Lake Surprise was 4.7 °C lower during the Last Glacial Maximum, with decreased evaporation rates and similar precipitation rates to modern. During the mid-deglacial period, the growth of Lake Surprise implied that the lake hydrologic budget briefly departed from steady state. Our reconstructions indicate that this growth took place rapidly, while the subsequent lake regression took place over several thousand years. Using models for precipitation and evaporation constrained from clumped isotope results, we determine that the disappearance of Lake Surprise coincided with a moderate increase in lake temperature, along with increasing evaporation rates outpacing increasing precipitation rates. Concomitant analysis of proxy data and climate model simulations for the Last Glacial Maximum are used to provide a robust means to understand past climate change, and by extension, predict how current hydroclimates may respond to expected future climate forcings. We suggest that an expansion of this analysis to more basins across a larger spatial scale could provide valuable insight into proposed climate forcings, and aid in climate model process depiction. Ultimately, our analysis highlights the importance of temperature-driven evaporation as a mechanism for lake growth and retreat in this region.

Geology↗

Verification and Regression Testing of a Physically Stabilized Layered Solid Element Formulation in DYNA3D/Paradyn

Recent modeling of filament-wound composite structures drove the need for a new element type within the finite element code DYNA3D/Paradyn. This new layered solid element was implemented and designed to capture the kinematics and constitutive be havior of various lamina layers defined with arbitrary orientations and volume fractions within the element to accurately model a laminated composite material. The new el ement uses a single integration point in each of the lamina layers defined to capture the constitutive behavior, and a novel physical stabilization routine is used to prevent hourglassing while mitigating shear and volumetric locking. This report documents the verification testing and the regression tests added to the DYNA3D/Paradyn software quality assurance test suite to assess the proper implementation of the new layered solid element. There were a total of 27 tests added the DYNA3D test suite, which consist of problems using the layered solid element with a single layer or multiple layers for isotropic and orthotropic material models. These tests are a combination of simple kinematically driven patch tests, beam bending tests, plate bending tests, and more complicated problems. Ultimately, the testing done verifies that the element behaves as expected and is implemented correctly.

42 ENGINEERING↗

Modeling Whitecaps on Global Scale

Whitecaps play an important role in the surface-atmosphere interactions across the ocean. They are directly linked to the energy dissipation rate during wave breaking and transfer of heat, momentum, and gas/aerosol exchange from the wind to the sea surface. Although the first models of W were dependent only on wind speeds, a large number of diverse models based on wind and sea state which include wave height, wave age, friction velocity, and stability effects have been proposed since then. However, it is recognized that most of the proposed W models have strong systematic (e.g., zonal bias) and random errors when compared against observations. This is partly due to the differences in environmental conditions, measurement techniques, and geographical locations among these studies. But, some of these biases are linked to the inability of the proposed models to capture the variability in W in certain wind/wave regimes. Despite the knowledge of existing biases, W residual relationships from the models with wind and wave fields remain highly uncertain, with residual trends varying between the published studies. Here, we take advantage of the availability of relatively dense observations of W from WindSat microwave satellite retrievals in combination with the University of Miami wave model which was recently incorporated within the NASA GMAO/GEOS system (GEOS-UMWM). We use Windsat W retrievals to assess and constrain the previously published W models and understand the relationships of residuals from models in different wind/wave regimes. We link these unexplained residual variations to additional factors such as swell index, drag coefficient etc and add information to the existing whitecap models. Since Windsat retrievals cover wide range of environmental conditions, it helps to reduce the uncertainties associated with differences in measurement techniques. Regression of wind-wave fields against all Windsat data points (CTL) results in larger residuals for lower wave age and W is overestimated upto ~4% for wave age < 10 and underestimated by upto ~2% as wave age increases. We attest to this bias by considering two approaches. One is to perform regression separately for different stages of wave development such as developing sea, fully developed, and wind sea regimes thereby understanding the sensitivity of regression coefficients to sea state (EXP1). Another is to derive coefficients of W models in EXP1 as a function of additional wind/wave factors such as swell index, drag coefficient, and mean squared slope, deriving more nonlinear W models (EXP2). EXP2 provides reduction in Root Mean Squared Error (RMSE) by 0.1-0.3%. Sea surface drag has a stronger relationship with regression coefficients compared to swell index.These additional factors provide improved parameterizations in different wind and wave age regimes, with smaller unexplained/residual variations in W that has been a major concern in the W community.

Raman, Aishwarya↗