Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Correction for Neutral Pressure-Driven Signal in Radiated Power Measurements on Proto-MPEX

A pinhole camera using four-channel resistive bolometers was designed and implemented on the Prototype Material Plasma Exposure eXperiment (Proto-MPEX) to measure the plasma radiated power. Quantification of the radiated power is required for comprehensive power balance assessments but faces unique challenges on linear plasma devices due to weak absolute signal, compared to typical use in toroidal fusion plasmas, and high neutral pressure changes. Around 1 mTorr, the pressure-driven signal contribution was shown to overwhelm the radiated power signal in Proto-MPEX, found to be ~3 μW . Since the pressure-driven signals could not be predicted from first principle arguments, the signals were corrected using empirical models that take two experimental pressure measurements and the raw bolometer signal to reveal the radiated power signals. Four “gas-only” Proto-MPEX shots were taken, without the radio frequency (rf) plasma discharge, to train, optimize, and validate empirical models. The data included two pressure measurements at different locations along with the bolometer signal. Multiple models were tested; partial least-squares regression with a cross correlation method to account for the time offset in the pressure measurements provided the best combination of accuracy and stability. The model was validated to have a modeling error of 0.0036 V, which was lower than 10% of the expected radiated power signal. The model was tested on a different “gas-only” shot with a complete time-series data. For plasma operation shots, the corrected bolometer measurements were compared with an absolute extreme ultraviolet photodiode measurement and similarities and differences are discussed.

Lee, Seungsup↗
NASA NTRS2017

Prediction of Lunar Reconnaissance Orbiter Reaction Wheel Assembly Angular Momentum Using Regression Analysis

This study determines the feasibility of creating a tool that can accurately predict Lunar Reconnaissance Orbiter (LRO) reaction wheel assembly (RWA) angular momentum, weeks or even months into the future. LRO is a three-axis stabilized spacecraft that was launched on June 18, 2009. While typically nadir-pointing, LRO conducts many types of slews to enable novel science collection. Momentum unloads have historically been performed approximately once every two weeks with the goal of maintaining system total angular momentum below 70 Nms; however flight experience shows the models developed before launch are overly conservative, with many momentum unloads being performed before system angular momentum surpasses 50 Nms. A more accurate model of RWA angular momentum growth would improve momentum unload scheduling and decrease the frequency of these unloads. Since some LRO instruments must be deactivated during momentum unloads and in the case of one instrument, decontaminated for 24 hours there after a decrease in the frequency of unloads increases science collection. This study develops a new model to predict LRO RWA angular momentum. Regression analysis of data from October 2014 to October 2015 was used to develop relationships between solar beta angle, slew specifications, and RWA angular momentum growth. The resulting model predicts RWA angular momentum using input solar beta angle and mission schedule data. This model was used to predict RWA angular momentum from October 2013 to October 2014. Predictions agree well with telemetry; of the 23 momentum unloads performed from October 2013 to October 2014, the mean and median magnitude of the RWA total angular momentum prediction error at the time of the momentum unloads were 3.7 and 2.7 Nms, respectively. The magnitude of the largest RWA total angular momentum prediction error was 10.6 Nms. Development of a tool that uses the models presented herein is currently underway.

LRO↗
DOE OSTI2020

A Survey of Constrained Gaussian Process: Approaches and Implementation Challenges

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a larger effort in scientific machine learning, many recent works have incorporated physical constraints or other a priori information within Gaussian process regression to supplement limited data and regularize the behavior of the model. We provide an overview and survey of several classes of Gaussian process constraints, including positivity or bound constraints, monotonicity and convexity constraints, differential equation constraints provided by linear PDEs, and boundary condition constraints. We compare the strategies behind each approach as well as the differences in implementation, concluding with a discussion of the computational challenges introduced by constraints.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Random forest models accurately classify synthetic opioids using high-dimensionality mass spectrometry datasets

Detection of novel threat agents presents several challenges, a principle one being the development of untargeted methods to screen an increasing number of threat chemicals whose exact structures are unknown. With the use of Machine Learning (ML) tools, we can guide the development of analytical methods for broad-spectrum detection of unbounded threat chemical families in complex mixtures. Toward this goal, we used nominal mass and high-resolution mass spectrometry data for hundreds of synthetic opioids and non-opioid compounds. We tested two ML techniques, logistic regression and random forest, to develop models towards a practical, implementable method for opioid detection. We found that of these tested ML methods, random forest models resulted in the highest validation accuracy (95+%) for both nominal mass and high-resolution classification of opioids versus non-opioids, with low false positive and false negative rates. The RF models were then used to successfully predict the classification of 10 compounds—five opioids and five non-opioids not part of the training and validation analysis. This application of ML is a critical step towards the development of field-deployable nominal mass spectrometers with ML-driven analyses for classification of emergent threats.

Chemistry↗
DOE OSTI2025

Random forest models accurately classify synthetic opioids using high-dimensionality mass spectrometry datasets

Detection of novel threat agents presents several challenges, a principle one being the development of untargeted methods to screen an increasing number of threat chemicals whose exact structures are unknown. With the use of Machine Learning (ML) tools, we can guide the development of analytical methods for broad-spectrum detection of unbounded threat chemical families in complex mixtures. Toward this goal, we used nominal mass and high-resolution mass spectrometry data for hundreds of synthetic opioids and non-opioid compounds. We tested two ML techniques, logistic regression and random forest, to develop models towards a practical, implementable method for opioid detection. We found that of these tested ML methods, random forest models resulted in the highest validation accuracy (95+%) for both nominal mass and high-resolution classification of opioids versus non-opioids, with low false positive and false negative rates. The RF models were then used to successfully predict the classification of 10 compounds—five opioids and five non-opioids not part of the training and validation analysis. This application of ML is a critical step towards the development of field-deployable nominal mass spectrometers with ML-driven analyses for classification of emergent threats.

Arasteh, Kourosh [Lawrence Livermore National Labo↗
DOE OSTI2023

A parametric finite element study for determining burst strength of thin and thick-walled pressure vessels

To accurately predict the burst strength of both thin and thick-walled pressure vessels (PVs), a parametric study of PV burst strength was performed for a wide range of vessel geometries and materials using elastic-plastic finite element analysis (FEA). A valid FEA model was established through a detailed study of 2D versus 3D FEA models, the critical stress failure criterion versus the limit load criteria, and the thick-wall effect on the FEA simulations. Here, the results show that the stresses and strains at the mean diameter, rather than outside diameter, determines a more accurate burst strength for both thin and thick-walled PVs. On this basis, a parametrized FEA script using the ABAQUS Python application programming interface (API) was used to create a large database of PV burst strengths for a variety of vessel geometries and materials, demonstrating that Python scripting is a powerful technique for performing parametric studies or generating large databases. From the FEA results, using the regression method, a new burst pressure model was developed as a function of the vessel geometry (D/t ratio) and material properties (UTS and n). As validated by a large number of full-scale burst test data, the proposed burst model can very accurately predict the burst strength for both thin and thick-walled PVs.

42 ENGINEERING↗
DOE OSTI2021

Thermodynamic modeling of calcium carbonate scale precipitation: aqueous Na + -Ca 2+ -Cl – -HCO 3 – -CO 3 2– -CO 2 system

To allow for accurate calculations of calcium carbonate scaling in highly saline produced waters, we present a comprehensive thermodynamic model based on the electrolyte nonrandom two-liquid (eNRTL) activity coefficient equation for the aqueous Na ⁺ -Ca ²⁺ -Cl – -HCO 3 – -CO 3 ²– -CO 2 system. The eNRTL binary interaction parameters for the H 2 O:(Na ⁺ -CO 3 2– ) pair, the H 2 O:(Na ⁺ -HCO 3 – ) pair, the (Na⁺-Cl–):(Na ⁺ -CO 3 2– ) pair, and the (Na ⁺ -Cl – ):(Na ⁺ -HCO 3 – ) pair are identified in this work via the regression of thermodynamic, calorimetric, and phase equilibria experimental data. The binary interaction parameters associated with the H 2 O:(Na ⁺ -Cl – ) pair, the CO 2 :(Na ⁺ -Cl – ) pair, the H 2 O:(Ca ²⁺ -Cl – ) pair, and the (Na ⁺ -Cl – ):(Ca ²⁺ -Cl – ) pair are retrieved from the literature. The remaining binary interaction parameters are retrieved from Aspen Plus or set to zero. In addition, the solubility product constants are identified for Na 2 CO 3 ·10H 2 O (s) , Na 2 CO 3 · 7H 2 O (s) , Na 2 CO 3 ·H 2 O (s) , Na 2 CO 3 ·NaHCO 3 2H 2 O (s) , Na 2 CO 3 ·3NaHCO 3 (s) , and CaCO 3(s) via regression of solubility data. Here, the model is capable of accurately calculating all phase equilibria and calorimetric properties at temperatures up to 473.15 K and salt concentrations up to saturation.

42 ENGINEERING↗
DOE OSTI2024

PV Generation and Load Forecasting for Adjuntas PR Community Microgrids

Existing frameworks to forecast time-series photovoltaic (PV) output power and consumer load for microgrid operations and controls assume a near-continuous availability of real-time input features from the field assets such as PV inverters, energy meters, and weather station. These incoming data points are used to periodically retrain models and update forecast snapshots over a moving horizon window, be it one hour-ahead, one-day ahead, or one-week ahead. However, such frameworks are not resilient to disruptions in data availability caused by losses in communications between the field sensors and data loggers. Hence, there is a need for programs that assume no availability of real-time microgrid asset data and still make reliable forecasts that can be used for decision-making. Such programs would be apt to function in extreme weather events such as hurricanes and would use lightweight recursive time-series models to independently forecast solar irradiance and ambient temperature, then compute PV power from those forecasts, as well as independently forecast consumer load. The codebase performs forecasting for the scenario of when the microgrid does not have a reliable access to forecasts or real-time observations of solar irradiance (I) and ambient temperature (AT) and load (Load) to be able to adequately forecast, in real-time, the PV power production or a business' load. In this case, using historical values of PV power and load, a univariate forecasting of generation and consumption are respectively made. The use-case in particular has two sub-scenarios: one, a normal 7-day ahead forecast where the unavailability of real-time data is assumed due to infrastructure issues such as loss of communication or sensor maintenance or service downtimes. Whereas a hurricane-caused unavailability of real-time data requires a second model trained specifically on historical hurricane days to be able to capture the extreme day behavior of generation in particular, and load if applicable. A gradient boosted regression tree comprises an ensemble of additive models that map between the input of historical values (be it irradiance, temperature, or load) and their corresponding output forecasts of a given horizon such that the individual learner predictions are summed up over the total number of such learners in the ensemble to produce an aggregate forecast. A weighting mechanism is applied to the training data in each iteration, where actual and forecast values are compared to penalize incorrect forecasts by increasing the weight and reducing it to reward correct forecasts. The code's benefits are that it: (a) accounts for a contingency where communication loss renders newly measured real-time data unavailable for model tuning and snapshot updates; (b) presents blind forecasting that recursively determines the next time-step value in a horizon using the forecast of the same attribute from a prior step; and (c) employs lightweight models that, once trained, can reliably generalize for different horizons, which make them suitable for enhancing the resilience of field microgrids prone to extreme events that encounter disruptions to data availability.

Sundararajan, Aditya [Oak Ridge National Laborator↗
DOE OSTI2023

Full-Field Strain Measurement Integrated with Two Dimension Regression Analysis to Evaluate the Bi-Modulus Elastic Properties of Isotropic and Transversely Isotropic Materials

Background: Measuring the physical properties of shale is critical for optimizing engineering activities such as geothermal energy generation and hydraulic fracturing. Shale is a transversely isotropic material. Furthermore, this material can also include micro and macro cracks at different locations and orientations that cause it to behave differently under tensile or compressive loading. Objective: In this work, a combined experimental–numerical approach is proposed to evaluate the bi-modulus elastic properties of isotropic and transversely isotropic materials. Methods: Full-field strain measurements for a circular disk under diametral compression are integrated with a regression analysis technique to evaluate the elastic properties of bi-modulus materials subjected to tensile and compressive loads using two loading configurations on the same specimen. Digital Image Correlation (DIC) is used to measure the full-field strains. Subsequently, in the case of an isotropic material, a linear least-squares approach is utilized to process the experimentally determined strains in conjunction with analytical expressions of the stress fields (in terms of far-field loading) to determine the elastic modulus E, the shear modulus G, and the Poisson’s ratio $v$. In the case of a transversely isotopic material, such as shale, a finite element model is implemented to determine the stress fields (again in terms of far-field loading), which is followed by repeating the previous regression analysis in an iterative process to estimate the elastic parameters. Results: The results show that the proposed technique successfully provides a complete set of elastic properties as a function of both the loading condition and the principal material directions. The technique is validated by measurements on a known isotropic material and then applied to determine the properties of shale. Conclusion: In this work, the proposed approach is successfully used to calculate the bi-modulus elastic response of poly(methyl meth- acrylate) (PMMA) and shale. As expected, PMMA exhibits an isotropic response with no bi-modulus effect, however, shale exhibits both transverse isotropy and a bi-modulus effect. Therefore, this approach holds promise for investigating the elastic properties of materials like rocks and fiber-reinforced composite laminates as functions of the principal material directions and the loading conditions.

42 ENGINEERING↗
DOE OSTI2024

Catalytic Reduction of Esters over Zirconia-Supported Metal Catalysts

Esters are often produced as unwanted byproducts during the catalytic upgrading of ethanol to diesel fuel precursors through Guerbet coupling. Removal of esters from the product stream is important to prevent the loss of downstream catalyst activity from ester-derived carboxylic acids. In this work, we studied ester hydrogenolysis to the parent alcohols as a viable route for enhanced diesel fuel production. Specifically, we investigated the reduction of hexyl acetate in butanol over ZrO 2 -supported Ni, Co, Cu, Rh, Pd, and Pt catalysts, where Cu/ZrO 2 was the most selective catalyst for the hydrogenolysis of hexyl acetate into hexanol and ethanol. Thermodynamic analysis reveals that a 90% alcohol yield can be obtained at 200 °C, 30 bar, and a relatively high H 2 :hexyl acetate molar ratio of 480:1. Experimentally, an alcohol yield of 88% yield was obtained with a 10 wt % Cu/ZrO 2 catalyst at these conditions with a residence time of 5.4 h kg cat kmol gas –1 . Catalytic tests on the support revealed that ZrO 2 catalyzes the transesterification reaction between hexyl acetate and butanol. However, only the Cu sites can catalyze the hydrogenolysis of the esters into the final alcohols. We developed a kinetic model for our experimental results, which shows that the transesterification and hydrogenolysis reactions run at two different timescales, the former being 10 times faster than the latter. Data regression has been used to develop a model to predict the mole fraction distribution of ester hydrogenolysis products over a wide range of contact times. Cu/ZrO 2 loses half its catalytic activity after 80 h of time on stream. Modeling of deactivation data reveals that the ZrO 2 support conserves a residual activity due to external active sites, while active sites over the Cu surface deactivate at different rates. Furthermore, the catalytic conversion of esters into their parent alcohols is relevant to the production of surrogate liquid fuels since alcohols can be bimolecularly dehydrated to produce a blend of ethers with diesel fuel-like properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

HighDimMixedModels.jl: Robust high-dimensional mixed-effects models across omics data

High-dimensional mixed-effects models are an increasingly important form of regression in which the number of covariates rivals or exceeds the number of samples, which are collected in groups or clusters. The penalized likelihood approach to fitting these models relies on a coordinate descent algorithm that lacks guarantees of convergence to a global optimum. Here, we empirically study the behavior of this algorithm on simulated and real examples of three types of data that are common in modern biology: transcriptome, genome-wide association, and microbiome data. Our simulations provide new insights into the algorithm’s behavior in these settings, and, comparing the performance of two popular penalties, we demonstrate that the smoothly clipped absolute deviation (SCAD) penalty consistently outperforms the least absolute shrinkage and selection operator (LASSO) penalty in terms of both variable selection and estimation accuracy across omics data. To empower researchers in biology and other fields to fit models with the SCAD penalty, we implement the algorithm in a Julia package, HighDimMixedModels.jl .

Gorstein, Evan↗
DOE OSTI2023

Comparing emulation methods for a high‐resolution storm surge model

Abstract Realistic simulations of complex systems are fundamental for climate and environmental studies. Large computer systems are often not sufficient to run sophisticated computational models for large numbers of different input settings. Statistical surrogate models, or emulators, are key tools enabling fast exploration of the simulator input space. Gaussian processes have become standard for computer simulator emulation. However, they require careful implementation to scale appropriately, motivating alternative methods more recently introduced. We present a comparison study of surrogates of the Sea, Lake, and Overland Surges from Hurricanes (SLOSH) simulator—the simulator of choice for government agencies—using four emulation approaches: BASS; BART; SEPIA; and RobustGaSP. SEPIA and RobustGaSP use Gaussian processes, BASS implements adaptive splines, and BART is based on ensembles of regression trees. We describe the four models and compare them in terms of computation time and predictive metrics. These surrogates use proven and distinct methodologies, are available through accessible software, and quantify prediction uncertainty. Our data cover millions of response values. We find that SEPIA and RobustGaSP provide exceptional predictive power, but cannot scale to emulate experiments as large as the one considered in this paper as effectively as BASS and BART.

Hutchings, Grant↗
DOE OSTI2025

UNCERTAINTY-AWARE DEEP LEARNING FRAMEWORK FOR FORECASTING COASTAL WATER LEVEL IN VIRGINIA BEACH

Coastal areas like Virginia Beach, USA, are increasingly vulnerable to flooding. To mitigate the impact of flooding, it is crucial for the City of Virginia Beach to have reliable 72-hour-ahead (3 days) forecasts of water levels at key gauge locations. To support this effort, several sensors have been installed throughout the city to monitor water levels and other environmental parameters such as wind speed, precipitation, and atmospheric pressure. Leveraging sensor data from one of these locations, we developed an uncertainty-aware deep learning model to forecast water levels. We employed deep quantile regression (DQR) to quantify variability in the predictions and examined the performance of three different model architectures. In addition to exclusively including historical data, we investigated the improvement wind forecasts provide to the accuracy of 72-hour-ahead water level predictions. The results show a twelvefold improvement in the flood forecast for a real flooding event.

Hasan, Mahmud [Thomas Jefferson National Accelerat↗
NASA NTRS1989

Weight and cost forecasting for advanced manned space vehicles

A mass and cost estimating computerized methology for predicting advanced manned space vehicle weights and costs was developed. The user friendly methology designated MERCER (Mass Estimating Relationship/Cost Estimating Relationship) organizes the predictive process according to major vehicle subsystem levels. Design, development, test, evaluation, and flight hardware cost forecasting is treated by the study. This methodology consists of a complete set of mass estimating relationships (MERs) which serve as the control components for the model and cost estimating relationships (CERs) which use MER output as input. To develop this model, numerous MER and CER studies were surveyed and modified where required. Additionally, relationships were regressed from raw data to accommodate the methology. The models and formulations which estimated the cost of historical vehicles to within 20 percent of the actual cost were selected. The result of the research, along with components of the MERCER Program, are reported. On the basis of the analysis, the following conclusions were established: (1) The cost of a spacecraft is best estimated by summing the cost of individual subsystems; (2) No one cost equation can be used for forecasting the cost of all spacecraft; (3) Spacecraft cost is highly correlated with its mass; (4) No study surveyed contained sufficient formulations to autonomously forecast the cost and weight of the entire advanced manned vehicle spacecraft program; (5) No user friendly program was found that linked MERs with CERs to produce spacecraft cost; and (6) The group accumulation weight estimation method (summing the estimated weights of the various subsystems) proved to be a useful method for finding total weight and cost of a spacecraft.

Williams, Raymond↗
NASA NTRS1972

A prediction model for lift-fan simulator performance

The performance characteristics of a model VTOL lift-fan simulator installed in a two-dimensional wing are presented. The lift-fan simulator consisted of a 15-inch diameter fan driven by a turbine contained in the fan hub. The performance of the lift-fan simulator was measured in two ways: (1) the calculated momentum thrust of the fan and turbine (total thrust loading), and (2) the axial-force measured on a load cell force balance (axial-force loading). Tests were conducted over a wide range of crossflow velocities, corrected tip speeds, and wing angle of attack. A prediction modeling technique was developed to help in analyzing the performance characteristics of lift-fan simulators. A multiple linear regression analysis technique is presented which calculates prediction model equations for the dependent variables.

Yuska, J. A.↗
NASA NTRS2006

Structure Detection of Nonlinear Aeroelastic Systems with Application to Aeroelastic Flight Test Data

This viewgraph presentation reviews the applicability of NARMAX structure detection to aeroelastic systems. In conclusion, the simulation results demonstrate bootstrap approach for structure computation of aircraft structural stiffness provided a high rate of true model selection: 1. T-test and stepwise regression methods had difficulty providing accurate results 2. Work contributes to understanding of the use of structure detection for modelling and identification of aerospace systems. 3. Limitation of model complexity that can be studied with these structure computation techniques 4. Result of the large number of candidate terms, for a given model order, and the data length required to guarantee convergence 5. Another approach to structure computation problem uses a least absolute shrinkage and selection operator (LASSO)

Kukreja, Sunil L.↗
NASA NTRSDate not supplied

Advancements in Blowing Dust Detection at Night via Machine Learning

This presentation introduces operational users to a machine-learning based Dust Probability product developed by the NASA SPoRT program for the application of detecting and monitoring blowing dust plumes at night. Advances in earth observing satellites has improved monitoring and detection of dust both day and night through derived imagery such as the Dust RGB. However, limitations of the RGB at night result in less contrast between dust and land surface features, as seen by the user. A Machine Learning (ML) model has been developed and applied to GOES-16 ABI to overcome this limitation and improve nighttime dust detection. The ML capability is a subset of Artificial Intelligence methods. In this case the Dust ML model was developed using a simple Random Forest (RF) model, typically used to solve classification challenges (or to provide regression type output). The goal was to leverage the strengths of the RF model to learn how to identify blowing dust, and hence, overcome the limitation of a user trying to detect blowing dust within the satellite imagery by eye alone. A brief description of the ML model development will be provided. However, the focus of the presentation will be on the initial user feedback from the assessment of this tool for the 2022 blowing dust events of March through April. During this time several users across the U.S. Southwest collaborated to apply this Dust ML product at night as a complement to the existing Dust RGB in order to determine if it provided greater operational efficiency and value.

Machine Learning↗