Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Multitask methods for predicting molecular properties from heterogeneous data

Data generation remains a bottleneck in training surrogate models to predict molecular properties. We demonstrate that multitask Gaussian process regression overcomes this limitation by leveraging both expensive and cheap data sources. In particular, we consider training sets constructed from coupled-cluster (CC) and density functional theory (DFT) data. We report that multitask surrogates can predict at CC-level accuracy with a reduction in data generation cost by over an order of magnitude. Of note, our approach allows the training set to include DFT data generated by a heterogeneous mix of exchange–correlation functionals without imposing any artificial hierarchy on functional accuracy. More generally, the multitask framework can accommodate a wider range of training set structures—including the full disparity between the different levels of fidelity—than existing kernel approaches based on Δ-learning although we show that the accuracy of the two approaches can be similar. Consequently, multitask regression can be a tool for reducing data generation costs even further by opportunistically exploiting existing data sources.

Chemistry↗
DOE OSTI2025

Integration of LIBS with Machine Learning for Real-Time Monitoring of Feedstock in H 2 Gasification Applications

This project, funded by the U.S. Department of Energy (DOE) – Office of Fossil Energy under Award Number DE-FE0032177, aimed to assess the feasibility of an integrated Laser-Induced Breakdown Spectroscopy (LIBS) system with advanced machine learning (ML) models for real-time characterization and potential control of hydrogen gasifiers running on waste materials as feedstocks. This was a multidisciplinary effort that encompassed the acquisition and standardized analysis of individual and blended feedstocks—comprising biomass, coal waste, and plastic waste, followed by the development of a dynamic LIBS bench system for material sample analysis and development of predictive ML models. Comprehensive laboratory testing enabled the creation of a robust elemental dataset that served as the foundation for ML model training. Techniques such as Random Forest, Gradient Boosting, Support Vector Regression, and Neural Networks were employed to predict key feedstock properties, including higher heating value (HHV), moisture content, thermal conductivity, and ash composition with high accuracy. The results were validated against experimental data and demonstrated strong potential for real-time application in gasifier control systems. The project concluded with a study on the integration of the LIBS+ML approach for gasifier control and a techno-economic analysis of the implementation of the approach into hydrogen (H 2 ) gasification systems. Dissemination of results was carried out at a DOE meeting. This work establishes a scalable framework for automated, in-line feedstock quality assessment, offering significant implications for process optimization and emissions reduction in hydrogen production.

01 COAL, LIGNITE, AND PEAT↗
NASA NTRS1976

Atmospheric refraction errors in laser ranging systems

The effects of horizontal refractivity gradients on the accuracy of laser ranging systems were investigated by ray tracing through three dimensional refractivity profiles. The profiles were generated by performing a multiple regression on measurements from seven or eight radiosondes, using a refractivity model which provided for both linear and quadratic variations in the horizontal direction. The range correction due to horizontal gradients was found to be an approximately sinusoidal function of azimuth having a minimum near 0 deg azimuth and a maximum near 180 deg azimuth. The peak to peak variation was approximately 5 centimeters at 10 deg elevation and decreased to less than 1 millimeter at 80 deg elevation.

Gardner, C. S.↗
NASA NTRS1986

Coupled stratospheric ozone and temperature responses to short-term changes in solar ultraviolet flux - An analysis of Nimbus 7 SBUV and SAMS data

Earlier studies of solar-induced variations in stratospheric parameters have been mainly concerned with observed ozone responses. In the present investigation, attention is given to temperature responses as well as ozone responses at low latitudes, taking into account 22 months of Nimbus 7 solar backscattered ultraviolet (SBUV) ozone and stratospheric and mesospheric sounder temperature data. A data description is provided, and cross-correlation and regression analyses are conducted. An extension is considered of an analytic model, which was derived by Frederick (1981) for the coupled behavior of ozone and temperature perturbations in the upper stratosphere and lower mesosphere. The extended model is applied to the results of the analyses. The obtained data provide statistical evidence for ozone and temperature responses to changes in solar ultraviolet flux on the time scale of the solar rotation period.

Hood, L. L.↗
NASA NTRS1997

Areal Distribution of the Oxygen-Isotope Ratio in Greenland

Mean values of the oxygen-isotope ratio relative to standard mean ocean water reported for 46 sites on the Greenland ice sheet are compiled together with data on mean annual surface temperature, latitude, 6180 elevation, and mean annual shortest distance to the open ocean denoted by the 10% sea-ice concentration boundary. Stepwise regression analyses, with 6180 as the dependent variable, define two robust models. In the forward mode at the 99.9% confidence level, only temperature enters the model. In the backward mode at the 95% confidence level, only temperature, latitude, and distance to the open ocean remain in the model. Inversions of the models on the basis of 160 gridpoint locations 100 km apart in the area delimited by the surface equilibrium line produce four contoured distributions of 6"0. Two distributions are based on the bivariate model and two on the multivariate model. The second distribution for each model is obtained substituting mean annual surface-temperature values obtained from the Nimbus-7 Temperature Humidity Infrared Radiometer (THIR) database. All four distributions are considered valid, and differences between them are evaluated using contoured anomaly maps. It is suggested that the inversion of the multivariate model using THIR data provides the more reliable pattern for studies of atmospheric advection or for the derivation of ice-flow adjustments for 6180 series obtained from deep-core or ablation-zone sites.

Zwally, H. Jay↗
NASA NTRS2000

Application of Neural Networks to Wind tunnel Data Response Surface Methods

The integration of nonlinear neural network methods with conventional linear regression techniques is demonstrated for representative wind tunnel force balance data modeling. This work was motivated by a desire to formulate precision intervals for response surfaces produced by neural networks. Applications are demonstrated for representative wind tunnel data acquired at NASA Langley Research Center and the Arnold Engineering Development Center in Tullahoma, TN.

Lo, Ching F.↗
NASA NTRS2001

Natural abundance deuterium and 18-oxygen effects on the precision of the doubly labeled water method

The doubly labeled water method for measuring total energy expenditure is subject to error from natural variations in the background 2H and 18O in body water. There is disagreement as to whether the variations in background abundances of the two stable isotopes covary and what relative doses of 2H and 18O minimize the impact of variation on the precision of the method. We have performed two studies to investigate the amount and covariance of the background variations. These were a study of urine collected weekly from eight subjects who remained in the Madison, WI locale for 6 wk and frequent urine samples from 14 subjects during round-trip travel to a locale > or = 500 miles from Madison, WI. Background variation in excess of analytical error was detected in six of the eight nontravelers, and covariance was demonstrated in four subjects. Background variation was detected in all 14 travelers, and covariance was demonstrated in 11 subjects. The median slopes of the regression lines of delta2H vs. delta18O were 6 and 7, respectively. Modeling indicated that 2H and 18O doses yielding a 6:1 ratio of final enrichments should minimize this error introduced to the doubly labeled water method.

NASA Discipline Regulatory Physiology↗
NASA NTRS1993

Horizontal angular VOR, nystagmus dumping, and sensation duration in spacelab SLS-1 crewmembers

In 1G, the apparent time constant (Td) of postrotatory SPV decay with the head tilted face down is 55% of that with head erect (Te). This phenomenon is called "nystagmus dumping" and has been attributed to G effects on VOR velocity storage. Similarly, postrotatory sensation duration with head tilted (Dd) is 32% of that when head erect (De). In parabolic flight, Te and De are 70% of 1-G values, but a pitch back dumping movement produces no further change. Te, Td, and Dd have not previously been measured in orbital flight. VOR and sensation duration was tested in 4 crewmembers in 4 preflight, 1 inflight (days 4 or 5) and 4 post flight sessions. Bitemporal EOG was recorded with eyes open in darkness. Instructions were to "gaze straight ahead," and indicate when "rotation sensation disappears or becomes ambiguous". Subjects were rotated CW and CCW head erect for 1 min at 120 degrees/s, stopped, and EOG was recorded for another 1 min. This procedure was then used to study dumping, except that immediately after chair stop, subjects pitched their head forward 90 degrees. SPV was calculated using order statistic filtering, and dropouts removed using an iterative model fitting method. Te and Td were determined by logarithmic linear regression of mean SPV for each subject. In orbit, 90 degrees pitch movement produced rapid subjective dumping, but not nystagmus dumping. Dd was noticeably shorter ("almost instantaneous") compared to preflight Dd. Te and Td in orbit were similar to preflight Te for 3/4 subjects (rather than to preflight Td as expected). No consistent VOR gain changes were seen in orbit. Although Te is known to decrease acutely in parabolic flight, a longer time constant was measured in 3/4 subjects after 4-5 days adaptation to weightlessness, suggesting a return of angular velocity storage.

NASA Experiment Number 178072 1/2↗
NASA NTRSDate not supplied

Simultaneous Development and Robust Optimization of a Microstructure Dependent Material

Recent microstructure characterization techniques combined with Symbolic Regression(SR)analysis has been proven to generate white box plasticity models well suited for incorporation into FEA software.The current work builds upon those efforts and demonstrates the applicability of Sequential Monte-Carlo (SMC) methods within SR analysis to condense model development and robust optimization into a single, co-dependent process. In this project, SMC methods provide a mechanism through which the observed microstructure features and associated variability can be incorporated into the discovery phase of model development and simultaneously recover approximate parameter distributions through SR analysis. The demonstration utilized a data set consisting of tensile test results from a limited number of sample specimens with corresponding EBSD data from which microstructure features were characterized.The maximum threshold stress model in the Visco-Plastic Self-Consistent (VPSC) code developed by Los Alamos National Laboratories was calibrated using mechanical test data.Synthetic volume elements with statistically equivalent microstructure were generated with DREAM3Dbased on the observed EBSD data. VPSC was used to simulate the corresponding tensile test response for each of the synthetic volume elements. The simulated microstructure and tensile test data was used astraining datafor SMC-SR algorithm and the resulting model was validated with data from the original empirical data set.

Karl Garbrecht↗
DOE OSTI2022

J-PLUS: Support vector regression to measure stellar parameters

Stellar parameters are among the most important characteristics in studies of stars which, in traditional methods, are based on atmosphere models. However, time, cost, and brightness limits restrain the efficiency of spectral observations. The Javalambre Photometric Local Universe Survey (J-PLUS) is an observational campaign that aims to obtain photometry in 12 bands. Owing to its characteristics, J-PLUS data have become a valuable resource for studies of stars. Machine learning provides powerful tools for efficiently analyzing large data sets, such as the one from J-PLUS, and enables us to expand the research domain to stellar parameters. The main goal of this study is to construct a support vector regression (SVR) algorithm to estimate stellar parameters of the stars in the first data release of the J-PLUS observational campaign. The training data for the parameter's regressions are featured with 12-waveband photometry from J-PLUS and are crossidentified with spectrum-based catalogs. These catalogs are from the Large Sky Area Multi-Object Fiber Spectroscopic Telescope, the Apache Point Observatory Galactic Evolution Experiment, and the Sloan Extension for Galactic Understanding and Exploration. We then label them with the stellar effective temperature, the surface gravity, and the metallicity. Ten percent of the sample is held out to apply a blind test. We develop a new method, a multi-model approach, in order to fully take into account, the uncertainties of both the magnitudes and the stellar parameters. The method utilizes more than 200 models to apply the uncertainty analysis. We present a catalog of 2 493 424 stars with the root mean square error of 160 K in the effective temperature regression, 0.35 in the surface gravity regression, and 0.25 in the metallicity regression. We also discuss the advantages of this multi-model approach and compare it to other machine-learning methods.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Exploring the Effects of Node Topology, Connectivity, and Metal Identity on the Binding of Nerve Agents and Their Hydrolysis Products in Metal–Organic Frameworks

Recent studies have shown that metal–organic frameworks (MOFs) built from hexanuclear M(IV) oxide cluster nodes are effective catalysts for nerve agent hydrolysis, where the properties of the active sites on the nodes can strongly influence the reaction energetics. The connectivity and metal identity of these M6 nodes can be easily tuned, offering extensive opportunities for computational screening to predict promising new materials. Thus, we used density functional theory (DFT) to examine the effects of node topology, connectivity, and metal identity on the binding energies of multiple nerve agents and their corresponding hydrolysis products. By computing an optimization metric based on the relative binding strengths of key hydrolysis reaction species (water, agent, and bidentate-bound products), we predicted optimal M6 nodes for hydrolyzing specific nerve agent and simulant molecules, where our results are in qualitative agreement with observed experimental trends. This analysis highlighted the notion that no single metal or node topology is optimal for all possible organophosphates, suggesting that MOFs should be selected based on the agent of interest. Using the large amount of data generated from our DFT calculations, we then derived quantitative structure–activity relationship (QSAR) models to help explain the complex trends observed in the binding energies. Through linear regression, we identified the most important descriptors for describing the binding of nerve agents and their hydrolysis products to M6 nodes. These results suggested that both molecular and node properties, including both structural and chemical features, collectively contribute to the binding energetics. By performing a thorough statistical analysis, we showed that our QSAR models are capable of making quantitatively accurate binding energy predictions for nerve agents and their hydrolysis products in a wide variety of M(IV)-MOFs. In conclusion, the insights gained herein can be used to guide future experiments for the synthesis of MOFs with enhanced catalytic activity for organophosphate hydrolysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

CO 2 zonal injection rate allocation and plume extent evaluation through wellbore temperature analysis

Temperature analysis during a pause in injection operations, known as warmback analysis, has been used in the petroleum industry for evaluating the injection conformance and estimating the location of the flooded front in applications, such as waterflooding oil reservoirs. Here in this work, methods are introduced to extend the application of temperature warmback analysis to estimate the zonal CO 2 injection rate and zonal CO 2 plume extent during geologic CO 2 storage in a saline aquifer. First, novel analytical solutions are developed to model transient temperature in the aquifer during the injection and subsequent shut-in periods considering two-phase flow (gaseous CO 2 and aqueous brine) conditions in the aquifer. The solution involves a discretization of the aquifer into regions; the energy and mass conservation equations for the regions are solved simultaneously considering appropriate boundary conditions at the interfaces. Two solutions techniques are presented: multi-region and three-region solutions. Inverse models are developed accordingly to evaluate the injection profile and estimate the extent of the plume front in the reservoir during the injection period. The multi-region solution results in an inversion approach that requires regression analysis. However, the three-region formulation results in a simple graphical technique for inverse modeling. The analytical solutions are validated against a thermally coupled reservoir simulation tool using different synthetic cases for CO 2 injection in deep saline aquifers. The results of the developed solutions provide a good match with numerical results during forward and inverse modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Artificial Intelligence/Machine Learning Technologies for Advanced Reactors (Workshop Summary Report)

A workshop on artificial intelligence and machine learning (AI/ML) for advanced reactors (AR) was held October 5-6, 2021. The workshop was to be attended in-person at ANL but COVID restrictions forced the workshop to go virtual. The objectives of the workshop were to identify the most promising AI/ML opportunities for improving advanced reactor design, optimizing plant performance, and enhancing economic competitiveness and to develop an understanding of the scientific, engineering and licensing challenges facing their application. The workshop planning committee included GAIN, EPRI and NEI and members of three national laboratories (ANL, INL, and ORNL). The workshop was attended by more than 200 individuals representing academic and scientific institutions and the nuclear power industry. The definition put forth for an AI/ML system was one that perceives its environment and takes actions that maximize its chance of achieving its goals. In this report AI/ML refers to next generation algorithms that include deep learning, statistical analysis and data analytics and associated scientific computing and their potential application to the design, licensing, operation and maintenance of ARs. These methods typically incorporate models built from process data and may also include data generated by simulations that represent the behavior of a system. The workshop was organized in response to the growing interest in application of AI/ML for improving the economic competitiveness of nuclear energy. Increasingly more resources are being allocated to investigating the benefits of AI/ML methods. The DOE created the Artificial Intelligence & Technology Office to promote their development. And within the Office of Nuclear Energy, resources have been allocated to explore and understand the potential benefits of AI/ML. Additionally, the national laboratories are strategically positioned with DOE computing facilities such as Summit, Perlmutter, Aurora and Frontier that support large-scale simulations, hybrid HPC models with AI surrogates, and the exploration of new types of generative models emerging from multi-model data streams and sources. The workshop was organized with members of the AR community to understand the effort and to identify the level of interest and progress in this emerging technology. The workshop discussions focused on identifying opportunities for AI/ML across diverse areas of the nuclear industry and identifying current scientific and engineering challenges for advanced reactors that might be addressed through transformational uses of AI/ML. Discussion panels focused on four high-interest technical domains for advanced reactors: design, maintenance and operations, energy storage, and materials. The results of those discussions are summarized in this report. This includes opportunities that were identified for exploiting AI techniques and methods to improve the efficacy and efficiency of reactor analysis and to improve the operation and optimization of advanced reactors. Advanced reactor developers expressed an interest in learning more about AI/ML methods and their application. This included understanding whether ML methods can provide an advantage over existing nonlinear data regression methods for collapsing high-fidelity simulation results into faster running models. A consensus emerged that AR advances planned for the next decade will benefit from the use of AI/ML tools. The need exists to understand and model complex systems across length scales and modalities. AI/ML is a tool for discovery that can yield a set of engineering principles for use by nuclear engineers, licensing bodies, and operators to solve problems in plant design, safety analyses, autonomous operation, and predictive maintenance. While AI/ML represents a new set of tools, an awareness by the nuclear community of the full potential is still in the early stages so there is a need to increase awareness. It appears that the wide-spread adoption of AI/ML tools for ARs would be facilitated by future educational workshops that describe foundational methods and capabilities and describe successful applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Predicting Intensive Care Unit Length of Stay and Mortality Using Patient Vital Signs: Machine Learning Model Development and Validation

Background: Patient monitoring is vital in all stages of care. In particular, intensive care unit (ICU) patient monitoring has the potential to reduce complications and morbidity, and to increase the quality of care by enabling hospitals to deliver higher-quality, cost-effective patient care, and improve the quality of medical services in the ICU. Objective: We here report the development and validation of ICU length of stay and mortality prediction models. The models will be used in an intelligent ICU patient monitoring module of an Intelligent Remote Patient Monitoring (IRPM) framework that monitors the health status of patients, and generates timely alerts, maneuver guidance, or reports when adverse medical conditions are predicted. Methods: We utilized the publicly available Medical Information Mart for Intensive Care (MIMIC) database to extract ICU stay data for adult patients to build two prediction models: one for mortality prediction and another for ICU length of stay. For the mortality model, we applied six commonly used machine learning (ML) binary classification algorithms for predicting the discharge status (survived or not). For the length of stay model, we applied the same six ML algorithms for binary classification using the median patient population ICU stay of 2.64 days. For the regression-based classification, we used two ML algorithms for predicting the number of days. We built two variations of each prediction model: one using 12 baseline demographic and vital sign features, and the other based on our proposed quantiles approach, in which we use 21 extra features engineered from the baseline vital sign features, including their modified means, standard deviations, and quantile percentages. Results: We could perform predictive modeling with minimal features while maintaining reasonable performance using the quantiles approach. The best accuracy achieved in the mortality model was approximately 89% using the random forest algorithm. The highest accuracy achieved in the length of stay model, based on the population median ICU stay (2.64 days), was approximately 65% using the random forest algorithm. Conclusions: The novelty in our approach is that we built models to predict ICU length of stay and mortality with reasonable accuracy based on a combination of ML and the quantiles approach that utilizes only vital signs available from the patient’s profile without the need to use any external features. This approach is based on feature engineering of the vital signs by including their modified means, standard deviations, and quantile percentages of the original features, which provided a richer dataset to achieve better predictive power in our models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Surface Structure of Reacting Solid Ramjet Fuels

Solid fuel ramjets are a developing technology that will enable extended range for supersonic vehicles. The simplicity of the system in terms of moving parts results in the performance being dictated by the solid fuel combustion processes. The physics near the surface, particularly in the fuel-rich recirculation zone, are challenging to resolve due to flow opacity. Here, regression rate measurements of hydroxyl-terminated polybutadiene from a miniature, portable slab burner are reported. Mass-averaged regression rates agree with correlations from the literature, suggesting that the proper physics in the burner are captured. Synchrotron-based phase-contrast imaging is used to quantify local surface features, including a multiphase froth layer, molten polymer transport, and local regression rate measurements in the recirculation zone. Regression rates near the inlet are less than the mass-averaged values, whereas near the reattachment point the local value exceeds the mass-averaged values. Further, the observed froth layer is as large as 2 mm near the inlet and decreases to sub-millimeter thicknesses near the reattachment point. An analytical heat transfer model is used to quantify the influence of the surface froth layer on the regression rates. Results indicate that the froth layer has an insulating effect and will reduce the local regression rate.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS2021

Chapter 5: Extravehicular Activity Metabolic Rate Model: Metabolic Rate Estimated from Heart Rate

In-flight monitoring of crew metabolic rates during extravehicular activity (EVA) provides crucial information in mitigating injury. The purpose of this study was to investigate the relationship of crewmember heart rate (HR) and metabolic rate (MR) during EVA operations to develop a predictive linear model. HR and MR data was collected from 132 EVAs from Shuttle and International Space Station (ISS) missions. MR was collected every 2-min from portable life support system delta oxygen decay, while HR was collected every 20-sec via electrocardiogram. HR was down sampled to every 2-min to match MR during EVA for evaluation. Further, a new metric was observed from direct relations between metabolic rate with HR over EVA time (MR/HR) measured as a BTU/beat. A range of BTU/beat was collected as a conversion scale between MR and HR at different EVA workloads categorized by increased MR. Both HR and MR values were observed to decrease through the duration of EVA. Similarly, HR and MR slopes decreased at start of EVA compared to end of EVA. MR/HR values were used to predict MR from HR over the entire duration of EVA with root mean square error less than 200 BTU/Hr. Additionally, MR was predicted based on HR values during EVA via a calculated simple linear regression. A regression equation was found for each EVA drawing relations between HR and MR (F (2923.84) and P<0.0001) with an R(sup 2) value of 0.402. Individual crew regressions improved prediction and R(sup 2) to greater than 0.82. Two models are presented to determine metabolic rate from heart rate during EVA. Results draw correlations for heart rate and metabolic rate fluctuations during EVA for individualized crew predictions during future operations. The linear models correlate to Apollo prediction data during historic EVAs.

Metabolic rate predictions↗