Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Variability in modelled reservoir greenhouse gas emissions: comparison of select US hydropower reservoirs against global estimates

Abstract Greenhouse gas (GHG) emissions from reservoirs have most often been evaluated on a global extent through areal scaling or linear-regression models. These models typically rely on a limited number of characteristics such as age, size, and average temperature to estimate per reservoir or areal flux. Such approaches may not be sufficient for describing conditions at all types of reservoirs. Emissions from hydropower reservoirs have received increasing attention as industry and policy makers seek to better understand the role of hydropower in sustainable energy solutions. In the United States (US), hydropower reservoirs span a wide range of climate regions and have diverse design and operational characteristics compared to those most heavily represented in model literature (i.e., large, tropical reservoirs). It is not clear whether estimates based on measurements and modeling of other subsets of reservoirs describe the diverse types of hydropower reservoirs in the US. We applied the Greenhouse Gas from Reservoirs (G‐res) emissions model to 28 hydropower reservoirs located in a variety of ecological, hydrological, and climate settings that represent the range of sizes and types of facilities within the US hydropower fleet. The dominant pathways for resulting GHG emissions estimates in the case-study reservoirs were diffusion of carbon dioxide, followed by methane ebullition. Among these case-study reservoirs, total post-impoundment areal flux of carbon ranges from 84 to 767 mgCm −2 d −1 , which is less variable than what has been reported through measurements at other US and global reservoirs. The net GHG reservoir footprint was less variable and towards the lower end of the range observed from modeling larger global reservoirs, with a range of 138 to 1,052 g CO 2 eq m −2 y −1 , while the global study reported a range of 115 to 145,472 g CO 2 eq m −2 y −1 . High variation in emissions normalized with respect to area and generation highlights the need to be cautious when using area or generation in predicting or communicating emissions footprints for reservoirs relative to those of other energy sources, especially given that many of the hydropower reservoirs in the US serve multiple purposes beyond power generation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

SysCaps (Language Interfaces for Simulation Surrogates of Complex Systems) [SWR-24-97]

You've found the official code repository for the paper "SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems," presented at the Foundation Models for Science: Progress, Opportunities, and Challenges workshop at NeurIPS 2024. Our paper conjectures that interfaces (both text templates as well as conversational) makes interacting with simulation surrogate models for complex systems more intuitive and accessible for both non-experts and experts. "System captions", or SysCaps, are text-based descriptions of systems based on information contained in simulation metadata. Our paper's goal is to train multimodal regression models that take text inputs (SysCaps) and timeseries inputs (exogenous system conditions such as hourly weather) and regress timeseries simulation outputs (e.g. hourly building energy consumption). The experiments in our paper with building and wind farm simulators, which can be reproduced using this codebase, aim to help us understand whether a) accurate regression in this setting is possible and b) if so, how well can we do it. Paper: https://arxiv.org/abs/2405.19653

Emami, Patrick↗
DOE OSTI2022

Epidural anesthesia needle guidance by forward-view endoscopic optical coherence tomography and deep learning

Epidural anesthesia requires injection of anesthetic into the epidural space in the spine. Accurate placement of the epidural needle is a major challenge. To address this, we developed a forward-view endoscopic optical coherence tomography (OCT) system for real-time imaging of the tissue in front of the needle tip during the puncture. We tested this OCT system in porcine backbones and developed a set of deep learning models to automatically process the imaging data for needle localization. A series of binary classification models were developed to recognize the five layers of the backbone, including fat, interspinous ligament, ligamentum flavum, epidural space, and spinal cord. The classification models provided an average classification accuracy of 96.65%. During puncture, it is important to maintain a safe distance between the needle tip and the dura mater. Regression models were developed to estimate that distance based on the OCT imaging data. Based on the Inception architecture, our models achieved a mean absolute percentage error of 3.05% ± 0.55%. Overall, our results validated the technical feasibility of using this novel imaging strategy to automatically recognize different tissue structures and measure the distances ahead of the needle tip during the epidural needle placement.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

An accurate and interpretable model for antimicrobial resistance in pathogenic Escherichia coli from livestock and companion animal species

Understanding the microbial genomic contributors to antimicrobial resistance (AMR) is essential for early detection of emerging AMR infections, a pressing global health threat in human and veterinary medicine. Here we used whole genome sequencing and antibiotic susceptibility test data from 980 disease causing Escherichia coli isolated from companion and farm animals to model AMR genotypes and phenotypes for 24 antibiotics. We determined the strength of genotype-to-phenotype relationships for 197 AMR genes with elastic net logistic regression. Model predictors were designed to evaluate different potential modes of AMR genotype translation into resistance phenotypes. Our results show a model that considers the presence of individual AMR genes and total number of AMR genes present from a set of genes known to confer resistance was able to accurately predict isolate resistance on average (mean F 1 score = 98.0%, SD = 2.3%, mean accuracy = 98.2%, SD = 2.7%). However, fitted models sometimes varied for antibiotics in the same class and for the same antibiotic across animal hosts, suggesting heterogeneity in the genetic determinants of AMR resistance. We conclude that an interpretable AMR prediction model can be used to accurately predict resistance phenotypes across multiple host species and reveal testable hypotheses about how the mechanism of resistance may vary across antibiotics within the same class and across animal hosts for the same antibiotic.

Chung, Henri C.↗
DOE OSTI2020

Control-Oriented Modeling of Cycle-to-Cycle Combustion Variability at the Misfire Limit in SI Engines

A control-oriented model is presented that can capture the prior-cycle correlation of combustion cycles during conditions with high levels of exhaust gas recirculation (EGR). Combustion events are modeled in discrete time and the dynamic evolution is captured by the residual air, fuel, and inert gas trapped in the combustion chamber. The mathematical formulation of the model is presented together with the calibration procedure to emulate a particular engine operating condition. A cycle-to-cycle system identification methodology is described which allows regressing model parameters from experimental data. Simulations are presented and compared to real engine measurements to show the modeling potential for analysis and control of combustion events.

Maldonado Puente, Bryan↗
DOE OSTI2020

EBSD seed LDRD project: Does Corona Virus – 2019 (COVID-19) and Seasonal Flu have similar meteorology and air quality controls driving their spread?

Seasonal influenza and Influenza like Illnesses (ILI) pose a serious public health risk and in turn affect the economy. Various factors affect ILI cases and mortality, including the pathogen and its interaction with the host, as well as environmental and socioeconomic factors such as meteorology, household structure, air pollution, urbanization, and population. Despite the growing number of studies on influenza and ILI, challenges remain in forecasting the timing of seasonal onset, outbreak patterns, and key factors affecting transmission. In particular, the impacts of meteorology and air quality on ILI have been challenging to understand, with linear regression studies focused on different geographic regions producing contradictory results. For example, influenza seasonality has been associated with cold-dry conditions in temperate mid-latitudes, but with humid-rainy conditions in tropical climates. These apparently contradictory results imply that the relationships between influenza cases and atmospheric variables may be too complex to be captured by linear regression models. In this seed project, we analyze meteorology and air quality variables from numerical models to determine which atmospheric variables are most helpful in predicting weekly changes in recorded flu cases. In contrast to most previous studies that relied on linear regression analysis to predict the timing of the flu onset or peak, we employ a robust machine learning algorithm to evaluate the contribution of atmospheric variables to weekly changes in recorded ILI cases. These results may also be relevant to the spread of other respiratory illnesses such as Corona Virus Disease – 2019 (COVID-19).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Multi-objective optimization of peel and shear strengths in ultrasonic metal welding using machine learning-based response surface methodology

Ultrasonic metal welding (UMW) is a solid-state joining technique with varied industrial applications. Despite of its numerous advantages, UMW has a relative narrow operating window and is sensitive to variations in process conditions. As such, it is imperative to quantitatively characterize the influence of welding parameters on the resulting joint quality. The quantification model can be subsequently used to optimize the parameters. Conventional response surface methodology (RSM) usually employs linear or polynomial models, which may not be able to capture the intricate, nonlinear input-output relationships in UMW. Furthermore, some UMW applications call for simultaneous optimization of multiple quality indices such as peel strength, shear strength, electrical conductivity, and thermal conductivity. To address these challenges, this paper develops a machine learning (ML)-based RSM to model the input-output relationships in UMW and jointly optimize two quality indices, namely, peel and shear strengths. The performance of various ML methods including spline regression, Gaussian process regression (GPR), support vector regression (SVR), and conventional polynomial regression models with different orders is compared. A case study using experimental data shows that GPR with radial basis function (RBF) kernel and SVR with RBF kernel achieve the best prediction accuracy. The obtained response surface models are then used to optimize a compound joint strength indicator that is defined as the average of normalized shear and peel strengths. In addition, the case study reveals different patterns in the response surfaces of shear and peel strengths, which has not been systematically studied in the literature. While developed for the UMW application, the method can be extended to other manufacturing processes.

42 ENGINEERING↗
DOE OSTI2025

Machine learning models for volumetric swelling in uranium nitride

Machine learning methods are applied to predict the volumetric swelling rate of the nuclear fuel uranium nitride (UN) over various temperatures, irradiation conditions, and power densities. Both kernel-based methods and symbolic regression models for UN swelling are developed and compared with multiple experimental datasets. We find that the UN pellet geometry and dimensions must be taken into account to accurately model swelling behavior. Strong agreement is observed between the developed machine learning models and the data. The predictive error generated by the machine learning models improves on empirical models taken from the literature. Sensitivity analysis is performed to determine which properties such as temperature, burnup, and power density, are most important in the swelling process. We find that machine learning can be used to quickly develop accurate swelling models for nuclear materials. In conclusion, the presented results illustrate the potential of machine learning to determine volumetric swelling in UN.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Effects of Different Types of Entrances on Natural Ventilation in a Subway Station

In this study, the natural ventilation of a horizontal entrance of a typical subway station is investigated based on numerical simulations and experiments. In addition, a renormalization group k-e model (RNG k-e model) is applied to compute both the internal and external airflow patterns. Computational fluid dynamics (CFD) simulations are validated based on the experimental results. Furthermore, a multiple variable regression model is employed to study how the different parameters affect the internal airflow rates of the subway station statistically, according to the experimental results. For this typical model, the parameter importance can be ranked as follows: (1) outdoor wind speed; (2) flow resistance of the subway station; (3) height of the wind catcher; and (4) length of the wind catcher. To understand the detailed pressure distribution of the horizontal entrance of the subway station with and without the wind catcher, 3D numerical simulations are conducted for different scenarios. We attempt to alter the size of the wind catcher (including the length and height) to study the characteristics of the pressure on the horizontal entrance of the subway station under outdoor wind-driven conditions. The pressure distributions for the entrance for different scenarios are compared and analyzed. Finally, the interactions between the internal and external flows are investigated by changing the resistance of the subway station. When the internal flow resistance is changed, the pressure coefficient (Cp) of the entrance is different as well. Hence, the Cp is not only affected by the outdoor environment, but is also influenced by the internal airflows.

CFD↗
DOE OSTI2022

Sulfur TES ML [SWR-23-02]

Sulfur TES ML contains code originally created to develop surrogate ML models to mimic the utility of CFD simulations of Sulfur TES systems. It has been adapted to provide a comprehensive package for building, training, validating, testing, and optimizing regression models with customizable features and targets.

Menear, Kevin↗
NASA NTRS2024

Evaluation, Analysis, and Application of Internal Strain-Gage Balance Data

Experimental processes, analytical methods, and numerical algorithms are described that may be used to predict the forces and moments of an internal strain–gage balance during a wind tunnel test. First, the control volume model of a strain–gage balance and the concepts of load state, load space, and output space are introduced. These important abstractions provide a better understanding of fundamental characteristics of different balance load prediction approaches. Then, the description of strain–gage balance data and the definition of the primary bridge sensitivity are discussed. Afterwards, basic elements of the calibration of a typical six–component balance are reviewed. Two fundamentally different balance load prediction methods, the processing of check loads, and related topics are also discussed. Three real–world balance data examples are reviewed in great detail to illustrate typical analysis results for a variety of strain–gage balance designs. Finally, important observations are summarized and recommendations are provided. – Additional information and detailed mathematical derivations can be found in the appendices of the document. They include the following topics: balance terminology, definitions of important statistical metrics, balance axis system conventions, balance load transformations, the combined load diagram, electrical output format options, bi–directional output characteristics, determination of the natural zeros, derivation of two balance load prediction methods, description of two tare load iteration algorithms, modeling of balance temperature effects, basics of three–component moment balances, definition of the percent contribution, detection of linear and near–linear dependencies in balance calibration data, a regression model search algorithm, balance interactions, and other related information.

strain-gage balance↗
DOE OSTI2025

PAVC Gridded 20m Alaska NGEE Tier3 PFTs v1.0

These 20-meter spatial resolution gridded products provide per-pixel fractional cover (%) of Next Generation Ecosystem Experiments (NGEE) Arctic Plant Functional Types (PFTs) Tier 3 across Alaska, north of the boreal treeline. The products were developed for the NGEE Arctic project, which is improving Arctic vegetation representation and parameterization of the E3SM Land Model. This dataset includes 8 files containing fractional cover for NGEE Tier 3 PFTs (https://data.ess-dive.lbl.gov/view/doi:10.15485/2529470): (1) bryophytes; (2) lichens; (3) non-vascular plants, i.e., the sum of lichens and bryophytes; (4) deciduous shrubs, (5) evergreen shrubs, (6) forbs, (7) graminoids, and a non-PFT class, (8) litter. Each pixel contains the percent cover (expressed as a fraction of total ground cover) that was predicted by random-forest regression models. The random-forest models were trained on cover data collected at 978 plots from 2010 to 2021, of which are archived in the Pan-Arctic Vegetation Cover (PAVC) database (https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2483557). The plot cover was linked to 20-meter spatial resolution, satellite-derived predictor variables: Sentinel-2 spectra and Sentinel-1 polarizations averaged over the 2019 growing season, as well as topographical features derived from ArcticDEM. Then, spatio-temporally anomalous plot data that introduced large variability to the regression outcomes were dropped using the Cook’s distance outlier detection method, and the models were re-created using high-quality plots and their associated satellite derived explanatory variables per each PFT. The correlations between plot-observed and satellite-derived fractional cover for all PFTs were well correlated (R2 = 0.69–0.95 and 0.5 for litter) and had low RMSE bias (0.02–0.11). This research was performed as a part of the NGEE Arctic project. The NGEE Arctic project was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Bi-fidelity variational auto-encoder for uncertainty quantification

Quantifying the uncertainty of quantities of interest (QoIs) from physical systems is a primary objective in model validation. However, achieving this goal entails balancing the need for computational efficiency with the requirement for numerical accuracy. To address this trade-off, we propose a novel bi-fidelity formulation of variational auto-encoders (BF-VAE) designed to estimate the uncertainty associated with a QoI from low-fidelity (LF) and high-fidelity (HF) samples of the QoI. Here, this model allows for the approximation of the statistics of the HF QoI by leveraging information derived from its LF counterpart. Specifically, we design a bi-fidelity auto-regressive model in the latent space which is integrated within the VAE’s probabilistic encoder–decoder structure. An effective algorithm is proposed to maximize the variational lower bound of the HF log-likelihood in the presence of limited HF data, resulting in the synthesis of HF realizations with a reduced computational cost. Additionally, we introduce the concept of the bi-fidelity information bottleneck (BF-IB) to provide an information-theoretic interpretation of the proposed BF-VAE model. Our numerical results demonstrate that the BF-VAE leads to considerably improved accuracy, as compared to a VAE trained using only HF data, when limited HF data is available.

42 ENGINEERING↗
DOE OSTI2022

Survival analysis of localized prostate cancer with deep learning

In recent years, data-driven, deep-learning-based models have shown great promise in medical risk prediction. By utilizing the large-scale Electronic Health Record data found in the U.S. Department of Veterans Affairs, the largest integrated healthcare system in the United States, we have developed an automated, personalized risk prediction model to support the clinical decision-making process for localized prostate cancer patients. This method combines the representative power of deep learning and the analytical interpretability of parametric regression models and can implement both time-dependent and static input data. To collect a comprehensive evaluation of model performances, we calculate time-dependent C-statistics C td over 2-, 5-, and 10-year time horizons using either a composite outcome or prostate cancer mortality as the target event. The composite outcome combines the Prostate-Specific Antigen (PSA) test, metastasis, and prostate cancer mortality. Our longitudinal model Recurrent Deep Survival Machine (RDSM) achieved C td 0.85 (0.83), 0.80 (0.83), and 0.76 (0.81), while the cross-sectional model Deep Survival Machine (DSM) attained C td 0.85 (0.82), 0.80 (0.82), and 0.76 (0.79) for the 2-, 5-, and 10-year composite (mortality) outcomes, respectively. In addition to estimating the survival probability, our method can quantify the uncertainty associated with the prediction. The uncertainty scores show a consistent correlation with the prediction accuracy. We find PSA and prostate cancer stage information are the most important indicators in risk prediction. Our work demonstrates the utility of the data-driven machine learning model in prostate cancer risk prediction, which can play a critical role in the clinical decision system.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Predicting bulge to total luminosity ratio of galaxies using deep learning

ABSTRACT We present a deep learning model to predict the r-band bulge-to-total luminosity ratio (B/T) of nearby galaxies using their multiband JPEG images alone. Our Convolutional Neural Network (CNN) based regression model is trained on a large sample of galaxies with reliable decomposition into the bulge and disc components. The existing approaches to estimate the B/T ratio use galaxy light-profile modelling to find the best fit. This method is computationally expensive, prohibitively so for large samples of galaxies, and requires a significant amount of human intervention. Machine learning models have the potential to overcome these shortcomings. In our CNN model, for a test set of 20 000 galaxies, 85.7 per cent of the predicted B/T values have absolute error (AE) less than 0.1. We see further improvement to 87.5 per cent if, while testing, we only consider brighter galaxies (with r-band apparent magnitude <17) with no bright neighbours. Our model estimates the B/T ratio for the 20 000 test galaxies in less than a minute. This is a significant improvement in inference time from the conventional fitting pipelines, which manage around 2–3 estimates per minute. Thus, the proposed machine learning approach could potentially save a tremendous amount of time, effort, and computational resources while predicting B/T reliably, particularly in the era of next-generation sky surveys such as the Legacy Survey of Space and Time (LSST) and the Euclid sky survey which will produce extremely large samples of galaxies.

Grover, Harsh (ORCID:0000000321338142)↗
NASA NTRS2007

Productivity Analysis of Public and Private Airports: A Causal Investigation

Around the world, airports are being viewed as enterprises, rather than public services, which are expected to be managed efficiently and provide passengers with courteous customer services. Governments are, increasingly, turning to the private sectors for their efficiency in managing the operation, financing, and development, as well as providing security for airports. Operational and financial performance evaluation has become increasingly important to airport operators due to recent trends in airport privatization. Assessing performance allows the airport operators to plan for human resources and capital investment as efficiently as possible. Productivity measurements may be used as comparisons and guidelines in strategic planning, in the internal analysis of operational efficiency and effectiveness, and in assessing the competitive position of an airport in transportation industry. The primary purpose of this paper is to investigate the operational and financial efficiencies of 22 major airports in the United States and Europe. These airports are divided into three groups based on private ownership (7 British Airport Authority airports), public ownership (8 major United States airports), and a mix of private and public ownership (7 major European Union airports. The detail ownership structures of these airports are presented in Appendix A. Total factor productivity (TFP) model was utilized to measure airport performance in terms of financial and operational efficiencies and to develop a benchmarking tool to identify the areas of strength and weakness. A regression model was then employed to measure the relationship between TFP and ownership structure. Finally a Granger causality test was performed to determine whether ownership structure is a Granger cause of TFP. The results of the analysis presented in this paper demonstrate that there is not a significant relationship between airport TFP and ownership structure. Airport productivity and efficiency is, however dependent upon the level of competition, choice of the market, and regulatory control.

Vasigh, Bijan↗
NASA NTRS2023

Accounting for Dose Uncertainty in Dose-Response Curve Estimation Using Hierarchical Bayes Models

As part of their development of the technology for low-boom supersonic flight, the National Aeronautics and Space Administration (NASA) is planning to conduct a set of supersonic aircraft annoyance surveys in select communities in the United States, to measure public perception of the reduced sonic boom. The relationship between a noise exposure level of a supersonic flight event and the probability of an individual being highly annoyed by the event is quantified by a dose-response curve, which is usually based on logistic regression modeling. Unavoidable amounts of estimation error are expected in the upcoming noise measurements, which can bias the results of the logistic regression if ignored. Hence, the development of an estimation approach that accounts for such error when estimating the dose-response curve is imperative. In this paper, an evaluation study is conducted to assess the impact of measurement error on dose-response curve estimation. For this, hierarchical Bayes models using different specifications are fit to data collected by NASA in 2018, as part of a risk-reduction study of supersonic flights affecting Galveston, Texas. It is observed that the estimated dose-response curve appears sensitive to uncertainty in dose measurements, being subject to attenuation bias.

community response↗