SEARCH · Engineering Papers
Results for “regression models”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Summary report of the 4th IAEA Technical Meeting on Fusion Data Processing, Validation and Analysis (FDPVA)
The objective of the Fourth Technical Meeting on Fusion Data Processing, Validation and Analysis was to provide a platform during which a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolating needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics and synthetic diagnostics data analysis (including image processing, regression analysis, inverse problems, deep learning, machine learning, big data and physics-based models for control) reported at the meeting. The progress in these areas highlight trends observed in current major fusion confinement devices. A special focus is dedicated on data analysis requirements for ITER and DEMO with a particular attention paid to artificial intelligence for automatization and improving reliability of control processes.
Machine Learned Empirical Numerical Integrator from Simulated Data
Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.
Two-Day Westward-Propagating Inertio-Gravity Waves during GoAmazon
The dynamical and thermodynamical features of Amazonian 2-day westward-propagating inertia–gravity (WIG) waves are examined. On the basis of a linear regression analysis of satellite brightness temperature and data from the 2014–15 Observations and Modeling of the Green Ocean Amazon (GoAmazon) field campaign, it is shown that Amazonian WIG waves exhibit structure and propagation characteristics consistent with the n = 1 WIG waves from shallow water theory. These WIG waves exhibit a pronounced seasonality, with peak activity occurring from March to May and a minimum occurring from June to September. Evidence is shown that mesoscale convective systems over the Amazon are frequently organized in 2-day WIG waves. Results suggest that many of the Amazonian WIG waves come from preexisting 2-day waves over the Atlantic, which slow down when coupled with the deeper, more intense convection over tropical South America. In contrast to WIG waves that occur over the ocean, Amazonian 2-day WIG waves exhibit a pronounced signature in surface temperature, moisture, and heat fluxes.
Biogeophysical Effects of Land-Use and Land-Cover Change Not Detectable in Warmest Month
Land-use and land-cover changes (hereafter simply “land use”) alter climates biogeophysically by affecting surface fluxes of energy and water. Yet, near-surface temperature responses to land use across observational versus model-based studies and spatial-temporal scales can be inconsistent. Here we assess the prevalence of the historical land use signal of daily maximum temperatures averaged over the warmest month of the year (t LU ) using regularized optimal fingerprinting for detection and attribution. We use observations from the Climatic Research Unit and Berkeley Earth alongside historical simulations with and without land use from phase 6 of the Coupled Model Intercomparison Project to reconstruct an experiment representing the effects of land use on climate. To assess the signal of land use at spatially resolved continental and global scales, we aggregate all input data across reference regions and continents, respectively. At both scales, land use does not comprise a significantly detectable set of forcings for two of four Earth system models and their multimodel mean. Furthermore, using a principal component analysis, we find that t LU is mostly composed of the nonlocal effects of land use rather than its local effects. These findings show that, at scales relevant for climate attribution, uncertainties in Earth system model representations of land use are too high relative to the effects of internal variability to confidently assess land use.
Trends in Regional Nodal Management of Breast Cancer Patients with Low Nodal Burden
Background: American College of Surgeons Oncology Group Z0011 confirms the safety of omitting axillary lymph node dissection (ALND) and regional nodal irradiation (RNI) in breast cancer patients with one to two positive sentinel lymph nodes (SLNs), without compromising disease-free survival (DFS) and overall survival (OS). In contrast, the NCIC MA20 trial showed improved DFS in node-positive patients undergoing ALND and RNI. We sought to examine how these data have influenced the management of patients with limited nodal burden. Methods: Using the National Cancer Database, patients diagnosed between 2010 and 2015 and who met the criteria for Z0011 were identified. Logistic regression was used to analyze factors associated with practice patterns. The Cox proportional hazards model was used to assess the association of ALND and RNI with OS. Results: Omission of ALND in Z0011-eligible patients reached 89.2% in 2015. This Z0011-compliant group was more likely to undergo RNI compared with the non-compliant group (36.4% vs. 31.3%; p < 0.05), with RNI increasing to 43.8% by 2015. Factors associated with the use of RNI included later year of diagnosis [odds ratio (OR) 1.8, 95% confidence interval (CI) 1.6–2.1], hormone receptor-negative tumor (OR 1.2, 95% CI 1.1–1.4), grade 3 tumor (OR 1.2, 95% CI 1.1–1.3), treatment at a non-academic site (OR 1.2, 95% CI 1.1–1.3) and two versus one positive SLN (OR 2.0, 95% CI 1.8–2.2). With 43 months median follow-up, RNI was not associated with improved OS. Conclusion: Since the publication of Z0011, the omission of ALND has become widespread; however nearly half of these women now receive RNI. The optimal radiation therapy approach for this low nodal burden population warrants further study.
An Experimental Kinetics Study of Isopropanol Pyrolysis and Oxidation behind Reflected Shock Waves
Isopropanol has potential as a future bio-derived fuel and is a promising substitute for ethanol in gasoline blends. Even so, little has been done in terms of high-temperature chemical kinetic speciation studies of this molecule. To this end, experiments were conducted in a shock tube using simultaneous CO and H2O laser absorption measurements. Water and CO formation during isopropanol pyrolysis was also examined at temperatures between 1127 and 2162 K at an average pressure of 1.42 atm. Species profiles were collected at temperatures between 1332 and 1728 K and at an average pressure of 1.26 atm for equivalence ratios of 0.5, 1.0, and 2.0 in highly diluted mixtures of 20% helium and 79.5% argon. Species profiles were also compared to four modern C3 alcohol mechanisms, including the impact of recent rate constant measurements. The Li et al. (2019) and Saggese et al. (2021) models both best predict CO and water production under pyrolysis conditions, while the AramcoMech 3.0 and Capriolo and Konnov models better predict the oxidation experimental profiles. Additionally, previous studies have collected ignition delay time (τign) data for isopropanol but are limited to low pressures in highly dilute mixtures. Therefore, real fuel–air experiments were conducted in a heated shock tube with isopropanol for stoichiometric and lean conditions at 10 and 25 atm between 942 and 1428 K. Comparisons to previous experimental results highlight the need for real fuel–air experiments and proper interpretation of shock-tube data. The AramcoMech 3.0 model over predicts τign values, while the Li et al. model severely under predicts τign. The models by Capriolo and Konnov and Saggese et al. show good agreement with experimental τign values. A sensitivity analysis using these two models highlights the underlying chemistry for isopropanol combustion at 25 atm. Additionally, modifying the Li et al. model with a recently measured reaction rate shows improvement in the model’s ability to predict CO and water profiles during dilute oxidation. Finally, a regression analysis was performed to quantify τign results from this study.
Determination of Molecular Structure and Dynamics of Molten Salts by Advanced Neutron and X-ray Scattering Measurements and Computer Modeling
The design and development of fully functional Molten-Salt Reactors (MSR) require detailed knowledge of the molten salt properties in order to understand and predict the salt’s behavior. Fundamental properties of interest include molecular structure, speciation, and dynamics (such as diffusion coefficients) of salt components and dissolved corrosion and fission products. Computer modeling is necessary to predict changes in physical and chemical properties due to irradiation, burning of dissolved fuel, and corrosion. The modeling requires experimental data, and advanced neutron and x-ray scattering and spectroscopy provide the most reliable and direct determination of the structure (Pair-Distribution Functions, PDF), and dynamics of ions in the melt. This project dealt with both fluoride and chloride salts. The PDFs have been measured by a combination of neutron and x-ray diffraction. We utilized the techniques of isotope substitutions, a very powerful tool available for neutron-scattering, to extract the details of the liquid structure. Although similar measurements have been done before, modern advanced neutron and x-ray-scattering techniques allow collecting the data at much higher resolution and in a wider range of temperatures. Importantly, we were among the first to study fluoride salts by neutron scattering. The importance of impurities and their effects on salt properties have become apparent recently and so new methods of salt purification were developed. We took advantage of these developments to produce reliable data, which have been used for computer simulations of both clean salts and those with added fission and corrosion products most relevant for MSRs. Ab initio molecular dynamics simulations have been performed to understand the multi-component liquid solution, in particular solubility of impurities and thermodynamic interactions in relation to the ionic-cluster structure of the fluid. We applied machine learning to regress from the simulation and experimental data in order to develop a fast-acting model that can handle molten salt with an arbitrary (≥ 10) number of chemical elements and be able to predict chemical potential as a function of composition and temperature. This project resulted in a number of experimental and computer-simulation publications, a patent application, and numerous conference presentations (American Physical Society, American Chemical Society, and The Electrochemical Society among others). Multiple students and postdocs participated and collaborated on aspects of this project. This project seeded new collaborations between MIT and other institutions, such as the University of Massachusetts Lowell, the University of Illinois Urbana-Champaign, the University of California Berkeley, and Oak Ridge and Los Alamos National Labs. As such, this project has had a broad and lasting impact beyond its original scientific scope.
Verification and validation of developed short-term forecasting models
Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.
Understanding Predictability of Daily Southeast U.S. Precipitation Using Explainable Machine Learning
Abstract We investigate the predictability of the sign of daily southeastern U.S. (SEUS) precipitation anomalies associated with simultaneous predictors of large-scale climate variability using machine learning models. Models using index-based climate predictors and gridded fields of large-scale circulation as predictors are utilized. Logistic regression (LR) and fully connected neural networks using indices of climate phenomena as predictors produce neither accurate nor reliable predictions, indicating that the indices themselves are not good predictors. Using gridded fields as predictors, an LR and convolutional neural network (CNN) are more accurate than the index-based models. However, only the CNN can produce reliable predictions that can be used to identify forecasts of opportunity. Using explainable machine learning we identify which variables and grid points of the input fields are most relevant for confident and correct predictions in the CNN. Our results show that the local circulation is most important as represented by maximum relevance of 850-hPa geopotential heights and zonal winds to making skillful, high-probability predictions. Corresponding composite anomalies identify connections with El Niño–Southern Oscillation during winter and the Atlantic multidecadal oscillation and North Atlantic subtropical high during summer.
Consumer-Oriented Energy Use and Range Metrics for Battery Electric Vehicles
The present study was motivated by a need to expand information for consumers offered through the FuelEconomy.Gov website. To that end, a power-based modeling approach has been used to examine the effect of steady-speed driving on estimated range for model year 2020 – 2023 battery electric vehicles (BEVs). This approach allowed rapid study of a broader range of BEV models than could be accomplished through vehicle tests. Publicly accessible certification test results and other data were used to perform a regression between cycle-average tractive power requirements and the resulting electrical power. Importantly, this regression enabled estimation of electric power and energy use over a range of steady highway speeds. These analyses in turn allowed projection of vehicle range at differing speeds. The projections agree within 6% with available 65 MPH manufacturer test data. Analyses of vehicles from model years 2020 – 2023 show that the 5-cycle range and energy use values from the window stickers of new vehicles are reasonable values for steady-speed driving at 65 MPH. Range decreases by a median value of approximately 15% for each 10 MPH increase in speed. The 5-cycle energy use (in kW-Hr / 100 miles) and energy economy (in miles / kW-Hr) derived from the 5-cycle energy use are reasonable estimates for 65 MPH steady speed driving. Energy economy decreases by about 0.5 miles / kW-Hr for every 10 MPH increase in speed.
Nested active learning for efficient model contextualization and parameterization: pathway to generating simulated populations using multi-scale computational models
There is increasing interest in the use of mechanism-based multi-scale computational models (such as agent-based models (ABMs)) to generate simulated clinical populations in order to discover and evaluate potential diagnostic and therapeutic modalities. The description of the environment in which a biomedical simulation operates (model context) and parameterization of internal model rules (model content) requires the optimization of a large number of free parameters. In this work, we utilize a nested active learning (AL) workflow to efficiently parameterize and contextualize an ABM of systemic inflammation used to examine sepsis. Contextual parameter space was examined using four parameters external to the model’s rule set. The model’s internal parameterization, which represents gene expression and associated cellular behaviors, was explored through the augmentation or inhibition of signaling pathways for 12 signaling mediators associated with inflammation and wound healing. We have implemented a nested AL approach in which the clinically relevant (CR) model environment space for a given internal model parameterization is mapped using a small Artificial Neural Network (ANN). The outer AL level workflow is a larger ANN that uses AL to efficiently regress the volume and centroid location of the CR space given by a single internal parameterization. We have reduced the number of simulations required to efficiently map the CR parameter space of this model by approximately 99%. In addition, we have shown that more complex models with a larger number of variables may expect further improvements in efficiency.
Accurate and uncertainty-aware multi-task prediction of HEA properties using prior-guided deep Gaussian processes
Surrogate modeling techniques have become indispensable in accelerating the discovery and optimization of high-entropy alloys (HEAs), especially when integrating computational predictions with sparse experimental observations. This study systematically evaluates the training and testing performance of four prominent surrogate models—conventional Gaussian processes (cGP), Deep Gaussian processes (DGP), encoder-decoder neural networks for multi-output regression and eXtreme Gradient Boosting (XGBoost)—applied to a hybrid dataset of experimental and computational properties of the 8-component HEA system Al-Co-Cr-Cu-Fe-Mn-Ni-V. We specifically assess their capabilities in predicting correlated material properties, including yield strength, hardness, modulus, ultimate tensile strength, elongation, and average hardness under dynamic/quasi-static conditions, alongside auxiliary computational properties. The comparison highlights the strengths of hierarchical deep modeling approaches in handling heteroscedastic, heterotopic, and incomplete data commonly encountered in materials science. Our findings illustrate that combined surrogate models such as DGPs infused with machine-learned priors outperform other surrogates by effectively capturing inter-property correlations and by assimilating prior knowledge. This enhanced predictive accuracy positions the combined surrogate models as powerful tools for robust and data-efficient materials design.
Machine learning enhanced predictions of ICRF heating: Overcoming numerical limitations via data curation
In this work, we present the development of robust surrogate models for Ion Cyclotron Range of Frequencies (ICRF) and High-Harmonic Fast Wave (HHFW) heating predictions in fusion plasmas. Building upon our previous efforts to achieve real-time capable models, we identify the cause of the outliers found using TORIC in certain HHFW heating scenarios. The outliers are observed to be spurious ion Bernstein wave (IBW)-like modes caused by a wavelength control algorithm designed to address challenging scenarios with high perpendicular wavenumbers. The effect arises from the modulation in the perpendicular susceptibility, which can induce sign reversal and IBW-like propagation for scenarios featuring normalized ion Larmor radius λ i ≫ 1. We use TORIC with this algorithm disabled to generate a novel HHFW-NSTX database that is free of outliers. Surrogate models trained on this database, including Random Forest Regressor (RFR), Multi-Layer Perceptrons, and Gaussian Process Regressors (GPR), demonstrate the ability to accurately predict HHFW heating profiles, with regression scores of R 2 ∈[0.93−0.99]. Additionally we demonstrate that it is possible to generalize predictions beyond training data by the use of both RFR and GPR models, enabling the prediction of scenarios previously limited to the original model. GPR models also provide uncertainty quantification, offering insights into model confidence. This work introduces a comprehensive Verification, Validation, and Uncertainty Quantification methodology for surrogate modeling, applicable not only to ICRF heating but also to other RF heating challenges and fusion physics problems. Beyond accelerated inference, these models show effective extrapolation capabilities, providing an alternative for addressing numerical challenges.
Conditioned Simulation of Ground-Motion Time Series at Uninstrumented Sites Using Gaussian Process Regression
Ground-motion time series are essential input data in seismic analysis and performance assessment of the built environment. Because instruments to record free-field ground motions are generally sparse, methods are needed to estimate motions at locations with no available ground-motion recording instrumentation. In this study, given a set of observed motions, ground-motion time series at target sites are constructed using a Gaussian process regression (GPR) approach, which treats the real and imaginary parts of the Fourier spectrum as random Gaussian variables. Model training, verification, and applicability studies are carried out using the physics-based simulated ground motions of the 1906 Mw 7.9 San Francisco earthquake and Mw 7.0 Hayward fault scenario earthquake in northern California. Additionally, the method’s performance is further evaluated using the 2019 Mw 7.1 Ridgecrest earthquake ground motions recorded by the Community Seismic Network stations located in southern California. These evaluations indicate that the trained GPR model is able to adequately estimate the ground-motion time series for frequency ranges that are pertinent for most earthquake engineering applications. The trained GPR model exhibits proper performance in predicting the long-period content of the ground motions as well as directivity pulses.
A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems
We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.
Improvements to CTF Code Verification and Unit Testing (FY2020)
In 2010, the U.S. Department of Energy created its first Energy Innovation Hub, which focuses on improving Light Water Reactors (LWRs) through Modeling and Simulation. This hub, named the Consortium for the Advanced Simulation of LWRs (CASL), attempts to characterize and understand LWR behavior under normal operating conditions and use any gained insights to improve their efficiency. In collaboration with North Carolina State University (NCSU), CASL has worked extensively on the thermal-hydraulic subchannel code Coolant Boiling in Rod Arrays—Three Field (COBRA-TF). The NCSU/CASL version of COBRA-TF has been rebranded as CTF. This document focuses on code verification test problems that ensure CTF converges to the correct answer for the intended application. The suite of code verification tests are mapped to the underlying conservation equations of CTF, and significant gaps are addressed. Convergence behavior and numerical errors are quantified for each of the tests. Tests that converge at the correct rate to the corresponding analytic solution are incorporated into the CTF automated regression suite. A new verification utility is created for this purpose, which enables code verification by generalizing the process. For problems that do not behave correctly, the results are reported but the problem is not included in the regression suite. In addition to verification studies, this document also quantifies the existing tests of constitutive models. A few existing gaps are addressed by adding new unit tests.
FY20 Improvements to CTF Code Verification and Unit Testing
In 2010, the U.S. Department of Energy created its first Energy Innovation Hub, which focuses on improving Light Water Reactors (LWRs) through Modeling and Simulation. This hub, named the Consortium for the Advanced Simulation of LWRs (CASL), attempts to characterize and understand LWR behavior under normal operating conditions and use any gained insights to improve their efficiency. In collaboration with North Carolina State University (NCSU), CASL has worked extensively on the thermal-hydraulic subchannel code Coolant Boiling in Rod Arrays–Three Field (COBRA-TF). The NCSU/CASL version of COBRA-TF has been rebranded as CTF. This document focuses on code verification test problems that ensure CTF converges to the correct answer for the intended application. The suite of code verification tests are mapped to the underlying conservation equations of CTF, and significant gaps are addressed. Convergence behavior and numerical errors are quantified for each of the tests. Tests that converge at the correct rate to the corresponding analytic solution are incorporated into the CTF automated regression suite. A new verification utility is created for this purpose, which enables code verification by generalizing the process. For problems that do not behave correctly, the results are reported but the problem is not included in the regression suite. In addition to verification studies, this document also quantifies the existing tests of constitutive models. A few existing gaps are addressed by adding new unit tests.