Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data predictive control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Simultaneously improving accuracy and computational cost under parametric constraints in materials property prediction tasks

Abstract Modern data mining techniques using machine learning (ML) and deep learning (DL) algorithms have been shown to excel in the regression-based task of materials property prediction using various materials representations. In an attempt to improve the predictive performance of the deep neural network model, researchers have tried to add more layers as well as develop new architectural components to create sophisticated and deep neural network models that can aid in the training process and improve the predictive ability of the final model. However, usually, these modifications require a lot of computational resources, thereby further increasing the already large model training time, which is often not feasible, thereby limiting usage for most researchers. In this paper, we study and propose a deep neural network framework for regression-based problems comprising of fully connected layers that can work with any numerical vector-based materials representations as model input. We present a novel deep regression neural network, iBRNet, with branched skip connections and multiple schedulers, which can reduce the number of parameters used to construct the model, improve the accuracy, and decrease the training time of the predictive model. We perform the model training using composition-based numerical vectors representing the elemental fractions of the respective materials and compare their performance against other traditional ML and several known DL architectures. Using multiple datasets with varying data sizes for training and testing, We show that the proposed iBRNet models outperform the state-of-the-art ML and DL models for all data sizes. We also show that the branched structure and usage of multiple schedulers lead to fewer parameters and faster model training time with better convergence than other neural networks. Scientific contribution: The combination of multiple callback functions in deep neural networks minimizes training time and maximizes accuracy in a controlled computational environment with parametric constraints for the task of materials property prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Continental United States may lose 1.8 petagrams of soil organic carbon under climate change by 2100

Abstract Aims High‐resolution information on soils’ vulnerability to climate‐induced soil organic carbon (SOC) loss can enable environmental scientists, land managers, and policy makers to develop targeted mitigation strategies. This study aims to estimate baseline and decadal changes in continental US surface SOC stocks under future emission scenarios. Location Continental United States. Time period 2014–2100. Methods We used recent SOC field observations ( n = 6,213 sites), environmental factors ( n = 32), and an ensemble machine learning (ML) approach to estimate baseline SOC stocks in surface soils across the continental United States at 100‐m spatial resolution, and decadal changes under the projected climate scenarios of Coupled Model Intercomparison Project Phase Six (CMIP6) earth system models (ESMs). Results Baseline SOC projections from ML approaches captured more than 50% of variability in SOC observations, whereas ESMs represented only 6–16% of observed SOC variability. ML estimates showed a mean total loss of 1.8 Pg C from US surface soils under the high‐emission scenario by 2100, whereas ESMs showed no significant change in SOC stocks with wide variation among ESMs. Both ML and ESM predictions agree on the direction of SOC change (net emissions or sequestration) across 46–51% of continental US land area. These differences are attributable to the high‐resolution site‐specific data used in the ML models compared to the relatively coarse grid represented in CMIP6 ESMs. Main conclusions Our high‐resolution estimates of baseline SOC stocks, identification of key environmental controllers, and projection of SOC changes from US land cover types under future climate scenarios suggest the need for high‐resolution simulations of SOC in ESMs to represent the heterogeneity of SOC. We found that the SOC change is sensitive to key soil related factors (e.g. soil drainage and soil order) that have not been historically considered as input parameters in ESMs, because currently more than 95% variability in the SOC of CMIP6 ESMs is controlled by net primary productivity, temperature, and precipitation. Using additional environmental factors to estimate the baseline SOC stocks and predict the future trajectory of SOC change can provide more accurate results.

54 ENVIRONMENTAL SCIENCES↗

Exploratory analysis of machine learning techniques in the Nevada geothermal play fairway analysis

Play fairway analysis (PFA) is commonly used to generate geothermal potential maps and guide exploration studies, with a particular focus on locating and characterizing blind geothermal systems. This study evaluates the application of machine learning techniques to PFA in the Great Basin region of Nevada. Following the evaluation of various techniques, we identified two approaches to PFA that produced promising results, 1) supervised Bayesian probabilistic neural networks to generate geothermal potential maps with confidence intervals, and 2) unsupervised principal component analysis paired with k-means clustering to generate both cluster maps to help identify spatial patterns, as well as new combined feature inputs. We applied these techniques to perform a comparative analysis between two principal sets of geological and geophysical features related to permeability and heat and a set of positive (known geothermal resources) and negative training sites (known drill sites with unsuitable geothermal conditions). We found that these methods constrain previously unrecognized feature controls on geothermal favorability, many of which are spatially organized within the extent of cluster groups and the major structural-hydrologic domains of the study area. Furthermore, we utilized exploratory unsupervised modeling to highlight spatial relationships between input data and predictive output results of our supervised modeling. As a result, we demonstrate how our models compare to the previous Nevada PFA and how the rapid insights these machine learning techniques offer may support future assessments of both known and undiscovered blind geothermal systems in the Great Basin region of Nevada and beyond.

15 GEOTHERMAL ENERGY↗

Theory of edge localized mode suppression by static resonant magnetic perturbations in the DIII-D tokamak

According to a recent paper [Hu et al ., Phys. Plasmas 26, 120702 (2019)], mode penetration at the top of the pedestal is a necessary and sufficient condition for the suppression of edge localized modes (ELMs) by a resonant magnetic perturbation (RMPs) in an H-mode tokamak discharge. This paper employs asymptotic matching theory to model a particular DIII-D discharge in which ELMs were suppressed by an externally generated, static, n ¼ 2, RMP whose amplitude was modulated at a frequency of 1 Hz. It is demonstrated that the response of the plasma to the applied RMP, in the immediate vicinities of the rational (i.e., resonant) surfaces, is governed by nonlinear, rather than by linear, physics. This is the case because the magnetic island widths associated with driven reconnection exceed the linear layer widths, even in cases where driven reconnection is strongly suppressed by plasma rotation. The natural frequency at a given rational surface (i.e., the helical frequency at which the locally resonant component of the RMP would need to propagate in order to maximize driven reconnection) is found to be offset from the local E B frame in the ion diamagnetic direction. The size of the offset is mostly determined by neoclassical poloidal rotation. Finally, the predictions of a fully nonlinear plasma response model are found to be broadly consistent with the DIII-D experimental data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Materials in Extremes [Slides]

Goals: Realization of advanced predictive models that capture aspects of processing structure-properties-performance (PSPP) in ways that build on scale bridging, data science, and transformational physics insights from experiments; Based on a robust and seamless integration of sample manufacturing, characterization (pre- and post-mortem), theory and simulation, and novel experiments; Ultimately we want to be able to reliably predict performance, and control the functionality of materials in extreme environments.

36 MATERIALS SCIENCE↗

EMPIRICAL VALIDATION OF MULTI-ZONE BUILDING AND HVAC SYSTEM MODELS UNDER UNCERTAINTY

This study implemented a framework of empirical validation of building energy models under uncertainty to a set of controlled experiments that aim to validate multi-zone building and HVAC system models. Energy models were created through iterative acquisitions of information and data and uses measurement data from various types of sensors as both inputs and as observations to validate predictions. Experimental and modeling uncertainties were quantified and propagated accordingly, and probabilistic accuracy metrics were used to evaluate the agreement between model predictions and observations under uncertainty. Sensitivity analysis was performed to identify the most influential uncertainties that will be prioritized to be addressed in the next steps. Current results of two cooling tests show an overall good agreement between predictions and observations on a set of HVAC system outputs despite considerable and influential uncertainty in DX cooling coil COP. Agreements on zone-level responses vary notably among individual rooms, likely because of significant uncertainties in room radiation heat gain and system supply air.

Li, Qi↗

Machine‐learning‐based construction of barrier functions and models for safe model predictive control

Abstract In this paper, we propose a control Lyapunov‐barrier function‐based model predictive control method utilizing a feed‐forward neural network specified control barrier function (CBF) and a recurrent neural network (RNN) predictive model to stabilize nonlinear processes with input constraints, and to guarantee that safety requirements are met for all times. The nonlinear system is first modeled using RNN techniques, and a CBF is characterized by constructing a feed‐forward neural network (FNN) model with unique structures and properties. The FNN model for the CBF is trained based on data samples collected from safe and unsafe operating regions, and the resulting FNN model is verified to demonstrate that the safety properties of the CBF are satisfied. Given sufficiently small bounded modeling errors for both the FNN and the RNN models, the proposed control system is able to guarantee closed‐loop stability while preventing the closed‐loop states from entering unsafe regions in state‐space under sample‐and‐hold control action implementation. We provide the theoretical analysis for bounded unsafe sets in state‐space, and demonstrate the effectiveness of the proposed control strategy using a nonlinear chemical process example with a bounded unsafe region.

Chen, Scarlett↗

Soil Metabolomics Predict Microbial Taxa as Biomarkers of Moisture Status in Soils from a Tidal Wetland

We present observations from a laboratory-controlled study on the impacts of extreme wetting and drying on a wetland soil microbiome. Our approach was to experimentally challenge the soil microbiome to understand impacts on anaerobic carbon cycling processes as the system transitions from dryness to saturation and vice-versa. Specifically, we tested for impacts on stress responses related to shifts from wet to drought conditions. We used a combination of high-resolution data for small organic chemical compounds (metabolites) and biological (community structure based on 16S rRNA gene sequencing) features. Using a robust correlation-independent data approach, we further tested the predictive power of soil metabolites for the presence or absence of taxa. Here, we demonstrate that taking an untargeted, multidimensional data approach to the interpretation of metabolomics has the potential to indicate the causative pathways selecting for the observed bacterial community structure in soils.

16S rRNA gene↗

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

36 MATERIALS SCIENCE↗

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

42 ENGINEERING↗

Materials Characterization: A Primer for Solid Phase Processing Applications

The Pacific Northwest National Laboratory (PNNL) undertook the Materials Characterization, Prediction, and Control (MCPC) Laboratory Directed Research and Development (LDRD) Project to advance understanding of nuclear material processing and enable multifold acceleration in the development and qualification of new material systems produced via advanced manufacturing methods, such as solid phase processing, for use in national security and advanced energy applications (Smith 2021). As a two-year LDRD investment requiring focused research, the MCPC project applied only a subset of the wide range of available destructive and nondestructive characterization methods to provide data to the predictive modeling and data analytics tasks. The purpose of this report is to review a wide range of destructive and nondestructive characterization methods that are relevant in solid-phase processing (SPP) applications, but not necessarily applied in the MCPC Project as a guide to the planning of characterization activities in future research. Particular attention is given to measured characteristics that can correlate to other material characteristics, with a particular interest in nondestructive evaluation (NDE) that can be applied to samples obtained in the MCPC Project. Destructive examinations include tensile tests, optical and electron microscopy, micro-hardness, and residual stress tests. NDE tests include surface visual inspection, eddy current examination for cracks, 4-point potential drop, ultrasound, x-ray, and computed tomography.

36 MATERIALS SCIENCE↗

Online System ID for Predicting Power Plant Performance Throughout Cycling Operations

This presentation represents a review of the background research conducted by NETL to apply artificial intelligence, i.e. auto-recursive algorithms and data analytics to detect leaks in utility scale boilers and laboratory power systems. The new project being funded by the Advanced Sensors and Controls Program is part of the Field Work Proposal funded in EY21 as Task 53 to demonstrate the application of these techniques on a utility scale power system.

Shadle, Lawrence↗

Forecasting Battery Electrode Performance via Electrochemical Fluorescence Microscopy and Machine-Learning

Predicting lithium-ion battery performance is hindered by microscale electrode heterogeneities invisible to conventional diagnostics. Here, we combine electrochemical fluorescence microscopy (EFM), which maps electronic connectivity by visualizing an electrofluorophore reaction distribution, with a multitask ElasticNet regression to forecast discharge capacity from spatial heterogeneity. Analyzing 196 images from six pilot-scale LiNi 0.5 Mn 0.3 Co 0.2 O 2 cathodes with varying carbon loadings, we extract 62 descriptors that capture morphology and texture. A compact five-feature model predicts capacity across eight discharge rates, achieving a per-target R 2 of up to 0.63 and an overall R 2 of 0.92, with a mean absolute percentage error of less than 2%. This performance rivals impedance-based approaches while avoiding their reliance on postformation data and incomplete electronic network information. Our facile and rapid, image-driven method may enable electrode quality control upstream of costly cell assembly to offer a transformative tool for data-driven battery research and manufacturing.

battery electrodes↗

Macroscopic Traffic Modeling Using Probe Vehicle Data: A Machine Learning Approach

Abstract The macroscopic fundamental diagram (MFD) captures an orderly relationship among traffic flow, density, and speed at the network level. It is a simple yet powerful tool for modeling traffic dynamics in large urban networks with broad application in traffic control and management. However, empirically derived MFDs in urban regions require high-resolution traffic data from the network. Having the network flow and vehicular density estimated at the (granular) census tract level using vehicle probe data, we apply machine learning methods to predict the MFDs across U.S. urban areas and capture the impacts of location-specific input features on the network flow–density relationships at a large scale. The results show that, among the four tested machine learning approaches (Random Forest, XGBoost, Support Vector Machine, and Neural Network), XGBoost delivers the best performance in predicting network traffic flow based on vehicular density and location attributes. Using interaction Shapley Additive explanation (SHAP) values and partial correlation analysis, we examine the factors influencing MFD shapes across different locations. Our empirical findings reveal that across U.S. urban areas, network topology, transportation infrastructure, and land use are primary factors shaping MFD curves, while demand and trip-related factors play a lesser role. Specifically, higher ranking roads, centrality, and development levels correlate positively with network capacity and critical density, whereas negative associations are observed for network connectivity, mixed-use development, and road roughness levels.

Jin, Ling↗

Engineering of increased L-Threonine production in bacteria by combinatorial cloning and machine learning

The goal of this study is to develop a general strategy for bacterial engineering using an integrated synthetic biology and machine learning (ML) approach. This strategy was developed in the context of increasing L-threonine production in Escherichia coli ATCC 21277. A set of 16 genes was initially selected based on metabolic pathway relevance to threonine biosynthesis and used for combinatorial cloning to construct a set of 385 strains to generate training data (i.e., a range of L-threonine titers linked to each of the specific gene combinations). Hybrid (regression/classification) deep learning (DL) models were developed and used to predict additional gene combinations in subsequent rounds of combinatorial cloning for increased L-threonine production based on the training data. As a result, E. coli strains built after just three rounds of iterative combinatorial cloning and model prediction generated higher L-threonine titers (from 2.7 g/L to 8.4 g/L) than those of patented L-threonine strains being used as controls (4-5 g/L). Interesting combinations of genes in L-threonine production included deletions of the tdh, metL, dapA, and dhaM genes as well as overexpression of the pntAB, ppc, and aspC genes. Mechanistic analysis of the metabolic system constraints for the best performing constructs offers ways to improve the models by adjusting weights for specific gene combinations. Graph theory analysis of pairwise gene modifications and corresponding levels of L-threonine production also suggests additional rules that can be incorporated into future ML models.

60 APPLIED LIFE SCIENCES↗

Sensitivity evaluation of the Kudryavtsev permafrost model

Modeling is an important way to assess current and future permafrost spatial distribution and dynamics, especially in data poor areas like the Arctic region. Here, we evaluate a physics-based analytical model, Kudryavtsev's active layer model, which is widely used because it has relatively few data requirements. This model was recently incorporated into a component modeling toolbox, allowing for coupled modeling of permafrost and geomorphic processes over geological timescales. However, systematic quantitative assessment of the influence of its controlling parameters on permafrost temperature and active layer thickness predictions has not been undertaken before. In this work, we investigate the sensitivity of the Kudryavtsev's active layer model by Monte Carlo simulations to generate probability distributions for input parameters and compare predictions with a comprehensive benchmark dataset of in-situ permafrost observations over entire Alaska. Predicted permafrost surface temperature is highly dependent on mean annual air temperature (r = 0.78 on average), annual temperature amplitude (–0.41), and winter-averaged snow thickness (0.30). Uncertainty of predicted permafrost temperature is relatively small (RMSE = 1 °C), when air temperature and snow depth are well constrained. Similarly, RMSE between simulated and observed ALT at stations is ~0.08 m. However, under given air temperature and snow conditions, soil water content bias can significantly affect modeled active layer thickness (RMSE = 0.1 m or 40% of the observed active layer thickness). If soil water content has a large bias, improvements in other parameters may not significantly improve the active layer predictions of the Kudryavtsev's model.

54 ENVIRONMENTAL SCIENCES↗

Explainable Bayesian Neural Network for Probabilistic Transient Stability Analysis Considering Wind Energy

While several data-driven models have been developed for transient stability assessment, how to consider the uncertainties from load and renewable generations and provide interpretation of data-driven assessment results are still open. This paper proposes an explainable Bayesian Neural Network (BNN) for probabilistic transient stability assessment (TSA). By extracting the uncertainties from loads and wind farms, the BNN model can make a reliable prediction and quantify the prediction uncertainties. We also develop the Gradient Shap algorithm to make the global and local explanations for the probabilistic TSA model, a significant advantage over existing black-box data-driven methods. Numerical results on the modified IEEE 39-bus system show that the proposed method outperforms the existing methods in terms of prediction accuracy and uncertainty quantification capabilities. The explainability of the proposed method allows system operators to design preventive controls for enhancing system stability.

Bayesian Neural Network↗

Autonomous Controls For Reactor Technologies (acorn)

ACORN (Autonomous Controls fOr Reactor techNologies) software utilizes data, obtained from an experimental test bed and/or simulation, to implement a control command for microreactor operation. Command examples include a change to the temperature profile, power profiles, heat fluxes, etc. The control command recommended by the code is derived based on future predicted states of a microreactor, allowing proactive optimal and autonomous microreactor operation. The software is written in Python languages. The current software supports autonomous temperature controls of heat pipe simulator and autonomous heat flux controls of a 37 heat pipe non-nuclear testbed simulator (or its surrogate models).

Lin, Linyu [Idaho National Laboratory (INL), Idaho↗