Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Predictions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Predicting Future Laboratory Fault Friction Through Deep Learning Transformer Models

Machine learning models using seismic emissions as input can predict instantaneous fault characteristics such as displacement and friction in laboratory experiments, and slow slip in Earth. Here, we address whether the seismic/acoustic emission (AE) from laboratory experiments contains information about future frictional behavior. The approach uses a convolutional encoder-decoder containing a transformer model in the latent space, similar to models used for natural language processing. We test the model limits using progressively larger AE input time windows and progressively larger output friction time windows. The results demonstrate that very near-term friction predictions are indeed contained in the AE signal, and predictions are progressively worse farther into the future. The future predictions by the model of impending failure in the near-term are remarkably robust. This first effort predicting future fault frictional behavior with machine learning will aid in guiding efforts for applications in Earth.

58 GEOSCIENCES↗
DOE OSTI2024

Global-Scale Convergence Obscures Inconsistencies in Soil Carbon Change Predicted by Earth System Models

Soil carbon (C) responses to environmental change represent a major source of uncertainty in the global C cycle. Feedbacks between soil C stocks and climate drivers could impact atmospheric CO 2 levels, further altering the climate. Here, we assessed the reliability of Earth system model (ESM) predictions of soil C change using the Coupled Model Intercomparison Project phases 5 and 6 (CMIP5 and CMIP6). ESMs predicted global soil C gains under the high emission scenario, with soils taking up 43.9 Pg (95% CI: 9.2–78.5 Pg) C on average during the 21st century. The variation in global soil C change declined significantly from CMIP5 (with average of 48.4 Pg [95% CI: 2.0–94.9 Pg] C) to CMIP6 models (with average of 39.3 Pg [95% CI: 23.9–54.7 Pg] C). For some models, a small C increase in all biomes contributed to this convergence. For other models, offsetting responses between cold and warm biomes contributed to convergence. Although soil C predictions appeared to converge in CMIP6, the dominant processes driving soil C change at global or biome scales differed among models and in many cases between earlier and later versions of the same model. Random Forest models, for soil carbon dynamics, accounted for more than 63% variation of the global soil C change predicted by CMIP5 ESMs, but only 36% for CMIP6 models. Although most CMIP6 models apparently agree on increased soil C storage during the 21st century, this consensus obscures substantial model disagreement on the mechanisms underlying soil C response, calling into question the reliability of model predictions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Skillful Multi‐Month Predictions of Ecosystem Stressors in the Surface and Subsurface Ocean

Abstract Anthropogenic carbon emissions and associated climate change are driving rapid warming, acidification, and deoxygenation in the ocean, which increasingly stress marine ecosystems. On top of long‐term trends, short term variability of marine stressors can have major implications for marine ecosystems and their management. As such, there is a growing need for predictions of marine ecosystem stressors on monthly, seasonal, and multi‐month timescales. Previous studies have demonstrated the ability to make reliable predictions of the surface ocean physical and biogeochemical state months to years in advance, but few studies have investigated forecast skill of multiple stressors simultaneously or assessed the forecast skill below the surface. Here, we use the Community Earth System Model (CESM) Seasonal to Multiyear Large Ensemble (SMYLE) along with novel observation‐based biogeochemical and physical products to quantify the predictive skill of dissolved inorganic carbon (DIC), dissolved oxygen, and temperature in the surface and subsurface ocean. CESM SMYLE demonstrates high physical and biogeochemical predictive skill multiple months in advance in key oceanic regions and frequently outperforms persistence forecasts. We find up to 10 months of skillful forecasts, with particularly high skill in the Northeast Pacific (Gulf of Alaska and California Current Large Marine Ecosystems) for temperature, surface DIC, and subsurface oxygen. Our findings suggest that dynamical marine ecosystem prediction could support actionable advice for decision making.

Environmental Sciences & Ecology↗
DOE OSTI2023

Closing in on Hydrologic Predictive Accuracy: Combining the Strengths of High-Fidelity and Physics-Agnostic Models

Applications of process-based models (PBM) for predictions are confounded by multiple uncertainties and computational burdens, resulting in appreciable errors. A novel modeling framework combining a high-fidelity PBM with surrogate and machine learning (ML) models is developed to tackle these challenges and applied for streamflow prediction. A surrogate model permits high computational efficiency of a PBM solution at a minimum loss of its accuracy. A novel probabilistic ML model partitions the PBM-surrogate prediction errors into reducible and irreducible types, quantifying their distributions that arise due to both explicitly perceived uncertainties (such as parametric) or those that are entirely hidden to the modeler (not included or unexpected). Using this approach, we demonstrate a substantial improvement of streamflow predictive accuracy for a case study urbanized watershed. Such a framework provides an efficient solution combining the strengths of high-fidelity and physics-agnostic models for a wide range of prediction problems in geosciences.

58 GEOSCIENCES↗
DOE OSTI2023

Physical Insights From the Multidecadal Prediction of North Atlantic Sea Surface Temperature Variability Using Explainable Neural Networks

Abstract North Atlantic sea surface temperatures (NASST), particularly in the subpolar region, are among the most predictable in the world's oceans. However, the relative importance of atmospheric and oceanic controls on their variability at multidecadal timescales remain uncertain. Neural networks (NNs) are trained to examine the relative importance of oceanic and atmospheric predictors in predicting the NASST state in the Community Earth System Model 1 (CESM1). In the presence of external forcings, oceanic predictors outperform atmospheric predictors, persistence, and random chance baselines out to 25‐year leadtimes. Layer‐wise relevance propagation is used to unveil the sources of predictability, and reveal that NNs consistently rely upon the Gulf Stream‐North Atlantic Current region for accurate predictions. Additionally, CESM1‐trained NNs successfully predict the phasing of multidecadal variability in an observational data set, suggesting consistency in physical processes driving NASST variability between CESM1 and observations.

Geology↗
DOE OSTI2023

Leveraging Groundwater Dynamics to Improve Predictions of Summer Low-Flow Discharges

Summer streamflow predictions are critical for managing water resources; however, warming-induced shifts from snow to rain regimes impact low-flow predictive models. Additionally, reductions in snowpack drive earlier peak flows and lower summer flows across the western United States increasing reliance on groundwater for maintaining summer streamflow. However, it remains poorly understood how groundwater contributions vary interannually. Here, we quantify recession limb groundwater (RLGW), defined as the proportional groundwater contribution to the stream during the period between peak stream flow and low flow, to predict summer low flows across three diverse western US watersheds. We ask (a) how do snow and rain dynamics influence interannual variations of RLGW contributions and summer low flows?; (b) which watershed attributes impact the effectiveness of RLGW as a predictor of summer low flows? Linear models reveal that RLGW is a strong predictor of low flows across all sites and drastically improves low-flow prediction compared to snow metrics at a rain-dominated site. Results suggest that strength of RLGW control on summer low flows may be mediated by subsurface storage. Subsurface storage can be divided into dynamic (i.e., variability saturated) and deep (i.e., permanently saturated) components, and we hypothesize that interannual variability in dynamic storage contribution to streamflow drives RLGW variability. In systems with a higher proportion of dynamic storage, RLGW is a better predictor of summer low flow because the stream is more responsive to dynamic storage contributions compared to deep-storage-dominated systems. Overall, including RLGW improved low-flow prediction across diverse watersheds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

The METLIN small molecule dataset for machine learning-based retention time prediction

Machine learning has been extensively applied in small molecule analysis to predict a wide range of molecular properties and processes including mass spectrometry fragmentation or chromatographic retention time. However, current approaches for retention time prediction lack sufficient accuracy due to limited available experimental data. Here we introduce the METLIN small molecule retention time (SMRT) dataset, an experimentally acquired reverse-phase chromatography retention time dataset covering up to 80,038 small molecules. To demonstrate the utility of this dataset, we deployed a deep learning model for retention time prediction applied to small molecule annotation. Results showed that in 70% of the cases, the correct molecular identity was ranked among the top 3 candidates based on their predicted retention time. We anticipate that this dataset will enable the community to apply machine learning or first principles strategies to generate better models for retention time prediction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Skillful multiyear predictions of ocean acidification in the California Current System

The California Current System (CCS) sustains economically valuable fisheries and is particularly vulnerable to ocean acidification, due to its natural upwelling of carbon-enriched waters that generate corrosive conditions for local ecosystems. Here we use a novel suite of retrospective, initialized ensemble forecasts with an Earth system model (ESM) to predict the evolution of surface pH anomalies in the CCS. We show that the forecast system skillfully predicts observed surface pH variations a year in advance over a naive forecasting method, with the potential for skillful prediction up to five years in advance. Skillful predictions of surface pH are mainly derived from the initialization of dissolved inorganic carbon anomalies that are subsequently transported into the CCS. Our results demonstrate the potential for ESMs to provide skillful predictions of ocean acidification on large scales in the CCS. Initialized ESMs could also provide boundary conditions to improve high-resolution regional forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Predicting fault slip via transfer learning

Abstract Data-driven machine-learning for predicting instantaneous and future fault-slip in laboratory experiments has recently progressed markedly, primarily due to large training data sets. In Earth however, earthquake interevent times range from 10’s-100’s of years and geophysical data typically exist for only a portion of an earthquake cycle. Sparse data presents a serious challenge to training machine learning models for predicting fault slip in Earth. Here we describe a transfer learning approach using numerical simulations to train a convolutional encoder-decoder that predicts fault-slip behavior in laboratory experiments. The model learns a mapping between acoustic emission and fault friction histories from numerical simulations, and generalizes to produce accurate predictions of laboratory fault friction. Notably, the predictions improve by further training the model latent space using only a portion of data from a single laboratory earthquake-cycle. The transfer learning results elucidate the potential of using models trained on numerical simulations and fine-tuned with small geophysical data sets for potential applications to faults in Earth.

58 GEOSCIENCES↗
DOE OSTI2022

Density of states prediction for materials discovery via contrastive learning from probabilistic embeddings

Abstract Machine learning for materials discovery has largely focused on predicting an individual scalar rather than multiple related properties, where spectral properties are an important example. Fundamental spectral properties include the phonon density of states (phDOS) and the electronic density of states (eDOS), which individually or collectively are the origins of a breadth of materials observables and functions. Building upon the success of graph attention networks for encoding crystalline materials, we introduce a probabilistic embedding generator specifically tailored to the prediction of spectral properties. Coupled with supervised contrastive learning, our materials-to-spectrum (Mat2Spec) model outperforms state-of-the-art methods for predicting ab initio phDOS and eDOS for crystalline materials. We demonstrate Mat2Spec’s ability to identify eDOS gaps below the Fermi energy, validating predictions with ab initio calculations and thereby discovering candidate thermoelectrics and transparent conductors. Mat2Spec is an exemplar framework for predicting spectral properties of materials via strategically incorporated machine learning techniques.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Climate-driven changes in the predictability of seasonal precipitation

Climate-driven changes in precipitation amounts and their seasonal variability are expected in many continental-scale regions during the remainder of the 21st century. However, much less is known about future changes in the predictability of seasonal precipitation, an important earth system property relevant for climate adaptation. Here, on the basis of CMIP6 models that capture the present-day teleconnections between seasonal precipitation and previous-season sea surface temperature (SST), we show that climate change is expected to alter the SST-precipitation relationships and thus our ability to predict seasonal precipitation by 2100. Specifically, in the tropics, seasonal precipitation predictability from SSTs is projected to increase throughout the year, except the northern Amazonia during boreal winter. Concurrently, in the extra-tropics predictability is likely to increase in central Asia during boreal spring and winter. The altered predictability, together with enhanced interannual variability of seasonal precipitation, poses new opportunities and challenges for regional water management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Learning nonlinear operators in latent spaces for real-time predictions of complex dynamics in physical systems

Abstract Predicting complex dynamics in physical applications governed by partial differential equations in real-time is nearly impossible with traditional numerical simulations due to high computational cost. Neural operators offer a solution by approximating mappings between infinite-dimensional Banach spaces, yet their performance degrades with system size and complexity. We propose an approach for learning neural operators in latent spaces, facilitating real-time predictions for highly nonlinear and multiscale systems on high-dimensional domains. Our method utilizes the deep operator network architecture on a low-dimensional latent space to efficiently approximate underlying operators. Demonstrations on material fracture, fluid flow prediction, and climate modeling highlight superior prediction accuracy and computational efficiency compared to existing methods. Notably, our approach enables approximating large-scale atmospheric flows with millions of degrees, enhancing weather and climate forecasts. Here we show that the proposed approach enables real-time predictions that can facilitate decision-making for a wide range of applications in science and engineering.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm

Abstract We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a material’s composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm—namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10 4 or greater data points. We encourage evaluating materials ML algorithms on the Matbench benchmark and comparing them against the latest version of Automatminer.

36 MATERIALS SCIENCE↗
DOE OSTI2022

High-throughput predictions of metal–organic framework electronic properties: theoretical challenges, graph neural networks, and data exploration

Abstract With the goal of accelerating the design and discovery of metal–organic frameworks (MOFs) for electronic, optoelectronic, and energy storage applications, we present a dataset of predicted electronic structure properties for thousands of MOFs carried out using multiple density functional approximations. Compared to more accurate hybrid functionals, we find that the widely used PBE generalized gradient approximation (GGA) functional severely underpredicts MOF band gaps in a largely systematic manner for semi-conductors and insulators without magnetic character. However, an even larger and less predictable disparity in the band gap prediction is present for MOFs with open-shell 3 d transition metal cations. With regards to partial atomic charges, we find that different density functional approximations predict similar charges overall, although hybrid functionals tend to shift electron density away from the metal centers and onto the ligand environments compared to the GGA point of reference. Much more significant differences in partial atomic charges are observed when comparing different charge partitioning schemes. We conclude by using the dataset of computed MOF properties to train machine-learning models that can rapidly predict MOF band gaps for all four density functional approximations considered in this work, paving the way for future high-throughput screening studies. To encourage exploration and reuse of the theoretical calculations presented in this work, the curated data is made publicly available via an interactive and user-friendly web application on the Materials Project.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Impact of microkinetic modeling assumptions on predicted kinetics and mechanisms over undercoordinated sites

Accurate modeling of catalytic reactions on undercoordinated sites requires accounting for the structural and ensemble-specific nature of the active sites. This study examines how common microkinetic modeling (MKM) assumptions affect predicted kinetics and mechanisms on the stepped Pt(211) facet for the ethane dehydrogenation (EDH) and the ethane hydrogenolysis (EH). Six (211) MKMs were developed, differing in (i) the number of active sites represented, (ii) adsorbate site occupancy treatment, and (iii) inclusion of cross-facet interactions. These models are benchmarked against a particle-based microkinetic model (PB-MKM), which best represents step-edge behavior. MKM assumptions caused deviations in turnover frequencies exceeding ten orders of magnitude and led to contrasting mechanistic and selectivity predictions. Multi-site MKMs overestimate activity by inflating free site availability, single-site models underestimate activity, and uniform occupancy models overpredict coverage of multi-dentate intermediates, leading to reaction-specific artifacts. Overall, the Combined Site Edge Model (CSEM), a single-site MKM accounting for site occupancy and cross-facet interactions, most closely approximates PB-MKM predictions. All models predict similar kinetics when surfaces are clean or primarily occupied by monodentate species. This work provides practical guidance for selecting MKM frameworks for undercoordinated catalytic surfaces and highlights the critical role of modeling assumptions in catalytic predictions.

(211) facet↗
DOE OSTI2020

Can a simple topological-constraints-based model predict the initial dissolution rate of borosilicate and aluminosilicate glasses?

Tuning glass composition to obtain targeted properties generally relies on empirical approaches. However, a deep understanding of the physical and chemical mechanisms linking glass composition to its structure and properties would enable developing reliable predictive models. Indeed, although empirical models are usually able to interpolate composition–property relationships within a given compositional envelope, they often fail at extrapolating predictions far from their training domain. Here, as an alternative route to empirical models, we show that a structural descriptor based on the number of topological constraints per atom can be used to predict the initial dissolution rate of aluminosilicate and borosilicate glasses after being parameterized on different families of glasses (specific series of borosilicate glasses). Sixteen glasses belonging to these families were studied and their initial dissolution rates were determined at 90 °C and pH 90 °C = 9, covering rates spanning over 5 orders of magnitude. The model based on topological constraints was trained based on seven select borosilicate glasses (R 2 = 0.997) and used to predict the dissolution rate of nine additional borosilicate and aluminosilicate glasses. We show that, provided that corrections are made for high alkali content glasses that dissolve incongruently (preferential release of Na), the model gives reasonable predictions, even far from its training domain.

36 MATERIALS SCIENCE↗
DOE OSTI2021

StressNet - Deep learning to predict stress with fracture propagation in brittle materials

Abstract Catastrophic failure in brittle materials is often due to the rapid growth and coalescence of cracks aided by high internal stresses. Hence, accurate prediction of maximum internal stress is critical to predicting time to failure and improving the fracture resistance and reliability of materials. Existing high-fidelity methods, such as the Finite-Discrete Element Model (FDEM), are limited by their high computational cost. Therefore, to reduce computational cost while preserving accuracy, a deep learning model, StressNet, is proposed to predict the entire sequence of maximum internal stress based on fracture propagation and the initial stress data. More specifically, the Temporal Independent Convolutional Neural Network (TI-CNN) is designed to capture the spatial features of fractures like fracture path and spall regions, and the Bidirectional Long Short-term Memory (Bi-LSTM) Network is adapted to capture the temporal features. By fusing these features, the evolution in time of the maximum internal stress can be accurately predicted. Moreover, an adaptive loss function is designed by dynamically integrating the Mean Squared Error (MSE) and the Mean Absolute Percentage Error (MAPE), to reflect the fluctuations in maximum internal stress. After training, the proposed model is able to compute accurate multi-step predictions of maximum internal stress in approximately 20 seconds, as compared to the FDEM run time of 4 h, with an average MAPE of 2% relative to test data.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Data analytics approach to predict high-temperature cyclic oxidation kinetics of NiCr-based Alloys

Abstract Although of practical importance, there is no established modeling framework to accurately predict high-temperature cyclic oxidation kinetics of multi-component alloys due to the inherent complexity. We present a data analytics approach to predict the oxidation rate constant of NiCr-based alloys as a function of composition and temperature with a highly consistent and well-curated experimental dataset. Two characteristic oxidation models, i.e., a simple parabolic law and a statistical cyclic oxidation model, have been chosen to numerically represent the high-temperature oxidation kinetics of commercial and model NiCr-based alloys. We have successfully trained machine learning (ML) models using highly ranked key input features identified by correlation analysis to accurately predict experimental parabolic rate constants ( k p ). This study demonstrates the potential of ML approaches to predict oxidation kinetics of alloys over wide composition and temperature ranges. This approach can also serve as a basis for introducing more physically meaningful ML input features to predict the comprehensive cyclic oxidation behavior of multi-component high-temperature alloys with proper constraints based on the known underlying mechanisms.

36 MATERIALS SCIENCE↗