Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Prediction Accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Modeling protein structures from predicted contacts with modern molecular dynamics potentials: accuracy, sensitivity, and refinement

Protein structure prediction has become increasingly popular and successful in recent years. An essential step for fragment-free, template-free methods is the generation of a final three-dimensional protein model from a set of predicted amino acid contacts that are often described by interresidue pairwise atomic distances. Here we explore the use of modern, open-source molecular dynamics (MD) engines, which have been continually developed over the last three decades with all-atom Hamiltonians to model biomolecular structure and dynamics, to generate accurate protein structures starting from a set of inferred pairwise distances. Additionally, the ability of MD empirical physical potentials to correct inaccuracies in the predicted geometries is tested. We rigorously characterize the effect of modeling parameters on results, the effect of different amounts of error in the predicted distances on the final structures, and test the ability of post-processing analysis to sort the best models out of a set of statistical replicas. We find that with exact distances and with noisy distances, the method can produce excellent structural models, and that the molecular dynamics force field seems to help correct errors in distance predictions, resisting the effects of applied noise.

Davidson, Russ↗

AI Improves the Accuracy, Reliability, and Economic Value of Continental‐Scale Flood Predictions

Accurate flood early warnings are critical to minimize damage and loss of life. Current large‐scale operational forecasting systems, however, have limited accuracy, description of uncertainty, and computational efficiency. While Artificial intelligence (AI) can address these limitations in principle, the accuracy and reliability of AI forecasts have thus far proven insufficient. Here we present a novel hybrid framework that integrates AI‐based machinery termed Errorcastnet (ECN) with the National Water Model (NWM) to showcase the potential of ensemble AI flood forecasts over the contiguous U.S. ECN boosts prediction accuracy four‐ to six‐fold across lead times of 1–10 days, while providing uncertainty quantification. It also outperforms Google's state‐of‐the‐art global AI model. ECN‐based forecasts offer superior economic value (up to four‐fold) for decision‐making as compared to those from NWM alone. ECN performs well in varied ecoregions, physiography, and land management conditions. The framework is computationally efficient, enabling national‐scale ensemble forecasts in minutes.

artificial intelligence↗

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗

Modified 316H constitutive model updated with high temperature stress relaxation test data

This report describes the calibration of a new high temperature constitutive model for 316H stainless steel, suitable for use with the ASME Boiler & Pressure Vessel Section III, Division 5, Class A rules for design by inelastic analysis. The model retains the same mathematical form used by the reference model included in Nonmandatory Appendix Z of the Code, but refits the model to an expanded dataset including all the data used to fit the original model plus seven new stress relaxation tests. The addition of these high temperature stress relaxation tests improves the model's accuracy in predicting relaxation at temperatures greater than 700 ⁰C, without compromising the accuracy of the model versus the original calibration data.

36 MATERIALS SCIENCE↗

Orbit Determination for the Lunar Reconnaissance Orbiter Using an Extended Kalman Filter

Since launch, the FDF has performed daily OD for LRO using the Goddard Trajectory Determination System (GTDS). GTDS is a batch least-squares (BLS) estimator. The tracking data arc for OD is 36 hours. Current operational OD uses 200 x 200 lunar gravity, solid lunar tides, solar radiation pressure (SRP) using a spherical spacecraft area model, and point mass gravity for the Earth, Sun, and Jupiter. LRO tracking data consists of range and range-rate measurements from: Universal Space Network (USN) stations in Sweden, Germany, Australia, and Hawaii. A NASA antenna at White Sands, New Mexico (WS1S). NASA Deep Space Network (DSN) stations. DSN data was sparse and not included in this study. Tracking is predominantly (50) from WS1S. The OD accuracy requirements are: Definitive ephemeris accuracy of 500 meters total position root-mean-squared (RMS) and18 meters radial RMS. Predicted orbit accuracy less than 800 meters root sum squared (RSS) over an 84-hour prediction span.

LRO↗

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗

Machine learning assisted rediscovery of methane storage and separation in porous carbon from material literature

Porous carbon (PC) has been widely regarded as one of the most promising absorbents for methane storage. Studies show that its uptake capacity and selectivity highly depend on textural structures. Although much effort has been made, unveiling their detailed structure-performance relationship remains a challenge. Here, we propose an innovative study where, with the assistance of machine learning, the hidden relationship of the textural structures of PC with the methane uptake and separation can be derived from existing data in material literature. Machine learning models were trained by the data, including specific surface area, micropore volume, mesopore volume, temperature, and pressure as the input variables and methane uptake as the output variable for prediction. Among the tested models, the multilayer perceptron (MLP) shows the highest accuracy in predicting the methane uptake. In addition, the model enables to automatically construct a uptake performance map in terms of micropore volume and mesopore volume. The obtained MLP model was also extended to explore the CO 2 /CH 4 selectivity by retraining it with the data collected from literature of PC for the CO 2 uptake. Finally, the constructed 2D selectivity map shows that the high selectivity can be achieved in the low CH 4 uptake region.

42 ENGINEERING↗

Atomistic measurement and modeling of intrinsic fracture toughness of two-dimensional materials

Quantifying the intrinsic mechanical properties of two-dimensional (2D) materials is essential to predict the long-term reliability of materials and systems in emerging applications ranging from energy to health to next-generation sensors and electronics. Currently, measurements of fracture toughness and identification of associated atomistic mechanisms remain challenging. Herein, we report an integrated experimental–computational framework in which in-situ high-resolution transmission electron microscopy (HRTEM) measurements of the intrinsic fracture energy of monolayer MoS 2 and MoSe 2 are in good agreement with atomistic model predictions based on an accurately parameterized interatomic potential. Changes in crystalline structures at the crack tip and crack edges, as observed in in-situ HRTEM crack extension tests, are properly predicted. Such a good agreement is the result of including large deformation pathways and phase transitions in the parameterization of the inter-atomic potential. The established framework emerges as a robust approach to determine the predictive capabilities of molecular dynamics models employed in the screening of 2D materials, in the spirit of the materials genome initiative. Moreover, it enables device-level predictions with superior accuracy (e.g., fatigue lifetime predictions of electro- and opto-electronic nanodevices).

Zhang, Xu↗

Three-dimensional modeling of diesel engine intake flow, combustion and emissions

A three-dimensional computer code (KIVA) is being modified to include state-of-the-art submodels for diesel engine flow and combustion: spray atomization, drop breakup/coalescence, multi-component fuel vaporization, spray/wall interaction, ignition and combustion, wall heat transfer, unburned HC and NOx formation, soot and radiation, and the intake flow process. Improved and/or new submodels which were completed are: wall heat transfer with unsteadiness and compressibility, laminar-turbulent characteristic time combustion with unburned HC and Zeldo'vich NOx, and spray/wall impingement with rebounding and sliding drops. Results to date show that adding the effects of unsteadiness and compressibility improves the accuracy of heat transfer predictions; spray drop rebound can occur from walls at low impingement velocities (e.g., in cold-starting); larger spray drops are formed at the nozzle due to the influence of vaporization on the atomization process; a laminar-and-turbulent characteristic time combustion model has the flexibility to match measured engine combustion data over a wide range of operating conditions; and finally, the characteristic time combustion model can also be extended to allow predictions of ignition. The accuracy of the predictions is being assessed by comparisons with available measurements. Additional supporting experiments are also described briefly. To date, comparisons with measured engine cylinder pressure and heat flux data were made for homogeneous charge, spark-ignited and compression-ignited engines. The model results are in good agreement with the experiments.

Reitz, R. D.↗

Decohesion Elements using Two and Three-Parameter Mixed-Mode Criteria

An eight-node decohesion element implementing different criteria to predict delamination growth under mixed-mode loading is proposed. The element is used at the interface between solid finite elements to model the initiation and propagation of delamination. A single displacement-based damage parameter is used in a softening law to track the damage state of the interface. The power law criterion and a three-parameter mixed-mode criterion are used to predict delamination growth. The accuracy of the predictions is evaluated in single mode delamination and in the mixed-mode bending tests.

Davila, Carlos G.↗

Estimation of Aerosol Optical Depth at Different Wavelengths by Multiple Regression Method

This study aims to investigate and establish a suitable model that can help to estimate aerosol optical depth (AOD) in order to monitor aerosol variations especially during non-retrieval time. The relationship between actual ground measurements (such as air pollution index, visibility, relative humidity, temperature, and pressure) and AOD obtained with a CIMEL sun photometer was determined through a series of statistical procedures to produce an AOD prediction model with reasonable accuracy. The AOD prediction model calibrated for each wavelength has a set of coefficients. The model was validated using a set of statistical tests. The validated model was then employed to calculate AOD at different wavelengths. The results show that the proposed model successfully predicted AOD at each studied wavelength ranging from 340 nm to 1020 nm. To illustrate the application of the model, the aerosol size determined using measure AOD data for Penang was compared with that determined using the model. This was done by examining the curvature in the ln [AOD]-ln [wavelength] plot. Consistency was obtained when it was concluded that Penang was dominated by fine mode aerosol in 2012 and 2013 using both measured and predicted AOD data. These results indicate that the proposed AOD prediction model using routine measurements as input is a promising tool for the regular monitoring of aerosol variation during non-retrieval time.

Tan, Fuyi↗

Machine Learning Approach for Aircraft Performance Model Parameter Estimation for Trajectory Prediction Applications

Inaccurate prediction of aircraft trajectory by ground-based decision support tools (DST) is a major concern in air traffic management (ATM). Aircraft trajectory prediction tools rely on a simplified point-mass aircraft performance model (APM) to make their predictions. Even though the performance coefficients and weight of an aircraft are a vital part of the APM’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to DSTs. Current ATM research focuses on improving the estimate of some APM parameters by freezing all other coefficients. This simplified approach introduces unwanted sources of bias and negatively impacts the accuracy of the performance model. In this paper, we apply machine learning (ML) techniques for the simultaneous prediction of three key APM parameters (two drag coefficients and the initial aircraft weight). To accomplish this, we employ an ordinary differential equation (ODE) fitting approach to generate optimized APM parameter labels customized to each individual flight record. Subsequently, we train ML models to capture the relationship between the historical data and the optimized APM parameters. Two different ML model solutions are applied and APM coefficients are predicted for unseen flights. The results indicate that the ML models are able to capture the relationship between APM parameters and flight-related features with good accuracy.

trajectory prediction, machine learning, aircraft ↗

Prediction of Mechanical Properties of Polymers With Various Force Fields

The effect of force field type on the predicted elastic properties of a polyimide is examined using a multiscale modeling technique. Molecular Dynamics simulations are used to predict the atomic structure and elastic properties of the polymer by subjecting a representative volume element of the material to bulk and shear finite deformations. The elastic properties of the polyimide are determined using three force fields: AMBER, OPLS-AA, and MM3. The predicted values of Young s modulus and shear modulus of the polyimide are compared with experimental values. The results indicate that the mechanical properties of the polyimide predicted with the OPLS-AA force field most closely matched those from experiment. The results also indicate that while the complexity of the force field does not have a significant effect on the accuracy of predicted properties, small differences in the force constants and the functional form of individual terms in the force fields determine the accuracy of the force field in predicting the elastic properties of the polyimide.

Odegard, Gregory M.↗

The contribution of Compton ionization to ultrafast x-ray scattering

We investigate the role of Compton ionization in ultrafast non-resonant x-ray scattering using a molecular model system, which includes the ionization continuum via an orthonormalized plane wave ansatz. Elastic and inelastic components of the scattering signal, as well as coherent-mixed scattering that arises from electron dynamics, are calculated. By virtue of a near-quantitative distinction between scattering related to electronic transitions into bound and continuum states, we demonstrate how Compton ionization contributes to the coherent-mixed component. Analogous to inelastic scattering, the contribution to the coherent-mixed signal is significant and particularly manifests at intermediate and high-momentum transfers. Strikingly, for molecules with inversion symmetry, the exclusion of bound or continuum transitions may lead to the prediction of spurious coherent-mixed signals. We conclude that qualitative and quantitative accuracies of predicted scattering signals on detectors without energy resolution require that elements of the two-electron density operator are used. This approach inherently accounts for all accessible electronic transitions, including ionization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Results of acoustic tests of a Prop-Fan model

Results of acoustic tests in a low speed open jet anechoic wind tunnel are presented for a counter rotation Prop-Fan model. The model tested had 5 front and 5 rear rotor blades with swept planform. Noise spectra are presented showing the influence of operating and configuration variables such as: (1) power absorption, (2) tip speed, (3) rotor-rotor spacing, (4) power split between the front and rear blade rows, (5) variation of the RPM ratio between front and rear blade rows, (6) tractor versus pusher (pylon effects), and (7) angle of attack. In addition to model scale results, calculated levels derived from test are presented showing the influence of the above variables on Effective Perceived Noise Level of a 13.1 ft diameter Prop-Fan at a flyover distance of 1500 ft. It was found that the strongest effects are caused by tip speed and power absorption. A significant finding was that there is an optimum operating tip speed for minimum noise for a given power absorption. Effects of other parametric variations are generally small but measurable. In order to minimize noise to meet airplane certification limits, operation at moderate tip speeds and power absorption is shown to be desirable. Accuracy of predicted Effective Perceived Noise Level is shown to be good with the best accuracy in the 590 to 670 ft/sec tip speed range.

Metzger, F.B.↗

Combining pairwise structural similarity and deep learning interface contact prediction to estimate protein complex model accuracy in CASP15

Abstract Estimating the accuracy of quaternary structural models of protein complexes and assemblies (EMA) is important for predicting quaternary structures and applying them to studying protein function and interaction. The pairwise similarity between structural models is proven useful for estimating the quality of protein tertiary structural models, but it has been rarely applied to predicting the quality of quaternary structural models. Moreover, the pairwise similarity approach often fails when many structural models are of low quality and similar to each other. To address the gap, we developed a hybrid method (MULTICOM_qa) combining a pairwise similarity score (PSS) and an interface contact probability score (ICPS) based on the deep learning inter‐chain contact prediction for estimating protein complex model accuracy. It blindly participated in the 15th Critical Assessment of Techniques for Protein Structure Prediction (CASP15) in 2022 and performed very well in estimating the global structure accuracy of assembly models. The average per‐target correlation coefficient between the model quality scores predicted by MULTICOM_qa and the true quality scores of the models of CASP15 assembly targets is 0.66. The average per‐target ranking loss in using the predicted quality scores to rank the models is 0.14. It was able to select good models for most targets. Moreover, several key factors (i.e., target difficulty, model sampling difficulty, skewness of model quality, and similarity between good/bad models) for EMA are identified and analyzed. The results demonstrate that combining the multi‐model method (PSS) with the complementary single‐model method (ICPS) is a promising approach to EMA.

59 BASIC BIOLOGICAL SCIENCES↗

Towards Efficient Uncertainty estimation in deep learning for robust energy prediction in crystal materials

In material science, recent studies have started to explore the potential of using deep learning to improve property prediction from high-fidelity simulations, e.g, density functional theory (DFT). However, the design spaces are sometimes too large and intractable to sample completely. This results in a critical question that is how to evaluate the confidence and robustness of the prediction. In this paper, we propose an efficient approach to estimate uncertainty in deep learning using a single forward pass and then apply it for robust prediction of the total energy in crystal lattice structures. Our approach is built upon the deep kernel learning (DKL) that originally introduces to leverage the expressiveness of deep neural networks as input with a probabilistic prediction of Gaussian processes (GPs) as output. Existing DKL methods have difficulties in the accuracy of predictive uncertainty, training stability, and scaling to large datasets, which lead to significant barriers in real-world applications. We propose to address these challenges by using an inducing point approximate GP in feature space combined with spectral normalization as a regularization. We finally demonstrate our robust performance on an artificial example and a real-world application from materials chemistry.

Bi, Sirui↗

Enhancing Drinking Water Quality Modeling: Leveraging Physics Informed Neural Networks for Learning with Imperfect Reaction Models and Partial Data

Chemical kinetics models, typically formulated as systems of ordinary or partial differential equations, are valuable tools for simulating drinking water quality. However, these models often face inaccuracies due to discrepancies between the laboratory and the real-world conditions, as well as limitations in experimental analytical methods, hindering the accurate representation of the true underlying chemical mechanisms. In this study, we propose a Physics Informed Neural Network (PINN), using the eXtreme Theory of Functional Connections, to improve the prediction of chemical concentrations over time. The PINN method accounts for imperfect chemical models and incorporates partial data to improve predictions. Focusing on reactions describing water disinfection residual and disinfectant byproduct formation, which are crucial for public health and regulatory compliance, we demonstrate that the PINN model is able to accurately predict the concentrations of chemical species across various pH values. Notably, the model extends its accuracy to predict concentrations of chemical species not originally included in its training data. The developed method can be extended to a variety of chemical systems, offering a wide array of potential applications.

13 HYDRO ENERGY↗