Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine learning prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Machine learning models for rat multigeneration reproductive toxicity prediction

Reproductive toxicity is one of the prominent endpoints in the risk assessment of environmental and industrial chemicals. Due to the complexity of the reproductive system, traditional reproductive toxicity testing in animals, especially guideline multigeneration reproductive toxicity studies, take a long time and are expensive. Therefore, machine learning, as a promising alternative approach, should be considered when evaluating the reproductive toxicity of chemicals. We curated rat multigeneration reproductive toxicity testing data of 275 chemicals from ToxRefDB (Toxicity Reference Database) and developed predictive models using seven machine learning algorithms (decision tree, decision forest, random forest, k-nearest neighbors, support vector machine, linear discriminant analysis, and logistic regression). A consensus model was built based on the seven individual models. An external validation set was curated from the COSMOS database and the literature. The performances of individual and consensus models were evaluated using 500 iterations of 5-fold cross-validations and the external validation data set. The balanced accuracy of the models ranged from 58% to 65% in the 5-fold cross-validations and 45%–61% in the external validations. Prediction confidence analysis was conducted to provide additional information for more appropriate applications of the developed models. The impact of our findings is in increasing confidence in machine learning models. We demonstrate the importance of using consensus models for harnessing the benefits of multiple machine learning models (i.e., using redundant systems to check validity of outcomes). While we continue to build upon the models to better characterize weak toxicants, there is current utility in saving resources by being able to screen out strong reproductive toxicants before investing in vivo testing. The modeling approach (machine learning models) is offered for assessing the rat multigeneration reproductive toxicity of chemicals. Our results suggest that machine learning may be a promising alternative approach to evaluate the potential reproductive toxicity of chemicals.

consensus model↗
DOE OSTI2022

Temporal regulation of cold transcriptional response in switchgrass

Switchgrass low-land ecotypes have significantly higher biomass but lower cold tolerance compared to up-land ecotypes. Understanding the molecular mechanisms underlying cold response, including the ones at transcriptional level, can contribute to improving tolerance of high-yield switchgrass under chilling and freezing environmental conditions. Here, by analyzing an existing switchgrass transcriptome dataset, the temporal cis- regulatory basis of switchgrass transcriptional response to cold is dissected computationally. We found that the number of cold-responsive genes and enriched Gene Ontology terms increased as duration of cold treatment increased from 30 min to 24 hours, suggesting an amplified response/cascading effect in cold-responsive gene expression. To identify genomic sequences likely important for regulating cold response, machine learning models predictive of cold response were established using k -mer sequences enriched in the genic and flanking regions of cold-responsive genes but not non-responsive genes. These k -mers, referred to as putative cis -regulatory elements (pCREs) are likely regulatory sequences of cold response in switchgrass. There are in total 655 pCREs where 54 are important in all cold treatment time points. Consistent with this, eight of 35 known cold-responsive CREs were similar to top-ranked pCREs in the models and only these eight were important for predicting temporal cold response. More importantly, most of the top-ranked pCREs were novel sequences in cold regulation. Our findings suggest additional sequence elements important for cold-responsive regulation previously not known that warrant further studies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Creep in multi-principal element materials –– A review

The ongoing push towards enhanced energy efficiency and reduced emissions has necessitated the creation of materials with superior performance, especially under extreme conditions. Modern industries, such as aerospace, energy production, and nuclear power, rely heavily on materials that can withstand elevated temperatures without compromising structural integrity. At these heightened temperatures, materials, even when subjected to mechanical stresses well below their yield strength, may experience slow deformation leading to eventual rupture — a phenomenon known as creep. With the expansive design space that comes with the high entropy concept and their reported excellent high temperature strength, multi-principal element materials (MPEMs) have attracted interest in the scientific community for high-temperature applications. Here, this review offers a comprehensive examination of existing studies on creep in MPEMs, which includes multi-principal element−alloys, −bulk metallic glasses, −ceramics, and −superalloys, comparing published findings on MPEMs with pure elements, traditional alloys, bulk metallic glasses, and superalloys. The sub-topics covered include a comparison among different creep-testing methods, creep mechanisms, creep exponents, creep strain rates, activation volume, and creep-activation energy. Modeling efforts for predicting creep behavior of MPEMs are also reviewed. Methods for improving creep resistance by performing heat treatments and/or modifying microstructures are discussed. Overall, the current state of MPEMs has not yet surpassed the creep performance of commercial alloys. Finally, directions for future efforts are suggested, such as experimenting in various controlled environments, expanding the number of compositions tested, exploring advanced manufacturing techniques, and using machine-learning to predict creep properties based on compositions and microstructures.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Enabling Efficient Surveillance, Control, and Automation of Geothermal Operations with Advanced Predictive Analytics

Automation and control of geothermal energy production and operations require reliable and efficient predictive tools. While physics-based simulation offers a comprehensive tool for predicting energy production performance in geothermal systems, predicting the behavior of geothermal reservoirs involves complex multi-physics processes with coupling effects, highly uncertain input parameters and subsurface descriptions. Moreover, building, running, and integrating simulation models into standard model calibration and optimization workflows entail significant technical and computational efforts. An emerging alternative to physics-based simulation is data-driven predictive analytics models that have gained popularity in energy industry. In this report, we develop novel predictive models for integration into real-time fault diagnosis and model predictive control algorithms to improve the efficiency of energy production operations in geothermal reservoirs. The report includes two major research Thrust Areas, that is, the surface power plant and the subsurface reservoir.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

DEEP Solar: Data DrivEn Modeling and Analytics for Enhanced System Layer ImPlementation

Realizing the SETO 2030 mission of reducing solar energy costs to 3-5 c/kWh will require innovative enabling research on effective, cost-efficient integration of local PV within distribution systems. However, the intermittent and variable nature of PVs compels operators to impose conservative hosting capacity constraints. Given the extremely high variability of (intermittent and unpredictable) solar energy generation, relaxing the capacity constraints (which are currently around 15%) and achieving 100% or greater integration of renewables will require a fundamental transformation of the power grid via the utilization of exponentially larger amounts of AMI enabled fine-grained data. To address the challenges in increasing the penetration of renewable energy based DERs, this project envisions an Enhanced System Layer (ESL) at the distribution network level that is reliable, cost-effective and scalable to millions of Distributed Energy Resources (DERs)/devices. This includes developing: 1) Transformative and highly scalable machine learning based predictive analytics tools that plug into distribution system planning and provide real-time situational awareness at the distribution level for short and long-term operational planning. The tools will be built using novel data-driven energy models of millions of active nodes with AMI, 2) Adaptive stochastic analysis and optimization algorithms for real-time grid operations, 3) Dynamic Scenario Analysis using parallel Cloudenabled implementations with < 1 minute computational cycle times.

14 SOLAR ENERGY↗
DOE OSTI2025

Biosynthesis of bioprivileged, linear molecules via novel carboligase reactions

Over the award period, we made progress on the three aims. We screened twenty-five carboligases for activity coupling twenty-one possible -keto acids (Aim 1). The carboligases were selected across a diverse set of protein sequences. Using Q-Exactive UHPLC-MS, we tested a total of 210 coupled products per enzyme and generated a dataset of 5250 enzyme-substrate activity relationships. We identified multiple enzymes that had activity for synthesizing suberic acid and heptanoic acid (Aim 2). We built a random forest model for predicting the activity of each enzyme toward substrates on which it was not tested using the data from Aim 1. Finally, we evaluated growth defects that occurred due to expression of different carboligases in E. coli (Aim 3). We were able to identify specific metabolites and putative pathways that, when supplemented in the media, recovered the growth defect associated with the presence of specific carboligases. We are in the process of publishing two manuscript describing the methods for high-throughput screening of enzyme promiscuity, using machine learning to predict activity on untested substrates, and enzyme activity data we collected. This project has produced enabling data for biosynthesis of a range of new-to-nature compounds to support biomanufacturing.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Battery calendar aging and machine learning

Batteries continue to attract immense attention due to the critical need for new energy technologies that can help humankind transition to a net-zero future. To meet global goals for implementation of new batteries, the research community needs to more coherently consider how to go about the process of innovation, development, and validation of new technologies. Current practices for bringing a new battery technology from the benchtop to deployment can be very time consuming and complex, given that batteries can have distinct aging pathways based on both how they are cycled and their storage conditions. In nearly all use cases, batteries experience periods of active cycling and also extended periods of rest. Thus, calendar time often occurs when a battery is close to fully charged. Currently, the combined cycle and calendar life aspects receive inconsistent attention during most stages of research and development. For batteries to fulfill the critical role envisioned to meet global energy demands, greater uniformity in practice is needed to alleviate potential delays caused by the inconsistent acquisition of aging data. In this study, we present our thoughts and recommendations on the need to further advance commonality and availability of calendar aging data for emerging high-energy and long-duration batteries. While there is a broad need to adopt best practices for both calendar and cycle life assessment, a push to greater uniformity in approach and reporting is sorely needed to allow calendar life predictions to harness many of the advances that have recently been seen for cycle life prediction using machine learning (ML) and other techniques.

25 ENERGY STORAGE↗
DOE OSTI2022

Discovering exceptionally hard and wear-resistant metallic glasses by combining machine-learning with high throughput experimentation

Lack of crystalline order in amorphous alloys, commonly called metallic glasses (MGs), tends to make them harder and more wear-resistant than their crystalline counterparts. However, finding inexpensive MGs is daunting; finding one with enhanced wear resistance is a further challenge. Relying on machine learning (ML) predictions of MGs alone requires a highly precise model; however, incorporating high-throughput (HiTp) experiments into the search rapidly leads to higher performing materials even from moderately accurate models. Here, we exploit this synergy between ML predictions and HiTp experimentation to discover new hard and wear-resistant MGs in the Fe–Nb–B ternary material system. Several of the new alloys exhibit hardness greater than 25 GPa, which is over three times harder than hardened stainless steel and only surpassed by diamond and diamond-like carbon. This ability to use less than perfect ML predictions to successfully guide HiTp experiments, demonstrated here, is especially important for searching the vast Multi-Principal-Element-Alloy combinatorial space, which is still poorly understood theoretically and sparsely explored experimentally.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Predicting metabolic modules in incomplete bacterial genomes with MetaPathPredict

The reconstruction of complete microbial metabolic pathways using ‘omics data from environmental samples remains challenging. Computational pipelines for pathway reconstruction that utilize machine learning methods to predict the presence or absence of KEGG modules in incomplete genomes are lacking. Here, we present MetaPathPredict, a software tool that incorporates machine learning models to predict the presence of complete KEGG modules within bacterial genomic datasets. Using gene annotation data and information from the KEGG module database, MetaPathPredict employs deep learning models to predict the presence of KEGG modules in a genome. MetaPathPredict can be used as a command line tool or as a Python module, and both options are designed to be run locally or on a compute cluster. Benchmarks show that MetaPathPredict makes robust predictions of KEGG module presence within highly incomplete genomes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Estimating Compressional Velocity and Bulk Density Logs in Marine Gas Hydrates Using Machine Learning

Compressional velocity (Vp) and bulk density (ρb) logs are essential for characterizing gas hydrates and near-seafloor sediments; however, it is sometimes difficult to acquire these logs due to poor borehole conditions, safety concerns, or cost-related issues. We present a machine learning approach to predict either compressional Vp or ρb logs with high accuracy and low error in near-seafloor sediments within water-saturated intervals, in intervals where hydrate fills fractures, and intervals where hydrate occupies the primary pore space. We use scientific-quality logging-while-drilling well logs, gamma ray, ρb, Vp, and resistivity to train the machine learning model to predict Vp or ρb logs. Of the six machine learning algorithms tested (multilinear regression, polynomial regression, polynomial regression with ridge regularization, K nearest neighbors, random forest, and multilayer perceptron), we find that the random forest and K nearest neighbors algorithms are best suited to predicting Vp and ρb logs based on coefficients of determination (R2) greater than 70% and mean absolute percentage errors less than 4%. Given the high accuracy and low error results for Vp and ρb prediction in both hydrate and water-saturated sediments, we argue that our model can be applied in most LWD wells to predict Vp or ρb logs in near-seafloor siliciclastic sediments on continental slopes irrespective of the presence or absence of gas hydrate.

Naim, Fawz↗
DOE OSTI2022

A systematic method for selecting molecular descriptors as features when training models for predicting physiochemical properties

Machine learning has proven to be a powerful tool for accelerating biofuel development. Although numerous models are available to predict a range of properties using chemical descriptors, there is a trade-off between interpretability and performance. Neural networks provide predictive models with high accuracy at the expense of some interpretability, while simpler models such as linear regression often lack in accuracy. In addition to model architecture, feature selection is also critical for developing interpretable and accurate predictive models. We present a method for systematically selecting molecular descriptor features and developing interpretable machine learning models without sacrificing accuracy. Our method simplifies the process of selecting features by reducing feature multicollinearity and enables discoveries of new relationships between global properties and molecular descriptors. To demonstrate our approach, we developed models for predicting melting point, boiling point, flash point, yield sooting index, and net heat of combustion with the help of the Tree-based Pipeline Optimization Tool (TPOT). For training, we used publicly available experimental data for up to 8351 molecules. Our models accurately predict various molecular properties for organic molecules (mean absolute percent error (MAPE) ranges from 3.3% to 10.5%) and provide a set of features that are well-correlated to the property. This method enables researchers to explore sets of features that significantly contribute to the prediction of the property, offering new scientific insights. To help accelerate early stage biofuel research and development, we also integrated the data and models into a open-source, interactive web tool.

09 BIOMASS FUELS↗
DOE OSTI2022

Improving net ecosystem CO2 flux prediction using memory-based interpretable machine learning

Terrestrial ecosystems play a central role in the global carbon cycle and affect climate change. However, our predictive understanding of these systems is still limited due to their complexity and uncertainty about how key drivers and their legacy effects influence carbon fluxes. Here, we propose an interpretable Long Short-Term Memory (iLSTM) network for predicting net ecosystem CO 2 exchange (NEE) and interpreting the influence on the NEE prediction from environmental drivers and their memory effects. We consider five drivers and apply the method to three forest sites in the United States. Besides performing the prediction in each site, we also conduct transfer learning by using the iLSTM model trained in one site to predict at other sites. Results show that the iLSTM model produces good NEE predictions for all three sites and, more importantly, it provides reasonable interpretations on the input driver's importance as well as their temporal importance on the NEE prediction. Additionally, the iLSTM model demonstrates good across-site transferability in terms of both prediction accuracy and interpretability. The transferability can improve the NEE prediction in unobserved forest sites, and the interpretability advances our predictive understanding and guides process-based model development.

Liu, Siyan↗
DOE OSTI2022

Prospects of federated machine learning in fluid dynamics

Physics-based models have been mainstream in fluid dynamics for developing predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this article, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while keeping all the training data on each edge device. We demonstrate the feasibility and prospects of such a decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics.

36 MATERIALS SCIENCE↗
DOE OSTI2022

3D Frequency Domain Reflectometry Digital Twin of an Electrical Cable: A First Glance

Electrical cables within nuclear power plants (NPPs) are critical components required for power, control, and instrumentation systems which may be exposed to stressors, such as elevated temperatures and gamma radiation. Such stressors can lead to a reduction in the remaining useful life of electrical cables, jeopardizing the safety of NPP systems. To evaluate the effect of stressors on the degradation of electrical cables, electrical reflectometry methods are commonly employed. Frequency domain reflectometry (FDR) is a non-destructive electrical reflectometry method that uses transmission line theory to detect degradation or impedance changes within electrical cables. However, in most cases FDR is only applied to de-energized cables, limiting the application in NPPs as the cable system must be taken offline. In this work, we explore the development of an FDR digital twin to predict the degradation of an electrical cable exposed to elevated temperature, which is expected to reduce the need for offline FDR. A 3-conductor low-voltage electrical cable was selected for evaluation of the digital twin. The fully three-dimensional digital twin was developed in COMSOL using the RF module. A cable length of 30-m and frequency bandwidth of 400 MHz was selected to mimic real-world application of FDR. Over a 1-m region, the permittivity of the insulation was varied by up to 20% to model thermal degradation. The results demonstrate accurate detection of the insulation damage region, supporting further investigation of the FDR digital twin using real-world data and machine learning for predictive damage estimation or remaining lifetime.

Spencer, Mychal P.↗
DOE OSTI2023

Application of machine learning for optical emission spectroscopy data in NAGDIS-II

In this study, we applied machine learning to optical emission spectroscopy (OES) data and device parameters from the linear plasma device NAGDIS-II to explore the potential application of machine learning for predicting electron density, $n$ e , and temperature, $T$ e . The covered ranges of $n$ e and $T$ e , which were measured by an electrostatic probe, are 3.6 × 10 17 –2.4 × 10 19 m -3 and 0.3–7.1 eV, respectively. A three hidden layer neural network (NN) is introduced to model the relationship between $n$ e /$T$ e and the combination of line intensities, radial position, and device parameters. It is shown that the errors in $n$ e and $T$ e become 18.0 and 18.8%, respectively, which were almost the same level for the electrostatic probe, using all available data. Lasso regression and greedy algorithm are used to select the necessary line emissions. In conclusion, it is shown that four- or five-line intensities are sufficient to obtain almost the same quality as the one with all the other lines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

teemi: An open-source literate programming approach for iterative design-build-test-learn cycles in bioengineering

Synthetic biology dictates the data-driven engineering of biocatalysis, cellular functions, and organism behavior. Integral to synthetic biology is the aspiration to efficiently find, access, interoperate, and reuse high-quality data on genotype-phenotype relationships of native and engineered biosystems under FAIR principles, and from this facilitate forward-engineering strategies. However, biology is complex at the regulatory level, and noisy at the operational level, thus necessitating systematic and diligent data handling at all levels of the design, build, and test phases in order to maximize learning in the iterative design-build-test-learn engineering cycle. To enable user-friendly simulation, organization, and guidance for the engineering of biosystems, we have developed an open-source python-based computer-aided design and analysis platform operating under a literate programming user-interface hosted on Github. The platform is called teemi and is fully compliant with FAIR principles. In this study we apply teemi for i) designing and simulating bioengineering, ii) integrating and analyzing multivariate datasets, and iii) machine-learning for predictive engineering of metabolic pathway designs for production of a key precursor to medicinal alkaloids in yeast. The teemi platform is publicly available at PyPi and GitHub.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Pandemic drugs at pandemic speed: infrastructure for accelerating COVID-19 drug discovery with hybrid machine learning- and physics-based simulations on high-performance computers

The race to meet the challenges of the global pandemic has served as a reminder that the existing drug discovery process is expensive, inefficient and slow. There is a major bottleneck screening the vast number of potential small molecules to shortlist lead compounds for antiviral drug development. New opportunities to accelerate drug discovery lie at the interface between machine learning methods, in this case, developed for linear accelerators, and physics-based methods. The two in silico methods, each have their own advantages and limitations which, interestingly, complement each other. Here, we present an innovative infrastructural development that combines both approaches to accelerate drug discovery. The scale of the potential resulting workflow is such that it is dependent on supercomputing to achieve extremely high throughput. We have demonstrated the viability of this workflow for the study of inhibitors for four COVID-19 target proteins and our ability to perform the required large-scale calculations to identify lead antiviral compounds through repurposing on a variety of supercomputers.

97 MATHEMATICS AND COMPUTING↗