Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine learning prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Data-driven predictions of complex organic mixture permeation in polymer membranes

Membrane-based organic solvent separations are rapidly emerging as a promising class of technologies for enhancing the energy efficiency of existing separation and purification systems. Polymeric membranes have shown promise in the fractionation or splitting of complex mixtures of organic molecules such as crude oil. Determining the separation performance of a polymer membrane when challenged with a complex mixture has thus far occurred in an ad hoc manner, and methods to predict the performance based on mixture composition and polymer chemistry are unavailable. Here, we combine physics-informed machine learning algorithms (ML) and mass transport simulations to create an integrated predictive model for the separation of complex mixtures containing up to 400 components via any arbitrary linear polymer membrane. We experimentally demonstrate the effectiveness of the model by predicting the separation of two crude oils within 6-7% of the measurements. Integration of ML predictors of diffusion and sorption properties of molecules with transport simulators enables for the rapid screening of polymer membranes prior to physical experimentation for the separation of complex liquid mixtures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning for international freight transportation management: A comprehensive review

Machine learning (ML) offers a promising avenue for international freight transportation management (IFTM) given its capability to harness the power of data that have become increasingly available to freight transportation researchers and practitioners. This paper conducts a comprehensive investigation of the state-of-the-art in developing ML models for applications to different aspects of IFTM. We start by giving an overview of various fundamental ML methods. Then, how different ML methods have been employed, adapted, and applied to a multitude of subject areas in IFTM are discussed, including demand forecast, operation and asset maintenance, and vehicle trajectory and on-time performance prediction. The potential data sources that may be used to develop ML models are further examined. Subsequently, a synthesis of the exiting work is performed to identify the specific topics addressed in the existing research, ML methods used, the trends of research, and opportunities for further explorations. Four directions for future research are proposed in the end.

Data sources↗

Machine Learning in the Big Data Era: Are We There Yet?

In this paper, we discuss the machine learning challenges of the Big Data era. We observe that recent innovations in being able to collect, access, organize, integrate, and query massive amounts of data from a wide variety of data sources have brought statistical machine learning under more scrutiny and evaluation for gleaning insights from the data than ever before. In that context, we pose and debate the question - Are machine learning algorithms scaling with the ability to store and compute? If yes, how? If not, why not? We survey recent developments in the state-of-the-art to discuss emerging and outstanding challenges in the design and implementation of machine learning algorithms at scale. We leverage experience from real-world Big Data knowledge discovery projects across domains of national security and healthcare to suggest our efforts be focused along the following axes: (i) the data science challenge - designing scalable and flexible computational architectures for machine learning (beyond just data-retrieval); (ii) the science of data challenge the ability to understand characteristics of data before applying machine learning algorithms and tools; and (iii) the scalable predictive functions challenge the ability to construct, learn and infer with increasing sample size, dimensionality, and categories of labels. We conclude with a discussion of opportunities and directions for future research.

Big Data↗

Automated and High-Throughput Phase Separation Control for Supramolecular Polymer Blends Enabled by Machine Learning

Supramolecular polymer blends (SPBs) offer tunable morphologies that dictate their macroscopic properties, yet their rational design is limited by the absence of predictive structure−morphology models. Here, we introduce a data-driven highthroughput workflow that integrates modular polymer synthesis, robotic formulation, automated morphology characterization, and machine learning (ML) for accelerated SPB discovery. Using a plug-and-play synthetic strategy, 33 hydrogen-bonding endfunctional homopolymers were prepared and orthogonally combined to generate 260 SPBs in 1 day. A fully automated atomic force microscopy (AFM) pipeline enabled systematic imaging, producing 2340 morphology data sets with minimal human intervention. Domain spacings were extracted through complementary imageprocessing methods and used to train ML models. A support vector regression (SVR) model accurately predicted target phase-separation sizes (50, 100, and 150 nm), which were experimentally validated. This work demonstrates the power of coupling high-throughput experimentation with ML to accelerate morphology discovery and provides one of the first large-scale experimental data sets for supramolecular polymer systems.

ML-guided polymer design↗

Multi-Omics Reveals Temporal Scales of Carbon Metabolism in Synechococcus Elongatus PCC 7942 Under Light Disturbance

Central carbon metabolism in model cyanobacteria involves multiple pathways to adapt to energy-light limitations across diel cycles. However, the success in mechanistic modeling for phenotypic prediction of the protein regulators in the metabolic state depends on capturing the vast possibilities emerging from multiple regulatory pathways in complex biological processes. Here, we developed a physics-informed machine learning approach based on energy-landscape concepts to predict regulatory proteins responding to cyclic circadian and unforeseen light perturbations in cyanobacterial metabolic networks. Our approach provides interpretable de novo models for inferring gene expression dynamics from Synechococcus elongatus over diel cycles and using redox proteome analysis to distinguish immediate light-responsive elements from circadian-regulated processes in carbon metabolism pathways. We identified distinct temporal signatures with the analysis of the redox proteome: there was an immediate shift in cysteine redox states accompanied by a limited change in protein abundance under constant illumination and after 2 hours of darkness. This discovery indicates that the generation of reductants coordinates photoinduced electron transport with redox metabolic pathways in two discernable molecular mechanisms: fast redox-based protein modifications occur immediately after the light disturbance, followed by slow transcriptional regulations across networks. This temporal regulation reveals how metabolic networks integrate rapid light responses with programmed circadian rhythms to maintain cellular homeostasis under the light-energy limitations over the diel cycle.

Biomolecular & subcellular processes↗

Learning to Predict Crystal Plasticity at the Nanoscale: Deep Residual Networks and Size Effects in Uniaxial Compression Discrete Dislocation Simulations

The density and configurational changes of crystal dislocations during plastic deformation influence the mechanical properties of materials. These influences have become clearest in nanoscale experiments, in terms of strength, hardness and work hardening size effects in small volumes. The mechanical characterization of a model crystal may be cast as an inverse problem of deducing the defect population characteristics (density, correlations) in small volumes from the mechanical behavior. In this work, we demonstrate how a deep residual network can be used to deduce the dislocation characteristics of a sample of interest using only its surface strain profiles at small deformations, and then statistically predict the mechanical response of size-affected samples at larger deformations. As a testbed of our approach, we utilize high-throughput discrete dislocation simulations for systems of widths that range from nano- to micro- meters. We show that the proposed deep learning model significantly outperforms a traditional machine learning model, as well as accurately produces statistical predictions of the size effects in samples of various widths. By visualizing the filters in convolutional layers and saliency maps, we find that the proposed model is able to learn the significant features of sample strain profiles.

36 MATERIALS SCIENCE↗

Bridging Nano- and Microscale X-Ray Tomography for Battery Research by Leveraging Artificial Intelligence

X-ray computed tomography (CT) is a non-destructive imaging technique in which contrast originates from the materials' absorption coefficient. The recent development of laboratory nanoscale CT (nano-CT) systems has pushed the spatial resolution for battery material imaging to voxel sizes of 50 nm, a limit previously achievable only with synchrotron facilities. Given the non-destructive nature of CT, in situ and operando studies have emerged as powerful methods to quantify morphological parameters, such as tortuosity factor, porosity, surface area and volume expansion, during battery operation or cycling. Combined with artificial intelligence and machine learning analysis techniques, nano-CT has enabled the development of predictive models to analyse the impact of the electrode microstructure on cell performances or the influence of material heterogeneities on electrochemical responses. In this Review, we discuss the role of X-ray CT and nano-CT experimentation in the battery field, discuss the incorporation of artificial intelligence and machine learning analyses and provide a perspective on how the combination of multiscale CT imaging techniques can expand the development of predictive multiscale battery behavioural models.

diagnostics↗

Unraveling Network-induced Memory Contention: Deeper Insights with Machine Learning

Remote Direct Memory Access (RDMA) is expected to be an integral communication mechanism for future exascale systems enabling asynchronous data transfers, so that applications may fully utilize CPU resources while simultaneously sharing data amongst remote nodes. We examine Network-induced Memory Contention (NiMC) on Infiniband networks. We expose the interactions between RDMA, main-memory and cache, when applications and out-of-band services compete for memory resources. We then explore NiMCs resulting impact on application-level performance. For a range of hardware technologies and HPC workloads, we quantify NiMC and show that NiMCs impact grows with scale resulting in up to 3X performance degradation at scales as small as 8K processes even in applications that previously have been shown to be performance resilient in the presence of noise. In addition, this work examines the problem of predicting NiMC's impact on applications by leveraging machine learning and easily accessible performance counters. This approach provides additional insights about the root cause of NiMC and facilitates dynamic selection of potential solutions. Finally, we evaluated three potential techniques to reduce NiMCs impact, namely hardware offloading, core reservation and network throttling.

97 MATHEMATICS AND COMPUTING↗

The macroevolution of filamentation morphology across the Saccharomycotina yeast subphylum

Saccharomycotina is a subphylum of ascomycete fungi with diverse asexual growth morphologies. Filamentous growth can comprise linear and branched budding cells that do not undergo cell separation, termed pseudohyphae, or tubular filaments with septa that perforate allowing movement of organelles, termed true hyphae. We integrated phenotypic, genomic, metabolic, and environmental data on isolation sources from 1051 species to examine the variation and evolutionary history of filamentation across Saccharomycotina and determine whether these data could predict filamentation types. We found that 63.37% of strains can form filaments; 6.56% true hyphae, 42.40% pseudohyphae, and 14.39% both true hyphae and pseudohyphae. The distributions of species that can produce true hyphae or filament were more strongly correlated with the yeast phylogeny than the distribution of species with pseudohyphae. Ancestral state reconstruction suggested that true hyphal and pseudohyphal morphologies evolved several times, that most yeast ancestors likely produced pseudohyphae or lacked filaments, and that the Saccharomycotina last common ancestor likely produced pseudohyphae but not true hyphae. Machine learning models trained on genomic and metabolic features predicted filament morphologies with ∼70% accuracy. Connecting the evolution of morphologies to their genomic, physiological, and ecological characteristics will enrich our understanding of how the diversity of lifestyles evolved in Saccharomycotina.

Saccharomycotina↗

Explaining machine-learning models for gamma-ray detection and identification

As more complex predictive models are used for gamma-ray spectral analysis, methods are needed to probe and understand their predictions and behavior. Recent work has begun to bring the latest techniques from the field of Explainable Artificial Intelligence (XAI) into the applications of gamma-ray spectroscopy, including the introduction of gradient-based methods like saliency mapping and Gradient-weighted Class Activation Mapping (Grad-CAM), and black box methods like Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP). In addition, new sources of synthetic radiological data are becoming available, and these new data sets present opportunities to train models using more data than ever before. In this work, we use a neural network model trained on synthetic NaI(Tl) urban search data to compare some of these explanation methods and identify modifications that need to be applied to adapt the methods to gamma-ray spectral data. We find that the black box methods LIME and SHAP are especially accurate in their results, and recommend SHAP since it requires little hyperparameter tuning. We also propose and demonstrate a technique for generating counterfactual explanations using orthogonal projections of LIME and SHAP explanations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development and assessment of a reactor system prognosis model with physics-guided machine learning

Autonomous control systems provide recommendations to help operators in decision-making during plant operations ranging from normal operation to accident management. An important step of autonomous control is prognosis. In nuclear engineering domain, prognosis is the process of predicting future conditions of a system or equipment based on present signs and symptoms of a fault. The prognosis model allows predicting future reactor states for possible candidate control strategies so that the outcomes can be evaluated to determine the best control strategy. The prognosis model requires representing direct relationships between the symptoms and the predictions. In nuclear engineering, computational simulations are approximate representations of the operation of the real system. However, prognosis with computational simulations requires high computation power and time due to possible large number of scenarios. Necessary computation resources can be reduced with machine learning (ML) approach for fast predictions by building a surrogate function using the simulation data. A critical issue is, ML models are ignorant of physical knowledge, and these models approximate statistical relationships between the system variables. This ignorance can produce results that are inconsistent with physical laws, even if an optimal result is achieved from a mathematical point of view. Physics-guided machine learning (PGML) is an approach to tackle this issue. Here, this work formulates and illustrates a framework to guide development and assessment of the ML-based prognosis model for autonomous control systems. The development of the prognosis model considers the training of a ML model which consists of optimizing many aspects of the ML approach. The assessment of the prognosis model considers training data limitations and uncertainties of the ML approach. Prognosis models with standalone ML and PGML are developed and assessed on the loss-of-flow scenario of Experimental Breeder Reactor II. The results indicate that PGML based prognosis model has the best performance compared to other prognosis models.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Deep representation learning improves prediction of LacI-mediated transcriptional repression

Significance The understanding of protein function increases with new experimental and evolutionary datasets. A major challenge is to apply machine learning to these datasets to capture essential features of protein function. Here, we analyze the experimentally determined repression function for tens of thousands of mutants of the LacI protein. This study provides a continuous, noncategorical repression value across a majority of all single mutations and for thousands of higher-order mutations. To develop a top-performing model for the prediction of repression by LacI, we compare several leading variant effect prediction algorithms. A deep representation learning paradigm, first trained across millions of proteins from all known protein families and then fine-tuned using LacI experimental data, offers the highest predictive performance of repression function.

42 ENGINEERING↗

Health Assessment and Performance Monitoring of Large Machine Diagnostics

Presentation to be given at the CCS-6 Statistical Seminar Series. Regularly maintained and operated diagnostic machines are a backbone of data collection and are a vital component of the Stockpile Stewardship Program’s efforts to better understand nuclear physics. The Cygnus X-ray machine, stationed at the Nevada National Security Site’s U1a underground facility, is one such diagnostic that provides a radiographic capability for the subcritical experiment program. Component failures within Cygnus can result in catastrophic downtime for the diagnostic, affecting performance, schedules, and cost. However, over the years various measurements have been collected on the two Cygnus axes, including voltage and current measurements at different locations, which we believe have predictive power to indicate machine health. We will share preliminary insight into this data and the machine learning approaches we are taking to assess Cygnus’ health, observe declining performance, and predict failures.

97 MATHEMATICS AND COMPUTING↗

A multi-dimensional parametric study of variability in multi-phase flow dynamics during geologic CO 2 sequestration accelerated with machine learning

Successful geologic CO 2 storage projects depend on numerical simulations to predict reservoir performance during site selection, injection verification, and post-injection monitoring phases of the project. These numerical simulations solve non-linear sets of coupled partial differential equations, while accounting for multi-phase fluid dynamics on the basis of constitutive equations that are embedded into the solution scheme. As a consequence, individual simulations often require tens to hundreds of hours to complete on high-performance computing clusters. Moreover, laboratory experiments reveal that parametric functions for capillary pressure and relative permeability exhibit substantial variability, even within the same rock type. This combination of computational expense and wide-ranging parametric variability means that there remains substantial uncertainty in the behavior of multi-phase CO 2 -water systems, particularly in the context of feedbacks between relative permeability and capillary pressure. To bridge this knowledge gap, here we develop a novel workflow that utilizes physics-based numerical simulation to train an artificial neural network (ANN) emulator for interrogating the multivariate parameter space that governs both capillary pressure and relative permeability. With this approach, the ANN is trained to emulate both fluid pressure distribution and CO 2 saturation, which are then interrogated quantitatively to generate parametric response surface mappings with high-fidelity resolution. Results from this study initially show that capillary entry pressure is the dominant control on both CO 2 plume geometry and fluid pressure propagation when considering the combined effects of capillary pressure and relative permeability, particularly when phase interference is low and residual CO 2 saturation is high. Moreover, the ANN emulator provides tremendous computational speed-up by computing 2691 individual simulations in several minutes; whereas, the same simulation ensemble would have required ~3 years of simulation time using only physics-based simulation methods (25,000 times speed up).

58 GEOSCIENCES↗

Predicting the rheology of limestone calcined clay cements (LC 3 ): Linking composition and hydration kinetics to yield stress through Machine Learning

The physicochemical characteristics of calcined clay influence yield stress of limestone calcined clay cements (LC 3 ), but the independent influences the clay's physical and chemical characteristics as well as the effect of other variables on LC 3 rheology are less well-understood. Further, a relationship between LC 3 hydration kinetics and yield stress – important for informing mixture design – has not yet been established. Here, rheological properties were determined in pastes with varying water-to-solid ratio (w/s), constituent mass ratios (PC:metakaolin:limestone), limestone particle size and gypsum content. From these data, an ML model developed allowed the independent examination of the different mechanisms by which metakaolin fraction influences yield stress of LC 3 , identifying four predictors – packing index, Al 2 O 3 /SO 3 , total particle density and metakaolin fraction relative to limestone (MK/LS) – most significant for predicting LC 3 yield stress. A methodology based on kernel smoothing also identified hydration kinetics parameters best correlated with yield stress.

36 MATERIALS SCIENCE↗

Finite Element Analysis and Machine Learning Guided Design of Carbon Fiber Organosheet-Based Battery Enclosures for Crashworthiness

Carbon fiber composite can be a potential candidate for replacing metal-based battery enclosures of current electric vehicles (E.V.s) owing to its better strength-to-weight ratio and corrosion resistance. However, the strength of carbon fiber-based structures depends on several parameters that should be carefully chosen. Here, in this work, we implemented high throughput finite element analysis (FEA) based thermoforming simulation to virtually manufacture the battery enclosure using different design and processing parameters. Subsequently, we performed virtual crash simulations to mimic a side pole crash to evaluate the crashworthiness of the battery enclosures. This high throughput crash simulation dataset was utilized to build predictive models to understand the crashworthiness of an unknown set. Our machine learning (ML) models showed excellent performance (R 2 > 0.97) in predicting the crashworthiness metrics, i.e., crush load efficiency, absorbed energy, intrusion, and maximum deceleration during a crash. We believe that this FEA-ML work framework will be helpful in down select process parameters for carbon fiber-based component design and can be transferrable to other manufacturing technologies.

36 MATERIALS SCIENCE↗

The drivers and predictability of wildfire re-burns in the western United States (US)

Evidence is mounting that the effectiveness of using prescribed burns as a management tactic may be diminishing due to the higher incidence of wildfire re-burns. The development of predictive models of re-burns is thus essential to better understand their primary drivers so that forest management practices can be updated to account for these events. First, we assess the potential for human activity as a driver of re-burns by evaluating re-burn trends both within and outside of the wildland–urban interface (WUI) of the western US. Next, we investigate the predictability of re-burns through the application of both random forest and the explanatory machine learning non-negative matrix factorization using k-means clustering (NMFk) algorithms to predict re-burn occurrence over California based on a number of climate factors. Our findings indicate that while most states showed increasing trends within the WUI when trends were conducted over longer moving windows (e.g. 20 years), California was the only state where the rate of increase was consistently higher in the WUI, indicating a stronger potential for human activity as a driver in that location. Furthermore, we find model performance was found to be robust over most of California (Testing F1 scores = 0.688), although results were highly variable based on EPA level III Ecoregion (F1 scores = 0.0–0.778). Insights provided from this study will lead to a better understanding of climate and human activity drivers of re-burns and how these vary at broad spatial scales so that improvements in forest management practices can be tuned according to the level of change that is expected for a given region.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning for Thermal Transport Analysis of Aluminum Alloys with Precipitate Morphology

A large number of microstructural parameters and a wide range of transport physics impose challenges on thermal transport analysis of alloy. Herein, modern data science techniques are employed to overcome the challenges, pursuing effective calculation of thermal transport properties. This emerging approach is tested for precipitate-hardened aluminum (Al) alloy with consideration of precipitate morphology. The finite element method (FEM) is employed to create a database of effective thermal conductivity of hypothetical Al alloys with varying precipitate morphological and thermal transport features. Using the FEM-generated data sets, the correlation analysis is conducted to qualitatively evaluate the importance of various precipitate features. The correlation analysis identifies the surface area, average diameter, and volume fraction of precipitates as the most descriptive features for determining the thermal conductivity of alloys. Afterward machine learning (ML) models are trained to accurately predict the effective thermal conductivity. Comparing the ML predictions with effective thermal conductivity and microstructural information from experiments, precipitate thermal transport properties can be calculated, such as interfacial conductance between Al matrix and precipitate, without atomistic simulations. This research demonstrates the feasibility of data-driven approaches for effective thermal transport calculation and the promise of the FEM-generated data analysis for more comprehensive evaluation of metallic alloys.

36 MATERIALS SCIENCE↗