Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Extreme learning machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Using machine learning to improve land use/cover characterization and projection for scenario-based global modeling

The characterization of the land surface in models is critical for robust estimation of the water cycle and associated extremes. Land use determines water demand, and land cover affects water availability. The interaction between water demand and availability is the key determinant of whether systems are resilient to variability in the overall water cycle. Furthermore, activities such as irrigation and deforestation or afforestation may influence regional to global precipitation patterns, depending on the extent of the activity. Thus this proposed work aims to address the following question: How does integrated land use/cover data and improved land use/cover projection, as informed by machine learning approaches, better resolve human-earth system resilience to water cycle variability and extremes?

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Revealing the Latent Atomic World Through Data-Driven Microscopy

Many emerging technologies depend on the precise design of materials structure, chemistry, and defects. As devices shrink, manufacturing tolerances tighten, and performance envelopes improve, we must increasingly measure and manipulate materials at or near the single atom level. Here we describe how transmission electron microscopy (TEM) underpins our ability to see and direct the latent atomic world. We review a selection of our recent high-resolution TEM studies of the synthesis of oxide-based nanomaterials and their evolution in extreme environments. We then discuss powerful new artificial intelligence (AI) and machine learning (ML) approaches we have developed for rich, reproducible, and scalable experimentation. Furthermore, we conclude by discussing future developments that will enable new materials for breakthrough technologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Quantifying wildfire drivers and predictability in boreal peatlands using a two-step error-correcting machine learning framework in TeFire v1.0

Abstract. Wildfires are becoming an increasing challenge to the sustainability of boreal peatland (BP) ecosystems and can alter the stability of boreal carbon storage. However, predicting the occurrence of rare and extreme BP fires proves to be challenging, and gaining a quantitative understanding of the factors, both natural and anthropogenic, inducing BP fires remains elusive. Here, we quantified the predictability of BP fires and their primary controlling factors from 1997 to 2015 using a two-step correcting machine learning (ML) framework that combines multiple ML classifiers, regression models, and an error-correcting technique. We found that (1) the adopted oversampling algorithm effectively addressed the unbalanced data and improved the recall rate by 26.88 %–48.62 % when using multiple datasets, and the error-correcting technique tackled the overestimation of fire sizes during fire seasons; (2) nonparametric models outperformed parametric models in predicting fire occurrences, and the random forest machine learning model performed the best, with the area under the receiver operating characteristic curve ranging from 0.83 to 0.93 across multiple fire datasets; and (3) four sets of factor-control simulations consistently indicated the dominant role of temperature, air dryness, and climate extreme (i.e., frost) for boreal peatland fires, overriding the effects of precipitation, wind speed, and human activities. Our findings demonstrate the efficiency and accuracy of ML techniques in predicting rare and extreme fire events and disentangle the primary factors determining BP fires, which are critical for predicting future fire risks under climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Predicting oxidation damage in ultra high-temperature borides: A machine learning approach

Ultra-high temperature (UHT) borides are ceramics materials with melting points above 3000 °C for structural applications in extreme environments. However, at temperatures exceeding 1600 °C and under oxidizing conditions, the material suffers from detrimental degradation. Optimized design and performance of diboride materials under such extreme conditions requires filling the missing composition-microstructure-oxidation gap. This study proposes a computational data-driven framework to connect the processing and microstructure of Ultra-high temperature borides with the oxidation damage. Random Forest Regressor (RFR) model is adopted to forecast the oxide scale thickness developed after oxidation testing based on processing variables and microstructural features. The model trained on a dataset consisting of 107 samples of experimental data extracted from the literature aims to predict oxidation damage. With proper data manipulation and fine model tuning, the predictor could forecast the oxide scale thickness of UHT diborides with a Mean Absolute Error of 37.45 μm and an R-square of 0.83. This model could be used as a high-throughput scheme to design and test new UHT diborides materials computationally. Furthermore, a model with larger composition capabilities could also be developed in the future as more experimental data become available.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Using Machine Learning to Predict Cloud Turbulent Entrainment–Mixing Processes

Different turbulent entrainment–mixing mechanisms between clouds and environment are essential to cloud–related processes; however, accurate representation of entrainment–mixing in weather/climate models still poses a challenge. This study exploits the use of machine learning (ML) to address this challenge. Four ML (Light Gradient Boosting Machine [LGB], eXtreme Gradient Boosting, Random Forest, and Support Vector Regression) are examined and compared. It is found that LGB performs best, and thus is selected to understand the impact of entrainment–mixing on microphysics using simulation data from Explicit Mixing Parcel Model. Compared with traditional parameterizations, the trained LGB provides more accurate microphysical properties (number concentration and cloud droplet spectral dispersion). The partial dependences of predicted microphysics on features exhibit a strong alignment with physical mechanisms and expectations, as determined by the interpreting method, thus overcoming the limitations of the “black box” scheme. The underlying mechanisms are that the smaller number concentration and larger spectral dispersion correspond to more inhomogeneous entrainment–mixing. Specifically, number concentration after entrainment–mixing is positively correlated with adiabatic number concentration and liquid water content affected by entrainment–mixing, and inversely correlated with adiabatic volume mean radius. Spectral dispersion after entrainment–mixing is negatively correlated with liquid water content affected by entrainment–mixing, turbulent dissipation rate and relative humidity of entrained air. Sensitivity analysis further suggests that number concentration is mainly determined by cloud microphysical properties whereas spectral dispersion is influenced by both cloud microphysical properties and environmental variables. The results indicate that the LGB scheme has the potential to enhance the representation of entrainment–mixing in weather/climate models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Next-Generation Materials Design: Quantum Mechanics and Data-Driven Modeling

The future of materials design is rapidly advancing through the combination of quantum mechanics and data-driven modeling. These approaches integrate quantum principles with advanced data analysis, enabling precise insights into material behavior. This talk will highlight recent progress in using these methods for computational design, particularly in high-entropy alloy catalysts, emphasizing the role of hierarchical machine-learning architectures for accurate predictions. Additionally, I will discuss our work on developing machine learning interatomic potentials (MLPs) for single-element metals, metal oxides, and alloys under extreme conditions, focusing on melting behavior and phase properties at high temperatures and pressures. We have also refined our MLP models to capture dynamic surface interactions, such as CO2 and CO adsorption on MgO, using both static and molecular dynamics simulations. These models maintain high accuracy while significantly reducing computational costs compared to first-principles calculations. By enabling efficient and accurate simulations, this work supports broader community adoption, optimizes datasets for materials discovery, and extends the accessible time, size, and environmental conditions beyond the limits of experiments and traditional simulations.

machine learning↗
DOE OSTI2020

DFT Accurate Interatomic Potential for Molten NaCl from Machine Learning

Molten alkali chloride salts are a critical component in concentrated solar power and nuclear applications. Despite their ubiquity, the extreme chemical reactivity of molten alkali chlorides at high temperatures has presented a significant challenge in characterizing atomic structures and dynamic properties experimentally. In this work, we we investigate molten NaCl by performing high temperature molecular dynamics simulations using a Gaussian Approximation Potential (GAP) trained on Density Functional Theory (DFT) datasets. Our GAP model, trained with a meager 1000 atomic configurations, arrives at near ab initio accuracy with a mean absolute error of 1.5 meV/atom thus enabling fast analysis of high temperature salt properties on large length (5000 ion pairs) and time (> 1ns) scales currently inaccessible to ab initio simulations. Calculated structure factors and diffusion constants from our GAP model simulations show excellent agreement with experiments. Our results indicate that GAP models are able to capture the many-body interactions required to accurately model ionic-systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Denoising diffusion probabilistic models for generative alloy design

Inverse material design is an extremely challenging optimization task made difficult by, in part, the highly nonlinear relationship linking performance with composition. Quantitative approaches have improved significantly owing to advances in high throughput experimentation and computational thermodynamics. However, existing physics-based tools are mostly forward models; input a chemistry and obtain a prediction. More recently the materials community has leveraged advances in the machine learning community to establish novel inverse design frameworks. Very recently denoising diffusion probabilistic models have been shown to be extremely powerful generators producing synthetic data of various modalities e.g. images, text, audio, tables, etc.. In this work a novel framework for alloy design and optimization is proposed leveraging these class of models. Five key generative tasks are demonstrated (1) unconditional generation (2) composition conditioned generation (3) property conditioned generation (4) multi-feedstock conditioned generation and (5) generative optimization. These methods were tested on three case studies: high entropy alloy design, superalloy binder jet additive manufacturing, and in-situ dual-feedstock wire-arc additive manufacturing. Results indicate that the established models are extremely flexible, expressive, and robust. The architecture’s flexibility and training procedure empower the model to learn complex intra-compositional and composition-property relationships. Furthermore, the probabilistic nature of these models makes them well suited for addressing solution non-uniqueness and tackling uncertainty quantification tasks. While the fidelity and quantity of the underlying training data is paramount, we envision that future alloy design frameworks will make extensive use of these kinds of machine learning models as “search” tools bolstering the utility of experimental and computational approaches.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Earth System Model Improvement Pipeline via Uncertainty Attribution and Active Learning

Primary focal area: 2 (Predictive Modeling via AI): We develop methods to formally quantify uncertainties in Earth System models for the land-atmosphere coupled system. Science Challenge: Earth system models still have significant biases in historical predictions of the intensity and frequency of water cycling extremes (e.g., droughts and flood events), leading to low confidence in future projections. Uncertainties arise from incomplete understanding of land and atmospheric processes, and insufficient observational constraints on model parameters. Many observations, including those from key DOE investments such as ARM and AmeriFlux, are used to evaluate model performance but have not been used to formally quantify model uncertainty because of the expense of running ESM simulations. An efficient pipeline engaging cutting-edge machine learning (ML) and uncertainty quantification (UQ) methods is needed to improve the predictive understanding of water cycle extremes in the Earth system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Cluster Structures with Machine Learning Support in Neutron Star M-R relations

Neutron stars (NS) are compact objects with strong gravitational fields, and a matter composition subject to extreme physical conditions. The properties of strongly interacting matter at ultra-high densities and temperatures impose a big challenge to our understanding and modelling tools. Some difficulties are critical, since one cannot reproduce such conditions in our laboratories or assess them purely from astronomical observations. The information we have about neutron star interiors are often extracted indirectly, e.g., from the star mass-radius relation. The mass and radius are global quantities and still have a significant uncertainty, which leads to great variability in studying the micro-physics of the neutron star interior. This leaves open many questions in nuclear astrophysics and the suitable equation of state (EoS) of NS. Recently, new observations appear to constrain the mass-radius and consequently has helped to close some open questions. In this work, utilizing modern machine learning techniques, we analyze the NS mass-radius (M-R) relationship for a set of EoS containing a variety of physical models. Our objective is to determine patterns through the M-R data analysis and develop tools to understand the EoS of neutron stars in forthcoming works.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

An interpretable machine learning framework to understand bikeshare demand before and during the COVID-19 pandemic in New York City

In recent years, bikesharing systems have become increasingly popular as affordable and sustainable micromobility solutions. Advanced mathematical models such as machine learning are required to generate good forecasts for bikeshare demand. Here, this study proposes a machine learning modeling framework to estimate hourly demand in a large-scale bikesharing system. Two Extreme Gradient Boosting models were developed: one using data from before the COVID-19 pandemic (March 2019 to February 2020) and the other using data from during the pandemic (March 2020 to February 2021). Furthermore, a model interpretation framework based on SHapley Additive exPlanations was implemented. Based on the relative importance of the explanatory variables considered in this study, share of female users and hour of day were the two most important explanatory variables in both models. However, the month variable had higher importance in the pandemic model than in the pre-pandemic model.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Keeping Classified Information Secret in the World of Quantum Computing

Quantum computing is a technology that promises to revolutionize computing by speeding up key computing tasks in are as such as machine learning and solving otherwise intractable problems.Some influential American policymakers, scholars, and analysts are extremely concerned about the effects quantum computing will have on national security. Similar to the way space technology was viewed in the context of the US-Soviet rivalry during the Cold War, scientific advancement in quantum computing is seen as a race with significant national security consequences, particularly in the emerging US-China rivalry.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Reconstruction of Six-Dimensional Phase Space

A phase space is a mathematical representation of all possible physical states of a system. Particle beams at Fermilab exist within a six-dimensional (6D) phase space defined by three positional components, (x, y, z) and three momentum components, (px, py, pz). To reconstruct this space implies taking measurement data from detectors and mapping out particle behavior using computational methods. The beam detectors, however, are only able to detect spatial distribution among the events of the beam, therefore being limited to positional data. Also, due to the vast number of events in a particle beam, it is extremely difficult to analyze and differentiate every single one’s behavior. However, with Machine Learning (ML), which can distinguish between patterns and map out particle behavior more efficiently. We first used the particle beam software, G4beamline, to simulate a 10,000-event muon beam, adjusting parameters such as initial momentum magnitude (p¬0) and virtual detector position. Using ten virtual detectors, we analyzed p0 values such that minimum 9,990 events were analyzed by every detector. We then input the data from these beam simulations to a C++ program, that randomly selects 100 events, and creates a 2D histogram based on spatial distribution, detector position, and event intensity. This process is repeated 100 times to create 100 histograms per p0 value. These images were then input to a modified ResNet18 Convolutional Neural Network (CNN) for training, and to predict p0 from some unseen set of histograms. The model was accurate when trained on momentum increments of 5 MeV/c and provided with denser training samples around highly variable test values. These results displayed machine learning being able to accurately predict p0 from being trained on different particle behaviors.

Shirlee, Jermain [Fermilab]↗
DOE OSTI2021

Characterization of Extreme Hydroclimate Events in Earth System Models using ML/AI

Focal Area(s): (1) We put forward the concepts of data assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization and unsupervised learning applied to downscale information within Earth System Models (ESMs). (2) We discuss predictive modeling through the use of AI techniques and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection) to improve the characterization of extreme hydroclimate events in ESMs. The AI-based models will run five-six order of magnitude times faster, yet will provide similar accuracy, allowing us to provide range bounds on uncertainty faster and thus enabling faster extreme event identification. (3) Further, we consider the insight gleaned from complex data (observed/simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI to improve the characterization of extreme hydroclimate events in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Using machine learning for particle track identification in the CLAS12 detector

Particle track reconstruction is the most computationally intensive process in nuclear physics experiments. Traditional algorithms use a combinatorial approach that exhaustively tests track measurements ("hits") to identify those that form an actual particle trajectory. In this article, we describe the development of four machine learning (ML) models that assist the tracking algorithm by identifying valid track candidates from the measurements in drift chambers. Several types of machine learning models were tested, including: Convolutional Neural Networks (CNN), Multi-Layer Perceptrons (MLP), Extremely Randomized Trees (ERT) and Recurrent Neural Networks (RNN). As a result of this work, an MLP network classifier was implemented as part of the CLAS12 reconstruction software to provide the tracking code with recommended track candidates. The resulting software achieved accuracy of greater than 99% and resulted in an end-to-end speedup of 35% compared to existing algorithms.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

The quenching of galaxies, bulges, and disks since cosmic noon

Here, we present an analysis of the quenching of star formation in galaxies, bulges, and disks throughout the bulk of cosmic history, from z = 2 – 0. We utilise observations from the Sloan Digital Sky Survey and the Mapping Nearby Galaxies at Apache Point Observatory survey at low redshifts. We complement these data with observations from the Cosmic Assembly Near-Infrared Deep Extragalactic Legacy Survey at high redshifts. Additionally, we compare the observations to detailed predictions from the LGalaxies semi-analytic model. To analyse the data, we developed a machine learning approach utilising a Random Forest classifier. We first demonstrate that this technique is extremely effective at extracting causal insight from highly complex and inter-correlated model data, before applying it to various observational surveys. Our primary observational results are as follows: at all redshifts studied in this work, we find bulge mass to be the most predictive parameter of quenching, out of the photometric parameter set (incorporating bulge mass, disk mass, total stellar mass, and B/T structure). Moreover, we also find bulge mass to be the most predictive parameter of quenching in both bulge and disk structures, treated separately. Hence, intrinsic galaxy quenching must be due to a stable mechanism operating over cosmic time, and the same quenching mechanism must be effective in both bulge and disk regions. Despite the success of bulge mass in predicting quenching, we find that central velocity dispersion is even more predictive (when available in spectroscopic data sets). In comparison to the LGalaxies model, we find that all of these observational results may be consistently explained through quenching via preventative ‘radio-mode’ active galactic nucleus feedback. Furthermore, many alternative quenching mechanisms (including virial shocks, supernova feedback, and morphological stabilisation) are found to be inconsistent with our observational results and those from the literature.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

RISE: Reducing I/O Contention in Staging-based Extreme-Scale In-situ Workflows

While in-situ workflow formulations have addressed some of the data-related challenges associated with extreme-scale scientific workflows, these workflows involve complex interactions and different modes of data exchange. In the context of increasing system complexity, such workflows present significant resource management challenges, requiring complex cost-performance tradeoffs. This paper presents RISE, an intelligent staging-based data management middleware, which builds on the DataSpaces framework and performs intelligent scheduling of data management operations to reduce I/O contention. In RISE, data are always written immediately to local buffers to reduce the effect of the transfer impact upon application performance. RISE identifies applications’ data access patterns and moves data towards data consumers only when the network is expected to be idle, reducing the impact of asynchronous background data movement upon critical data read/write requests. Here, we experimentally demonstrate that RISE can take advantage of staging nodes to offload data during writes without degrading application data movement performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

On the frontiers of coupled extreme environments

Coupled extreme environments pose among the highest demands on materials, stressing the limits of temperature, pressure, electric and magnetic fields, atomic displacement rates, and chemical potentials that can be simultaneously sustained. Here, this issue highlights exciting new materials science methods that will enable rapid progress in what has traditionally been the most difficult materials arena. New opportunities in artificial intelligence, multi-physics simulations capabilities, the use of extreme conditions to synthesize novel materials, and our ability to interrogate materials under relevant conditions provide new avenues to understand and design new materials.

36 MATERIALS SCIENCE↗