Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Extreme learning machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Denoising diffusion probabilistic models for generative alloy design

Inverse material design is an extremely challenging optimization task made difficult by, in part, the highly nonlinear relationship linking performance with composition. Quantitative approaches have improved significantly owing to advances in high throughput experimentation and computational thermodynamics. However, existing physics-based tools are mostly forward models; input a chemistry and obtain a prediction. More recently the materials community has leveraged advances in the machine learning community to establish novel inverse design frameworks. Very recently denoising diffusion probabilistic models have been shown to be extremely powerful generators producing synthetic data of various modalities e.g. images, text, audio, tables, etc.. In this work a novel framework for alloy design and optimization is proposed leveraging these class of models. Five key generative tasks are demonstrated (1) unconditional generation (2) composition conditioned generation (3) property conditioned generation (4) multi-feedstock conditioned generation and (5) generative optimization. These methods were tested on three case studies: high entropy alloy design, superalloy binder jet additive manufacturing, and in-situ dual-feedstock wire-arc additive manufacturing. Results indicate that the established models are extremely flexible, expressive, and robust. The architecture’s flexibility and training procedure empower the model to learn complex intra-compositional and composition-property relationships. Furthermore, the probabilistic nature of these models makes them well suited for addressing solution non-uniqueness and tackling uncertainty quantification tasks. While the fidelity and quantity of the underlying training data is paramount, we envision that future alloy design frameworks will make extensive use of these kinds of machine learning models as “search” tools bolstering the utility of experimental and computational approaches.

36 MATERIALS SCIENCE↗

Earth System Model Improvement Pipeline via Uncertainty Attribution and Active Learning

Primary focal area: 2 (Predictive Modeling via AI): We develop methods to formally quantify uncertainties in Earth System models for the land-atmosphere coupled system. Science Challenge: Earth system models still have significant biases in historical predictions of the intensity and frequency of water cycling extremes (e.g., droughts and flood events), leading to low confidence in future projections. Uncertainties arise from incomplete understanding of land and atmospheric processes, and insufficient observational constraints on model parameters. Many observations, including those from key DOE investments such as ARM and AmeriFlux, are used to evaluate model performance but have not been used to formally quantify model uncertainty because of the expense of running ESM simulations. An efficient pipeline engaging cutting-edge machine learning (ML) and uncertainty quantification (UQ) methods is needed to improve the predictive understanding of water cycle extremes in the Earth system.

54 ENVIRONMENTAL SCIENCES↗

Cluster Structures with Machine Learning Support in Neutron Star M-R relations

Neutron stars (NS) are compact objects with strong gravitational fields, and a matter composition subject to extreme physical conditions. The properties of strongly interacting matter at ultra-high densities and temperatures impose a big challenge to our understanding and modelling tools. Some difficulties are critical, since one cannot reproduce such conditions in our laboratories or assess them purely from astronomical observations. The information we have about neutron star interiors are often extracted indirectly, e.g., from the star mass-radius relation. The mass and radius are global quantities and still have a significant uncertainty, which leads to great variability in studying the micro-physics of the neutron star interior. This leaves open many questions in nuclear astrophysics and the suitable equation of state (EoS) of NS. Recently, new observations appear to constrain the mass-radius and consequently has helped to close some open questions. In this work, utilizing modern machine learning techniques, we analyze the NS mass-radius (M-R) relationship for a set of EoS containing a variety of physical models. Our objective is to determine patterns through the M-R data analysis and develop tools to understand the EoS of neutron stars in forthcoming works.

79 ASTRONOMY AND ASTROPHYSICS↗

An interpretable machine learning framework to understand bikeshare demand before and during the COVID-19 pandemic in New York City

In recent years, bikesharing systems have become increasingly popular as affordable and sustainable micromobility solutions. Advanced mathematical models such as machine learning are required to generate good forecasts for bikeshare demand. Here, this study proposes a machine learning modeling framework to estimate hourly demand in a large-scale bikesharing system. Two Extreme Gradient Boosting models were developed: one using data from before the COVID-19 pandemic (March 2019 to February 2020) and the other using data from during the pandemic (March 2020 to February 2021). Furthermore, a model interpretation framework based on SHapley Additive exPlanations was implemented. Based on the relative importance of the explanatory variables considered in this study, share of female users and hour of day were the two most important explanatory variables in both models. However, the month variable had higher importance in the pandemic model than in the pre-pandemic model.

99 GENERAL AND MISCELLANEOUS↗

Data-Driven Study of Shape Memory Behavior of Multi-Component Ni-Ti Alloys

Ni-Ti based shape memory alloys (SMAs) have found wide-spread use in aerospace, automotive, biomedical, and commercial applications owing to their favorable properties and ease of operation. Especially important for many NASA applications is the ability to tune the martensitic transformation temperature of Ni-Ti alloys by varying the alloy composition and processing conditions. Recently, researchers at NASA have compiled an extensive database of shape memory properties of materials, including over 8,000 multi-component Ni-Ti alloys containing 37 different alloying elements. Using this dataset, machine learning models are trained to predict transformation temperatures, hysteresis, and transformation strain with extremely low mean absolute errors. These models are used to learn relationships between shape memory behavior and input parameters in the composition and processing space. ML predictions are validated through new experiments. The combination of an extensive experimental dataset and accurate learning models, together, make our approach highly suitable for the rapid discovery and design of novel SMAs with targeted properties. We are not aware of any current approaches capable of predicting SMA transformation behavior over such a wide range of compositions and processing conditions.

Shape memory alloys↗

Data-Driven Study of Shape Memory Behavior of Multi-component Ni-Ti Alloys

Ni-Ti based shape memory alloys (SMAs) have found wide-spread use in aerospace, automotive, biomedical, and commercial applications owing to their favorable properties and ease of operation. Especially important for many NASA applications is the ability to tune the martensitic transformation temperature of Ni-Ti alloys by varying the composition and processing conditions. Recently, researchers at NASA have compiled an extensive database of shape memory properties of materials, including over 8,000 multi-component Ni-Ti alloys containing 37 different alloying elements. Using this dataset, machine learning models are trained to predict transformation temperatures, hysteresis, and transformation strain with extremely small errors. These models are used to learn relationships between shape memory behavior and input parameters in the composition and processing space. ML predictions are validated through new experiments. The combination of an extensive dataset and accurate learning models, together, make our approach highly suitable for the rapid discovery of novel SMAs with targeted properties.

Shape Memory Alloys↗

Keeping Classified Information Secret in the World of Quantum Computing

Quantum computing is a technology that promises to revolutionize computing by speeding up key computing tasks in are as such as machine learning and solving otherwise intractable problems.Some influential American policymakers, scholars, and analysts are extremely concerned about the effects quantum computing will have on national security. Similar to the way space technology was viewed in the context of the US-Soviet rivalry during the Cold War, scientific advancement in quantum computing is seen as a race with significant national security consequences, particularly in the emerging US-China rivalry.

97 MATHEMATICS AND COMPUTING↗

Reconstruction of Six-Dimensional Phase Space

A phase space is a mathematical representation of all possible physical states of a system. Particle beams at Fermilab exist within a six-dimensional (6D) phase space defined by three positional components, (x, y, z) and three momentum components, (px, py, pz). To reconstruct this space implies taking measurement data from detectors and mapping out particle behavior using computational methods. The beam detectors, however, are only able to detect spatial distribution among the events of the beam, therefore being limited to positional data. Also, due to the vast number of events in a particle beam, it is extremely difficult to analyze and differentiate every single one’s behavior. However, with Machine Learning (ML), which can distinguish between patterns and map out particle behavior more efficiently. We first used the particle beam software, G4beamline, to simulate a 10,000-event muon beam, adjusting parameters such as initial momentum magnitude (p¬0) and virtual detector position. Using ten virtual detectors, we analyzed p0 values such that minimum 9,990 events were analyzed by every detector. We then input the data from these beam simulations to a C++ program, that randomly selects 100 events, and creates a 2D histogram based on spatial distribution, detector position, and event intensity. This process is repeated 100 times to create 100 histograms per p0 value. These images were then input to a modified ResNet18 Convolutional Neural Network (CNN) for training, and to predict p0 from some unseen set of histograms. The model was accurate when trained on momentum increments of 5 MeV/c and provided with denser training samples around highly variable test values. These results displayed machine learning being able to accurately predict p0 from being trained on different particle behaviors.

Shirlee, Jermain [Fermilab]↗

Characterization of Extreme Hydroclimate Events in Earth System Models using ML/AI

Focal Area(s): (1) We put forward the concepts of data assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization and unsupervised learning applied to downscale information within Earth System Models (ESMs). (2) We discuss predictive modeling through the use of AI techniques and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection) to improve the characterization of extreme hydroclimate events in ESMs. The AI-based models will run five-six order of magnitude times faster, yet will provide similar accuracy, allowing us to provide range bounds on uncertainty faster and thus enabling faster extreme event identification. (3) Further, we consider the insight gleaned from complex data (observed/simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI to improve the characterization of extreme hydroclimate events in ESMs.

54 ENVIRONMENTAL SCIENCES↗

Using machine learning for particle track identification in the CLAS12 detector

Particle track reconstruction is the most computationally intensive process in nuclear physics experiments. Traditional algorithms use a combinatorial approach that exhaustively tests track measurements ("hits") to identify those that form an actual particle trajectory. In this article, we describe the development of four machine learning (ML) models that assist the tracking algorithm by identifying valid track candidates from the measurements in drift chambers. Several types of machine learning models were tested, including: Convolutional Neural Networks (CNN), Multi-Layer Perceptrons (MLP), Extremely Randomized Trees (ERT) and Recurrent Neural Networks (RNN). As a result of this work, an MLP network classifier was implemented as part of the CLAS12 reconstruction software to provide the tracking code with recommended track candidates. The resulting software achieved accuracy of greater than 99% and resulted in an end-to-end speedup of 35% compared to existing algorithms.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The quenching of galaxies, bulges, and disks since cosmic noon

Here, we present an analysis of the quenching of star formation in galaxies, bulges, and disks throughout the bulk of cosmic history, from z = 2 – 0. We utilise observations from the Sloan Digital Sky Survey and the Mapping Nearby Galaxies at Apache Point Observatory survey at low redshifts. We complement these data with observations from the Cosmic Assembly Near-Infrared Deep Extragalactic Legacy Survey at high redshifts. Additionally, we compare the observations to detailed predictions from the LGalaxies semi-analytic model. To analyse the data, we developed a machine learning approach utilising a Random Forest classifier. We first demonstrate that this technique is extremely effective at extracting causal insight from highly complex and inter-correlated model data, before applying it to various observational surveys. Our primary observational results are as follows: at all redshifts studied in this work, we find bulge mass to be the most predictive parameter of quenching, out of the photometric parameter set (incorporating bulge mass, disk mass, total stellar mass, and B/T structure). Moreover, we also find bulge mass to be the most predictive parameter of quenching in both bulge and disk structures, treated separately. Hence, intrinsic galaxy quenching must be due to a stable mechanism operating over cosmic time, and the same quenching mechanism must be effective in both bulge and disk regions. Despite the success of bulge mass in predicting quenching, we find that central velocity dispersion is even more predictive (when available in spectroscopic data sets). In comparison to the LGalaxies model, we find that all of these observational results may be consistently explained through quenching via preventative ‘radio-mode’ active galactic nucleus feedback. Furthermore, many alternative quenching mechanisms (including virial shocks, supernova feedback, and morphological stabilisation) are found to be inconsistent with our observational results and those from the literature.

79 ASTRONOMY AND ASTROPHYSICS↗

RISE: Reducing I/O Contention in Staging-based Extreme-Scale In-situ Workflows

While in-situ workflow formulations have addressed some of the data-related challenges associated with extreme-scale scientific workflows, these workflows involve complex interactions and different modes of data exchange. In the context of increasing system complexity, such workflows present significant resource management challenges, requiring complex cost-performance tradeoffs. This paper presents RISE, an intelligent staging-based data management middleware, which builds on the DataSpaces framework and performs intelligent scheduling of data management operations to reduce I/O contention. In RISE, data are always written immediately to local buffers to reduce the effect of the transfer impact upon application performance. RISE identifies applications’ data access patterns and moves data towards data consumers only when the network is expected to be idle, reducing the impact of asynchronous background data movement upon critical data read/write requests. Here, we experimentally demonstrate that RISE can take advantage of staging nodes to offload data during writes without degrading application data movement performance.

97 MATHEMATICS AND COMPUTING↗

On the frontiers of coupled extreme environments

Coupled extreme environments pose among the highest demands on materials, stressing the limits of temperature, pressure, electric and magnetic fields, atomic displacement rates, and chemical potentials that can be simultaneously sustained. Here, this issue highlights exciting new materials science methods that will enable rapid progress in what has traditionally been the most difficult materials arena. New opportunities in artificial intelligence, multi-physics simulations capabilities, the use of extreme conditions to synthesize novel materials, and our ability to interrogate materials under relevant conditions provide new avenues to understand and design new materials.

36 MATERIALS SCIENCE↗

The LSST AGN Data Challenge: Selection Methods

Abstract Development of the Rubin Observatory Legacy Survey of Space and Time (LSST) includes a series of Data Challenges (DCs) arranged by various LSST Scientific Collaborations that are taking place during the project's preoperational phase. The AGN Science Collaboration Data Challenge (AGNSC-DC) is a partial prototype of the expected LSST data on active galactic nuclei (AGNs), aimed at validating machine learning approaches for AGN selection and characterization in large surveys like LSST. The AGNSC-DC took place in 2021, focusing on accuracy, robustness, and scalability. The training and the blinded data sets were constructed to mimic the future LSST release catalogs using the data from the Sloan Digital Sky Survey Stripe 82 region and the XMM-Newton Large Scale Structure Survey region. Data features were divided into astrometry, photometry, color, morphology, redshift, and class label with the addition of variability features and images. We present the results of four submitted solutions to DCs using both classical and machine learning methods. We systematically test the performance of supervised models (support vector machine, random forest, extreme gradient boosting, artificial neural network, convolutional neural network) and unsupervised ones (deep embedding clustering) when applied to the problem of classifying/clustering sources as stars, galaxies, or AGNs. We obtained classification accuracy of 97.5% for supervised models and clustering accuracy of 96.0% for unsupervised ones and 95.0% with a classic approach for a blinded data set. We find that variability features significantly improve the accuracy of the trained models, and correlation analysis among different bands enables a fast and inexpensive first-order selection of quasar candidates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Knowledge Graph Framework for Organizing Heterogeneous Datasets for Utilization in Classical and Quantum Computing: Current Challenges and Future Directions

"The escalating impact of climate change induced extreme weather events in urban, suburban, and rural environments demands a rethink of how we have been using the single event-based or use-case-based knowledge graph models. The lack of representation in interaction within environmental variables found in literature led to the development of a novel framework that reflects the true nature of the interconnectedness in our environment. We propose an Environmental Interaction Knowledge Graph (EIKG) framework. This general EIKG framework works as the basis for interconnected environmental events by knitting interrelated events such as hurricanes leading to storm surges, which lead to flood events that could cause mudslides, landslides, etc., The cascading nature of one event leading to another related event in the environment requires an adequate understanding of each event using contextual information before conducting any data-driven analytics. This vision paper showcases how the EIKG:floods, EIKG:wildfire EIKG:landslides, etc, can be derived from a base case framework of EIKG as those individual events are interconnected with some common denominator variables. As an example, the precipitation variable is used in the flood case study as well as in the wildfire case study, as excessive precipitation levels lead to floods, and lack of precipitation leads to droughts and wildfires. We identify the precipitation variable as a “common-denominator-variable” in extreme weather events that play a key role in modeling the environment leading to different extreme weather events based on the variability of that variable (varying values where low precipitation leads to drought, and high values lead to floods). We use the insights gained from EIKG to conduct classical and Quantum Machine Learning (QML) based data analysis on the research questions developed. Our preliminary study shows how the Variational Quantum Classifier (VQC) and Quantum Support Vector Classifier (QSVC) are used along with the classical machine learning models to compare the model accuracies. Our study elaborates on how a quantitative analysis uses state-of-the-art machine learning techniques that include implementing both classical and quantum machine learning models and developing the knowledge graph. The EIKG is used to organize heterogeneous datasets and integrate the relations to case-specific extreme weather events such as floods. The study uses datasets such as county-to-country residential mobility data, socioeconomic datasets from the US Census Bureau, climate and weather-related Earth Observational data from NASA, and critical infrastructure data from the Homeland Infrastructure datasets."

Knowledge Graphs, Quantum Computing, Heterogenous ↗

Genome-Wide Analysis of RNA Decay in the Cyanobacterium Synechococcus sp. Strain PCC 7002

ABSTRACT RNA degradation is an important process that influences the ultimate concentration of individual proteins inside cells. While the main enzymes that facilitate this process have been identified, global maps of RNA turnover are available for only a few species. Even in these cases, there are few sequence elements that are known to enhance or destabilize a native transcript; even fewer confer the same effect when added to a heterologous transcript. To address this knowledge gap, we assayed genome-wide RNA degradation in the cyanobacterium Synechococcus sp. strain PCC 7002 by collecting total RNA samples after stopping nascent transcription with rifampin. We quantified the abundance of each position in the transcriptome as a function of time using RNA-sequencing data and later analyzed the global mRNA decay map using machine learning principles. Half-lives, calculated on a per-ORF (open reading frame) basis, were extremely short, with a median half-life of only 0.97 min. Despite extremely rapid turnover of most mRNA, transcripts encoding proteins involved in photosynthesis were both highly expressed and highly stable. Upon inspection of these stable transcripts, we identified an enriched motif in the 3′ untranslated region (UTR) that had similarity to Rho-independent terminators. We built statistical models for half-life prediction and used them to systematically identify sequence motifs in both 5′ and 3′ UTRs that correlate with stabilized transcripts. We found that transcripts linked to a terminator containing a poly(U) tract had a longer half-life than both those without a poly(U) tract and those without a terminator. IMPORTANCE RNA degradation is an important process that affects the final concentration of individual mRNAs, affecting protein expression and cellular physiology. Studies of how RNA is degraded increase our knowledge of this fundamental process as well as enable the creation of genetic tools to manipulate RNA stability. By studying global transcript turnover, we searched for sequence elements that correlated with transcript (in)stability and used these sequences to guide tool design. This study probes global RNA turnover in a cyanobacterium, Synechococcus sp. strain PCC 7002, that both has a unique array of RNases that facilitate RNA degradation and is an industrially relevant strain that could be used to convert CO 2 and sunlight into useful products.

59 BASIC BIOLOGICAL SCIENCES↗

Automation is all you need: Faster Earth system models with AI/ML

Focal Area: Data acquisition and assimilation enabled by machine learning (ML), artificial intelligence (AI) and advanced methods. Science Challenge: Tropical cyclones can in- duce extreme water cycle events through dramatic precipitation and storm surge. More reliable models of intensity will translate into better prediction of the impact of extreme events in large scale Earth systems simulations. We demonstrate and describe AI/ML methodologies for rapid assimilation of new, in situ data products.

54 ENVIRONMENTAL SCIENCES↗

A tale of two extremes: Temperature sensitivity of carbon loss from cool and hot soils

Soils represent the largest terrestrial carbon (C) pool, and the flux of carbon dioxide (CO 2 ) from soils to the atmosphere is ~ 6-10 times more than anthropogenic emissions. Understanding responses of soil CO 2 emissions to warming is crucial for evaluating feedback to ongoing environmental changes. The relationship between microbial respiration and temperature is typically modeled using a Q 10 function. Generally, observations of the apparent Q 10 of soil respiration are higher for cold vs. warm ecosystems, reflecting expected biophysical controls of Arrhenius kinetics. However, results from two field warming experiments in the tropics contradict this expectation, both observing extraordinarily high soil respiration responses to in situ warming. Our overall objective for the proposed work is to reduce uncertainty in temperature sensitivity of soil C loss by systematically synthesizing underlying mechanisms related to soil C turnover and stabilization. We are evaluating the temperature sensitivity of soil respiration in ecosystems across temperature extremes (e.g., arctic/boreal and tropical systems) by integrating data collected from field warming experiments with machine learning and biogeochemical models.

54 ENVIRONMENTAL SCIENCES↗