NETL's SmartSearch Deep Learning Tool, Scalable Data Search and Parse for Carbon Storage Data Discovery
NETL's SmartSearch Deep Learning Tool, Scalable Data Search and Parse for Carbon Storage Data Discovery
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
NETL's SmartSearch Deep Learning Tool, Scalable Data Search and Parse for Carbon Storage Data Discovery
We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. Here, the framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.
PolyID enables the discovery of polymers with advanced performance and greater sustainability while reducing material development timelines. The material design space is immense and cannot be reasonably probed using an Edisionian approach. High-throughput property prediction, enabled by artificial intelligence provides a hypothesis driven approach for down selection of candidate polymers to pursue experimentally. To aid experimentalists in the down selection of material targets this high-throughput, machine learning-based tool is capable of predicting polymer properties simply from molecular structures. Currently, transport, thermal, and mechanical properties across 7 polymer class (polyamides, polyesters, polycarbonates, polyimides, polyolefins, polyacrylates, and polyurethanes) can be predicted, and the PolyID platform has been flexibly designed so new materials and properties can be added.
We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure --- this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.
We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.
We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure - this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.
The energy transition still faces a daunting math. Currently, more than three quarters of final energy consumption occurs in form of fuels vs less than one quarter in electricity. On the other hand, renewable energy additions come almost exclusively in the form of electricity (dominantly photovoltaics and wind). Thus, meeting the terawatt challenge requires enormous growth in renewables, sufficient to convert excess electricity into fuels, as well as the development of non-electricity based solar fuel technologies, for example via solar thermochemical routes. In this presentation, we will review successes and challenges in photovoltaic materials from silicon to CdTe to halide perovskites and potential emerging materials, with a particular perspective on the role of first principles calculations and predictions. Materials design and discovery is evolving to incorporate defects, disorder, and interfaces. These phenomena play also an important role in the thermochemical generation of hydrogen, allowing to utilize synergies between renewable electricity and fuels in computational research. At the same time, machine learning approaches are increasingly geared toward properties of non-ideal materials, for example defect formation, allowing the screening for more complex material behavior as needed for the respective applications.
This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a proof-of-concept investigation based on simulated neural dynamics, for which the ground-truth causality is known through the underlying connectivity matrix. For transformer models trained to forecast neuronal population dynamics, we show that the cross-attention module effectively captures the causal relationship among neurons, with an accuracy equal to or superior to that of the most popular Granger causality discovery method. While we acknowledge that real-world neurobiology data will bring further challenges, including dynamic connectivity and unobserved variability, this research offers an encouraging preliminary glimpse into the utility of the transformer model for causal representation learning in neuroscience.
Reprocessing is an important step in the nuclear fuel cycle where usable nuclear materials are extracted from spent fuel for recycling. The extraction of materials for reuse simultaneously reduces not only the volume of nuclear waste, but its decay time to radioactivity levels similar to that of the originating uranium ore. As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is designing and constructing a solvent extraction testbed named Beartooth. Beartooth will allow researchers to refine extraction processes, test innovative extraction processes, and give early career scientists opportunities to gain skills in performing separations chemistry that uses centrifugal contactors. In addition, the Beartooth testbed is being uniquely designed to enable novel technologies including machine learning capabilities for the characterization of chemical process operations in near real-time. To aid in the design of Beartooth, a team of researchers are installing a variety of atypical sensors into a system of contactors for signal discovery. The team will implement machine learning methods on sensor data to determine signal features with the goal of providing a process operator with a deeper understanding of the chemical process and equipment usage. This work will summarize sensors utilized and preliminary results from an infrared camera.
The universe is growing at an accelerated rate, yet the several experiments and science cases used to measure this property yield conflicting results for the rate. Known colloquially as the Hubble tension problem, this discrepancy calls for a novel measurement of the Hubble Constant, H0, in order to be resolved. The Dark Energy Survey Gravitational Wave group (DESGW) aims to relieve this tension by performing a standard sirens measurement of H0 independent of traditional methods. To do so in the current era of data abundance and limited telescope time demands a robust, optimized, and complete science software pipeline to carefully balance the transition from gravitational wave data to state-of-the-art images, images to photometric data, and photometric data to identification and analysis of electromagnetic counterparts to gravitational wave signals. This thesis details the contributions of the author to the DESGW Search & Discovery Pipeline for the fourth observing run of the LIGO/Virgo/KAGRA gravitational wave detector network, as well as the science applications that have been pursued.
The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. Our ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.
Reprocessing is an important step in the nuclear fuel cycle where usable nuclear materials are extracted from used fuel for recycling. The separation of materials for reuse simultaneously reduces not only the volume of nuclear waste, but its decay time to radioactivity levels similar to that of the originating uranium ore. As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is designing and constructing a solvent extraction testbed named Beartooth. This testbed will allow researchers to refine separation processes, test innovative extraction processes, and give early career scientists opportunities to gain skills in performing separations chemistry utilizing centrifugal contactors. In addition, the Beartooth testbed is being uniquely designed to enable novel technologies including machine learning capabilities for the characterization of chemical process operations in near real-time. To aid in the design of Beartooth, a team of researchers are installing a variety of atypical sensors into a system of contactors for signal discovery. The team will implement machine learning methods on acquired sensor data to extract signal features. The goal is to provide a process operator with a deeper understanding of the chemical process and equipment usage. This work will summarize sensors utilized and preliminary results from an infrared camera.
Images are increasingly becoming the currency for documenting biodiversity on the planet, providing novel opportunities for accelerating scientific discoveries in the field of organismal biology, especially with the advent of large vision-language models (VLMs). We ask if pre-trained VLMs can aid scientists in answering a range of biologically relevant questions without any additional fine-tuning. In this paper, we evaluate the effectiveness of 12 state-of-the-art (SOTA) VLMs in the field of organismal biology using a novel dataset, VLM4Bio, consisting of 469K question8 answer pairs involving 30K images from three groups of organisms: fishes, birds, and butterflies, covering five biologically relevant tasks. We also explore the effects of applying prompting techniques and tests for reasoning hallucination on the performance of VLMs, shedding new light on the capabilities of current SOTA VLMs in answering biologically relevant questions using images
Materials are the bedrock of economy and foundation for all real-world technologies. The viability of space travel, grid energy storage, solar to fuels conversion, methane removal, and photovoltaic energy solutions hinge on the discovery and optimization of novel materials and rapid scaling toward manufacturing. The last 20 years have seen an exponential growth in the theoretical predictive capability for crystalline materials and small molecules. However, it is only in the last five years that we have seen the rapid expansion of high-throughput synthesis enabled by laboratory robotics and microfluidics, as well as a resurgence of combinatorial synthesis (Abolhasani and Kumacheva 2023; Epps and Abolhasani 2021; Jiang et al. 2022; Rajan 2008; Soldatov et al. 2021; Szymanski et al. 2023). Combinatorial synthesis, microfluidics, and ultimately dip-pen megalibraries have demonstrated the ability to “write” multicomponent nanomaterials at high throughput scale, generating millions of material examples in the 3D, 4D, and 5D composition spaces (Chen et al. 2016, 2019; Jibril et al. 2022).
On July 4, 2012, scientists at CERN announced the discovery of an essential part of the Standard Model of particle physics: the Higgs boson. The search for the Higgs at experiments at the Large Hadron Collider was an international effort involving thousands of people, with physicists and engineers from US institutions playing a significant role throughout.
Searches for new phenomena in complex scientific data are predominantly model-dependent, optimized for specific hypotheses, and therefore limited in their coverage of the space of possible signals. Recently, new AI-based model-agnostic search strategies, many of which have been pioneered in high-energy physics, have been proposed which provide a complementary paradigm, prioritizing broad exploration over tailored analyses. These techniques offer an opportunity to enhance the overall discovery potential of modern experiments, especially in regimes where theoretical guidance is scarce. In this document, we review the conceptual framework behind the main classes of AI-based model-agnostic strategies. We discuss the potential pitfalls of these methods, and strategies for their validation and interpretation. We aim for this document to serve as a useful reference both for practitioners and for researchers interested in learning more about these model-agnostic search strategies.
The Neutrino Discovery Platform (NDP) aims to accelerate DUNE-era science by making the neutrino program's existing datasets analyzable through fast, reproducible, and auditable workflows. We report a working version of two of its layers, data curation and agentic orchestration, built and tested end to end on MINERvA open data. The guiding lesson throughout is that a cross section is a measurement, and not just a plotted shape, only if it carries a defensible systematic-uncertainty budget, a trustworthy unfolding, and a reproducible record. Using a single medium-energy playlist pair from the MINERvA open-data release (about $2.05\times10^{17}$ protons on target of data), we first reproduced the shapes of two published charged-current inclusive $\nu_\mu$ measurements through a complete extraction ladder: selection, background subtraction, D'Agostini unfolding, efficiency correction, and flux normalization. These shape-level reproductions ran and tracked the published results, but they lacked the systematic-uncertainty machinery that defines a MINERvA cross section. To supply it, we vendored and built the MINERvA Analysis Toolkit and developed a many-universe systematic-uncertainty tool that produces a portable covariance artifact, a parallel event-loop runner, and a per-run auditability harness. Validated against a published covariance release, the toolchain reproduces the released statistical, flux, and muon-energy-scale terms and shows that they account for roughly 63\% of the total variance, with the remainder unreleased. Using this same infrastructure, we then performed a measurement of our own design, the hadronic recoil-energy distribution of low-energy ($E_\nu<2.5$~GeV) charged-current inclusive events, and found data/simulation shape agreement of $\chi^2/\mathrm{ndf}=1.26$. Together these results show that the platform supports original physics and not only reproductions.
Not Available