Engineering Papers⌕ Search

Engineering topics

Jablonka, Kevin Maik

Publications and source records attributed to Jablonka, Kevin Maik.

11 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Assessment of fine-tuned large language models for real-world chemistry and material science applications

The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens doors to a wider chemical audience, as field-specific featurization techniques can be omitted. In this work, we explore the potential and limitations of this approach. We studied the performance of fine-tuning three open-source LLMs (GPT-J-6B, Llama-3.1-8B, and Mistral-7B) for a range of different chemical questions. We benchmark their performances against “traditional” machine learning models and find that, in most cases, the fine-tuning approach is superior for a simple classification problem. Depending on the size of the dataset and the type of questions, we also successfully address more sophisticated problems. The most important conclusions of this work are that, for all datasets considered, their conversion into an LLM fine-tuning training set is straightforward and that fine-tuning with even relatively small datasets leads to predictive models. These results suggest that the systematic use of LLMs to guide experiments and simulations will be a powerful technique in any research study, significantly reducing unnecessary experiments or computations.

Van Herck, Joren↗
DOE OSTI2024

Prioritizing Mentorship as Scientific Leaders

Scientific careers are rarely straight paths. This article emphasizes the crucial role of mentorship in navigating scientific careers and sustaining innovation in STEMM fields. Effective mentorship can have a positive impact on graduate students' research productivity, research self-efficacy, degree completion, and program satisfaction. Despite its importance, mentorship is often an overlooked and underappreciated component of scientific training. As members of the 2022 CAS Future Leaders class, representing ten countries and various chemistry subdisciplines, we share our mentorship experiences to suggest actions to promote healthy and inclusive mentor-mentee relationships in chemistry. The article explores the importance of mentorship, outlines impactful strategies, and offers insights into how to create a scientific community that values and prioritizes effective mentorship.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Using genetic algorithms to systematically improve the synthesis conditions of Al-PMOF

The synthesis of metal-organic frameworks (MOFs) is often complex and the desired structure is not always obtained. In this work, we report a methodology that uses a joint machine learning and experimental approach to optimize the synthesis conditions of Al-PMOF (Al 2 (OH) 2 TCPP) [H 2 TCPP = meso-tetra(4-carboxyphenyl)porphine], a promising material for carbon capture applications. Al-PMOF was previously synthesized using a hydrothermal reaction, which gave a low throughput yield due to its relatively long reaction time (16 hours). Here, we use a genetic algorithm to carry out a systematic search for the optimal synthesis conditions and a microwave-based high-throughput robotic platform for the syntheses. We show that, in just two generations, we could obtain excellent crystallinity and yield close to 80% in a much shorter reaction time (50 minutes). Moreover, by analyzing the failed and partially successful experiments, we could identify the most important experimental variables that determine the crystallinity and yield.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Bias free multiobjective active learning for materials design and discovery

The design rules for materials are clear for applications with a single objective. For most applications, however, there are often multiple, sometimes competing objectives where there is no single best material and the design rules change to finding the set of Pareto optimal materials. In this work, we leverage an active learning algorithm that directly uses the Pareto dominance relation to compute the set of Pareto optimal materials with desirable accuracy. We apply our algorithm to de novo polymer design with a prohibitively large search space. Using molecular simulations, we compute key descriptors for dispersant applications and drastically reduce the number of materials that need to be evaluated to reconstruct the Pareto front with a desired confidence. This work showcases how simulation and machine learning techniques can be coupled to discover materials within a design space that would be intractable using conventional screening approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A reproducibility study of "Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Space"

Nigam et al. reported a genetic algorithm (GA) utilizing the SELFIES representation and also propose an adaptive, neural network-based penalty that is supposed to improve the diversity of the generated molecules. The main claims of the paper are that this GA outperforms other generative techniques (as measured by the penalized logP) and that a neural network-based adaptive penalty increases the diversity of the generated molecules. In this work, we investigated the reproducibility of their claims. Overall, we were able to reproduce comparable results using the SELFIES-based GA, but mostly by exploiting deficiencies of the (easily optimizable) fitness function (i.e., generating long, sulfur containing chains). In addition, we reproduce results showing that the discriminator can be used to bias the generation of molecules to ones that are similar to the reference set. Lastly, we attempted to quantify the evolution of the diversity, understand the influence of some hyperparameters, and propose improvements to the adaptive penalty.

Jablonka, Kevin Maik↗
DOE OSTI2020

A data-driven perspective on the colours of metal–organic frameworks

Colour is at the core of chemistry and has been fascinating humans since ancient times. It is also a key descriptor of optoelectronic properties of materials and is often used to assess the success of a synthesis. However, predicting the colour of a material based on its structure is challenging. In this work, we leverage subjective and categorical human assignments of colours to build a model that can predict the colour of compounds on a continuous scale. In the process of developing the model, we also uncover inadequacies in current reporting mechanisms. For example, we show that the majority of colour assignments are subject to perceptive spread that would not comply with common printing standards. To remedy this, we suggest and implement an alternative way of reporting colour—and chemical data in general. All data is captured in an objective, and standardised, form in an electronic lab notebook and subsequently automatically exported to a repository in open formats, from where it can be interactively explored by other researchers. We envision this to be key for a data-driven approach to chemical research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

The Role of Machine Learning in the Understanding and Design of Materials

Developing algorithmic approaches for the rational design and discovery of materials can enable us to systematically find novel materials, which can have huge technological and social impact. However, such rational design requires a holistic perspective over the full multistage design process, which involves exploring immense materials spaces, their properties, and process design and engineering as well as a techno-economic assessment. The complexity of exploring all of these options using conventional scientific approaches seems intractable. Instead, novel tools from the field of machine learning can potentially solve some of our challenges on the way to rational materials design. Here we review some of the chief advancements of these methods and their applications in rational materials design, followed by a discussion on some of the main challenges and opportunities we currently face together with our perspective on the future of rational materials design and discovery.

36 MATERIALS SCIENCE↗