Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “LLM”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Effect of Sample Mass, Confinement, and Preheating Time on the Thermal Response of LLM‐105: Experiments and Kinetic Analysis

Various small-scale experiments were performed to provide data for developing a model to predict the thermal response of LLM-105 over a wide range of conditions. The thermal decomposition of LLM-105 was studied as a function of sample mass, confinement of volatile products, and preheating time in both isothermal and ramped heating experiments. The thermal decomposition of LLM-105 is a two-step process, as shown by the two exothermic peaks in the heat flow profiles, which were fitted to two nth-order autocatalytic reaction models with a similar activation energy of ∼289 kJ/mol. The magnitude and shape of these peaks varied with sample mass and confinement. Increasing sample mass enhanced the second exotherm with respect to the first one, while increasing the level of confinement promoted a transition from a sublimation-dominated regime towards thermal decomposition. The effect of LLM-105 particle size on the rate of weight loss was evident for open-pan experiments, where bigger particles sublimed at lower temperatures than smaller particles. Thermal response and solid residue composition of LLM-105 samples were analyzed following preheating for different durations. Longer preheating times caused a shift of the second exotherm to lower temperatures and a decrease in the reaction enthalpy, confirming that LLM-105 decay is a consecutive reaction mechanism, probably autocatalytic. In conclusion, the kinetic model derived from ramped experiments was validated against the measured LLM-105 fraction remaining and the enthalpy remaining of the solid residue as a function of preheating times and showed good agreement.

Chemistry - Chemical explosives↗

An isotopic labeling investigation into the influence of the nitro group on LLM-105 thermal decomposition

Here, this work presents the first application of isotopically labeled LLM-105 (2,6-diamino-3,5-dinitropyrazine-1-oxide) to investigate thermal decomposition pathways. Specially synthesized LLM-105 isotopologues were utilized to isolate the influence of labeled 15 NO 2 nitro groups on the formation of lightgas products. Simultaneous differential scanning calorimetry, thermo-gravimetric, and mass spectrometry measurements were employed to track the evolution of product gases, enabling the direct comparison of isotopically shifted species with unlabeled LLM-105. Key findings show that C 2 N 2 production is mainly dependent on nitrogen sources from either the amine groups or the pyrazine ring (i.e., not the nitro groups). The formation of NO, N 2 , and N 2 O all involves the nitro groups to some extent. NO (nitric oxide) was found to be the predominant gas species directly formed from the nitro group of LLM-105. In contrast, mixed nitrogen isotopologues of N 2 and N 2 O (i.e., 14 N 15 N and 15 NNO) formed more readily in comparison to their pure counterparts (i.e., 15 N 2 and 15 N 2 O). This indicates the amine and/or pyrazine groups of LLM-105, in addition to the nitro group, are involved in the decomposition pathways forming N 2 and N 2 O. In addition, our investigation led to the discovery of two previously unreported decomposition products (CHO and HNCO), which were confirmed through hydrogen labelling utilizing deuterium isotopes. These results provide detailed speciation trends of gaseous products during LLM-105 decomposition, offering new insights into reaction pathways. Experimental data reported here will support the development of a detailed chemical kinetics model for LLM-105, essential for the safe handling of high explosives.

Chemistry - Chemical explosives↗

Oxadiazole-based Heterocycles as Building Block for Material Property Control: Design, Synthesis, and Characterization of 3,4-Bis(3-(4-nitro-1,2,5-oxadiazol-3-yl)- 1,2,4-oxadiazol-5-yl)-1,2,5-oxadiazole (LLM-210)

This paper presents an approach to novel oxadiazole-based melt-castable energetic material, LLM-210. Used in pour-in process and 3D printing, melt-castable energetic materials (MCEM) must possess required physical and safety properties of industry-standard energetic materials, also a narrow range of melting point between 80-100 °C. Melting point is difficult to accurately predict, therefore, searching for MCEM is challenging. 3,4-Bis(5-(4-nitro-1,2,5-oxadiazol-3-yl)-1,2,4-oxadiazol3-yl)-1,2,5-oxadiazole (LLM-205), composed of five-oxadiazole rings allied via carbon-carbon bonds, was selected as new MCEM candidate. The target molecule was synthesized and characterized, showing a density of 1.807g/cm3 ; thermal decomposing temperature at 299 °C; and insensitive to external stimuli, but the melting point of 104 °C was out of the rang. Based on the molecular properties and ab initio calculations, 3,4-bis(3-(4-nitro-1,2,5-oxadiazol-3-yl)-1,2,4-oxadiazol-5-yl)- 1,2,5-oxadiazole (LLM-210), an isomer of LLM-205, was designed and synthesized from a different way. LLM-210 was characterized as MCEM, possessing melting point of 87 °C; density of 1.812 g/cm3 ; and exothermally decomposing temperature at 314 °C; being insensitive to external stimuli. In this study, the relationship of molecular structure to properties of LLM-205 and LLM-210 based on the results of Density Functional Theory (DFT) and X-ray crystallographic analysis is also briefly discussed.

Chemistry - Chemical explosives↗

Expert evaluation of LLM world models: A high-T c superconductivity case study

Large Language Models (LLMs) show great promise as a powerful tool for scientific literature exploration. However, their effectiveness in providing scientifically accurate and comprehensive answers to complex questions within specialized domains remains an active area of research. Using the field of high-temperature cuprates as an exemplar, we evaluate the ability of LLM systems to understand the literature at the level of an expert. We construct an expert-curated database of 1,726 scientific papers that covers the history of the field, and a set of 67 expert-formulated questions that probe deep understanding of the literature. We then evaluate six different LLM-based systems for answering these questions, including both commercially available closed models and a custom retrieval-augmented generation (RAG) system capable of retrieving images alongside text. Experts then evaluate the answers of these systems against a rubric that assesses balanced perspectives, factual comprehensiveness, succinctness, and evidentiary support. Among the six systems, two using RAG on curated literature outperformed existing closed models across key metrics, particularly in providing comprehensive and well-supported answers. We discuss promising aspects of LLM performances as well as critical short-comings of all the models. The set of expert-formulated questions and the rubric will be valuable for assessing expert level performance of LLM based reasoning systems.

36 MATERIALS SCIENCE↗

Open giant magnons on LLM geometries

We compute sigma model solutions for rigidly rotating open strings suspended between giant gravitons in general LLM geometries. These solutions are confined to the LLM plane. These all have a dispersion relation for Δ - J that is consistent with saturation of a BPS bound of the centrally extended spin chain. For the special case of circularly symmetric LLM geometries, we can further evaluate the amount of angular momentum J carried by these strings. This quantity diverges for string configurations that try to move between different “coloring regions” in the LLM plane. All of these quantities have a perturbative expansion in the t’Hooft coupling. For the strings suspended between AdS giants, we can compute in field theory the leading result of J carried by the string via an analytic continuation of the SU(2) result, with the help of the Bethe Ansatz for the SL(2) sector. We thus provide additional information on how the radial direction of AdS arises from (open) spin chain calculations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Chaotic LLM billiards

Abstract We study null geodesics of the ten-dimensional LLM geometries. In particular, we show that there are a subset of these null geodesics that are confined to the LLM plane. The effective dynamics of these in-plane geodesics is that of a Hamiltonian system with two degrees of freedom (a phase space of dimension 4). We show that these are chaotic. In the two-coloring of the LLM plane, if they start in the empty region, they cannot penetrate the filled region and viceversa. The dynamical problem is therefore very similar to that of a billiards problem with fixed obstacles. We study to what extent LLM geometries with many droplets may be treated as an incipient black hole and draw analogies with the fuzzball proposal. We argue that for in-plane null geodesics deep in the interior of a region with a lot of droplets, in order to exit towards theAdSboundary they will need to undergo a process that resembles diffusion. This mechanism can account for signals getting lost in the putative black hole for a very long time.

Physics↗

Predicted Reaction Mechanisms, Product Speciation, Kinetics, and Detonation Properties of the Insensitive Explosive 2,6-Diamino-3,5-dinitropyrazine-1-oxide (LLM-105)

2,6-Diamino-3,5-dinitropyrazine-1-oxide (LLM-105) is a relatively new and promising insensitive high-explosive (IHE) material that remains only partially characterized. IHEs are of interest for a range of applications and from a fundamental science standpoint, as the root causes behind insensitivity are poorly understood. In this work, we adopt a multitheory approach based on reactive molecular dynamic simulations performed with density functional theory, density functional tight-binding, and reactive force fields to characterize the reaction pathways, product speciation, reaction kinetics, and detonation performance of LLM-105. We compare and contrast these predictions to 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a prototypical IHE, and 1,3,5,7-tetranitro-1,3,5,7-tetrazoctane (HMX), a more sensitive and higher performance material. The combination of different predictive models allows access to processes operative on progressively longer timescales while providing benchmarks for assessing uncertainties in the predictions. We find that the early reaction pathways of LLM-105 decomposition are extremely similar to TATB; they involve intra- and intermolecular hydrogen transfer. Additionally, the detonation performance of LLM-105 falls between that of TATB and HMX. We find agreement between predictive models for first-step reaction pathways but significant differences in final product formations. Predictions of detonation performance result in a wide range of values, and one-step kinetic parameters show the similar reaction rates at high temperatures for three out of four models considered.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Experimental and theoretical investigation into the high pressure deflagration products of 2,6-diamino-3,5-dinitropyrazine-1-oxide (LLM-105)

Diamond anvil cell (DAC) laser ignition experiments and reactive ab initio molecular dynamics (AIMD) simulations were performed on the high explosive (HE) LLM-105 to investigate its high pressure (HP) deflagration chemistry. Raman and optical spectroscopy measurements reveal LLM-105 reacts into an opaque carbonaceous product at 4–25 GPa. At pressures >~ 27 GPa, the reaction product consists of an amorphous optically transparent solid and nitrogen (N 2 ) in the solid phase. While not a one-to-one comparison due to the small time and length scales, the HP AIMD simulations show that some of the product is molecular N 2 , in qualitative agreement with experiment, while above 20 GPa most of the product consists of large amorphous C x H y N z O k clusters. Clustering is enhanced with pressure and reduces with temperature. In the experiments with initial sample pressure >~ 25 GPa, the pressure within the DAC decreases with minimal change in DAC cavity area. At initial sample pressures of 43.9 GPa, when quenched to 0 K, simulations predict a product experiencing a lower pressure consistent with the experimental measurement at lower load pressures. In conclusion, the results are important for understanding the HP deflagration chemistry of LLM-105.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

32 examples of LLM applications in materials science and chemistry: towards automation, assistants, agents, and accelerated scientific discovery

Abstract Large language models (LLMs) are reshaping many aspects of materials science and chemistry research, enabling advances in molecular property prediction, materials design, scientific automation, knowledge extraction, and more. Recent developments demonstrate that the latest class of models are able to integrate structured and unstructured data, assist in hypothesis generation, and streamline research workflows. To explore the frontier of LLM capabilities across the research lifecycle, we review applications of LLMs through 32 total projects developed during the second annual LLM hackathon for applications in materials science and chemistry, a global hybrid event. These projects spanned seven key research areas: (1) molecular and material property prediction, (2) molecular and material design, (3) automation and novel interfaces, (4) scientific communication and education, (5) research data management and automation, (6) hypothesis generation and evaluation, and (7) knowledge extraction and reasoning from the scientific literature. Collectively, these applications illustrate how LLMs serve as versatile predictive models, platforms for rapid prototyping of domain-specific tools, and much more. In particular, improvements in both open source and proprietary LLM performance through the addition of reasoning, additional training data, and new techniques have expanded effectiveness, particularly in low-data environments and interdisciplinary research. As LLMs continue to improve, their integration into scientific workflows presents both new opportunities and new challenges, requiring ongoing exploration, continued refinement, and further research to address reliability, interpretability, and reproducibility.

Computer Science↗

LLM integration into EPICS

The utilization of large language models (LLMs) such as ChatGPT has seen a remarkable increase in various fields over the past few years. These models have demonstrated their versatility and capability in understanding and generating human-like text, making them invaluable tools in numerous applications. In this project, we explore the integration of a LLM into the Experimental Physics and Industrial Control System (EPICS). The primary focus of this integration is to employ the LLM for advanced image processing and spatial analysis on images obtained from the beamlines. By leveraging the capabilities of the LLM, we aim to enhance the accuracy and efficiency of image interpretation, enabling more precise data analysis and decision-making within the EPICS framework. This integration not only showcases the potential of LLMs in scientific and industrial applications but also sets the stage for future advancements in automated control systems.

Adams, Ethan↗

Computational Determination of the Refractive Index of TATB, LLM-105, β-HMX, & α-RDX

In this study, we use Materials Studio CASTEP, an ab initio quantum mechanical (QM) program employing density functional theory (DFT), to compute the refractive index (RI) of solid energetic materials, specifically, PETN (tetragonal phase), TATB, LLM-105, β-HMX, and α-RDX. The use of quantum mechanical DFT methods affords the investigation of the optical mate rial properties of a system without the need for any experimental input. The RI values of PETN and TATB have been experimentally determined previously and are compared here to the QM derived RI values as validation of the theoretical approach in determining material optical proper ties. To date, experimental measurements to determine the RI values for LLM-105 have yet to be determined. This fact obviates the need to determine LLM-105 RI values using quantum mechanical means.

36 MATERIALS SCIENCE↗

Evaluation of LLM-Generated Kokkos Code Using Compile-Time and Run-Time Testing

Due to the growing use of large language models (LLMs) by developers and researchers, it has become essential to reliably evaluate their ability to generate code that uses specialized libraries. We explore the use of compile-time and run-time evaluation of LLM-generated Kokkos code through extending the methods used by OpenAI with the HumanEval dataset. Our evaluation framework is based on the first 40 prompts from the Kokkos138 dataset. We start by discussing two different forms of LLM prompting, using entirely plain English or providing pseudocode for added context. These two methods are used to generate Kokkos code with the Llama-3.1-8B-Instruct and CodeQwen1.5-7B-Chat models. We found that both forms of prompting led to high failure rates and difficulties with reliably parsing LLM-generated code, while prompts with pseudocode for context generally led to improved results on more complicated tests.

97 MATHEMATICS AND COMPUTING↗

Problem Complexity and LLM: H-M Team Reliability in Challenging Environments

In traditional human-machine operations, the functional decomposition of actions and responsibilities among various agents is assigned a priori. For instance, in current air traffic operations, although assisted by software, human pilots have the ultimate control of aircraft. Multiagent human-machine and machine-machine systems will face problems of varying and potentially unpredicted complexity in future challenging scenarios of planetary, en route, and orbital activities. Hence, it is important to enable dynamic transfer of decision-making to appropriate team members, human or machine, depending on which agent is best equipped to solve that specific problem on a time budget. In this paper, we consider aspects of problem-solving and its modeling that affect the outcomes of decision-making as a function of solution quality and the likelihood of solving the problem on a required time budget. We focus on Large Language Models (LLM) as potential machine teammates and conclude that practical, predictive modeling of their performance, at the current stage of their development, is infeasible. Simple examples help us illustrate that current LLM will require fundamental advancements to provide reliable support in team decision-making, especially in safety-critical and time-critical domains. The study is not meant to diminish the value of the remarkable capabilities of LLM, but rather to gain a better understanding of the technology’s appropriate use and the needed additions.

function allocation↗

Automated Membership Inference Attacks: Discovering MIA Signal Computations using LLM Agents

Membership inference attacks (MIAs), which enable adversaries to determine whether specific data points were part of a model's training dataset, have emerged as an important framework to understand, assess, and quantify the potential information leakage associated with machine learning systems. Designing effective MIAs is a challenging task that usually requires extensive manual exploration of model behaviors to identify potential vulnerabilities. In this paper, we introduce AutoMIA -- a novel framework that leverages large language model (LLM) agents to automate the design and implementation of new MIA signal computations. By utilizing LLM agents, we can systematically explore a vast space of potential attack strategies, enabling the discovery of novel strategies. Our experiments demonstrate AutoMIA can successfully discover new MIAs that are specifically tailored to user-configured target model and dataset, resulting in improvements of up to 0.18 in absolute AUC over existing MIAs. This work provides the first demonstration that LLM agents can serve as an effective and scalable paradigm for designing and implementing MIAs with SOTA performance, opening up new avenues for future exploration.

Tran, Toan Viet [Emory University]↗

Energetic Copolymers From LLM-105 and Aliphatic Isocyanates

Energetic polymers typically feature fuel-rich backbones with pendant oxidizing explosophores, which are used to modify pressure and temperature characteristics in energetic formulations. However, these pendant explosophores generally increase sensitivity and decrease the thermal stability of the polymer in the condensed phase. Direct polymerization of insensitive high explosives (IHEs) bearing polymerizable functionalities, such as amines, provides a synthetic platform for deriving tunable energetic materials. Here, this work demonstrates the first direct polymerization of the IHE 2,6-diamino-3,5-dinitropyrazine-1-oxide (LLM-105) with aliphatic isocyanate comonomers to yield an energetic copolyurea (PUa1) and an energetic copolyurea network (PUa2). 1 H and 13 C nuclear magnetic resonance (NMR) and Fourier transform infrared spectroscopy (FTIR) confirm copolyurea synthesis. PUa1 exhibited branching reactions commonly found in polyurea syntheses, and these side reactions were suppressed in PUa2 through use of a polyfunctional isocyanate. Differential scanning calorimetry (DSC) and thermogravimetric analysis (TGA) demonstrate the energetic IHE based polyurea preserves the energetic decomposition of the parent monomer LLM-105 in PUa1 (1203 J g −1 ) and PUa2 (687 J g −1 ), albeit with reduced thermal stability with peak decomposition temperatures of 235°C and 233°C, respectively. This work presents a new approach for generating energetic polymers from IHE cores with tunable energetic, thermal, and structural characteristics.

Chemistry↗

ChatPORT: Fine-Tuned LLM for Easy Code {PORT}ing

Fine-tuning existing LLMs for specialized tasks has become a very attractive alternative due to its low cost and quick development cycle. With many pre-trained LLMs available, it is an increasingly complex task to choose the correct model as the starting point or base model. In this work we discuss ChatPORT - a specialized fine-tuned LLM geared towards providing correctly translated codes from one programming model to another. We evaluate a number of base models and compare and contrast their features and characteristics that make them a viable starting point. In this paper, we focus on the OpenMP offload porting capabilities of ChatPORT. We build our training data using kernels from the Heterogeneous Computing Benchmarks (HeCBench) [12] and the OpenMP Validation and Verification suite [5] to fine-tune the base models. We then test the model using unseen kernels extracted from the HeCBench benchmark suite. Our results show that: (1) not all open LLMs geared towards HPC are aware of programming models like OpenMP, (2) although all base models benefit from fine-tuning they learn differently and produce different correctness rates, (3) depending on the memory size and compute resource available, different base models can be used for fine-tuning without significantly affecting the quality of transpiled code they generate, (4) fine-tuning improved the correctness rate of the LLM by an average of 43.2%, and (5) feedback-based training data further increased the correctness rate by an average of 6% over the LLMs tested.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges, requiring efficient hardware acceleration. Benchmarking the performance of LLMs across diverse hardware platforms is crucial to understanding their scalability and throughput characteristics. We introduce LLM-Inference-Bench, a comprehensive benchmarking suite to evaluate the hardware inference performance of LLMs. We thoroughly analyze diverse hardware platforms, including GPUs from Nvidia and AMD and specialized AI accelerators, Intel Habana and SambaNova. Our evaluation includes several LLM inference frameworks and models from LLaMA, Mistral, and Qwen families with 7B and 70B parameters. Our benchmarking results reveal the strengths and limitations of various models, hardware platforms, and inference frameworks. We provide an interactive dashboard to help identify configurations for optimal performance for a given hardware platform.

Chitty-Venkata, Krishna Teja↗

LLM-Based Adaptive Distribution Voltage Regulation Under Frequent Topology Changes: An In-Context MPC Framework

This paper proposes a large language model (LLM) based adaptive inverter control for distribution voltage regulation under frequent topology changes. We leverage the ability of the LLM to perform in-context learning and create a topology-adaptive surrogate model for power flow calculation. The surrogate model is then integrated with a long short-term memory-based load forecaster and a model predictive control (MPC) scheme to achieve the optimal inverter control that adapts to frequent topology changes. Unlike many existing works that assume fixed-topology grids or require the knowledge of all possible topologies when training a model, the proposed in-context MPC method tackles the distribution voltage control problem under various topologies and adapts to unknown topologies with limited data requirement for fine-tuning. The effectiveness of our method is demonstrated on a modified IEEE 123-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗