Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “LLAMA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

22 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Evaluation of LLM-Generated Kokkos Code Using Compile-Time and Run-Time Testing

Due to the growing use of large language models (LLMs) by developers and researchers, it has become essential to reliably evaluate their ability to generate code that uses specialized libraries. We explore the use of compile-time and run-time evaluation of LLM-generated Kokkos code through extending the methods used by OpenAI with the HumanEval dataset. Our evaluation framework is based on the first 40 prompts from the Kokkos138 dataset. We start by discussing two different forms of LLM prompting, using entirely plain English or providing pseudocode for added context. These two methods are used to generate Kokkos code with the Llama-3.1-8B-Instruct and CodeQwen1.5-7B-Chat models. We found that both forms of prompting led to high failure rates and difficulties with reliably parsing LLM-generated code, while prompts with pseudocode for context generally led to improved results on more complicated tests.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

GOLEM: GOld standard for Learning and Evaluation of Motifs

Motifs are distinctive, recurring, widely used idiom-like words or phrases, often originating from folklore, whose meaning is anchored in a narrative and have a significance as communicative devices across a wide range of media, including news, literature, and propaganda. Many motifs concisely imply a large constellation of culturally relevant information, and their broad usage suggests their cognitive importance as touchstones of cultural knowledge. As such, their detection is a step towards culturally aware natural language processing. We present GOLEM (GOld standard for Learning and Evaluation of Motifs) a dataset of English news articles, opinion pieces, and broadcast transcripts annotated for motific information. The dataset identifies 25,737 motif candidates across 34 motif types drawn from three cultural or national groups: Jewish, Irish, and Puerto Rican. The dataset contains 2,024,141 words split into 25,737 text snippets drawn from 8,073 articles. Each motif candidate is labeled according to a scheme which identifies the type of usage (motific, referential, eponymic, or unrelated), resulting in 1,743 actual motific instances in the data. Annotation was performed by individuals identifying as members of each group and achieved a Fleiss’ kappa (?) of > 0.55. In addition to the data, we demonstrate that classification of the candidate type is a challenging task for Large Language Models (LLMs) using a few-shot approach; recent models such as T5, FLAN-T5, GPT-2, and Llama 2 (7B) achieved a performance of 41% accuracy at best, where the majority class accuracy is 41% and the average chance accuracy is 27%. These data will support development of new models and approaches for detecting (and reasoning about) motific information in text.

motif, culture, natural language, artificial intel↗
DOE OSTI2024

Radiation-induced alteration of apatite on the surface of Mars: first in situ observations with SuperCam Raman onboard Perseverance

Abstract Planetary exploration relies considerably on mineral characterization to advance our understanding of the solar system, the planets and their evolution. Thus, we must understand past and present processes that can alter materials exposed on the surface, affecting space mission data. Here, we analyze the first dataset monitoring the evolution of a known mineral target in situ on the Martian surface, brought there as a SuperCam calibration target onboard the Perseverance rover. We used Raman spectroscopy to monitor the crystalline state of a synthetic apatite sample over the first 950 Martian days (sols) of the Mars2020 mission. We note significant variations in the Raman spectra acquired on this target, specifically a decrease in the relative contribution of the Raman signal to the total signal. These observations are consistent with the results of a UV-irradiation test performed in the laboratory under conditions mimicking ambient Martian conditions. We conclude that the observed evolution reflects an alteration of the material, specifically the creation of electronic defects, due to its exposure to the Martian environment and, in particular, UV irradiation. This ongoing process of alteration of the Martian surface needs to be taken into account for mineralogical space mission data analysis.

Science & Technology - Other Topics↗
DOE OSTI2025

Impact of ionization peak location on measured opaqueness in DIII-D H-mode plasmas

This study investigates the relationship between electron pedestal density and the location of the ionization peak on neutral penetration in DIII-D H-mode plasmas, utilizing a database of Lyman-α emission measurements. The high electron density leads to neutrals being ‘screened’ and the ionization front being pushed out into the Scrape-Off Layer (SOL). This is also referred to as the neutral opaqueness, which is heuristically expected to scale with edge plasma density and machine size. However, at lower electron pedestal density, the penetration depth of the neutrals varies, and measured opaqueness deviates from the heuristic scaling. The database reveals that at low density, when the ionization peak is located in SOL region, the linear relationship between the electron density and neutral penetration holds. However, when the peak is located inside the separatrix, the penetration of the neutrals (λ n 0 ) is much wider ~3.0–3.5 cm, breaking the heuristic opaqueness approximation. These findings provide valuable insights into fueling efficiency and plasma behavior, with implications for Fusion Pilot Plants where high pedestal densities are anticipated and where the neutral opaqueness behaves like its heuristic approximation. This analysis offers a framework to refine neutral opaqueness approximations, enhancing the predictive capability for advanced tokamak operations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗