Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tasking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING↗

Semisupervised Learning for Seismic Monitoring Applications

The impressive performance that deep neural networks demonstrate on a range of seismic monitoring tasks depends largely on the availability of event catalogs that have been manually curated over many years or decades. However, the quality, duration, and availability of seismic event catalogs vary significantly across the range of monitoring operations, regions, and objectives. Semisupervised learning (SSL) enables learning from both labeled and unlabeled data and provides a framework to leverage the abundance of unreviewed seismic data for training deep neural networks on a variety of target tasks. We apply two SSL algorithms (mean-teacher and virtual adversarial training) as well as a novel hybrid technique (exponential average adversarial training) to seismic event classification to examine how unlabeled data with SSL can enhance model performance. In general, we find that SSL can perform as well as supervised learning with fewer labels. We also observe in some scenarios that almost half of the benefits of SSL are the result of the meaningful regularization enforced through SSL techniques and may not be attributable to unlabeled data directly. Lastly, the benefits from unlabeled data scale with the difficulty of the predictive task when we evaluate the use of unlabeled data to characterize sources in new geographic regions. Finally, in geographic areas where supervised model performance is low, SSL significantly increases the accuracy of source-type classification using unlabeled data.

58 GEOSCIENCES↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

Development of Spouting Bed Reactor for Reduction of Hematite to Magnetite (Final Report)

This project was designed to leverage both past and current technology development efforts and utilize the expertise of the National Energy Technology Laboratory (NETL) in a collaborative effort with SIOX for the development of a spouting bed reactor to produce magnetite from very fine hematite waste. More specifically, the effort involved the conversion of a steel manufacturing byproduct, iron oxide hematite (Fe 2 O 3 ), and reduces it chemically into a salable magnetite product applicable to a number of markets. SIOX previously operated a magnetite batch production facility based on a rotary kiln reactor process. Unfortunately, that process was both costly and inefficient, making it difficult to achieve desired economies, purity, and throughput levels. NETL’s technology, developed in this work, replaced the batch inefficient rotary kiln with a continuous spouting bed reactor capable of producing synthetic magnetite products. In the project, NETL was to develop the spouting bed for the SIOX application and SIOX was to construct and operate a fully integrated pilot scale demonstration plant. NETL successfully completed its tasks, but SIOX due to financial issues was not able to complete their tasks. They have chosen not to participate in this final report so for their tasks a short summary of NETL’s knowledge of their efforts is included.

36 MATERIALS SCIENCE↗

Cognition at the Point of Sensing

Over the last 15 years, compressive sensing techniques have been developed which have the potential to greatly reduce the amount of data collected by systems while preserving the amount of information obtained. A cost of this efficiency is that a computationally-intensive optimization routine must be used to put the sensed data into a form that a person can interpret. At the same time, machine learning techniques have experienced tremendous growth as well. Machines have demonstrated the ability learn how to effectively perform tasks such as detection and classification at speeds much faster than humanly possible. Our goal in this project was to study the feasibility of using compressive sensing systems "at the edge." That is, how can compressive sensing sensors be deployed such that information is created at the remote sensor rather than sending raw data to a central processing location? Studies were performed to analyze whether machine learning could be done on the compressively sensed data in its raw form. If a machine is performing the task, is it possible to do so without putting the data into a human interpretable form? We show that this is possible for some systems, in particular a compressive sensing snapshot imaging spectrometer. Machine learning tasks were demonstrated to be more effective and more robust to noise when the machine learning algorithm worked on data in its raw form. This system is shown to outperform a traditional spectrometer. Techniques for reducing the complexity of the reconstruction routine were also analyzed. Techniques for such as data regularization, deep neural networks, and matrix completion were studied and shown to have benefits over traditional reconstruction techniques. In this project we showed that compressive sensing sensors are indeed feasible at the edge. As always, sensors and algorithms must be carefully tuned to work in the constrained environment. In this project we developed tools and techniques to enable those analyses.

47 OTHER INSTRUMENTATION↗

Neuromorphic scaling advantages for energy-efficient random walk computations

Computing stands to be radically improved by neuromorphic computing (NMC) approaches inspired by the brain's incredible efficiency and capabilities. Most NMC research, which aims to replicate the brain's computational structure and architecture in man-made hardware, has focused on artificial intelligence; however, less explored is whether this brain-inspired hardware can provide value beyond cognitive tasks. We demonstrate that high-degree parallelism and configurability of spiking neuromorphic architectures makes them well-suited to implement random walks via discrete time Markov chains. Such random walks are useful in Monte Carlo methods, which represent a fundamental computational tool for solving a wide range of numerical computing tasks. Additionally, we show how the mathematical basis for a probabilistic solution involving a class of stochastic differential equations can leverage those simulations to provide solutions for a range of broadly applicable computational tasks. Despite being in an early development stage, we find that NMC platforms, at a sufficient scale, can drastically reduce the energy demands of high-performance computing platforms.

59 BASIC BIOLOGICAL SCIENCES↗

Rheology and Flow Evaluation of Neutralized Sodium Reactor Experiment Fuel with Manganous Nitrate

H-Canyon is preparing the Sodium Reactor Experiment (SRE) solutions in Tanks 16.3 and 16.4 for discard to the Savannah River Site (SRS) High Level Waste (HLW) Tanks into Sludge Batch (SB) 10. To meet HLW's criticality requirements, manganese will be added to the SRE solutions. The addition of manganese to the existing thorium and uranium in the SRE solution raised concerns with the flow of this neutralized material as it is discharged from H-Canyon through the gravity drain system to the H-Area Pump Pit (HPP). A neutralized Mn adjusted SRE stream will produce primarily Mn, Th, and U solids that can deter transfer. A 2012 rheology study was completed as part of the flowsheet development.1 However, the initial rheology study did not include the addition of manganous nitrate as a poison. Therefore, H-Canyon Engineering requested Savannah River National Laboratory (SRNL) to determine if the neutralized, Mn-adjusted SRE solutions will flow through the waste header to the HPP. The H-Canyon Technical Task Request (TTR) specified a target of 80 to 1 to bound the uncertainty in Mn target. Parallel studies were being performed to ensure that freshly precipitated Mn did not have a solubility that would result in challenging the DWPF WAC requirements of 70 to 1. This task was requested via a TTR and is governed by a Task Technical and Quality Assurance Plan (TTQAP).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Hawai‘i National Marine Renewable Energy Center (HINMREC)

The Hawaii National Marine Renewable Energy Center (HINMREC) was established to facilitate the commercialization of wave energy converter (WEC) devices, and to accelerate development and testing of Ocean Thermal Energy Conversion (OTEC) technologies. Housed at the Hawaii Natural Energy Institute (HNEI) of the University of Hawaii (UH), this program started with execution of the contract between the US Department of Energy (DOE) and UH in March 2009, and activities ran through the end of the project in September 2019. The DOE tasked HINMREC with facilitating and accelerating the build-out of the Navy’s Wave Energy Test Site (WETS), the nation’s first grid-connected open water wave energy conversion test facility, located off Marine Corps Base Hawaii (MCBH) in Kaneohe, on the island of Oahu. WETS was expanded from an existing test berth at 30m water depth to include test berths at 60m and 80m water depths. In recognition of the high costs associated with at-sea testing and evaluation of WEC devices, it was deemed imperative that HINMREC seek ways to reduce costs to developers by providing key research support to these early-stage technologies. WETS and HINMREC’s support allowed development of wave energy technology by providing a testing infrastructure that allows technology developers to test, demonstrate and evaluate their WEC devices, and generate data in order to advance WEC designs toward commercial readiness. HINMREC’s roles have included support in the establishment of the full site, including of wave resource characterization and site survey, followed by the essential roles of independent WEC device power performance assessment and environmental monitoring in support of deployed pre-commercial WECs. This DOE-funded work transitioned effectively to continue Navy-funded tasks for OTEC development, and activities at WETS, now under Naval Facilities Engineering Command (NAVFAC) funding. A secondary objective in the establishment of HINMREC was to assist the private sector in moving OTEC systems beyond proof-of-concept to pre-commercialization, primarily focused on system and component engineering, and local and global investigations into the potential environmental impacts of OTEC systems. HINMREC was tasked with maintaining high-resolution models of ocean thermal resources and the potential sustainable power output of OTEC systems. Ongoing tests begun previously under Navy funding at the OTEC Heat Exchangers (HXs) Test Facility at the Natural Energy Laboratory of Hawaii Authority (NELHA), in Kona on Hawaii Island, have been continued to identify cost-effective aluminum alloys for use in OTEC systems operating in the corrosive marine environment.

16 TIDAL AND WAVE POWER↗

Pre-Commercial Scale-Up of a Gas-Fired Absorption Heat Pump

The project sought to advance the maturity of SMTI’s 80 kBTU/hr residential space and water heating GAHP from the engineering prototype stage (TRL-7) to pre-production readiness by addressing manufacturing, balance of system design and installation, cost, reliability, and field application questions. As part of this project, the project team has: (1) Matured the design package for a commercially ready product (2) Demonstrated compliance with relevant ANSI standards (3) Completed manufacturing and assembly process specifications (4) Completed total production cost estimates and capital equipment requirements (5) Initiated component and system level reliability assessments (6) Completed a small field demonstration including measured performance, installation requirements and expected costs, and customer/key stakeholder feedback. (7) Completed a Techno-economic analysis for representative applications and climate zones, including justification for utility incentive programs. (8) Completed a market intelligence report. Scope of Work: A multi-faceted project was completed that included: (a) design for manufacturing tasks for both the sealed system and balance of system, (b) development and trial of key manufacturing processes and techniques, (c) evaluation of component and system level reliability, (d) exploration of make/buy decisions including impact on cost and required capital. Additionally, (e) installation and monitoring of a small number of field test units was completed to demonstrate energy savings and collect customer/installer feedback, and (f) a focused market research task was completed to explore potential barriers and improve market introduction plans. These tasks addressed many of the remaining technical risks regarding long-term reliability, verification of manufacturing cost estimates and identification of cost concerns, identify installation and balance of system design criteria necessary to achieve energy savings and installed cost goals, and identify market barriers and strategies prior to product market introduction.

03 NATURAL GAS↗

Summary Report for the Anti-Climb Coating Test Project: Simulated Attack and Skid-Resistance Tests

The Sandia National Laboratories Physical Security Center of Excellence (PSCOE) has been tasked by the Department of State (DOS) Bureau of Diplomatic Security Research and Development branch to investigate the potential anti-climb benefits of newly developed skid-resistant paint coatings - one light base and one dark base. DOS is interested in studying the application of the coatings on passive barriers commonly used at diplomatic facilities. The purpose of the anti-climb coating in this context is to deter and delay adversaries from climbing onto the passive barriers. PSCOE was tasked to perform delay testing that focused on the effectiveness of the coatings on the two DOS perimeter passive barriers - the DS-41 anti-ram fence and a 9 foot high by 1 foot thick reinforced concrete wall intended to mimic the DS-30 anti-ram perimeter wall. PSCOE was also tasked in performing skid-resistance testing using a British Pendulum skid-resistance tester. Delay testing and skid-resistance testing were also performed on two different passive barriers without any anti-climb coating to determine a baseline.

42 ENGINEERING↗

An Introduction to Word Embeddings and Language Models

Language models have advanced at a phenomenal pace over the past decade. This document provides a short introduction to terminology, word embeddings (aka low-dimensional representations), and popular large-scale language models (LMs). Word embeddings are used to represent words as numerical vectors and are context-independent, meaning a word can only have a single representation (e.g., club can only be club sandwich, not golf club ). Language models can determine the probability of a given sequence of words occurring in a sentence and can provide context to distinguish between words and phrases that sound similar. LMs are context-dependent (e.g., club can be club sandwich or golf club ) and largely fall in two main classes – autoregressive and autoencoding models. Autoregressive models are pretrained on the classic language modeling task: guess the next token having read all the previous ones. Those models can be fine-tuned and achieve great results on many tasks, the most natural application is text generation. A typical example of such models is GPT, but others include GPT-2, GPT-3, CTLR, TRANSFORMER-XL, REFORMER, XLNET. Autoencoding models are pretrained by corrupting the input tokens in some way and trying to reconstruct the original sentence. They can be fine-tuned and achieve great results on many tasks such as text generation, but their most natural application is sentence classification or token classification. A typical example of such models is BERT, but others include ROBERTA, ALBERT, XML, XML-ROBERTA, FLAUBERT AND LONGFORMER.

97 MATHEMATICS AND COMPUTING↗

High Performance non-PGM Transition Metal Oxide ORR Catalysts of PEMFCs

This project was designed to develop acid-stable PGM-free transition metal oxide oxygen reduction reaction (ORR) electrocatalysts to meet or exceed the performance and durability of the DOE 2020 Technical Targets for platinum-group metal (PGM) free electrocatalysts from first-principles to incorporation into membrane-electrode assemblies (MEAs) for polymer electrolyte membrane (PEM) fuel cells. The planned project was to accomplish this goal with a multi-step approach: 1) materials modeling and experimental screening to identify acid-stable oxides with high ORR activity, 2) optimization of catalyst particle size and catalyst/carbon/ionomer catalyst layer composition, 3) fabrication of MEAs for performance and durability testing. During the course of this project: 1) acid-stability descriptors were developed for manganese oxides; 2) a family of acid-stable multicomponent oxides based on antimony were developed; 3) a flexible synthesis for the formation of nanocrystalline nonstoichiometric oxides was developed; 4) limited ORR activity but modest and improving oxygen evolution reaction (OER) activity was measured for multicomponent antimony oxides. The project was programmed into five technical tasks: The development of acid-stable ORR electrocatalytic oxides through 1) identification and optimization of acid-stable oxide compositions, and 2) electrochemical characterization; 3) optimization of catalyst layer composition for MEAs using identified ORR electrocatalysts; 4) MEA fabrication and performance testing to result in performance of 44 mA-cm-2 at 0.9 V vs. RHE; and 5) accelerated-stress testing of optimized MEAs. Because no acid-stable oxide was identified with the requisite activity for ORR (4.4 µA-cm-2oxide intrinsic activity at 0.9 V vs. RHE) within the time and budget allotted in Tasks 1 and 2, the project was halted at the end of phase 1, with no activity in Tasks 3-5. The research output, while not succeeding in developing ORR electrocatalysts, advanced the development of acid-stable oxide materials, showing potential for further improvement as OER electrocatalysts.

08 HYDROGEN↗

Creep-fatigue Behavior and Damage Accumulation of a Candidate Structural Material for Concentrating Solar Power Solar Thermal Receiver (Final Technical Report)

Creep-fatigue deformation is an important consideration for a thermal receiver in Concentrating Solar Power systems due to the constant static stress or pressure, diurnal cycling, and elevated service temperatures required for efficient operation. An accurate description of the creep-fatigue behavior, not available for five of the six candidate materials, is important for assessment of preliminary designs. This project has provided a detailed analysis of the creep-fatigue behavior and damage accumulation of Alloy 740H, a candidate structural material for a CSP solar thermal receiver to address a critical knowledge barrier for receiver designs identified in the CSP Gen3 Demonstration Roadmap. This project was divided in to three tasks, split between two general categories: Experimental and design methodology. Tasks 1 and 3, relating to the collection of data on Alloy 740H plate and sheet forms, respectively, were performed at the Idaho National Laboratory and used as input to Task 2, the development of design methodology performed at Argonne National Laboratory. Experimental work covered limited tensile and creep testing to fill gaps in available data that is currently available and to demonstrate how the plate of Alloy 740H tested in this work compared to historical data. A more substantial testing program for fatigue and creep-fatigue was performed, with particular emphasis on creep-fatigue as there is little available data and it is necessary to understand the creep-fatigue interaction and develop related design models. This effort includes the development of rules for the design of solar receiver components against high temperature creep-fatigue and ratcheting failure modes. The ASME Code rules for high temperature nuclear components was used to the basis of the method but adjustments will be made to reflect the generally shorter, diurnal operating cycles of thermal receivers and the relative consequences of failure, comparing nuclear to solar components. This work has provided guidance for the design of components for concentrating power facilities operating at high temperatures and undergoing high, secondary thermal stresses relative to the applied primary pressure stress. The design rules were developed for the design of Generation 3 CSP tubular receivers manufactured from Alloy 740H, but are generally applicable to a wide range of component types undergoing similar loads. Procedural design rules for components to be used in conjunction with the 2019 edition of the ASME Boiler & Pressure Vessel Code and the corresponding design data for Alloy 740H have been developed. A commentary describing the rationale behind the design rules and the data underlying the design material properties, as well as an extensive set of worked sample problems detailing the application of the rules to CSP components were developed as a part of this project, with a separate report covering these aspects in detail and included in the Appendix of this report.

14 SOLAR ENERGY↗

Enhanced Hanford Low-Activity Waste Glass Property Data Development: Phase 2

The U.S. Department of Energy’s (DOE) Office of River Protection (ORP) requested Pacific Northwest National Laboratory (PNNL) to support the River Protection Project vitrification in an effort to support operations upon completion of startup activities (DOE 2012). This work was performed under the PNNL project titled “ORP Glass Support Work.” One task of this project—Enhanced Hanford Waste Glass Models—is the subject of this report. A previous task focused on generating property-composition data and models for the Hanford site low-activity waste (LAW) glasses with lower waste loadings, which are relevant to the commissioning of the LAW vitrification facility. The current task has the long-term objective of expanding the Hanford site LAW glass database and property composition models for the balance of the Hanford site tank waste treatment and immobilization mission. During the balance of the mission, LAW glasses with higher waste loadings will be produced. This report presents the glass compositions and glass property data developed in Phase 2 of the enhanced Hanford LAW glass property data development effort. When this effort is complete, enhanced LAW glass property models will be developed. Section 1.1 summarizes the status of the LAW glass composition regions and waste loading constraints prior to the data development effort documented in this report. Section 1.2 summarizes the LAW Phase 2 glass composition region and test matrix. Section 1.3 documents the quality assurance program used in performing the work discussed in this report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Industry Level Integrated Fire Modeling Using Fire Risk Investigation in 3D (FRI3D)

The software Fire Risk Investigation in 3D (FRI3D) has been developed over the last 2 years to integrate 3D spatial modeling with existing fire probabilistic risk assessment (PRA) models and fire simulation codes. The goal of this research and development is to automate many of the fire analysis manual tasks to reduce industry efforts in the initial fire modeling and operational costs for the model maintenance and evaluations required during normal plant operations. The tasks for Fiscal Year (FY) 2021 include first testing the FRI3D modeling capabilities by importing an industry fire model into FRI3D and making a 3D model of a complex/high-risk significant area. (For this work, the switchgear room was chosen.) Then, the second task of FY 2021 is to develop a dynamic fire PRA process that can help optimize traditional fire PRA models. The switchgear room model will be used for the dynamic fire PRA work. This report describes the work and insights learned when using FRI3D software to model both a Nuclear Regulatory Report (NUREG) example models and a full industry switchgear room.

97 MATHEMATICS AND COMPUTING↗

Assessing Cognitive Impacts of Errors from Machine Learning and Deep Learning Models: Final Report

Due to their recent increases in performance, machine learning and deep learning models are being increasingly adopted across many domains for visual processing tasks. One such domain is international nuclear safeguards, which seeks to verify the peaceful use of commercial nuclear energy across the globe. Despite recent impressive performance results from machine learning and deep learning algorithms, there is always at least some small level of error. Given the significant consequences of international nuclear safeguards conclusions, we sought to characterize how incorrect responses from a machine or deep learning-assisted visual search task would cognitively impact users. We found that not only do some types of model errors have larger negative impacts on human performance than other errors, the scale of those impacts change depending on the accuracy of the model with which they are presented and they persist in scenarios of evenly distributed errors and single-error presentations. Further, we found that experiments conducted using a common visual search dataset from the psychology community has similar implications to a safeguards- relevant dataset of images containing hyperboloid cooling towers when the cooling tower images are presented to expert participants. While novice performance was considerably different (and worse) on the cooling tower task, we saw increased novice reliance on the most challenging cooling tower images compared to experts. These findings are relevant not just to the cognitive science community, but also for developers of machine and deep learning that will be implemented in multiple domains. For safeguards, this research provides key insights into how machine and deep learning projects should be implemented considering their special requirements that information not be missed.

97 MATHEMATICS AND COMPUTING↗

Semi-supervised Bayesian Low-shot Learning

Deep neural networks (NNs) typically outperform traditional machine learning (ML) approaches for complicated, non-linear tasks. It is expected that deep learning (DL) should offer superior performance for the important non-proliferation task of predicting explosive device configuration based upon observed optical signature, a task which human experts struggle with. However, supervised machine learning is difficult to apply in this mission space because most recorded signatures are not associated with the corresponding device description, or “truth labels.” This is challenging for NNs, which traditionally require many samples for strong performance. Semi-supervised learning (SSL), low-shot learning (LSL), and uncertainty quantification (UQ) for NNs are emerging approaches that could bridge the mission gaps of few labels and rare samples of importance. NN explainability techniques are important in gaining insight into the inferential feature importance of such a complex model. In this work, SSL, LSL, and UQ are merged into a single framework, a significant technical hurdle not previously demonstrated. Exponential Average Adversarial Training (EAAT) and Pairwise Neural Networks (PNNs) are chosen as the SSL and LSL methods of choice. Permutation feature importance (PFI) for functional data is used to provide explainability via the Variable importance Explainable Elastic Shape Analysis (VEESA) pipeline. A variety of uncertainty quantification approaches are explored: Bayesian Neural Networks (BNNs), ensemble methods, concrete dropout, and evidential deep learning. Two final approaches, one utilizing ensemble methods and one utilizing evidential learning, are constructed and compared using a well-quantified synthetic 2D dataset along with the DIRSIG Megascene.

97 MATHEMATICS AND COMPUTING↗