Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “task work”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Chemical signature characterization with hyperspectral imagery: novel deep learning model architectures and physically-motivated data augmentation techniques

The high spectral resolution afforded by Hyperspectral Imaging (HSI) sensors is poised to bring unprecedented advancements to signature characterization applications. Thus far, much of the research in the machine learning field devoted to HSI applications has focused on a few specific tasks like land-use land-cover classification. In land classification tasks, spatial information is very important, and model architectures are often designed to leverage spatial contexts. However, it is unclear how well these spatially-tuned models will translate to tasks where spectral information is critical, like the detection and characterization of chemicals. In this work, we compare spectral models (inputs are 1D spectra) and spatial-spectral models (inputs are 3D cubes) in the context of predicting chemical concentration maps. We find that spatial-spectral models perform the best, though we find a wide range in performance across the different architectures tested. Additionally, we find that model performance is impacted by the availability of training data, particularly in scenarios where the training data doesn't fully capture the true variance of real-world conditions. We find that data augmentation can help mitigate sparse coverage of observed parameter space (e.g., seasonal or geographic variability in ground cover), and present augmentation strategies that are tailored to hyperspectral data.

• Artificial intelligence (AI) / machine learning ↗

SU-D-12A-06: A Comprehensive Parameter Analysis for Low Dose Cone-Beam CT Reconstruction

Purpose: There is always a parameter in compressive sensing based iterative reconstruction (IR) methods low dose cone-beam CT (CBCT), which controls the weight of regularization relative to data fidelity. A clear understanding of the relationship between image quality and parameter values is important. The purpose of this study is to investigate this subject based on experimental data and a representative advanced IR algorithm using Tight-frame (TF) regularization. Methods: Three data sets of a Catphan phantom acquired at low, regular and high dose levels are used. For each tests, 90 projections covering a 200-degree scan range are used for reconstruction. Three different regions-of-interest (ROIs) of different contrasts are used to calculate contrast-to-noise ratios (CNR) for contrast evaluation. A single point structure is used to measure modulation transfer function (MTF) for spatial-resolution evaluation. Finally, we analyze CNRs and MTFs to study the relationship between image quality and parameter selections. Results: It was found that: 1) there is no universal optimal parameter. The optimal parameter value depends on specific task and dose level. 2) There is a clear trade-off between CNR and resolution. The parameter for the best CNR is always smaller than that for the best resolution. 3) Optimal parameters are also dose-specific. Data acquired under a high dose protocol require less regularization, yielding smaller optimal parameter values. 4) Comparing with conventional FDK images, TF-based CBCT images are better under a certain optimally selected parameters. The advantages are more obvious for low dose data. Conclusion: We have investigated the relationship between image quality and parameter values in the TF-based IR algorithm. Preliminary results indicate optimal parameters are specific to both the task types and dose levels, providing guidance for selecting parameters in advanced IR algorithms. This work is supported in part by NIH (1R01CA154747-01)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗

Learning the simplicity of scattering amplitudes

The simplification and reorganization of complex expressions lies at the core of scientific progress, particularly in theoretical high-energy physics. This work explores the application of machine learning to a particular facet of this challenge: the task of simplifying scattering amplitudes expressed in terms of spinor-helicity variables. We demonstrate that an encoder-decoder transformer architecture achieves impressive simplification capabilities for expressions composed of handfuls of terms. Lengthier expressions are implemented in an additional embedding network, trained using contrastive learning, which isolates subexpressions that are more likely to simplify. The resulting framework is capable of reducing expressions with hundreds of terms—a regular occurrence in quantum field theory calculations—to vastly simpler equivalent expressions. Starting from lengthy input expressions, our networks can generate the Parke-Taylor formula for five-point gluon scattering, as well as new compact expressions for five-point amplitudes involving scalars and gravitons.

Cheung, Clifford [California Institute of Technolo↗

Final Report for Project DE-FC02-06ER25755 [Pmodels2]

In this report, we describe the research accomplished by the OSU team under the Pmodels2 project. The team has worked on various angles: designing high performance MPI implementations on modern networking technologies (Mellanox InfiniBand (including the new ConnectX2 architecture and Quad Data Rate), QLogic InfiniPath, the emerging 10GigE/iWARP and RDMA over Converged Enhanced Ethernet (RoCE) and Obsidian IB-WAN), studying MPI scalability issues for multi-thousand node clusters using XRC transport, scalable job start-up, dynamic process management support, efficient one-sided communication, protocol offloading and designing scalable collective communication libraries for emerging multi-core architectures. New designs conforming to the Argonne’s Nemesis interface have also been carried out. All of these above solutions have been integrated into the open-source MVAPICH/MVAPICH2 software. This software is currently being used by more than 2,100 organizations worldwide (in 71 countries). As of January ’14, more than 200,000 downloads have taken place from the OSU Web site. In addition, many InfiniBand vendors, server vendors, system integrators and Linux distributors have been incorporating MVAPICH/MVAPICH2 into their software stacks and distributing it. Several InfiniBand systems using MVAPICH/MVAPICH2 have obtained positions in the TOP500 ranking of supercomputers in the world. The latest November ’13 ranking include the following systems: 7th ranked Stampede system at TACC with 462,462 cores; 11th ranked Tsubame 2.5 system at Tokyo Institute of Technology with 74,358 cores; 16th ranked Pleiades system at NASA with 81,920 cores; Work on PGAS models has proceeded on multiple directions. The Scioto framework, which supports task-parallelism in one-sided and global-view parallel programming, has been extended to allow multi-processor tasks that are executed by processor groups. A quantum Monte Carlo application is being ported onto the extended Scioto framework. A public release of Global Trees (GT) has been made, along with the Global Chunks (GC) framework on which GT is built. The Global Chunks (GC) layer is also being used as the basis for the development of a higher level Global Graphs (GG) layer. The Global Graphs (GG) system will provide a global address space view of distributed graph data structures on distributed memory systems.

97 MATHEMATICS AND COMPUTING↗

HTS Transmission Cable System for installation in the Long Island Power Grid

Department of Energy (DOE) Award DE-FC26-07NT43240 was issued on October 1, 2007. Referred to as LIPA2, the principal objectives of the project were to develop key components required to deploy and demonstrate second-generation (2G) high temperature superconductor (HTS) cables in a 600 meter (2000 feet) underground segment of a 138kV three-phase transmission circuit of the Long Island Power Authority (LIPA) power grid. A previous effort under DOE Award DE-FC36-03GO13032 (referred to as LIPA1) resulted in installation (and subsequent successful operation) of first-generation (1G) HTS cables at the LIPA site. As with LIPA1, American Superconductor (AMSC) led the effort for LIPA2 and was responsible for overall management of the project and producing sufficient 2G wire to fabricate the required cable. Nexans' tasks included design/manufacture/installation of the cable, joint (splice), cable terminations and field repairable cryostat; while work by Air Liquide involved engineering and installation support for the refrigeration system modifications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Load Composition Model Workflow (BPA TIP-371 Deliverable 1A)

This project is funded under Bonneville Power Administration (BPA) Strategic Partnership Project (SPP) 17-005 between BPA and SLAC National Accelerator Laboratory. The project in a BPA Technology Improvement Project (TIP) that builds on and validates the Composite Load Model developed by the Western Electric Coordinating Council's (WECC) Load Modeling Task Force (LMTF). The composite load model is used by the WECC Modeling and Validation Work Group to study the stability and security of the western electricity interconnection. The work includes development of load composition data sets, collection of load disturbance data, and model development and validation. This work supports reliable and economic operation of the power system. This report was produced for Deliverable 1A of the BPA TIP-371 Project entitled \TIP 371: Advancing the Load Composition Model". The deliverable documents the proposed work ow for the Composite Load Model, which provides the basis for the instrumentation, data acquisition, analysis and data dissemination activities addressed by later phases of the project.

24 POWER TRANSMISSION AND DISTRIBUTION↗

MCC On Boarding Section J-2 (Exhibit H) Quality Assurance Requirements [Slides]

Upon MATOC Award, SUBCONTRACTOR shall submit a Quality Assurance Program for evaluation in accordance with subcontract technical and quality requirements. This may be the Subcontractors corporate QA program. Acceptance by Triad of the SUBCONTRACTORS Quality Assurance Program (QAP), as prescribed in Exhibit H, QC-01A and 01B, allows the SUBCONTRACTOR to execute this contract using their approved QAP. SUBCONTRACTORS QAP as approved by CONTRACTOR must meet the applicable requirements of DOE Order 414.1D (see next slide) and must address flow down of the quality requirements to lower tier subcontractors. Triad acceptance of SUBCONTRACTOR’s QAP approval is required prior to Notice to Proceed with on-site work. A Project Specific QA plan may on rare occasions be required for a specific task

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Accuracy Enhancement of Nuclear Power Plant Simulators Utilizing High Accuracy Simulation Predictions

More recently, reactor core simulators for core designs associated with commercial nuclear power plants that utilize what is believed to be higher fidelity models have been developed. Features such as neutronics models that utilize transport equation solvers with fine spatial meshes and many energy-groups, thermal-hydraulic models that utilize sub-channel solvers with fine spatial mesh and capable of treating a wide range of fluid conditions, and fuel-coolant chemistry interaction models capable of treating CRUD deposition are to be found in these higher fidelity core simulators. These reactor core simulators require access to higher performance computers, characterized by many processors, cores and large memory. So associated with utilization of these simulators is access to high performance computers and ability to accommodate in one’s workflow longer execution times. By contrast, currently used core simulators by the nuclear industry can execute on engineering workstations and have execution times of seconds to minutes. The desirability for having short execution times is not only desired for support of time critical tasks but supports the mental process of decision making by engineers. The goal of the work reported upon here has the objective of retaining the fidelity of higher fidelity models while retaining the ability to utilize engineering workstations. Beyond the core simulator goal, additional goals of this work include incorporating the just described core simulator capability into a Nuclear Steam Supply System (NSSS) simulator, and to incorporate the resulting capability into an environment supportive of design and operational decision making associated with nuclear power stations. The model selected for the core neutronics model is the NESTLE code, for the core thermal-hydraulic model is the CTF code utilizing coarse mesh, and for the NSSS model is the RELAP5-3D code. WSC’s proprietary 3KEYMASTERTM platform is being used to provide software coupling, user interface, visualization, and reporting. The NESTLE core neutronics simulator was first integrated with the CTF core thermal-hydraulic simulator using CTF developed communication commands which are also used for CTF to communicate with RELAP5-3D under WSC’s proprietary 3KEYMASTERTM platform. To assure NESTLE prediction consistency with higher fidelity core neutronic simulators, buffer codes have been created to automatically generate from output files written by the VERA core simulator the NESTLE nodal neutronic parameter’ library, geometry, and pin-power reconstruction input files, thereby avoiding a number of challenges associated with utilizing lattice physics codes and providing consistency with VERA predictions. To treat absorber rod effects a multi-set library is utilized, where a set refers to a specific absorber rod fully inserted pattern. A coarse spatial mesh CTF model was developed with features added that support using CTF as envisioned in the engineering quality simulator. A hybrid meshing approach was implemented to allow for automated construction of models with mixed levels of refinement. Specifically, a core model could resolve some assemblies at a nodal level (4 subchannels per assembly) and others at a pin-resolution (one subchannel per coolant subchannel in the assembly). The intention is that this will allow for better resolution of limiting conditions such as DNBR and PCT, which are based on local rod and subchannel conditions. Further development was done of features that enhance the capabilities for the envisioned engineering quality simulator that has been developed, but now for RELAP-3D. The RELAP5-3D code development includes ability to model more than 999 components and the addition of the cross-channels turbulence mixing model and the void drift model that are implemented in CTF, aiming to achieve closer prediction agreement of the two codes for transient simulations, specifically, more accurate matches of the overall mass, momentum, and energy exchanges of both the liquid and gas phases between the neighboring core assemblies. Graphics were also developed for the Instructor Station for this project under WSC’s proprietary 3KEYMASTERTM platform to facilitate design and operational decision making.

42 ENGINEERING↗

Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.

Unlu, Eyup B. (ORCID:0000000266836463)↗

Double Q-Learning for Radiation Source Detection

Anomalous radiation source detection in urban environments is challenging due to the complex nature of background radiation. When a suspicious area is determined, a radiation survey is usually carried out to search for anomalous radiation sources. To locate the source with high accuracy and in a short time, different survey approaches have been studied such as scanning the area with fixed survey paths and data-driven approaches that update the survey path on the fly with newly acquired measurements. In this work, we propose reinforcement learning as a data-driven approach to conduct radiation detection tasks with no human intervention. A simulated radiation environment is constructed, and a convolutional neural network-based double Q-learning algorithm is built and tested for radiation source detection tasks. Simulation results show that the double Q-learning algorithm can reliably navigate the detector and reduce the searching time by at least 44% compared with traditional uniform search methods and gradient search methods.

36 MATERIALS SCIENCE↗

Analysis of Hybrid Gas–Dust Outbursts Observed at 67P/Churyumov–Gerasimenko

Cometary outbursts offer a valuable window into the composition of comet nuclei with their forceful ejection of dust and volatiles in explosive events, revealing the interior components of the comet. Understanding how different types of outbursts influence the dust properties and volatile abundances, to better interpret what signatures can be attributed to primordial composition and what features are the result of processing, is an important task best undertaken with a multi-instrument approach. The European Space Agency Rosetta mission to 67P/Churyumov–Gerasimenko carried a suite of instruments capable of carrying out this task in the near-nucleus coma with unprecedented spatial and spectral resolution. In this work, we discuss two outbursts that occurred 2015 November 7 and were observed by three instruments on board: the Alice ultraviolet spectrograph, the Visual Infrared and Thermal Imaging Spectrometer, and the Optical, Spectroscopic, and Infrared Remote Imaging System. Together, the observations show that mixed gas and dust outbursts can have different spectral signatures representative of their initiating mechanisms, with the first outburst showing indicators of a cliff collapse origin and the second more representative of fresh volatiles being exposed via a deepening fracture. This analysis opens up the possibility of remote spectral classification of cometary outbursts with future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Probing for Artifacts: Detecting Imagenet Model Evasions

While deep learning models have made incredible progress across a variety of machine learning tasks, they remain vulnerable to adversarial examples crafted to fool otherwise trustworthy models. In this work we approach this problem through the lens of a detection framework. We propose a classification network that uses the hidden layer activations of a trained model as inputs to detect adversarial artifacts in an input. We train this classification network simultaneously against multiple adversarial algorithms to create a more robust detector and show higher detection rates than several alternatives. The novelty of our approach is in the scale and scope of probing Imagenet models for adversarial artifacts. In addition, we propose an improvement to feature squeezing, another common adversarial example detection method.

Rounds, Jeremiah↗

Towards a Benchmark Experiment with the Compact Nuclear Power Source

The Compact Nuclear Power Source (CNPS) was a high-assay low enriched uranium (HALEU) tristructural isotropic (TRISO)-fueled, graphite-moderated microreactor constructed in 1987 at Los Alamos National Laboratory. The reactor, conceived as a power source for short-range radar stations, was designed to be "walk-away safe," and was cooled by heat pipes and ambient air. Though the project was formally cancelled after the fuel and moderator material had been received, its potential to meaningfully advance the body of critical and integral data was evident, and critical experiments with a mock-up of the reactor proceeded at TA-18 until its disassembly in 1991. The reflector and some components of the core would later go on to see service as part of the New Production Reactor Modular High-Temperature Gas-Cooled Reactor (NP-MHTGR) critical experiments. In light of the progress made by groups like Westinghouse and X-Energy towards contemporary graphite-moderated microreactors, the system remains an attractive candidate for the basis of a benchmark experiment even today. Uncertainties remain, however, in some features of the system–inconsistencies in the dimensions and composition of the reactor’s components as described in literature and implemented in current computational models. The identification, quantification, and to the extent possible, the minimization of these uncertainties is a crucial task on the path towards creating a benchmark based on the CNPS system. The present work seeks to initiate this process with a survey of available documentation and improvements to the accuracy of CNPS neutronics models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Prioritizing and Managing Technology Needs to Meet River Protection Project Mission Objectives - 16462

Over 56 million gallons of radioactive waste are stored in 177 large underground tanks at the Hanford Site, located in southeastern Washington State. This nuclear waste resulted from plutonium production for the nation's nuclear defense program. The River Protection Project (RPP) mission is to: - Safeguard and safely manage waste stored in the Hanford tanks, - Treat the waste using the Waste Treatment and Immobilization Plant (WTP), - Ensure safe disposition of the waste to protect the Columbia River and the environment. Each aspect of the mission requires some application of technology in order to meet the mission objectives. The RPP Technology Roadmap document presents a comprehensive, integrated assessment of the technology-related advances needed to ensure successful completion of the Hanford tank waste cleanup mission. This paper describes the development of the RPP Technology Roadmap, summarizes its content, describes integration and collaboration with the Department of Energy's national laboratories to support the work identified, and defines how priorities were identified to ensure near-term RPP mission commitments can be accomplished while preserving the longer term technology development elements necessary for mission completion. The Challenge - Managing a wide variety of technology needs that involve multiple organizations, contractors, and national laboratories presents additional challenges when funding constraints are factored in. A process was needed to ensure the technology needs supporting near term mission priorities were appropriately identified, prioritized, and supported through the fiscal year planning process. Additionally, the national laboratory resources necessary to support many of the technologies require coordination to ensure the most appropriate resources are applied at the appropriate level without duplication or contradiction of effort. The Solution - The RPP Technology Roadmap was developed with the primary purposes to: - Identify technology related items needed to support or enhance the River Protection Project (RPP) mission, - Prioritize technology needs to support fiscal year planning processes, - Organize National laboratory support of the RPP mission and communicate needs to the participating contractors. The Technology Roadmap is consistent with Department of Energy (DOE) Hanford mission priorities and is also in alignment with other Hanford Site technical initiatives and policy and planning documents. The Technology Roadmap highlights the current estimated technology needs and identifies where planning shortfalls exist and where national laboratory participation is needed to support mission success. This information assists fiscal year planning and national laboratory contracting processes to ensure that technology needs are supported. In addition to supporting the RPP baseline mission, the Technology Roadmap provides a basis for strategic planning by identifying opportunities to use technology solutions to enhance mission efficiency. This waste management paper describes the innovative and collaborative processes used to develop, validate, and communicate the results so the project owners and the national laboratories can most effectively plan work scope and resources. A discussion of the following processes is included: - Technology needs and task owner identification, - Functional area grouping and area lead identification, - Needs prioritization, - High priority needs ranking (including validation), - Results compilation and planning gap identification, - Results presentation by project and functional area, - National laboratory coordination and collaboration. Application - The process used to develop the RPP technology roadmap is applicable to any site where multiple national laboratories and contractors are involved in identifying and implementing technology based solutions. This process is also applicable to the DOE HQ role to provide prioritization and coordination of the nationwide technology development activities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Economies of Numbers Formulations for Optimal Process Family Design of Carbon Capture Systems

Enabling rapid, widespread deployment of many process variants across a range of design requirements is key to ensuring the widespread availability of critical decentralized technologies such as carbon capture systems. Unfortunately, traditional process design methods are not efficient for designing many similar variations of a process rapidly across a wide range of system requirements. Rather than considering each process variant as a separate design task, we have proposed viewing the entire set of variants as a “family.” In our work, we present rigorous optimization formulations that simultaneously design each variant within the family from a platform of available unit modules, largely inspired by product family and platform design.

Stinchfield, Georgia↗

Neural Scaling Laws for Jet Generation

Recently observed empirical scaling laws describe the performance of foundation-type models as three independent key quantities -- dataset size, compute, and model parameters -- are modified. Extracting these scaling laws informs the training of large complex models for which the tuning of hyperparameters in traditional ways is not feasible. This work for the first time explores if scaling laws can also be observed for the task of particle jet generation -- both relevant as a pre-training objective for foundation models and as in-situ simulation by itself. We indeed replicate the key logarithmic scaling law behavior for model-size scaling. Beyond studying the next token prediction validation loss of the generative model, we also study the sliced Wasserstein distance of five physical quantities that are not immediately available to the model during training. Our study shows that this quantity is monotonically related to the next token prediction validation loss, meaning that this loss is indeed a good proxy for the physics performance. For the scaling with dataset size and compute, we observe substantially weaker scaling behavior of both the loss and the sliced Wasserstein distance. We analyze this behavior by introducing the concept of a learnable window, and argue that autoregressive next token prediction on jet constituents exhibits comparatively rapid saturation relative to language-model studies. We discuss possible origins of this behavior, including the stochastic nature of QCD radiation and differences between generative and supervised learning tasks in collider physics.

Amram, Oz [Fermilab]↗

Distilling Knowledge from Ensembles of Cluster-Constrained-Attention Multiple-Instance Learners for Whole Slide Image Classification

The peculiar nature of whole slide imaging (WSI), digitizing conventional glass slides to obtain multiple high resolution images which capture microscopic details of a patient’s histopathological features, has garnered increased interest from the computer vision research community over the last two decades. Given the unique computational space and time complexity inherent to gigapixel-size whole slide image data, researchers have proposed novel machine learning algorithms to aid in the performance of diagnostic tasks in clinical pathology. One effective algorithm represents a Whole slide image as a bag of smaller image patches, which can be represented as low-dimension image patch embeddings. Weakly supervised deep-learning methods, such as cluster-constrained-attention multiple instance learning (CLAM), have shown promising results when combined with image patch embeddings. While traditional ensemble classifiers yield improved task performance, such methods come with a steep cost in model complexity. Through knowledge distillation, it is possible to retain some performance improvements from an ensemble, while minimizing costs to model complexity. In this work, we implement a weakly supervised ensemble using clustering-constrained-attention multiple-instance learners (CLAM), which uses attention and instance-level clustering to identify task salient regions and feature extraction in whole slides. By applying logit-based and attention-based knowledge distillation, we show it is possible to retain some performance improvements resulting from the ensemble at zero cost to model complexity.

Alamudun, Folami↗