Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tasks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Remote Radiation Sensing Using Aerial and Ground Platforms

Remote sensing of ionizing radiation has a significant role in waste management, nuclear material management and nonproliferation, and radiation safety. Robotic platforms can surpass the number of tasks that are achieved by humans. With this technique, the operator's radiation exposure can be decreased. Remote sensing allows for the evaluation and monitoring of radiological contamination. Gamma-ray and neutron sensors were integrated onto the robotic platforms. This approach allows for the radiation sensor data to be dynamically tracked and mapped thus enabling further analysis of the radiation flux in temporal and spatial domains. The goal is to complete scheduled tasks while the robot is being irradiated. To achieve this, electronic components must be shielded and radiation hardened. CZT Detector: Cadmium Zinc Telluride (CZT) detector technology has been a promising solution for gamma-ray and x-ray measurements. Detector data is transferred to the Odroid minicomputer that controls and powers the module via the USB. Robot Operating System (ROS) was utilized for data acquisition and data fusion. The Mariscotti method was employed for the spectrum analysis. A function was programmed in ROS for the automatic identification of photopeaks. CLYC Detector: A Cs{sub 2}LiYCl{sub 6}:Ce{sup 3+} (CLYC) detector was used for simultaneous medium-resolution gamma-ray measurements and neutron counting. A 2.54 cm diameter photomultiplier tube (PMT) was equipped with a high voltage supply and a miniature digitizer. Gamma-ray excitation: fast core-to-valence luminescence (CVL) with 1 ns decay constant, and prompt Ce{sup 3+} emission with 50 ns decay constant. Neutron excitation: slow cerium self-trapped excitation (Ce{sup 3+} STE), 1000 ns decay constant. Radiation Source Localization: Maximum Likelihood Estimation (MLE) and gradient-based methods were used to locate the position of a radiation source based on measured radiation intensities. Multi-Particle Transport Code FLUKA: Estimation of radiation damage of the electronic components is important in order to optimize the robot's operational time while it is irradiated. Displacement per atom (DPA) represents the radiation damage in materials exposed to the ionizing radiation. Various shielding layers of different thickness t were analyzed (< 5% statistical error). The model of the controller of the UAS was designed in FLUKA. Conclusion: CZT and CLYC detectors were integrated onto the robotic platforms. Radiation source localization and contour mapping using robotic platforms were studied. Functions for data analysis and fusion were developed in ROS. FLUKA code was utilized to analyze DPA values. Layers of low-density and high-density materials were used to shield the UAS electronics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Training for Decommissioning and Waste Management - Competence in the Field of Nuclear Engineering - 20137

Due to the phase-out of nuclear power and the reorganization of the participating organizations in Germany, the demand for qualified personnel has increased. But the number of nuclear study programs has rapidly decreased in Germany, although qualified employees are needed for the upcoming tasks in nuclear decommissioning. The solution for those challenging tasks can only be achieved through a strategic approach, involving all stakeholders. AiNT supports this process by offering a tailor-made Education and Training (E and T) program in cooperation with a wide range of partners and initiating the project BEAST (Building competence - Expert knowledge - Applied techniques - Safe decommissioning - Train fellows) as part of the OECD NEA framework Nuclear Education, Skills and Technology (NEST) program. This paper describes the current situation in Germany, provides insight into the education and training program of AiNT, and presents the project BEAST. We are currently looking for international partner institutions that would like to cooperate with us within the framework of the BEAST project and expand the range of topics. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Risk to Ecological Resources on Burial Waste Sites on the Hanford Site, Washington - 20248

The US and other nations have a large nuclear and chemical waste remediation task remaining from World War II, the Cold War, and industrial activities. The US Department of Energy (DOE) has the largest task in the U.S., with Hanford (Washington State) being the most contaminated site, with the longest and most costly cleanup program projected to extend to the end of the century. One of the greatest remediation problems at Hanford are the burial waste facilities, some of which are inside the 200 Areas on the Central Plateau, while others are outside the 200 Areas. These areas are associated with waste sites, pipes, and contaminated trenches, posing technical cleanup challenges to meet DoE's remediation goals, including protection of human health and the environment commensurate with Tri- Party Agreement and current regulatory requirements. In this paper we select one of the legacy waste sites (the BC Cribs and Trenches) as a case study to explore how risk to ecological resources varies during and as a consequence of remediation on sites primarily considered legacy waste sites. We used the risk methodology developed by the Consortium for Risk Evaluation with Stakeholder Participation (CRESP) during the Hanford Site-wide Risk Review. The CRESP methodology included evaluating the risk to receptors, including human health, the Columbia River, groundwater, and ecological and cultural resources. The risk evaluation process for ecological receptors included defining the boundaries of each evaluation unit (EU) to be remediated, definition of a suitable buffer area that might be affected, and consideration of the known resource value based on field work. This information, coupled with known remediation options or strategies, allowed us to develop a risk rating for ecological resources. Site risks were evaluated on a scale of 'not discernible' to 'very high' risk. Consideration of the risks at the buried waste sites was complicated by uncertainties in remediation methods and the degree of restoration that would occur as part of the remediation process. We use the BC Cribs and Trenches as a case study to explore why the risks are low currently but increase during remediation. The current 'not discernible to low' risk rating is due to the lack of high quality ecological resources on the BC Cribs and Trenches EU, except for edge areas (with some state-listed species). During remediation the risks increase to 'medium', mainly due to high quality resources on adjacent buffer lands, which could be disrupted during active remediation. Medium and high quality resources on the edge of the site are continuous with higher quality native shrub-steppe habitat on the buffer. Ecological resources on some of the areas surrounding the 200 East and West Areas are some of the highest quality shrub-steppe areas on the Hanford Site, and risk to these resources could be prevented by planning before and during remediation to minimize disruption. For example, lay down areas for the BC Cribs and Trenches can be minimized by careful planning. Heavy truck and other vehicular traffic can be minimized. Spread of the noxious weeds now on some of the site can be prevented, and the spread of invasive species into the site (particularly near undisturbed shrub-steppe habitat) can be reduced. Further, the areas around and between the 200 East and West Areas have been largely undisturbed and can serve as a source of seeds and propagules for any revegetation that occurs as part of the remediation process. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Virtual and Augmented Realities to Support Development, Training, Deployment, and Operations of Remote Systems - 20516

Throughout the U.S. Department of Energy complex, there is a need to deploy new, unique equipment and systems for cleanup activities, waste processing, infrastructure repair, and decommissioning and demolition in radioactive and hazardous environments. The new equipment often consists of custom systems created by integrating and modifying commercial technologies. In addition, the systems are deployed in unique environments due to limited access, waste properties, and the presence of previously installed equipment or infrastructure that has been left in place. The deployment of custom systems that are 'turnkey' ready for first-time installation and application has its risks. Use of test platforms and mockups for cold (i.e., non-radioactive) testing is one method to mitigate that risk: however, full-scale test mockups for operations such as waste retrieval and tank inspection can be expensive and must be modified to incorporate the uniqueness of each application. An alternative to full-scale mockups is to use three-dimensional (3D) virtual environments and virtual reality (VR) technology to develop interactive virtual test beds. These can be used throughout the down-selection, development, system integration, operational planning, operator training, and mission execution phases of a task. Virtual test beds are readily reconfigured, can be used for multiple tasks, support multiple users in parallel, and can accommodate enhancements and changes not originally planned or conceived in the initial design. Virtual test beds also provide a platform for developing and testing augmented reality (AR) tools for improving operator efficiency. A VR experience has been generated for waste retrieval from a Hanford waste tank to present the potential applications of a virtual test bed. Features of the VR experience are presented, potential applications of VR and AR for remote applications are discussed, and development areas for improving future application are considered. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

The Design, Fabrication, and Test Program for NREL's Wave-Powered Desalination System

Starting in 2018, the U.S. Department of Energy's Water Power Technologies Office (WPTO), initiated the development of a prize competition as a foundational investment of Powering the Blue Economy, the prize encouraged the development of small, modular, cost-competitive wave-powered desalination systems. The National Renewable Energy Laboratory (NREL) was tasked with managing the prize, known as the Waves to Water Prize (W2W), and providing technical input based on prior desalination research performed at the lab. NREL partnered with the Coastal Studies Institute (CSI) and Jennette's Pier in North Carolina for their expertise in deploying research articles at the Jennette's Pier research facility. The prize consisted of five stages that included high-level concept proposals, numerical modelling, site-specific design, subsystem prototyping, and a final ocean demonstration. Due to the logistical risks of installing numerous prototypes in the ocean at the same time, NREL was tasked with designing and building a test article to de-risk the final event. The test article design needed to represent the technologies expected in the final stage of the prize. This meant that the design was expected to follow the same rules as the competitors, providing CSI with an opportunity to practice installations and develop a final logistics plan prior to the final event. After concluding the W2W event in April 2022, the NREL test article was redeployed in August 2022 to better understand the challenges of anchoring wave energy converters (WECs) in shallow water conditions with breaking waves.

desalination↗
DOE OSTI2023

Overview and Current Progress of the DOE/NNSA Nuclear Criticality Safety Program Training and Education Program

Since 2011, the US Department of Energy/National Nuclear Security Administration (DOE/NNSA) Nuclear Criticality Safety Program (NCSP) has been providing a two-week nuclear criticality safety (NCS) practitioner course to support the training and qualification of new NCS staff. In 2013, an NCS Manager’s course was developed for process supervisors, managers, regulators, and other professionals with NCS-related responsibilities, and, in 2017, an additional course was proposed for Criticality Safety Officers (CSOs). In addition to hands-on training, other NCSP-funded tasks include training on sensitivity/uncertainty methods, NCS resource pipeline tasks, development of NCS guides, maintenance and development of Nuclear Criticality Safety Education Training (NCSET) modules and designing of a new subcritical assembly for hands-on training purposes. This paper provides an overview of the NCSP training and education program. The status of the NCSP hands-on training program will also be provided.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Reference Design Cases for Floating Offshore Wind Arrays

Given the immature nature of the Floating Offshore Wind (FLOW) industry, there is a need for reference FLOW farm designs to allow researchers and technology developers to study the behavior of floating wind turbine systems, without having to design every part of those systems or without having to get access to a wide range of information that is often confidential. The International Energy Agency (IEA) Wind Task 49 is facilitating research collaboration on the integrated design of Floating Offshore Wind Arrays (FOWA), and will develop several reference FOWAs to facilitate R&D activities of the floating wind community and efficient scale change of the floating wind industry (from pilot farms to commercial ones). This paper will outline the key design considerations the task has identified for the sustainable deployment of large-scale FOWAs. The aim is to prepare a comprehensive overview of the different elements that impact the design of FOWA to support the development of best practices for FOWA design. The paper will also present three baseline reference design cases that are being prepared for shallow, intermediate and deep water sites. The final designs will be made open access including the engineering and cost inputs to accelerate further innovation, research and the deployment of FOWAs.

array layout↗
DOE OSTI2024

Towards in-situ certification of additively manufactured parts: the vital roles of physics-based and data-driven models

Certifying additively manufactured (AM) parts in-situ at the completion of a build is an enticing prospect, as it can help reduce the high costs associated with post-build testing and evaluation. However, achieving this goal presents significant challenges that may keep it aspirational for the foreseeable future. Nonetheless, incremental progress can pave the way forward. A critical aspect of in-situ certification involves continuous quality checking due to the random nature of the AM process and the difficulties in detecting defects or anomalies once layers are built over. While real-time in-situ monitoring strategies assisted by machine learning (ML) play a pivotal role in auditing part quality, they must ideally be supported by real-time (or near real-time) adaptive process control enabled by ML-assisted decision-making. By analyzing in-situ monitoring data in real-time (or near real- time) to dynamically adjust manufacturing parameters, such intervention can ensure AM parts are built to meet stringent certification standards. This can be achieved virtually by using high-fidelity performance models for the physical testing and evaluation tasks. In this short editorial, we discuss the key contributions made by data-driven and physics-based models in providing intelligence to the monitoring and process control tasks underpinning in-situ certification and in the simulation of the build’s performance under test and service conditions. While our focus lies in metal AM, the concepts discussed here are also relevant to other AM processes.

: In-situ monitoring↗
DOE OSTI2024

Numerical Evaluation of Effective Thermal Conductivity of PCM with Metal Foam Incorporating Buoyancy Effects for Thermal Energy Storage

The thermal energy storage (TES) system has the capability to efficiently preserve thermal energy directly derived from the energy source, minimizing any conversion losses. Especially latent heat storage offers distinct advantages, including a substantial increase in energy storage density and minimization of temperature fluctuations within the plants. However, the phase change material (PCM) employed in latent heat storage has low thermal conductivity. Consequently, various studies are being conducted to enhance heat transfer. One approach to enhance heat transfer involves utilizing metal foam to maximize the heat transfer area. However, modeling metal foam with its intricate structure is a challenging task in numerical analysis. For this reason, ongoing research focuses on simplifying the modeling of metal foam. Nevertheless, fully encompassing all the characteristics of actual metal foam proves to be a challenging task for the simplified analytical model. The objective of this paper is to interpret the simple lattice metal foam analysis model from the perspective of behavior induced by buoyancy. When comparing the analysis results of solid PCM and liquid PCM with the same thermal conductivity under changes in porosity and gravity direction, we conducted an analysis to discern the trends in effective thermal conductivity that are overestimated due to convection. In the analysis, a constant heat flux of 10 kW and a constant surface boundary condition of 350 K were applied, and a sensitivity study regarding the mesh was conducted. The results indicate that, from the perspective of gravity in the simple lattice model, the solid analysis yields an effective thermal conductivity 29-47% higher compared to the liquid analysis. Additionally, as porosity increases, there is an observed increase of 24-33% in effective thermal conductivity.

25 ENERGY STORAGE↗
DOE OSTI2024

NuGraph2: A Graph Neural Network for Neutrino Event Reconstruction

Neutrino experiments are set to probe some of the most important open questions in physics, from CP violation and the nature of dark matter. The technology of choice for many of these experiments is the liquid argon time projection chamber (LArTPC). In current LArTPC experiments, reconstruction performance often represents a limiting factor for the sensitivity. New developments are therefore needed to unlock the full potential of LArTPC experiments. NuGraph2 is a state of the art Graph Neural Network for reconstruction of data in LArTPC experiments. NuGraph2 utilizes a heterogeneous graph structure, with separate subgraphs of 2D nodes (hits in each plane) connected across planes via 3D nodes (space points). The model provides a consistent description of the neutrino interaction across all planes. NuGraph2 is a multi-purpose network, with a common message-passing attention engine connected to multiple decoders with different classification or regression tasks. These include the classification of detector hits according to the particle type that produced them (semantic segmentation) and the separation of hits from the neutrino interaction from hits due to noise or cosmic-ray background. Additional decoders are being developed, performing tasks such as the regression of the neutrino interaction vertex position. Performance results will be presented based on publicly available samples from MicroBooNE. These include both physics performance metrics, achieving 95% accuracy for semantic segmentation and 98% classification of neutrino hits, as well as computational metrics for training and for inference on CPU or GPU. The status of the NuGraph integration in the LArSoft software framework will be presented, as well as initial studies about model interpretability and injection of domain knowledge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Alfalfa Virtual Building Service: Software Engineering Best Practices Applied to Runtime Interaction with Building Energy Models

Buildings are active participants in increasingly complex energy systems. Building Energy Modeling (BEM) has a key role to play in planning and de-risking an equitable energy transition, with BEM-backed "virtual buildings" critical path for diverse applications that include workforce training tools, Hardware-in-the-Loop (HIL) experimentation to study equipment performance under a range of conditions, Control-Hardware-in-the-Loop (CHIL) experimentation to de-risk commercial control implementations at equipment through grid orchestration levels, and integration of dynamic load profiles into grid modeling tools for energy system experimentation at the urban scale. Modeling requirements vary across these applications, but many software engineering tasks do not. The Alfalfa Virtual Building Service (AVBS, see https://github.com/NREL/alfalfa/wiki) is an open-source web service that solves these common tasks robustly in one place, providing a foundational platform for power users to bootstrap their own applications. AVBS abstracts the specifics of runtime interaction with OpenStudio, Modelica, and Spawn of EnergyPlus models behind a unified REST API. Additionally, AVBS provides resources for cloud deployment and scaling to 100s of parallel simulations, a growing library of modular Operational Technology (OT) integrations for emulation of real-world interfaces, and scripts to automate the population of communities of virtual buildings from URBANopt, ResStock and ComStock.

building automation↗
DOE OSTI2024

NuGraph2: A Graph Neural Network for Neutrino Event Reconstruction

Neutrino experiments are set to probe some of the most important open questions in physics, from CP violation and the nature of dark matter. The technology of choice for many of these experiments is the liquid argon time projection chamber (LArTPC). In current LArTPC experiments, reconstruction performance often represents a limiting factor for the sensitivity. New developments are therefore needed to unlock the full potential of LArTPC experiments. NuGraph2 is a state of the art Graph Neural Network for reconstruction of data in LArTPC experiments [https://arxiv.org/abs/2403.11872]. NuGraph2 utilizes a heterogeneous graph structure, with separate subgraphs of 2D nodes (hits in each plane) connected across planes via 3D nodes (space points). The model provides a consistent description of the neutrino interaction across all planes. NuGraph2 is a multi-purpose network, with a common message-passing attention engine connected to multiple decoders with different classification or regression tasks. These include the classification of detector hits according to the particle type that produced them (semantic segmentation) and the separation of hits from the neutrino interaction from hits due to noise or cosmic-ray background. Additional decoders are being developed, performing tasks such as the regression of the neutrino interaction vertex position. Performance results will be presented based on publicly available samples from MicroBooNE. These include both physics performance metrics, achieving 95% accuracy for semantic segmentation and 98% classification of neutrino hits, as well as computational metrics for training and for inference on CPU or GPU. The status of the NuGraph integration in the LArSoft software framework will be presented, as well as initial studies about model interpretability and injection of domain knowledge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

A Method for Producing Hierarchical and Statistically Calibrated Predictions of Nuclear Material Properties from Existing Models

Computer vision-based analysis of micrographs of nuclear materials is an emerging technique for property prediction, synthetic route identification, and other material analysis tasks. These analysis tasks play a pivotal role in many material characterization applications such as signature development for treaty verification, process optimization, etc. The backbone in many of the recent computer vision-based techniques is a deep learning model, which takes a fixed-size set of pixels and provides a class prediction for that set of pixels. For example, previous work developed a deep convolutional neural network (CNN) to predict the synthetic route from a 256 px x 256 px patch taken from a larger image of uranium ore concentrates. In this work, we present several methods for first calibrating these models in a manner that they can provide accurate probabilities of their predictions’ veracity, and several methods of combining these probabilities. Overall, the combination of these two steps into a pipeline allows for full-image and even full-sample (where a sample has many images) predictions with associated confidence values. Finally, we show that one can also use the patch predictions and confidence to produce a visualization to map predicted constituents through the image. Results and examples for predicting and mapping uranium ore concentrates’ synthetic process from imagery will be presented.

artificial intelligence↗
DOE OSTI2024

Technology Development of a High-Capacity High-Assay Low Enriched Uranium Transportation Concept

This paper discusses the technology development (TD) efforts that led to the development of a High-Capacity High-Assay Low Enriched Uranium Transportation (HALEU) transportation concept. In 2018, the Department of Energy (DOE) Office of Nuclear Technology and Research Development tasked Idaho National Laboratory (INL) to investigate strategies to transport large quantities of HALEU. To complete this task, INL collaborated with Pacific Northwest National Laboratory and Oak Ridge National Laboratory. The project was completed in 2020, and one of the project outcomes was a transportation concept that consisting of five individual Type B packages transported on a single legal-weight truck (LWT). The total payload capacity of this concept is 1,881 kg (4,149 lb) of HALEU in the form of uranium dioxide (UO2) powder. The concept utilizes an existing Type B packaging design carrying a novel fuel basket design with an incorporated flux trap. The basket can be loaded with 18 individual fuel canisters. The research collaboration investigated the U.S. certification potential of this concept. This part of the project included evaluations of criticality safety, radiological safety, thermal safety, structural integrity, and confinement under hypothetical accident scenarios of transport. The results of these evaluations demonstrated a promising potential for U.S. certification of this concept. Eventually, the described efforts led to the pursuance and issuance of a U.S. patent, thus, protecting the associated intellectual property (IP). Current short-term goals include making this IP available to private industry partners for licensing, directly supporting DOE’s objectives of accelerating commercialization of national laboratory-generated IP. If additional funding becomes available, long-term research goals could include exploring the feasibility of transporting other uranium chemical forms (e.g., UF4) with this concept, or refining operational procedures to load or unload the packagings.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Geothermal Reservoir Simulation Analysis in Support of Electricity Co-Production Feasibility Study at the Blackburn Oil Field, Nevada: Preprint

Geothermal electricity co-production is a viable option for oil reservoirs producing large water cuts with elevated wellhead-observed temperatures. Repurposing existing oil wells significantly reduces initial investment costs historically associated with geothermal resource utilization. The National Renewable Energy Laboratory (NREL), partnering with Gradient Geothermal, Inc. (formerly known as Transitional Energy) and Grant Canyon Oil and Gas, has been tasked to evaluate the feasibility of geothermal electricity co-production at the Blackburn Oil Field with Organic Rankine Cycle (ORC) generators. The Devonian steady-state reservoir has historically been producing high water cuts of 240 degrees F (115.6 degrees C) observed at the wellhead without documented pressure drawdown or thermal breakthrough. An estimated initial reservoir temperature of approx. 260degreesF (126.7 degrees C) has been observed in the field and history-matched in a wellbore production analysis and reservoir simulation. Our objective was to develop a conceptual geological model of the subsurface, simulate a natural-state reservoir, model production scenarios, and complete a technical feasibility analysis to accomplish this task. Through extensive modeling and the use of available proprietary and public data, it was possible simulate three scenarios that indicated minimal thermal decline over the duration of a simulated ten-year production and re-injection scheme.

Blackburn Nevada↗
DOE OSTI2025

Geothermal Reservoir Simulation Analysis in Support of Electricity Co-Production Feasibility Study at the Blackburn Oil Field, Nevada

Geothermal electricity co-production is a viable option for oil reservoirs producing large water cuts with elevated wellhead temperatures. Repurposing existing oil wells significantly reduces initial investment costs historically associated with geothermal resource utilization. The National Renewable Energy Laboratory (NREL), partnering with Gradient Geothermal, Inc. (formerly known as Transitional Energy) and Grant Canyon Oil and Gas, has been tasked to evaluate the feasibility of geothermal electricity co-production at the Blackburn Oil Field with Organic Rankine Cycle (ORC) generators. The Devonian steady-state reservoir has historically been producing high water cuts of 240 degrees F (115.6 degrees C) observed at the wellhead without documented pressure drawdown or thermal breakthrough. An estimated initial reservoir temperature of approx. 260 degrees F (126.7 degrees C) has been observed in the field and history-matched in a wellbore production analysis and reservoir simulation. Our objective was to develop a conceptual geological model of the subsurface, simulate a natural-state reservoir, model production scenarios, and complete a technical feasibility analysis to accomplish this task. Through extensive modeling and the use of available proprietary and public data, it was possible simulate three scenarios that indicated minimal thermal decline over the duration of a simulated ten-year production and re-injection scheme.

Blackburn Nevada↗
DOE OSTI2025

Automation of Vulnerability and Patch Management: Information Extraction, Association, and Optimization

Vulnerability and patch management is an integral part of a robust cybersecurity program, yet it grows increasingly complex due to the sheer amount of data that must be analyzed. Particularly in Operational Technology (OT) environments, analysis must be done manually because of the lack of automated solutions. Additionally, there are many steps in this process, from the initial discovery of the vulnerability to the implementation of its remediation, and each step in the process requires different data in order to be performed effectively. In this work, we provide approaches and strategies to assist operators in industrial or OT environments throughout the vulnerability management cycle. Security advisories provide key information about mitigation strategies, or actions that can be taken when a patch is unavailable or cannot be installed. Details of these strategies are not shared in public vulnerability databases and must be found manually. We approach this problem by designing a solution to automatically identify that information within vendor security advisories and retrieve it for operator use. We start with an approach that requires domain-specific knowledge of certain frequently-seen reference websites. Next, an approach that can work on an arbitrary website but relies on certain keywords. Finally, an approach that uses Natural Language Processing (NLP) methods and does not require specific knowledge or keywords. Each of these approaches is more general than its predecessor; we demonstrate high accuracy for all approaches Advisories also often contain details of affected products in non-standard or natural language formats. While this information can be easily understood when read by an operator, the non-standard format acts as a barrier to effective automation. We provide an approach for the first step in this process: identifying vendors in security advisories and mapping them to a standard framework for representing digital assets and software products. We evaluate five established string similarity algorithms, plus one of our own design that combines string similarity and information theory, on the task of mapping vendors to their corresponding entries in the Common Platform Enumeration (CPE) repository. Our results show that our proposed metric outperforms all others. Due to the constraints on time, finances, and personnel for organizations, Large Language Models (LLMs) may seem like attractive opportunities for security operators to speed up information gathering; however, it is still not clear whether LLMs can handle vulnerability management tasks well. To answer this question, we perform an empirical study of LLMs’ ability to provide consistent, accurate information about vulnerabilities in order to guide organizations in their adoption of LLMs. We observe poor performance for all models tested, suggesting that these models are not well-suited to the consistent retrieval of accurate vulnerability information. Finally, once vulnerabilities have been identified and any additional information has been obtained, operators must decide which remediation actions to implement based on their available resources. This already-complex problem becomes even more so when we consider that a vulnerability may have multiple avenues for remediation. We formulate this scenario as two knapsack problems and provide solutions, which we then compare against several existing strategies for vulnerability prioritization seen in real operational environments.

McClanahan, Kylie↗
DOE OSTI2023

Correlated Trajectory Uncertainty for Adaptive Sequential Decision Making

One of the great challenges with decision making tasks on real world systems is the fact that data is sparse and acquiring additional data is expensive. In these cases, it is often crucial to make a model of the environment to assist in making decisions. At the same time, limited data means that learned models are erroneous, making it just as important to equip the model with good predictive uncertainties. In the context of learning sequential decision making policies, these uncertainties can prove useful for informing which data to collect for the greatest improvement in policy performance \citep{mehta2021experimental, mehta2022exploration} or informing the policy about unsure regions of state and action space to avoid during test time \citep{yu2020mopo}. Additionally, assuming that realistic samples of the environment can be drawn, an adaptable policy can be trained that attempts to make optimal decisions for any given possible instance of the environment \citep{ghosh2022offline, chen2021offline}. In this work, we examine the so-called ``probabilistic neural network'' (PNN) model that is ubiquitous in model-based reinforcement learning (MBRL) works. We argue that while PNN models may have good marginal uncertainties, they form a distribution of non-smooth transition functions. Not only are these samples unrealistic and may hamper adaptability, but we also assert that this leads to poor uncertainty estimates when predicting multiple step trajectory estimates. To address this issue, we propose a simple sampling method that can be implemented on top of pre-existing models.We evaluate our sampling technique on a number of environments, including a realistic nuclear fusion task, and find that, not only do smooth transition function samples produce more calibrated uncertainties, but they also lead to better downstream performance for an adaptive policy.

Offline Reinforcement Learning↗