Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Test Report”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Automation of FARM from Alpha Phase to Beta Phase

Integrated energy systems (IES) combine different energy technologies in synergistic ways to achieve a more secure and economical energy supply. The RAVEN-based HYBRID framework and the RAVEN plugin for grid and capacity optimization (HERON) are used to find the optimal installed capacity and the optimal economical dispatch of each component of the IES, by respecting the limits on the production variables and the corresponding rates of variation (explicit constraints). Besides, there are other process variables whose evolution needs to be bounded to avoid damaging the components (e.g., condensers, heat exchangers, steam generators, etc.) or degrading the process efficiency (e.g., electrolysis in the hydrogen production process). To avoid violating these latter limits (implicit constraints), a proof-of-concept HERON validator based on Feasible Actuator Range Modifier (FARM-Alpha) was developed by Argonne National Laboratory in January 2021. This FARM-Alpha validator calculates the evolution of process variables on whom the implicit constraints are placed, and then provides feedback to HERON dispatcher to adjust the power setpoints of three IES components, i.e., Balance of Plant, Secondary Energy Source, and Thermal Energy Storage, so as to meet both the explicit and implicit constraints. FARM-Alpha was designed to assess the performance of FARM as a HERON validator only, i.e., the list of components and implicit operational constraints were hard-coded within the source code. The lack of flexibility of the corresponding software structure does not allow the deployment in production environment. This report describes the development and the implementation of an enhanced version of the FARM-based validator (FARM-Beta), which ensures more flexibility for the end user in modeling multiple IES configurations and scenarios. Several test cases of the power dispatch problem were then selected to demonstrate the capabilities offered by FARM-beta. The test cases illustrate the efficiency of the closed-loop optimization scheme and the capability to calculate set-point trajectories satisfying both explicit and implicit constraints.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Verification Testing of OLI Systems Mixed Solvent Electrolyte Model for the Na-K-Mg-Ca-H-Cl-SO 4 -OH-HCO 3 -CO 3 -CO 2 -H 2 ) System to High Ionic Strength at 25°C

This technical report summarizes model verification results and summary statistics for 41 evaporite mineral solubility cases evaluated by Savannah River National Laboratory using OLI Systems’ aqueous electrolyte thermodynamic modeling software. The 41 verification cases containing a total of 60 solubility curves comprise mineral solubility data from low to high ionic strength at 25°C for the eight-component system Na-K-Mg-Ca-H-Cl-SO 4 -OH-HCO 3 -CO 3 -CO 2 -H 2 O as reported by Harvie et al. (1984). Thermodynamic calculations were executed using OLI Systems’ Stream Analyzer computation module within the OLI Studio software platform (Ver. 11.0, Rev. 11.0.1.9). The Mixed Solvent Electrolyte (MSE) thermodynamic framework was chosen for this investigation because of its superiority in modeling high ionic-strength inorganic salt solutions and actinide redox chemistry and solubility, both of which are relevant to the geological repository conditions at the Waste Isolation Pilot Plant in Carlsbad, New Mexico. Mineral solubility data in various inorganic salt solutions were digitized and extracted from figures generated by Harvie et al. (1984). For each of the 60 solubility curves, a case-specific chemistry model and input file were generated in OLI Studio using OLI Stream Analyzer and the MSE (H 3 O + ion) public databank provided by OLI Systems. Model simulation results were exported to Microsoft Excel to calculate summary statistics and to generate graphs comparing the OLI model predictions to the solubility data. Summary statistics include residuals (model – data) and concordance (accuracy × precision, where precision is indicated by the Pearson correlation coefficient and accuracy accounts for bias and scale differential). Private databanks were not developed, and activity coefficient model regressions were not performed to improve OLI model fits to the data. Of the 41 model verification plots, 83% have a mean of the percent residuals less than or equal to 25%. Similarly, 75% display a concordance greater than or equal to 0.75. Only seven of the 41 verification plots fail to show good agreement between the model and data. Of these seven, three are relevant to the WIPP repository because they involve the Mg-OH-Cl-SO 4 -CO 3 aqueous system. The remaining four address salt solubilities at the pH extremes (strong acid and strong base). It should be noted that in two of the three Mg-OH-Cl-SO 4 -CO 3 system cases, the regressed Harvie et al. (1984) solubility curve also deviated from the data. Lack of agreement between the OLI model-predicted solubility curves and the data is attributable to one or more of the following: specific solid species are not included in the OLI MSE databank; there is significant variation among the different solubility datasets chosen by Harvie et al. (1984); the OLI MSE model’s thermodynamic parameters were determined using different solubility datasets; and the activity coefficient parameters for certain relevant ion-ion and ion-molecule pairs have not been optimized via data regression. Two recommendations for future work are to (1) evaluate solubility data for the Mg-OH-Cl-SO 4 -CO 3 system at high ionic strength and, if necessary, develop a private OLI MSE database that includes missing species and, where necessary, regressed standard state properties and interaction parameters; (2) perform similar verification testing of the OLI model for actinide solubility data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Formulation and calibration of two-dimensional constitutive models for composite structures based on panel tests

Steel Plate Concrete (SC) composite members have been widely adopted because of its cost-efficiency and enhanced structural behavior. While researchers have attempted to study its in-plane shear behavior in the past twenty years, very limited number of large-scale pure shear tests were performed due to the challenge of experimental set-up and the availability of facilities. In this paper, a series of uniaxial loading tests and two full-scale pure shear panel tests of SC members were reported, on which the “mechanics-based Membrane Model of SC elements (MM-SC)” is developed. The MM-SC model is based on the fixed-angle crack formulation and the smeared-crack formulation, in which the experimental-based uniaxial constitutive models are implemented, considering the local buckling of faceplate, the tension stiffening of steel plate, the strength degradation of cracked concrete and the confinement effect of concrete. The proposed MM-SC model is subsequently incorporated into the object-oriented software OpenSEES. Finally, the simulation results of proposed model well predict the SC test observations in terms of critical branch points and structural behaviors, including initial stiffness, cracking strength, post-crack stiffness, yield strength, maximum strength, and failure modes.

42 ENGINEERING↗
DOE OSTI2025

Automated segmentation and analysis of point clouds of pier foundations using Pier Inspection and Evaluation Report (PIER)

Pier foundations are commonly used in locations with unstable soil or where other types of foundations are unsuitable or cost prohibitive. A pier foundation consists of vertical columns to support the structure and elevate it above the ground. Common materials for pier foundations include masonry, concrete, timber, and steel. The methods for accurate placement of pier foundations have remained relatively unchanged for decades. For simple installations, construction chalk lines are used to layout the locations of piers to ensure accurate placement and elevation. For more complex installations, surveying instruments operated by trained professionals are employed to accurately locate piers and assess correct elevation before construction. After installation, another survey may need to be performed to assess the quality of the as-built foundation. However, with the advent of terrestrial laser scanners (TLS), the means now exist for contractors to conduct their own assessments of as-built foundations. The major barrier preventing contractors from performing their own assessments of as-built foundation quality is the segmentation and analysis of point cloud data, a skill that often requires a trained user. The objective of this research is to develop a software tool (PIER: Pier Inspection and Evaluation Report) to enable automated segmentation and analysis of point clouds of pier foundations. In this paper, the automated segmentation and analysis algorithms are detailed. A mockup lay out of pier foundations was built using concrete masonry units, and the algorithms were tested to evaluate performance. Limitations of the current algorithms and future research direction are discussed.

Turki, Amine [ORNL]↗
DOE OSTI2021

Dynamic Building Load Control to Facilitate High Penetration of Solar Photovoltaic Generation (Final Technical Report)

Solar photovoltaic (PV) resources are the most common form of distributed generation in residential and commercial customer premises within electric distribution networks. A higher penetration of PV generation in distribution circuits will impose challenges on maintaining service voltages within the range of industry standards, power quality, and power flow. Buildings consume 74% of the electricity produced in the United States, and a significant portion of the building load is dispatchable, making them responsive to electrical grid needs. Oak Ridge National Laboratory—in collaboration with Southern Company; the University of Tennessee, Knoxville; and the Georgia Institute of Technology—is examining the PV integration issues in distribution-level electrical grids and developing integrated demand-side control and communication systems to enable responsive loads. The proposed responsive loads mechanism performs renewable generation following to increase the penetration of solar PV within each feeder. The specific objectives of this project are to (1) examine distribution-level PV integration scenarios to understand requirements, (2) undertake an end-to-end simulation-based design of a distributed control strategy of loads geographically near the PV generation asset to minimize the effect on the distribution feeder, (3) deploy and demonstrate the control technology developed in partnership with utilities, and (4) perform a scalability analysis at the utility scale. This 3-year integrated project aims to develop, demonstrate, and validate demand-side control technology to enable increased the penetration of renewables while mitigating challenges that arise due to their intermittency. Activities in Budget Period (BP) 1 focused on a literature review and the formal design of a control system for integrating local distribution with generation and loads. The team used modeling and simulation to evaluate the impact of varying buildings loads, variable PV generation, and power flow dynamics on the distribution circuit. The dynamic models developed in BP 1 were used in BP 2 to develop a model-based control design and a test bed. The test bed has enabled the simulation-based testing and comparison of different control designs and formulations applied to different configurations of the distribution grid, PVs, and building loads. The control approaches developed in BP 2 were implemented in BP 3 in the form of hardware deployed at the Central Baptist Church (CBC) in Knoxville, Tennessee, for testing and evaluation. The outcome of this project was the development and demonstration of open-source, low-cost, low-touch sensing and control retrofits to distributed PV generation and building loads that, in a coordinated fashion, provide the load-shaping response needed to integrate high levels of renewable penetration. This research addresses the target metrics by dynamically controlling a load with solar generation variability to minimize the extent of two-way power flow, enhance reliability, facilitate high PV penetration (>100% of peak load in a line segment), and generate scalable software and hardware solutions adaptable to any penetration levels. The research and development activities are focused and designed to be impactful within the relevant 2020 targets time frame.An accurate open-source integration simulation framework for end-to-end control design was developed and deployed at the CBC facility for testing and evaluation. This final report provides a detailed review of the technical results achieved during this 3-year integrated project. A novel spectral analysis of PV data is demonstrated to derive the requirements of the control design. A detailed simulation-based analysis of PV integration at increasing penetration levels is presented using 1 year of PV data to demonstrate the impact on the distribution circuits. Two different control strategies were developed and demonstrated via simulation to track variable PV generation with adaptive load dispatch. The report concludes with a summary of accomplishments and recommendations for a path forward.

14 SOLAR ENERGY↗
DOE OSTI2024

Morphology and particle size (MaPS) exercise: testing the applications of image analysis and morphology descriptions for nuclear forensics

Image analysis techniques have been applied and shown to be a valuable tool in nuclear forensics analysis. The interlaboratory exercise reported here has tested quantitative and qualitative approaches for characterizing nuclear materials. Particle size, surface features and morphology descriptions were compared by four laboratories on a common image set generated by Scanning Electron Microscopy and Digital Light Microscopy. Quantitative analysis of the image sets through the Morphological Analysis for MAterials software highlighted the strength of image analysis, but also that the application of the software alone can introduce significant bias in the analysis. Qualitative morphology descriptions following the process outlined by Tamasi et al. (J Radioanal Nuclear Chem 307:1611–1619, 2015) were compared with a discussion on the robustness and reproducibility of the results. Finally, future work should continue to focus on proficiency and standardization of image analysis through continued exercises within the extended nuclear forensics community.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors (Code Version 4.3)

The document compiles in a single volume the verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. The verification of sixteen capabilities of the PLTEMP/ANL Version 4.3 code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis are described and documented. Each chapter of the document deals with the verification or validation of a specific part of the software that calculates a specific phenomenon, e.g., channel flow calculation, coolant property calculation, heat transfer calculation, and flow instability calculation. The software verification work is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The software validation is done by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL verification works that are available in the open literature are simply referenced and not included in the document. PLTEMP/ANL has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors, Volume 2

This is Volume 2 of a two-volume document that collects the verification and validation (V&V) works done for the PLTEMP/ANL code during the years of its development and improvement. Volume 1 describes the V&V of sixteen capabilities of the PLTEMP/ANL code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis. Volume 2 describes the V&V of developments and improvements since the release of PLTEMP/ANL Version 4.3. Each chapter of the document focuses on verifying or validating a specific part of the software that calculates a particular phenomenon, e.g., channel flow calculation, coolant property calculation, heat transfer calculation, and flow instability calculation. Software verification is performed by comparing the code with a hand calculation, Microsoft spreadsheet calculation, Mathematica calculation, or MATLAB calculation. The software validation is achieved by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL V&V works that are available in the open literature are simply referenced in Volume 1 of the document. PLTEMP/ANL has been used in safety analysis reports of several US and foreign research reactors licensed and converted from highly enriched uranium fuel to low-enriched uranium fuel. A list of such reactors is given in Volume 1 of the document.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors, Volume 1

This is Volume 1 of a two-volume document that collects the verification and validation (V&V) works done for the PLTEMP/ANL code during the years of its development and improvement. Volume 1 describes the V&V of sixteen capabilities of the PLTEMP/ANL code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis. Volume 2 describes the V&V of developments and improvements since the release of PLTEMP/ANL Version 4.3. Each chapter of the document focuses on verifying or validating a specific part of the software that calculates a specific phenomenon, e.g., channel flow calculation, coolant property calculation, heat transfer calculation, and flow instability calculation. Software verification is performed by comparing the code with hand calculation, Microsoft spreadsheet calculation, Mathematica calculation, or MATLAB calculation. The software validation is done by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL V&V works that are available in the open literature are simply cited in Volume 1 of the document. PLTEMP/ANL has been used in the safety analysis reports of several US and foreign research reactors licensed and converted from highly enriched uranium fuel to low-enriched uranium fuel. A list of such reactors is given in Volume 1 of the document.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

M-Star® Software Test and Verification for Impeller Mixing in a Tank

Before a sample of the Slurry Mix Evaporator (SME) can be taken, the SME product sampling procedure requires that the agitator power be stable between 20 and 30 kW for at least one hour. The SME transfer to Melter Feed Tank (MFT) procedure also requires the SME agitator power be stabilized between 20 and 30 kW prior to transfer. These requirements are specified to ensure samples are homogeneous, as discussed in the Waste Form Qualification Report. During SME Batch 804, the agitator power dropped to 19 kW and struggled to achieve and maintain 20 kW. It was later discovered that the cause of the power drop was due to one of the bottom blades of the agitator breaking off. Both the sample and the transfer occurred without the power stabilizing between 20 and 30 kW. Therefore, the quality of SME Batch 804 is indeterminate, and homogeneity was questionable.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Industry Level Integrated Fire Modeling Using Fire Risk Investigation in 3D (FRI3D)

The software Fire Risk Investigation in 3D (FRI3D) has been developed over the last 2 years to integrate 3D spatial modeling with existing fire probabilistic risk assessment (PRA) models and fire simulation codes. The goal of this research and development is to automate many of the fire analysis manual tasks to reduce industry efforts in the initial fire modeling and operational costs for the model maintenance and evaluations required during normal plant operations. The tasks for Fiscal Year (FY) 2021 include first testing the FRI3D modeling capabilities by importing an industry fire model into FRI3D and making a 3D model of a complex/high-risk significant area. (For this work, the switchgear room was chosen.) Then, the second task of FY 2021 is to develop a dynamic fire PRA process that can help optimize traditional fire PRA models. The switchgear room model will be used for the dynamic fire PRA work. This report describes the work and insights learned when using FRI3D software to model both a Nuclear Regulatory Report (NUREG) example models and a full industry switchgear room.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Wireless System Development for GaN-Based Transmitters for Advanced Nuclear Reactor Environments

The market for consumer electronics is dominated by Si-based electronics. Many Si-based complementary metal–oxide–semiconductor (CMOS) devices are reaching their limitations in terms of switching frequencies, voltages, currents, and temperatures. Furthermore, these devices are widely known to be susceptible to ionizing radiation and neutrons. Advanced nuclear reactors, especially microreactors and small modular reactors, require wireless electronics that can survive larger neutron and gamma doses than Si CMOS. Because of their size, electronics will need to be placed closer to the reactor cores, and cabling capabilities may be limited. However, GaN high-electron-mobility transistors (HEMTs) have been shown to switch faster with higher gains, and they can achieve current and voltage limits beyond traditional Si CMOS. However, they have less market maturity and have undergone less testing. These GaN HEMTs have been shown to survive ionizing radiation with little effects, but the effects of neutron radiation remain widely unknown. In this report, a wireless electronic system capable of supporting multiple radiation-hardened (rad-hard) sensors is presented. The proposed transmission scheme was designed to be simple to increase the likelihood of success in the immature GaN HEMT process and in high-radiation environments. The transmission system was tested using software-defined radios to emulate the transmission scheme before the transmitter circuitry in the GaN process was developed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

User Manual for the Thermal Hydraulic Code SE2RCT

SE2-ANL is a modified version of SUPERENERGY-2 which interfaces the power distribution in the ANL maintained physics codes for the user. SE2RCT is a special version of SE2-ANL developed for specific use on models of the Experimental Breeder Reactor-II (EBR-II). SE2RCT fulfills a specific role in the calculated results as part of the Fuels Irradiation and Physics Database (FIPD) and is built to connect with the Physics and Analysis DataBase (PADB) for metallic fuel research and development in advanced sodium-cooled fast reactors (SFRs) created for EBR-II. SE2RCT is primarily a thermal analysis code that interfaces with the RCT based pin power details instead of the built-in pin power dehomogenization strategy in SE2-ANL. Beyond the thermal hydraulic calculation, the SE2RCT code provides detailed axial distributions of the RCT calculated results. SE2RCT also calculates the the axial distribution of pin wise DPA for the cladding materials which is part of the FIPD calculated results. This report serves as the user manual for SE2RCT and thus eliminates the QA gap of missing documentation on the SE2RCT software. All of the features and limitations of SE2RCT are documented in this report. The input and output specifications of SE2RCT are discussed in detail, and some unique features of SE2RCT, e.g. accurate pin power and temperature results for problems with non-uniform composition within an assembly, are also demonstrated and tested.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Radiological Recovery Logistics Tool - 20161

Argonne is building and testing a tool, the Radiological Recovery Logistics Tool (RRLT), that can be used during the response and recovery from a radiological or nuclear incident to effectively allocate appropriate commercial and public works equipment to mitigate, remove, and contain radiological contamination. The requirements for this tool - as well as development of the resulting software - is overseen by a steering committee of stakeholders from DHS's National Urban Security Technology Laboratory (NUSTL), the Federal Emergency Management Agency (FEMA), and the Environmental Protection Agency (EPA). One essential requirement is for RRLT to support the efficient and appropriate allocation of resources for a radiological response. Subsequent discussions between ANL and stakeholders have solidified the nature of this support to include identification of the types of resources to be allocated. The study reported in this paper has both factored fundamental concepts and connections out of this identification process and created a Knowledge Base detailing support goals, response scenarios, and efficacy information on dozens of equipment types. In short, RRLT will dynamically apply these findings to situational conditions surrounding contamination incidents. RRLT's Domain, the model of elements, ideas and relationships with which the tool will work, draws concepts from technical reports and stakeholder vocabularies to connect response goals and scenarios to types of equipment that offer utility towards those goals in those scenarios. RRLT's Knowledge Base will contain details on dozens of equipment types and facilitate the operator's discovery and consumption of these details most pertinent to a dynamically selected subset of goals. The core of its Domain Model is based on a report authored by this team. This report [1] contains a comprehensive list of proposed equipment to accomplish various missions or scenarios that might arise after a large-scale radiological contamination incident in an urban environment or critical infrastructure. The report divides potential response and recovery efforts into five support goals: Survey and monitoring of the contaminated area; Mitigation of received dose to first responders: Decontamination (gross and final) of buildings, vehicles, roadways, parks, and other surfaces: Waste management of solid waste generated during recovery operations: and Containment of wastewater and other waste generated during the response and recovery phases. RRLT's development is driven by use cases. A use case is an intention with which a user approaches the software. Use cases are grouped into delivery increments to schedule development, testing, and presentation to stakeholders. This model partitions the system into seven increments: User Arrival and Authentication, Search and Navigation, Equipment Recommendation, Plan Management, Content Management, and Expanded Access. Once a user 15 authenticated, RRLT will present the user with a dashboard that allows them to explore or search RRLT's content. The dashboard will also include a 'Plan' panel for collecting decisions and relevant observations about an incident at hand to facilitate development of an equipment list. RRLT will offer three general modes of access to items in the knowledge base: - Keyword search for direct discovery of items, - Navigation along predetermined paths from recovery goal towards equipment types, and - Interactive guidance towards equipment types by an autonomous software agent: the Equipment Recommendation Wizard. This presentation will detail progress in the development of the RRLT and also discuss opportunities for those interested in providing feedback on its content and functionality. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Prioritizing ICS Beachhead Systems for Cyber Vulnerability Testing

Cyber Testing for Resilient Industrial Control Systems™ (CyTRICS™) is the Department of Energy’s (DOE’s) program for cybersecurity vulnerability testing, digital subcomponent enumeration, and forensic assessment. CyTRICS leverages best-in-class test facilities and analytic capabilities at six DOE National Laboratories and strategic partnerships with key stakeholders including technology developers, manufacturers, asset owners and operators, and interagency partners. During the program’s development, CyTRICS established a unique methodology for prioritizing digital components within operational technology (OT) and industrial control systems (ICS) in the Energy Sector Industrial Base (ESIB) for cyber vulnerability testing. The CyTRICS Prioritization Process leverages multiple characteristics of systems, components, and their contextual deployment to calculate a quantification of individual digital components for CyTRICS testing. The initial version of the CyTRICS Prioritization Process was premised largely upon the impact which could result to an industrial control system if the digital component under testing was compromised, either through malicious means, faulty engineering, or other modes. The worldwide compromise of the SolarWinds Orion platform, first reported in December 2020, through malicious interference with the digital patching cycle was a watershed event in cyber supply chain security. The SolarWinds compromised demonstrated the strategic importance of certain types of ubiquitous software, and the ability to generate widespread cybersecurity effects. To address this challenge and as a part of the Department of Energy’s response to the SolarWinds compromise, DOE’s Office of Cybersecurity, Energy Security, and Emergency Response (CESER) directed the National Laboratories to evolve the CyTRICS Prioritization Process methodology to encompass additional factors related to the strategic importance of digital components. CESER directed CyTRICS researchers to identify, characterize, and append strategic factors to the CyTRICS Prioritization Process to provide additional weight to these characteristics. National Laboratory expert researchers identified functionality, distribution, and platform characteristics for digital components in ICS and OT that they assessed would be likely targeted in strategic initial-access cyber attack. CyTRICS has termed these factors “ICS Beachhead Systems,” leveraging a definition first advanced by Schneider Electric, which is intended as a blanket term to encompass digital components, products, and systems in OT. This paper describes the ICS Beachhead Systems identified and the rationale for inclusion. As a next step in the research and refinement process, the National Laboratories will validate this initial set of characteristics against digital components evaluated by the CyTRICS program and current implementation of the CyTRICS Prioritization Process. After validation, CyTRICS researchers will then develop a scoring methodology to generate a quantitative score to assess the degree to which a digital component is characterized as an ICS Beachhead System. Finally, the National Laboratories will append this scoring to the existing CyTRICS Prioritization Process algorithm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

DFTT report for Signal Analysis (2023)

The Detection Framework Testbed and Toolkit (DFTT) is a database and associated java programs intended to facilitate the development and testing of algorithms for operating suites of correlation and subspace detectors. This framework is a generalization of the system described in Harris and Dodge (2011) and Dodge and Harris (2016). DFTT allows retrospective processing of sequences of data using various system configurations. Results are saved in a database, so it is easy to compare the results obtained using different configurations of the system. The principal software components of DFTT are the ConfigCreator, the framework_runner and the Builder program. ConfigCreator assembles the files necessary to define a particular configuration used for processing. The framework_runner operates suites of detectors and saves the results in an Oracle™ database. Builder allows visual examination of templates and detected signals and allows editing and creation of detectors. In addition, there are tools for importing continuous data into the database. DFTT is licensed under the MIT license and has LLNL release number LLNL-CODE-801881. In the current fiscal year DFTT has been used in two different projects. The first (NTL-funded) project investigates the feasibility of screening nuisance detections using correlation detectors. The second (GNEM-funded) project seeks to extend the results of Harris and Dodge (2021) to 3- D sources and multiple stations. Each of these efforts required that additional functionality be added to DFTT. In this report I will summarize the enhancements to DFTT in the context of the relevant research effort.

58 GEOSCIENCES↗
DOE OSTI2020

FY20 Proxy App Suite Release: Report for ECP Proxy App Project Milestone ADCD-504-10

Version 4.0 of the ECP Proxy App Suite is practically unchanged from the previous release. The current set of proxies has proven useful for many aspects of benchmarking and co-design and we see little reason to alter the suite. Although there have been few changes to the ECP suite, the team has been hard at work in other areas. In the area of Machine Learning (ML) we have now created a separate proxy suite dedicated to this scientific applications of ML. The suite includes: miniGAN (Generative Adversarial Networks), miniRL (Reinforcement Learning), CRADL (inline inference), Cosmoflow-Benchmark (Convolutional Neural Network), and MLPerf-DeepCam (Climate Segmentation Benchmark). Section 3 contains more information about these proxies as well as the principles that are guiding the development of the suite. We have surveyed available proxies for several application domains including Computational Fluid Dynamics, Quantum Chemistry, Quantum Computing Simulation, Molecular Dynamics, Monte Carlo Transport, and Density Functional Theory to identify gaps in proxy coverage. Several new proxy apps are either already available or will be released soon to fill these gaps. Section 4 provides full details. Finally, section 5 reports on our continued collaboration with the ECP Continuous Integration (CI) effort to use proxy apps to help identify problems and roadblocks to cross-lab CI. We have also assisted the El Capitan Center of Excellence (COE) to stand up a CI system that will be used to test releases of HPE and AMD software stacks. We hope that the COE effort can serve as a model for ECP by showing how the Proxy App Team can work with AD and ST teams identify critical features, kernels, patterns, etc. and incorporate them into a CI system that will help ensure that Frontier and Aurora will provide those needed capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

PV Validation Hub

The Validation Hub will be a clearinghouse for the transfer of novel algorithms and software from the PV research community to industry. Potential algorithms tested in the Hub could include the estimation of various PV loss factors and the detection of various operational issues. The primary function of the Hub will be for developers to submit executable code which will run on hosted data sets. Developers will receive private reports on the accuracy and performance (e.g., run-time) of the submitted algorithms, and public high level summaries will be hosted. These summaries will indicate the organization who submitted the algorithm (e.g., links to GitHub pages, documentation websites, etc.), high-level accuracy metrics, and standardized performance metrics. These results will be stored in a publicly available database, accessible through the Hub, with the ability for users to sort and filter the results. In short, the Hub will be presented to public users as a collection of interactive leaderboards, organized around specific analysis tasks pertinent to the PV data science community. These tasks include things such as the estimation of various PV loss factors and the detection of various operational issues. We will present progress on the development of this hub, including preliminary results of comparative validation of PV data science algorithms and progress towards building the platform itself.

algorithm↗