Development of the CMS Phase2 Outer Tracker Analyzer Of Test Outputs (POTATO) software
Explore the source record for details and available documents.
Marchisio Caprioglio, Matteo [Fermilab]↗
SEARCH · Engineering Papers
Results for “software testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Testing of Scientific Software: Impacts on Research Credibility, Development productivity, Maturation, and Sustainability
Abstract not provided
97 MATHEMATICS AND COMPUTING↗
Monitoring Helium Cryogen Usage with iFix Software at IB1 Test Facility
At the IB1 facility of the Applied Physics and Superconducting Technology Directorate within the Cryogenic Division at Fermilab, Liquid Helium is essential to the testing activities. The test stands require large amounts of Helium to test the thermal and superconducting cavities and magnets. The Liquid Helium that enters the test stand is monitored through a series of valves and controls to determine the start and stop for monitoring time. There are 3 phases of cryogen usage that must be considered for each stand, cooldown, warming and overnight mode. With a new system in place, cold hour tracking will be more objective and precise within each test stand ensuring better calculations for User s fees which are charged to various groups that employ the facility and aid replenishment of Helium and continual operation at IB1.
Trillo, Angelica↗
Software for Tool Design and Testing
Abstract—: The development of software for calculating the cutting parameters in the course of machining or in simulations is discussed. The software developed may be used to create and test new cutting tools.
42 ENGINEERING↗
IBPSA Project 2 BOPTEST: An update on the test cases available in the framework for testing advanced control strategies in buildings
Project 2 develops software infrastructure, test cases, and extensions for the Building Optimization Testing Framework (BOPTEST) to address the expanding needs of building and urban energy system controls through open international collaboration. This paper provides an overview of the new test cases available as of BOPTEST version 0.7.1. Each test case is developed using open-source Modelica libraries and Spawn of EnergyPlus, enabling the creation of high-fidelity building models that incorporate envelope dynamics, Heating Ventilation and Air Conditioning (HVAC) systems, and explicit control representations. Currently, eight test cases are available, with five additional cases under development. These test cases cover a wide range of climates, building types, and HVAC systems. This paper compiles and summarizes test case descriptions, cites original manuscripts that developed them for a more detailed description, and reports baseline control performance metrics. Furthermore, two example applications are presented: one illustrating different levels of control, from supervisory to low-level, and another demonstrating how Model Predictive Control (MPC) solutions must be adapted from continuous to integer to control some building actuators.
Zanetti, Ettore↗
Single-Bar SMT Testing on Alloy 617 using Software Controls
INL has performed simplified model testing using a variable in the software control program to compare with the testing performed at ORNL, which uses hardware to modify the control signal. The INL tests compared well with the ORNL tests, showing similar stress and strain values, as well as similarly shaped hysteresis loops. This demonstrates that possibility of performing simplified model testing without any hardware modifications.
36 MATERIALS SCIENCE↗
Named Data Networking for DER Cybersecurity
We present our research findings on the novel NDN protocol. In this work, we defined key attack scenarios for possible exploitation and detail software security testing procedures to evaluate the security of the NDN software. This work was done in the context of distributed energy resources (DER). The software security testing included an execution of unit tests and static code analyses to better understand the software rigor and the security that has been implemented. The results from the penetration testing are presented. Recommendations are discussed to provide additional defense for secure end-to-end NDN communications.
97 MATHEMATICS AND COMPUTING↗
Functional Testing Protocols for Commercial Building Efficiency Baseline Modeling Software
This document describes procedures for testing and validating proprietary baseline energy modeling software accuracy in predicting energy use over the period of interest, such as a month or a year. The procedures are designed according to the methodology used for public domain baselining software in another LBNL report that was (like the present report) prepared for Pacific Gas and Electric Company: ?Commercial Building Energy Baseline Modeling Software: Performance Metrics and Method Testing with Open Source Models and Implications for Proprietary Software Testing Protocols? (referred to here as the ?Model Analysis Report?). The test procedure focuses on the quality of the software?s predictions rather than on the specific algorithms used to predict energy use. In this way the software vendor is not required to divulge or share proprietary information about how their software works, while enabling stakeholders to assess its performance.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
ComPort: Rigorous Testing Methods to Safeguard Software Porting (Final UW Report)
This report summarizes the University of Washington’s contributions to the ComPort project, Rigorous Testing Methods to Safeguard Software Porting, funded under the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research (ASCR), award number DE-SC0022081. UW’s work addressed numerics-driven correctness challenges arising in heterogeneous and rapidly evolving computing environments. Our efforts focused on developing interactive analysis tools, correctness-preserving rewriting systems, semantic-aware code-transformation infrastructure, and multi-language support for reproducible numerical experiments.
97 MATHEMATICS AND COMPUTING↗
Method of Test for Evaluating Building Performance Simulation Software
ANSI/ASHRAE Standard 140 Method of Test for Evaluating Building Performance Simulation Software specifies the method to test the core competency of building performance simulation (BPS) software, a broad class of software which includes building energy modeling (BEM) software. Standard 140 has been widely used by BEM software vendors to help diagnose and compare the results from the program with other modeling programs. The Standard is also referenced by codes, standards, government programs, and other incentive programs as a part of minimum requirements for qualifying BEM software. The explanatory information, summary tables and figures in this 140 User’s Manual (referred to as “this Manual”) are provided to help users in implementing various suites of tests specified in Standard 140-2023 (referred to in this manual as “Standard 140” or “the Standard”).
97 MATHEMATICS AND COMPUTING↗
REALIZATION OF A AUTOMATED T-WAY COMBINATORIAL TESTING APPROACH FOR A SOFTWARE BASED EMBEDDED DIGITAL DEVICE
Under the Department of Energy’s Light Water Reactor Sustainability Program, within the Plant Modernization research pathway, the Digital I&C Qualification Project is identifying new methods that would be beneficial in qualifying digital I&C systems and devices for safety-related usage. One such method that would be useful in qualifying field components such as sensors and actuators is the concept of testability. The Nuclear Regulatory Commission (NRC) considers testability to be one of two design attributes sufficient to eliminate consideration of software-based or software logic-based common cause failure (the other being diversity). The NRC defines acceptable “testability” as follows: Testability – A system is sufficiently simple such that every possible combination of inputs and every possible sequence of device states are tested and all outputs are verified for every case (100% tested). [NUREG 0800, Chapter 7, Branch Technical Position (BTP) 7-19] This qualification method has never proven to be practical in view of the very large number of combinations of inputs and sequences of device states for a typical I&C device. However, many of these combinations are not unique in the sense that they represent the same state space or in that that they represent state space that would not affect the critical design basis functions of the device. Therefore, the state space of interest might possibly be reduced to a manageable dimension through such analysis. This project will focus on a representative I&C device similar in design, function, and complexity to the types of devices that would likely be deployed in nuclear power plants as digital or software based sensors and actuators (e.g. Smart Sensors). Analysis will be conducted to determine the feasibility of testing this device in a manner consistent with the NRC definition. This report describes the development of test process for Bounded Exhaustive Testing with respect to Combinatorial Test (CT) methods. The report describes the candidate Device Under Test SW – the VCU smart sensor, conceptual experimental methods for stated test objectives, description of the process, tools, resources, and computing. This information will be used to fully develop a detailed test plan (based on statistical measure needs) and test environment for conducting an I&C device testability demonstration study. The future planed experimental study of this project is to demonstrate digital qualification via Bounded Exhaustive Testability with respect to Common Cause Failure.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
SU-E-T-106: Development of a Collision Prediction Algorithm for Determining Problematic Geometry for SBRT Treatments Using a Stereotactic Body Frame
Purpose: Collision between the gantry and the couch or patient during Radiotherapy is not a common concern for conventional RT (static fields or arc). With the increase in the application of stereotactic planning techniques to the body, collisions have become a greater concern. Non-coplanar beam geometry is desirable in stereotatic treatments in order to achieve sharp gradients and a high conformality. Non-coplanar geometry is less intuitive in the body and often requires an iterative process of planning and dry runs to guarantee deliverability. Methods: Purpose written software was developed in order to predict the likelihood of collision between the head of the gantry and the couch, patient or stereotatic body frame. Using the DICOM plan and structures set, exported by the treatment planning system, this software is able to predict the possibility of a collision. Given the plan's isocenter, treatment geometry and exterior contours, the software is able to determine if a particular beam/arc is clinically deliverable or if collision is imminent. Results: The software was tested on real world treatment plans with untreatable beam geometry. Both static non-coplanar and VMAT plans were tested. Of these, the collision prediction software could identify all as having potentially problematic geometry. Re-plans of the same cases were also tested and validated as deliverable. Conclusion: This software is capable of giving good initial indication of deliverability for treatment plans that utilize complex geometry (SBRT) or have lateral isocenters. This software is not intended to replace the standard pre-treatment QA dry run. The effectiveness is limited to those portions of the patient and immobilization devices that have been included in the simulation CT and contoured in the planning system. It will however aid the planner in reducing the iterations required to create complex treatment geometries necessary to achieve ideal conformality and organ sparing.
60 APPLIED LIFE SCIENCES↗
"Who Has Plots?": Contextualizing Scientific Software, Practice, and Visualizations
We present that software is an integral element of the work of science yet it is not commonly an object of inquiry in studies of scientific infrastructures. This paper presents findings from an ethnographic study of a cosmology group's collaborative scientific software production. We demonstrate how these cosmologists use plots to simultaneously test their software and analyze data while interrogating multiple layers of infrastructural components. We broaden perspectives on scientific software development using a sociotechnical, software studies lens to examine this work of scientific discovery as a creative and embodied, yet exacting and methodical, activity that requires a 'human in the loop'. Here, we offer a new reading of scientific software practices to convey how creating scientific software is often really the act of doing science itself--an intervention we believe is necessary to more successfully support scientific software sharing and infrastructure production.
97 MATHEMATICS AND COMPUTING↗
Test GammaPix™ Radiation Detection Software with Smartphones
GammaPix™ is a smartphone application that uses smartphone cameras to detect ionizing radiation. Brookhaven National Laboratory (BNL) evaluated the performance of the software in detecting radioactive materials. For this purpose, a series of tests were conducted at the Radiation Calibration Facility Annex at BNL. The experiments included dose measurements with three types of NIST-traceable calibration sources, 60Co, 241Am, and 137Cs. The recorded results by GammaPix™ were compared with the values measured by calibrated dosimeters to determine the detection thresholds. Several selected models of iPhones and Android cell phones with different pixel sizes and resolution were tested. In this paper, we present the test procedures and discuss the test results.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Single-Bar SMT Creep-Fatigue Testing on Alloy 617 with Software Controls on elastic Follow-Up Feedback in Support of New Creep-Fatigue Design Methodology
The Simplified Model Test (SMT) is one of the alternative ways to calculate the creep-fatigue damage of elevated temperature components. The SMT approach unifies the creep and fatigue damage, simplifying the damage calculation process with improved accuracy. Traditionally, SMT tests has have been conducted through the two bars: first is the driver bar and second is the test bar. The driver bar stays elastic and imposes the confinement to the second bar. This experimental procedure requires two test frames and a large test specimen, which limits the test parameter range and accessibility of this testing procedures. Hence, a single-bar SMT (SB-SMT) tests has been developed to simplify complexity in SMT experiment setup. The software-controlled SB-SMT test process has been introduced which completely replaces the driver bar. This paper discusses the single-bar SMT (SB-SMT) test procedure with software controls. The challenges and critical parameters in the software-controlled SB-SMT procedure are addresses addressed and recommendations are provided. A scoping test with a set of wider strain range, elastic follow-ups and dwell time validated the proposed test procedure.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
A Software Developer’s Guide to Informal Evaluation of Visual Analytics Environments Using VAST Challenge Information
The VAST Challenge has been a popular venue for academic and industry participants for over ten years. Many participants comment that the majority of their time in preparing VAST Challenge entries is discovering elements in their software environments that need to be redesigned in order to solve the given task. Fortunately, there is no need to wait until the VAST Challenge is announced to test out software systems. The Visual Analytics Benchmark Repository contains all past VAST Challenge tasks, data, solutions and submissions. This paper details the various types of evaluations that may be conducted using the Repository information. In this paper we describe how developers can do informal evaluations of various aspects of their visual analytics environments using VAST Challenge information. Aspects that can be evaluated include the appropriateness of the software for various tasks, the various data types and formats that can be accommodated, the effectiveness and efficiency of the process supported by the software, and the intuitiveness of the visualizations and interactions. Researchers can compare their visualizations and interactions to those submitted to determine novelty. In addition, the paper provides pointers to various guidelines that software teams can use to evaluate the usability of their software. While these evaluations are not a replacement for formal evaluation methods, this information can be extremely useful during the development of visual analytics environments.
evaluation↗
SU-F-P-54: Guidelines to Check Image Registration QA of a Clinical Deformation Registration Software: A Single Institution Preliminary Study
Purpose: The objective of this study is to verify and analyze the accuracy of a clinical deformable image registration (DIR) software. Methods: To test clinical DIR software qualitatively and quantitatively, we focused on lung radiotherapy and analyzed a single (Lung) patient CT scan. Artificial anatomical changes were applied to account for daily variations during the course of treatment including the planning target volume (PTV) and organs at risk (OAR). The primary CT (pCT) and the structure set (pST) was deformed with commercial tool (ImSimQA-Oncology Systems Limited) and after artificial deformation (dCT and dST) sent to another commercial tool (VelocityAI-Varian Medical Systems). In Velocity, the deformed CT and structures (dCT and dST) were inversely deformed back to original primary CT (dbpCT and dbpST). We compared the dbpST and pST structure sets using similarity metrics. Furthermore, a binary deformation field vector (BDF) was created and sent to ImSimQA software for comparison with known “ground truth” deformation vector fields (DVF). Results: An image similarity comparison was made by using “ground truth” DVF and “deformed output” BDF with an output of normalized “cross correlation (CC)” and “mutual information (MI)” in ImSimQA software. Results for the lung case were MI=0.66 and CC=0.99. The artificial structure deformation in both pST and dbpST was analyzed using DICE coefficient, mean distance to conformity (MDC) and deformation field error volume histogram (DFEVH) by comparing them before and after inverse deformation. We have noticed inadequate structure match for CTV, ITV and PTV due to close proximity of heart and overall affected by lung expansion. Conclusion: We have seen similarity between pCT and dbpCT but not so well between pST and dbpST, because of inadequate structure deformation in clinical DIR system. This system based quality assurance test will prepare us for adopting the guidelines of upcoming AAPM task group 132 protocol.
60 APPLIED LIFE SCIENCES↗
Debugging high-performance computing applications at massive scales
In this work, dynamic analysis techniques help programmers find the root cause of bugs in large-scale parallel applications.
97 MATHEMATICS AND COMPUTING↗