Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Implementation of Plot File Testing in the DYNA3D/ParaDyn Software Quality Assurance Suite

Automated testing of DYNA3D/ParaDyn plot files was added to the DYNA3D/ParaDyn software quality assurance (SQA) test suite. The new capability extracts select data from the plot files generated during each verification run and compares it to the same baseline answers used to verify the problem. Deviations between baseline answers and plot file values are reported in the same manner as solution discrepancies, and differences in precision levels between the baseline answers and plot file results are accounted for. The new testing leverages the existing SQA test suite framework and test problems and the Python Mili reader and minimally increases the overall run time (< 5%) of the SQA test suite. This new capability provides incremental end-toend testing of the most common DYNA3D/ParaDyn simulation workflows.

42 ENGINEERING↗

Reaction Rover

Reaction Rover is a software application designed to enable reaction optimization with little or no human intervention and to provide a flexible platform to facilitate rapid testing, automation, and implementation of new reaction optimization algorithms. Toward these goals, Reaction Rover is designed to be modular, allowing the optimization algorithm, analyzer, and reactor components to be changed for any given process using easily integrated plugins. The Reaction Rover platform is a key development that enables the testing, use, and automation of machine learning (ML) and non-ML optimizers in a variety of laboratory situations.

Windus, Theresa↗

An automatic input/output test experience of FPGA-based logic controller with I/O stimulator - 282

This paper describes an automatic testing approach instead of a traditional manual test for an FPGA-based Logic Controller (FLC). It mainly describes an automatic testing of FLC using an I/O stimulator with the initiated manual action. The FLC was developed by Doosan Heavy Industry and KAERI in S. Korea. We also developed a test-bed like I/O stimulator for a burning test based on the operational scenario. Signal sources from the I/O stimulator contain an analog input, an analog output, a digital input and a digital output, a programmable power supply, an RS232C serial interface, and a dual port Ethernet interface. LabVIEW Programming was used for the automatic testing. The FLC consists of a general processor module (FPM-01), a complex processor module (FPM-02), analog input modules (FAI-01), analog output modules (FAO-01), digital input modules (FDI-01), digital output modules (FDO-01), a data link module (FDL-01), and a network module (FNW-01). Among these, in this paper, automatic digital I/O testing and automatic analog I/O testing are described. In addition, for the accuracy of the automatic testing, two graphic recorders are used. One is the output results of general processor based testing, and the other is the output results of complex processor based testing. These are different company products. Redundancy recording was found in the test results. The test results were synchronized internally with the existing I/O stimulator and externally with two graphic recorders. Calibrations of all of the equipment were made before the system testing. Before the testing started, a test plan and the test procedure were set up in advance, and we performed test scenario-based automatic functional testing for the FLC as the qualification process. It can be several executed depending on the scenario and conditional parameters of the test. For validation of the accuracy and reliability in our automated test, manual testing was also performed. Manual tests were conducted in two ways. The first one was a manual test using Fluke 754 and Fluke 715. The other one was using embedded manual features of the I/O stimulator. By performing the automatic input and output testing using the I/O stimulator, the time and expense of FLC testing can be reduced significantly compared with a conventional manual test. We rechecked the automatic test results using Fluke754 manually. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Verification test suite for systems analysis tools

This report documents strategies and test problems to support Verification and Validation (V&V) of the systems analysis tools currently being developed under the Reactor Product Line (RPL) of DOE’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. A suite of verification test cases has been developed. This test suite supports development of new codes as well as maintenance of existing codes. For advanced tools that are under development like RELAP-7 for light water reactor analysis [1] and the MOOSE based component models for SFR (M-SFR) analyses [2], verification of simulation results must be performed throughout the entire development phase. This test suite is also useful for established codes as part of automated testing to ensure that general code maintenance does not change existing results.

Sumner, T.↗

Design and Implementation of Automated Characterization of T-type based Power Module for PV Inverter Reliability Assessment

Reliability of power electronics holds the key for future power and energy systems since it is essential for system integration with renewables and energy storage systems. Variation of power module characteristics over the converter’s operational lifetime is a critical indicator to assess its reliability. Device characterization consists of different steps to collect, process, and visualize results, which is usually time-consuming, especially for power modules based on a non-phase-leg configuration, such as T-type circuits, widely applied for PV inverters. To reduce the time, ensure repeatability, and guarantee consistency, an automated test bench can be helpful. This paper focuses on a T-type-based power module and proposes a unique characterization platform and corresponding automation procedure and implementation. Considering the major characterization difference between T-type power modules over the conventional phase-leg power module, first, the special consideration for static characterization is highlighted. Second, the unique dynamic characterization design associated with the T-type power module is described. Finally, the automation of the power module characterization and the test platform is presented along with results and special considerations.

Siraj, Ahmed↗

UQpy v4.1: Uncertainty quantification with Python

This paper presents the latest improvements introduced in Version 4 of the UQpy, Uncertainty Quantification with Python, library. In the latest version, the code was restructured to conform with the latest Python coding conventions, refactored to simplify previous tightly coupled features, and improve its extensibility and modularity. To improve the robustness of UQpy, software engineering best practices were adopted. A new software development workflow significantly improved collaboration between team members, and continuous integration and automated testing ensured the robustness and reliability of software performance. Continuous deployment of UQpy allowed its automated packaging and distribution in system agnostic format via multiple channels, while a Docker image enables the use of the toolbox regardless of operating system limitations.

97 MATHEMATICS AND COMPUTING↗

Modifying Network Guided Vehicle for Repeatable EcoCAR ACC Energy Testing

The newest iteration of the Department of Energy (DOE) Advanced Vehicle Technology Competitions is the EcoCAR Mobility Challenge. In this paper, ANL and HORIBA MIRA collaborate to propose and pilot a test method that enables controlled, repeatable track-based energy consumption testing of semi-autonomous features. The testing was performed at MIRA’s proving ground facility in Nuneaton, UK, using their Network Guided Vehicle (NGV) connectivity and automation test platform. The NGV served as a repeatable lead vehicle following prescribed drive traces around two different track circuits while the host vehicle under test, a Honda Civic with full speed range Adaptive Cruise Control, followed behind. Over the course of a two day test, multiple iterations of certification and custom EPA drive traces were performed on track, demonstrating the viability of a two vehicle energy test. Results were analyzed to assess NGV lead vehicle performance in following the prescribed cycle using SAE J2951 standard calculations in an effort to quantify how repeatably and accurately the lead vehicle followed the trace. Host vehicle energy consumption was assessed using both vehicle CAN bus monitoring and an on-board fuel flow meter.

ACC↗

SU-E-T-27: A Tool for Routine Quality Assurance of Radiotherapy Dose Calculation Software

Purpose: Dose calculation software is thoroughly evaluated when it is commissioned; however, evaluation of periodic software updates is typically limited in scope due to staffing constraints and the need to quickly return the treatment planning system to clinical service. We developed a tool for quickly and comprehensively testing and documenting dose calculation software against measured data. Methods: A tool was developed using MatLab (The MathWorks, Natick, MA) for evaluation of dose calculation algorithms against measured data. Inputs to the tool are measured data, reference DICOM RT PLAN files describing the measurements, and dose calculations in DICOM format. The tool consists of a collection of extensible modules that can perform analysis of point dose, depth dose curves, and profiles using dose difference, distance-to-agreement, and the gamma-index. Each module generates a report subsection that is incorporated into a master template, which is converted to final form in portable document format (PDF). Results: After each change to the treatment planning system, a report can be generated in approximately 90 minutes. The tool has been in use for more than 5 years, spanning 5 versions of the eMC and 4 versions of the AAA. We have detected changes to the algorithms that affected clinical practice once during this period. Conclusion: Our tool provides an efficient method for quality assurance of dose calculation software, providing a complete set of tests for an update. Future work includes the addition of plan level tests, allowing incorporation of, for example, the TG-119 test suite for IMRT, and integration with the treatment planning system via an application programming interface. Integration with the planning system will permit fully-automated testing and reporting at scheduled intervals.

07 ISOTOPE AND RADIATION SOURCES↗

HDTS 2017.0 Testing and verification document

This report is a continuation of the series of Hunter Dose Tracking System (HDTS) Quality Assurance documents including (Foley and Powell, 2010; Dixon, 2012). In this report we have created a suite of automated test cases and a system to analyze the results of those tests as well as documented the methodology to ensure the field system performs within specifications. The software test cases cover all of the functions and interactions of functions that are practical to test. With the developed framework, if software defects are discovered, it will be easy to create one or more test cases to reproduce the defect and ensure that code changes correct the defect. These tests con rm HDTS version 2017.0 performs according to its specifications and documentation and that its performance meets the needs of its users at the Savannah River Site.

97 MATHEMATICS AND COMPUTING↗

Software development infrastructure for the HYBRID modeling and simulation project

One of the goals of the HYBRID modeling and simulation project is to assess the economic viability of hybrid systems in a market that contains renewable energy sources like wind. The idea is that it is possible for the nuclear plant to sell non-electric energy cushions, which absorb (at least partially) the volatility introduced by the renewable energy sources. This system is currently modeled in the Modelica programming language. To assess the economics of the system, an optimization procedure is trying to find the minimal cost of electricity production. The RAVEN code is used as a driver for the whole problem. It is assumed that at this stage, the HYBRID modeling and simulation framework can be classified as non-safety “research and development” software. The associated quality level is Quality Level 3 software. This imposes low requirements on quality control, testing and documentation. The quality level could change as the application development continues.Despite the low quality requirement level, a workflow for the HYBRID developers has been defined that include a coding standard and some documentation and testing requirements. The repository performs automated unit testing of contributed models. The automated testing is achieved via an open-source python script called BuildingsP from Lawrence Berkeley National Lab. BuildingsPy runs Modelica simulation tests using Dymola in an automated manner and generates and runs unit tests from Modelica scripts written by developers. In order to assure effective communication between the different national laboratories a biweekly videoconference has been set-up, where developers can report their progress and issues. In addition, periodic face-face meetings are organized intended to discuss high-level strategy decisions with management. A second means of communication is the developer email list. This is a list to which everybody can send emails that will be received by the collective of the developers and managers involved in the project. Thirdly, to exchange documents quickly, a SharePoint directory has been set-up. SharePoint allows teams and organizations to intelligently share, and collaborate on content from anywhere.

97 MATHEMATICS AND COMPUTING↗

HDTS 2017.1 Testing and Verification Document

This report is a continuation of the series of Hunter Dose Tracking System (HDTS) Quality Assurance documents including (Foley and Powell, 2010; Dixon, 2012; Whiteside, 2017b). In this report we have created a suite of automated test cases and a system to analyze the results of those tests as well as documented the methodology to ensure the field system performs within specifications. The software test cases cover all of the functions and interactions of functions that are practical to test. With the developed framework, if software defects are discovered, it will be easy to create one or more test cases to reproduce the defect and ensure that code changes correct the defect.

97 MATHEMATICS AND COMPUTING↗

Development and Implementation of a CTF Code Verification Suite.

CTF is a thermal hydraulic subchannel code developed to predict light water reactor (LWR) core behavior. It is a version of Coolant Boiling in Rod Arrays (COBRA) developed by Oak Ridge National Laboratory (ORNL) and North Carolina State University (NCSU) and used in the Consortium for the Advanced Simulation of LWRs (CASL). Here, the existing CTF code verification matrix is expanded, which ensures that the code is a faithful representation of the underlying mathematical model. The suite of code verification tests are mapped to the underlying conservation equations of CTF and significant gaps are addressed. As such, five new problems are incorporated: isokinetic advection, conduction, pressure drop, convection, and pipe boiling. Convergence behavior and numerical errors are quantified for each of the tests and all tests converge at the correct rate to their corresponding analytic solution. A new verification utility that generalizes the code verification process is used to incorporate these problems into the CTF automated test suite.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Persistent Elevated Soot Emissions Induced by Clustered Stochastic Preignition Events

Stochastic Preignition (SPI) is an abnormal combustion phenomenon that can occur in spark-ignition engines particularly under high-load operation. SPI is characterized by uncontrolled initiation of combustion prior to spark discharge, an abnormal combustion process that can lead to severe knock events and significant engine damage. SPI has been associated with fuel properties, lubricant composition, and engine design and operation. Here, in this work, a single-cylinder test engine with a dry-sump oil system was utilized to study the SPI response of E10 and E25 fuels with a range of Reid Vapor Pressure (RVP). An automated test procedure was employed, consisting of ten square-waved load profile segments, with each segment composed of 5 min of low-load operation followed by 25 min of sustained high-load operation. These tests were replicated across multiple days of testing including a lubricant triple flush between tests, and an online Fuel in Oil diagnostic measurement. Exhaust particulate emissions were continuously measured by an AVL microsoot sensor (MSS). Elevated particulate matter emissions were observed to occur concurrently with SPI events as blooms of soot. Particularly after clustered events (i.e., multiple SPI cycles occurring within 10 consecutive engine cycles), high soot emissions were observed to persist over several days of sequential operation despite daily lubricant changes, a complete warm-up procedure, and sustained low-load operation between test segments. This result implies that the particulate emissions trends may be dominated by deposit-based effects, where higher load operation is needed to alter deposition and formation processes. The observed soot blooms were also found to correspond to a reduction in the engine fueling and the fuel engine oil dilution rate despite the engine exhaust remaining at stoichiometric exhaust operation. These observations suggest that post-SPI events, pathways for lubricant migration and consumption into the combustion chamber may occur until these pathways are closed from deposit formation or ring dynamics during extended operation. These observed sooting propensity persisted with all fuels tests, but a linear correlation was observed between the summation of soot and particulate matter index (PMI) value for each fuel as well as SPI events, proving that PMI is a crucial fuel property for reducing SPI.

Splitter, Derek [Oak Ridge National Laboratory (OR↗