Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

PyOECP: A flexible open-source software library for estimating and modeling the complex permittivity based on the open-ended coaxial probe (OECP) technique

Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.

97 MATHEMATICS AND COMPUTING↗

Evaluation of System-Integrated Smart Grid Devices using Software- and Hardware-in-the-Loop

This paper presents a concise description of state-of-the-art real-time simulation-based testing methods and demonstrates how they can be used independently and/or in combination as an integrated development and validation approach for smart grid DERs and systems. A three-part case study demonstrating the application of this integrated approach at the different stages of development and validation of a system-integrated smart photovoltaic (PV) inverter is also presented. Laboratory testing results and perspectives from two international research laboratories are included in the case study.

14 SOLAR ENERGY↗

Contingency Contractor Optimization Phase 3 Sustainment Verification and Validation V&V) Report - Contingency Contractor Optimization Engineering - Prototype

The reports and test plans contained within this document serve as supporting materials to the activities listed within the “Contingency Contractor Optimization Tool – Prototype (CCOT-P) Verification & Validation Plan” [1]. The activities included test development, testing, peer reviews, and expert reviews. The engineering prototype reviews were done for both the software and the mathematical model used in CCOT-P. Section 2 includes the peer and expert review reports, which summarize the findings from each of the reviews and document the resolution of any issues. Section 3 details the test plans that were followed for functional testing of the application through the interface. Section 4 describes the unit tests that were run on the code.

97 MATHEMATICS AND COMPUTING↗

SU-E-T-277: Raystation Electron Monte Carlo Commissioning and Clinical Implementation

Purpose: To evaluate the Raystation v4.0 Electron Monte Carlo algorithm for an Elekta Infinity linear accelerator and commission for clinical use. Methods: A total of 199 tests were performed (75 Export and Documentation, 20 PDD, 30 Profiles, 4 Obliquity, 10 Inhomogeneity, 55 MU Accuracy, and 5 Grid and Particle History). Export and documentation tests were performed with respect to MOSAIQ (Elekta AB) and RadCalc (Lifeline Software Inc). Mechanical jaw parameters and cutout magnifications were verified. PDD and profiles for open cones and cutouts were extracted and compared with water tank measurements. Obliquity and inhomogeneity for bone and air calculations were compared to film dosimetry. MU calculations for open cones and cutouts were performed and compared to both RadCalc and simple hand calculations. Grid size and particle histories were evaluated per energy for statistical uncertainty performance. Acceptability was categorized as follows: performs as expected, negligible impact on workflow, marginal impact, critical impact or safety concern, and catastrophic impact of safety concern. Results: Overall results are: 88.8% perform as expected, 10.2% negligible, 2.0% marginal, 0% critical and 0% catastrophic. Results per test category are as follows: Export and Documentation: 100% perform as expected, PDD: 100% perform as expected, Profiles: 66.7% perform as expected, 33.3% negligible, Obliquity: 100% marginal, Inhomogeneity 50% perform as expected, 50% negligible, MU Accuracy: 100% perform as expected, Grid and particle histories: 100% negligible. To achieve distributions with satisfactory smoothness level, 5,000,000 particle histories were used. Calculation time was approximately 1 hour. Conclusion: Raystation electron Monte Carlo is acceptable for clinical use. All of the issues encountered have acceptable workarounds. Known issues were reported to Raysearch and will be resolved in upcoming releases.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Angular-resolution and material-characterization measurements for a dual-particle imaging system with mixed-oxide fuel

A dual-particle imaging (DPI) system, capable of simultaneously imaging fast neutrons and gamma rays, has been operated in the presence of mixed-oxide (MOX) fuel to assess the system's angular resolution and material-characterization capabilities. The detection principle is based on the scattering physics of neutrons (elastic scattering) and gamma rays (Compton scattering) in organic and inorganic scintillators. The detection system is designed as a combination of a two-plane Compton camera and a neutron-scatter camera. The front plane consists of EJ-309 liquid scintillators and the back plane consists of interleaved EJ-309 and NaI(Tl) scintillators. MCNPX-PoliMi was used to optimize the geometry of the system and the resulting prototype was built and tested using a Cf-252 source as an SNM surrogate. A software package was developed to acquire and process data in real time. The software was used for a measurement campaign to assess the angular resolution of the imaging system with MOX samples. Measurements of two MOX canisters of similar isotopics and intensity were performed for 6 different canister separations (from 5° to 30°, corresponding to distances of 21 cm and 131 cm, respectively). The measurements yielded a minimum separation of 20° at 2.5 m (86-cm separation) required to see 2 separate hot spots. Additionally, the results displayed good agreement with MCNPX-PoliMi simulations. These results indicate an angular resolution between 15° and 20°, given the 5° step. Coupled with its large field of view, and its capability to differentiate between spontaneous fission and (α,n) sources, the DPI system shows its potential for nuclear-nonproliferation applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparison of sleep parameters from wrist-worn ActiGraph and Actiwatch devices

Abstract Sleep and physical activity, two important health behaviors, are often studied independently using different accelerometer types and body locations. Understanding whether accelerometers designed for monitoring each behavior can provide similar sleep parameter estimates may help determine whether one device can be used to measure both behaviors. Three hundred and thirty one adults (70.7 ± 13.7 years) from the Baltimore Longitudinal Study of Aging wore the ActiGraph GT9X Link and the Actiwatch 2 simultaneously on the non-dominant wrist for 7.0 ± 1.6 nights. Total sleep time (TST), wake after sleep onset (WASO), sleep efficiency, number of wake bouts, mean wake bout length, and sleep fragmentation index (SFI) were extracted from ActiGraph using the Cole–Kripke algorithm and from Actiwatch using the software default algorithm. These parameters were compared using paired t-tests, Bland–Altman plots, and Deming regression models. Stratified analyses were performed by age, sex, and body mass index (BMI). Compared to the Actiwatch, the ActiGraph estimated comparable TST and sleep efficiency, but fewer wake bouts, longer WASO, longer wake bout length, and higher SFI (all p < .001). Both devices estimated similar 1-min and 1% differences between participants for TST and SFI (β = 0.99, 95% CI: 0.95, 1.03, and 0.91, 1.13, respectively), but not for other parameters. These differences varied by age, sex, and/or BMI. The ActiGraph and the Actiwatch provide comparable absolute and relative estimates of TST, but not other parameters. The discrepancies could result from device differences in movement collection and/or sleep scoring algorithms. Further comparison and calibration is required before these devices can be used interchangeably.

Liu, Fangyu (ORCID:0000000315541478)↗

SU-G-TeP2-04: Comprehensive Machine Isocenter Evaluation with Separation of Gantry, Collimator, and Table Variables

Purpose: To develop and demonstrate application of a method that characterizes deviation of linac x-ray beams from the centroid of the volumetric radiation isocenter as a function of gantry, collimator, and table variables. Methods: A set of Winston-Lutz ball-bearing images was used to determine the gantry radiation isocenter as the midrange of deviation values resulting from gantry and collimator rotation. Also determined were displacement of table axis from gantry isocenter and recommended table axis adjustment. The method, previously reported, has been extended to include the effect of collimator walkout by obtaining measurements with 0 and 180 degree collimator rotation for each gantry angle. Twelve images were used to characterize the volumetric isocenter for the full range of available gantry, collimator, and table rotations. Results: Three Varian True Beam, two Elekta Infinity and four Versa HD linacs at five institutions were tested using identical methodology. Varian linacs exhibited substantially less deviation due to head sag than Elekta linacs (0.4 mm vs. 1.2 mm on average). One linac from each manufacturer had additional isocenter deviation of 0.3 to 0.4 mm due to jaw instability with gantry and collimator rotation. For all linacs, the achievable isocenter tolerance was dependent on adjustment of collimator position offset, transverse position steering, and alignment of the table axis with gantry isocenter, facilitated by these test results. The pattern and magnitude of table axis wobble vs. table angle was reproducible and unique to each machine. Conclusion: This new method provides a comprehensive set of isocenter deviation values including all variables. It effectively facilitates minimization of deviation between beam center and target (ball-bearing) position. This method was used to quantify the effect of jaw instability on isocenter deviation and to identify the offending jaw. The test is suitable for incorporation into a routine machine QA program. Software development was performed by Radiological Imaging Technology, Inc.

60 APPLIED LIFE SCIENCES↗

Pecos v. 1.0

Pecos is a python package designed to perform quality control analysis on time series data for system operations. The software loads time indexed databases, performs a series of quality control tests defined by the user, and creates automated reports which include summary statistics, tables, and graphics.

Klise, Katherine↗

Slope Extensions to ASL Library

Extensions to the AMPL/solver interface library (http://netlib.sandia.gov/ampl/solvers) to compute bounds on algebraic expressions, plus a test program. use in uncertainty quantification and global optimization algorithms. This software is not primarily for military applications.

Gay, David↗

System Validation Platform Working Directories

A suite of software tools used to interface with power electronic equipment for laboratory testing and device certification. They are typically used as equipment drivers with using the System Validation Platform (SVP) graphical user interface (GUI). Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1185 O

Johnson, JayT↗

RegPrecise 3.0 – A resource for genome-scale exploration of transcriptional regulation in bacteria

Background: Genome-scale prediction of gene regulation and reconstruction of transcriptional regulatory networks in prokaryotes is one of the critical tasks of modern genomics. Bacteria from different taxonomic groups, whose lifestyles and natural environments are substantially different, possess highly diverged transcriptional regulatory networks. The comparative genomics approaches are useful for in silico reconstruction of bacterial regulons and networks operated by both transcription factors (TFs) and RNA regulatory elements (riboswitches). Description: RegPrecise (http://regprecise.lbl.gov) is a web resource for collection, visualization and analysis of transcriptional regulons reconstructed by comparative genomics. We significantly expanded a reference collection of manually curated regulons we introduced earlier. RegPrecise 3.0 provides access to inferred regulatory interactions organized by phylogenetic, structural and functional properties. Taxonomy-specific collections include 781 TF regulogs inferred in more than 160 genomes representing 14 taxonomic groups of Bacteria. TF-specific collections include regulogs for a selected subset of 40 TFs reconstructed across more than 30 taxonomic lineages. Novel collections of regulons operated by RNA regulatory elements (riboswitches) include near 400 regulogs inferred in 24 bacterial lineages. RegPrecise 3.0 provides four classifications of the reference regulons implemented as controlled vocabularies: 55 TF protein families; 43 RNA motif families; ~150 biological processes or metabolic pathways; and ~200 effectors or environmental signals. Genome-wide visualization of regulatory networks and metabolic pathways covered by the reference regulons are available for all studied genomes. A separate section of RegPrecise 3.0 contains draft regulatory networks in 640 genomes obtained by an conservative propagation of the reference regulons to closely related genomes. Conclusions: RegPrecise 3.0 gives access to the transcriptional regulons reconstructed in bacterial genomes. Analytical capabilities include exploration of: regulon content, structure and function; TF binding site motifs; conservation and variations in genome-wide regulatory networks across all taxonomic groups of Bacteria. RegPrecise 3.0 was selected as a core resource on transcriptional regulation of the Department of Energy Systems Biology Knowledgebase, an emerging software and data environment designed to enable researchers to collaboratively generate, test and share new hypotheses about gene and protein functions, perform large-scale analyses, and model interactions in microbes, plants, and their communities.

59 BASIC BIOLOGICAL SCIENCES↗

WTFgenes: What's The Function of these genes? Static sites for model-based gene set analysis

A common technique for interpreting experimentally-identified lists of genes is to look for enrichment of genes associated with particular ontology terms. The most common test uses the hypergeometric distribution; more recently, a model-based test was proposed. These approaches must typically be run using downloaded software, or on a server. We develop a collapsed likelihood for model-based gene set analysis and present WTFgenes, an implementation of both hypergeometric and model-based approaches, that can be published as a static site with computation run in JavaScript on the user's web browser client. Apart from hosting files, zero server resources are required: the site can (for example) be served directly from Amazon S3 or GitHub Pages. A C++11 implementation yielding identical results runs roughly twice as fast as the JavaScript version. WTFgenes is available from https://github.com/evoldoers/wtfgenes under the BSD3 license. A demonstration for the Gene Ontology is usable at https://evoldoers.github.io/wtfgo.

Mungall, Christopher J.↗

Plant-Level Modeling and Simulation of Used Nuclear Fuel Dissolution

Plant-level modeling and simulation of a used nuclear fuel prototype dissolver is presented. Emphasis is given in developing a modeling and simulation approach to be explored by other processes involved in the recycle of used fuel. The commonality concepts presented in a previous communication were used to create a model and realize its software module. An initial model was established based on a theory of chemical thermomechanical network transport outlined previously. A software module prototype was developed with the required external behavior and internal mathematical structure. Results obtained demonstrate the generality of the design approach and establish an extensible mathematical model with its corresponding software module for a wide range of dissolvers. Scale up numerical tests were made varying the type of used fuel (breeder and light-water reactors) and the capacity of dissolution (0.5 t/d to 1.7 t/d). These tests were motivated by user requirements in the area of nuclear materials safeguards. A computer module written in high-level programing languages (MATLAB and Octave) was developed, tested, and provided as open-source code (MATLAB) for integration into the Separations and Safeguards Performance Model application in development at Sandia National Laboratories. The modeling approach presented here is intended to serve as a template for a rational modeling of all plant-level modules. This will facilitate the practical application of the commonality features underlying the unifying network transport theory proposed recently. In addition, by example, this model describes, explicitly, the needed data from sub-scale models, and logical extensions for future model development. For example, from thermodynamics, an off-line simulation of molecular dynamics could quantify partial molar volumes for the species in the liquid phase; this simulation is currently at reach for high-performance computing. From fluid mechanics, a hold-up capacity function is needed for the dissolver device; this simulation is currently at reach for computational fluid mechanics given the existing CAD geometry. From chemical transport phenomena, a simulation of the particle-scale dissolution front is needed to derive an improved solid dissolution kinetics law by predicting the local surface area change; an example was provided in this report. In addition, the associated reaction mechanisms for dissolution are presently largely untested and simplified, hence even a parallel experimental program in reaction kinetics is needed to support modeling and simulation efforts. Last but not least, a simple account of finite rates of solid feed and transfer can be readily introduced via a coupled delayed model. These are some of the theoretical benefits of a rational plant-level modeling approach which guides the development of smaller length and time scale modeling. Practical, and other theoretical benefits have been presented on a previous report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Pecos v. 1.0

Pecos is a python package designed to perform quality control analysis on time series data for system operations. The software loads time indexed databases, performs a series of quality control tests defined by the user, and creates automated reports which include summary statistics, tables, and graphics.

Klise, Katherine↗

Applied Metrology for the Assembly of the Nb3Sn MQXFA Quadrupole Magnets for the HL-LHC AUP

The US HL-LHC Accelerator Upgrade Project (AUP) is building Nb3Sn quadrupole magnets, called MQXFA, with plans to install 16 of them in the HL-LHC Interaction Regions. Variability in coil size must be dealt with at the assembly level, which requires timely and repeatable measurement of each coil. In this paper we will present the methodology used for coil measurements and the geometrical size data for the coils that have been measured thus far. We will also show the coil measurements of 8 coils before and after cold test. The Leica AT960-MR laser tracker with Spatial Analyzer software acquired to achieve these measurements has been used elsewhere in the project to great effect.

43 PARTICLE ACCELERATORS↗

Fiscal Year 2024 Software Quality Assurance Activities for the ARC Software

The continued goal of the ARC SQA project in the Advanced Reactor Technologies program of DOE is to resolve the QA gaps for the ARC software that limit, or prevent, commercialization of the software for industry users. This project started in earnest in fiscal year 2023 which saw the entire code system moved from a SVN repository to a GitLab repository and an associated software quality assurance plan (SQAP) developed and ratified. Most of the QA gaps in the ARC software were identified in collaboration with industry partners and work begin in fiscal year 2023 and continued in 2024. The primary documentation that is missing includes user manuals, user guides, software verification reports, and code coverage assessments. The SUMMAR manual was completed this fiscal year and work was started on creating manuals for SE2ANL, SE2RCT, and DASSH. Software verification work was carried out for DIF3D and REBUS in a previous program and the current fiscal year saw the completion of software verification reports for GAMSOR, GAMSRC, VARPOW, EvaluateFlux, and SUMMAR. The goal for the next fiscal year is to complete the PERSENT software verification work and begin planning the software verification work for DASSH, SE2ANL, and SE2RCT. The code coverage reports for DIF3D and MC2-3 were completed in the previous fiscal year and the goal is to generate code coverage reports for REBUS, GAMSOR, PERSENT, and DASSH in the coming fiscal year. A considerable amount of effort was spent in the current fiscal year working on the continuous integration capability for automated regression testing in GitLab. The first version of the testing was created in the previous fiscal year and applied to DIF3D and its utility programs. That testing was extended this year to cover GAMSOR, REBUS, and PERSENT. To accomplish this, the first version of the new testing methodology had to be updated to make a single output checking methodology viable for all of the ARC software. This will result in a single document to detail the automated regression testing methodology and minor documents to detail the tolerance settings that have been applied to the output for each ARC code. The previous methodology put into place with SVN would have required a separate document for each ARC code to detail the output checking methodology and the tolerance settings for the output from each code. Because some of our industry partners are providing funds to add new capabilities to the ARC software to meet their needs, all of which must be reviewed and approved by the SQA program funded by this project, a summary of that development work is detailed in this report. Overall progress on resolving the QA gaps has been good this year with the most impactful improvement for our industry partners in capability being the creation of a threaded version of DIF3D-VARIANT that allows the DIF3D, REBUS, and GAMSOR run times to be reduced by a factor of 4-6. The most impactful QA gap that was resolved was the software verification of GAMSRC and VARPOW.

97 MATHEMATICS AND COMPUTING↗

TH-C-12A-12: Veritas: An Open Source Tool to Facilitate User Interaction with TrueBeam Developer Mode

Purpose: To address the challenges of creating delivery trajectories and imaging sequences with TrueBeam Developer Mode, a new open-source graphical XML builder, Veritas, has been developed, tested and made freely available. Veritas eliminates most of the need to understand the underlying schema and write XML scripts, by providing a graphical menu for each control point specifying the state of 30 mechanical/dose axes. All capabilities of Developer Mode are accessible in Veritas. Methods: Veritas was designed using QT Designer, a ‘what-you-is-what-you-get’ (WYSIWIG) tool for building graphical user interfaces (GUI). Different components of the GUI are integrated using QT's signals and slots mechanism. Functionalities are added using PySide, an open source, cross platform Python binding for the QT framework. The XML code generated is immediately visible, making it an interactive learning tool. A user starts from an anonymized DICOM file or XML example and introduces delivery modifications, or begins their experiment from scratch, then uses the GUI to modify control points as desired. The software automatically generates XML plans following the appropriate schema. Results: Veritas was tested by generating and delivering two XML plans at Brigham and Women's Hospital. The first example was created to irradiate the letter ‘B’ with a narrow MV beam using dynamic couch movements. The second was created to acquire 4D CBCT projections for four minutes. The delivery of the letter ‘B’ was observed using a 2D array of ionization chambers. Both deliveries were generated quickly in Veritas by non-expert Developer Mode users. Conclusion: We introduced a new open source tool Veritas for generating XML plans (delivery trajectories and imaging sequences). Veritas makes Developer Mode more accessible by reducing the learning curve for quick translation of research ideas into XML plans. Veritas is an open source initiative, creating the possibility for future developments and collaboration with other researchers. I am an employee of Varian Medical Systems.

07 ISOTOPE AND RADIATION SOURCES↗

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗