Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Evaluation of an in vitro three-dimensional HepaRG spheroid model for genotoxicity testing using the high-throughput CometChip platform

Three-dimensional (3D) culture systems are increasingly being used for genotoxicity studies due to improved cell-to-cell interactions and tissue-like structures that are limited or lacking in 2D cultures. The present study optimized a 3D culture system using metabolically competent HepaRG cells for in vitro genotoxicity testing. 3D HepaRG spheroids, formed in 96- or 384-well ultra-low attachment plates, were exposed to various concentrations of 34 test articles, including 8 direct-acting and 11 indirect-acting genotoxicants/carcinogens as well as 15 compounds that show different genotoxic responses in vitro and in vivo. DNA damage was evaluated using the high-throughput CometChip assay with concurrent cytotoxicity assessment by the ATP assay in both 2D and 3D cultures. 3D HepaRG spheroids maintained a stable phenotype for up to 30 days with higher levels of albumin secretion, cytochrome P450 gene expression, and enzyme activities compared to 2D cultures. 3D spheroids also demonstrated a higher sensitivity than 2D cultures for detecting both direct- and indirect-acting genotoxicants/carcinogens, indicating a better prediction of in vivo genotoxicity responses. When DNA damage dose-response data were quantified using PROAST software, 3D spheroids generally had lower or similar benchmark dose values compared to 2D HepaRG cells and were more comparable with primary human hepatocytes. These results demonstrate that 3D models can be adapted to the CometChip technology for high-throughput genotoxicity testing and that 3D HepaRG spheroids may be used as a reliable and pragmatic in vitro approach to better support the hazard identification and risk assessment of potential human genotoxic carcinogens.

60 APPLIED LIFE SCIENCES↗

SU-E-T-50: Automatic Validation of Megavoltage Beams Modeled for Clinical Use in Radiation Therapy

Purpose: To automatically validate megavoltage beams modeled in XiO™ 4.50 (Elekta, Stockholm, Sweden) and Varian Eclipse™ Treatment Planning Systems (TPS) (Varian Associates, Palo Alto, CA, USA), reducing validation time before beam-on for clinical use. Methods: A software application that can automatically read and analyze DICOM RT Dose and W2CAD files was developed using MatLab integrated development environment.TPS calculated dose distributions, in DICOM RT Dose format, and dose values measured in different Varian Clinac beams, in W2CAD format, were compared. Experimental beam data used were those acquired for beam commissioning, collected on a water phantom with a 2D automatic beam scanning system.Two methods were chosen to evaluate dose distributions fitting: gamma analysis and point tests described in Appendix E of IAEA TECDOC-1583. Depth dose curves and beam profiles were evaluated for both open and wedged beams. Tolerance parameters chosen for gamma analysis are 3% and 3 mm dose and distance, respectively.Absolute dose was measured independently at points proposed in Appendix E of TECDOC-1583 to validate software results. Results: TPS calculated depth dose distributions agree with measured beam data under fixed precision values at all depths analyzed. Measured beam dose profiles match TPS calculated doses with high accuracy in both open and wedged beams. Depth and profile dose distributions fitting analysis show gamma values < 1. Relative errors at points proposed in Appendix E of TECDOC-1583 meet therein recommended tolerances.Independent absolute dose measurements at points proposed in Appendix E of TECDOC-1583 confirm software results. Conclusion: Automatic validation of megavoltage beams modeled for their use in the clinic was accomplished. The software tool developed proved efficient, giving users a convenient and reliable environment to decide whether to accept or not a beam model for clinical use. Validation time before beam-on for clinical use was reduced to a few hours.

60 APPLIED LIFE SCIENCES↗

Final Report on Reservoir Modeling (SECARB Phase III Work Product 4.2.4.c)

The SECARB Partnership Anthropogenic Test, located in the Southeast Unit of the Citronelle oilfield will inject CO 2 into the saline waters of the Cretaceous Paluxy sandstone formation for three years. In order to accurately model the injection, migration, and long-term fate of CO 2 in the subsurface, GEM, a Computer Modeling Group software program for transport and geochemical modeling, was selected for the simulation. GEM is a very robust compositional reservoir simulator, with all the necessary options available for modeling CO 2 trapping mechanisms (including solubility, residual gas and mineralization). This simulation tool is widely known and used in the petroleum and sequestration industries. A reservoir model was built, based on a previously developed comprehensive picture of the subsurface geology at the site (Work Product 4.2.1.d - Report on Subsurface Characterization for the Anthropogenic Test Project Site). This report describes in details the different inputs that were used to create the model as well as the results of the injection scenario in terms of achievable injection rates, plume extent and pressure response.

01 COAL, LIGNITE, AND PEAT↗

Fukushima Daiichi Accident Study Information Portal Quality Assurance Review: Pre-Public Release

This design review compared the current product with the original intent set forth in the initial internet portal design found in the document: Fukushima Daiichi Database Design, Revision 5. The current revision of the Fukushima Daiichi Accident Study Information Portal (FDASIP) is 1.0.21. This revision is one that restricts access for each user based on roles granted by the project administrator. The public access revision is currently on the test server and will be considered in this review as well.

42 ENGINEERING↗

SU-E-CAMPUS-T-01: Automation of the Winston-Lutz Test for Stereotactic Radiosurgery

Purpose: To optimize clinical efficiency and shorten patient wait time by minimizing the time and effort required to perform the Winston-Lutz test before stereotactic radiosurgery (SRS) through automation of the delivery, analysis, and documentation of results. Methods: The radiation fields of the Winston-Lutz (WL) test were created in a “machine-QA patient” saved in ARIA for use before SRS cases. Images of the BRW target ball placed at mechanical isocenter are captured with the portal imager for each of four, 2cm×2cm, MLC-shaped beams. When the WL plan is delivered and closed, this event is detected by in-house software called EventNet which automates subsequent processes with the aid of the ARIA web services. Images are automatically retrieved from the ARIA database and analyzed to determine the offset of the target ball from radiation isocenter. The results are posted to a website and a composite summary image of the results is pushed back into ImageBrowser for review and authenticated documentation. Results: The total time to perform the test was reduced from 20-25 minutes to less than 4 minutes. The results were found to be more accurate and consistent than the previous method which used radiochromic film. The images were also analyzed with DoseLab for comparison. The difference between the film and automated WL results in the X and Y direction and the radius were (−0.17 +/− 0.28) mm, (0.21 +/− 0.20) mm and (−0.14 +/− 0.27) mm, respectively. The difference between the DoseLab and automated WL results were (−0.05 +/− 0.06) mm, (−0.01 +/− 0.02) mm and (0.01 +/− 0.07) mm, respectively. Conclusions: This process reduced patient wait times by 15–20 minutes making the treatment machine available to treat another patient. Accuracy and consistency of results were improved over the previous method and were comparable to other commercial solutions. Access to the ARIA web services is made possible through an Eclipse co-development agreement with Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

Results of the 2013 UT modeling benchmark obtained with models implemented in CIVA

The 2013 Ultrasonic Testing (UT) modeling benchmark concerns direct echoes from side drilled holes (SDH), flat bottom holes (FBH) and corner echoes from backwall breaking artificial notches inspected with a matrix phased array probe. This communication presents the results obtained with the models implemented in the CIVA software: the pencilmodel is used to compute the field radiated by the probe, the Kirchhoff approximation is applied to predict the response of FBH and notches and the SOV (Separation Of Variables) model is used for the SDH responses. The comparison between simulated and experimental results are presented and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗

Software engineering to sustain a high-performance computing scientific application: QMCPACK

We provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum MonteCarlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion ofcontinuous integration (CI) targeting CPU, using GitHub Actions runners, and graphics processing units (GPU) in pre-exascalesystems, using self-hosted hardware; (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Dockercontainers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, sustainable maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the sustainability of community HPC codes and scientific discovery at scale.

Godoy, William↗

Introduction to MDSplus using Docker

With increased use of MDSplus comes an influx of new users. With them comes a need for more and better ways to learn the suite of tools that is MDSplus. Therefore, the MDSplus team continually evaluates new technologies to improve our software and user experience. To this end, we investigated Docker to determine if and how it could help new users understand MDSplus, make MDSplus easier to install, and allow us to easily test old/new versions. To achieve this, a set of Docker images and instructions have been developed. This paper will provide an overview of MDSplus, and detail the methods to create and use the Docker images. Additionally, we will explore the limitations of such an approach, and the recommended applications. The project where these Docker Images were built, along with the Demo is here: https://github.com/WhoBrokeTheBuild/DockerizedMDSplus https://hub.docker.com/r/whobrokethebuild/mdsplus The now official Docker Images are available here: https://github.com/MDSplus/Docker https://hub.docker.com/r/mdsplus/mdsplus

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Belle II Conditions Database

The Belle II experiment at KEK is preparing for taking first collision data in early 2018. For the success of the experiment it is essential to have information about varying conditions available to systems worldwide in a fast and efficient manner that is straightforward for both the user and maintainer. The Belle II Conditions Database was designed to make maintenance as easy as possible. To this end, a HTTP REST service was developed with industry-standard tools such as Swagger for the API interface development, Payara for the Java EE application server, and the Hazelcast in-memory data grid for support of scalable caching as well as transparent distribution of the service across multiple sites. On the client side, the online and offline software has to be able to obtain conditions data from the Belle II Conditions Database in a robust and reliable way under very different situations. As such the client side interface to the Belle II Conditions Database has been designed with a variety of access mechanisms which allow the software to be used with and without an internet connection. Different methods to access the payload information are implemented to allow for a high level of customization per site and to simplify testing of new payloads locally. Changes to the conditions data are usually handled transparently but users can actively check whether an object has changed or register callback functions to be called whenever a conditions data object is updated. In addition a command line user interface has been developed to simplify inspection and modification of the database contents.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

EMMA: a new paradigm in configurable software

EMMA is a framework designed to create a family of configurable software systems, with emphasis on extensibility and flexibility. It is based on a loosely coupled, event driven architecture. The EMMA framework has been built upon the premise of composing software systems from independent components. It opens up opportunities for reuse of components and their functionality and composing them together in many different ways. As a result, it provides the developer of test and measurement applications with a lightweight alternative to microservices, while sharing their various advantages, including composability, loose coupling, encapsulation, and reuse.

97 MATHEMATICS AND COMPUTING↗

CPU and memory efficient coherent mode decomposition for the partially coherent x-ray simulations

In this work, the method of the Coherent Mode Decomposition (CMD) is applied to numerical wave propagation calculations for partially-coherent X-rays, using the Fourier optics and compatible methods. Its CPU and memory efficiency is discussed in various cases of the wavefront at the source and the beam waist. With the absence of the quadratic phase terms, the required sampling density of the electric fields is effectively reduced. The problem size is thus moderate and the method is feasible to be implemented on a single-node CPU server. In other cases, the same argument holds with proper treatments of the quadratic phase terms. Tests on CMD and the modes propagation are done for the case of the Coherent Hard X-ray beamline of the National Synchrotron Light Source II, using the Synchrotron Radiation Workshop software. We observe a few hundred or less dominant decomposed modes that resemble the electric fields converge to the wavefront intensity at a high accuracy of over 99%.

36 MATERIALS SCIENCE↗

Effect of image quality on calcification detection in digital mammography

Purpose: This study aims to investigate if microcalcification detection varies significantly when mammographic images are acquired using different image qualities, including: different detectors, dose levels, and different image processing algorithms. An additional aim was to determine how the standard European method of measuring image quality using threshold gold thickness measured with a CDMAM phantom and the associated limits in current EU guidelines relate to calcification detection. Methods: One hundred and sixty two normal breast images were acquired on an amorphous selenium direct digital (DR) system. Microcalcification clusters extracted from magnified images of slices of mastectomies were electronically inserted into half of the images. The calcification clusters had a subtle appearance. All images were adjusted using a validated mathematical method to simulate the appearance of images from a computed radiography (CR) imaging system at the same dose, from both systems at half this dose, and from the DR system at quarter this dose. The original 162 images were processed with both Hologic and Agfa (Musica-2) image processing. All other image qualities were processed with Agfa (Musica-2) image processing only. Seven experienced observers marked and rated any identified suspicious regions. Free response operating characteristic (FROC) and ROC analyses were performed on the data. The lesion sensitivity at a nonlesion localization fraction (NLF) of 0.1 was also calculated. Images of the CDMAM mammographic test phantom were acquired using the automatic setting on the DR system. These images were modified to the additional image qualities used in the observer study. The images were analyzed using automated software. In order to assess the relationship between threshold gold thickness and calcification detection a power law was fitted to the data. Results: There was a significant reduction in calcification detection using CR compared with DR: the alternative FROC (AFROC) area decreased from 0.84 to 0.63 and the ROC area decreased from 0.91 to 0.79 (p < 0.0001). This corresponded to a 30% drop in lesion sensitivity at a NLF equal to 0.1. Detection was also sensitive to the dose used. There was no significant difference in detection between the two image processing algorithms used (p > 0.05). It was additionally found that lower threshold gold thickness from CDMAM analysis implied better cluster detection. The measured threshold gold thickness passed the acceptable limit set in the EU standards for all image qualities except half dose CR. However, calcification detection varied significantly between image qualities. This suggests that the current EU guidelines may need revising. Conclusions: Microcalcification detection was found to be sensitive to detector and dose used. Standard measurements of image quality were a good predictor of microcalcification cluster detection.

61 RADIATION PROTECTION AND DOSIMETRY↗

SU-E-T-65: Characterization of a 2D Array for QA and Pretreatment Plan Verification

Purpose: The OCTAVIUS detector729 is a 2D array of 729 air vented cubic plane parallel ion chambers used for pretreatment verification and QA. In this study we investigated dosimetric characteristics of this system for clinical photon beam dosimetry. Methods: Detector performance evaluation included determination of the location of the effective point of measurement (EPM), sensitivity, linearity, and reproducibility of detector response, as well as output factor, dose rate, and source to surface distance (SSD) dependence. Finally, assessment of wedge modulated fields was carried out. All the evaluations were performed five times for low and high photon energies. For reference measurements, a 0.6 cc ionization chamber was used. Data analysis and comparison of the OCTAVIUS detector with reference ion chamber data was performed using the VeriSoft patient plan verification software. Results: The reproducibility and stability of the measurements are excellent, the detector showed same signal with a maximum deviation of less than 0.5% in short and long term. Results of sensitivity test showed same signal with a maximum deviation of approximately 0.1%. As the detector 729 response is linear with dose and dose rate, it can be used for the measurement at regions of high dose gradient effectively. The detector agrees with the ionization chamber measurement to within 1% for SSD range of 75 to 125 cm. Also, its measured wedge modulated profiles matched very well with ion chamber dose profiles acquired in a water tank. Conclusions: As the response of the detector 729 is linear with dose and dose rate, it can be used for the measurements in the areas of dose gradients effectively. Based on the measurements and comparisons performed, this system is a reliable and accurate dosimeter for QA and pretreatment plan verification in radiotherapy.

60 APPLIED LIFE SCIENCES↗

Streaming readout for next generation electron scattering experiments

Current and future experiments at the high-intensity frontier are expected to produce an enormous amount of data that needs to be collected and stored for offline analysis. Thanks to the continuous progress in computing and networking technology, it is now possible to replace the standard ‘triggered’ data acquisition systems with a new, simplified and outperforming scheme. ‘Streaming readout’ (SRO) DAQ aims to replace the hardware-based trigger with a much more powerful and flexible software-based one, that considers the whole detector information for efficient real-time data tagging and selection. Considering the crucial role of DAQ in an experiment, validation with on-field tests is required to demonstrate SRO performance. In this paper, we report results of the on-beam validation of the Jefferson Lab SRO framework. In this work, we exposed different detectors (PbWO-based electromagnetic calorimeters and a plastic scintillator hodoscope) to the Hall-D electron-positron secondary beam and to the Hall-B production electron beam, with increasingly complex experimental conditions. By comparing the data collected with the SRO system against the traditional DAQ, we demonstrate that the SRO performs as expected. Furthermore, we provide evidence of its superiority in implementing sophisticated AI-supported algorithms for real-time data analysis and reconstruction.

47 OTHER INSTRUMENTATION↗

ISAVS: Interactive Scalable Analysis and Visualization System

Modern science is inundated with ever increasing data sizes as computational capabilities and image acquisition techniques continue to improve. For example, simulations are tackling ever larger domains with higher fidelity, and high-throughput microscopy techniques generate larger data that are fundamental to gather biologically and medically relevant insights. As the image sizes exceed memory, and even sometimes local disk space, each step in a scientific workflow is impacted. Current software solutions enable data exploration with limited interactivity for visualization and analytic tasks. Furthermore analysis on HPC systems often require complex hand-written parallel implementations of algorithms that suffer from poor portability and maintainability. We present a software infrastructure that simplifies end-to-end visualization and analysis of massive data. First, a hierarchical streaming data access layer enables interactive exploration of remote data, with fast data fetching to test analytics on subsets of the data. Second, a library simplifies the process of developing new analytics algorithms, allowing users to rapidly prototype new approaches and deploy them in an HPC setting. Third, a scalable runtime system automates mapping analysis algorithms to whatever computational hardware is available, reducing the complexity of developing scaling algorithms. Here, we demonstrate the usability and performance of our system using a use case from neuroscience: filtering, registration, and visualization of tera-scale microscopy data. We evaluate the performance of our system using a leadership-class supercomputer, Shaheen II.

97 MATHEMATICS AND COMPUTING↗

Multi-Purpose, Application-Centric, Scalable I/O Proxy Application

MACSio is a Multi-purpose, Application-Centric, Scalable I/O proxy application. It is designed to support a number of goals with respect to parallel I/O performance testing and benchmarking including the ability to test and compare various I/O libraries and I/O paradigms, to predict scalable performance of real applications and to help identify where improvements in I/O performance can be made within the HPC I/O software stack.

Miller, M.C.↗

BubbleCluster v4

The BubbleCluster algorithm was developed to help address the limitations of traditional genetic mapping tools when presented with large amounts of data. The BubbleCluster software is a tool for the initial stage in the genetic mapping pipeline -- clustering genetic markers into linkage groups. BubbleCluster was designed to tackle large genetic marker data sets, and has been tested on input of up to 1.6M markers. Input format is identical to that of the popular MSTMap package, aiding useability.

Buluc, Aydin↗