Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Verification Test of Automated Robotic Assembly of Space Truss Structures

A multidisciplinary program has been conducted at the Langley Research Center to develop operational procedures for supervised autonomous assembly of truss structures suitable for large-aperture antennas. The hardware and operations required to assemble a 102-member tetrahedral truss and attach 12 hexagonal panels were developed and evaluated. A brute-force automation approach was used to develop baseline assembly hardware and software techniques. However, as the system matured and operations were proven, upgrades were incorporated and assessed against the baseline test results. These upgrades included the use of distributed microprocessors to control dedicated end-effector operations, machine vision guidance for strut installation, and the use of an expert system-based executive-control program. This paper summarizes the developmental phases of the program, the results of several assembly tests, and a series of proposed enhancements. No problems that would preclude automated in-space assembly or truss structures have been encountered. The test system was developed at a breadboard level and continued development at an enhanced level is warranted.

Rhodes, Marvin D.↗

Position Estimation Verification Testing for the Video Guidance Sensor and Dynamic Overhead Target Simulator

The Video Guidance Sensor, part of the Automated Rendezvous and Capture mechanism, is due to undergo formal qualification testing at Marshall Space Flight Center. Before it undergoes this qualification, a test was needed to verify repeatability of the sensor, and to allow different sensor configurations to be compared. This test was developed at the Flight Robotics Laboratory. The test uses a software script to drive the sensor target to the same position and thus allows sensor runs to be compared. The sensor target is the Dynamic Overhead Target Simulator. The simulator uses encoders as its position indicator. Distance Measuring Device's were used to independently verify the software script, the sensor reading, and the target position. The test area, sensor, and other test equipment are briefly described. The actual data is tabulated and will serve as a baseline for future tests. The software script was found to be adequate for the test. Position repeatability was acceptable for all the equipment. The system test is now ready to be used in formal qualification testing.

Gaines, Joseph↗

Quantitative imaging and automated fuel pin identification for passive gamma emission tomography

Compliance of member States to the Treaty on the Non-Proliferation of Nuclear Weapons is monitored through nuclear safeguards. The Passive Gamma Emission Tomography (PGET) system is a novel instrument developed within the framework of the International Atomic Energy Agency (IAEA) project JNT 1510, which included the European Commission, Finland, Hungary and Sweden. The PGET is used for the verification of spent nuclear fuel stored in water pools. Advanced image reconstruction techniques are crucial for obtaining high-quality cross-sectional images of the spent-fuel bundle to allow inspectors of the IAEA to monitor nuclear material and promptly identify its diversion. In this work, we have developed a software suite to accurately reconstruct the spent-fuel cross sectional image, automatically identify present fuel rods, and estimate their activity. Unique image reconstruction challenges are posed by the measurement of spent fuel, due to its high activity and the self-attenuation. While the former is mitigated by detector physical collimation, we implemented a linear forward model to model the detector responses to the fuel rods inside the PGET, to account for the latter. The image reconstruction is performed by solving a regularized linear inverse problem using the fast-iterative shrinkage-thresholding algorithm. We have also implemented the traditional filtered back projection (FBP) method based on the inverse Radon transform for comparison and applied both methods to reconstruct images of simulated mockup fuel assemblies. Higher image resolution and fewer reconstruction artifacts were obtained with the inverse-problem approach, with the mean-square-error reduced by 50%, and the structural-similarity improved by 200%. We then used a convolutional neural network (CNN) to automatically identify the bundle type and extract the pin locations from the images; the estimated activity levels finally being compared with the ground truth. The proposed computational methods accurately estimated the activity levels of the present pins, with an associated uncertainty of approximately 5%.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Synthetic Biology PacBio/JAWS QC Analysis (PBJ) v3.0

This software was designed as a sequence validation tool for the assembly of synthetic constructs. It analyzes FASTQ files against a list of reference sequences, combining the results from eight sequencing libraries to generate a summary, and the files needed to view the results in the Integrative Genomics Viewer (IGV) application for manual verification. This was developed for FASTQ files generated by PacBio sequencing, but could be used on any FASTQ files that do not have paired end reads. It can be used to analyze one - eight libraries at a time, and assumes that each construct sequence in the reference will be in each pool, however, this is not a requirement. This is used to identify which libraries of pooled sequences contains a perfect match, or fixable match to the reference file. This pipeline uses many freely available open source libraries, the value added is that in our application the steps of the pipeline are defined in Workflow Description Language (WDL) and run through the Cromwell workflow engine in Docker containers, for easy distribution and set up, as well as the user friendly html summary that is generated.

Simirenko, Lisa↗

Non-RF Chain of Custody Item Monitor (CoCIM) Development Report

The Chain of Custody Item Monitor (CoCIM) developed by Sandia National Laboratories is one of the most mature and well-studied active seals for use in containment applications for arms control treaty verification and international nuclear safeguards. However, its typical design includes wireless communications provided by a radio frequency (RF) transmitter and receiver. While this provides flexibility of movement for many applications, it is unnecessary and undesired for some treaty verification applications. This report details the design and construction of two variants of the CoCIM that remove the RF transmission capability in favor of directly connected wired and short-range infrared communications, as well as a new coordinator that is used to interface the CoCIM to a computer, and new interface software that is simplified for a likely inspection use case.

42 ENGINEERING↗

Distributed systems and Ada

Viewgraphs of two briefings designed to provide information to the Software I and V Study Group to help complete the I and V study task are given. The information is taken from the areas of Ada real-time processing support, Ada run-time environments, Ada program construction, object oriented design, and Ada/UNIX/POSIX interfaces. Also covered are the development, integration, and verification of Ada systems; fault tolerance and Ada; and Ada programming standards, techniques, and tools.

Source record↗

Combining real-time monitoring and knowledge-based analysis in MARVEL

Real-time artificial intelligence is gaining increasing attention for applications in which conventional software methods are unable to meet technology needs. One such application area is the monitoring and analysis of complex systems. MARVEL, a distributed monitoring and analysis tool with multiple expert systems, was developed and successfully applied to the automation of interplanetary spacecraft operations at NASA's Jet Propulsion Laboratory. MARVEL implementation and verification approaches, the MARVEL architecture, and the specific benefits that were realized by using MARVEL in operations are described.

Schwuttke, Ursula M.↗

Computational solution verification and validation applied to a thermal model of a ruggedized instrumentation package

This study details a methodology for quantification of errors and uncertainties of a finite element heat transfer model applied to a Ruggedized Instrumentation Package (RIP). The proposed verification and validation (V&V) process includes solution verification to examine errors associated with the code's solution techniques, and model validation to assess the model's predictive capability for quantities of interest. The model was subjected to mesh resolution and numerical parameters sensitivity studies to determine reasonable parameter values and to understand how they change the overall model response and performance criteria. To facilitate quantification of the uncertainty associated with the mesh, automatic meshing and mesh refining/coarsening algorithms were created and implemented on the complex geometry of the RIP. Automated software to vary model inputs was also developed to determine the solution’s sensitivity to numerical and physical parameters. The model was compared with an experiment to demonstrate its accuracy and determine the importance of both modelled and unmodelled physics in quantifying the results' uncertainty. An emphasis is placed on automating the V&V process to enable uncertainty quantification within tight development schedules.

97 MATHEMATICS AND COMPUTING↗

Advanced software integration: The case for ITV facilities

The array of technologies and methodologies involved in the development and integration of avionics software has moved almost as rapidly as computer technology itself. Future avionics systems involve major advances and risks in the following areas: (1) Complexity; (2) Connectivity; (3) Security; (4) Duration; and (5) Software engineering. From an architectural standpoint, the systems will be much more distributed, involve session-based user interfaces, and have the layered architectures typified in the layers of abstraction concepts popular in networking. Typified in the NASA Space Station Freedom will be the highly distributed nature of software development itself. Systems composed of independent components developed in parallel must be bound by rigid standards and interfaces, the clean requirements and specifications. Avionics software provides a challenge in that it can not be flight tested until the first time it literally flies. It is the binding of requirements for such an integration environment into the advances and risks of future avionics systems that form the basis of the presented concept and the basic Integration, Test, and Verification concept within the development and integration life cycle of Space Station Mission and Avionics systems.

Garman, John R.↗

First-Order SPICE Modeling of Extreme-Temperature 4H-SiC JFET Integrated Circuits

A separate submission to this conference reports that 4H-SiC Junction Field Effect Transistor (JFET) digital and analog Integrated Circuits (ICs) with two levels of metal interconnect have reproducibly demonstrated electrical operation at 500 C in excess of 1000 hours. While this progress expands the complexity and durability envelope of high temperature ICs, one important area for further technology maturation is the development of reasonably accurate and accessible computer-aided modeling and simulation tools for circuit design of these ICs. Towards this end, we report on development and verification of 25 C to 500 C SPICE simulation models of first order accuracy for this extreme-temperature durable 4H-SiC JFET IC technology. For maximum availability, the JFET IC modeling is implemented using the baseline-version SPICE NMOS LEVEL 1 model that is common to other variations of SPICE software and importantly includes the body-bias effect. The first-order accuracy of these device models is verified by direct comparison with measured experimental device characteristics.

JFET↗

SU-E-T-105: Development of 3D Dose Verification System for Volumetric Modulated Arc Therapy Using Improved Polyacrylamide-Based Gel Dosimeter

Purpose: The aim of this dosimetric study was to develop 3D dose verification system for volumetric modulated arc therapy (VMAT) using polyacrylamide-based gel (PAGAT) dosimeter improved the sensitivity by magnesium chloride (MgCl{sub 2}). Methods: PAGAT gel containing MgCl{sub 2} as a sensitizer was prepared in this study. Methacrylic-acid-based gel (MAGAT) was also prepared to compare the dosimetric characteristics with PAGAT gel. The cylindrical glass vials (4 cm diameter, 12 cm length) filled with each polymer gel were irradiated with 6 MV photon beam using Novalis Tx linear accelerator (Varian/BrainLAB). The irradiated polymer gel dosimeters were scanned with Signa 1.5 T MRI system (GE), and dose calibration curves were obtained using T{sub 2} relaxation rate (R{sub 2} = 1/T{sub 2}). Dose rate (100-600 MU min{sup −1}) and fractionation (1-8 fractions) were varied. In addition, a cubic acrylic phantom (10 × 10 × 10 cm{sup 3}) filled with improved PAGAT gel inserted into the IMRT phantom (IBA) was irradiated with VMAT (RapidArc). C-shape structure was used for the VMAT planning by the Varian Eclipse treatment planning system (TPS). The dose comparison of TPS and measurements with the polymer gel dosimeter was accomplished by the gamma index analysis, overlaying the dose profiles for a set of data on selected planes using in-house developed software. Results: Dose rate and fractionation dependence of improved PAGAT gel were smaller than MAGAT gel. A high similarity was found by overlaying the dose profiles measured with improved PAGAT gel dosimeter and the TPS dose, and the mean pass rate of the gamma index analysis using 3%/3 mm criteria was achieved 90% on orthogonal planes for VMAT using improved PAGAT gel dosimeter. Conclusion: In-house developed 3D dose verification system using improved polyacrylamide-based gel dosimeter had a potential as an effective tool for VMAT QA.

60 APPLIED LIFE SCIENCES↗

System Verification of MSL Skycrane Using an Integrated ADAMS Simulation

Mars Science Laboratory (MSL) will use the Skycrane architecture to execute final descent and landing maneuvers. The Skycrane phase uses closed-loop feedback control throughout the entire phase, starting with rover separation, through mobility deploy, and through touchdown, ending only when the bridles have completely slacked. The integrated ADAMS simulation described in this paper couples complex dynamical models created by the mechanical subsystem with actual GNC flight software algorithms that have been compiled and linked into ADAMS. These integrated simulations provide the project with the best means to verify key Skycrane requirements which have a tightly coupled GNC-Mechanical aspect to them. It also provides the best opportunity to validate the design of the algorithm that determines when to cut the bridles. The results of the simulations show the excellent performance of the Skycrane system.

White, Christopher↗

Continuous Energy Photon Transport Implementation in MCATK

The Monte Carlo Application ToolKit (MCATK) code development team has implemented Monte Carlo photon transport into the MCATK software suite. The current particle transport capabilities in MCATK, which process the tracking and collision physics, have been extended to enable tracking of photons using the same continuous energy approximation. We describe the four photoatomic processes implemented, which are coherent scattering, incoherent scattering, pair-production, and photoelectric absorption. The accompanying background, implementation, and verification of these processes will be presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Specific recommendations for accurate and direct use of PET-CT in PET guided radiotherapy for head and neck sites

Purpose: To provide specific experience-based guidance and recommendations for centers wishing to develop, validate, and implement an accurate and efficient process for directly using positron emission tomography-computed tomography (PET-CT) for the radiotherapy planning of head and neck cancer patients. Methods: A PET-CT system was modified with hard-top couch, external lasers and radiotherapy immobilization and indexing devices and was subject to a commissioning and quality assurance program. PET-CT imaging protocols were developed specifically for radiotherapy planning and the image quality and pathway tested using phantoms and five patients recruited into an in-house study. Security and accuracy of data transfer was tested throughout the whole data pathway. The patient pathway was fully established and tested ready for implementation in a PET-guided dose-escalation trial for head and neck cancer patients. Results: Couch deflection was greater than for departmental CT simulator machines. An area of high attenuation in the couch generated image artifacts and adjustments were made accordingly. Using newly developed protocols CT image quality was suitable to maintain delineation and treatment accuracy. Upon transfer of data to the treatment planning system a half pixel offset between PET and CT was observed and corrected. By taking this into account, PET to CT alignment accuracy was maintained below 1 mm in all systems in the data pathway. Transfer of structures delineated in the PET fusion software to the radiotherapy treatment planning system was validated. Conclusions: A method to perform direct PET-guided radiotherapy planning was successfully validated and specific recommendations were developed to assist other centers. Of major concern is ensuring that the quality of PET and CT data is appropriate for radiotherapy treatment planning and on-treatment verification. Couch movements can be compromised, bore-size can be a limitation for certain immobilization techniques, laser positioning may affect setup accuracy and couch deflection may be greater than scanners dedicated to radiotherapy. The full set of departmental commissioning and routine quality assurance tests applied to radiotherapy CT simulators must be carried out on the PET-CT scanner. CT image quality must be optimized for radiotherapy planning whilst understanding that the appearance will differ between scanners and may affect delineation. PET-CT quality assurance schedules will need to be added to and modified to incorporate radiotherapy quality assurance. Methods of working for radiotherapy and PET staff will change to take into account considerations of both parties. PET to CT alignment must be subject to quality control on a loaded and unloaded couch preferably using a suitable emission phantom, and tested throughout the whole data pathway. Data integrity must be tested throughout the whole pathway and a system included to verify that delineated structures are transferred correctly. Excellent multidisciplinary team communication and working is vital, and key staff members on both sides should be specifically dedicated to the project. Patient pathway should be clearly devised to optimize patient care and the resources of all departments. Recruitment of a cohort of patients into a methodology study is valuable to test the quality assurance methods and pathway.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Build Optimization Software Tools (BOOST) v2.0.0

Build Optimization Software Tools (BOOST) accelerate the design of DNA, RNA and protein sequences for their synthesis and assembly in an automated and scalable fashion. The BOOST Juggler automates the following two design tasks: - Reverse-Translation of protein sequences into DNA sequences - Codon Juggling of DNA sequences The BOOST Polisher provides the following design tasks: - The Verification of DNA sequences against DNA synthesis constraints - The Modification of DNA sequences in case they violate any DNA synthesis constraint In addition, the BOOST Polisher can be instructed to verify and modify DNA sequences against sequence patterns, such as restriction sites. The BOOST Partitioner supports both Gibson/chewback and Yeast assembly (also known as Transformation-Associated Recombination, or TAR) methods when performing the decomposition of large sequences that exceed the maximum length of DNA synthesis into synthesizable building blocks. The Partitioner can be instructed to find building blocks with appropriate overlap sequences, making their assembly into the complete construct more efficient. BOOST Workflows enable, in a customized fashion, the execution of the Juggler, Polisher, and Partitioner tools on a batch of sequences.

Sharkey, Michael↗

USPAS Digital Low-Level RF firmware and software suite (uspas_llrf) v1.0

The USPAS Digital Low-Level RF firmware and software suite was originally developed for the USPAS 2023 LLRF course, for demonstrating the close loop RF control on the BerkeleyLab Marble FPGA carrier and Zest digitizer platform in controlling the RF field for various accelerators. The suite features Register-transfer level (RTL) designs for the board-support layer, digital signal processing and verification test benches, system-on-chip architecture, and Experimental Physics and Industrial Control System (EPICS) support, utilizing a open-source tool chain.

Du, Qiang↗

Status of the NEAMS and ARC neutronic fast reactor tools integration to the NEAMS Workbench

The Workbench initiative was launched in FY-2017 within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Integration Product Line to facilitate the transition from conventional tools to high-fidelity tools. The Workbench provides a common user interface for model creation, real-time validation, execution, output processing, and visualization for integrated codes. The integration of the Argonne Reactor Computation (ARC) suite of codes into the NEAMS Workbench was initiated in FY-2017. The ARC codes contain both legacy codes like DIF3D and REBUS-3 that were developed with over 30 years of experience, and newer NEAMS additions like MC2-3, PERSENT and PROTEUS. The ARC integration into the NEAMS Workbench interface relies on the PyARC module which handles the pre- and post-processing of the native ARC codes input, and the runtime environment. The PyARC module together with the NEAMS Workbench interface are both released under Open Source Software licenses. In FY-2019, the effort focused on integrating the explicit assembly management logic of REBUS, the GAMSOR code for gamma heating transport, and of the NODAL solver of PROTEUS. Additional capabilities were also integrated in response to user requests, such as the assembly power peaking calculation and a 2D result plotting capability. For verification and demonstration purposes, the ARC codes were used through the Workbench for solving the Sodium-cooled Fast Reactor Uncertainty Analysis in Modelling (SFR-UAM) benchmark problems, including the newly proposed unit cells and ASTRID problem. Significant effort in FY-2019 focused on training new users from ANL, INL, NCSU, and Westinghouse. In particular, extensive training material was developed in the form of tutorials, including documentation, sample inputs, and associated presentations. The ARC codes are now actively used through the NEAMS Workbench by nuclear engineers at ANL, INL, NCSU, and Westinghouse, for LFR, MSR, micro-reactor, and SFR core design analyses. Future efforts will focus on adding new and existing modeling capabilities available with the ARC and NEAMS codes, training new users and supporting them to continue building user experience.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

S4PST: Sustainability for Programming Systems and Tools: May Workshop Report

The US Department of Energy (DOE) Exascale Computing Project (ECP) has fostered and strengthened the use of modern software engineering practices for developing applications and libraries, and this effort has resulted in the coordinated and interoperable E4S1 and xSDK2 ecosystems. Although this approach is cost-effective, it relies on robust programming systems and tools (PST) as the underlying foundation for our HPC software. At present, our primary PST stack consists of traditional high-performance computing (HPC) languages, namely Fortran, C, C++, and the popular Python language for data analysis and AI workflows. These languages support various programming frameworks and run-time abstractions that enable parallelism and concurrency across multiple node architectures and thousands of nodes through a variety of interconnect systems. However, to accommodate users’ diverse needs, certain aspects of the HPC ecosystem are delegated to vendor-specific or third-party implementations that extend beyond a particular scientific domain. This broader scope results in a multitude of specifications and variations, which leads to a complex orchestration of many-ecosystems. Unfortunately, this complexity in the ecosystem imposes additional overhead costs on consumers during the latter stages of the development cycle. In addition to the software ecosystem challenge, the upcoming conclusion of the ECP by December 2023 has raised significant concerns within the HPC programming systems community, from both the economic and social perspectives. The ECP has implemented a management structure for software development and funding decisions across all ECP participants by following a conventional hierarchical and centralized approach. However, this structure has prompted certain considerations within the community, particularly in anticipation of the Software Sustainability initiative by the DOE’s Advanced Scientific Computing Research Program (ASCR). For the success of this new initiative, it is of utmost importance to secure consistent funding and foster close engagement with researchers and core developers of existing programming-system products. This collaboration is vital to maintaining the critical capabilities of the current software during the transition phase while proactively adapting to future technology and workforce trends. The community recognizes the significance of adapting to emerging trends and is aware of the inherent fragility of the HPC software ecosystem, particularly in relation to programming systems that cater to all users. The ability to adapt and evolve is essential to staying relevant and effectively addressing these technical, economic, and social challenges. The S4PST team, which represents one of the six ASCR Software Sustainability seedling projects, is dedicated to tackling these challenges through community-based approaches that go beyond the scope of the DOE. This involves collaboration between national laboratories with academia, non-DOE institutions, hardware and system vendors, and international partners. By fostering these partnerships, we aim to create a robust and sustainable HPC software ecosystem that can effectively meet the needs of the community. This new community effort, driven by the eight DOE labs, will take on the responsibility of guiding funding decisions for programming-systems development and maintenance with transparency and consistency across all decisions. Additionally, the team will offer common technical services to the programming systems community, irrespective of their funding situations, and facilitate community-wide incubation to proactively nurture the software ecosystem. By actively engaging with stakeholders and employing a collaborative approach, we can collectively shape the future of programming systems and ensure a robust and thriving HPC software landscape. On May 11–12, 2023, the S4PST team conducted its inaugural kick-off workshop at the Innovative Computing Laboratory (ICL) in the University of Tennessee, Knoxville, hosted by Hartwig Anzt. The workshop encompassed various sessions dedicated to presentations and discussions, with the aim of comprehending the team members’ perspectives on the vision of software sustainability. Additionally, the workshop aimed to identify the technical, economic, and social requirements for sustaining the programming-systems community in the field of HPC. This report provides a summary of the S4PST effort by highlighting five major thrust areas discussed during the workshop: (i) community, (ii) technical support, (iii) training and diversity, (iv) verification, validation and correctness, and (v) emerging technologies. It also encompasses an overview of the presentations and discussions held throughout the event, our views and potential synergies with other seedling efforts, along with the outcomes and key takeaways from our initial discussions.

97 MATHEMATICS AND COMPUTING↗