Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Test Tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

SU-E-T-532: Validation and Implementation of Model-Based Patient Specific Quality Assurance Using Mobius3D and MobiusFX in a Clinical Setting

Purpose: This work carries out the commissioning and validation of the Mobius3D and MobiusFX software tools, which can replace the time-consuming measurement-based patient specific quality assurance (PSQA). Methods: The beam model supplied by Mobius3D was validated against a 21EX linac's beam measured data. Complex patient (VMAT) plans using Eclipse treatment planning system (TPS) was used to test the consistency between Mobius3D (calculates dose using patient image and field data) and MobiusFx (calculates dose using treatment dynalog files). Dose difference and gamma analysis (3%/3mm) between Mobius3D and MobiusFx were used to assess treatment plan and treatment delivery consistency. An end-to-end test was performed to validate Mobius3D and MobiusFx against ion chamber measurements. Effect of the dosimetric leaf gap (DLG) on Mobius3D dose calculation was additionally investigated. Results: Mobius3D beam model parameters matched within 1%-3% with our beam measured data. A comparison of Mobius3D and MobiusFx dose matrices for VMAT planned prostate cases showed (0.33±0.07)% mean dose difference with gamma values above 95%. The end-to-end test showed dose differences of 1% between Mobius3D and MobiusFx. Dependence of Mobius3D dose calculation upon DLG was explored by introducing a ±0.5 mm change in the default value for DLG. This change resulted in agreement differences above 2% Conclusion: Use of reference beam data would appear to speed up commissioning process for the clinical implementation of Mobius3D. However, careful consideration is required when comparing the information provided by the software, since large dose variations can be seen when the proper parameters are not optimized. The plan and delivered dose were in good agreement; hence MobiusFx has the potential to significantly speed up the PSQA process and at the same time helps to verify treatment parameters that are not possible with measurement-based PSQA.

60 APPLIED LIFE SCIENCES↗

Investigating and implementing enhancements to the simulation of short-term collision hazards

A software tool, the Relative Collision Matrix (RCM), has been developed to provide a quick-look representation of the shortterm collision hazard to space systems from a fragmentation event in Earth orbit. The software performs multiple fragmentation simulations of space objects to quantify the probability of collision for a satellite or a constellation of satellites nearby. Previously, the results were displayed in a color matrix format which showed the relative hazard of each constellation. The RCM can be used for scientific research and operational assessments even though it was designed for test and evaluation applications. Because of its successful use as an analytical tool, the capabilities of RCM are being extended by enhancing the orbital hazard analysis routines, developing ballistic trajectory hazard analysis routines, and expanding the breakup modeling. Improvements are also being made to the RCM's usability and presentation quality by developing a graphical user interface and by providing graphical animated and nonanimated output.

Huth, Jeffrey S.↗

SAS4A/SASSYS-1 Verification Testing for Sodium Fast Reactor Applications (Acceptance Testing Report)

SAS4A/SASSYS-1 (SAS) is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal- cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over fifty years and represents a critical investment in safety analysis capabilities for the U.S. Department of Energy. To support demonstration of software pedigree and confirm key functional requirements, this report has been generated to provide detailed verification of the software. Although SAS was developed to support the analysis of any liquid-metal-cooled nuclear reactor, the acceptance testing described in this document focuses on the verification of SAS capabilities as they relate to pool-type Sodium Fast Reactors (SFRs). This report includes documentation of the test problem definition, analytical solution(s), computational solution(s), acceptance criteria, comparisons of analytical/computational solutions, and determination of acceptance of the computational solution(s). Deviations from acceptance criteria are noted.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Satellite Image Simulation Toolkit

The Satellite Image Simulation Toolkit (SatIST) is a python software package designed to generate diverse and realistic satellite imaging scenarios. It serves as a toolkit for simulating data that supports the development and testing of algorithms used in satellite detection, calibration, and characterization. SIST provides a suite of simulation tools that allow users to replicate various satellite observation conditions, including sidereal and target tracking. By enabling the creation of scenarios that mimic real-world satellite operations, SIST facilitates advancements in satellite image data processing and the study of satellite behavior under different observational parameters.

Perloff, AlexxS [Lawrence Livermore National Labor↗

Electrically Engaged UnduLation (EEL) Marine Energy System

Current technologies at the forefront of instrumentation for ocean observation through acoustic mapping are powered by batteries that cannot achieve the lasting durations required for high-resolution measurements. Pyro-E has designed an Electrically Engaged unduLation (EEL) system capable of in situ energy harvest and deployment in sub-sea configurations. By extracting kinetic energy from the ocean, EEL proposes to provide power output ranging from 1 mW to 1,000 mW. Such a magnitude of power can sustain active instrumentation with onboard processing of data and over-the-horizon telemetry. Pyro-E and Oak Ridge National Laboratory have utilized software tools and powerful computing resources to develop a techno-economic design of the EEL capable of harvesting 5 W. The material response of the EEL under simulated hydromechanical loads is described through time-accurate predictions. All physical tests were conducted by Pyro-E to guide simulations at Oak Ridge National Laboratory.

16 TIDAL AND WAVE POWER↗

The integration of automated knowledge acquisition with computer-aided software engineering for space shuttle expert systems

A prediction was made that the terms expert systems and knowledge acquisition would begin to disappear over the next several years. This is not because they are falling into disuse; it is rather that practitioners are realizing that they are valuable adjuncts to software engineering, in terms of problem domains addressed, user acceptance, and in development methodologies. A specific problem was discussed, that of constructing an automated test analysis system for the Space Shuttle Main Engine. In this domain, knowledge acquisition was part of requirements systems analysis, and was performed with the aid of a powerful inductive ESBT in conjunction with a computer aided software engineering (CASE) tool. The original prediction is not a very risky one -- it has already been accomplished.

Modesitt, Kenneth L.↗

Integrating payload design, planning, and control in the Dutch Utilisation Centre

Spacecraft payload design, experiment planning and scheduling, and payload control are traditionally separate areas of activity. This paper describes the development of a prototype software tool--the Activity Scheduling System (ASS)--which integrates these activity areas. ASS is part of a larger project to build a Dutch Utilisation Centre (DUC), intended eventually to support all space utilization activities in The Netherlands. ASS has been tested on the High Performance Capillary Electrophoresis payload. The paper outlines the integrated preparation and operations concept embodied in ASS. It describes the ASS prototype, including a typical session. The results of testing are summarized. Possible enhancement of ASS, including integration into DUC, is sketched.

Grant, T. J.↗

Interactive Software Fault Analysis Tool for Operational Anomaly Resolution

Resolving software operational anomalies frequently requires a significant amount of resources for software troubleshooting activities. The time required to identify a root cause of the anomaly in the software may lead to significant timeline impacts and in some cases, may extend to compromise of mission and safety objectives. An integrated tool that supports software fault analysis based on the observed operational effects of an anomaly could significantly reduce the time required to resolve operational anomalies; increase confidence for the proposed solution; identify software paths to be re-verified during regression testing; and, as a secondary product of the analysis, identify safety critical software paths.

Chen, Ken↗

An Overview of the Smart Sensor Inter-Agency Reference Testbench (SSIART)

In this paper, we present an overview of a proposed collaboration between the National Aeronautics and Space Administration (NASA) and the European Space Agency (ESA), which is designed to facilitate the introduction of commercial-off-the-shelf (COTS) radios for smart-sensing applications into international spaceflight programs and projects. The proposed work will produce test hardware reference designs, test software reference architectures and example implementations, test plans in reference test environments, and test results, all of which will be shared between the agencies and documented for future use by mission planners. The proposed collaborative structure together with all of the anticipated tools and results produced under the effort is collectively referred to as the Smart Sensor Inter-agency Reference Testbench or SSIART. It is intended to provide guidance in technology selection and in increasing the related readiness levels of projects and missions as well as the space industry.

Wagner, Raymond S.↗

The 200 Gbps Challenge: Imagining HL-LHC analysis facilities

The IRIS-HEP software institute, as a contributor to the broader HEP Python ecosystem, is developing scalable analysis infrastructure and software tools to address the upcoming HL-LHC computing challenges with new approaches and paradigms, driven by our vision of what HL-LHC analysis will require. The institute uses a "Grand Challenge" format, constructing a series of increasingly large, complex, and realistic exercises to show the vision of HL-LHC analysis. Recently, the focus has been demonstrating the IRIS-HEP analysis infrastructure at scale and evaluating technology readiness for production. As a part of the Analysis Grand Challenge activities, the institute executed a "200 Gbps Challenge", aiming to show sustained data rates into the event processing of multiple analysis pipelines. The challenge integrated teams internal and external to the institute, including operations and facilities, analysis software tools, innovative data delivery and management services, and scalable analysis infrastructure. The challenge showcases the prototypes - including software, services, and facilities - built to process around 200 TB of data in both the CMS NanoAOD and ATLAS PHYSLITE data formats with test pipelines. The teams were able to sustain the 200 Gbps target across multiple pipelines. The pipelines focusing on event rate were able to process at over 30 MHz. These target rates are demanding; the activity revealed considerations for future testing at this scale and changes necessary for physicists to work at this scale in the future. The 200 Gbps Challenge has established a baseline on today's facilities, setting the stage for the next exercise at twice the scale.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

TH-AB-207A-05: A Fully-Automated Pipeline for Generating CT Images Across a Range of Doses and Reconstruction Methods

Purpose: To evaluate the robustness of CAD or Quantitative Imaging methods, they should be tested on a variety of cases and under a variety of image acquisition and reconstruction conditions that represent the heterogeneity encountered in clinical practice. The purpose of this work was to develop a fully-automated pipeline for generating CT images that represent a wide range of dose and reconstruction conditions. Methods: The pipeline consists of three main modules: reduced-dose simulation, image reconstruction, and quantitative analysis. The first two modules of the pipeline can be operated in a completely automated fashion, using configuration files and running the modules in a batch queue. The input to the pipeline is raw projection CT data; this data is used to simulate different levels of dose reduction using a previously-published algorithm. Filtered-backprojection reconstructions are then performed using FreeCT-wFBP, a freely-available reconstruction software for helical CT. We also added support for an in-house, model-based iterative reconstruction algorithm using iterative coordinate-descent optimization, which may be run in tandem with the more conventional recon methods. The reduced-dose simulations and image reconstructions are controlled automatically by a single script, and they can be run in parallel on our research cluster. The pipeline was tested on phantom and lung screening datasets from a clinical scanner (Definition AS, Siemens Healthcare). Results: The images generated from our test datasets appeared to represent a realistic range of acquisition and reconstruction conditions that we would expect to find clinically. The time to generate images was approximately 30 minutes per dose/reconstruction combination on a hybrid CPU/GPU architecture. Conclusion: The automated research pipeline promises to be a useful tool for either training or evaluating performance of quantitative imaging software such as classifiers and CAD algorithms across the range of acquisition and reconstruction parameters present in the clinical environment. Funding support: NIH U01 CA181156; Disclosures (McNitt-Gray): Institutional research agreement, Siemens Healthcare; Past recipient, research grant support, Siemens Healthcare; Consultant, Toshiba America Medical Systems; Consultant, Samsung Electronics.

60 APPLIED LIFE SCIENCES↗

FASTER -- A Tool for DSN Forecasting and Scheduling

FASTER (Forecasting And Scheduling Tool for Earth-based Resources) is a suite of tools designed for forecasting and scheduling of JPL's DSN. The DSN is a set of antennas and other associated resources that must be scheduled for satellite communications, astronomy, maintenance, and testing. FASTER is a MS-Windows based program that replaces two existing programs (RALPH and PC4CAST). FASTER was designed to be more flexible, maintainable, and user friendly. FASTER makes heavy use of commercial software to allow for customization by users. FASTER implements scheduling as a two pass process: the first pass calculates a predictive profile of resource utilization; the second pass uses this information to calculate a cost function used in a dynamic programming optimization step. This information allows the scheduler to "look ahead" at activities that are not as yet scheduled. FASTER has succeeded in allowing wider access to data and tools, reducing the amount of effort expended and increasing the quality of analysis.

forecasting↗

Radiological Recovery Logistics Tool - 20161

Argonne is building and testing a tool, the Radiological Recovery Logistics Tool (RRLT), that can be used during the response and recovery from a radiological or nuclear incident to effectively allocate appropriate commercial and public works equipment to mitigate, remove, and contain radiological contamination. The requirements for this tool - as well as development of the resulting software - is overseen by a steering committee of stakeholders from DHS's National Urban Security Technology Laboratory (NUSTL), the Federal Emergency Management Agency (FEMA), and the Environmental Protection Agency (EPA). One essential requirement is for RRLT to support the efficient and appropriate allocation of resources for a radiological response. Subsequent discussions between ANL and stakeholders have solidified the nature of this support to include identification of the types of resources to be allocated. The study reported in this paper has both factored fundamental concepts and connections out of this identification process and created a Knowledge Base detailing support goals, response scenarios, and efficacy information on dozens of equipment types. In short, RRLT will dynamically apply these findings to situational conditions surrounding contamination incidents. RRLT's Domain, the model of elements, ideas and relationships with which the tool will work, draws concepts from technical reports and stakeholder vocabularies to connect response goals and scenarios to types of equipment that offer utility towards those goals in those scenarios. RRLT's Knowledge Base will contain details on dozens of equipment types and facilitate the operator's discovery and consumption of these details most pertinent to a dynamically selected subset of goals. The core of its Domain Model is based on a report authored by this team. This report [1] contains a comprehensive list of proposed equipment to accomplish various missions or scenarios that might arise after a large-scale radiological contamination incident in an urban environment or critical infrastructure. The report divides potential response and recovery efforts into five support goals: Survey and monitoring of the contaminated area; Mitigation of received dose to first responders: Decontamination (gross and final) of buildings, vehicles, roadways, parks, and other surfaces: Waste management of solid waste generated during recovery operations: and Containment of wastewater and other waste generated during the response and recovery phases. RRLT's development is driven by use cases. A use case is an intention with which a user approaches the software. Use cases are grouped into delivery increments to schedule development, testing, and presentation to stakeholders. This model partitions the system into seven increments: User Arrival and Authentication, Search and Navigation, Equipment Recommendation, Plan Management, Content Management, and Expanded Access. Once a user 15 authenticated, RRLT will present the user with a dashboard that allows them to explore or search RRLT's content. The dashboard will also include a 'Plan' panel for collecting decisions and relevant observations about an incident at hand to facilitate development of an equipment list. RRLT will offer three general modes of access to items in the knowledge base: - Keyword search for direct discovery of items, - Navigation along predetermined paths from recovery goal towards equipment types, and - Interactive guidance towards equipment types by an autonomous software agent: the Equipment Recommendation Wizard. This presentation will detail progress in the development of the RRLT and also discuss opportunities for those interested in providing feedback on its content and functionality. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Taking advantage of ground data systems attributes to achieve quality results in testing software

During the software development life cycle process, basic testing starts with the development team. At the end of the development process, an acceptance test is performed for the user to ensure that the deliverable is acceptable. Ideally, the delivery is an operational product with zero defects. However, the goal of zero defects is normally not achieved but is successful to various degrees. With the emphasis on building low cost ground support systems while maintaining a quality product, a key element in the test process is simulator capability. This paper reviews the Transportable Payload Operations Control Center (TPOCC) Advanced Spacecraft Simulator (TASS) test tool that is used in the acceptance test process for unmanned satellite operations control centers. The TASS is designed to support the development, test and operational environments of the Goddard Space Flight Center (GSFC) operations control centers. The TASS uses the same basic architecture as the operations control center. This architecture is characterized by its use of distributed processing, industry standards, commercial off-the-shelf (COTS) hardware and software components, and reusable software. The TASS uses much of the same TPOCC architecture and reusable software that the operations control center developer uses. The TASS also makes use of reusable simulator software in the mission specific versions of the TASS. Very little new software needs to be developed, mainly mission specific telemetry communication and command processing software. By taking advantage of the ground data system attributes, successful software reuse for operational systems provides the opportunity to extend the reuse concept into the test area. Consistency in test approach is a major step in achieving quality results.

Sigman, Clayton B.↗

A knowledge-based system design/information tool for aircraft flight control systems

Research aircraft have become increasingly dependent on advanced electronic control systems to accomplish program goals. These aircraft are integrating multiple disciplines to improve performance and satisfy research objective. This integration is being accomplished through electronic control systems. Systems design methods and information management have become essential to program success. The primary objective of the system design/information tool for aircraft flight control is to help transfer flight control system design knowledge to the flight test community. By providing all of the design information and covering multiple disciplines in a structured, graphical manner, flight control systems can more easily be understood by the test engineers. This will provide the engineers with the information needed to thoroughly ground test the system and thereby reduce the likelihood of serious design errors surfacing in flight. The secondary object is to apply structured design techniques to all of the design domains. By using the techniques in the top level system design down through the detailed hardware and software designs, it is hoped that fewer design anomalies will result. The flight test experiences are reviewed of three highly complex, integrated aircraft programs: the X-29 forward swept wing; the advanced fighter technology integration (AFTI) F-16; and the highly maneuverable aircraft technology (HiMAT) program. Significant operating technologies, and the design errors which cause them, is examined to help identify what functions a system design/informatin tool should provide to assist designers in avoiding errors.

Mackall, Dale A.↗

SAS4A/SASSYS-1 Verification Testing for Sodium Fast Reactor Applications: Acceptance Testing Report

SAS4A/SASSYS-1 (SAS) is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over forty-five years and represents a critical investment in safety analysis capabilities for the U.S. Department of Energy. To support demonstration of software pedigree and confirm key functional requirements, this report has been generated to provide detailed verification of the software. Although SAS was developed to support the analysis of any liquid-metal-cooled nuclear reactor, the acceptance testing described in this document focuses on the verification of SAS capabilities as they relate to pool-type Sodium Fast Reactors (SFRs). This report includes documentation of the test problem definition, analytical solution(s), computational solution(s), acceptance criteria, comparisons of analytical/computational solutions, and determination of acceptance of the computational solution(s). Deviations from acceptance criteria are noted.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating causal‐based feature selection for fuel property prediction models

Abstract In‐silico screening of novel biofuel molecules based on chemical and fuel properties is a critical first step in the biofuel evaluation process due to the significant volumes of samples required for experimental testing, the destructive nature of engine tests, and the costs associated with bench‐scale synthesis of novel fuels. Predictive models are limited by training sets of few existing measurements, often containing similar classes of molecules that represent just a subset of the potential molecular fuel space. Software tools can be used to generate every possible molecular descriptor for use as input features, but most of these features are largely irrelevant and training models on datasets with higher dimensionality than size tends to yield poor predictive performance. Feature selection has been shown to improve machine learning models, but correlation‐based feature selection fails to provide scientific insight into the underlying mechanisms that determine structure–property relationships. The implementation of causal discovery in feature selection could potentially inform the biofuel design process while also improving model prediction accuracy and robustness to new data. In this study, we investigate the benefits causal‐based feature selection might have on both model performance and identification of key molecular substructures. We found that causal‐based feature selection performed on par with alternative filtration methods, and that a structural causal model provides valuable scientific insights into the relationships between molecular substructures and fuel properties.

Nguyen, Bernard↗

WE-F-16A-05: Use of 3D-Printers to Create a Tissue Equivalent 3D-Bolus for External Beam Therapy

Purpose: The purpose of this project is to demonstrate that a non-expensive 3D-printer can be used to manufacture a 3D-bolus for external beam therapy. The printed bolus then can be modeled in our treatment planning system to ensure accurate dose delivery to the patient. Methods: We developed a simple method to manufacture a patient-specific custom 3Dbolus. The bolus is designed using Eclipse Treatment Planning System, contoured onto the patients CT images. The bolus file is exported from Eclipse to 3D-printer software, and then printed using a 3D printer. Various tests were completed to determine the properties of the printing material. Percent depth dose curves in this material were measured with electron and photon beams for comparison to other materials. In order to test the validity of the 3D printed bolus for treatment planning, a custom bolus was printed and tested on the Rando phantom using film for a dose plane comparison. We compared the dose plane measured on the film to the same dose plane exported from our treatment planning system using Film QA software. The gamma-dose distribution tool was used in our film analysis. Results: We compared point measurements throughout the dose plane and were able to achieve greater than 95% passing rate at 3% dose difference and 3 mm distance to agreement, which is our departments acceptable gamma pixel parameters. Conclusion: The printed 3D bolus has proven to be accurately modeled in our treatment planning system, it is more conformal to the patient surface and more durable than other bolus currently used (wax, superflab etc.). It is also more convenient and less costly than comparable bolus from milling machine companies.

60 APPLIED LIFE SCIENCES↗