Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Formal Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

593 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Development of a phantom to validate high-dose-rate brachytherapy treatment planning systems with heterogeneous algorithms

Purpose: This work presents the development of a phantom to verify the treatment planning system (TPS) algorithms used for high-dose-rate (HDR) brachytherapy. It is designed to measure the relative dose in a heterogeneous media. The experimental details used, simulation methods, and comparisons with a commercial TPS are also provided. Methods: To simulate heterogeneous conditions, four materials were used: Virtual Water™ (VM), BR50/50™, cork, and aluminum. The materials were arranged in 11 heterogeneity configurations. Three dosimeters were used to measure the relative response from a HDR {sup 192}Ir source: TLD-100™, Gafchromic{sup ®} EBT3 film, and an Exradin™ A1SL ionization chamber. To compare the results from the experimental measurements, the various configurations were modeled in the PENELOPE/penEasy Monte Carlo code. Images of each setup geometry were acquired from a CT scanner and imported into BrachyVision™ TPS software, which includes a grid-based Boltzmann solver Acuros™. The results of the measurements performed in the heterogeneous setups were normalized to the dose values measured in the homogeneous Virtual Water™ setup and the respective differences due to the heterogeneities were considered. Additionally, dose values calculated based on the American Association of Physicists in Medicine-Task Group 43 formalism were compared to dose values calculated with the Acuros™ algorithm in the phantom. Calculated doses were compared at the same points, where measurements have been performed. Results: Differences in the relative response as high as 11.5% were found from the homogeneous setup when the heterogeneous materials were inserted into the experimental phantom. The aluminum and cork materials produced larger differences than the plastic materials, with the BR50/50™ material producing results similar to the Virtual Water™ results. Our experimental methods agree with the PENELOPE/penEasy simulations for most setups and dosimeters. The TPS relative differences with the Acuros™ algorithm were similar in both experimental and simulated setups. The discrepancy between the BrachyVision™, Acuros™, and TG-43 dose responses in the phantom described by this work exceeded 12% for certain setups. Conclusions: The results derived from the phantom measurements show good agreement with the simulations and TPS calculations, using Acuros™ algorithm. Differences in the dose responses were evident in the experimental results when heterogeneous materials were introduced. These measurements prove the usefulness of the heterogeneous phantom for verification of HDR treatment planning systems based on model-based dose calculation algorithms.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2022

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗
NASA NTRSDate not supplied

Bridging the Gap Between Requirements and Simulink Model Analysis

Formal veri fication and simulation are powerful tools for the veri fication of requirements against complex systems. Requirements are developed in early stages of the software lifecycle and are typically expressed in natural language. There is a gap between such requirements and their software implementations. We present a framework that bridges this gap by supporting a tight integration and feedback loop between high-level requirements and their analysis against software artifacts. Our framework implements an analysis portal within the fret requirements elicitation tool, thus forming an end-to-end, open-source environment where requirements are written in an intuitive, structured natural language, and are veri fied automatically against Simulink models.

FRET↗
DOE OSTI2013

A dynamic, dependent type system for nuclear fuel cycle code generation

The nuclear fuel cycle may be interpreted as a network or graph, thus allowing methods from formal graph theory to be used. Nodes are often idealized as nuclear fuel cycle facilities (reactors, enrichment cascades, deep geologic repositories). With the advent of modern object-oriented programming languages - and fuel cycle simulators implemented in these languages - it is natural to define a class hierarchy of facility types. Bright is a quasi-static simulator, meaning that the number of material passes through a facility is tracked rather than natural time. Bright is implemented as a C++ library that models many canonical components such as reactors, storage facilities, and more. Cyclus is a discrete time simulator, meaning that natural time is tracked through out the simulation. Therefore a robust, dependent type system was developed to enable inter-operability between Bright and Cyclus. This system is capable of representing any fuel cycle facility. Types declared in this system can then be used to automatically generate code which binds a facility implementation to a simulator front end. Facility model wrappers may be used either internally to a fuel cycle simulator or as a mechanism for inter-operating multiple simulators. While such a tool has many potential use cases it has two main purposes: enabling easy performance of code-to-code comparisons and the verification and the validation of user input.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Challenges and opportunities in verification and validation of low temperature plasma simulations and experiments

This paper describes the verification and validation (V&V) framework developed for the stochastic Particle-in-Cell, Direct Simulation Monte Carlo code Aleph. An ideal framework for V&V from the viewpoint of the authors is described where a physics problem is defined, and relevant physics models and parameters to the defined problem are assessed and captured in a Phenomena Identification and Ranking Table (PIRT). Furthermore, numerous V&V examples guided by the PIRT for a simple gas discharge are shown to demonstrate the V&V process applied to a real-world simulation tool with the overall goal to demonstrably increase the confidence in the results for the simulation tool and its predictive capability. Although many examples are provided here to demonstrate elements of the framework, the primary goal of this work is to introduce this framework and not to provide a fully complete implementation, which would be a much longer document. Comparisons and contrasts are made to more usual approaches to V&V, and techniques new to the low-temperature plasma community are introduced. Specific challenges relating to the sufficiency of available data (e.g., cross sections), the limits of ad hoc validation approaches, the additional difficulty of utilizing a stochastic simulation tool, and the extreme cost of formal validation are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Calculation Of The First Moment Of Energy Using D-T Reactivity Formalisms Under The Maxwell-Boltzmann Distribution--Part II

Nuclear fusion science is an example of a scientific field with a rich history of expert involvement and scientific publications, which together, form an expert-knowledge base. One example of a nuclear fusion formalism is the utilization of published reaction rates from a variety of authors. Investigators for Deuterium- Tritium (D-T) ion fusion can choose from using frequently cited methods: the Bosch and Hal reactivity, thermonuclear reaction rates from Caughlan and Fowler, and the reactivity evaluation from Miley, Towner & Ivich which forms the basis of the Naval Research Lab (NRL) formulary. There are other choices available. Each of the reactivity formulations considered here, are based upon the Maxwell-Boltzmann velocity distribution for D-T fusion ion reactants. Numerical methods for computer codes simulating hot, energetic plasmas, include tabulations of the reactivity, and the first moment of energy. This report continues the step toward building understanding of nuclear fusion reactivity formalisms. It is part of a series of reports with the same goal, [5-10] and is the continuation of the Part I paper for defining the mathematical relationship of the first moment of D-T fusion ion kinetic energy, <$E$>, with the fusion cross-section, fusion reactivity and its derivative with ion-temperature. In Part I, three variants of the first moment <$E$> were analytically developed and explored: 1) constant cross-section, 2) a normalized first moment, and 3) a particular function of the first moment from Brysk. In Part II, attention is given to the definition of <$K$>, originally described as a ratio of moments from Brysk, and its relationship to the first moment definitions from Part I. One measure of the progress made in these documents is the identification that Brysk’s ratio of the second moment to the first moment ratio, <$K$>, does not correspond to his provided solution of the first moment of energy. Another measure of (our) progress from this work is the comparison of first moment variants. That comparison includes confirming the importance of cross sections defined in terms of energy. The analytical relationships we have developed among important physics quantities are useful tools in validation and verification (V&V). For example, we can calculate the kinetic energy as a mean or as a first moment, or as a function of the first moment. These analytically-determined values can be compared directly with numerically-determined values, supplied to the authors, representing <$E$>.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2016

SU-G-201-15: Nomogram as an Efficient Dosimetric Verification Tool in HDR Prostate Brachytherapy

Purpose: Nomogram as a simple QA tool for HDR prostate brachytherapy treatment planning has been developed and validated clinically. Reproducibility including patient-to-patient and physician-to-physician variability was assessed. Methods: The study was performed on HDR prostate implants from physician A (n=34) and B (n=15) using different implant techniques and planning methodologies. A nomogram was implemented as an independent QA of computer-based treatment planning before plan execution. Normalized implant strength (total air kerma strength Sk*t in cGy cm{sup 2} divided by prescribed dose in cGy) was plotted as a function of PTV volume and total V100. A quadratic equation was used to fit the data with R{sup 2} denoting the model predictive power. Results: All plans showed good target coverage while OARs met the dose constraint guidelines. Vastly different implant and planning styles were reflected on conformity index (entire dose matrix V100/PTV volume, physician A implants: 1.27±0.14, physician B: 1.47±0.17) and PTV V150/PTV volume ratio (physician A: 0.34±0.09, physician B: 0.24±0.07). The quadratic model provided a better fit for the curved relationship between normalized implant strength and total V100 (or PTV volume) than a simple linear function. Unlike the normalized implant strength versus PTV volume nomogram which differed between physicians, a unique quadratic model based nomogram (Sk*t)/D=−0.0008V2+0.0542V+1.1185 (R{sup 2}=0.9977) described the dependence of normalized implant strength on total V100 over all the patients from both physicians despite two different implant and planning philosophies. Normalized implant strength - total V100 model also generated less deviant points distorting the smoothed ones with a significantly higher correlation. Conclusion: A simple and universal, excel-based nomogram was created as an independent calculation tool for HDR prostate brachytherapy. Unlike similar attempts, our nomogram is insensitive to implant style and does not rely on reproducing dose calculations using TG-43 formalism, thus making it a truly independent check.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-J-130: Margin Determination for Hypofractionated Partial Breast Irradiation

Purpose: To determine the Planning Target Volume (PTV) margin for Hypofractionated Partial Breast Irradiation (HPBI) using the van Herk formalism (M=2.5∑+0.7σ). HPBI is a novel technique intended to provide local control in breast cancer patients not eligible for surgical resection, using 40 Gy in 5 fractions prescribed to the gross disease. Methods: Setup uncertainties were quantified through retrospective analysis of cone-beam computed tomography (CBCT) data sets, collected prior to (prefraction) and after (postfraction) treatment delivery. During simulation and treatment, patients were immobilized using a wing board and an evacuated bag. Prefraction CBCT was rigidly registered to planning 4-dimensional computed tomography (4DCT) using the chest wall and tumor, and translational couch shifts were applied as needed. This clinical workflow was faithfully reproduced in Pinnacle (Philips Medical Systems) to yield residual setup and intrafractional error through translational shifts and rigid registrations (ribs and sternum) of prefraction CBCT to 4DCT and postfraction CBCT to prefraction CBCT, respectively. All ten patients included in this investigation were medically inoperable; the median age was 84 (range, 52–100) years. Results: Systematic (and random) setup uncertainties (in mm) detected for the left-right, craniocaudal and anteroposterior directions were 0.4 (1.5), 0.8 (1.8) and 0.4 (1.0); net uncertainty was determined to be 0.7 (1.5). Rotations >2° in any axis occurred on 8/72 (11.1%) registrations. Conclusion: Preliminary results suggest a non-uniform setup margin (in mm) of 2.2, 3.3 and 1.7 for the left-right, craniocaudal and anteroposterior directions is required for HPBI, given its immobilization techniques and online setup verification protocol. This investigation is ongoing, though published results from similar studies are consistent with the above findings. Determination of margins in breast radiotherapy is a paradigm shift, but a necessary step in moving towards hypofractionated regiments, which may ultimately redefine the standard of care for this select patient population.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

The spin structure of the nucleon

We review the present understanding of the spin structure of protons and neutrons, the fundamental building blocks of nuclei collectively known as nucleons. The field of nucleon spin provides a critical window for testing Quantum Chromodynamics (QCD), the gauge theory of the strong interactions since it involves fundamental aspects of hadron structure, and it can be probed in detail in experiments, particularly deep inelastic lepton scattering on polarized targets. QCD was initially probed in high energy deep inelastic lepton scattering with unpolarized beams and targets. With time, interest shifted from testing perturbative QCD to illuminating the nucleon structure itself. In fact, the spin degrees of freedom of hadrons provides an essential and detailed verification of both perturbative and nonperturbative QCD dynamics. Nucleon spin was initially thought of coming mostly from the spin of its quark constituents, based on intuition from the parton model. However, the first experiments showed that this expectation was incorrect. It is now clear that nucleon physics is much more complex, involving quark orbital angular momenta as well as gluonic and sea quark contributions. Thus, the nucleon spin structure remains a most active aspect of QCD research, involving important advances such as the developments of generalized parton distributions (GPD) and transverse momentum distributions (TMD). Elastic and inelastic lepton-proton scattering, as well as photoabsorption experiments provide various ways to investigate non-perturbative QCD. Fundamental sum rules --such as the Bjorken sum rule for polarized photoabsorption on polarized nucleons-- are also in the non-perturbative domain. This realization triggered a vigorous program to link the low energy effective hadronic description of the strong interactions to fundamental quarks and gluon degrees of freedom of QCD. This has also led to the development of holographic QCD ideas based on the AdS/CFT or gauge/gravity correspondence, a novel approach providing a well-founded semiclassical approximation to QCD. Any QCD-based model of the nucleon's spin and dynamics must also successfully account for the observed spectroscopy of hadrons. Analytic calculations of the hadron spectrum, a long sought goal of QCD research, has now being realized using light-front holography and superconformal quantum mechanics, a formalism consistent with the results from nucleon spin studies. We begin this review with a phenomenological description of nucleon structure in general and of its spin structure in particular, aimed to engage non-specialist readers. A fundamental tool is Dirac's front form and light-front quantization which provides a frame-independent, relativistic description of hadron structure and dynamics, the derivation of spin-sum rules, and a direct connection to the QCD Lagrangian. Next, we discuss the nucleon spin structure at high energy, including topics such as GPDs and TMDs, as well as nucleon spin observables sensitive to final-state interactions such as the Sivers effect. We then discuss experimental and theoretical advances in the nonperturbative domain --in particular the development of light-front holographic QCD and superconformal quantum mechanics, its predictions for the spin content of nucleons, the computation of PDFs and of hadron masses.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2014

SU-E-T-05: A 2D EPID Transit Dosimetry Model Based On An Empirical Quadratic Formalism

Purpose: To describe a 2D electronic portal imaging device (EPID) transit dosimetry model, based on an empirical quadratic formalism, that can predict either EPID or in-phantom dose distribution for comparisons with EPID captured image or treatment planning system (TPS) dose respectively. Methods: A quadratic equation can be used to relate the reduction in intensity of an exit beam to the equivalent path length of the attenuator. The calibration involved deriving coefficients from a set of dose planes measured for homogeneous phantoms with known thicknesses under reference conditions. In this study, calibration dose planes were measured with EPID and ionisation chamber (IC) in water for the same reference beam (6MV, 100mu, 20×20cm{sup 2}) and set of thicknesses (0–30cm). Since the same calibration conditions were used, the EPID and IC measurements can be related through the quadratic equation. Consequently, EPID transit dose can be predicted from TPS exported dose planes and in-phantom dose can be predicted using EPID distribution captured during treatment as an input. The model was tested with 4 open fields, 6 wedge fields, and 7 IMRT fields on homogeneous and heterogeneous phantoms. Comparisons were done using 2D absolute gamma (3%/3mm) and results were validated against measurements with a commercial 2D array device. Results: The gamma pass rates for comparisons between EPID measured and predicted ranged from 93.6% to 100.0% for all fields and phantoms tested. Results from this study agreed with 2D array measurements to within 3.1%. Meanwhile, comparisons in-phantom between TPS computed and predicted ranged from 91.6% to 100.0%. Validation with 2D array device was not possible for inphantom comparisons. Conclusion: A 2D EPID transit dosimetry model for treatment verification was described and proven to be accurate. The model has the advantage of being generic and allows comparisons at the EPID plane as well as multiple planes in-phantom.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Uncertainty as a Function of Time for Subcritical Experiment Parameters Using the Hage-Cifarelli Formalism

When designing critical or subcritical experiments, it is desirable to have an estimate of the measurement uncertainties prior to performing an experiment. In addition, an important goal is to have the smallest measurement uncertainties possible given measurement time constraints. Having well-designed experiments with small uncertainties helps improve nuclear data and therefore has direct impacts on criticality safety. This work shows how the uncertainties in various measurement parameters vary as a function of counting time and provides an approach to estimate measured uncertainties and guides in optimizing the available counting time. The uncertainty in six parameters used in subcritical experiments was investigated as a function of time: singles count rate (R{sub 1}), doubles count rate (R{sub 2}), lifetime (1/λ), leakage multiplication (M{sub L}), spontaneous fission rate (FS), and detector efficiency (ε). A comparison to measured data will be presented at the meeting. The approach and results in this work will be used to optimize measurement time in future subcritical experiments and will be used to help estimate measurement uncertainties during the design phase. Having well-designed experiments with the smallest uncertainties possible can help the criticality safety community through data validation. (authors)

42 ENGINEERING↗
DOE OSTI2013

Development and implementation of energy efficiency standards and labeling programs in China: Progress and challenges

Over the last twenty years, with growing policy emphasis on improving energy efficiency and reducing environmental pollution and carbon emissions, China has implemented a series of new minimum energy performance standards (MEPS) and mandatory and voluntary energy labels to improve appliance energy efficiency. As China begins planning for the next phase of standards and labeling (S&L) program development under the 12th Five Year Plan, an evaluation of recent program developments and future directions is needed to identify gaps that still exist when compared with international best practices. The review of China’s S&L program development and implementation in comparison with major findings from international experiences reveal that there are still areas of improvement, particularly when compared to success factors observed across leading international S&L program. China currently lacks a formalized regulatory process for standard-setting and do not have any legal or regulatory guidance on elements of S&L development such as stakeholder participation or the issue of legal precedence between conflicting national, industrial and local standards. Consequently, China’s laws regarding standard-setting and management of the mandatory energy label program could be updated, as they have not been amended or revised recently and no longer reflects the current situation. While China uses similar principles for choosing target products as the U.S., Australia, EU and Japan, including high energy-consumption, mature industry and testing procedure and stakeholder support, recent MEPS revisions have generally aimed at only eliminating the bottom 20% efficiency of the market. Setting a firm principle based on maximizing energy savings that are technically feasible and economically justified may help improve the stringency of China’s MEPS program and reduce the need for frequent revisions. China also lacks robust survey data and relies primarily on market research data in relatively simple techno-economic analyses used to determine its efficiency standards levels rather than the specific sets of analyses and tools used internationally. Based on international experiences, inclusion of more detailed energy consumption surveys in the Chinese national census surveys and statistical reporting systems could help provide the necessary data for more comprehensive standard-setting analyses. In terms of stakeholder participation in the standards development process, stakeholder participation in China is limited to membership on technical committees responsible for developing or revising standards and generally do not include environmental groups, consumer associations, utilities and other NGOs. Increasing stakeholder involvement to broader interest groups could help garner more support and feedback in the S&L implementation process. China has emerged as a leader in a national verification testing scheme with complementary pilot checktesting projects, but it still faces challenges with insufficient funding, low local awareness amongst some regulatory agencies and resistance to check-testing by some manufacturers, limited product sampling scope, and testing inconsistency and incomparability of results. Thus, further financial and staff resources and capacity building will be needed to overcome these remaining challenges and to expand impacts evaluations to assess the actual effectiveness of implementation and enforcement.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2018

The OpenSE Cookbook: A Practical, Recipe Based Collection of Patterns, Procedures, and Best Practices for Executable Systems Engineering for the Thirty Meter Telescope

The OpenSE Cookbook is an open-sourced collection of patterns, procedures, and best practices targeted for systems engineers who seek guidance on applying model-based and executable systems engineering (MBSE) using SysML. Its content has emerged from the system level modeling effort on the European Framework Program 6 (FP6) and the Thirty Meter Telescope (TMT). The TMT MBSE approach applied the Executable Systems Engineering Method (ESEM) and the open-source Engineering Environment (OpenMBEE) to specify, analyze, and verify requirements of TMT’s Alignment and Phasing System (APS) and the Narrow Field Infrared Adaptive Optics System (NFIRAOS). In these applications, implicit dependencies are made explicit in a formal model through the use of ESEM, OpenMBEE, and SysML modeling constructs. The value proposition for applying this MBSE approach was to establish precise requirements and fine-grained traceability to system designs, and to verify key requirements beginning early in development. The integration of ESEM and the OpenMBEE tooling infrastructure (providing linked-data and web-operability) is a significant added value for the MBSE approach. The APS is responsible for the overall pre-adaptive optics wavefront quality, using starlight to measure wavefront errors and align the TMT optics. In the formally integrated and executable SysML model, simulations are performed to analyze the impact of changed requirements and verify specified constraints for various operational scenarios. The APS team used several modeling patterns to capture information such as the requirements, the operational scenarios, involved subsystems and their interaction points, the estimated or required time durations, and the mass and power consumption. Adaptive optics systems are designed to sense real-time atmospheric turbulence and correct the telescope’s optical beam to remove its effect. The system model for the adaptive optics operational modes was developed to capture sequence behaviors and operational scenarios to run Monte-Carlo simulations for verifying acquisition time, observing efficiency, and operational behavior requirements. The model is particularly useful for investigating the effect of parallelization, identifying interface issues, and re-ordering sequence acquisition tasks. A former version of the Cookbook (which is now updated to MBSE challenges, goals, and lessons learned) included modeling guidelines and conventions for all system aspects, hierarchy levels, and views, which were developed during for the Active Phasing Experiment (APE), an opto-mechatronical system technology demonstrator for the Extremely Large Telescope (ELT). The Cookbook utilizes the above mentioned system models as real-world case-studies to demonstrate and document the applications of the recipes, providing also instructional examples and addressing the available tooling support. The Cookbook is accompanied by a number of SysML models and aodel libraries which facilitate model authoring and maintenance. The Cookbook covers the different aspects of Systems Engineering such as management of Requirements, Design (behavior and structure), Interfaces, Interdisciplinary Integration, Analysis, Trade Studies, and Technical Resources. This paper presents the background, motivation, architecture, and highlights some key content of the Cookbook. For example, interface management, error budget management, requirements verification, Monte Carlo driven analysis, and timing analysis of operational scenarios. The paper discusses how the capabilities of OpenMBEE contributed significantly to the adoption of executable systems engineering.

Brower, Eric↗
DOE OSTI2025

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

open quantum systems & decoherence↗
NASA NTRS2008

Automated Generation and Assessment of Autonomous Systems Test Cases

This slide presentation reviews some of the issues concerning verification and validation testing of autonomous spacecraft routinely culminates in the exploration of anomalous or faulted mission-like scenarios using the work involved during the Dawn mission's tests as examples. Prioritizing which scenarios to develop usually comes down to focusing on the most vulnerable areas and ensuring the best return on investment of test time. Rules-of-thumb strategies often come into play, such as injecting applicable anomalies prior to, during, and after system state changes; or, creating cases that ensure good safety-net algorithm coverage. Although experience and judgment in test selection can lead to high levels of confidence about the majority of a system's autonomy, it's likely that important test cases are overlooked. One method to fill in potential test coverage gaps is to automatically generate and execute test cases using algorithms that ensure desirable properties about the coverage. For example, generate cases for all possible fault monitors, and across all state change boundaries. Of course, the scope of coverage is determined by the test environment capabilities, where a faster-than-real-time, high-fidelity, software-only simulation would allow the broadest coverage. Even real-time systems that can be replicated and run in parallel, and that have reliable set-up and operations features provide an excellent resource for automated testing. Making detailed predictions for the outcome of such tests can be difficult, and when algorithmic means are employed to produce hundreds or even thousands of cases, generating predicts individually is impractical, and generating predicts with tools requires executable models of the design and environment that themselves require a complete test program. Therefore, evaluating the results of large number of mission scenario tests poses special challenges. A good approach to address this problem is to automatically score the results based on a range of metrics. Although the specific means of scoring depends highly on the application, the use of formal scoring - metrics has high value in identifying and prioritizing anomalies, and in presenting an overall picture of the state of the test program. In this paper we present a case study based on automatic generation and assessment of faulted test runs for the Dawn mission, and discuss its role in optimizing the allocation of resources for completing the test program.

Testing challenges↗
NASA NTRS1996

Development and Demonstration of an Ada Test Generation System

In this project we have built a prototype system that performs Feasible Path Analysis on Ada programs: given a description of a set of control flow paths through a procedure, and a predicate at a program point feasible path analysis determines if there is input data which causes execution to flow down some path in the collection reaching the point so that tile predicate is true. Feasible path analysis can be applied to program testing, program slicing, array bounds checking, and other forms of anomaly checking. FPA is central to most applications of program analysis. But, because this problem is formally unsolvable, syntactic-based approximations are used in its place. For example, in dead-code analysis the problem is to determine if there are any input values which cause execution to reach a specified program point. Instead an approximation to this problem is computed: determine whether there is a control flow path from the start of the program to the point. This syntactic approximation is efficiently computable and conservative: if there is no such path the program point is clearly unreachable, but if there is such a path, the analysis is inconclusive, and the code is assumed to be live. Such conservative analysis too often yields unsatisfactory results because the approximation is too weak. As another example, consider data flow analysis. A du-pair is a pair of program points such that the first point is a definition of a variable and the second point a use and for which there exists a definition-free path from the definition to the use. The sharper, semantic definition of a du-pair requires that there be a feasible definition-free path from the definition to the use. A compiler using du-pairs for detecting dead variables may miss optimizations by not considering feasibility. Similarly, a program analyzer computing program slices to merge parallel versions may report conflicts where none exist. In the context of software testing, feasibility analysis plays an important role in identifying testing requirements which are infeasible. This is especially true for data flow testing and modified condition/decision coverage. Our system uses in an essential way symbolic analysis and theorem proving technology, and we believe this work represents one of the few successful uses of a theorem prover working in a completely automatic fashion to solve a problem of practical interest. We believe this work anticipates an important trend away from purely syntactic-based methods for program analysis to semantic methods based on symbolic processing and inference technology. Other results demonstrating the practical use of automatic inference is being reported in hardware verification, although there are significant differences between the hardware work and ours. However, what is common and important is that general purpose theorem provers are being integrated with more special-purpose decision procedures to solve problems in analysis and verification. We are pursuina commercial opportunities for this work, and will use and extend the work in other projects we are engaged in. Ultimately we would like to rework the system to analyze C, C++, or Java as a key step toward commercialization.

Source record↗
DOE OSTI2016

Status of Electronics Upgrades to the LANL Green is Clean Phoswich Detector Systems - 16419

Los Alamos National Laboratory radiological facilities produce low-density room trash that, in many cases, is not contaminated with radioactivity. It has been estimated that 50 to 90% of low-density room trash is free of radioactive contamination and eligible for inclusion in LANL's Green is Clean (GIC) program. The GIC program is a verification program for non-regulated waste from radiation controlled areas that has been actively segregated as nonradioactive through the use of the waste generator's acceptable knowledge. The GIC program has employed two large area Phoswich gamma ray detector systems (HERCULES and ZEUS) to assay and verify that GIC candidate waste meets free release disposal requirements. The large area (127 cm{sup 2}) Phoswich detectors consist of a thin NaI front crystal (3 mm thick) that is optically coupled to a thick CsI back crystal (50 mm thick). The crystals are set in an oxygen-free high-conductivity copper housing with a very thin (0.025 mm) aluminum entrance window. The scintillation properties of the two crystals are different enough to allow the system's electronic components to identify the origin of any pulse. The original systems utilize Nuclear Instrumentation Module (NIM) electronics to process the detector signals. These electronic modules provide the buffering, amplification, and pulse shape analyzer needed for the proper presentation of signals to the custom Phosmux router module. The router module separates the sodium iodide and cesium iodide signals by their rise times and transfers this information into the computer-mounted multichannel analyzer, a Canberra Model S-100 system. While these NIM Bin counting electronics configurations have been effective for approximately 20 years of operation, they are bulky requiring numerous modules per detector and the important Phosmux module is no longer manufactured by LANL. Modern advancement of commercial counting electronics now offer more compact options for equivalent detector signal processing. A pulse shape discriminator module, the DGF Pixie-4, made by XIA LLC, has been identified that can replace the majority of the original NIM bin electronics in a much more compact chassis - one Pixie-4 replaces four NIM amplifiers and four NIM PSAs and fits in a small National Instruments{sup TM} chassis. Thus, LANL has initiated a system upgrade project to replace the historic NIM electronics with the XIA Pixie4 and associated configuration software. The hardware for one Phoswich systems has been procured for the project and the configuration software, customized for the LANL Phoswich detector application, has been written by the manufacturer. Initial setup and optimization of the Pixie-4 configuration has been performed. Qualitative and quantitative baseline comparisons to the NIM electronics has been performed. Good agreement of key low energy gamma lines between the systems has allowed 'Proof of Concept' to be concluded. Further optimization and performance evaluations are in progress. Modifications to the LabVIEW{sup TM} based operating software (originally written by VI Control Systems Ltd.) are being performed by a LANL LabVIEW{sup TM} programmer to accommodate the electronics upgrade. A new LabVIEW{sup TM} interface to control the Pixie-4 has already been developed. Final optimization and testing, formal software QA, and revisions to operating procedures are in progress to achieve completion of the GIC system upgrade project. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗