Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Evaluation of Programming Language-Aware Diffs for Improving Developer Productivity

As the number of supported platforms for SNL software increases, so do the testing requirements. This increases the total time spent between when a developer submits code for testing, and when tests are completed. This in turn leads developers to hold off submitting code for testing, meaning that when code is ready for testing there's a lot more of it. This increases the likelihood of merge conflicts which the developer must resolve by hand -- because someone else touched the files near the lines the developer touched. Current text-based diff tools often have trouble resolving conflicts in these cases. Work in Europe and Japan has demonstrated that, using programming language aware diff tools (e.g., using the abstract syntax tree (AST) a compiler might generate) can reduce the manual labor necessary to resolve merge conflicts. These techniques can detect code blocks which have moved, as opposed than current text-based diff tools, which only detect insertions / deletions of text blocks. In this study, we evaluate one such tool, GumTree, and see how effective it is as a replacement for traditional text-based diff approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Hubble Frontier Field Clusters and Their Parallel Fields: Photometric and Photometric Redshift Catalogs

We present a multiband analysis of the six Hubble Frontier Field clusters and their parallel fields, producing catalogs with measurements of source photometry and photometric redshifts. We release these catalogs to the public along with maps of intracluster light and models for the brightest galaxies in each field. This rich data set covers a wavelength range from 0.2 to 8 μm, utilizing data from the Hubble Space Telescope, Keck Observatories, Very Large Telescope array, and Spitzer Space Telescope. We validate our products by injecting into our fields and recovering a population of synthetic objects with similar characteristics to those in real extragalactic surveys. The photometric catalogs contain a total of over 32,000 entries, with 50% completeness at a threshold of mag AB ~ 29.1 for unblended sources and magAB ~ 29 for blended ones, in the IR-weighted detection band. Photometric redshifts were obtained by means of template fitting and have an average outlier fraction of 10.3% and scatter σ = 0.067 when compared to spectroscopic estimates. The software we devised, after being tested in the present work, will be applied to new data sets from ongoing and future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

Investigating Short Circuit Models for Wind Turbine Generators

Short circuit study needs to be performed at the planning stage before connecting large gen erators with the electric grid. This study will reveal the impact of new generation on the fault levels of the grid. The fault levels will determine the rating of nearby equipment and setting of relays. However, a short circuit model of the new generation is required for this study. This report investigates and quantifies the short circuit models of different wind turbine generators (WTGs) and of wind farms, and using these models, explores the effects of the wind farms on the nearby switchgear. WTGs, commonly classified as Type 1, Type 2, Type 3, and Type 4, exhibit different short circuit behavior depending upon their architecture and controls. The short circuit model (synonymous to Thevenin model) of Type 1 WTG is well known; it comprises of a voltage source behind a transient reactance, X'. The transient reactance X' is derived using the reactance of stator, rotor and the magnetizing reactance. In case of Type 2 WTG, an external rotor resistance is used to increase the range of operating slips. The value of the external rotor resistance increases at higher operating slips. The effect of the external rotor resistance on the fault current response is analyzed by simulating a validated model of Type 2 WTG. The validation is performed using the field data from an actual 67-machine Type 2 wind farm located in Wyoming, USA. The results shows that the external rotor resistance should be considered in its Thevenin impedance for better accuracy. A wind farm contains a large number of WTGs, pad mounted transformers, and cables typically connected in a ‘daisy chain” configuration. The effect of these cable impedances on the short circuit model of Type 2 wind farm is examined using the validated models. It is found that the collector circuit cables inside the farm do not have a significant effect on the short circuit model of the farm. Based on this finding, a simple equivalencing procedure for the wind farm is proposed and validated. Faults inside and outside the wind farm are analyzed and recommendations to select main circuit breakers and generator circuit breakers are made. Type 3 WTG, also known as Doubly Fed Asynchronous Generator (DFAG), uses back to back converters in the rotor circuit to inject slip frequency voltage into the rotor circuit. Until recently, these machines used crowbar to short the rotor circuit during faults to protect the converter com ponents form high rotor currents resulting from faults. This type of WTG is simulated and the model is validated using field data from a 66-machine Type 3 wind farm in Wyoming, USA. The simulation study reveals that the crowbar feature is activated almost immediately after the fault takes place, and remains activated throughout the fault-period. This confirms that the short circuit model for Type 3 WTG with crowbar is similar to the model for Type 2 WTG. In the past, wind farms were allowed to disconnect during faults. However, recent grid codes around the world and in the United States demand that the wind farms be kept connected to the grid during faults, and provide certain reactive power quantified based on the voltage dip at the point of interconnection. This requirement, also called low voltage ride through (LVRT), can be accomplished by using Type 4 WTGs that employ full back to back converter interface between generators (permanent magnet synchronous generators are typically used) and the grid. However, the controls are proprietary, and hence the short circuit models are not well defined. This report proposes controls that enable the WTG to comply with the strictest grid codes, and based on this model, proposes a short circuit model of the Type 4 WTG. This model is not validated due to lack of validation data, but the use of grid code requirements as control objectives lends good credibility to the model. PSCAD/EMTDC ® , a powerful and time-tested time-domain simulation software is used to implement all models. This software is capable of modeling in detail all components of wind farms, and all components and controls of converters in time domain.

17 WIND ENERGY↗
DOE OSTI2015

Developing a 300C Analog Tool for EGS

This paper covers the development of a 300°C geothermal well monitoring tool for supporting future EGS (enhanced geothermal systems) power production. This is the first of 3 tools planed. This is an analog tool designed for monitoring well pressure and temperature. There is discussion on 3 different circuit topologies and the development of the supporting surface electronics and software. There is information on testing electronic circuits and component. One of the major components is the cable used to connect the analog tool to the surface.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Science Federation Emulation Testbed: Demonstration of VFSIE Functionalities

The Virtual Federated Science Instrument Environment (VFSIE) is a digital twin of a federated infrastructure of multiple sites with science instruments and computing systems that are geographically dispersed. It emulates the federation using containers and virtual hosts (vhosts) connected over local and wide-area networks for the main purpose of supporting the development and testing of science workflows and software stacks, which will subsequently transition to the physical infrastructure. In this demo, we present VFSIE of a four sites scenario and illustrate the following use cases: (i) execution of federation stack components that expose resources to enable a science user to execute workflows, (ii) execution of remote control commands of beam-line instruments to collect measurements and position the sensor, and (iii) remote execution and access of Jupyter Notebook for tomographic image computations

Al Najjar, Anees↗
DOE OSTI2024

Scalable DAQ system operating the CHIPS-5 neutrino detector

The CHIPS R&D project focuses on development of low-cost water Cherenkov neutrino detectors through novel design strategies and resourceful engineering. This work presents an end-to-end DAQ solution intended for a recent 5 kt CHIPS prototype, which is largely based on affordable mass-produced components. Much like the detector itself, the presented instrumentation is composed of modular arrays that can be scaled up and easily serviced. A single such array can carry up to 30 photomultiplier tubes (PMTs) accompanied by electronics that generate high voltage in-situ and deliver time resolution of up to 0.69 ns. In addition, the technology is compatible with the White Rabbit timing system, which can synchronize its elements to within 100 ps. While deployment issues did not permit the presented DAQ system to operate beyond initial evaluation, the presented hardware and software successfully passed numerous commissioning tests that demonstrated their viability for use in a large-scale neutrino detector, instrumented with thousands of PMTs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

RELAP5-3D Developer Guidelines and Programming Practices

Our ultimate goal is to create and maintain RELAP5-3D as the best software tool available to analyze nuclear power plants. This begins with writing excellent programming and requires thorough testing. This document covers development of RELAP5-3D software, the behavior of the RELAP5-3D program that must be maintained, and code testing. RELAP5-3D must perform in a manner consistent with previous code versions with backward compatibility for the sake of the users. Thus file operations, code termination, input and output must remain consistent in form and content while adding appropriate new files, input and output as new features are developed. As computer hardware, operating systems, and other software change, RELAP5-3D must adapt and maintain performance. The code must be thoroughly tested to ensure that it continues to perform robustly on the supported platforms. The coding must be written in a consistent manner that makes the program easy to read to reduce the time and cost of development, maintenance and error resolution. The programming guidelines presented her are intended to institutionalize a consistent way of writing FORTRAN code for the RELAP5-3D computer program that will minimize errors and rework. A common format and organization of program units creates a unifying look and feel to the code. This in turn increases readability and reduces time required for maintenance, development and debugging. It also aids new programmers in reading and understanding the program. Therefore, when undertaking development of the RELAP5-3D computer program, the programmer must write computer code that follows these guidelines. This set of programming guidelines creates a framework of good programming practices, such as initialization, structured programming, and vector-friendly coding. It sets out formatting rules for lines of code, such as indentation, capitalization, spacing, etc. It creates limits on program units, such as subprograms, functions, and modules. It establishes documentation guidance on internal comments. The guidelines apply to both existing and new subprograms. They are written for both FORTRAN 77 and FORTRAN 95. The guidelines are not so rigorous as to inhibit a programmer’s unique style, but do restrict the variations in acceptable coding to create sufficient commonality that new readers will find the coding in each new subroutine familiar. It is recognized that this is a “living” document and must be updated as languages, compilers, and computer hardware and software evolve.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2019

Low temperature oxidation of methylpropyl ether

Ethers are potential high-performance fuels that can be produced from renewable carbon sources such as biomass, but their combustion properties are not clearly understood. The cetane numbers (CN) for ethers, a measure of autoignition tendency, can range from less than 10 to greater than 100, and predictive tools based upon the molecular structures are desirable in order to focus fuel development research. In this study, we used molecular modeling, chemical kinetic modeling, and experimental measurements to understand the important reactions that lead to the autoignition of methylpropyl ether (MPE), a model for ethers containing alkyl chains long enough for intramolecular hydrogen transfer. These reactions are known to be important in the autoignition of alkanes and ethers and we propose to investigate the relationship between alkyl and ether reaction pathways. A reaction mechanism for MPE was created using MIT’s Reaction Mechanism Generator (RMG) and G4 quantum calculation results and models were tested using the ChemKin Pro suite of software. Results from atmospheric pressure, flow tube reactor experiments and rapid compression machine (RCM) experiments were used to test the kinetic model and suggest refinements.

autoignition↗
DOE OSTI2020

Low Temperature Oxidation of Methylpropyl Ether

Ethers are potential high-performance fuels that can be produced from renewable carbon sources such as biomass, but their combustion properties are not clearly understood. The cetane numbers (CN) for ethers, a measure of autoignition tendency, can range from less than 10 to greater than 100, and predictive tools based upon the molecular structures are desirable in order to focus fuel development research. In this study, we used molecular modeling, chemical kinetic modeling, and experimental measurements to understand the important reactions that lead to the autoignition of methylpropyl ether (MPE), a model for ethers containing alkyl chains long enough for intramolecular hydrogen transfer. These reactions are known to be important in the autoignition of alkanes and ethers and we propose to investigate the relationship between alkyl and ether reaction pathways. A reaction mechanism for MPE was created using MIT's Reaction Mechanism Generator (RMG) and G4 quantum calculation results and models were tested using the ChemKin Pro suite of software. Results from atmospheric pressure, flow tube reactor experiments and rapid compression machine (RCM) experiments were used to test the kinetic model and suggest refinements.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2014

Advanced Test Reactor Core Modeling Update Project: Annual Report for Fiscal Year 2014

Legacy computational reactor physics software tools and protocols currently used for support of Advanced Test Reactor (ATR) core fuel management and safety assurance, and to some extent, experiment management, are inconsistent with the state of modern nuclear engineering practice, and are difficult, if not impossible, to verify and validate (V&V) according to modern standards. Furthermore, the legacy staff knowledge required for effective application of these tools and protocols from the 1960s and 1970s is rapidly being lost due to staff turnover and retirements. In late 2009, the Idaho National Laboratory (INL) initiated a focused effort, the ATR Core Modeling Update Project, to address this situation through the introduction of modern high-fidelity transport theory based computational software and models to replace the legacy methods, with appropriate verification and validation (V&V) protocols according to applicable national standards. The project has now completed its fifth, and last, full year of development activity, and has entered an accelerated deployment phase that is expected to run through 2015.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Modernization efforts for the R -Matrix code SAMMY [Abstract]

The R-Matrix code SAMMY is a widely used nuclear data evaluation code focused on the resolved range, which includes corrections for experimental effects. The code is still mostly written in Fortran 77, and uses a memory management system suitable for the time of its initial writing (1984). A modernization effort is under way to bring the code in-line with modern software development practices. A continuous-integration testing framework was added, automating the large existing set of test cases. It is run on every commit. The memory management was updated to current standard practices suitable for modern software analysis tools. The code can be obtained from https://code.ornl.gov/RNSD/SAMMY. The resonance parameters and covariance information are now stored in C++ objects shared by SAMMY and AMPX, the processing code that generates nuclear data libraries for SCALE. This allows for easier maintenance and access to the resonance parameters inside and outside of SAMMY. This feature is already used by accessing and changing parameters in memory in the Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments project, Further plans include the switch to the ENDF reading and writing routines in AMPX, as these routines are more robust, easier to maintain, and support more features. Of note here is support for the new GNDS format. Previously it wasn’t easy to share the full covariance matrix for evaluations containing more than one isotope due to limitations on the ENDF format; this is now supported in GNDS. The data are currently available in a binary SAMMY format and can be exported to GNDS to make them more widely available and sharable. The next step will be to use the same resonance processing code at 0K in AMPX and SAMMY as one of the available Reich-Moore R-Matrix formalism. The first step toward this goal is to isolate the reconstruction into a module that takes resonance parameters as its input and does not depend on SAMMY global parameters. This goal has been achieved and it should now be possible to more easily change the resonance formalism and add enhancements as the Phenomenological R-Matrix parameterization of direct, doorway, and compound nuclear reactions discussed elsewhere on this conference. This concerted modernization and enhancement effort provides multiple advantages to the nuclear data community. It will allow parameter optimization using enhanced formalisms, including experimental effects, that better match complex experimental data. Then those evaluated parameters can immediately be passed off to AMPX to be reconstructed with the exact same cross section model and be put into a data library for subsequent testing using SCALE and the Valid Benchmark suite or other suitable benchmark suites.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

Using simulation to quantify the reliability of control software

More than two decades ago, Butler and Finelli examined the problem of experimentally demonstrating the reliability of safety critical software and concluded that it was impractical. We revisit this conclusion in the light of recent advances in computer system virtualization technology and the capability to link virtualization tools to simulation models of physical environments. A specific demonstration of testing for reliability is offered using software that is part of a building control system. Extrapolating the results of this demonstration, we conclude that experimental demonstrations of high reliability may now be feasible for some applications.

Nutaro, James J.↗
DOE OSTI2013

Advanced Test Reactor Core Modeling Update Project Annual Report for Fiscal Year 2013

Legacy computational reactor physics software tools and protocols currently used for support of Advanced Test Reactor (ATR) core fuel management and safety assurance, and to some extent, experiment management, are inconsistent with the state of modern nuclear engineering practice, and are difficult, if not impossible, to verify and validate (V&V) according to modern standards. Furthermore, the legacy staff knowledge required for effective application of these tools and protocols from the 1960s and 1970s is rapidly being lost due to staff turnover and retirements. In late 2009, the Idaho National Laboratory (INL) initiated a focused effort, the ATR Core Modeling Update Project, to address this situation through the introduction of modern high-fidelity computational software and protocols. This aggressive computational and experimental campaign will have a broad strategic impact on the operation of the ATR, both in terms of improved computational efficiency and accuracy for support of ongoing DOE programs as well as in terms of national and international recognition of the ATR National Scientific User Facility (NSUF).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Continuous integration for concurrent MOOSE framework and application development on GitHub

For the past several years, Idaho National Laboratory’s MOOSE framework team has employed modern software engineering techniques (continuous integration, joint application/framework source code repos- itories, automated regression testing, etc.) in developing closed-source multiphysics simulation software (Gaston et al., Journal of Open Research Software vol. 2, article e10, 2014). In March 2014, the MOOSE framework was released under an open source license on GitHub, significantly expanding and diversifying the pool of current active and potential future contributors on the project. Despite this recent growth, the same philosophy of concurrent framework and application development continues to guide the project’s development roadmap. Several specific practices, including techniques for managing multiple repositories, conducting automated regression testing, and implementing a cascading build process are discussed in this short paper. Furthermore, special attention is given to describing the manner in which these practices naturally synergize with the GitHub API and GitHub-specific features such as issue tracking, Pull Requests, and project forks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Wholesale Electricity Analysis via Simulation & Learning Experiments (WEASLE): Platform Development and Pilot Competition

This document reports the development of the Wholesale Electricity Analysis via Simulation and Learning Experiments (WEASLE) platform and the pilot competition that was conducted to test the platform. Due to the increasing reliance on variable renewable energy resources for bulk power, the pilot competition, called the Energy Storage Participation Algorithm Competition (ESPA-Comp), was used to test the effect of various market designs on storage utilization and market efficiency. Basic details of the platform are provided, including an overview of the market clearing engine, the battery dispatch and degradation models, electric grid topology and resource mix, and software architecture. Two market designs were tested: a two-settlement market analogous to typical ISO design today, and a multi-settlement market that allows additional forward-trading periods during the real-time market. Results from the pilot competition show that the storage bidding problem is nontrivial and is well suited for future challenges. We find that: 1) all four teams utilized different approaches to the bidding problem, 2) different methodological approaches led to substantially different offer behaviors, 3) resource profits are clustered by team and methodological approach, 4) simulated offers reduced market surplus by about 0.5%, 5) substantially different prices between two-settlement and multi-settlement markets albeit minimal difference in overall market surplus.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2014

SU-E-T-33: An EPID-Based Method for Testing Absolute Leaf Position for MLC Without Backup Jaws

Purpose: Methods in common use for MLC leaf position QA are limited to measurements relative to an arbitrary reference position. The authors previously presented an EPID-based method for efficiently testing accuracy of leaf position relative to the mechanical isocenter for MLC with backup jaws. The purpose of this work is to extend that method to the general case of MLC without backup jaws. Methods: A pair of collimator walkout images is used to determine the location of the mechanical isocenter relative to the center of one field using a parameter called X-offset. The method allows for shift of the imager panel to cover subsets of MLC leaves within the limited field of view of the imager. For a shifted panel position, an image of three beam strips defined by a subset of MLC leaves allows determination of the position of each leaf relative to the isocenter. The location of the isocenter is determined by applying X-offset to an image of a single rectangular field obtained at that panel position. The method can also be used to test backup jaws instead of MLC leaves. A software tool was developed to efficiently analyze the images. Results: The software tool reports leaf position and deviation from nominal position, and provides visual displays to facilitate rapid qualitative interpretation. Test results using this method agree well with results using the previous method requiring backup jaws. Test results have been successfully used to recalibrate one model MLC (Elekta MLCi2™). Work in progress includes extension of the software tool to other MLC models, and quantification of reproducibility of the measurements. Conclusion: This work successfully demonstrates a method to efficiently and accurately measure MLC leaf position, or backup jaw position, relative to the mechanical isocenter of the collimator.

60 APPLIED LIFE SCIENCES↗