Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Building an Efficient Cluster Cosmology Software Package for Modeling Cluster Counts and Lensing

We introduce a software suite developed for galaxy cluster cosmological analysis with the Dark Energy Survey Data. Cosmological analyses based on galaxy cluster number counts and weak-lensing measurements need efficient software infrastructure to explore an increasingly large parameter space, and account for various cosmological and astrophysical effects. Our software package is designed to model the cluster observables in a wide-field optical survey, including galaxy cluster counts, their averaged weak-lensing masses, or the cluster's averaged weak-lensing radial signals. To ensure maximum efficiency, this software package is developed in C++ in the CosmoSIS software framework, making use of the CUBA integration library. We also implement a testing and validation scheme to ensure the quality of the package. We demonstrate the effectiveness of this development by applying the software to the Dark Energy Survey Year 1 galaxy cluster cosmological data sets, and acquired cosmological constraints that are consistent with the fiducial Dark Energy Survey analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

pdas-experiments

SAND2025-04589O pdas-experiments automates computational experiments of fluid flow simulations. It uses the pressio-demoapps-schwarz package as a basis to break down complex simulations into smaller, manageable parts. This application is an extension of the Sandia Pressio software which uses domain decomposition to work with complex simulations more efficiently. Users can test different simulation setups, while keeping a detailed record of their experiments so they can be reproduced later. The software includes a C++ program that runs individual experiments based on user-defined settings in a YAML file, as well as a Python script that can manage multiple simulations at once. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Tezaur, Irina [Sandia National Lab. (SNL-CA), Live↗
DOE OSTI2026

Testing the Common Platform LLRF with a 197 MHz NCRF Cavity

The Common Platform is the hardware that will support the new LLRF platform to be used for the Electron-Ion Collider. The Common Platform features a carrier board that is used to interface with a variety of daughter for different applications. This paper details the testing that was done using the Common Platform and an RF Digitizer Daugther Board. Firstly, the firmware and software development is discussed followed by a description of the controls algorithms used in the testing. Then, testing and verification of the platform with a 197 MHz NCRF cavity is discussed. The paper concludes with results from the testing and the path forward.

42 ENGINEERING↗
DOE OSTI2021

CLMM : a LSST-DESC cluster weak lensing mass modeling library for cosmology

ABSTRACT We present the v1.0 release of CLMM, an open source python library for the estimation of the weak lensing masses of clusters of galaxies. CLMM is designed as a stand-alone toolkit of building blocks to enable end-to-end analysis pipeline validation for upcoming cluster cosmology analyses such as the ones that will be performed by the Vera C. Rubin Legacy Survey of Space and Time-Dark Energy Science Collaboration (LSST-DESC). Its purpose is to serve as a flexible, easy-to-install, and easy-to-use interface for both weak lensing simulators and observers and can be applied to real and mock data to study the systematics affecting weak lensing mass reconstruction. At the core of CLMM are routines to model the weak lensing shear signal given the underlying mass distribution of galaxy clusters and a set of data operations to prepare the corresponding data vectors. The theoretical predictions rely on existing software, used as backends in the code, that have been thoroughly tested and cross-checked. Combined theoretical predictions and data can be used to constrain the mass distribution of galaxy clusters as demonstrated in a suite of example Jupyter Notebooks shipped with the software and also available in the extensive online documentation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Computer Programs For Analysis Of Thermally Reactive Tracer Tests In Geothermal Reservoirs

The Tracer Analysis Toolbox (TAT) is a stand-alone executable software package that focuses on reservoir monitoring, using changes in concentration of thermally degrading tracers between and injection well and a production well to reflect the temperature-time histories along flow paths through the reservoir. By conducting such tests periodically, the thermal evolution of the flow paths connecting injection wells to production wells can be monitored. Because this approach is sensitive to temperature along the whole path, it can detect changes well before they occur at the distal end of the path (i.e., the production well). Thus, the thermally degrading tracer method provides early detection of thermal decline before it impacts that well. The goal of TAT is to simplify planning of a reactive tracer monitoring campaign and interpretation of results by providing: (1) tracer test planning and analysis tools to define the necessary kinetic parameters, injection concentrations, and other tracer parameters that are suitable for the expected reservoir residence time and temperature, (2) identification of tracers with suitable characteristics (defined by (1)) and (3) a suite of analysis programs to analyze tracer test results.

Plummer, MitchellAaron [Idaho National Laboratory ↗
DOE OSTI2020

Scalability of high-performance PDE solvers

Performance tests and analyses are critical to effective high-performance computing software development and are central components in the design and implementation of computational algorithms for achieving faster simulations on existing and future computing architectures for large-scale application problems. In this article, we explore performance and space-time trade-offs for important compute-intensive kernels of large-scale numerical solvers for partial differential equations (PDEs) that govern a wide range of physical applications. We consider a sequence of PDE-motivated bake-off problems designed to establish best practices for efficient high-order simulations across a variety of codes and platforms. We measure peak performance (degrees of freedom per second) on a fixed number of nodes and identify effective code optimization strategies for each architecture. In addition to peak performance, we identify the minimum time to solution at 80% parallel efficiency. The performance analysis is based on spectral and p-type finite elements but is equally applicable to a broad spectrum of numerical PDE discretizations, including finite difference, finite volume, and h-type finite elements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Bayesian And Human Reliability Analysis (hra)-aided Method For The Reliability Analysis Of Software (bahamas)

The purpose of the BAHAMAS code is to provide a simplified process for performing quantitative evaluations of software reliability. The Bayesian and Human Reliability Analysis (HRA)-Aided method for the Reliability Analysis of software (BAHAMAS) was developed specifically to perform quantification under limited data conditions, i.e., when limited testing or operational data are available, such as during early development stages. BAHAMAS essentially examines the quality of a software development life cycle to determine the probability of specific types of software failure. BAHAMAS will have modules to support user input for detailed and simplified analyses. The user interface will also support software common cause failure analysis.

Wang, Congjian (0000000207789927)↗
DOE OSTI2020

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Scoping Study of Effects on the Advanced Test Reactor’s Center Flux Trap Due to Various Loadings in the H and Inner A Test Positions

This study determined the effects experienced by the In-Pile Tube, of the Advanced Test Reactor’s center flux trap, due to various loading configurations of the H and Inner A positions. The effects of concern included: the axial profile of the linear heat generation rate of each fuel rodlet, the axial flux shape, and spectrum, in the fuel, and cladding, of each rodlet, and the total fission heating rate of the entire In-Pile Tube. Additionally, the reactivity worth of each configuration, relative to an ATR configuration with water filling all concerning test positions, was determined. The test positions were filled with commonly used test specimens, backup test specimens, and homogeneous substances. The study was performed using the modeling software MCNP6.2.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Preliminary Feasibility of Printing, Microstructure Analysis and Mechanical Performance of a Down Selected Ni Alloy

This report is submitted as completion of a Milestone 3 deliverable under work package ORNL CT-23OR1304051 in support of the Advanced Materials and Manufacturing Technologies (AMMT) program. The AMMT program is aiming at the faster incorporation of new materials and manufacturing technologies into complex nuclear-related systems. An integrated approach, combining advanced characterization, high-throughput and accelerated testing, modeling and simulation including machine learning and artificial intelligence will be employed. While 316H (Fe-16-18Cr-10-14Ni-2-3Mo-0.04-0.1C) has been identified as a key alloy to be integrated into the AMMT accelerated alloy qualification approach due its relevance for many current and future nuclear energy reactors, many other alloys could be considered for the advanced fabrication of innovate high-performance nuclear components. ANL, INL, ORNL and PNNL are collaborating on identifying the most promising alloy candidates relevant for the AMMT program. A selection criteria matrix was established to evaluate the alloys considering their relative importance and technological readiness levels for nuclear energy applications, with a focus on laser powder bed fusion (LPBF). Due to the broad range of potential candidate alloys, ORNL and INL focused on Ni-based alloys, while ANL and PNNL mainly evaluated Fe-based alloys. PNNL previously published materials scorecards reports on several key alloys and this report is providing a broader overview of Ni-based candidate alloys, expending beyond alloys well-known to the nuclear community. Of particular interest are alloys that are currently commercially available in powder form due to the growing demand from other industries that have invested heavily in additive manufacturing. Among these alloys, Haynes 282 (Fe-20Cr-20Co-8Mo) was selected due to its superior strength at high temperature compared to the code-qualified alloy 617 (Ni-20-24Cr-10-15Co-8-10Mo). To assess the integration of this new alloy into the AMMT digital manufacturing framework, we performed the rapid optimization of alloy 282 printing parameters on a Renishaw 250 machine, the fabrication of sufficient materials for extensive characterization and mechanical testing both at ORNL and INL, and added the printing data into the digital platform via the Peregrine software. A detailed analysis of the LPBF 718 alloy was also conducted, with creep specimens being tested at 600-650°C and characterized by advanced electron microscopy. The alloy superior mechanical strength and great printability associated with the extensive database that has already been generated highlight the promising potential of LPBF 718 as a candidate alloy for the AMMT program. INL, ANL and PNNL have generated similar reports and all the information will be compiled into a final M2 milestone report to provide the AMMT leadership team with clear recommendations on the down selection of reactor materials, as well as establish a roadmap for the qualification of these selected alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Software Development for Data Visualization and Analysis of PN-Diodes & MOSFET Devices

The U.S. Department of Energy has a broad mission to ensure the nation’s security by addressing ongoing environmental challenges, developing novel energy production technologies, and mitigating nuclear security concerns. These efforts benefit from developing more effective semiconductor materials and devices. The research discussed in this report aims to further the development of these new electronics by improving implementations of vertical device structures, which offer theoretically better performance compared to lateral structures. Specifically, it reviews the background and development of a new and easy-to-use program for data processing and analysis from experiments run on vertical gallium nitride power devices. Current vertical structures fall short in critical performance metrics, such as On-Resistance and Breakdown Voltage, due to poor management of the device’s electric field. Junction termination extensions, or JTEs, are a field management technique that increases a device’s resilience to expected failure modes by controlling its surface electric fields. Each JTE design requires significant experimental validation, consisting of hundreds of tested devices, each outputting an enormous set of data points. The new software includes multiple methods of filtering large sets of device testing data to identify and remove flawed devices, automate device analyses, and provide statistical breakdowns for four metrics used to define the effectiveness of the JTE and the current carrying capacity of the device. These results can then be related back to fabrication techniques and device design, and in the future, be combined with processing simulations to further improve our understanding of the JTE mechanisms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A step towards the final frontier: Lessons learned from acceptance testing of the first HPE/Cray EX 3000 system at ORNL

Summary In this article, we summarize the deployment of the Air Force Weather (AFW) HPC11 system at Oak Ridge National Laboratory (ORNL) including the process followed to successfully complete acceptance testing of the system. HPC11 is the first HPE/Cray EX 3000 system that has been successfully released to its user community in a federal facility. HPC11 consists of two identical 800‐node supercomputers, Fawbush and Miller, with access to two independent and identical lustre parallel file systems. HPC11 is equipped with Slingshot 10 interconnect technology and relies on the HPE Performance Cluster Manager software for system configuration. ORNL has a clearly defined acceptance testing process used to ensure that every new system deployed can provide the necessary capabilities to support user workloads. We worked closely with HPE and AFW to develop a set of tests that used the United Kingdom's Meteorological Office's Unified Model and 4‐dimensional variational data assimilation. We also included benchmarks and applications from the Oak Ridge Leadership Computing Facility portfolio to fully exercise the HPE/Cray programming environment and evaluate the functionality and performance of the system. Acceptance testing of HPC11 required parallel execution of each element on Fawbush and Miller. In addition, careful coordination was needed to ensure successful acceptance of the newly deployed lustre file systems alongside the compute resources. In this work, we present test results from specific system components and provide an overview of the issues identified, challenges encountered, and the lessons learned along the way.

Melesse Vergara, Verónica G.↗
DOE OSTI2026

Requirements Description of DASSH-F

This report reviews the modeling and simulation capabilities of Argonne National Laboratory’s DASSH code that is used in present reactor analysis activities. These capabilities will be used to establish the set of verification tasks necessary to verify DASSH for use on commercial projects. A similar approach was taken for the PERSENT, REBUS and DIF3D software packages. The DASSH program is a thermal analysis code designed to rapidly allow a reactor design engineer to obtain flow rates requirements that satisfy peak temperature constraints in the domain. DASSH is a follow-on development to the SE2-ANL software and SUPERENERGY-2 software that it is based upon. DASSH was designed to account for both neutron and gamma heating and is inherently connected to the GAMSOR part of the ARC suite of fast reactor analysis software. SE2-ANL is a developed piece of software from the 1980s while DASSH is a modern implementation with notable improvements in geometry handling. The most important upgrade of DASSH relative to SE2-ANL is that it can analyze multiple time points in a single run where SE2-ANL can only treat a single time point. This allows the user to understand the impact of and search the flow distribution for the entire operational period of a reactor design considering pressure drop, peak coolant and fuel temperatures, and thermal striping. DASSH has three input paths that have to be verified. The first input path builds the geometry and power distribution based upon the DIF3D model but ignores the gamma heating aspects of the problem. The second input path also builds the geometry from the DIF3D model but it takes the neutron and gamma heating distributions from GAMSOR. The third input path is to take the geometry and power distribution directly from user input (i.e. not coupled to DIF3D or GAMSOR). DASSH also has many built in correlations for material properties along with a user defined specification of the fuel, structure, and coolant properties. There are correlations for flow split, mixing, pressure drop, and heat transfer coefficients (subchannel rather than a direct methodology). In total, verification of DASSH will require an extensive testing to cover all possible user features of the software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Advances on CHP District Energy and Microgrids Deployment: Simplified Tool for Rapidly Deploying Feasibility Analytics for the Non-Technical User (Final Technical Report)

Community energy systems have proven to have the potential to improve cost efficiency, resilience, and decarbonize. However, investing in community energy systems such as community microgrids or district energy systems is a complex decision due to the high initial investment and the uncertainties associated with the long development time and lifecycle of the project. Tools that make feasibility assessments accessible to non-technical users like investors, policymakers, and other stakeholders will result in more feasibility analyses completed, more candidate projects identified, and more community energy systems deployed. The pilot tool developed under this award is named Energy Fellow. Energy Fellow allows technical and non-technical users to complete feasibility analyses for district energy systems and community microgrids. This is the first software tool of its kind designed for non-technical users and available at no cost. Its scope was adjusted to a 25x25-mile region within the Houston area in Texas to make its development compatible with the funding available. However, the findings and models developed make this pilot tool easily scalable to the US. The lessons learned during the design, implementation, and testing stages have helped find trade-off solutions to software and hardware challenges related to implementing 3D models in online tools. Green software strategies has been successfully applied to the design and operations of the tool, and the team has researched the aspects of the (non-technical) user experience that will make commercial developments of this tool even more impactful.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

A Step Towards the Final Frontier: Lessons Learned from Acceptance Testing of the First HPE/Cray EX 3000 System at ORNL

In this paper, we summarize the deployment of the Air Force Weather (AFW) HPC11 system at Oak Ridge National Laboratory (ORNL) including the process followed to successfully complete acceptance testing of the system. HPC11 is the first HPE/Cray EX 3000 system that has been successfully released to its user community in a federal facility. HPC11 consists of two identical 800-node supercomputers, Fawbush and Miller, with access to two independent and identical Lustre parallel file systems. HPC11 is equipped with Slingshot 10 interconnect technology and relies on the HPE Performance Cluster Manager (HPCM) software for system configuration. ORNL has a clearly defined acceptance testing process used to ensure that every new system deployed can provide the necessary capabilities to support user workloads. We worked closely with HPE and AFW to develop a set of tests that used the United Kingdom’s Meteorological Office’s Unified Model (UM) and 4DVAR. We also included benchmarks and applications from the Oak Ridge Leadership Computing Facility (OLCF) portfolio to fully exercise the HPE/Cray programming environment and evaluate the functionality and performance of the system. Acceptance testing of HPC11 required parallel execution of each element on Fawbush and Miller. In addition, careful coordination was needed to ensure successful acceptance of the newly deployed Lustre file systems alongside the compute resources. In this work, we present test results from specific system components and provide an overview of the issues identified, challenges encountered, and the lessons learned along the way.

Melesse Vergara, Veronica↗
DOE OSTI2022

Triton: Environmental Monitoring Technology Development, Collision Risk Data Collection (Final Report)

In this project, we assembled a sensor suite that combines a scientific echosounder (sonar) system with video and acoustic cameras (secondary sensors). The sensor suite generates data that is amenable to automated target detection algorithms and can provide inputs to animal encounter models. We developed software (archiving software) to collect data simultaneously from all sensors in the suite, analyze the sonar data automatically in near real-time to identify time periods when targets of interest were present, and automatically archive data from the secondary sensors for these time periods. The product of the archiving software is a data set for the secondary sensors, containing data only for the times when targets of interest were determined to be present by the sonar. We performed controlled field testing to verify the operation of the sensor suite and the archiving software.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Development of a Hardware-in-The-Loop Testbed for a Decentralized, Data-Driven Electric Vehicle Charging Control Algorithm

This study presents the design of an electric vehicle (EV)-grid integration (EVGI) hardware test-bed to implement smart EV charging algorithms. Here, the proposed test-bed also allows to create different grid events via flexible integration of other power hardware (e.g., controllable loads and battery energy storage systems) and test their impacts on EV charging. The design uses a real-time digital simulator to realize a complex distribution grid model with primary and secondary networks. A grid simulator physically realizes the selected nodes of the simulated grid to power an actual EV, forming a hardware-in-the-loop (HIL) test setup. The EV-grid integration is demonstrated based on the custom hardware and software implementation of the J1772 charging protocol using dSPACE MicroLabBox, operating as a custom EV Supply Equipment (EVSE). The HIL test-bed features a novel testing platform for accurate implementation and analysis of scalable charging algorithms. To this end, a data-driven, decentralized, model-free charging controller based on the Additive Increase and Multiplicative Decrease (AIMD) algorithm is presented and validated on an EV using the HIL test-bed. We tested the proposed algorithm under various case studies, and presented a comparison study with an existing droop-based, decentralized charging solution. The results showed that the EV successfully performed charging commands generated by the EVSE and regulated its charging power to effectively reduce the system loading caused by high EV penetration.

33 ADVANCED PROPULSION SYSTEMS↗