Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Performance portable ice-sheet modeling with MALI

High-resolution simulations of polar ice sheets play a crucial role in the ongoing effort to develop more accurate and reliable Earth system models for probabilistic sea-level projections. These simulations often require a massive amount of memory and computation from large supercomputing clusters to provide sufficient accuracy and resolution; therefore, it has become essential to ensure performance on these platforms. Many of today’s supercomputers contain a diverse set of computing architectures and require specific programming interfaces in order to obtain optimal efficiency. In an effort to avoid architecture-specific programming and maintain productivity across platforms, the ice-sheet modeling code known as MPAS-Albany Land Ice (MALI) uses high-level abstractions to integrate Trilinos libraries and the Kokkos programming model for performance portable code across a variety of different architectures. In this article, we analyze the performance portable features of MALI via a performance analysis on current CPU-based and GPU-based supercomputers. The analysis highlights not only the performance portable improvements made in finite element assembly and multigrid preconditioning within MALI with speedups between 1.26 and 1.82x across CPU and GPU architectures but also identifies the need to further improve performance in software coupling and preconditioning on GPUs. We perform a weak scalability study and show that simulations on GPU-based machines perform 1.24–1.92x faster when utilizing the GPUs. The best performance is found in finite element assembly, which achieved a speedup of up to 8.65x and a weak scaling efficiency of 82.6% with GPUs. We additionally describe an automated performance testing framework developed for this code base using a changepoint detection method. The framework is used to make actionable decisions about performance within MALI. We provide several concrete examples of scenarios in which the framework has identified performance regressions, improvements, and algorithm differences over the course of 2 years of development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

FY16 Status Report on NEAMS Neutronics Activities

The goal of the NEAMS neutronics effort is to develop a neutronics toolkit for use on sodium-cooled fast reactors (SFRs) which can be extended to other reactor types. The neutronics toolkit includes the high-fidelity deterministic neutron transport code PROTEUS and many supporting tools such as a cross section generation code MC 2 -3, a cross section library generation code, alternative cross section generation tools, mesh generation and conversion utilities, and an automated regression test tool. The FY16 effort for NEAMS neutronics focused on supporting the release of the SHARP toolkit and existing and new users, continuing to develop PROTEUS functions necessary for performance improvement as well as the SHARP release, verifying PROTEUS against available existing benchmark problems, and developing new benchmark problems as needed. The FY16 research effort was focused on further updates of PROTEUS-SN and PROTEUS-MOCEX and cross section generation capabilities as needed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2018

Sandia Cable Tester: Reference Manual

The Sandia Cable Tester is an automated cable testing solution capable of quickly testing connectivity and isolation of arbitrary cables. This manual describes how to operate the unit including system setup and how to read out results. This manual also goes into detail on the design and theory behind the system.

42 ENGINEERING↗
DOE OSTI2019

REALIZATION OF A AUTOMATED T-WAY COMBINATORIAL TESTING APPROACH FOR A SOFTWARE BASED EMBEDDED DIGITAL DEVICE

Under the Department of Energy’s Light Water Reactor Sustainability Program, within the Plant Modernization research pathway, the Digital I&C Qualification Project is identifying new methods that would be beneficial in qualifying digital I&C systems and devices for safety-related usage. One such method that would be useful in qualifying field components such as sensors and actuators is the concept of testability. The Nuclear Regulatory Commission (NRC) considers testability to be one of two design attributes sufficient to eliminate consideration of software-based or software logic-based common cause failure (the other being diversity). The NRC defines acceptable “testability” as follows: Testability – A system is sufficiently simple such that every possible combination of inputs and every possible sequence of device states are tested and all outputs are verified for every case (100% tested). [NUREG 0800, Chapter 7, Branch Technical Position (BTP) 7-19] This qualification method has never proven to be practical in view of the very large number of combinations of inputs and sequences of device states for a typical I&C device. However, many of these combinations are not unique in the sense that they represent the same state space or in that that they represent state space that would not affect the critical design basis functions of the device. Therefore, the state space of interest might possibly be reduced to a manageable dimension through such analysis. This project will focus on a representative I&C device similar in design, function, and complexity to the types of devices that would likely be deployed in nuclear power plants as digital or software based sensors and actuators (e.g. Smart Sensors). Analysis will be conducted to determine the feasibility of testing this device in a manner consistent with the NRC definition. This report describes the development of test process for Bounded Exhaustive Testing with respect to Combinatorial Test (CT) methods. The report describes the candidate Device Under Test SW – the VCU smart sensor, conceptual experimental methods for stated test objectives, description of the process, tools, resources, and computing. This information will be used to fully develop a detailed test plan (based on statistical measure needs) and test environment for conducting an I&C device testability demonstration study. The future planed experimental study of this project is to demonstrate digital qualification via Bounded Exhaustive Testability with respect to Common Cause Failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Sierra/SolidMechanics Verification Report

This document presents the Sierra/SolidMechanics (Sierra/SM) verification plan. This plan centers on the tests in the Sierra/SM verification test suite, a subset of which are documented in the Sierra/SM Verification Tests Manual. Most of these tests are run nightly with the Sierra/SM code suite, and the results of the tests are checked against analytic solutions. For each of the tests presented in the Verification Tests Manual, the test setup, a description of the analytic solution, and comparison of the Sierra/SM code results to the analytic solution is provided. Mesh convergence is also checked on a nightly basis for several of these tests. This verification plan discusses these various types of tests and what they mean for Sierra/SM verification. Many other activities also contribute to Sierra/SM quality. These address code and solution quality and range from low-level unit tests, run nightly, up to full-fidelity acceptance tests, used to verify release stability. This acceptance test suite checks that new versions of Sierra/SM continue to yield the same answers for high-resolution analyst problems. Further code quality measures include an extensive suite of intermediate-size regression tests and automated nightly code quality checks. While these additional activities do not fall under a strict definition of verification, they greatly add to the quality, stability, and reliability of Sierra/SM, and are discussed here as well.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Development of a Gibbs Energy Minimiser for the MOOSE-based Corrosion Modelling App Yellowjacket and Validation of MSTDB

Nuclear materials are highly complex multiscale, multiphysics systems,and an effective prediction of nuclear reactor performance and safety requires simulation capabilities that tightly couple different physical phenomena. The Idaho National Laboratory’s Multiphysics Object Oriented Simulation Environment (MOOSE) provides the computational foundation for performing such simulations. With the move towards advanced reactors, such as the Molten Salt Reactor (MSR), that employ high temperature fluids compared to conventional reactors, corrosion has become a problem of great interest. A new application called Yellowjacket is currently under development to directly couple thermodynamic equilibrium and kinetics with phase field models in order to model corrosion in MSRs. As part of Yellowjacket, a Gibbs energy minimiser is being developed to perform thermochemical equilibrium calculations for a range of different materials, which is currently in its infancy. This report describes the further progress towards the development of Yellowjacket Gibbs energy minimiser. Ontario Tech University is developing a new Gibbs energy minimiser for Yellowjacket which is the primary contribution of this work. The aim to develop a thermochemistry solver for the MOOSE framework following the same development philosophy and using the same tools and libraries. A special focus is on performance, documentation and SQA. Furthermore through a scope extension partway through the fiscal year a thorough assessment of the MSTDB-TC v1.3 was performed at Ontario Tech University in the context of continuous improvement and quality assurance. The objective of the work was to have an arm’s length review of the database to give confidence that the database is performing as it was intended while assessing its current state to give recommendations to future developments. This assessment involved two parts: A) a quantitative assessment, and B) a qualitative assessment. Part A involved developing an automated test-suite that would compute values from the database using Thermochimica with comparisons to experimental measurements for validation purposes, which gives confidence to the database’s stakeholders that its functioning properly. Part B involved reviewing all binary systems in the database and making a qualitative assessment with two performance indicators: comprehensiveness and overall confidence. It is important to note that the models in the database are empirical, which is to say that the quality of any model is highly dependent on the experimental data used to inform its development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Verification and Validation of the New MCNP6.3 Criticality Features [Slides]

This presentation touches on a separate MCNP6.3 V&V document reports on all the default calculations for all test suites. Here, we look at new optional features of the MCNP6.3 code with Fission-matrix-based options, Convergence and population testing, and Automated acceleration of the fission source additionally Doppler Broadening Resonance Correction. Also touched on are validation benchmarks: criticality, crit_expanded, and Rossi-α. All the new MCNP6.3 options give statistically equivalent results and either provide a reduction or no change in computational cost. We consider giving these new features a try and using them for all criticality calculations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Vitis CI/CD & Containerization

Modern development flows that use tooling for automated building, testing, and deployment of software are becoming the norm for large scale software and hardware projects. These flows offer quite a few advantages that make them desirable, but when attempting to implement them for projects that use FPGAs, some complications can arise when attempting to integrate them with traditional FPGA toolchains and deployment workflows. In this poster, we present early our early efforts integrating the Vitis FPGA toolchain into a modern, Kuberentes and Github actions based CI/CD pipeline.

Hawks, Benjamin G. [Fermilab]↗
DOE OSTI2026

Nondestructive Evaluation of Carbon Fiber Reinforced Polymers

The American Society of Mechanical Engineers Boiler and Pressure Vessel Code requires repair and replacement of safety-related piping materials to meet the original Construction Code; however, no construction criteria currently exist for carbon fiber reinforced polymer (CFRP) materials in the nuclear industry. Although nondestructive examination (NDE) techniques for cast and wrought ferritic and austenitic steels are well established, licensees are increasingly deploying novel materials such as CFRP for which assessment of the use of NDE is required, as the inspectability of such materials and the influence of manufacturing processes on inspectability remain insufficiently understood. To address these gaps, Pacific Northwest National Laboratory (PNNL) evaluated the fabrication of several CFRP repair mockups and the effectiveness of NDE methods to support regulatory review of CFRP repairs in nuclear power plant applications. Representative flat-plate mockups containing realistic fabrication defects were manufactured and inspected using manual and automated tap testing, dynamic response spectroscopy (DRS), and ultrasonic testing (UT). The study identified significant fabrication variability, particularly in controlling defect size and epoxy thickness, which strongly influenced defect detectability by NDE methods. Tap testing was effective for shallow defects in thin epoxy configurations but unreliable for thicker repairs and deeper flaws. DRS demonstrated higher sensitivity to dry spots but produced unconfirmed indications for thicker plates, requiring further validation. Conventional UT, particularly at 1.0 MHz, showed the strongest overall capability for detecting a range of defects, although performance degraded with increasing repair thickness and complexity. The results highlight the need to better define critical defect sizes, develop reliable mockup fabrication methods, and validate NDE methods needed to support CFRP repairs.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Rapid Spaceborne Mapping of Wildfire Retardant Drops for Active Wildfire Management

Aerial application of fire retardant is a critical tool for managing wildland fire spread. Retardant applications are carefully planned to maximize fire line effectiveness, improve firefighter safety, protect high-value resources and assets, and limit environmental impact. However, topography, wind, visibility, and aircraft orientation can lead to differences between planned drop locations and the actual placement of the retardant. Information on the precise placement and areal extent of the dropped retardant can provide wildland fire managers with key information to (1) adaptively manage event resources, (2) assess the effectiveness of retardant slowing or stopping fire spread, (3) document location in relation to ecologically sensitive areas; and perform or validate cost-accounting for drop services. This study uses Sentinel-2 satellite data and commonly used machine learning classifiers to test an automated approach for detecting and mapping retardant application. We show that a multiclass model (retardant, burned, unburned, and cloud artifact classes) outperforms a single-class retardant model and that image differencing (post-application minus pre-application) outperforms single-image models. Compared to the random forest and support vector machine, the gradient boosting model performed the best with an overall accuracy of 0.88 and an F1 Score of 0.76 for fire retardant, though results were comparable for all three models. Our approach maps the full areal extent of the dropped retardant within minutes of image availability, rather than linear representations currently mapped by aerial GPS surveys. The development of this capability allows for the rapid assessment of retardant effectiveness and documentation of placement in relation to sensitive environments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Measurement report: A comparison of ground-level ice-nucleating-particle abundance and aerosol properties during autumn at contrasting marine and terrestrial locations

Abstract. Ice-nucleating particles (INPs) are an essential class of aerosols found worldwide that have far-reaching but poorly quantified climate feedback mechanisms through interaction with clouds and impacts on precipitation. These particles can have highly variable physicochemical properties in the atmosphere, and it is crucial to continuously monitor their long-term concentration relative to total ambient aerosol populations at a wide variety of sites to comprehensively understand aerosol–cloud interactions in the atmosphere. Hence, our study applied an in situ forced expansion cooling device to measure ambient INP concentrations and test its automated continuous measurements at atmospheric observatories, where complementary aerosol instruments are heavily equipped. Using collocated aerosol size, number, and composition measurements from these sites, we analyzed the correlation between sources and abundance of INPs in different environments. Toward this aim, we have measured ground-level INP concentrations at two contrasting sites, one in the Southern Great Plains (SGP) region of the United States with a substantial terrestrially influenced aerosol population and one in the Eastern North Atlantic Ocean (ENA) region with a primarily marine-influenced aerosol population. These measurements examined INPs mainly formed through immersion freezing and were performed at a ≤ 12 min resolution and with a wide range of heterogeneous freezing temperatures (Ts above −31 °C) for at least 45 d at each site. The associated INP data analysis was conducted in a consistent manner. We also explored the additional offline characterization of ambient aerosol particle samples from both locations in comparison to in situ data. From our ENA data, on average, INP abundance ranges from ≈ 1 to ≈ 20 L−1 (−30 °C ≤ T ≤ −20 °C) during October–November 2020. Backward air mass trajectories reveal a strong marine influence at ENA with 75.7 % of air masses originating over the Atlantic Ocean and 96.6 % of air masses traveling over open water, but analysis of particle chemistry suggests an additional INP source besides maritime aerosols (e.g., sea spray aerosols) at ENA. In contrast, 90.8 % of air masses at the SGP location originated from the North American continent, and 96.1 % of the time, these air masses traveled over land. As a result, organic-rich SGP aerosols from terrestrial sources exhibited notably high INP abundance from ≈ 1 to ≈ 100 L−1 (−30 °C ≤ T ≤ −15 °C) during October–November 2019. The probability density function of aerosol surface area-scaled immersion freezing efficiency (ice nucleation active surface site density; ns) was assessed for selected freezing temperatures. While the INP concentrations measured at SGP are higher than those of ENA, the ns(T) values of SGP (≈ 105 to ≈ 107 m−2 for −30 °C ≤ T ≤ −15 °C) are reciprocally lower than ENA for approximately 2 orders of magnitude (≈ 107 to ≈ 109 m−2 for −30 °C ≤ T ≤ −15 °C). The observed difference in ns(T) mainly stems from varied available aerosol surface areas, Saer, from two sites (Saer,SGP > Saer,ENA). INP parameterizations were developed as a function of examined freezing temperatures from SGP and ENA for our study periods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Development of an Automated Software Reliability Tester for Digital I and C

Existing nuclear facilities are in the process of upgrading analog systems to new, software- based digital components; however, the qualification of these new systems has been a significant hurdle for their implementation in the United States. This paper describes the development of a Software Reliability Tester (SRT) that will provide a means to quantify the reliability and fault tolerance of digital instrumentation and control (I and C) systems used in nuclear facilities. The SRT is comprised of hardware and software that exercise digital equipment inputs and compare the outputs to expected values to quantify system reliability. Incorporation of fault injection techniques enables the SRT to evaluate the robustness of digital I and C in the presence of abnormal conditions. The integration of both quantitative reliability and fault tolerance measures will provide the nuclear industry with an automated and systematic approach to digital I and C qualification. This will enable safer, more reliable, and more cost effective implementations of a broad spectrum of digital I and C equipment in existing and next generation nuclear facilities. This paper includes a description of the design of the SRT, including software modules and the hardware interface. In addition, an example of using the SRT to automate functional testing of a digital timer relay is presented. The SRT described in this paper provides a means to conduct efficient and robust testing for a variety of digital devices. Future plans for the SRT include integrating fault injection testing so that devices can be evaluated in the presence of off-normal conditions. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

ANSTO Synroc's Inactive Engineering Demonstrator - 19342

As part of the strategy for delivering the SyMo facility, a first of a kind project demonstrating the use of ANSTO Synroc technology for the treatment of intermediate liquid waste derived from Molybdenum-99 production, an inactive engineering demonstrator has been constructed by ANSTO Synroc. The role of this facility is to mitigate a number of the technology risks associated with a first of a kind project by addressing process integration, process operation, process recovery, maintenance, and operator training. Further, the plant is being used to develop the quality assurance framework to ensure that the waste package produced meets the waste acceptance criteria for final disposition. The inactive engineering demonstrator is a highly automated test-platform where the process design for the SyMo facility has been validated. A risk-based approach has been used to develop a comprehensive testing program aimed at mitigating the risks associated with a first of a kind plant and increasing the technology readiness level of the design. The ultimate result of this work is to ensure that the SyMo facility is highly reliable, operable, and maintainable. This paper will deliver a brief overview of the SyMo Facility, the project delivery methodology, and the role the inactive engineering demonstrator plays in project realisation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

"Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test"

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. We explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

Jang, Kathy↗