Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Concrete Structure Health Monitoring Using Vibro-acoustic Testing and Machine Learning

Assessment and management of aging concrete structures in nuclear power plants require a more systematic approach than simple reliance on margins of safety in existing codes. Research is required to deploy online monitoring capability to assess the health of concrete structures in nuclear power plants and perform predictive analytics based on heterogeneous measurements, in order to reduce the operation and maintenance costs. The research effort described in this report focuses on the health monitoring of concrete slabs containing reactive aggregates using the vibro-acoustic modulation (VAM) technique and predictive modeling. The research is developing an approach to enable detection, localization, and estimation of the extent of degradation in concrete slabs due to alkali-silica reaction (ASR). The project outcomes are generic and extendable to other degradation modes in concrete. A concrete slab without reinforcements was cast at Vanderbilt University and cured in aggressive conditions to accelerate ASR degradation. In this report, we develop a methodology for the automation of VAM testing, and the construction of machine learning models to facilitate damage localization in concrete structures. We investigate how machine learning models based on physics simulation data can be effectively utilized for damage localization (damage location and depth) and estimation in a concrete slab specimen. Our study indicates that these models could potentially support damage localization and estimation for NPP structures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

WE-H-BRC-05: Catastrophic Error Metrics for Radiation Therapy

Purpose: Intuitive evaluation of complex radiotherapy treatments is impractical, while data transfer anomalies create the potential for catastrophic treatment delivery errors. Contrary to prevailing wisdom, logical scrutiny can be applied to patient-specific machine settings. Such tests can be automated, applied at the point of treatment delivery and can be dissociated from prior states of the treatment plan, potentially revealing errors introduced early in the process. Methods: Analytical metrics were formulated for conventional and intensity modulated RT (IMRT) treatments. These were designed to assess consistency between monitor unit settings, wedge values, prescription dose and leaf positioning (IMRT). Institutional metric averages for 218 clinical plans were stratified over multiple anatomical sites. Treatment delivery errors were simulated using a commercial treatment planning system and metric behavior assessed via receiver-operator-characteristic (ROC) analysis. A positive result was returned if the erred plan metric value exceeded a given number of standard deviations, e.g. 2. The finding was declared true positive if the dosimetric impact exceeded 25%. ROC curves were generated over a range of metric standard deviations. Results: Data for the conventional treatment metric indicated standard deviations of 3%, 12%, 11%, 8%, and 5 % for brain, pelvis, abdomen, lung and breast sites, respectively. Optimum error declaration thresholds yielded true positive rates (TPR) between 0.7 and 1, and false positive rates (FPR) between 0 and 0.2. Two proposed IMRT metrics possessed standard deviations of 23% and 37%. The superior metric returned TPR and FPR of 0.7 and 0.2, respectively, when both leaf position and MUs were modelled. Isolation to only leaf position errors yielded TPR and FPR values of 0.9 and 0.1. Conclusion: Logical tests can reveal treatment delivery errors and prevent large, catastrophic errors. Analytical metrics are able to identify errors in monitor units, wedging and leaf positions with favorable sensitivity and specificity. In part by Varian.

60 APPLIED LIFE SCIENCES↗

Adrastea: An Efficient FPGA Design Environment for Heterogeneous Scientific Computing and Machine Learning

We present Adrastea, an efficient FPGA design environment for developing scientific machine learning applications. FPGA development is challenging, from deployment, proper toolchain setup, programming methods, interfacing FPGA kernels, and more importantly, the need to explore design space choices to get the best performance and area usage from the FPGA kernel design. Adrastea provides an automated and scalable design flow to parameterize, implement, and optimize complex FPGA kernels and associated interfaces. We show how virtualization of the development environment via virtual machines is leveraged to simplify the setup of the FPGA toolchain while deploying the FPGA boards and while scaling up the automated design space exploration to leverage multiple machines concurrently. Adrastea provides an automated build and test environment of FPGA kernels. By exposing design space hyper-parameters, Adrastea can automatically search the design space in parallel to optimize the FPGA design for a given metric, usually performance or area. Adrastea simplifies the task of interfacing with the FPGA kernels with a simplified interface API. To demonstrate the capabilities of Adrastea, we implement a complex random forest machine learning kernel with 10,000 input features while achieving extremely low computing latency without loss of prediction accuracy, which is required by a scientific edge application at SNS. We also demonstrate Adrastea using an FFT kernel and show that for both applications Adrastea is able to systematically and efficiently evaluate different design options, which reduced the time and effort required to develop the kernel from months of manual work to days of automatic builds.

Young, Aaron↗

Development and testing of a continuous maritime monitor for radionuclide aerosols

Monitoring airborne concentrations of radionuclide activity may provide a timely warning to sea-based assets to avoid contamination from a radioactive plume. The development and testing of an automated aerosol monitoring system that can capture and detect radioactive particulate from marine air is presented. A custom electrostatic precipitator (ESP) was designed to capture particulate onto a reusable collection media. The collection efficiency of the ESP system for radon progeny was determined to be ~23%. A conservative calculation of the minimum detectable concentration of 214 Bi was estimated as 0.3-8 Bq/m 3 . The system was demonstrated in continuous operation, without consumables and limited maintenance, in a marine environment at the PNNL campus in Sequim, Washington. In conclusion, a successful 2-month deployment indicates the feasibility of the approach for continuous maritime monitoring for radionuclide aerosols.

Moore, Michael E. [Pacific Northwest National Labo↗

Continuous Integration, In-Code Documentation, and Automation for Nuclear Quality Assurance Conformance

The Multiphysics Object Oriented Simulation Environment (MOOSE) is an open-source, finite element framework for solving highly coupled sets of nonlinear equations. The development of the framework and applications occurs concurrently using an agile, continuous-integration software package. Included in the framework is an in-code, extensible documentation system. Using these two tools in union with the repository management tools GitHub and GitLab, a software quality plan was created and followed such that MOOSE and a MOOSE-based application (BISON) have been shown to meet the American Society of Mechanical Engineers’ Nuclear Quality Assurance-1 standard. The approach relies heavily on automation for both testing and documentation. The resulting effort demonstrates that a rigorous software quality plan may be implemented that incurs a minimal impact on day-to-day development of the software, satisfying the stringent guidelines necessary to operate the software in a safety function within a nuclear facility.

97 MATHEMATICS AND COMPUTING↗

A strategy for a general search for new phenomena using data-derived signal regions and its application within the ATLAS experiment

This paper describes a strategy for a general search used by the ATLAS Collaboration to find potential indications of new physics. Events are classified according to their final state into many event classes. For each event class an automated search algorithm tests whether the data are compatible with the Monte Carlo simulated expectation in several distributions sensitive to the effects of new physics. The significance of a deviation is quantified using pseudo-experiments. A data selection with a significant deviation defines a signal region for a dedicated follow-up analysis with an improved background expectation. The analysis of the data-derived signal regions on a new dataset allows a statistical interpretation without the large look-elsewhere effect. The sensitivity of the approach is discussed using Standard Model processes and benchmark signals of new physics. As an example, results are shown for 3.2 fb –1 of proton–proton collision data at a centre-of-mass energy of 13 TeV collected with the ATLAS detector at the LHC in 2015, in which more than 700 event classes and more than 10 5 regions have been analysed. Furthermore, no significant deviations are found and consequently no data-derived signal regions for a follow-up analysis have been defined.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Automatic Imagery Data Analysis for Proactive Computer-Based Workflow Management during Nuclear Power Plant Outages

This report is being submitted for the task “Final Report” of DOE NEUP Project 15-8121 “Automatic Imagery Data Analysis for Proactive Computer-Based Workflow Management during Nuclear Power Plant Outages.” Typical nuclear power plant (NPP) outages always involve thousands of maintenance and refueling activities and a large number of workers in limited workspaces, while having tight schedules and zero-tolerance for accidents. During an outage, thousands of workers will be working in various workspaces across the NPP. High outage costs and expensive delays (approximately 1.5 million dollars of loss per day of delay) in NPP maintenance demand tight outage schedules. In packed workspaces, an automatic system that monitors human behaviors in real-time and provides insights about current and pending schedule deviations from the plan is critical for ensuring: 1) effective collaboration among workers and worker teams from different trades; 2) less waste of time and resources due to the lack of situational awareness; and 3) proactive outage project control. The overall goal of this project is to test the hypothesis that real-time imagery-based object tracking and spatial analysis, as well as human behavior modeling of outage participants, will significantly improve the efficiency of outage control while lowering the rates of accidents and incidents. Three objectives of this project are: 1) Establish real-time object tracking and spatiotemporal analysis methods that automatically assess the productivity of field activities and detect anomalous spatiotemporal relationships among activities that cause inefficiencies and risks; 2) Establish realtime human tracking and human factor modeling methods for automatically diagnosing unexpected actions of and interactions between outage participants, those which cause inefficient collaborations between Advanced Outage Control Center (AOCC), satellite outage centers, NPP workers, and maintenance service providers; and 3) Test the proposed automated object tracking, human behavior modeling, and spatiotemporal analysis methods in outage control case studies in order to characterize the effectiveness of automated imagery-data-driven methods in proactively improving the efficiency and safety of workflows in outage coordination and risk management. Recent studies of detailed human behavior monitoring on construction sites have examined the potential of applying advanced computer vision algorithms in detecting and tracking anomalous workers (i.e., workers who do not wear hard hats or safety vests) for ensuring job site safety. Some studies of human factor studies revealed the importance of modeling detailed interactions between individuals within and across teams in better understanding the impact of human in proactive project control. Other studies in the construction domain have developed computational simulation frameworks that formalize detailed spatiotemporal interactions between tasks in order to simulate the impacts of individual tasks on the performance of workflows. While integrated analyses that combine human factor assessment, as well as image processing and simulation, are in demand for effective decision-making, limited studies have examined the potential of such integrated analyses in NPP outage control. This research project has examined an automatic outage monitoring and control system that integrates human factor analysis, computer vision techniques, and simulation methods in order to enable engineers to better understand the interactions between humans, resources, and workflows during outage processes. The project aims at providing NPP maintenance agencies insights into more efficient use of limited resources in extending the life of a nuclear plant, as well as reducing waste while ensuring sufficient generation of electricity. This study is significant for the safety of nuclear plants, sustainable electricity generation for livable communities, and cost savings for maintaining electricity infrastructures in the United States.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CICE Consortium Progress Report, June 2018 - December 2019

The CICE Consortium accomplished a number of major upgrades to our sea ice model code, scripts and testing infrastructure, while strengthening our visibility in the international modeling community. We released CICE versions 6.0.0, 6.0.1, 6.0.2 and 6.1.0, all of which include updated releases of Icepack. Major new capabilities include a floe size distribution, new coupling infrastructure, improvements to all of CICE’s dynamics options, a new atmospheric data set for historical simulations, overhauled documentation, and more robust and flexible scripts for running and testing the code. Several key testing processes were automated this year. In addition, the team is actively engaged in planning our first user workshop and tutorial in February 2020. In addition to overseeing modifications to the Consortium’s resources and code releases, management tasks included meeting with and updating the Consortium’s Sponsors group in October 2018, prioritizing tasks by mapping them onto potential release targets, and rescuing early CICE releases (version 1 through 3.14) from a disappearing LANL archive.

54 ENVIRONMENTAL SCIENCES↗

Multi-Speed Transmission For Commercial Delivery Medium Duty PEDVs

Successful completion of the proposed project will set a course for improving quality of life by overcoming key challenges in the gearbox for commercial-delivery, medium-duty, plug-in electric drive vehicles: It will reduce US dependency on foreign oil through the use of electric driven propulsion instead of fuel driven. It will reduce health risks by replacing tailpipe emissions in densely populated city centers. Finally, it will improve the performance-cost basis to meet or exceed the expectations of the targeted medium duty vehicle fleet owners and the independent customers. The proposed multi-speed transmission will narrow motor operation to the peak efficiency region, thereby increasing the electric powertrain efficiency to help close the range gap. Further, it will enhance customer satisfaction by improving vehicle acceleration, top speed and gradeability over the baseline. The project was conducted in three budget periods: In BP1: Technology Development, High-level vehicle powertrain models were used to optimize candidate transmission architectures and ratios along with a variety of traction motor characteristics for concept selection. The detailed driveline designs and component dynamics were investigated to meet medium-duty EV requirements; In BP2: Technology Development and Prototype Demonstration, The modeling and simulations with multi-speed transmissions were extended to other MD and HD EV platforms. Clean sheet design of a compact, lightweight, flexible, and modular, four-speed transmission was completed. Development of novel shifting and controls strategies were started and procurement of the prototype transmission and the controller hardware was begun; In BP3: Technology Integration, Testing, and Demonstration, Prototyping the four-speed automated mechanical transmission was completed. The transmission controls system and software development and preliminary gearbox dyno tests were done at Eaton. ORNL conducted integrated powertrain HIL tests. One of the prototype units was fully integrated into a Proterra BE35 demonstration electric bus. The shift control strategy was fine-tuned on the integrated vehicle at Eaton Marshall Proving Grounds. NREL tested the vehicle and validated the performance gains. Simulations predicted up to 20% increase in system energy efficiency depending on drive cycles, a top speed of greater than70 mph on flat road, 40% faster acceleration and a doubled gradeability with four-speed transmission as compared to the baseline EVs. Chassis Dyno Tests at NREL verified the simulation results of Eaton team and the HIL test results of ORNL team. The new four-speed EV transmission is efficient, reliable, modular, scalable, light weight, small size, and will be affordable. Furthermore, four-speed transmission enables downsizing of motor, battery and final drive, thereby reducing the total system cost.

33 ADVANCED PROPULSION SYSTEMS↗

Pico-second laser materials interactions: mechanisms, material lifetime and performance optimization Ted Laurence(14-ERD-014)

Laser-induced damage with ps pulse widths straddles the transition from intrinsic, multiphoton ionization- and avalanche ionization-based ablation with fs pulses to defectdominated, thermal-based damage with ns pulses. We investigated the morphology and scaling of damage for commonly used silica and hafnia coatings as well as fused silica. Using carefully calibrated laser-induced damage experiments, in situ imaging, and high-resolution optical microscopy, atomic force microscopy, and scanning electron microscopy, we showed that defects play an important role in laser-induced damage for pulse durations as short as 1 ps. Three damage morphologies were observed: standard material ablation, ultra-high density pits, and isolated absorbers. For 10 ps and longer, the isolated absorbers limited the damage performance of the coating materials. We showed that damage resulting from the isolated absorbers grows dramatically with subsequent pulses for sufficient fluences. For hafnia coatings, we used electric field modeling and experiments to show that isolated absorbers near the surface were affected by the chemical environment (vacuum vs. air) for pulses as short as 10 ps. Coupled with the silica results, these results suggested that improvements in the performance in the 10 -60 ps range have not reached fundamental limits. These findings motivate new efforts, including a new SI LDRD in improving the laser-damage performance of multi-layer dielectric coatings. A damage test facility for ps pulses was developed and automated, and was used for testing production optics for ARC. The resulting software was transferred to other laser test facilities for fs pulses and multiple wavelengths with 30 ps pulses. Additionally, the LDRD supported the retention and promotion of an important staff scientist in high-resolution dynamic microscopy and laser-damage testing.

36 MATERIALS SCIENCE↗

Weldability and Impact Energy Properties of High-Hardness Armor Steel

In this study, the weldability of high-hardness armor steel by the gas metal arc welding method has been investigated. The study was aimed at determining the weakness points of manual welding compared to automated welding through microhardness testing, the cooling rate, tensile characteristics and nondestructive analysis. Detailed studies were performed for automated welding on the impact energy and microhardness in the fusion line, as the most sensitive zone of the armor steel weld joint. It was demonstrated that the selection of the preheating and interpass temperature is important in terms of the cooling rate and quantity of diffusible and retained hydrogen in the weld joint. The tensile strength was higher than 800 MPa. The width of the heat-affected zone did not exceed 15.9 mm, measured from the weld centerline, while the impact energy results were 74 and 39 J at 20 and – 40 °C, respectively.

36 MATERIALS SCIENCE↗

Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm

Abstract We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a material’s composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm—namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10 4 or greater data points. We encourage evaluating materials ML algorithms on the Matbench benchmark and comparing them against the latest version of Automatminer.

36 MATERIALS SCIENCE↗

Automated Redox Titrations via Interdigitated Electrode Arrays: Application to the Mediated Electron Transfer Interrogation of Charge and Rate on Electrodeposited Polymers

Mediated electron transfer (MET) plays a crucial role in energy storage and conversion technologies such as redox targeting flow batteries (RTFBs), yet its experimental investigation often requires labor-intensive and low-throughput setups. To address this, we developed a microfabricated interdigitated electrode array (IDA) platform that enables automated, high-throughput electrochemical redox titration measurement to be performed to study the MET process. Our redox titration method enables simultaneous measurement of the charge capacity and rate of MET processes on a material or surface. Automated redox titration (ART) facilitates systematic investigation of the MET process across a broad parameter space, exemplified through the study of polypyrrole (PPy) and a pyrene-4,5,9,10-tetrone azo group-based polymer (PTAP), both redox-active polymers relevant to various energy storage applications. Using PPy as a model material, 500 redox titration measurements were conducted within 50 h, varying the electrode gap widths, polymer charging potentials, voltammetric scan rates, and electrolyte concentrations. Finite-element simulations confirmed the electrochemical responses and elucidated the kinetics of the MET reactions. Our automated methodology was further tested with PTAP, revealing a surprising charging potential dependence on the rate of MET. The automation, flexibility, and scalability of our redox titration platform pave the way not only for advanced studies of MET processes relevant to RTFBs, but also with implications in the understanding of next-generation energy storage materials, molecular electrocatalysis, and biosensing.

electrochemical analysis↗

Light Water Sustainability Program: Optimizing Information Automation Using a New Method Based on System-Theoretic Process Analysis

This report describes the interim progress for research supporting the design and optimization of information automation systems for nuclear power plants. Much of the domestic nuclear fleet is currently focused on modernizing technologies and processes, including transitioning toward digitalization in the control room and elsewhere throughout the plant, along with a greater use of automation, artificial intelligence, robotics, and other emerging technologies. While there are significant opportunities to apply these technologies toward greater plant safety, efficiency, and overall cost-effectiveness, optimizing their design and avoiding potential safety and performance risks depends on ensuring that human-performance-related organizational and technical design issues are identified and addressed. This report describes modeling tools and techniques, based on sociotechnical system theory, to support these design goals and their application in the current research effort. The report is intended for senior nuclear energy stakeholders, including regulators, corporate management, and senior plant management. We have developed and employed a method to design an optimized information automation ecosystem (IAE) based on the systems-theoretic constructs underlying sociotechnical systems theory in general and the Systems-Theoretic Accident Modeling and Processes (STAMP) approach in particular. We argue that an IAE can be modeled as an interactive information control system whose behavior can be understood in terms of dynamic control and feedback relationships amongst the system’s technical and organizational components. Up to this point, we have employed a Causal Analysis based on STAMP (CAST) technique to examine a performance- and safety-related incident at an industry partner’s plant that involved the unintentional activation of an emergency diesel generator. This analysis provided insight into the behavior of the plant’s current information control structure within the context of a specific, significant event. Our ongoing analysis is focused on identifying near-term process improvements and longer-term design requirements for an optimized IAE system. The latter analyses will employ a second STAMP-derived technique, System-Theoretic Process Analysis (STPA). STPA is a useful modeling tool for generating and analyzing actual or potential information control structures. Finally, we have begun modeling plantwide organizational relationships and processes. Organizational system modeling will supplement our CAST and STPA findings and provide a basis for mapping out a plantwide information control architecture. CAST analysis findings indicate an important underlying contributor to the incident under investigation, and a significant risk to information automation system performance, was perceived schedule pressure, which exposed weaknesses in interdepartmental coordination between and within responsible plant organizations and challenged the resilience of established plant processes, until a human caused the initiating event. These findings are discussed in terms of their risk to overall system performance and their implications for information automation system resilience and brittleness. We present two preliminary information automation models. The proactive issue resolution model is a test case of an information automation concept with significant near-term potential for application and subsequent reduction in significant plant events. The IAE model is a more general representation of a broader, plantwide information automation system. From our results, we have generated a set of preliminary system-level requirements and safety constraints. These requirements will be further developed over the remainder of our project in collaboration with nuclear industry subject matter experts and specialists in the technical systems under consideration. Additionally, we will continue to pursue the system analyses initiated in the first part of our effort, with a particular emphasis on STPA as the main tool to identify weak or weakening control structures that affect the resilience of organizations and programs. Our intent is to broaden the scope of the analysis from an individual use case to a related set of use cases (e.g., maintenance tasks, compliance tasks) with similar human-system performance challenges. This will enable more generalized findings to refine the Proactive Issue Resolution and IAE models, as well as their system-level requirements and safety constraints. We will use organizational system modeling analyses to supplement STPA findings and model development. We conclude the report with a set of summary recommendations and an initial draft list of system-level requirements and safety constraints for optimized information automation systems.

99 GENERAL AND MISCELLANEOUS↗