Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An Overview of Gemma FY20 Verification Activities

Gemma verification activities for FY20 can be divided into three categories: the development of specialized quadrature rules, initial progress towards the development of manufactured solutions for code verification, and automated code-verification testing. In the method-of-moments implementation of the electric-field integral equation, the presence of a Green’s function in the four-dimensional integrals yields singularities in the integrand when two elements are nearby. To address these challenges, we have developed quadrature rules to integrate the functions through which the singularities can be characterized. Code verification is necessary to develop confidence in the implementation of the numerical methods in Gemma. Therefore, we have begun investigating the use of manufactured solutions to more thoroughly verify Gemma. Manufactured solutions provide greater flexibility for testing aspects of the code; however, the aforementioned singularities provide challenges, and existing work is limited in rigor and quantity. Finally, we have implemented automated code-verification testing using the VVTest framework to automate the mesh refinement and execution of a Gemma simulation to generate mesh convergence data. This infrastructure computes the observed order of accuracy from these data and compares it with the theoretical order of accuracy to either develop confidence in the implementation of the numerical methods or detect coding errors.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

vvtools v. 1.0

Vvtools is a suite of testing tools, with a focus on reproducible verification and validation. They are written in pure Python, and contain a test harness and an automated process management tool. Users of vvtools can develop suites of verification and validation tests and run them on small to large high performance computing resources in an automated and reproducible way. The test harness enables complex processes to be performed in each test and even supports a one-level parent/child dependency between tests. It includes a built in capability to manage workloads requiring multiple processors and platforms that use batch queueing systems.

Drake, RichardR.↗
DOE OSTI2021

Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation

This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2017

Real-time, In-line Assessment of Flow Performance for Compressible and Anisotropic Bulk Solids

Feeding and handling problems have been recognized as a major contributor to low production of renewable cellulosic ethanol in the US, which achieved only 7% of nameplate capacity in 2016. Current methods that assess material feeding and handling properties require multiple hours to complete, making them ill-suited for quality assurance and control (QA/QC) in production environments. This talk presents a method, based upon a custom hopper with adaptable geometry, to assess feeding and handling behavior of materials in a production or receiving line in real-time, so that those properties can be used to either sort material or adjust preprocessing conditions to ensure that incoming material meet feeding and handling specifications. Flow properties are determined by continually adjusting the size of the outlet in a plane-flow hopper to maintain a constant fill level in the hopper. The angle of the hopper walls can also be adjusted to tune the geometry to different materials. Tests conducted at approximately 1,000 lbs per hour indicate that this method readily assesses the flow performance differences of corn stover and pine wood due to changes in particle size from 3 to 13 mm and due to changes in moisture content from 10 to 20%. Comparison of this method with shear tests using an automated Schulze ring shear indicate that this method is more sensitive for determining differences in flowability performance than traditional shear tests for corn stover and pine wood. Test results, including wall pressure measurements, are compared to simulations and indicate that this method shows promise for in-line quantitative estimation of the flow properties of compressible and anisotropic materials, including bulk density, cohesion, and internal angle of friction.

09 BIOMASS FUELS↗
DOE OSTI2014

SU-E-T-442: Sensitivity of Quality Assurance Tools to Delivery Errors On a Magnetic Resonance-Imaging Guided Radiation Therapy (MR-IGRT) System

Purpose: To test the sensitivity of the quality assurance (QA) tools actively used on a clinical MR-IGRT system for potential delivery errors. Methods: Patient-specific QA procedures have been implemented for a commercially available Cobalt-60 MR-IGRT system. The QA tools utilized were a MR-compatible cylindrical diode-array detector (ArcCHECK) with a custom insert which positions an ionization chamber (Exradin A18) in the middle of the device, as well as an in-house treatment delivery verification program. These tools were tested to investigate their sensitivity to delivery errors. For the ArcCHECK and ion chamber, a baseline was established with a static field irradiation to a known dose. Variations of the baseline were investigated which included rotated gantry, altered field size, directional shifts, and different delivery time. In addition, similar variations were tested with the automated delivery verification program that compared the treatment parameters in the machine delivery logs to the ones in the plan. To test the software, a 3-field conformal plan was generated as the baseline. Results: ArcCHECK noted at least a 13% decrease in passing rate from baseline in the following scenarios: gantry rotation of 1 degree from plan, 5mm change in field size, 2mm lateral shift, and delivery time decrease. Ion chamber measurements remained consistent for these variations except for the 5 second decrease in delivery time scenario which resulted in an 8% difference from baseline. The delivery verification software was able to detect and report the simulated errors such as when the gantry was rotated by 0.6 degrees, the beam weighting was changed by a percent, a single multileaf collimator was moved by 1cm, and the dose was changed from 2 to 1.8Gy. Conclusion: The results show that the current tools used for patient specific QA are capable of detecting small errors in RT delivery with presence of magnetic field.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

kiloAMPS (Final Report)

This project aims to reduce the testing time of various electrochemical techniques for neural interface electrodes by developing an automated PCB design which would be capable of testing multiple interface electrodes in parallel. The system should be able to perform the full battery of electrochemical tests, though electrochemical impedance spectroscopy (EIS) will be of primary interest. Previous versions of this project have already improved upon traditional interface testing by automating many parts of the process, reducing the test time to around a day and requiring the technician to check up on the process once every six hours. A key bottleneck is that the electrode testing is still done sequentially. Testing time could be heavily reduced if electrodes could be tested in parallel.

42 ENGINEERING↗
DOE OSTI2019

Automated “Cells-To-Peptides” Sample Preparation Workflow for High-Throughput, Quantitative Proteomic Assays of Microbes

Mass spectrometry-based quantitative proteomic analysis has proven valuable for clinical and biotechnology-related research and development. Improvements in sensitivity, resolution, and robustness of mass analyzers have also added value. However, manual sample preparation protocols are often a bottleneck for sample throughput and can lead to poor reproducibility, especially for applications where thousands of samples per month must be analyzed. To alleviate these issues, we developed a “cells-to-peptides” automated workflow for Gram-negative bacteria and fungi that includes cell lysis, protein precipitation, resuspension, quantification, normalization, and tryptic digestion. The workflow takes 2 h to process 96 samples from cell pellets to the initiation of the tryptic digestion step and can process 384 samples in parallel. We measured the efficiency of protein extraction from various amounts of cell biomass and optimized the process for standard liquid chromatography–mass spectrometry systems. The automated workflow was tested by preparing 96 Escherichia coli samples and quantifying over 600 peptides that resulted in a median coefficient of variation of 15.8%. Similar technical variance was observed for three other organisms as measured by highly multiplexed LC-MRM–MS acquisition methods. These results show that this automated sample preparation workflow provides robust, reproducible proteomic samples for high-throughput applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Microreactor Automated Control System - Digital Twin Models and Advanced Control Systems Updates

Automation of control systems is expected to be important in the economic and safe operation of microreactors. Therefore, there is a need to develop and demonstrate automated control for microreactors, along with the development of testbeds for this purpose. This report provides updates on the status of a nonnuclear microreactor automated control system (MACS)—a real-time, hardware-in-the-loop testbed for non-nuclear testing of microreactor control system automation. A real-time hardware-in-the-loop testbed incorporates the realistic dynamics of physical systems into control system development and testing. The collaborative effort between Oak Ridge National Laboratory (ORNL) and Idaho National Laboratory (INL) resulted in the development of a prototypic microreactor plant-level digital twin that includes the reactor and a balance of plant system. Advanced control strategies were incorporated to demonstrate testing of control automation solutions. The gRPC communication protocol, which was implemented in the hardware-in-the-loop testbed by INL, was coupled to a digital twin model developed using the TRANsient Simulation Framework of Reconfigurable Models (TRANSFORM) library in Modelica. This digital twin simulation was tested with the ViBRANT hardware for realistic feedback and visual representation of control action in real time. A modular Python client structure was developed to manage functional mock-up unit-based simulation and real-time gRPC communication. Hardware-in-the-loop testing indicated that the modeled reactor—a natural-convection, molten-salt coolant loop configuration—responds well to control of drum positioning for modulation of reactor core power, as well as system-level control and downstream demand changes. Ongoing research is focused on integrating additional control algorithms that utilize data from newly included sensors within the MACS hardware testbed, as well as demonstrating and assessing the performance of the different automated control algorithms on multiple additional operational scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

SU-F-J-37: Commissioning a Six Degree of Freedom Couch

Purpose: The proper operation of a six degree of freedom couch (6DOFC) to position a patient for treatment requires that a number systems on the treatment unit work together correctly. Commissioning a 6DOFC requires not only the commissioning of each separate system but also commissioning the interactions between the systems. Methods: To commission a 6DOFC, we tested the resolvers that readout the linear and angular positions; the orthogonality of the axes of the laser positioning system, the imaging system, the gantry and the couch as well as their relationship to each other. An automated Winston-Lutz test was used verify the coincidence of the origins of the laser system, imaging system and treatment unit. The IsoCal phantom was used to verify the consistency of axes orientations between systems. The operation of the couch and imaging system was verified under simulated load conditions and an end to end test was performed to verify correct operation of the system. Results: The tests on the couch resolvers, orthogonality and coincidence of the axes of each system were successfully completed and showed excellent agreement. The automated Winston-Lutz test showed that the maximum displacement of the center of the radiation field with respect to the isocenter was <0.6 mm (radius) at isocenter. The analysis of the IsoCal phantom showed that the maximum variation of the radiation field with respect to known locations in the phantom was ∼0.9 mm for all the BBs in the phantom. Load tests showed maximum errors of 1 mm. Conclusion: We tested all system associated with the 6DOFC and found the uncertainty due to imaging was <.9mm and the uncertainty due to loading ∼1 mm, resulting in a total error of ∼1.4 mm.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Bio-fuel effects and seasonal fuel property variations related to abnormal combustion occurrences observed in the field

Since 2015, the automotive industry has regularly observed sharp increases in customer complaints of poor driveability and increased warranty claims during the months of September and October. These persistent seasonal complaint increases have been tracked to occur from increased abnormal combustion events that coincide with the seasonal transition from summer to winter fuel volatility, beginning on September 15th annually. The Reid Vapor Pressure (RVP) of gasoline during this seasonal transition has been found to be the primary property attributed to this annual issue. It’s hypothesized that an increase in volatile butanes and pentanes from advanced petroleum recovery techniques and hydrofracking production has hastened the transition from summer to winter fuel volatility in the marketplace, rather than the gradual increase of the RVP over time as historically intended. At worst, mid-winter fuel, with an RVP ranging from 12 to 16 psi, depending on location in the U.S., enters the market while ambient temperatures can still be above average for the winter season. This combination of high volatility fuel with unseasonably warm weather will increase fuel system flash boiling, injector spray cavitation, and spray collapse inside the engine’s combustion chamber, ultimately linking fuel property variations to abnormal engine combustion processes. This CRADA program will investigate these known knowledge gaps by coupling with two national laboratories, Oak Ridge National Laboratory, and the National Renewable Energy Laboratory to employ both unique tools and expertise throughout the industry to provide the insight, knowledge, and data critical to understand the observed interactions. Overall findings of this work are that fuel wall retention increased SPI proportionally, and fuels with an increased distillation (i.e. energy fraction) above the wall temperature increased fuel retention. Likewise fuels with increased enthalpy of vaporization (HoV) increased fuel retention proportional to the temperature reduction from the HoV (~13K reduction in this work). Thus, fuel with increased HoV and increased fuel distillation above the linear temperature also exhibited increased SPI rates. Fuel with high RVP did exhibit increased fuel spray collapse form spray imaging measurements, but in SPI testing the high volatility of these fuels at the tested conditions did not necessarily increase SPI rates despite exhibiting increased spray collapse in injector imaging and increased spray-wall impingement measured in fired engine testing. It was also found that spray imaging showed collapse was possible at throttled conditions, but this was not relevant to high boost pressures relevant to SPI conditions, however, under transient load and or speed encountered in real-world operation fuel spray collapse could affect fuel retention and real-world SPI that were not probed in the automated high load test sequence of this work.

09 BIOMASS FUELS↗
DOE OSTI2015

RAVEN Quality Assurance Activities

This report discusses the quality assurance activities needed to raise the Quality Level of Risk Analysis in a Virtual Environment (RAVEN) from Quality Level 3 to Quality Level 2. This report also describes the general RAVEN quality assurance activities. For improving the quality, reviews of code changes have been instituted, more parts of testing have been automated, and improved packaging has been created. For upgrading the quality level, requirements have been created and the workflow has been improved.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2016

Oak ridge national laboratory automated clean chemistry for bulk analysis of environmental swipe samples

To shorten the lengthy and costly manual chemical purification procedures, sample preparation methods for mass spectrometry are being automated using commercial-off-the-shelf (COTS) equipment. This addresses a serious need in the nuclear safeguards community to debottleneck the separation of U and Pu in environmental samples—currently performed by overburdened chemists—with a method that allows unattended, overnight operation. In collaboration with Elemental Scientific Inc., the prepFAST-MC2 was designed based on current COTS equipment that was modified for U/Pu separations utilizing Eichrom™ TEVA and UTEVA resins. Initial verification of individual columns yielded small elution volumes with consistent elution profiles and good recovery. Combined column calibration demonstrated ample separation without crosscontamination of the eluent. Automated packing and unpacking of the built-in columns initially showed >15% deviation in resin loading by weight, which can lead to inconsistent separations. Optimization of the packing and unpacking methods led to a reduction in the variability of the packed resin to less than 5% daily. The reproducibility of the automated system was tested with samples containing 30 ng U and 15 pg Pu, which were separated in a series with alternating reagent blanks. These experiments showed very good washout of both the resin and the sample from the columns as evidenced by low blank values. Analysis of the major and minor isotope ratios for U and Pu provided values well within data quality limits for the International Atomic Energy Agency. Additionally, system process blanks spiked with 233U and 244Pu tracers were separated using the automated system after it was moved outside of a clean room and yielded levels equivalent to clean room blanks, confirming that the system can produce high quality results without the need for expensive clean room infrastructure. Comparison of the amount of personnel time necessary for successful manual vs. automated chemical separations showed a significant decrease in hands-on time from 9.8 hours to 35 minutes for seven samples, respectively. This documented time savings and reduced labor translates to a significant cost savings per sample. Overall, the system will enable faster sample reporting times at reduced costs by limiting personnel hours dedicated to the chemical separation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

TRANSP-based optimization towards tokamak scenario development

An optimization approach that incorporates the predictive transport code TRANSP is proposed for tokamak scenario development. Optimization methods are often employed to develop open-loop control strategies to aid access to high performance tokamak scenarios. Generally, the optimization approaches use control-oriented models, i.e. models that are reduced in complexity and prediction accuracy as compared to physics-oriented transport codes such as TRANSP. In the presented approach, an optimization procedure using the TRANSP code to simulate the tokamak plasma is considered for improved predictive capabilities. As a test case, the neutral beam injection (NBI) power is optimized to develop a control strategy that maximizes the noninductive current fraction during the ramp-up phase for NSTX-U. Simulation studies towards the achievement of noninductive ramp-up in NSTX-U have already been carried out with the TRANSP code. The optimization-based approach presented in this work is used to maximize the noninductive current fraction during ramp-up in NSTX-U, demonstrating that the scenario development task can be automated. An additional test case considers optimization of the current ramp rate in DIII-D for obtaining a stationary plasma characterized by a flat loop voltage profile in the flattop phase.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

TRANSP-based Optimization Towards Tokamak Scenario Development

An optimization approach that incorporates the predictive transport code TRANSP is proposed for tokamak scenario development. Optimization methods are often employed to develop open-loop control strategies to aid access to high performance tokamak scenarios. In general, the optimization approaches use control-oriented models, i.e. models that are reduced in complexity and prediction accuracy as compared to physics-oriented transport codes such as TRANSP. In the presented approach, an optimization procedure using the TRANSP code to simulate the tokamak plasma is considered for improved predictive capabilities. As a test case, the neutral beam injection (NBI) power is optimized to develop a control strategy that maximizes the non-inductive current fraction during the ramp-up phase for NSTX-U. Simulation studies towards the achievement of non-inductive ramp up in NSTX-U have already been carried out with the TRANSP code. The optimization-based approach proposed in this work is used to maximize the non-inductive current fraction during ramp-up in NSTX-U, demonstrating that the scenario development task can be automated. An additional test case considers optimization of the current ramp rate in DIII-D for obtaining a stationary plasma characterized bya flat loop voltage profile in the flattop phase.

DIII-D↗
DOE OSTI2020

Unified architecture for data-driven metadata tagging of building automation systems

This article presents a Unified Architecture (UA) for automated point tagging of Building Automation System (BAS) data, based on a combination of data-driven approaches. Advanced energy analytics applications—including fault detection and diagnostics and supervisory control—have emerged as a significant opportunity for improving the performance of our built environment. Effective application of these analytics depends on harnessing structured data from the various building control and monitoring systems, but typical BAS implementations do not employ any standardized metadata schema. While standards such as Project Haystack and Brick Schema have been developed to address this issue, the process of structuring the data, i.e., tagging the points to apply a standard metadata schema, has, to date, been a manual process. This process is typically costly, labor-intensive, and error-prone. In this work we address this gap by proposing a UA that automates the process of point tagging by leveraging the data accessible through connection to the BAS, including time-series data and the raw point names. The UA intertwines supervised classification and unsupervised clustering techniques from machine learning and leverages both their deterministic and probabilistic outputs to inform the point tagging process. Furthermore, we extend the UA to embed additional input and output data-processing modules that are designed to address the challenges associated with the real-time deployment of this automation solution. We test the UA on two datasets for real-life buildings: (i) commercial retail buildings and (ii) office buildings from the National Renewable Energy Laboratory (NREL) campus. We report the proposed methodology correctly applied 85–90% and 70–75% of the tags in each of these test scenarios, respectively for two significantly different building types used for testing UA's fully-functional prototype. The proposed UA, therefore, offers promising approach for automatically tagging BAS data as it reaches close to 90% accuracy. Further building upon this framework to algorithmically identify the equipment type and their relationships is an apt future research direction to pursue.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗