Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

High throughput embryonic zebrafish test with automated dechorionation to evaluate nanomaterial toxicity

Engineered nanomaterials pose occupational health and environmental concerns as they possess unique physical and chemical properties that can contribute to toxicity. High throughput toxicity screening methods are needed to address the increasing number of nanomaterials in production. Here we used a zebrafish photomotor response (PMR) test to evaluate a set of fifteen nanomaterials with military relevance. Automated dechorionation of zebrafish embryos was used to enhance nanomaterials bioavailability. Optimal PMR activity in zebrafish embryos was found at 30–31 hours post-fertilization (hpf). Behavioral and toxicological responses were measured at 30 and 120 hpf; behavioral responses were found for thirteen of the fifteen nanomaterials and acute toxicity (LC50) levels for nine of the fifteen nanomaterials below the maximum test concentration of 500 μg/ml. Physico-chemical characterization of the nanomaterials detected endotoxin and bacterial contamination in two of the tested samples, which may have contributed to observed toxicity and reinforces the need for physical and chemical characterization of nanomaterials use in toxicity testing. The zebrafish PMR test, together with automated dechorionation, provides an initial rapid assessment of the behavioral effects and toxicity of engineered nanomaterials that can be followed up by physico-chemical characterization if toxicity is detected, reducing the amount of time and monetary constraints of physico-chemical testing.

59 BASIC BIOLOGICAL SCIENCES↗

Excess Density as a Descriptor for Electrolyte Solvent Design

Electrolytes mediate interactions between the cathode and anode and determine performance characteristics of batteries. Mixtures of multiple solvents are often used in electrolytes to achieve desired properties, such as viscosity, dielectric constant, boiling point, and melting point. Conventionally, multi-component electrolyte properties are approximated with linear mixing, but in practice, significant deviations are observed. Excess quantities can provide insights into the molecular behavior of the mixture and could form the basis for designing high-performance electrolytes. Here we investigate the excess density of commonly used Li-ion battery solvents such as cyclic carbonates, linear carbonates, ethers, and nitriles with molecular dynamics simulations. We additionally investigate electrolytes consisting of these solvents and a salt. The results smoothly vary with mole percent and are fit to permutation-invariant Redlich-Kister polynomials. Mixtures of similar solvents, such as cyclic-cyclic carbonate mixtures, tend to have excess properties that are lower in magnitude compared to mixtures of dissimilar substances, such as carbonate-nitrile mixtures. We perform experimental testing using our automated test stand, Clio, to provide validation to the observed simulation trends. We quantify the structure similarity using SOAP fingerprints to create a descriptor for excess density, enabling the design of electrolyte properties. To a first approximation, this will allow us to estimate the deviation of a mixture from ideal behavior based solely upon the structural dissimilarity of the components.

74 ATOMIC AND MOLECULAR PHYSICS↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗

Commercial PV Inverter IEEE 1547.1 Ride-Through Assessments Using an Automated PHIL Test Platform

As more countries seek solutions to their de-carbonization targets using renewable energy (RE) technologies, interconnection standards and national grid codes for distributed energy resources (DER) are being updated to support higher penetrations of RE and improve grid stability. Common grid-code revisions mandate DER devices, such as solar inverters and energy storage systems, ride-through (RT) voltage and frequency disturbances. This is necessary because as the percentage of generation from DER increases, there is a greater risk power system faults will cause many or all DER to trip, triggering a substantial load-generation imbalance and possible cascading blackout. This paper demonstrates for the first time a methodology to verify commercial DER devices are compliant to new voltage, frequency, and rate of change of frequency (ROCOF) RT requirements established in IEEE Std. 1547-2018. The methodology incorporates a software automation tool, called the SunSpec System Validation Platform (SVP), in combination with a hardware-in-the-loop (HIL) system to execute the IEEE Std. 1547.1-2020 RT test protocols. In this paper, the approach is validated with two commercial photovoltaic inverters, the test results are analyzed for compliance, and improvements to the test procedure are suggested.

14 SOLAR ENERGY↗

Implementation of Plot File Testing in the DYNA3D/ParaDyn Software Quality Assurance Suite

Automated testing of DYNA3D/ParaDyn plot files was added to the DYNA3D/ParaDyn software quality assurance (SQA) test suite. The new capability extracts select data from the plot files generated during each verification run and compares it to the same baseline answers used to verify the problem. Deviations between baseline answers and plot file values are reported in the same manner as solution discrepancies, and differences in precision levels between the baseline answers and plot file results are accounted for. The new testing leverages the existing SQA test suite framework and test problems and the Python Mili reader and minimally increases the overall run time (< 5%) of the SQA test suite. This new capability provides incremental end-toend testing of the most common DYNA3D/ParaDyn simulation workflows.

42 ENGINEERING↗

Reaction Rover

Reaction Rover is a software application designed to enable reaction optimization with little or no human intervention and to provide a flexible platform to facilitate rapid testing, automation, and implementation of new reaction optimization algorithms. Toward these goals, Reaction Rover is designed to be modular, allowing the optimization algorithm, analyzer, and reactor components to be changed for any given process using easily integrated plugins. The Reaction Rover platform is a key development that enables the testing, use, and automation of machine learning (ML) and non-ML optimizers in a variety of laboratory situations.

Windus, Theresa↗

Design and Implementation of Automated Characterization of T-type based Power Module for PV Inverter Reliability Assessment

Reliability of power electronics holds the key for future power and energy systems since it is essential for system integration with renewables and energy storage systems. Variation of power module characteristics over the converter’s operational lifetime is a critical indicator to assess its reliability. Device characterization consists of different steps to collect, process, and visualize results, which is usually time-consuming, especially for power modules based on a non-phase-leg configuration, such as T-type circuits, widely applied for PV inverters. To reduce the time, ensure repeatability, and guarantee consistency, an automated test bench can be helpful. This paper focuses on a T-type-based power module and proposes a unique characterization platform and corresponding automation procedure and implementation. Considering the major characterization difference between T-type power modules over the conventional phase-leg power module, first, the special consideration for static characterization is highlighted. Second, the unique dynamic characterization design associated with the T-type power module is described. Finally, the automation of the power module characterization and the test platform is presented along with results and special considerations.

Siraj, Ahmed↗

UQpy v4.1: Uncertainty quantification with Python

This paper presents the latest improvements introduced in Version 4 of the UQpy, Uncertainty Quantification with Python, library. In the latest version, the code was restructured to conform with the latest Python coding conventions, refactored to simplify previous tightly coupled features, and improve its extensibility and modularity. To improve the robustness of UQpy, software engineering best practices were adopted. A new software development workflow significantly improved collaboration between team members, and continuous integration and automated testing ensured the robustness and reliability of software performance. Continuous deployment of UQpy allowed its automated packaging and distribution in system agnostic format via multiple channels, while a Docker image enables the use of the toolbox regardless of operating system limitations.

97 MATHEMATICS AND COMPUTING↗

Development and Implementation of a CTF Code Verification Suite.

CTF is a thermal hydraulic subchannel code developed to predict light water reactor (LWR) core behavior. It is a version of Coolant Boiling in Rod Arrays (COBRA) developed by Oak Ridge National Laboratory (ORNL) and North Carolina State University (NCSU) and used in the Consortium for the Advanced Simulation of LWRs (CASL). Here, the existing CTF code verification matrix is expanded, which ensures that the code is a faithful representation of the underlying mathematical model. The suite of code verification tests are mapped to the underlying conservation equations of CTF and significant gaps are addressed. As such, five new problems are incorporated: isokinetic advection, conduction, pressure drop, convection, and pipe boiling. Convergence behavior and numerical errors are quantified for each of the tests and all tests converge at the correct rate to their corresponding analytic solution. A new verification utility that generalizes the code verification process is used to incorporate these problems into the CTF automated test suite.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Persistent Elevated Soot Emissions Induced by Clustered Stochastic Preignition Events

Stochastic Preignition (SPI) is an abnormal combustion phenomenon that can occur in spark-ignition engines particularly under high-load operation. SPI is characterized by uncontrolled initiation of combustion prior to spark discharge, an abnormal combustion process that can lead to severe knock events and significant engine damage. SPI has been associated with fuel properties, lubricant composition, and engine design and operation. Here, in this work, a single-cylinder test engine with a dry-sump oil system was utilized to study the SPI response of E10 and E25 fuels with a range of Reid Vapor Pressure (RVP). An automated test procedure was employed, consisting of ten square-waved load profile segments, with each segment composed of 5 min of low-load operation followed by 25 min of sustained high-load operation. These tests were replicated across multiple days of testing including a lubricant triple flush between tests, and an online Fuel in Oil diagnostic measurement. Exhaust particulate emissions were continuously measured by an AVL microsoot sensor (MSS). Elevated particulate matter emissions were observed to occur concurrently with SPI events as blooms of soot. Particularly after clustered events (i.e., multiple SPI cycles occurring within 10 consecutive engine cycles), high soot emissions were observed to persist over several days of sequential operation despite daily lubricant changes, a complete warm-up procedure, and sustained low-load operation between test segments. This result implies that the particulate emissions trends may be dominated by deposit-based effects, where higher load operation is needed to alter deposition and formation processes. The observed soot blooms were also found to correspond to a reduction in the engine fueling and the fuel engine oil dilution rate despite the engine exhaust remaining at stoichiometric exhaust operation. These observations suggest that post-SPI events, pathways for lubricant migration and consumption into the combustion chamber may occur until these pathways are closed from deposit formation or ring dynamics during extended operation. These observed sooting propensity persisted with all fuels tests, but a linear correlation was observed between the summation of soot and particulate matter index (PMI) value for each fuel as well as SPI events, proving that PMI is a crucial fuel property for reducing SPI.

Splitter, Derek [Oak Ridge National Laboratory (OR↗

Controller Verification of a Smart-Grid Compatible 200 kHz Single-stage Photovoltaic Microinverter

This paper presents control system design, implementation, and experimental validation of a single-stage 400 W, 200 kHz solar photovoltaic (PV) microinverter using hardware-in-the-loop (HIL) and hardware testing. The selected circuit topology is based on a Gallium Nitride (GaN) direct-matrix based dual active bridge (DAB) converter with a low voltage active power decoupler (APD) circuit. Control performance is verified, smart-grid compatibility is tested, and circuit operation is confirmed. Controller HIL (CHIL) is shown to aid in a complex power electronics system design by 1) enabling detailed control development prior to hardware implementation, 2) expanding the use of automated testing, and 3) increasing confidence in control performance prior to prototype testing. Altogether, these factors make HIL a valuable tool in complex power electronic designs.

14 SOLAR ENERGY↗

Seascape Interface Control Document (V.1)

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source codes, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

Seascape Interface Control Document (V. 2)

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source codes, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

Seascape Interface Control Document

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source software, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

Update to the Microcontroller Benchmark for Radiation Testing

LANL developed a benchmark of software code for radiation testing of microprocessors several years ago, and it was published under an open-source license on GitHub. Publishing the software is necessary for other researchers to adopt and implement this benchmark for radiation testing of other microprocessors to standardize test practices so that test data can be compared across different microprocessors. The original codes have been used several times by other organizations to test a wide range of microcontrollers and microprocessors. After several years of research, LANL is ready to update the benchmark. Changes include: 1. Addition of new codes that allow common software codes to be tested, 2. Addition of new codes that instrument more microprocessor circuitry, 3. Addition of input patterns that allow for a more compressive understanding of how the memory layout affects the sensitivity to radiation-induced faults and better use of automated test pattern generation standards, and 4. Modification of current codes for faster and more resilient detection, reporting and correction of radiation-induced faults. These codes have been tested by LANL researchers over the last few years, which has been published in the open literature. As the code base for the new benchmarks are stable, it is time to release the update to the GitHub repository, where the original codes were released.

Quinn, Heather↗