Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Design and test experience with a triply redundant digital fly-by-wire control system

A triplex digital fly-by-wire flight control system was developed and then installed in a NASA F-8C aircraft to provide fail-operative, full authority control. Hardware and software redundancy management techniques were designed to detect and identify failures in the system. Control functions typical of those projected for future actively controlled vehicles were implemented. This paper describes the principal design features of the system, the implementation of computer, sensor, and actuator redundancy management, and the ground test results. An automated test program to verify sensor redundancy management software is also described.

Szalai, K. J.↗

Study of solar cell welds

The thermal imaging technique was evaluated for its capabilities in the nondestructive evaluation of solar cell welds. The temperature and spatial resolution of state of the art instrumentation was sufficient for both qualitative and quantitative determination of the quality of solar cell welds. The addition of color digitized thermography enhanced the aspects of the thermographic display and allowed easily computerized testing procedures. For automated testing systems an accurate correlation of weld quality with temperature profiles of the welds needs to be performed. In comparison, the holographic technique was complementary with the thermal imaging technique, except that the holographic analysis appeared to be more quantitative at the present time. However, the thermal imaging approach is much more versatile in overall capabilities.

Workman, G. L.↗

Accelerated and real-time geosynchronous life cycling test performance of nickel-hydrogen batteries

RCA Astro-Electronics currently has four nickel-hydrogen storage battery modules (11 cells each) on test in simulated geosynchronous life cycle regimes. These battery modules are of identical design to those used on the GSTAR (GTE Satellite Corp.) and Spacenet (GTE Spacenet Corp.) communications satellites. The batteries are being tested using an automated test station equipped with computer-controlled environmental chambers and recording equipment. The two battery types, 30 ampere-hours and 40 ampere-hours (GSTAR and Spacenet, respectively), are being electrically cycled using identical 44-day eclipse sequences at 5 C and vary with respect to depth of discharge, recharge ratio, duration of accumulated suntime, and the use of a reconditioning sequence. The test parameters are outlined and the preliminary test data and results are presented.

Green, R. S.↗

Experiments with Test Case Generation and Runtime Analysis

Software testing is typically an ad hoc process where human testers manually write many test inputs and expected test results, perhaps automating their execution in a regression suite. This process is cumbersome and costly. This paper reports preliminary results on an approach to further automate this process. The approach consists of combining automated test case generation based on systematically exploring the program's input domain, with runtime analysis, where execution traces are monitored and verified against temporal logic specifications, or analyzed using advanced algorithms for detecting concurrency errors such as data races and deadlocks. The approach suggests to generate specifications dynamically per input instance rather than statically once-and-for-all. The paper describes experiments with variants of this approach in the context of two examples, a planetary rover controller and a space craft fault protection system.

Artho, Cyrille↗

Digital Image Correlation for Performance Monitoring

Evaluating the health of a mechanism requires more than just a binary evaluation of whether an operation was completed. It requires analyzing more comprehensive, full-field data. Health monitoring is a process of non-destructively identifying characteristics that indicate the fitness of an engineered component. In order to monitor unit health in a production setting, an automated test system must be created to capture the motion of mechanism parts in a real-time and non-intrusive manner. One way to accomplish this is by using high-speed video and Digital Image Correlation (DIC). In this approach, individual frames of the video are analyzed to track the motion of mechanism components. The derived performance metrics allow for state-of-health monitoring and improved fidelity of mechanism modeling. The results are in-situ state-of-health identification and performance prediction. This paper introduces basic concepts of this test method, and discusses two main themes: the use of laser marking to add fiducial patterns to mechanism components, and new software developed to track objects with complex shapes, even as they move behind obstructions. Finally, the implementation of these tests into an automated tester is discussed.

Palaviccini, Miguel↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

Verification Test of Automated Robotic Assembly of Space Truss Structures

A multidisciplinary program has been conducted at the Langley Research Center to develop operational procedures for supervised autonomous assembly of truss structures suitable for large-aperture antennas. The hardware and operations required to assemble a 102-member tetrahedral truss and attach 12 hexagonal panels were developed and evaluated. A brute-force automation approach was used to develop baseline assembly hardware and software techniques. However, as the system matured and operations were proven, upgrades were incorporated and assessed against the baseline test results. These upgrades included the use of distributed microprocessors to control dedicated end-effector operations, machine vision guidance for strut installation, and the use of an expert system-based executive-control program. This paper summarizes the developmental phases of the program, the results of several assembly tests, and a series of proposed enhancements. No problems that would preclude automated in-space assembly or truss structures have been encountered. The test system was developed at a breadboard level and continued development at an enhanced level is warranted.

Rhodes, Marvin D.↗

Test & Measurement System Security in an IT World

Automated test and measurement systems are coming under increased cybersecurity scrutiny. Most of these systems fall under the “Operational Technology” designation, as defined by NIST, and often have unique requirements that conflict with enterprise security policy. These systems are typically not well understood by traditional enterprise IT personnel, which leaves them ill-supported or invalidated.▪This presentation attempts to help Test System owners recognize the security landscape, determine their unique system requirements and concerns, and negotiate a peer-level working arrangement with an existing IT department while maintaining a NIST-recommended level of autonomy and sovereignty.

automated test↗

From an automated flight-test management system to a flight-test engineer's workstation

The capabilities and evolution is described of a flight engineer's workstation (called TEST-PLAN) from an automated flight test management system. The concept and capabilities of the automated flight test management systems are explored and discussed to illustrate the value of advanced system prototyping and evolutionary software development.

Duke, E. L.↗

Railroad Valley Radiometric Calibration Test Site (RadCaTS) as Part of a Global Radiometric Calibration Network (RadCalNet)

The Radiometric Calibration Network (RadCalNet) is a coordinated multinational effort to provide in situ data that are suitable for the radiometric calibration and validation of Earth observation sensors that operate in the visible to shortwave infrared solar reflective spectral region (400 nm to 1000 nm). The main goals of RadCalNet are to provide top-of-atmosphere reflectance data to the scientific community, standardize data collection protocols for automated test sites, and to document the SI-traceable uncertainty budgets for each automated test site, of which there are currently four. The data available from RadCalNet are suitable for the calibration and validation of spaceborne imaging spectrometers. The work presented here provides a description of RadCalNet as well as a sample of the current results from the Radiometric Calibration Test Site (RadCaTS), which is located at Railroad Valley, Nevada, USA. Selected sensors for comparison include Terra and Aqua MODIS, SNPP and NOAA-20 VIIRS, and Sentinel-3A and -3B OLCI.

RadCalNet↗

Test Generator for MATLAB Simulations

MATLAB Automated Test Tool, version 3.0 (MATT 3.0) is a software package that provides automated tools that reduce the time needed for extensive testing of simulation models that have been constructed in the MATLAB programming language by use of the Simulink and Real-Time Workshop programs. MATT 3.0 runs on top of the MATLAB engine application-program interface to communicate with the Simulink engine. MATT 3.0 automatically generates source code from the models, generates custom input data for testing both the models and the source code, and generates graphs and other presentations that facilitate comparison of the outputs of the models and the source code for the same input data. Context-sensitive and fully searchable help is provided in HyperText Markup Language (HTML) format.

Henry, Joel↗

Inspection and Verification of Domain Models with PlanWorks and Aver

When developing a domain model, it seems natural to bring the traditional informal tools of inspection and verification, debuggers and automated test suites, to bear upon the problems that will inevitably arise. Debuggers that allow inspection of registers and memory and stepwise execution have been a staple of software development of all sorts from the very beginning. Automated testing has repeatedly proven its considerable worth, to the extent that an entire design philosophy (Test Driven Development) has been developed around the writing of tests. Unfortunately, while not entirely without their uses, the limitations of these tools and the nature of the complexity of models and the underlying planning systems make the diagnosis of certain classes of problems and the verification of their solutions difficult or impossible. Debuggers provide a good local view of executing code, allowing a fine-grained look at algorithms and data. This view is, however, usually only at the level of the current scope in the implementation language, and the data-inspection capabilities of most debuggers usually consist of on-line print statements. More modem graphical debuggers offer a sort of tree view of data structures, but even this is too low-level and is often inappropriate for the kinds of structures created by planning systems. For instance, god or constraint networks are at best awkward when visualized as trees. Any any non-structural link between data structures, as through a lookup table, isn't captured at all. Further, while debuggers have powerful breakpointing facilities that are suitable for finding specific algorithmic errors, they have little use in the diagnosis of modeling errors.

Bedrax-Weiss, Tania↗

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗

Commercial PV Inverter IEEE 1547.1 Ride-Through Assessments Using an Automated PHIL Test Platform

As more countries seek solutions to their de-carbonization targets using renewable energy (RE) technologies, interconnection standards and national grid codes for distributed energy resources (DER) are being updated to support higher penetrations of RE and improve grid stability. Common grid-code revisions mandate DER devices, such as solar inverters and energy storage systems, ride-through (RT) voltage and frequency disturbances. This is necessary because as the percentage of generation from DER increases, there is a greater risk power system faults will cause many or all DER to trip, triggering a substantial load-generation imbalance and possible cascading blackout. This paper demonstrates for the first time a methodology to verify commercial DER devices are compliant to new voltage, frequency, and rate of change of frequency (ROCOF) RT requirements established in IEEE Std. 1547-2018. The methodology incorporates a software automation tool, called the SunSpec System Validation Platform (SVP), in combination with a hardware-in-the-loop (HIL) system to execute the IEEE Std. 1547.1-2020 RT test protocols. In this paper, the approach is validated with two commercial photovoltaic inverters, the test results are analyzed for compliance, and improvements to the test procedure are suggested.

14 SOLAR ENERGY↗

Contact dynamics testing of automated three-point docking mechanism

An evaluation of an OMV docking mechanism, based on an adaptation of the Shuttle Flight Support System Pallet Berthing Mechanism was completed. The mechanism uses automatically actuated motorized latches to engage towel bars on the target satellite. LED sensors establish the towel bar position within the capture envelope and the latch capture commands are issued. Then, locking pawls engage the bar, locking and pre-loading the mechanism. Two series of tests were conducted to test nominal and failure mode captures and to evaluate design parameters such as LED sensor locations, automatic closure algorithms, latch closure velocity, position/velocity entry envelopes, and closure method. The first test series involved single latch testing on the Flat Floor Facility, the 6 DOF Facility, and an analytic simulation model. The intent was to compare results in order to validate the various facilities. Reasonably good agreement was achieved. The second test series repeated the single latch testing on the refurbished 6 DOF Facility to validate the facility modifications. The individual latches were tested under free-drift conditions for functionality and performance. Next, the three-latch configuration underwent parametric testing. Test results validated the improved fidelity of the 6 DOF Facility and verified successful docking at the required entry velocity. The tests determined the 'best' design parameter definitions and concluded that the locking pawls should not lock until all three latches completely close.

Rourke, Kenneth H.↗

Application of quantitative methods for reliability testing of a nuclear power plant digital rod position indication diagnostic system - 391

Obsolescence, aging, reliability, and performance issues are driving nuclear facilities to replace conventional analog Instrumentation and Control (I and C) systems with digital technologies. In addition, the designs of the next generation of nuclear reactors, including Small Modular Reactors (SMRs), will incorporate digital I and C for most, if not all, of their safety and non-safety related functions. As part of an on-going research and development (R and D) effort under the auspices of the U.S. Department of Energy (DOE), Analysis and Measurement Services Corporation (AMS) is developing a platform to provide automated testing of digital I and C systems and create a standard method of evaluation for reliability assessments. This hands-on R and D effort has produced a Software Reliability Tester (SRT), which is a set of software and hardware tools designed to automate the testing of digital I and C systems to measure and quantify how well the systems perform under normal operating conditions and in the presence of faults. Furthermore, the SRT provides the foundation for a practical tool to automate verification and validation (V and V) activities and reduce the amount of testing time of digital I and C systems. When combined with its capabilities of integrating both reliability and fault tolerance quantification, the SRT can be used to ensure that digital I and C implementations are both safe and cost-effective for the nuclear industry. This paper describes the application of the SRT to perform V and V of a new Digital Rod Position Indication (DRPI) diagnostic system. The DRPI diagnostic system is a digital system that monitors the rod address and rod position data bus voltages of typical DRPI systems in nuclear power plants to detect and diagnose faults. For this application, the SRT was configured to exercise the inputs of the DRPI diagnostic system, and test cases were generated for common system faults such as address and data bit errors, bus voltage, and timing problems. These test cases were applied by the SRT hardware as voltage inputs to the DRPI diagnostic system and the outputs were compared to expected values generated by a model of the DRPI diagnostic system. Included in the paper is a description of the overall design of the SRT including the hardware and software architectures. Methodologies for automating test cases are also described. V and V using the SRT demonstrates the benefits of automated testing and qualification to provide a quantitative assessment of reliability and cost effective implementation of digital I and C in existing and next generation nuclear power plants. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗