Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

SU-E-T-143: Automatic PBS Treatment Planning for Prostate Cancer

Purpose: This study presents a novel idea of using automated planning technique for parallel-opposed prostate plans with pencil beam scanning proton therapy. Methods: A random 5 clinical prostate patients treated with parallel-opposed modulated-scanning proton beam in our proton center were selected in this study. All of the 5 cases were re-planned with in-house developed python scripts integrated into RayStation 4.0 clinical version. This automatic tool was designed to perform patient DICOM data import, external structure contours, CT density assignment, prescription to PTV assignment, beam placement, optimization, and dose calculation. Results: The mean time to generate a complete treatment plan was 1 minute per plan. For the automatically generated plans, 5 out of 5 plans (100%) were deemed clinically acceptable by one experienced radiation oncologist. In addition, the automated plans were overall dosimetrically equivalent to the clinical plans when scored for target coverage, rectum and bladder dose. Mann-Whitney U tests did not show significant dosimetric differences for normal tissue structures between the clinical and automated plans. Conclusion: We have developed a robust and automated method for fully inversed planned paralleled-opposed prostate proton treatment planning. This efficient method can be readily integrated into clinical practice. The tool produces clinically acceptable plans using only manually contoured anatomic structures and simulation CT data set. We anticipate that this tool will not only improve patient access to high-quality proton treatment by simplifying the planning process and will also reduce the effort and cost of incorporating more advanced planning into clinical practice in the near future.

60 APPLIED LIFE SCIENCES↗

Testing of ENDF71x: A new ACE-formatted neutron data library based on ENDF/B-VII.1

The ENDF71x library [1] is the most thoroughly tested set of ACE-format data tables ever released by the Nuclear Data Team at Los Alamos National Laboratory (LANL). It is based on ENDF/B-VII. 1, the most recently released set of evaluated nuclear data files produced by the US Cross Section Evaluation Working Group (CSEWG). A variety of techniques were used to test and verify the ENDF7 1x library before its public release. These include the use of automated checking codes written by members of the Nuclear Data Team, visual inspections of key neutron data, MCNP6 calculations designed to test data for every included combination of isotope and temperature as comprehensively as possible, and direct comparisons between ENDF71x and previous ACE library releases. Visual inspection of some of the most important neutron data revealed energy balance problems and unphysical discontinuities in the cross sections for some nuclides. Doppler broadening of the total cross sections with increasing temperature was found to be qualitatively correct. Test calculations performed using MCNP prompted two modifications to the MCNP6 source code and also exposed bad secondary neutron yields for {sup 231,233}Pa that are present in both ENDF/B-VII.1 and ENDF/B-VII.0. A comparison of ENDF71x with its predecessor ACE library, ENDF70, showed that dramatic changes have been made in the neutron cross section data for a number of isotopes between ENDF/B-VII.0 and ENDF/B-VII.1. Based on the results of these verification tests and the validation tests performed by Kahler, et al. [2], the ENDF71x library is recommended for use in all Monte Carlo applications. (authors)

97 MATHEMATICS AND COMPUTING↗

Testing, Requirements, and Metrics

The criticality of correct, complete, testable requirements is a fundamental tenet of software engineering. Also critical is complete requirements based testing of the final product. Modern tools for managing requirements allow new metrics to be used in support of both of these critical processes. Using these tools, potential problems with the quality of the requirements and the test plan can be identified early in the life cycle. Some of these quality factors include: ambiguous or incomplete requirements, poorly designed requirements databases, excessive or insufficient test cases, and incomplete linkage of tests to requirements. This paper discusses how metrics can be used to evaluate the quality of the requirements and test to avoid problems later. Requirements management and requirements based testing have always been critical in the implementation of high quality software systems. Recently, automated tools have become available to support requirements management. At NASA's Goddard Space Flight Center (GSFC), automated requirements management tools are being used on several large projects. The use of these tools opens the door to innovative uses of metrics in characterizing test plan quality and assessing overall testing risks. In support of these projects, the Software Assurance Technology Center (SATC) is working to develop and apply a metrics program that utilizes the information now available through the application of requirements management tools. Metrics based on this information provides real-time insight into the testing of requirements and these metrics assist the Project Quality Office in its testing oversight role. This paper discusses three facets of the SATC's efforts to evaluate the quality of the requirements and test plan early in the life cycle, thus preventing costly errors and time delays later.

Rosenberg, Linda↗

An Imaging System for Satellite Hypervelocity Impact Debris Characterization

This paper discusses the design of an automated imaging system for size characterization of debris produced by the DebriSat hypervelocity impact test. The goal of the DebriSat project is to update satellite breakup models. A representative LEO satellite, DebriSat, was constructed and subjected to a hypervelocity impact test. The impact produced an estimated 85,000 debris fragments. The size distribution of these fragments is required to update the current satellite breakup models. An automated imaging system was developed for the size characterization of the debris fragments. The system uses images taken from various azimuth and elevation angles around the object to produce a 3D representation of the fragment via a space carving algorithm. The system consists of N point-and-shoot cameras attached to a rigid support structure that defines the elevation angle for each camera. The debris fragment is placed on a turntable that is incrementally rotated to desired azimuth angles. The number of images acquired can be varied based on the desired resolution. Appropriate background and lighting is used for ease of object detection. The system calibration and image acquisition process are automated to result in push-button operations. However, for quality assurance reasons, the system is semi-autonomous by design to ensure operator involvement. This paper describes the imaging system setup, calibration procedure, repeatability analysis, and the results of the debris characterization.

Moraguez, Matthew↗

Research Prototype: Automated Analysis of Scientific and Engineering Semantics

Physical and mathematical formulae and concepts are fundamental elements of scientific and engineering software. These classical equations and methods are time tested, universally accepted, and relatively unambiguous. The existence of this classical ontology suggests an ideal problem for automated comprehension. This problem is further motivated by the pervasive use of scientific code and high code development costs. To investigate code comprehension in this classical knowledge domain, a research prototype has been developed. The prototype incorporates scientific domain knowledge to recognize code properties (including units, physical, and mathematical quantity). Also, the procedure implements programming language semantics to propagate these properties through the code. This prototype's ability to elucidate code and detect errors will be demonstrated with state of the art scientific codes.

Stewart, Mark E. M.↗

Rockwell Automation PLC-5 Lands Stennis Space Center with a Reliable, Flexible Control System

Ever since the first rocket was launched, people have been infatuated with the vast and unchartered frontier of space. Whether it's visiting a space center or watching a shuttle launch, people are waiting to see what will be discovered next. And even though orbiting the Earth or taking soil samples form the Moon now seems effortless, decades worth of behind-the-scenes work have helped the U.S. space program get to this point. Even today, NASA must take every precaution to ensure equipment is up to the endeavor of setting foot on the moon. As part of the initial push to put the first man on the moon, NASA established the John C. Stennis Space Center, Hancock County, Mississippi in 1961 for space engine propulsion system development. Today, Stennis has three major test complexes where engine and component testing is carried out and integrated into full motion systems for space shuttles and vehicles as well as secondary testing facilities. With different products being tested throughout the facilities, Stennis was in need of an automation system that could link the operations. By integrating a control system based on a Rockwell Automation's flexible and reliable PLC-5 controller, Stennis was able to implement projects more efficiently and focus its efforts on getting the next generation of products ready for space.

Epperson, Dave↗

Automated objective characterization of visual field defects in 3D

A method and apparatus for electronically performing a visual field test for a patient. A visual field test pattern is displayed to the patient on an electronic display device and the patient's responses to the visual field test pattern are recorded. A visual field representation is generated from the patient's responses. The visual field representation is then used as an input into a variety of automated diagnostic processes. In one process, the visual field representation is used to generate a statistical description of the rapidity of change of a patient's visual field at the boundary of a visual field defect. In another process, the area of a visual field defect is calculated using the visual field representation. In another process, the visual field representation is used to generate a statistical description of the volume of a patient's visual field defect.

Fink, Wolfgang↗

Cockpit Adaptive Automation and Pilot Performance

The introduction of high-level automated systems in the aircraft cockpit has provided several benefits, e.g., new capabilities, enhanced operational efficiency, and reduced crew workload. At the same time, conventional 'static' automation has sometimes degraded human operator monitoring performance, increased workload, and reduced situation awareness. Adaptive automation represents an alternative to static automation. In this approach, task allocation between human operators and computer systems is flexible and context-dependent rather than static. Adaptive automation, or adaptive task allocation, is thought to provide for regulation of operator workload and performance, while preserving the benefits of static automation. In previous research we have reported beneficial effects of adaptive automation on the performance of both pilots and non-pilots of flight-related tasks. For adaptive systems to be viable, however, such benefits need to be examined jointly in the context of a single set of tasks. The studies carried out under this project evaluated a systematic method for combining different forms of adaptive automation. A model for effective combination of different forms of adaptive automation, based on matching adaptation to operator workload was proposed and tested. The model was evaluated in studies using IFR-rated pilots flying a general-aviation simulator. Performance, subjective, and physiological (heart rate variability, eye scan-paths) measures of workload were recorded. The studies compared workload-based adaptation to to non-adaptive control conditions and found evidence for systematic benefits of adaptive automation. The research provides an empirical basis for evaluating the effectiveness of adaptive automation in the cockpit. The results contribute to the development of design principles and guidelines for the implementation of adaptive automation in the cockpit, particularly in general aviation, and in other human-machine systems. Project goals were met or exceeded. The results of the research extended knowledge of automation-related performance decrements in pilots and demonstrated the positive effects of adaptive task allocation. In addition, several practical implications for cockpit automation design were drawn from the research conducted. A total of 12 articles deriving from the project were published.

Parasuraman, Raja↗

Induction Bonding of Prepreg Tape and Titanium Foil

Hybrid structural laminates made of titanium foil and carbon fiber reinforced polymer composite offer a potential for improved performance in aircraft structural applications. To obtain information needed for the automated fabrication of hybrid laminates, a series of bench scale tests were conducted of the magnetic induction bonding of titanium foil and thermoplastic prepreg tape. Foil and prepreg specimens were placed in the gap of a toroid magnet mounted in a bench press. Several magnet power supplies were used to study power at levels from 0.5 to 1.75 kW and frequencies from 50 to 120 kHz. Sol-gel surface-treated titanium foil, 0.0125 cm thick, and PIXA/IM7 prepreg tape were used in several lay-up configurations. Data were obtained on wedge peel bond strength, heating rate, and temperature ramp over a range of magnet power levels and frequencies at different "power-on" times for several magnet gap dimensions. These data will be utilized in assessing the potential for automated processing. Peel strengths of foil-tape bonds depended on the maximum temperature reached during heating and on the applied pressure. Maximum peel strengths were achieved at 1.25kW and 8OkHz. Induction heating of the foil appears to be capable of good bonding up to 10 plies of tape. Heat transfer calculations indicate that a 20-40 C temperature difference exists across the tape thickness during heat-up.

Messier, Bernadette C.↗

Deployable reflector antenna performance optimization using automated surface correction and array-feed compensation

Methods for increasing the electromagnetic (EM) performance of reflectors with rough surfaces were tested and evaluated. First, one quadrant of the 15-meter hoop-column antenna was retrofitted with computer-driven and controlled motors to allow automated adjustment of the reflector surface. The surface errors, measured with metric photogrammetry, were used in a previously verified computer code to calculate control motor adjustments. With this system, a rough antenna surface (rms of approximately 0.180 inch) was corrected in two iterations to approximately the structural surface smoothness limit of 0.060 inch rms. The antenna pattern and gain improved significantly as a result of these surface adjustments. The EM performance was evaluated with a computer program for distorted reflector antennas which had been previously verified with experimental data. Next, the effects of the surface distortions were compensated for in computer simulations by superimposing excitation from an array feed to maximize antenna performance relative to an undistorted reflector. Results showed that a 61-element array could produce EM performance improvements equal to surface adjustments. When both mechanical surface adjustment and feed compensation techniques were applied, the equivalent operating frequency increased from approximately 6 to 18 GHz.

Schroeder, Lyle C.↗

Pilot and Controller Evaluations of Separation Function Allocation in Air Traffic Management

Two human-in-the-loop simulation experiments were conducted in coordinated fashion to investigate the allocation of separation assurance functions between ground and air and between humans and automation. The experiments modeled a mixed-operations concept in which aircraft receiving ground-based separation services shared the airspace with aircraft providing their own separation service (i.e., self-separation). Ground-based separation was provided by air traffic controllers without automation tools, with tools, or by ground-based automation with controllers in a managing role. Airborne self-separation was provided by airline pilots using self-separation automation enabled by airborne surveillance technology. The two experiments, one pilot-focused and the other controller-focused, addressed selected key issues of mixed operations, assuming the starting point of current-day operations and modeling an emergence of NextGen technologies and procedures. In the controller-focused experiment, the impact of mixed operations on controller performance was assessed at four stages of NextGen implementation. In the pilot-focused experiment, the limits to which pilots with automation tools could take full responsibility for separation from ground-controlled aircraft were tested. Results indicate that the presence of self-separating aircraft had little impact on the controllers' ability to provide separation services for ground-controlled aircraft. Overall performance was best in the most automated environment in which all aircraft were data communications equipped, ground-based separation was highly automated, and self-separating aircraft had access to trajectory intent information for all aircraft. In this environment, safe, efficient, and highly acceptable operations could be achieved for twice today's peak airspace throughput. In less automated environments, reduced trajectory intent exchange and manual air traffic control limited the safely achievable airspace throughput and negatively impacted the maneuver efficiency of self-separating aircraft through high-density airspace. In a test of scripted conflicts with ground-managed aircraft, flight crews of self-separating aircraft prevented separation loss in all conflicts with detection time greater than one minute. In debrief, pilots indicated a preference for at least five minute's alerting notice and trajectory intent information on all aircraft. When intent information on ground-managed aircraft was available, self-separating aircraft benefited from fewer conflict alerts and fewer required deviations from trajectory-based operations.

Wing, David↗

Assessment of Flow-Enhanced Electrochemical Sensor Testing and Deployments for MSRs

This report serves as the deliverable for Milestone M3RS-23AN0401061 that is part of Work Package RS-23AN040106 (Flow Enhanced Sensors for MSRs – ANL). The goal of this milestone was to determine performance of the flow enhanced electrochemical sensor (FEES) and modular flow instrumentation testbed (MFIT) in safeguards relevant scenarios. Flow enhanced electrochemical sensors are a type of electroanalytical sensor that has been developed at Argonne National Laboratory to be installed directly into MSR flow conduits to make measurements of the salt composition. These sensors represent a significant improvement in capabilities compared to earlier electroanalytical sensors that instead can only be operated in quiescent conditions. Previous work has focused on testing of the FEES in flowing conditions provided by the MFIT to assess the accuracy and precision of the sensor measurements. To further improve this capability, in FY23 we undertook a campaign of safeguards relevant scenarios in molten salt containing a range of uranium chloride concentrations (0 to 3 wt%). All the testing carried out in FY23 was aided by a control system designed to automatically actuate flow conditions and collect data. This new automation system is estimated to have increased experimental throughput by a factor of four and enabled testing in a variety of complex conditions. The advancements in throughput and repeatability led to improved quantification of actinide concentrations using the in-flow sensors, with a reduction of the mean absolute relative error from 5.6% in FY22 to 3.1% in FY23. In addition to safeguards scenarios run in the MFIT, FY23 work included deployment of a FEES at a partner institution where it will be tested in a flowing salt loop. The FEES was successfully integrated into that loop and is being tested prior to loop startup. In FY23, work also continued on the smaller flow system that we have named the mini-MFIT. This smaller system is capable of rapid prototyping of new sensor designs prior to installation in the larger MFIT radiological flow system. Work was carried out to test this new system in non-radiological molten salts in a separate glovebox. This work is helping us to enhance the accuracy of our salt monitoring capabilities through the integration of multiple types of sensors. The high degree of accuracy required by 10 CFR 74 represents a significant challenge, and further design evolution and integration of the sensors into multimodal sensing frameworks will be needed to further push the measurement accuracy to the needed level.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A wide variety of injection molding technologies is now applicable to small series and mass production

Micro plastic parts open new fields for application, e. g., to electronics, sensor technologies, optics, and medical engineering. Before micro parts can go to mass production, there is a strong need of having the possibility for testing different designs and materials including material combinations. Hence, flexible individual technical and technological solutions for processing are necessary. To manufacture high quality micro parts, a micro injection moulding machine named formicaPlast based on a two-step plunger injection technology was developed. Resulting from its design, the residence time and the accuracy problems for managing small shot volumes with reproducible high accuracy are uncompromisingly solved. Due to their simple geometry possessing smooth transitions and non adherent inner surfaces, the plunger units allow to process 'all' thermoplastics from polyolefines to high performance polymers, optical clear polymers, thermally sensitive bioresorbables, highly filled systems (the so-called powder injection molding PIM), and liquid silicon rubber (LSR, here with a special kit). The applied platform strategy in the 1K and 2K version allows integrating automation for assembling, handling and packaging. A perpendicular arrangement allows encapsulation of inserts, also partially, and integration of this machine into process chains. Considering a wide variety of different parts consisting of different materials, the high potential of the technology is demonstrated. Based on challenging industrial parts from electronic applications (2K micro MID and bump mat, where both are highly structured parts), the technological solutions are presented in more detail.

36 MATERIALS SCIENCE↗

Implementation of a state of the art automated system for the production of cloud/water vapor motion winds from geostationary satellites

The research objectives in this proposal were part of a continuing program at UW-CIMSS to develop and refine an automated geostationary satellite winds processing system which can be utilized in both research and operational environments. The majority of the originally proposed tasks were successfully accomplished, and in some cases the progress exceeded the original goals. Much of the research and development supported by this grant resulted in upgrades and modifications to the existing automated satellite winds tracking algorithm. These modifications were put to the test through case study demonstrations and numerical model impact studies. After being successfully demonstrated, the modifications and upgrades were implemented into the NESDIS algorithms in Washington DC, and have become part of the operational support. A major focus of the research supported under this grant attended to the continued development of water vapor tracked winds from geostationary observations. The fully automated UW-CIMSS tracking algorithm has been tuned to provide complete upper-tropospheric coverage from this data source, with data set quality close to that of operational cloud motion winds. Multispectral water vapor observations were collected and processed from several different geostationary satellites. The tracking and quality control algorithms were tuned and refined based on ground-truth comparisons and case studies involving impact on numerical model analyses and forecasts. The results have shown the water vapor motion winds are of good quality, complement the cloud motion wind data, and can have a positive impact in NWP on many meteorological scales.

Velden, Christopher↗

Results From F-18B Stability and Control Parameter Estimation Flight Tests at High Dynamic Pressures

A maximum-likelihood output-error parameter estimation technique has been used to obtain stability and control derivatives for the NASA F-18B Systems Research Aircraft. This work has been performed to support flight testing of the active aeroelastic wing (AAW) F-18A project. The goal of this research is to obtain baseline F-18 stability and control derivatives that will form the foundation of the aerodynamic model for the AAW aircraft configuration. Flight data have been obtained at Mach numbers between 0.85 and 1.30 and at dynamic pressures ranging between 600 and 1500 lbf/sq ft. At each test condition, longitudinal and lateral-directional doublets have been performed using an automated onboard excitation system. The doublet maneuver consists of a series of single-surface inputs so that individual control-surface motions cannot be correlated with other control-surface motions. Flight test results have shown that several stability and control derivatives are significantly different than prescribed by the F-18B aerodynamic model. This report defines the parameter estimation technique used, presents stability and control derivative results, compares the results with predictions based on the current F-18B aerodynamic model, and shows improvements to the nonlinear simulation using updated derivatives from this research.

Moes, Timothy R.↗

Generating Synthetic Time Series Photovoltaic Data with Real-World Physical Challenges and Noise for Use in Algorithm Test and Validation

The PV Fleet Data Initiative and other projects seek the develop algorithms for automated analysis of PV time series data for extraction of statistical information and other parameters of the data such as degradation rates, soiling loss information, tracker performance, clipping or curtailment, system availability and other valuable information. While there is a vast body of PV data available for application of said extraction algorithms it is difficult to validate these algorithms because the true parameters to be extracted are not known. There has been a wide use of synthetic data in the literature for algorithm validation but this synthetic data is typically very bounded by the problem or topic at hand. The PV Fleet Data Initiative project has demonstrated that real time series PV data almost always includes a host of data quality and physical problems that, in reality, any automated PV abstraction algorithm must handle appropriately. For this reason, this work describes the development of a complex synthetic PV times series data set that includes data quality and physical problems that have been experienced in real world PV data. The various quality and physical problems are documented in the synthetic data so that users can test the validity of various PV extraction algorithms as well as develop new algorithms to solve problems this data set can support.

14 SOLAR ENERGY↗

Design, fabrication and test of prototype furnace for continuous growth of wide silicon ribbon

A program having the overall objective of growing wide, thin silicon dendritic web crystals quasi-continuously from a semi-automated facility is discussed. The design considerations and fabrication of the facility as well as the test and operation phase are covered; detailed engineering drawings are included as an appendix. During the test and operation phase of the program, more than eighty growth runs and numerous thermal test runs were performed. At the conclusion of the program, 2.4 cm wide web was being grown at thicknesses of 100 to 300 micrometers. As expected, the thickness and growth rate are closely related. Solar cells made from this material were tested at NASA-Lewis and found to have conversion efficiencies comparable to devices fabricated from Czochralski material.

Duncan, C. S.↗

BRAINSTACK – A Platform for Artificial Intelligence & Machine Learning Collaborative Experiments on a Nano-Satellite

As the space economy continues to expand through increasingly easy access to advanced and inexpensive technology, space missions themselves have become more ambitious with exploration targets growing ever distant while simultaneously requiring larger guidance and communication budgets. These conflicting desires of distance and control drive the need for advanced on-board intelligent decision making to reduce communication and control limitations by automating as many mission functions as possible in-situ. While the amount of research on such Artificial Intelligence and Machine Learning (AI/ML) software modules has grown exponentially, the capacity to experimentally validate such software modules in space in a rapid and inexpensive format has not. To this end, the Nano Orbital Workshop (NOW) group at NASA Ames Research Center has been at the forefront of performing initial flight evaluation tests of ‘commercially’ available bleeding-edge computational platforms via what is programmatically referred to as the BrainStack on the TechEdSat (TES-n) flight series. This on-orbit computational platform provides an evaluation laboratory where advanced software experiments are pre-loaded into memory prior to launch, then executed as payloads during mission operations with results reported back and program tweaks or new training sets uploaded as needed. Processors selected as part of the BrainStack are of ideal size, packaging, and power consumption for easy integration into a cube satellite structure. These experiments have included the evaluation of small, high-performance GPUs and, more recently, neuromorphic processors, in LEO operations. Neuromorphic processors are of particular interest due to their superior power efficiency over GPUs in intelligent automation applications. The first TES-n flight test of an Intel first-generation Loihi neuromorphic processor launched on TES-13, January 13, 2022, and continues to operate in orbit despite no significant modifications to harden the processor against the space environment. The Intel Loihi Gen-1 on TES-13 is characterized by a 14nm 128-core Spiking Neural Network (SNN) able to support on-chip training. The processor is packaged in the Kapoho Bay USB module, providing a relatively straight-forward interface to the bus avionics system. The Kapoho Bay was in turn managed by an Intel Pentium single-board computer to handle scheduling of the software application payloads and communications with the satellite’s primary computer. The recently released Intel Loihi Gen-2, able to support integer-valued spike payloads and produced using 7nm process, will form part of the continually evolving BrainStack in the upcoming three TES-n/NOW flights. The Kapoho Point unit will incorporate eight Loihi-2 processors, enabling neural networks of up to one million neurons and one billion synapsis. Additionally, it is planned to measure the radiation environment these processors experience to understand any degradation or computational artifacts caused by long term space radiation exposure on these novel architectures. This evolving flexible and collaborative environment involving various research teams across NASA and other organizations is intended to be a convenient orbital test platform from which many anticipated future space automation applications may be initially tested.

Artificial Intelligence↗