Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Status of NASA's Earth-to-Orbit Propulsion Technology program

Earth-to-Orbit Propulsion Technology program is considered. The program's three major technical areas include combustion devices, turbomachinery, and controls and monitoring. Directed toward reducing acquisition and operations risk and cost the ETO program is conducted in two serially-performed categories: technology acquisition and technology validation. The former is constituted of studies, tool building, and bench-scale experimentation. The latter involves next-step verification of the acquisition results and findings, usually leading to a test-bed validated technology 'product'.

Escher, W. J. D.↗
NASA NTRS1977

Thermodynamic processes induced by coherent radiation

It is shown by quantum statistics that under certain stated conditions the entropy of coherent radiation is zero and it is still negligible for multimode laser operation. This makes possible gas kinetic processes which, to a small extent, have already been observed or even utilized, but which can be greatly enhanced by an optimized choice of molecular structures and radiation conditions. Radiative cooling of gases is discussed in detail. The conditions for maximum heat withdrawal are derived, and it is proposed that the processes of cooling and relaxation heating can be sufficiently separated in time to achieve certain effects and thermodynamic cycles. One of these is the complete conversion, possible in principle, of coherent radiation into work. This concept is based on a heat pump process followed by heat-to-work conversion, the heat rejected being just equal to that withdrawn by radiation. The conditions for complete conversion turn out to be the same as for maximum heat withdrawal. The feasibility of these processes depends on the degree to which practical conditions can be met, and on the validity of certain assumptions which have to await experimental verification.

Garbuny, M.↗
NASA NTRS1986

Space Telescope precision pointing control system

The Hubble Space Telescope has the most stringent pointing requirements imposed on any spacecraft to date. The overall HST stability shall not exceed 0.007 arc-seconds rms. The Pointing Control System utilizes fine guidance sensors and rate gyros for attitude reference and rate information. Control torques are provided by reaction wheels. A digital computer collects the sensor data, performs the control law computations, and sends torque commands to the reaction wheels. To attain this precision pointing, improvements were made to the rate gyros to lower their noise characteristics and to the reaction wheels to reduce their emitted vibration levels. The control system design was validated in a test sequence which progressed from model verification tests on an air-bearing to operations-oriented, closed loop testing on the assembled vehicle. A test system is described which allowed the simultaneous production of test case command loads for the flight computer and plots of predicted profiles to assist in test data analysis. Workarounds were required during system test to accommodate gyro biases and noise introduced into the closed loop system. Testing and analysis indicate that the HST will provide the capability to meet the requirements for precision pointing.

Beals, G. A.↗
NASA NTRS2011

Telemetry and Science Data Software System

The Telemetry and Science Data Software System (TSDSS) was designed to validate the operational health of a spacecraft, ease test verification, assist in debugging system anomalies, and provide trending data and advanced science analysis. In doing so, the system parses, processes, and organizes raw data from the Aquarius instrument both on the ground and while in space. In addition, it provides a user-friendly telemetry viewer, and an instant pushbutton test report generator. Existing ground data systems can parse and provide simple data processing, but have limitations in advanced science analysis and instant report generation. The TSDSS functions as an offline data analysis system during I&T (integration and test) and mission operations phases. After raw data are downloaded from an instrument, TSDSS ingests the data files, parses, converts telemetry to engineering units, and applies advanced algorithms to produce science level 0, 1, and 2 data products. Meanwhile, it automatically schedules upload of the raw data to a remote server and archives all intermediate and final values in a MySQL database in time order. All data saved in the system can be straightforwardly retrieved, exported, and migrated. Using TSDSS s interactive data visualization tool, a user can conveniently choose any combination and mathematical computation of interesting telemetry points from a large range of time periods (life cycle of mission ground data and mission operations testing), and display a graphical and statistical view of the data. With this graphical user interface (GUI), the data queried graphs can be exported and saved in multiple formats. This GUI is especially useful in trending data analysis, debugging anomalies, and advanced data analysis. At the request of the user, mission-specific instrument performance assessment reports can be generated with a simple click of a button on the GUI. From instrument level to observatory level, the TSDSS has been operating supporting functional and performance tests and refining system calibration algorithms and coefficients, in sync with the Aquarius/SAC-D spacecraft. At the time of this reporting, it was prepared and set up to perform anomaly investigation for mission operations preceding the Aquarius/SAC-D spacecraft launch on June 10, 2011.

Bates, Lakesha↗
NASA NTRS2013

Advanced Stirling Convertor Testing at GRC

NASA Glenn Research Center (GRC) has been supporting development of the Advanced Stirling Radioisotope Generator (ASRG) since 2006. A key element of the ASRG project is providing life, reliability, and performance testing of the Advanced Stirling Convertor (ASC). The latest version of the ASC, deemed ASC-E3, is of a design identical to the forthcoming flight convertors. The first pair of ASC-E3 units was delivered in December 2012. GRC has begun the process of adding these units to the catalog of ongoing Stirling convertor operation. This process includes performance verification, which examines the data from various tests to validate the convertors performance to the product specification.

Schifer, Nick↗
NASA NTRS2016

Post-Test Inspection of NASA's Evolutionary Xenon Thruster Long Duration Test Hardware: Ion Optics

A Long Duration Test (LDT) was initiated in June 2005 as a part of NASA's Evolutionary Xenon Thruster (NEXT) service life validation approach. Testing was voluntarily terminated in February 2014, with the thruster accumulating 51,184 hours of operation, processing 918 kg of xenon propellant, and delivering 35.5 MN-s of total impulse. The post-test inspection objectives for the ion optics were derived from the original NEXT LDT test objectives, such as service life model validation, and expanded to encompass other goals that included verification of in situ measurements, test issue root causes, and past design changes. The ion optics cold grid gap had decreased only by an average of 7% of pretest center grid gap, so efforts to stabilize NEXT grid gap were largely successful. The upstream screen grid surface exhibited a chamfered erosion pattern. Screen grid thicknesses were ≥ 86% of the estimated pretest thickness, indicating that the screen grid has substantial service life remaining. Deposition was found on the screen aperture walls and downstream surfaces that was primarily composed of grid material and back-sputtered carbon, and this deposition likely caused the minor decreases in screen grid ion transparency during the test. Groove depths had eroded through up to 35% of the accelerator grid thickness. Minimum accelerator aperture diameters increased only by about 5-7% of the pretest values and downstream surface diameters increased by about 24-33% of the pretest diameters. These results suggest that increasing the accelerator aperture diameters, improving manufacturing tolerances, and masking down the perforated diameter to 36 cm were successful in reducing the degree of accelerator aperture erosion at larger radii.

Ion Thruster↗
NASA NTRS2021

Post-test Inspection of NASA’s Evolutionary Xenon Thruster Long Duration Test Hardware: Ion Optics

A Long Duration Test (LDT) was initiated in June 2005 as a part of NASA’s Evolutionary Xenon Thruster (NEXT) service life validation approach. Testing was voluntarily terminated in February 2014, with the thruster accumulating 51,184 hours of operation, processing 918 kg of xenon propellant, and delivering 35.5 MN-s of total impulse. The post-test inspection objectives for the ion optics were derived from the original NEXT LDT test objectives, such as service life model validation, and expanded to encompass other goals that included verification of in situ measurements, test issue root causes, and past design changes. The ion optics cold grid gap had decreased only by an average of 7% of pretest center grid gap, so efforts to stabilize NEXT grid gap were largely successful. The upstream screen grid surface exhibited a chamfered erosion pattern. Screen grid thicknesses were ≥ 86% of the estimated pretest thickness, indicating that the screen grid has substantial service life remaining. Deposition was found on the screen aperture walls and downstream surfaces that was primarily composed of grid material and back-sputtered carbon, and this deposition likely caused the minor decreases in screen grid ion transparency during the test. Groove depths had eroded through up to 35% of the accelerator grid thickness. Minimum accelerator aperture diameters increased only by about 5-7% of the pretest values and downstream surface diameters increased by about 24-33% of the pretest diameters. These results suggest that increasing the accelerator aperture diameters, improving manufacturing tolerances, and masking down the perforated diameter to 36 cm were successful in reducing the degree of accelerator aperture erosion at larger radii.

George C. Soulas↗
NASA NTRSDate not supplied

What Is the OPP Approach to the Next Generation of Laboratory Requirements

Planetary Protection Quality Management System NASA’s Office of Planetary Protection uses a quality-based process evaluation approach to verify planetary protection bioburden compliance over a project’s life cycle. The verification strategy shifts from a comparative direct assay approach validating hardware bioburden at a “moment in time,” to one that implements a continual quality assurance demonstration of the analytical process via established data requirements, laboratory operational, and management parameters throughout the mission’s entire assembly process. Laboratory quality-based systems and management strategies are standardized and implemented across government and industry. A standardized laboratory quality system approach increases transparency throughout the project’s life cycle and aligns planetary protection analytical approaches with government and industry practices to support both NASA and commercial endeavors. Strategies include the implementation of a laboratory quality management structure that documents and routinely validates parameters critical to experimental design and data collection, provides data quality assessment parameters, and ultimately validates that the collected data is of sufficient quality and quantity to meet the specified technical goals. Planetary protection can draw on these practices to provide a systematic process-based quality approach to support planetary protection validation and compliance requirements. Quality approaches including data quality objectives, method performance, data acceptance criteria and the associated laboratory quality management system are presented to provide an overview and framework for a planetary protection laboratory quality management system.

Amy Baker↗
NASA NTRS2010

Evaluation of Enhanced High Resolution MODIS/AMSR-E SSTs and the Impact on Regional Weather Forecast

Over the last few years, the NASA Short-term Prediction Research and Transition (SPoRT) Center has been generating a 1-km sea surface temperature (SST) composite derived from retrievals of the Moderate Resolution Imaging Spectroradiometer (MODIS) for use in operational diagnostics and regional model initialization. With the assumption that the day-to-day variation in the SST is nominal, individual MODIS passes aboard the Earth Observing System (EOS) Aqua and Terra satellites are used to create and update four composite SST products each day at 0400, 0700, 1600, and 1900 UTC, valid over the western Atlantic and Caribbean waters. A six month study from February to August 2007 over the marine areas surrounding southern Florida was conducted to compare the use of the MODIS SST composite versus the Real-Time Global SST analysis to initialize the Weather Research and Forecasting (WRF) model. Substantial changes in the forecast heat fluxes were seen at times in the marine boundary layer, but relatively little overall improvement was measured in the sensible weather elements. The limited improvement in the WRF model forecasts could be attributed to the diurnal changes in SST seen in the MODIS SST composites but not accounted for by the model. Furthermore, cloud contamination caused extended periods when individual passes of MODIS were unable to update the SSTs, leading to substantial SST latency and a cool bias during the early summer months. In order to alleviate the latency problems, the SPoRT Center recently enhanced its MODIS SST composite by incorporating information from the Advanced Microwave Scanning Radiometer-EOS (AMSR-E) instruments as well as the Operational Sea Surface Temperature and Sea Ice Analysis. These enhancements substantially decreased the latency due to cloud cover and improved the bias and correlation of the composites at available marine point observations. While these enhancements improved upon the modeled cold bias using the original MODIS SSTs, the discernable impacts on the WRF model were still somewhat limited. This paper explores several factors that may have contributed to this result. First, the original methodology to initialize the model used the most recent SST composite available in a hypothetical real ]time configuration, often matching the forecast initial time with an SST field that was 5-8 hours offset. To minimize the differences that result from the diurnal variations in SST, the previous day fs SST composite is incorporated at a time closest to the model initialization hour (e.g. 1600 UTC composite at 1500 UTC model initialization). Second, the diurnal change seen in the MODIS SST composites was not represented by the WRF model in previous simulations, since the SSTs were held constant throughout the model integration. To address this issue, we explore the use of a water skin-temperature diurnal cycle prediction capability within v3.1 of the WRF model to better represent fluctuations in marine surface forcing. Finally, the verification of the WRF model is limited to very few over-water sites, many of which are located near the coastlines. In order to measure the open ocean improvements from the AMSR-E, we could use an independent 2-dimensional, satellite-derived data set to validate the forecast model by applying an object-based verification method. Such a validation technique could aid in better understanding the benefits of the mesoscale SST spatial structure to regional models applications.

Schiferl, Luke D.↗
NASA NTRSDate not supplied

Simulating High Energy Dynamic Impact of IM7/PEKK Continuous Fiber Laminated Thermoplastic Composite using Open Hole Coupon Experiments

The use of advanced thermoplastic composites (TPC) for structural applications in the aerospace and automotive industries has grown increasingly popular due to their high performance, high manufactured part output, and sustainability. Enhancing verification simulations of the progressive failure in TPCs at the coupon scale is needed to better validate advanced composite material models at larger length scales, such as element level panels. MAT_213, a tabulated composite material model, has been applied to simulate high velocity dynamic impact (HEDI) and is integrated in the LS-DYNA explicit finite element (FE) software. Previous efforts using MAT_213 have calibrated HEDI simulated failures with experimental data. Traditionally simulations have relied on a structured mesh to represent quasi-isotropic panels. For this study, a continuous fiber unidirectional tape, IM7/PEKK, was analyzed through a series of verification studies of notched laminate coupons, then validation analyses of quasi-isotropic panels under HEDI were compared with experimental data. Experiments using unidirectional TPC were performed to obtain tabulated stress vs strain curves using Digital Image Correlation (DIC) for input into MAT_213. Next, notched coupon experiments were used as an intermediate step to calibrate the damage and failure behavior in MAT_213. Lastly, investigations into differences between HEDI simulations using a fiber aligned mesh were compared with experimental failure patterns and damage sizes. The use of experimentally generated material behavior along with selective mesh layout improved HEDI predictions with minimal material parameter calibration.

Polymer matrix composites↗
NASA NTRS2004

A "Kane's Dynamics" Model for the Active Rack Isolation System Part Two: Nonlinear Model Development, Verification, and Simplification

Many microgravity space-science experiments require vibratory acceleration levels that are unachievable without active isolation. The Boeing Corporation's active rack isolation system (ARIS) employs a novel combination of magnetic actuation and mechanical linkages to address these isolation requirements on the International Space Station. Effective model-based vibration isolation requires: (1) An isolation device, (2) an adequate dynamic; i.e., mathematical, model of that isolator, and (3) a suitable, corresponding controller. This Technical Memorandum documents the validation of that high-fidelity dynamic model of ARIS. The verification of this dynamics model was achieved by utilizing two commercial off-the-shelf (COTS) software tools: Deneb's ENVISION(registered trademark), and Online Dynamics Autolev(trademark). ENVISION is a robotics software package developed for the automotive industry that employs three-dimensional computer-aided design models to facilitate both forward and inverse kinematics analyses. Autolev is a DOS-based interpreter designed, in general, to solve vector-based mathematical problems and specifically to solve dynamics problems using Kane's method. The simplification of this model was achieved using the small-angle theorem for the joint angle of the ARIS actuators. This simplification has a profound effect on the overall complexity of the closed-form solution while yielding a closed-form solution easily employed using COTS control hardware.

Beech, G. S.↗
NASA NTRS1997

Fourth NASA Langley Formal Methods Workshop

This publication consists of papers presented at NASA Langley Research Center's fourth workshop on the application of formal methods to the design and verification of life-critical systems. Topic considered include: Proving properties of accident; modeling and validating SAFER in VDM-SL; requirement analysis of real-time control systems using PVS; a tabular language for system design; automated deductive verification of parallel systems. Also included is a fundamental hardware design in PVS.

Holloway, C. Michael↗
NASA NTRSDate not supplied

Guiding Integration of Formal Verification in Assurance Cases

Assurance cases are being increasingly acknowledged as away to build trust in complex systems with autonomous capabilities. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for a specific mission and operating environment. Formal verification is often reserved for the most critical components of such systems. However, formal verification tools are often complex, and their usage is subject to many constraints and contextual dependencies. This can raise challenges both for performing the verification as well as reflecting the verification results appropriately in the assurance case, especially for non-expert users of the verification tool. To address these challenges, we present a tool-supported methodology for integrating formal verification results in an assurance case by capturing key verification method information in a rigorously constructed assurance case. In particular, we capture the tool specification in terms of its inputs, outputs, and assurance constraints as assumptions over inputs and guarantees provided over its outputs. The tool specification is parametrized over the inputs and outputs to both guide the intended application of the tool, as well as to check that the tool has been applied following the stated assumptions and that the guarantees hold. We define a generic tool assurance argument pattern that enables integration of the verification results in the assurance case by allowing custom refinement and automated instantiation for each tool use. We demonstrate our methodology on two formal verification tools and their applications to the verification of neural network properties for the aircraft domain.

Assurance Cases↗
NASA NTRS2011

Validation of Real-Time Data Processing for the Ground and Air-MSPI Systems

JPL is currently developing the multi-angle spectro-polarimetric imager (MSPI), targeted for the Aerosol-Cloud-Ecosystems (ACE) mission, as defined in the National Academies 2007 Decadal Survey. In preparation for the space instrument, the MSPI team has built two incremental camera systems (Ground- and Air-MSPI) to improve understanding of the proposed architecture. Ground-MSPI is a gimballed instrument used primarily for stationary observation and characterization of the imager and optics. The ER-2 based Air-MSPI operates in a step-and-stare mode, providing multi-angle imaging of a static target. This mode-of-operation simulates the observation scenario of the space instrument. Physically, MSPI is a pushbroom camera with a specialized frontend. Before imaging, light entering the camera passes through a pair of photoelastic modulators and a set of pattern polarizers. These optical elements act on the light to make polarimetric extraction computationally feasible. Calculating polarimetric parameters from the imager's data stream requires a real-time least-squares computation that produces coefficients of a truncated time-series expansion of the image. As reported in, the data processing algorithm can operate in real-time on a Xilinx Virtex-5 FPGA. Moving beyond verification with an onboard data source, the algorithm has been validated on a commercial development board interfaced with the ground camera. In addition, the algorithm has been instantiated within the Air-MSPI electronics board's FPGA, and in situ first-light has been achieved.

real-time data processing↗
NASA NTRS1982

Experiences and perspectives with SRI's tools for software design and validation

Development of tools that include the STP theorem poer and its associated Design Verification Systems; PHIL, a meta-programmable context sensitive structured editor; Pegasus, a system for support of graphical programming; and OBJ, an ultra high level programming language based on rewrite rules and abstract data type is reported.

Goguen, J.↗
NASA NTRS1987

Verification of 3D viscous/turbulent codes for internal flows

A computational fluid dynamics code is validated using data obtained through a nonintrusive laser Doppler velocimeter. A space marching technique and a parabolic marching technique are use to calculate the flow in a compressor using compressible and incompressible flow assumptions. In a viewgraph format, both computational fluid dynamics techniques and experimental data are compared to each other.

Lakshminarayana, B.↗
NASA NTRS2011

Uncertainty Assessment of Hypersonic Aerothermodynamics Prediction Capability

The present paper provides the background of a focused effort to assess uncertainties in predictions of heat flux and pressure in hypersonic flight (airbreathing or atmospheric entry) using state-of-the-art aerothermodynamics codes. The assessment is performed for four mission relevant problems: (1) shock turbulent boundary layer interaction on a compression corner, (2) shock turbulent boundary layer interaction due a impinging shock, (3) high-mass Mars entry and aerocapture, and (4) high speed return to Earth. A validation based uncertainty assessment approach with reliance on subject matter expertise is used. A code verification exercise with code-to-code comparisons and comparisons against well established correlations is also included in this effort. A thorough review of the literature in search of validation experiments is performed, which identified a scarcity of ground based validation experiments at hypersonic conditions. In particular, a shortage of useable experimental data at flight like enthalpies and Reynolds numbers is found. The uncertainty was quantified using metrics that measured discrepancy between model predictions and experimental data. The discrepancy data is statistically analyzed and investigated for physics based trends in order to define a meaningful quantified uncertainty. The detailed uncertainty assessment of each mission relevant problem is found in the four companion papers.

Bose, Deepak↗
NASA NTRSDate not supplied

An Evaluation of Extended Reality Technologies for Use in Verification Testing at NASA 2024 HRP IWS Abstract

BACKGROUND At NASA, verification testing is the formal process of ensuring that a product conforms to requirements set by a project or program. Some verification methods, such as Demonstrations and Test, require either the end product or a mockup of the product with sufficient fidelity to stand-in for the product during the test. Traditionally, these mockups have been physical (e.g., foam-core and wood) but there is growing interest in exploring new methods for testing with these mockups. These methods include virtual reality (VR), mixed reality, and augmented reality which are collectively referred to as eXtended Reality (XR) technologies. VR has already been adopted and used by many in the aerospace industry as a tool for use in early design phases (e.g., developmental testing) and may have the most potential for use in verification tests. Benefits of using VR mockups offer cost effectiveness, ease of iteration, simulation of hazardous conditions (e.g., an egress through a hatch with smoke obscuring vision), and the ability to simulate microgravity conditions, which are challenging to do with physical mockups. However, the validity of test results obtained from VR mockup demonstrations or testing, compared to the current gold standard of physical mockups, remains uncertain. It is unlikely that there is one clean answer as there are many different types of verification outcomes and each XR technology must be evaluated on its own merits. This is not an issue during developmental testing as the design is still in flux and the total success of the design is not dependent upon the results of a developmental test. Verification tests, however, only happen once, assuming no change to the design, and the results are used to certify the product. Therefore, establishing the validity of XR mockup-based verification outcomes is essential before considering them for any use in verification tests. OBJECTIVE AND METHOD To address this concern, the Human Research Program has funded a project to explore and qualify how XR technologies might be used in verification demonstration and testing at NASA. Currently, we are conducting a review of the literature on the utilization of XR mockups for design activities, prototyping, and user testing. We are employing the Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis method to identify the pros, cons, and barriers to adoption of XR technologies for verification testing at NASA. Additionally, we are developing a framework to guide the deployment of XR mockups for verification tests. Building upon available evidence from the literature and subject-matter expert feedback, our goal for the framework is to provide guidelines for which forms of XR mockups are suitable for a given verification test, when only physical mockups should be employed and to highlight areas for which more evidence is needed. To further refine our framework and to contribute to the body of evidence, we are planning a lab-based experiment comparing a VR mockup to a physical twin for a set of select verification outcomes. ANTICIPATED RESULTS In this presentation, we will present the work we conducted to evaluate XR technologies for use in verification tests at NASA. We will summarize and report our findings from the SWOT analysis and our lab-based study, and we will present the current state of the XR Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project. Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project.

Extended Reality↗