A Graphical Toolkit for the Validation of Requirements for Detect and Avoid Systems
Explore the source record for details and available documents.
Validation↗
SEARCH · Engineering Papers
Results for “system validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Implementing JEDI into NASA GMAO’s Real Time Production Suite
NASA’s Global Modeling and Assimilation Office (GMAO) has prepared their first production system involving the Joint Effort for Data assimilation Integration (JEDI) framework. In this system the central analysis, that drives the deterministic forecast, will be provided using JEDI. This talk outlines the phased approach to implementing JEDI into production that GMAO has designed, and how this approach will allow for a careful analysis of the system against the existing data assimilation framework (GSI). In the first phase of implementation the existing data assimilation system will perform certain actions that are still under development in JEDI. These include thinning the observations and producing satellite bias correction coefficients. JEDI is hooked up to the existing workflow so a single line switch can activate whether the existing or JEDI-based analysis is cycled. Outside of the monumental effort to construct JEDI that is ongoing at the Joint Center for Satellite Data Assimilation (JCSDA), GMAO have undertaken two areas of considerable effort. The talk will describe these efforts and highlight the main challenges that have been encountered. The first area of work is to implement the background error model from the existing data assimilation system into JEDI. The second is to validate the observing system in JEDI against the one in GSI, which has involved several new features being added to the observation operators in JEDI. While the longer-term plans involve trying to improve on the GSI in these two areas, GMAO is keen to have JEDI start from a trusted baseline. This is also key to implementing JEDI quickly so other priorities, such as increasing the number of model levels, can be easily worked on in parallel. GMAO is actively working on a framework to shepherd in the next generation coupled data assimilation system and model. As JEDI is implemented for the first time the plan is to ambitiously cycle through implementations, frequently bringing JEDI features to production. Details of these plans will be given in the talk and we will highlight key implementation and product milestones that we hope to achieve, as well as touch on the development environment that we will use to support frequent refreshing of the production system.
JEDI↗
Large Area Airborne Contamination Monitoring
The individual components of a Large Area Airborne Contamination Monitoring (LAACM) system have been demonstrated as functional and the concept of a low-cost, rapidly deployable, and rapidly expandable system has been validated. All components of a previously demonstrated system were re-evaluated. Based on this evaluation, recommendations were made for air collection equipment, scintillating material was synthesized and optimized for application, and improved images were acquired. A preliminary concept of operations was developed, outlining the need for an automated scintillation application system and software for data acquisition and analysis. The work conducted under this program in FY24 has raised the Technology Readiness Level (TRL) of the LAACM from TRL 3 to TRL 4.
Whiteside, Tad S. [Savannah River National Laborat↗
A Portable Ground-Based Atmospheric Monitoring System (PGAMS) for the Calibration and Validation of Atmospheric Correction Algorithms Applied to Aircraft and Satellite Images
Detecting changes in the Earth's environment using satellite images of ocean and land surfaces must take into account atmospheric effects. As a result, major programs are underway to develop algorithms for image retrieval of atmospheric aerosol properties and atmospheric correction. However, because of the temporal and spatial variability of atmospheric transmittance it is very difficult to model atmospheric effects and implement models in an operational mode. For this reason, simultaneous in situ ground measurements of atmospheric optical properties are vital to the development of accurate atmospheric correction techniques. Presented in this paper is a spectroradiometer system that provides an optimized set of surface measurements for the calibration and validation of atmospheric correction algorithms. The Portable Ground-based Atmospheric Monitoring System (PGAMS) obtains a comprehensive series of in situ irradiance, radiance, and reflectance measurements for the calibration of atmospheric correction algorithms applied to multispectral. and hyperspectral images. The observations include: total downwelling irradiance, diffuse sky irradiance, direct solar irradiance, path radiance in the direction of the north celestial pole, path radiance in the direction of the overflying satellite, almucantar scans of path radiance, full sky radiance maps, and surface reflectance. Each of these parameters are recorded over a wavelength range from 350 to 1050 nm in 512 channels. The system is fast, with the potential to acquire the complete set of observations in only 8 to 10 minutes depending on the selected spatial resolution of the sky path radiance measurements
Schiller, Stephen↗
Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation
Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.
He, Yuning↗
An Approach to V&V of Embedded Adaptive Systems
Rigorous Verification and Validation (V&V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V&V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment. In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov's Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA's Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology. ,
Liu, Yan↗
The CLVTOPS Toolchain for NASA Space Launch System Liftoff Analysis and Post Flight Validation
This paper showcases the unique technical capabilities of the CLVTOPS multi-body flight dynamics toolchain developed by Marshall Space Flight Center (MSFC) for analyzing NASA’s Space Launch System (SLS) liftoff events. The CLVTOPS toolchain integrates high-fidelity simulations, geometric algorithms, advanced data analytics, and post-flight telemetry to demonstrate positive clearance between separating bodies and inform design decisions that enhance mission reliability. Proper liftoff separation is crucial to the success of the launch vehicle’s mission; vehicle impacts with the launch tower and supporting components incur a heightened risk of mission failure. For liftoff analysis, the CLVTOPS toolchain enables the integration of vehicle, launch pad, and environmental input models for the investigation of key clearance effectors. Furthermore, recent enhancements to the CLVTOPS toolchain allow for validation via photogrammetric trajectory reconstruction and plume pressure impingement estimation on the tower. The following sections will walk through the tool-chain, SLS liftoff ground rules and assumptions, key models, standard analysis, recent enhancements, and post-flight validation of the Artemis I mission liftoff event.
CLVTOPS↗
Mathematical algorithms for approximate reasoning
Most state of the art expert system environments contain a single and often ad hoc strategy for approximate reasoning. Some environments provide facilities to program the approximate reasoning algorithms. However, the next generation of expert systems should have an environment which contain a choice of several mathematical algorithms for approximate reasoning. To meet the need for validatable and verifiable coding, the expert system environment must no longer depend upon ad hoc reasoning techniques but instead must include mathematically rigorous techniques for approximate reasoning. Popular approximate reasoning techniques are reviewed, including: certainty factors, belief measures, Bayesian probabilities, fuzzy logic, and Shafer-Dempster techniques for reasoning. A group of mathematically rigorous algorithms for approximate reasoning are focused on that could form the basis of a next generation expert system environment. These algorithms are based upon the axioms of set theory and probability theory. To separate these algorithms for approximate reasoning various conditions of mutual exclusivity and independence are imposed upon the assertions. Approximate reasoning algorithms presented include: reasoning with statistically independent assertions, reasoning with mutually exclusive assertions, reasoning with assertions that exhibit minimum overlay within the state space, reasoning with assertions that exhibit maximum overlay within the state space (i.e. fuzzy logic), pessimistic reasoning (i.e. worst case analysis), optimistic reasoning (i.e. best case analysis), and reasoning with assertions with absolutely no knowledge of the possible dependency among the assertions. A robust environment for expert system construction should include the two modes of inference: modus ponens and modus tollens. Modus ponens inference is based upon reasoning towards the conclusion in a statement of logical implication, whereas modus tollens inference is based upon reasoning away from the conclusion. These algorithms allow one to reason accurately with uncertain data. The above environment can replicate state-f-the-art expert system environments which provides a continuity between the current expert systems which cannot be validated or verified and future expert systems which should be both validated and verified
Murphy, John H.↗
Field Validation of Packaged RAD-AC HVAC System: Efficiency and Load Shifting via Electrochemical Regeneration of Liquid Desiccants
In this project, Mojave and SRI have demonstrated field validation and load shifting of liquid desiccant air conditioning systems with two liquid desiccant dedicated outdoor air system (DOAS) air conditioner units – one employing traditional thermal desiccant regeneration and the other utilizing Mojave’s novel electrochemical desiccant regeneration technology based on Redox Assisted electrodialysis. The Redox Assisted Dehumidification Air Conditioning (RAD-AC) technology is further developed and validated in this work to demonstrate an Integrated Seasonal Moisture Removal Efficiency (ISMRE) > 5.0 kg/kWh and shifting of ≥ 10% electric load in ≤ 72 hours. Furthermore, the longevity and durability of Mojave’s liquid desiccant air conditioning technology is validated in field testing of the thermally regenerated unit, with the unit demonstrating operation with >90% uptime while experiencing an efficiency degradation of < 10% during a testing campaign of over 5400 hours.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
SMAP Verification and Validation Project - Final Report
In 2007, the National Research Council (NRC) released the Decadal Survey of Earth science. In the future decade, the survey identified 15 new space missions of significant scientific and application value for the National Aeronautics and Space Administration (NASA) to undertake. One of these missions was the Soil Moisture Active Passive (SMAP) mission that NASA assigned to the Jet Propulsion Laboratory (JPL) in 2008. The goal of SMAP1 is to provide global, high resolution mapping of soil moisture and its freeze/thaw states. The SMAP project recently passed its Critical Design Review and is proceeding with its fabrication and testing phase.Verification and Validation (V&V) is widely recognized as a critical component in system engineering and is vital to the success of any space mission. V&V is a process that is used to check that a system meets its design requirements and specifications in order to fulfill its intended purpose. Verification often refers to the question "Have we built the system right?" whereas Validation asks "Have we built the right system?" Currently the SMAP V&V team is verifying design requirements through inspection, demonstration, analysis, or testing. An example of the SMAP V&V process is the verification of the antenna pointing accuracy with mathematical models since it is not possible to provide the appropriate micro-gravity environment for testing the antenna on Earth before launch.
Soil Moisture Active Passive (SMAP)↗
Occupant Protection during Orion Crew Exploration Vehicle Landings
The constellation program is evaluating current vehicle design capabilities for nominal water landings and contingency land landings of the Orion Crew Exploration vehicle. The Orion Landing Strategy tiger team was formed to lead the technical effort for which associated activities include the current vehicle design, susceptibility to roll control and tip over, reviewing methods for assessing occupant injury during ascent / aborts /landings, developing an alternate seat/attenuation design solution which improves occupant protection and operability, and testing the seat/attenuation system designs to ensure valid results. The EVA physiology, systems and Performance (EPSP) project is leading the effort under the authority of the Tiger Team Steering committee to develop, verify, validate and accredit biodynamics models using a variety of crash and injury databases including NASCAR, Indy Car and military aircraft. The validated biodynamics models will be used by the Constellation program to evaluate a variety of vehicle, seat and restraint designs in the context of multiple nominal and off-nominal landing scenarios. The models will be used in conjunction with Acceptable Injury Risk definitions to provide new occupant protection requirements for the Constellation Program.
Gernhardt, Michael L.↗
Interactive specification acquisition via scenarios: A proposal
Some reactive systems are most naturally specified by giving large collections of behavior scenarios. These collections not only specify the behavior of the system, but also provide good test suites for validating the implemented system. Due to the complexity of the systems and the number of scenarios, however, it appears that automated assistance is necessary to make this software development process workable. Interactive Specification Acquisition Tool (ISAT) is a proposed interactive system for supporting the acquisition and maintenance of a formal system specification from scenarios, as well as automatic synthesis of control code and automated test generation. This paper discusses the background, motivation, proposed functions, and implementation status of ISAT.
Hall, Robert J.↗
Developments in Test Facility and Data Networking for the Altitude Test Stand at the John C. Stennis Space Center, MS - A General Overview
May 2007, NASA's Constellation Program selected John C Stennis Space Center (SSC) near Waveland Mississippi as the site to construct an altitude test facility for the developmental and qualification testing of the Ares1 upper stage (US) engine. Test requirements born out of the Ares1 US propulsion system design necessitate exceptional Data Acquisition System (DAS) design solutions that support facility and propellant systems conditioning, test operations control and test data analysis. This paper reviews the new A3 Altitude Test Facility's DAS design requirements for real-time deterministic digital data, DAS technology enhancements, system trades, technology validation activities, and the current status of this system's new architecture. Also to be discussed will be current network technologies to improve data transfer.
Hebert, Phillip W., Sr.↗
Cold Helium Pressurization for Liquid Oxygen/Liquid Methane Propulsion Systems: Fully-Integrated Hot-Fire Test Results
Hot-fire test demonstrations were successfully conducted using a cold helium pressurization system fully integrated into a liquid oxygen (LOX) / liquid methane (LCH4) propulsion system (Figure 1). Cold helium pressurant storage at near liquid nitrogen (LN2) temperatures (-275 F and colder) and used as a heated tank pressurant provides a substantial density advantage compared to ambient temperature storage. The increased storage density reduces helium pressurant tank size and mass, creating payload increases of ~35% for small lunar-lander sized applications. This degree of mass reduction also enables pressure-fed propulsion systems for human-rated Mars ascent vehicle designs. Hot-fire test results from the highly-instrumented test bed will be used to demonstrate system performance and validate integrated models of the helium and propulsion systems. A pressurization performance metric will also be developed as a means to compare different active pressurization schemes.
Morehead, R. L.↗
Use of the Ames Check Standard Model for the Validation of Wall Interference Corrections
The new check standard model of the NASA Ames 11-ft Transonic Wind Tunnel was chosen for a future validation of the facility's wall interference correction system. The chosen validation approach takes advantage of the fact that test conditions experienced by a large model in the slotted part of the tunnel's test section will change significantly if a subset of the slots is temporarily sealed. Therefore, the model's aerodynamic coefficients have to be recorded, corrected, and compared for two different test section configurations in order to perform the validation. Test section configurations with highly accurate Mach number and dynamic pressure calibrations were selected for the validation. First, the model is tested with all test section slots in open configuration while keeping the model's center of rotation on the tunnel centerline. In the next step, slots on the test section floor are sealed and the model is moved to a new center of rotation that is 33 inches below the tunnel centerline. Then, the original angle of attack sweeps are repeated. Afterwards, wall interference corrections are applied to both test data sets and response surface models of the resulting aerodynamic coefficients in interference-free flow are generated. Finally, the response surface models are used to predict the aerodynamic coefficients for a family of angles of attack while keeping dynamic pressure, Mach number, and Reynolds number constant. The validation is considered successful if the corrected aerodynamic coefficients obtained from the related response surface model pair show good agreement. Residual differences between the corrected coefficient sets will be analyzed as well because they are an indicator of the overall accuracy of the facility's wall interference correction process.
wind tunnel wall interferenc↗
Instrumentation System Diagnoses a Thermocouple
An improved self-validating thermocouple (SVT) instrumentation system not only acquires readings from a thermocouple but is also capable of detecting deterioration and a variety of discrete faults in the thermocouple and its lead wires. Prime examples of detectable discrete faults and deterioration include open- and short-circuit conditions and debonding of the thermocouple junction from the object, the temperature of which one seeks to measure. Debonding is the most common cause of errors in thermocouple measurements, but most prior SVT instrumentation systems have not been capable of detecting debonding. The improved SVT instrumentation system includes power circuitry, a cold-junction compensator, signal-conditioning circuitry, pulse-width-modulation (PWM) thermocouple-excitation circuitry, an analog-to-digital converter (ADC), a digital data processor, and a universal serial bus (USB) interface. The system can operate in any of the following three modes: temperature measurement, thermocouple validation, and bonding/debonding detection. The software running in the processor includes components that implement statistical algorithms to evaluate the state of the thermocouple and the instrumentation system. When the power is first turned on, the user can elect to start a diagnosis/ monitoring sequence, in which the PWM is used to estimate the characteristic times corresponding to the correct configuration. The user also has the option of using previous diagnostic values, which are stored in an electrically erasable, programmable read-only memory so that they are available every time the power is turned on.
Perotti, Jose↗
Advanced Information Processing System (AIPS)
Advanced Information Processing System (AIPS) is a computer systems philosophy, a set of validated hardware building blocks, and a set of validated services as embodied in system software. The goal of AIPS is to provide the knowledgebase which will allow achievement of validated fault-tolerant distributed computer system architectures, suitable for a broad range of applications, having failure probability requirements of 10E-9 at 10 hours. A background and description is given followed by program accomplishments, the current focus, applications, technology transfer, FY92 accomplishments, and funding.
Pitts, Felix L.↗
Flight validation of a pulsed smoke flow visualization system
A flow visualization scheme, designed to measure vortex fluid dynamics on research aircraft, was validated in flight. Strake vortex trajectories and axial core velocities were determined using pulsed smoke, high-speed video images, and semiautomated image edge detection hardware and software. Smoke was pulsed by using a fast-acting three-way valve. After being redesigned because of repeatedly jamming in flight, the valve shuttle operated flawlessly during the last two tests. A 25-percent scale, Gothic strake was used to generate vortex over the wing of a GA-7 Cougar and was operated at a local angle of attack of 22 degrees and Reynolds number of approximately 7.8 x 10(exp 5)/ft. Maximum axial velocities measured in the vortex core were between 1.75 and 1.95 times the freestream velocity. Analysis of the pulsed smoke system's affect on forebody vortices indicates that the system may reorient the forebody vortex system; however, blowing momentum coefficients normally used will have no appreciable affect on the leading-edge extension vortex system. It is recommended that a similar pulsed smoke system be installed on the F/A-18 High Angle Research Vehicle and that this approach be used to analyze vortex core dynamics during the remainder of its high-angle-of-attack research flights.
Ward, Donald T.↗