Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Design and Analysis Techniques for Concurrent Blackboard Systems

Blackboard systems are a natural progression of knowledge-based systems into a more powerful problem solving technique. They provide a way for several highly specialized knowledge sources to cooperate to solve large, complex problems. Blackboard systems incorporate the concepts developed by rule-based and expert systems programmers and include the ability to add conventionally coded knowledge sources. The small and specialized knowledge sources are easier to develop and test, and can be hosted on hardware specifically suited to the task that they are solving. The Formal Model for Blackboard Systems was developed to provide a consistent method for describing a blackboard system. A set of blackboard system design tools has been developed and validated for implementing systems that are expressed using the Formal Model. The tools are used to test and refine a proposed blackboard system design before the design is implemented. My research has shown that the level of independence and specialization of the knowledge sources directly affects the performance of blackboard systems. Using the design, simulation, and analysis tools, I developed a concurrent object-oriented blackboard system that is faster, more efficient, and more powerful than existing systems. The use of the design and analysis tools provided the highly specialized and independent knowledge sources required for my concurrent blackboard system to achieve its design goals.

Mcmanus, John William↗
NASA NTRS1992

Satellite retrievals of marine stratiform cloud systems

The initial validation of a satellite-based cloud retrieval scheme of the spatial-coherence type that is being used to create a marine stratiform cloudiness (MSC) climatology is discussed. Initial results are presented which describe correlations between MSC properties and SST, which could be useful for providing guidelines for assessing potential climate feedbacks regarding these cloud types. The correlation of triangle-technique- and spatial-coherence-method-derived fractional cloud covers together with the regression line for all data points is shown.

Molnar, Gyula I.↗
NASA NTRS2009

Compartment Venting Analyses of Ares I First Stage Systems Tunnel

Compartment venting analyses have been performed for the Ares I first stage systems tunnel using both the lumped parameter method and the three-dimensional (31)) transient computational fluid dynamics (CFD) approach. The main objective of venting analyses is to predict the magnitudes of differential pressures across the skin so the integrity of solid walls can be evaluated and properly designed. The lumped parameter method assumes the gas pressure and temperature inside the systems tunnel are spatially uniform, which is questionable since the tunnel is about 1,700 in. long and 4 in. wide. Therefore, 31) transient CFD simulations using the commercial CFD code FLUENT are performed in order to examine the gas pressure and temperature variations inside the tunnel. It was found that the uniform pressure and temperature assumptions inside the systems tunnel are valid during ascent. During reentry, the uniform pressure assumption is also reasonable but the uniform temperature assumption is not valid. Predicted pressure and temperature inside the systems tunnel using CFD are also compared with those from the lumped parameter method using the NASA code CHCHVENT. In general, the average pressure and temperature inside the systems tunnel from CFD are between the burst and crush results from CHCHVENT during both ascent and reentry. The skin differential pressure and pressure inside the systems tunnel relative to freestream pressure from CHCHVENT as well as velocity vectors and streamlines are also discussed in detail.

Wang, Qunzhen↗
NASA NTRS2004

Design considerations and validation of the MSTAR absolute metrology system

Absolute metrology measures the actual distance between two optical fiducials. A number of methods have been employed, including pulsed time-of-flight, intensity-modulated optical beam, and two-color interferometry. The rms accuracy is currently limited to -5 microns. Resolving the integer number of wavelengths requires a 1-sigma range accuracy of -0.1 microns. Closing this gap has a large pay-off the range (length measurement) accuracy can be increased substantially using the unambiguous optical phase. The MSTAR sensor (Modulation Sideband Technology for Absolute Ranging) is a new system for measuring absolute distance, capable of resolving the integer cycle ambiguity of standard interferometers, and making it possible to measure distance with sub-nanometer accuracy. In this paper, we present recent experiments that use dispersed white light interferometry to independently validate the zero-point of the system. We also describe progress towards reducing the size of optics, and stabilizing the laser wavelength for operation over larger target ranges. MSTAR is a general-purpose tool for conveniently measuring length with much greater accuracy than was previously possible, and has a wide range of possible applications.

Jeganathan, Muthu↗
NASA NTRS2019

Architecture of a faul-tolerant and verifiable outer planet flyby

Flyby missions to outer solar system objects require a very high confidence of since there are no second chances. The quantity, quality, and diversity of science measurements to be made in a matter of hours or days must justify the mission cost. Accordingly, the mission architecture must include a high degree of redundancy, large design margins, and an ability to correct or operate through anomalies while at the same time being deterministic enough for confidence in system verification and validation. In this paper we present a system architecture as part of a proposed mission to Triton, called “Trident”.

Mitchell, Karl L.↗
NASA NTRSDate not supplied

Implementing JEDI into NASA GMAO’s Real Time Production Suite

NASA’s Global Modeling and Assimilation Office (GMAO) has prepared their first production system involving the Joint Effort for Data assimilation Integration (JEDI) framework. In this system the central analysis, that drives the deterministic forecast, will be provided using JEDI. This talk outlines the phased approach to implementing JEDI into production that GMAO has designed, and how this approach will allow for a careful analysis of the system against the existing data assimilation framework (GSI). In the first phase of implementation the existing data assimilation system will perform certain actions that are still under development in JEDI. These include thinning the observations and producing satellite bias correction coefficients. JEDI is hooked up to the existing workflow so a single line switch can activate whether the existing or JEDI-based analysis is cycled. Outside of the monumental effort to construct JEDI that is ongoing at the Joint Center for Satellite Data Assimilation (JCSDA), GMAO have undertaken two areas of considerable effort. The talk will describe these efforts and highlight the main challenges that have been encountered. The first area of work is to implement the background error model from the existing data assimilation system into JEDI. The second is to validate the observing system in JEDI against the one in GSI, which has involved several new features being added to the observation operators in JEDI. While the longer-term plans involve trying to improve on the GSI in these two areas, GMAO is keen to have JEDI start from a trusted baseline. This is also key to implementing JEDI quickly so other priorities, such as increasing the number of model levels, can be easily worked on in parallel. GMAO is actively working on a framework to shepherd in the next generation coupled data assimilation system and model. As JEDI is implemented for the first time the plan is to ambitiously cycle through implementations, frequently bringing JEDI features to production. Details of these plans will be given in the talk and we will highlight key implementation and product milestones that we hope to achieve, as well as touch on the development environment that we will use to support frequent refreshing of the production system.

JEDI↗
NASA NTRS2000

A Portable Ground-Based Atmospheric Monitoring System (PGAMS) for the Calibration and Validation of Atmospheric Correction Algorithms Applied to Aircraft and Satellite Images

Detecting changes in the Earth's environment using satellite images of ocean and land surfaces must take into account atmospheric effects. As a result, major programs are underway to develop algorithms for image retrieval of atmospheric aerosol properties and atmospheric correction. However, because of the temporal and spatial variability of atmospheric transmittance it is very difficult to model atmospheric effects and implement models in an operational mode. For this reason, simultaneous in situ ground measurements of atmospheric optical properties are vital to the development of accurate atmospheric correction techniques. Presented in this paper is a spectroradiometer system that provides an optimized set of surface measurements for the calibration and validation of atmospheric correction algorithms. The Portable Ground-based Atmospheric Monitoring System (PGAMS) obtains a comprehensive series of in situ irradiance, radiance, and reflectance measurements for the calibration of atmospheric correction algorithms applied to multispectral. and hyperspectral images. The observations include: total downwelling irradiance, diffuse sky irradiance, direct solar irradiance, path radiance in the direction of the north celestial pole, path radiance in the direction of the overflying satellite, almucantar scans of path radiance, full sky radiance maps, and surface reflectance. Each of these parameters are recorded over a wavelength range from 350 to 1050 nm in 512 channels. The system is fast, with the potential to acquire the complete set of observations in only 8 to 10 minutes depending on the selected spatial resolution of the sky path radiance measurements

Schiller, Stephen↗
NASA NTRS2012

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗
NASA NTRS2004

An Approach to V&V of Embedded Adaptive Systems

Rigorous Verification and Validation (V&V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V&V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment. In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov's Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA's Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology. ,

Liu, Yan↗
NASA NTRSDate not supplied

The CLVTOPS Toolchain for NASA Space Launch System Liftoff Analysis and Post Flight Validation

This paper showcases the unique technical capabilities of the CLVTOPS multi-body flight dynamics toolchain developed by Marshall Space Flight Center (MSFC) for analyzing NASA’s Space Launch System (SLS) liftoff events. The CLVTOPS toolchain integrates high-fidelity simulations, geometric algorithms, advanced data analytics, and post-flight telemetry to demonstrate positive clearance between separating bodies and inform design decisions that enhance mission reliability. Proper liftoff separation is crucial to the success of the launch vehicle’s mission; vehicle impacts with the launch tower and supporting components incur a heightened risk of mission failure. For liftoff analysis, the CLVTOPS toolchain enables the integration of vehicle, launch pad, and environmental input models for the investigation of key clearance effectors. Furthermore, recent enhancements to the CLVTOPS toolchain allow for validation via photogrammetric trajectory reconstruction and plume pressure impingement estimation on the tower. The following sections will walk through the tool-chain, SLS liftoff ground rules and assumptions, key models, standard analysis, recent enhancements, and post-flight validation of the Artemis I mission liftoff event.

CLVTOPS↗
NASA NTRS1988

Mathematical algorithms for approximate reasoning

Most state of the art expert system environments contain a single and often ad hoc strategy for approximate reasoning. Some environments provide facilities to program the approximate reasoning algorithms. However, the next generation of expert systems should have an environment which contain a choice of several mathematical algorithms for approximate reasoning. To meet the need for validatable and verifiable coding, the expert system environment must no longer depend upon ad hoc reasoning techniques but instead must include mathematically rigorous techniques for approximate reasoning. Popular approximate reasoning techniques are reviewed, including: certainty factors, belief measures, Bayesian probabilities, fuzzy logic, and Shafer-Dempster techniques for reasoning. A group of mathematically rigorous algorithms for approximate reasoning are focused on that could form the basis of a next generation expert system environment. These algorithms are based upon the axioms of set theory and probability theory. To separate these algorithms for approximate reasoning various conditions of mutual exclusivity and independence are imposed upon the assertions. Approximate reasoning algorithms presented include: reasoning with statistically independent assertions, reasoning with mutually exclusive assertions, reasoning with assertions that exhibit minimum overlay within the state space, reasoning with assertions that exhibit maximum overlay within the state space (i.e. fuzzy logic), pessimistic reasoning (i.e. worst case analysis), optimistic reasoning (i.e. best case analysis), and reasoning with assertions with absolutely no knowledge of the possible dependency among the assertions. A robust environment for expert system construction should include the two modes of inference: modus ponens and modus tollens. Modus ponens inference is based upon reasoning towards the conclusion in a statement of logical implication, whereas modus tollens inference is based upon reasoning away from the conclusion. These algorithms allow one to reason accurately with uncertain data. The above environment can replicate state-f-the-art expert system environments which provides a continuity between the current expert systems which cannot be validated or verified and future expert systems which should be both validated and verified

Murphy, John H.↗
NASA NTRS2012

SMAP Verification and Validation Project - Final Report

In 2007, the National Research Council (NRC) released the Decadal Survey of Earth science. In the future decade, the survey identified 15 new space missions of significant scientific and application value for the National Aeronautics and Space Administration (NASA) to undertake. One of these missions was the Soil Moisture Active Passive (SMAP) mission that NASA assigned to the Jet Propulsion Laboratory (JPL) in 2008. The goal of SMAP1 is to provide global, high resolution mapping of soil moisture and its freeze/thaw states. The SMAP project recently passed its Critical Design Review and is proceeding with its fabrication and testing phase.Verification and Validation (V&V) is widely recognized as a critical component in system engineering and is vital to the success of any space mission. V&V is a process that is used to check that a system meets its design requirements and specifications in order to fulfill its intended purpose. Verification often refers to the question "Have we built the system right?" whereas Validation asks "Have we built the right system?" Currently the SMAP V&V team is verifying design requirements through inspection, demonstration, analysis, or testing. An example of the SMAP V&V process is the verification of the antenna pointing accuracy with mathematical models since it is not possible to provide the appropriate micro-gravity environment for testing the antenna on Earth before launch.

Soil Moisture Active Passive (SMAP)↗
NASA NTRS2009

Occupant Protection during Orion Crew Exploration Vehicle Landings

The constellation program is evaluating current vehicle design capabilities for nominal water landings and contingency land landings of the Orion Crew Exploration vehicle. The Orion Landing Strategy tiger team was formed to lead the technical effort for which associated activities include the current vehicle design, susceptibility to roll control and tip over, reviewing methods for assessing occupant injury during ascent / aborts /landings, developing an alternate seat/attenuation design solution which improves occupant protection and operability, and testing the seat/attenuation system designs to ensure valid results. The EVA physiology, systems and Performance (EPSP) project is leading the effort under the authority of the Tiger Team Steering committee to develop, verify, validate and accredit biodynamics models using a variety of crash and injury databases including NASCAR, Indy Car and military aircraft. The validated biodynamics models will be used by the Constellation program to evaluate a variety of vehicle, seat and restraint designs in the context of multiple nominal and off-nominal landing scenarios. The models will be used in conjunction with Acceptable Injury Risk definitions to provide new occupant protection requirements for the Constellation Program.

Gernhardt, Michael L.↗
NASA NTRS1992

Interactive specification acquisition via scenarios: A proposal

Some reactive systems are most naturally specified by giving large collections of behavior scenarios. These collections not only specify the behavior of the system, but also provide good test suites for validating the implemented system. Due to the complexity of the systems and the number of scenarios, however, it appears that automated assistance is necessary to make this software development process workable. Interactive Specification Acquisition Tool (ISAT) is a proposed interactive system for supporting the acquisition and maintenance of a formal system specification from scenarios, as well as automatic synthesis of control code and automated test generation. This paper discusses the background, motivation, proposed functions, and implementation status of ISAT.

Hall, Robert J.↗
NASA NTRS2008

Developments in Test Facility and Data Networking for the Altitude Test Stand at the John C. Stennis Space Center, MS - A General Overview

May 2007, NASA's Constellation Program selected John C Stennis Space Center (SSC) near Waveland Mississippi as the site to construct an altitude test facility for the developmental and qualification testing of the Ares1 upper stage (US) engine. Test requirements born out of the Ares1 US propulsion system design necessitate exceptional Data Acquisition System (DAS) design solutions that support facility and propellant systems conditioning, test operations control and test data analysis. This paper reviews the new A3 Altitude Test Facility's DAS design requirements for real-time deterministic digital data, DAS technology enhancements, system trades, technology validation activities, and the current status of this system's new architecture. Also to be discussed will be current network technologies to improve data transfer.

Hebert, Phillip W., Sr.↗
NASA NTRS2016

Cold Helium Pressurization for Liquid Oxygen/Liquid Methane Propulsion Systems: Fully-Integrated Hot-Fire Test Results

Hot-fire test demonstrations were successfully conducted using a cold helium pressurization system fully integrated into a liquid oxygen (LOX) / liquid methane (LCH4) propulsion system (Figure 1). Cold helium pressurant storage at near liquid nitrogen (LN2) temperatures (-275 F and colder) and used as a heated tank pressurant provides a substantial density advantage compared to ambient temperature storage. The increased storage density reduces helium pressurant tank size and mass, creating payload increases of ~35% for small lunar-lander sized applications. This degree of mass reduction also enables pressure-fed propulsion systems for human-rated Mars ascent vehicle designs. Hot-fire test results from the highly-instrumented test bed will be used to demonstrate system performance and validate integrated models of the helium and propulsion systems. A pressurization performance metric will also be developed as a means to compare different active pressurization schemes.

Morehead, R. L.↗
NASA NTRS2018

Use of the Ames Check Standard Model for the Validation of Wall Interference Corrections

The new check standard model of the NASA Ames 11-ft Transonic Wind Tunnel was chosen for a future validation of the facility's wall interference correction system. The chosen validation approach takes advantage of the fact that test conditions experienced by a large model in the slotted part of the tunnel's test section will change significantly if a subset of the slots is temporarily sealed. Therefore, the model's aerodynamic coefficients have to be recorded, corrected, and compared for two different test section configurations in order to perform the validation. Test section configurations with highly accurate Mach number and dynamic pressure calibrations were selected for the validation. First, the model is tested with all test section slots in open configuration while keeping the model's center of rotation on the tunnel centerline. In the next step, slots on the test section floor are sealed and the model is moved to a new center of rotation that is 33 inches below the tunnel centerline. Then, the original angle of attack sweeps are repeated. Afterwards, wall interference corrections are applied to both test data sets and response surface models of the resulting aerodynamic coefficients in interference-free flow are generated. Finally, the response surface models are used to predict the aerodynamic coefficients for a family of angles of attack while keeping dynamic pressure, Mach number, and Reynolds number constant. The validation is considered successful if the corrected aerodynamic coefficients obtained from the related response surface model pair show good agreement. Residual differences between the corrected coefficient sets will be analyzed as well because they are an indicator of the overall accuracy of the facility's wall interference correction process.

wind tunnel wall interferenc↗