Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Analysis and Monitoring of Cyber-Physical Systems via Environmental Domain Knowledge & Modeling

While verifying adherence to a specification (i.e., specification-based testing) is important, the results are only as valid as the specification itself. Problematically, verifying a system specification must be done within the context of changing or even unknown environmental domain knowledge that could render the specification ineffective or incorrect. This issue is even more apparent in the context of self-adaptive systems, where uncertainty in both the system configuration and environment can impact the validity of the system. This paper introduces a method to explicitly model domain knowledge of the environment as a secondary system to enable design-time verification against documented environmental assumptions (i.e., those elements external to the system). In addition, run-time monitors are used to detect scenarios in the actual environment not specified by the modeled environmental domain knowledge. Rather than simply identifying unexpected inputs, our approach is able to identify run-time violations of the environmental domain knowledge, even when inputs appear valid based on the domain assumptions embedded in the system specification. These violations can then be used to correspondingly update the system and environmental specifications via automated run-time adaptation or subsequent design-time revisions. We illustrate our approach by applying our method to a running example of a goal-based model of a baby monitor.

Byron DeVries↗
NASA NTRS1989

Advanced orbiting systems test-bedding and protocol verification

The Consultative Committee for Space Data Systems (CCSDS) has begun the development of a set of protocol recommendations for Advanced Orbiting Systems (SOS). The AOS validation program and formal definition of AOS protocols are reviewed, and the configuration control of the AOS formal specifications is summarized. Independent implementations of the AOS protocols by NASA and ESA are discussed, and cross-support/interoperability tests which will allow the space agencies of various countries to share AOS communication facilities are addressed.

Noles, James↗
NASA NTRS2016

A Test-Bed Validation of Electromagnetic Surface Wave Propagation Along a Dielectric-Coated Metal Pipe

This paper provides a summary of the results of an attempt at experimental verification of the propagation of electromagnetic surface waves at microwaves frequencies, in and along the uniform dielectric coating of a circular cylindrical metal pipe, based on the previously established theoretical investigation. These experimental results are of value for the diagnostic of anomalies on the surface of tar-coated pipes used in protecting the underground power transmission cables (feeder pipes). A test-bed was designed and implemented using an aluminum tubes (10” diameter) with an acrylic tube coating (0.25” thickness). Two identical wave launcher/receiver arrays, each of 32 elements around the tube for relatively uniform radiation/reception, were designed and fabricated at the frequency of interest (~6 GHz). This arrangement was put in a specially designed small anechoic chamber and attached to a network analyzer. A variety of tests were performed to establish the launch efficiency, prove surface wave propagation along, and reflection from different types of anomalies on the coating. In the paper, a number of test results and supporting graphs will be provided and future work for improving the performance of the launch array and the test-bed arrangement for better results will be outlined.

Gatti, Mark↗
NASA NTRSDate not supplied

Overview of Predictive Simulation Capability Development for Crater Evolution and Ejecta in Continuum/Rarefied Flows

As part of the Game Changing Development (GCD) Program, funded by NASA’s Space Technology Mission Directorate (STMD), the development of simulation capability for the prediction of extra-terrestrial Plume Surface Interaction (PSI) environments has been undertaken by the Fluid Dynamics Branch at NASA/MSFC. The Predictive Simulation Capability (PSC) Element is focused on creating simulation capability for the reliable and accurate prediction of PSI in Martian (~650 Pa) and Lunar (vacuum) ambient environments. In addition to the predictive simulation capability, the GCD Program also contains a companion Ground Testing Element for development of focused datasets for validation of predictive capability as well as a Flight-focused Instrumentation Element. The focus of this paper is to provide an overview and a brief status on one area of capability development through this GCD PSI project - capturing the effects of mixed continuum/rarefied flow on crater development and ejecta sheets. This includes both capability enhancements and maturation of the predictive tool, Loci/GGFS, into a production capable tool as well as validation of the tool against PSI data in Martian and Lunar environments. There are six newly developed capabilities that will be production ready by the end of the fiscal year. Newly developed capabilities must first be verified prior to being production ready, and this process includes capability demonstration, solution verification, and performance evaluation. An overview of the newly developed capabilities with respect to several test cases, including cratering simulations of the Apollo Lunar Module, will be presented. Several validation analyses have been performed to validate in Martian and more Lunar-like environments, including simulations of cratering from a subsonic flow test at Planetary Aeolian Lab (PAL) conducted in a Martian-like environment and pre-test cratering predictions of Physics Focused Ground Test (PFGT) tests planned to be performed in Martian-like and more Lunar-like environments. An overview of these validation analyses as it pertains to the capability development will be presented.

Andrew Weaver↗
NASA NTRS2010

Lithosphere-Atmosphere-Ionosphere Coupling (LAIC) Model - An Unified Concept for Earthquake Precursors Validation

The paper presents a conception of complex multidisciplinary approach to the problem of clarification the nature of short-term earthquake precursors observed in atmosphere, atmospheric electricity and in ionosphere and magnetosphere. Our approach is based on the most fundamental principles of tectonics giving understanding that earthquake is an ultimate result of relative movement of tectonic plates and blocks of different sizes. Different kind of gases: methane, helium, hydrogen, and carbon dioxide leaking from the crust can serve as carrier gases for radon including underwater seismically active faults. Radon action on atmospheric gases is similar to the cosmic rays effects in upper layers of atmosphere: it is the air ionization and formation by ions the nucleus of water condensation. Condensation of water vapor is accompanied by the latent heat exhalation is the main cause for observing atmospheric thermal anomalies. Formation of large ion clusters changes the conductivity of boundary layer of atmosphere and parameters of the global electric circuit over the active tectonic faults. Variations of atmospheric electricity are the main source of ionospheric anomalies over seismically active areas. Lithosphere-Atmosphere-Ionosphere Coupling (LAIC) model can explain most of these events as a synergy between different ground surface, atmosphere and ionosphere processes and anomalous variations which are usually named as short-term earthquake precursors. A newly developed approach of Interdisciplinary Space-Terrestrial Framework (ISTF) can provide also a verification of these precursory processes in seismically active regions. The main outcome of this paper is the unified concept for systematic validation of different types of earthquake precursors united by physical basis in one common theory.

Pulinets, S.↗
NASA NTRS1994

Use of multiple gauges and microwave attenuation of precipitation for satellite verification

In this paper both a microwave attenuation measurement along a horizontal line and multiple point gauge measurements are analyzed as possible ground-truth designs to validate satellite precipitation retrieval algorithms at the field of view spatial level (typically about 20 km). The design consists of comparing a sequence of pairs of contemporaneous measurements taken from the ground and from space. The authors examine theoretically the variance of expected differences between the two systems. The line average measurement leads to a smaller mean-square error compared to the case of a single point gauge, since some of the small-scale variability of the rain field is smoothed away by the line integration. The multiple point gauge measurements also give smaller mean-square error than that of a single point gauge. The centroid of the line and point gauge configurations are considered to be located randomly inside the field of view for different overpasses. A space-time spectral formalism is used with a noise-forced diffusive rain field to find the mean-square error. By considering instantaneous ground and satellite measurement pairs over about 50 visits when raining, we can reduce the expected error to approximately 10% of the standard deviation of climatological variability. This is considered to be a useful level of tolerance for identifying biases in the retrieval algorithms. It is found that the multiple point gauges (especially two gauges) are the economical ground-truth design compared to the microwave attenuation based on the mean-square error comparison. The major finding of this study is that a significant improvement over the point gauge is obtained by adding a single additional piece of information; adding more gauges or extending the line of attenuation is not an important improvement.

Ha, Eunho↗
NASA NTRS1999

Aqueous Cleaning and Validation for Space Shuttle Propulsion Hardware at the White Sands Test Facility

The NASA White Sands Test Facility (WSTF) has developed an entirely aqueous final cleaning and verification process to replace the current chlorofluorocarbon (CFC) 113 based process. This process has been accepted for final cleaning and cleanliness verification of WSTF ground support equipment. The aqueous process relies on ultrapure water at 50 C (323 K) and ultrasonic agitation for removal of organic compounds and particulate. The cleanliness is verified bv determining the total organic carbon (TOC) content and filtration with particulate counting. The effectiveness of the aqueous methods for detecting hydrocarbon contamination and particulate was compared to the accepted CFC 113 sampling procedures. Testing with known contaminants, such as hydraulic fluid and cutting and lubricating oils, to establish a correlation between aqueous TOC and CFC 113 nonvolatile residue (NVR) was performed. Particulate sampling on cleaned batches of hardware that were randomly separated and sampled by the two methods was performed. This paper presents the approach and results, and discusses the issues in establishing the equivalence of aqueous sampling to CFC 113 sampling, while describing the approach for implementing aqueous techniques on Space Shuttle Propulsion hardware.

Hornung, Steven D.↗
NASA NTRS2001

Modeling and simulation for space medicine operations: preliminary requirements considered

The NASA Space Medicine program is now developing plans for more extensive use of high-fidelity medical simulation systems. The use of simulation is seen as means to more effectively use the limited time available for astronaut medical training. Training systems should be adaptable for use in a variety of training environments, including classrooms or laboratories, space vehicle mockups, analog environments, and in microgravity. Modeling and simulation can also provide the space medicine development program a mechanism for evaluation of other medical technologies under operationally realistic conditions. Systems and procedures need preflight verification with ground-based testing. Traditionally, component testing has been accomplished, but practical means for "human in the loop" verification of patient care systems have been lacking. Medical modeling and simulation technology offer potential means to accomplish such validation work. Initial considerations in the development of functional requirements and design standards for simulation systems for space medicine are discussed.

Non-programmatic↗
NASA NTRS2001

Requirements for Modeling and Simulation for Space Medicine Operations: Preliminary Considerations

The NASA Space Medicine program is now developing plans for more extensive use of high-fidelity medical Simulation systems. The use of simulation is seen as means to more effectively use the limited time available for astronaut medical training. Training systems should be adaptable for use in a variety of training environments, including classrooms or laboratories, space vehicle mockups, analog environments, and in microgravity. Modeling and simulation can also provide the space medicine development program a mechanism for evaluation of other medical technologies under operationally realistic conditions. Systems and procedures need preflight verification with ground-based testing. Traditionally, component testing has been accomplished, but practical means for "human in the loop" verification of patient care systems have been lacking. Medical modeling and simulation technology offer potential means to accomplish such validation work. Initial considerations in the development of functional requirements and design standards for simulation systems for space medicine are discussed.

Dawson, David L.↗
NASA NTRS2015

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗
NASA NTRS2024

Anthropometric Measurement Procedures at the Anthropometry and Biomechanics Facility

The Anthropometry and Biomechanics Facility (ABF) at NASA Johnson Space Center (JSC) is the centralized source of anthropometry data at NASA for use in requirement development, engineering design, and verification of human-system integrations such as spacesuits and vehicles. To ensure the collection of consistent, accurate, and valid anthropometry data, ABF has defined anthropometric measurements and anatomical landmarks which are generally based on the Anthropometric Survey for US Army Personnel (ANSUR), but with additional measurements which have been uniquely designed for spacesuit and hardware accommodation purposes. Unlike ANSUR, NASA anthropometry measurements primarily rely on 3D body scanning, a method which allows for explicitly defining the process of collecting measurements and the quality control methods used to ensure measurement reliability. In addition to ABF’s anthropometry measurement definitions and procedures, this presentation will also compare specifics of different measurement techniques ABF uses, for example, laser scanning versus manual measurement methods (e.g., tape measure or anthropometer-based), and the benefits and considerations of each method. The evolution of ABF’s measurement process will also be addressed, as new spaceflight programs have been introduced which have required unique measurements and the need to capture body shape changes over time was identified to be critical for spacesuit fit in some instances.

Garima Gupta↗
NASA NTRS2024

Anthropometric Measurement Procedures at the Anthropometry and Biomechanics Facility

The Anthropometry and Biomechanics Facility (ABF) at NASA Johnson Space Center (JSC) is the centralized source of anthropometry data at NASA for use in requirement development, engineering design, and verification of human-system integrations such as spacesuits and vehicles. To ensure the collection of consistent, accurate, and valid anthropometry data, ABF has defined anthropometric measurements and anatomical landmarks which are generally based on the Anthropometric Survey for US Army Personnel (ANSUR), but with additional measurements which have been uniquely designed for spacesuit and hardware accommodation purposes. Unlike ANSUR, NASA anthropometry measurements primarily rely on 3D body scanning, a method which allows for explicitly defining the process of collecting measurements and the quality control methods used to ensure measurement reliability. In addition to ABF’s anthropometry measurement definitions and procedures, this presentation will also compare specifics of different measurement techniques ABF uses, for example, laser scanning versus manual measurement methods (e.g., tape measure or anthropometer-based), and the benefits and considerations of each method. The evolution of ABF’s measurement process will also be addressed, as new spaceflight programs have been introduced which have required unique measurements and the need to capture body shape changes over time was identified to be critical for spacesuit fit in some instances.

Garima Gupta↗
NASA NTRS1982

Design, analysis, and test verification of advanced encapsulation systems

Design sensitivities are established for the development of photovoltaic module criteria and the definition of needed research tasks. The program consists of three phases. In Phase I, analytical models were developed to perform optical, thermal, electrical, and structural analyses on candidate encapsulation systems. From these analyses several candidate systems will be selected for qualification testing during Phase II. Additionally, during Phase II, test specimens of various types will be constructed and tested to determine the validity of the analysis methodology developed in Phase I. In Phse III, a finalized optimum design based on knowledge gained in Phase I and II will be developed. All verification testing was completed during this period. Preliminary results and observations are discussed. Descriptions of the thermal, thermal structural, and structural deflection test setups are included.

Mardesich, N.↗
NASA NTRS1998

Performance Testing of a Trace Contaminant Control Subassembly for the International Space Station

As part of the International Space Station (ISS) Trace Contaminant Control Subassembly (TCCS) development, a performance test has been conducted to provide reference data for flight verification analyses. This test, which used the U.S. Habitation Module (U.S. Hab) TCCS as the test article, was designed to add to the existing database on TCCS performance. Included in this database are results obtained during ISS development testing; testing of functionally similar TCCS prototype units; and bench scale testing of activated charcoal, oxidation catalyst, and granular lithium hydroxide (LiOH). The present database has served as the basis for the development and validation of a computerized TCCS process simulation model. This model serves as the primary means for verifying the ISS TCCS performance. In order to mitigate risk associated with this verification approach, the U.S. Hab TCCS performance test provides an additional set of data which serve to anchor both the process model and previously-obtained development test data to flight hardware performance. The following discussion provides relevant background followed by a summary of the test hardware, objectives, requirements, and facilities. Facility and test article performance during the test is summarized, test results are presented, and the TCCS's performance relative to past test experience is discussed. Performance predictions made with the TCCS process model are compared with the U.S. Hab TCCS test results to demonstrate its validation.

Perry, J. L.↗
NASA NTRSDate not supplied

Modeling Radiation Sources for Experimental Validation

To build on previously completed experimental work, I have been working to implement a model of our lab’s Americium-Beryllium neutron source and Ludlum detection instruments computationally to provide secondary verification of our experimental results. This has been done using the radiation transport code MCNP6 (Monte Carlo N-Particle). I have developed files to calculate the mass ratio of various composite materials that we have exposed to the radiation source, as well as the components of the detection instruments and converted all of these into geometric coordinates that define the experimental setup. Identifying the proper energy distribution and detector efficiencies as well as the correct interpretation of the detector physics have proven to be the most difficult and time-consuming challenges of the work. It is currently too early for results based on the most updated and accurate models. With this experience, the next step is to develop another source model of a proton beam to simulate exposures on other composite targets. This will be developed based on existing experimental datasets, but not used to validate them. Each of these projects will further define the radiation shielding needs for humans in space radiation environments that astronauts will someday be exposed to beyond Low Earth Orbit.

Juliana Simon↗
NASA NTRS2001

Theory Interpretations in PVS

The purpose of this task was to provide a mechanism for theory interpretations in a prototype verification system (PVS) so that it is possible to demonstrate the consistency of a theory by exhibiting an interpretation that validates the axioms. The mechanization makes it possible to show that one collection of theories is correctly interpreted by another collection of theories under a user-specified interpretation for the uninterpreted types and constants. A theory instance is generated and imported, while the axiom instances are generated as proof obligations to ensure that the interpretation is valid. Interpretations can be used to show that an implementation is a correct refinement of a specification, that an axiomatically defined specification is consistent, or that a axiomatically defined specification captures its intended models. In addition, the theory parameter mechanism has been extended with a notion of theory as parameter so that a theory instance can be given as an actual parameter to an imported theory. Theory interpretations can thus be used to refine an abstract specification or to demonstrate the consistency of an axiomatic theory. In this report we describe the mechanism in detail. This extension is a part of PVS version 3.0, which will be publicly released in mid-2001.

Owre, Sam↗
NASA NTRS2011

Control System Modeling for the Thirty Meter Telescope Primary Mirror

The Thirty Meter Telescope primary mirror is composed of 492 segments that are controlled to high precision in the presence of wind and vibration disturbances, despite the interaction with structural dynamics. The higher bandwidth and larger number of segments compared with the Keck telescopes requires greater attention to modeling to ensure success. We focus here on the development and validation of a suite of quasi-static and dynamic modeling tools required to support the design process, including robustness verification, performance estimation, and requirements flowdown. Models are used to predict the dynamic response due to wind and vibration disturbances, estimate achievable bandwidth in the presence of control-structure-interaction (CSI) and uncertainty in the interaction matrix, and simulate and analyze control algorithms and strategies, e.g. for control of focus-mode, and sensor calibration. Representative results illustrate TMT performance scaling with parameters, but the emphasis is on the modeling framework itself.

uncetainty↗
NASA NTRS2022

NESC GN&C TDT Best Practices: Design Requirements for Satisfactory Handling Qualities of a Piloted Spacecraft

This document describes work to determine a proposed set of concise design requirements for manned spacecraft to yield satisfactory handling qualities when the pilot is performing manual control. This is done primary via the analysis of various historic spacecraft. Partial requirements verification is performed via the creation of a simulated pilot used to determine limits of satisfactory vehicle performance. Partial requirements validation is per-formed via example conceptual design of a spacecraft that is compliant with all relevant proposed requirements.

Cooper-Harper↗