Development and Validation of the NASA Modified System Usability Scale (NMSUS): A Brief Summary
Explore the source record for details and available documents.
usability↗
SEARCH · Engineering Papers
Results for “verification and validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
International Space Station Microgravity Analytical Model Correlation And Update
The acceleration environment aboard the completed International Space Station (ISS) is a key resource for scientific and technological endeavors. Hardware verification activIties and early measurements indicate that the ISS is well on the way of meeting these "Assembly Complete" "microgravity" provisions, however, the simulation models that compute these accelerations have, to date, lacked the high degree of empirical validation typical of standard aerospace industry practices. Assembly stage, on-orbit measurements are used to address this shortcoming and to develop higher confidence in the simulation models. The Phase I correlation results show the analyses to be consistently conservative, producing higher than measured levels. The 25 to 30% greater quasi-steady computations are deemed acceptable for verification. Updates are made to localized structural dynamic and vibroacoustic parameters that reduce responses in selected one-third octave bands by almost 50%. These models are then used for the Assembly Complete verification analysis which concludes that the ISS vehicle meets the ISS microgravity requirements with minor reservations. Two of the sixteen rack are marginally non-compliant in the quasi-steady regime, and operational constraints are needed on the U. S. Lab and ESA APM vacuum resource vents, and the Russian Resistive Exercise Device in the structural dynamic regime.
DelBasso, Steve↗
Motion simulator study of longitudinal stability requirements for large delta wing transport airplanes during approach and landing with stability augmentation systems failed
A ground-based simulator investigation was conducted in preparation for and correlation with an-flight simulator program. The objective of these studies was to define minimum acceptable levels of static longitudinal stability for landing approach following stability augmentation systems failures. The airworthiness authorities are presently attempting to establish the requirements for civil transports with only the backup flight control system operating. Using a baseline configuration representative of a large delta wing transport, 20 different configurations, many representing negative static margins, were assessed by three research test pilots in 33 hours of piloted operation. Verification of the baseline model to be used in the TIFS experiment was provided by computed and piloted comparisons with a well-validated reference airplane simulation. Pilot comments and ratings are included, as well as preliminary tracking performance and workload data.
Snyder, C. T.↗
STS-99 Shuttle Radar Topography Mission Stability and Control
The Shuttle Radar Topography Mission (SRTM) flew aboard Space Shuttle Endeavor February 2000 and used interferometry to map 80% of the Earth's landmass. SRTM employed a 200-foot deployable mast structure to extend a second antenna away from the main antenna located in the Shuttle payload bay. Mapping requirements demanded precision pointing and orbital trajectories from the Shuttle on-orbit Flight Control System (PCS). Mast structural dynamics interaction with the FCS impacted stability and performance of the autopilot for attitude maneuvers and pointing during mapping operations. A damper system added to ensure that mast tip motion remained with in the limits of the outboard antenna tracking system while mapping also helped to mitigate structural dynamic interaction with the FCS autopilot. Late changes made to the payload damper system, which actually failed on-orbit, required a redesign and verification of the FCS autopilot filtering schemes necessary to ensure rotational control stability. In-flight measurements using three sensors were used to validate models and gauge the accuracy and robustness of the pre-mission notch filter design.
Hamelin, Jennifer L.↗
Advanced Mirror Technology Development (AMTD): Year Five Status
The Advanced Mirror Technology Development (AMTD) project is in Phase 2 of a multiyear effort initiated in Fiscal Year (FY) 2012, to mature the Technology Readiness Level (TRL) of critical technologies required to enable 4-m-or-larger monolithic or segmented ultraviolet, optical, and infrared (UVOIR) space telescope primary-mirror assemblies for general astrophysics, ultra-high-contrast observations of exoplanets, and National Interest missions. Key accomplishments of 2016/17 include the completion of the Harris Corp approximately 150 Hz 1.5-meter Ultra-Low Expansion (ULE Registered trademark) mirror substrate using stacked core method to demonstrate lateral stability of the stacked core technology, as well as the characterization and validation by test of the mechanical and thermal performance of the 1.2-meter Zerodur (Registered trademark) mirror using the STOP model prediction and verification of CTE homogeneity.
Space Mirror Technology↗
Beyond Guesswork: Code Verification for Acoustic Duct Mode Prediction
The code used in the work (Swirl) is a frequency-domain linearized Euler equation solver that is designed to predict the effect of acoustic liners on acoustic modes propagating in realistic sheared and swirling mean flows, guiding the design of more efficient liner configurations. The purpose of this study is to validate Swirl using the Method Of Manufactured Solutions (MMS). This study also investigated the effect of the integration and spatial differencing methods on the convergence for a given Manufactured Solution. In addition, the effect of boundary condition implementation was tested. Through rigorous validation of the Swirl code using the MMS, this research underscores the significance of integration and spatial differencing methods on convergence, evaluates boundary condition implementations, and systematically assesses the impact of various filters.
Code Verification↗
Fluid Structure Interaction of Parachutes in Supersonic Planetary Entry
A research program to provide physical insight into disk-gap-band parachute operation in the supersonic regime on Mars was conducted. The program included supersonic wind tunnel tests, computational fluid dynamics and fluid structure interaction simulations. Specifically, the nature and cause of the "area oscillation" phenomenon were investigated to determine the scale, aerodynamic, and aero-elastic dependence of the supersonic parachute collapse and re-inflation event. A variety of non-intrusive, temporally resolved, and high resolution diagnostic techniques were used to interrogate the flow and generate validation datasets. The results of flow visualization, particle image velocimetry, load measurements, and photogrammetric reconstruction will be presented. Implications to parachute design, use, and verification will also be discussed.
parachute↗
Large liquid rocket engine transient performance simulation system
Phase 1 of the Rocket Engine Transient Simulation (ROCETS) program consists of seven technical tasks: architecture; system requirements; component and submodel requirements; submodel implementation; component implementation; submodel testing and verification; and subsystem testing and verification. These tasks were completed. Phase 2 of ROCETS consists of two technical tasks: Technology Test Bed Engine (TTBE) model data generation; and system testing verification. During this period specific coding of the system processors was begun and the engineering representations of Phase 1 were expanded to produce a simple model of the TTBE. As the code was completed, some minor modifications to the system architecture centering on the global variable common, GLOBVAR, were necessary to increase processor efficiency. The engineering modules completed during Phase 2 are listed: INJTOO - main injector; MCHBOO - main chamber; NOZLOO - nozzle thrust calculations; PBRNOO - preburner; PIPE02 - compressible flow without inertia; PUMPOO - polytropic pump; ROTROO - rotor torque balance/speed derivative; and TURBOO - turbine. Detailed documentation of these modules is in the Appendix. In addition to the engineering modules, several submodules were also completed. These submodules include combustion properties, component performance characteristics (maps), and specific utilities. Specific coding was begun on the system configuration processor. All functions necessary for multiple module operation were completed but the SOLVER implementation is still under development. This system, the Verification Checkout Facility (VCF) allows interactive comparison of module results to store data as well as provides an intermediate checkout of the processor code. After validation using the VCF, the engineering modules and submodules were used to build a simple TTBE.
Mason, J. R.↗
Scientific goals of the Cooperative Multiscale Experiment (CME)
Mesoscale Convective Systems (MCS) form the focus of CME. Recent developments in global climate models, the urgent need to improve the representation of the physics of convection, radiation, the boundary layer, and orography, and the surge of interest in coupling hydrologic, chemistry, and atmospheric models of various scales, have emphasized the need for a broad interdisciplinary and multi-scale approach to understanding and predicting MCS's and their interactions with processes at other scales. The role of mesoscale systems in the large-scale atmospheric circulation, the representation of organized convection and other mesoscale flux sources in terms of bulk properties, and the mutually consistent treatment of water vapor, clouds, radiation, and precipitation, are all key scientific issues concerning which CME will seek to increase understanding. The manner in which convective, mesoscale, and larger scale processes interact to produce and organize MCS's, the moisture cycling properties of MCS's, and the use of coupled cloud/mesoscale models to better understand these processes, are also major objectives of CME. Particular emphasis will be placed on the multi-scale role of MCS's in the hydrological cycle and in the production and transport of chemical trace constituents. The scientific goals of the CME consist of the following: understand how the large and small scales of motion influence the location, structure, intensity, and life cycles of MCS's; understand processes and conditions that determine the relative roles of balanced (slow manifold) and unbalanced (fast manifold) circulations in the dynamics of MCS's throughout their life cycles; assess the predictability of MCS's and improve the quantitative forecasting of precipitation and severe weather events; quantify the upscale feedback of MCS's to the large-scale environment and determine interrelationships between MCS occurrence and variations in the large-scale flow and surface forcing; provide a data base for initialization and verification of coupled regional, mesoscale/hydrologic, mesoscale/chemistry, and prototype mesoscale/cloud-resolving models for prediction of severe weather, ceilings, and visibility; provide a data base for initialization and validation of cloud-resolving models, and for assisting in the fabrication, calibration, and testing of cloud and MCS parameterization schemes; and provide a data base for validation of four dimensional data assimilation schemes and algorithms for retrieving cloud and state parameters from remote sensing instrumentation.
Cotton, William↗
The Solid Rocket Motor Slag Population: Results of a Radar-Based Regressive Statistical Evaluation
Solid rocket motor (SRM) slag has been identified as a potential source of man-made orbital debris. The possibility that SRMs (in addition to generating dust particles in the sub-millimeter range) may generate particles up to centimeters in size has caused concern regarding their contribution to the debris environment. Returned surfaces from space do not have sufficient area or exposure time to provide a clear picture of the SRM millimeter and centimeter debris population. Currently, radar observation is probably the only way to collect data showing the debris contribution from SRMs. Such observation is used to sample the debris environment, but it is difficult to obtain accurate orbital elements for the detected debris objects. NASA has developed several models to describe the different orbital debris populations, based on assumed debris production mechanisms to create clouds of debris objects that can be propagated in time. The NASA model, LEGEND (LEO-to-GEO Environment Debris), functions as a time-tested debris model for most debris sources. However, the current LEGEND model does not include contributions from the SRM population. An SRM model has recently been developed by NASA, based on purely theoretical details of SRM production and known SRM launches, but verification with hard data is needed. Because the detections of individual SRM objects cannot be deterministically separated from the total debris observed by radar, the validation of the SRM model can only be done by combining it with the LEGEND breakup model and comparing it with data. By applying observational constraints, the degree of SRM slag contribution to the environment may be estimated. This serves as an observationally sound method from which to calibrate a purely theoretical model into something more realistic. For this study, we use the populations observed by the Haystack radar from 1996 to present. For the SRM debris, we use a historical database of SRM launches, propellant masses, and estimated locations and times of tailoff to produce and propagate the SRM debris clouds. Comparisons with radar data from the ensuing years were made, and the SRM model was altered with respect to size and mass production of slag particles to reflect the populations estimated from the data. The result is a model SRM population that fits within the bounds of the observed environment and estimates of the production and contribution of SRM debris to the environment.
Horstman, Matthew F.↗
Application of FUN3D and CFL3D to the Third Workshop on CFD Uncertainty Analysis
Two Reynolds-averaged Navier-Stokes computer codes - one unstructured and one structured - are applied to two workshop cases (for the 3rd Workshop on CFD Uncertainty Analysis, held at Instituto Superior Tecnico, Lisbon, in October 2008) for the purpose of uncertainty analysis. The Spalart-Allmaras turbulence model is employed. The first case uses the method of manufactured solution and is intended as a verification case. In other words, the CFD solution is expected to approach the exact solution as the grid is refined. The second case is a validation case (comparison against experiment), for which modeling errors inherent in the turbulence model and errors/uncertainty in the experiment may prevent close agreement. The results from the two computer codes are also compared. This exercise verifies that the codes are consistent both with the exact manufactured solution and with each other. In terms of order property, both codes behave as expected for the manufactured solution. For the backward facing step, CFD uncertainty on the finest grid is computed and is generally very low for both codes (whose results are nearly identical). Agreement with experiment is good at some locations for particular variables, but there are also many areas where the CFD and experimental uncertainties do not overlap.
Rumsey, C. L.↗
Validation of scramjet exhaust simulation technique at Mach 6
Current design philosophy for hydrogen-fueled, scramjet-powered hypersonic aircraft results in configurations with strong couplings between the engine plume and vehicle aerodynamics. The experimental verification of the scramjet exhaust simulation is described. The scramjet exhaust was reproduced for the Mach 6 flight condition by the detonation tube simulator. The exhaust flow pressure profiles, and to a large extent the heat transfer rate profiles, were then duplicated by cool gas mixtures of Argon and Freon 13B1 or Freon 12. The results of these experiments indicate that a cool gas simulation of the hot scramjet exhaust is a viable simulation technique except for phenomena which are dependent on the wall temperature relative to flow temperature.
Hopkins, H. B.↗
A Flexible Statechart-to-model-checker Translator
Many current-day software design tools offer some variant of statechart notation for system specification. We, like others, have built an automatic translator from (a subset of) statecharts to a model checker, for use to validate behavioral requirements.
statecharts↗
Cryo Testing of tbe James Webb Space Telescope's Integrated Science Instrument Module
The Integrated Science Instrument Module (ISIM) of the James Webb Space Telescope will be integrated and tested at the Environmental Test Facilities at Goddard Space Flight Center (GSFC). The cryogenic thermal vacuum testing of the ISIM will be the most difficult and problematic portion of the GSFC Integration and Test flow. The test is to validate the coupled interface of the science instruments and the ISIM structure and to sufficiently stress that interface while validating image quality of the science instruments. The instruments and the structure are not made from the same materials and have different CTE. Test objectives and verification rationale are currently being evaluated in Phase B of the project plan. The test program will encounter engineering challenges and limitations, which are derived by cost and technology many of which can be mitigated by facility upgrades, creative GSE, and thorough forethought. The cryogenic testing of the ISIM will involve a number of risks such as the implementation of unique metrology techniques, mechanical, electrical and optical simulators housed within the cryogenic vacuum environment. These potential risks are investigated and possible solutions are proposed.
VanCampen, Julie↗
NASA's Commercial Crew Program, the Next Step in U.S. Space Transportation
The Commercial Crew Program (CCP) is leading NASA's efforts to develop the next U.S. capability for crew transportation and rescue services to and from the International Space Station (ISS) by the middecade timeframe. The outcome of this capability is expected to stimulate and expand the U.S. space transportation industry. NASA is relying on its decades of human space flight experience to certify U.S. crewed vehicles to the ISS and is doing so in a two phase certification approach. NASA certification will cover all aspects of a crew transportation system, including: Development, test, evaluation, and verification. Program management and control. Flight readiness certification. Launch, landing, recovery, and mission operations. Sustaining engineering and maintenance/upgrades. To ensure NASA crew safety, NASA certification will validate technical and performance requirements, verify compliance with NASA requirements, validate that the crew transportation system operates in the appropriate environments, and quantify residual risks. The Commercial Crew Program will present progress to date and how it manages safety and reduces risk.
Mango, Edward J., Jr.↗
NASA's Commercial Crew Program, The Next Step in U.S. Space Transportation
The Commercial Crew Program (CCP) is leading NASA's efforts to develop the next U.S. capability for crew transportation and rescue services to and from the International Space Station (ISS) by the mid-decade timeframe. The outcome of this capability is expected to stimulate and expand the U.S. space transportation industry. NASA is relying on its decades of human space flight experience to certify U.S. crewed vehicles to the ISS and is doing so in a two phase certification approach. NASA Certification will cover all aspects of a crew transportation system, including development, test, evaluation, and verification; program management and control; flight readiness certification; launch, landing, recovery, and mission operations; sustaining engineering and maintenance/upgrades. To ensure NASA crew safety, NASA Certification will validate technical and performance requirements, verify compliance with NASA requirements, validate the crew transportation system operates in appropriate environments, and quantify residual risks.
Mango, Edward J.↗
SEDS1 mission software verification using a signal simulator
The first flight of the Small Expendable Deployer System (SEDS1) is schedule to fly as the secondary payload of a Delta 2 in March, 1993. The objective of the SEDS1 mission is to collect data to validate the concept of tethered satellite systems and to verify computer simulations used to predict their behavior. SEDS1 will deploy a 50 lb. instrumented satellite as an end mass using a 20 km tether. Langley Research Center is providing the end mass instrumentation, while the Marshall Space Flight Center is designing and building the deployer. The objective of the experiment is to test the SEDS design concept by demonstrating that the system will satisfactorily deploy the full 20 km tether without stopping prematurely, come to a smooth stop on the application of a brake, and cut the tether at the proper time after it swings to the local vertical. Also, SEDS1 will collect data which will be used to test the accuracy of tether dynamics models used to stimulate this type of deployment. The experiment will last about 1.5 hours and complete approximately 1.5 orbits. Radar tracking of the Delta II and end mass is planned. In addition, the SEDS1 on-board computer will continuously record, store, and transmit mission data over the Delta II S-band telemetry system. The Data System will count tether windings as the tether unwinds, log the times of each turn and other mission events, monitor tether tension, and record the temperature of system components. A summary of the measurements taken during the SEDS1 are shown. The Data System will also control the tether brake and cutter mechanisms. Preliminary versions of two major sections of the flight software, the data telemetry modules and the data collection modules, were developed and tested under the 1990 NASA/ASEE Summer Faculty Fellowship Program. To facilitate the debugging of these software modules, a prototype SEDS Data System was programmed to simulate turn count signals. During the 1991 summer program, the concept of simulating signals produced by the SEDS electronics systems and circuits was expanded and more precisely defined. During the 1992 summer program, the SEDS signal simulator was programmed to test the requirements of the SEDS Mission software, and this simulator will be used in the formal verification of the SEDS Mission Software. The formal test procedures specification was written which incorporates the use of the signal simulator to test the SEDS Mission Software and which incorporates procedures for testing the other major component of the SEDS software, the Monitor Software.
Pierson, William E.↗
GPS and Galileo Developments on Board the International Space Station With the Space Communications and Navigation (SCaN) Testbed
The Space Communications and Navigation (SCaN) is a facility developed by NASA and hosted on board the International Space Station (ISS) on an external truss since 2013.It has the objective of testing navigation and communication experimentations with a Software Defined Radio (SDR) approach, which permits software updates for testing new experimentations.NASA has developed the Space Telecommunications Radio System (STRS) architecture standard for SDRs used in space and ground-based platforms to provide commonality among radio developments to provide enhanced capability. The hardware is equipped with both L band front-end radios and the NASA space network communicates with it using S-band, Ku-band and Ka-band links.In May 2016 Qascom started GARISS (GPS and Galileo Receiver for the ISS), an activity of experimentation in collaboration with ESA and NASA that has the objective to develop and validate the acquisition and processing of combined GPS and Galileo signals on board the ISS SCaN testbed. This paper has the objective to present the mission, and provide preliminary details about the challenges in the design, development and verification of the waveform that will be installed on equipment with limited resources. GARISS is also the first attempt to develop a waveform for the ISS as part of an international collaboration between US and Europe. Although the final mission objective is to target dual frequency processing, initial operations will foresee a single frequency processing. Initial results and trade-off between the two options, as well as the final decision will be presented and discussed. The limited resources on board the SCaN with respect to the challenging requirements to acquire and track contemporaneously two satellite navigation systems, with different modulations and data structure, led to the need to assess the possibility of aiding from ground through the S-band. This option would allow assistance to the space receiver in order to provide knowledge of GNSS orbits and reduce the processing on board. Trade off and various options for telemetry and uplink data are presented and discussed. Finally, integration and validation of the waveform are one of the major challenges of GARISS: The Experiment Development System (EDS) and the the Ground Integration Unit (GIU) for VV will be used prior to conducting the experiment on the ISS. The EDS can be used in lab environment and allows prototyping and verification activities with the simulator, but does not include all hardware components. The GIU on the other side is the flight model which replicates the flying equipment, but has limited flexibility for testing.As conclusion, the project is now approaching the Preliminary Design Review (PDR) and indeed only preliminary results are available. This paper is an opportunity to present the GARISS mission as part of an International cooperation between ESA, NASA and Qascom. The preliminary results include GPS and Galileo processing from space signals, the challenges and trade off decisions, the high level STRS architecture and foreseen experimentation campaign. Detailed results from the test campaigns are expected in 2017.
space navigation↗