Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “QA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

The Role of Independent V&V in Upstream Software Development Processes

This paper describes the role of Verification and Validation (V&V) during the requirements and high level design processes, and in particular the role of Independent V&V (IV&V). The job of IV&V during these phases is to ensure that the requirements are complete, consistent and valid, and to ensure that the high level design meets the requirements. This contrasts with the role of Quality Assurance (QA), which ensures that appropriate standards and process models are defined and applied. This paper describes the current state of practice for IV&V, concentrating on the process model used in NASA projects. We describe a case study, showing the processes by which problem reporting and tracking takes place, and how IV&V feeds into decision making by the development team. We then describe the problems faced in implementing IV&V. We conclude that despite a well defined process model, and tools to support it, IV&V is still beset by communication and coordination problems.

Easterbrook, Steve↗
NASA NTRS1991

NASA Software Documentation Standard

The NASA Software Documentation Standard (hereinafter referred to as "Standard") is designed to support the documentation of all software developed for NASA; its goal is to provide a framework and model for recording the essential information needed throughout the development life cycle and maintenance of a software system. The NASA Software Documentation Standard can be applied to the documentation of all NASA software. The Standard is limited to documentation format and content requirements. It does not mandate specific management, engineering, or assurance standards or techniques. This Standard defines the format and content of documentation for software acquisition, development, and sustaining engineering. Format requirements address where information shall be recorded and content requirements address what information shall be recorded. This Standard provides a framework to allow consistency of documentation across NASA and visibility into the completeness of project documentation. The basic framework consists of four major sections (or volumes). The Management Plan contains all planning and business aspects of a software project, including engineering and assurance planning. The Product Specification contains all technical engineering information, including software requirements and design. The Assurance and Test Procedures contains all technical assurance information, including Test, Quality Assurance (QA), and Verification and Validation (V&V). The Management, Engineering, and Assurance Reports is the library and/or listing of all project reports.

Source record↗
NASA NTRS1998

MODIS Science Team Member Semi-annual Report

This paper presents a semi-annual report of the MODerate resolution imaging Spectroradiometer (MODIS) Science Team Members. The most important activities undertaken during this reporting period are the following: 1) Versions 2.1 and 2.2 surface reflectance L2/L3 DAAC/SDST delivery; 2) Version 2.0 1km and 250m VI product delivery (assist Arizona); 3) Version 2.1 surface reflectance L2 testing; 4) Land Synthetic data set generator improvements; 5) QA; 6) Surface reflectance error budget generation (SWAMP request); 7) SCF Hardware; 8) Aerosol transport modeling; 9) Aerosol optical depth retrieval from AVHRR data; 10) Aerosol characteristics retrieval from SeaWIFS/AVHRR fusioned data; 11) Validation activities; 12) Aerosol climatology; and 13) 6S code. The report includes summaries of the topics above.

Vermote, Eric↗
NASA NTRS2000

System Risk Balancing Profiles: Software Component

The Software QA / V&V guide will be reviewed and updated based on feedback from NASA organizations and others with a vested interest in this area. Hardware, EEE Parts, Reliability, and Systems Safety are a sample of the future guides that will be developed. Cost Estimates, Lessons Learned, Probability of Failure and PACTS (Prevention, Avoidance, Control or Test) are needed to provide a more complete risk management strategy. This approach to risk management is designed to help balance the resources and program content for risk reduction for NASA's changing environment.

Kelly, John C.↗
NASA NTRS2001

MODIS Snow-Cover Products

On December 18, 1999, the Terra satellite was launched with a complement of five instruments including the Moderate Resolution Imaging Spectroradiometer (MODIS). Many geophysical products are derived from MODIS data including global snow-cover products. These products have been available through the National Snow and Ice Data Center (NSIDC) Distributed Active Archive Center (DAAC) since September 13, 2000. MODIS snow-cover products represent potential improvement to the currently available operation products mainly because the MODIS products are global and 500-m resolution, and have the capability to separate most snow and clouds. Also the snow-mapping algorithms are automated which means that a consistent data set is generated for long-term climates studies that require snow-cover information. Extensive quality assurance (QA) information is stored with the product. The snow product suite starts with a 500-m resolution swath snow-cover map which is gridded to the Integerized Sinusoidal Grid to produce daily and eight-day composite tile products. The sequence then proceeds to a climate-modeling grid product at 5-km spatial resolution, with both daily and eight-day composite products. A case study from March 6, 2000, involving MODIS data and field and aircraft measurements, is presented. Near-term enhancements include daily snow albedo and fractional snow cover.

Hall, Dorothy K.↗
NASA NTRS2000

Model-Based Testability Assessment and Directed Troubleshooting of Shuttle Wiring Systems

We have recently completed a pilot study on the Space shuttle wiring system commissioned by the Wiring Integrity Research (WIRe) team at NASA Ames Research Center, As the space shuttle ages, it is experiencing wiring degradation problems including arcing, chaffing insulation breakdown and broken conductors. A systematic and comprehensive test process is required to thoroughly test and quality assure (QA) the wiring systems. The NASA WIRe team recognized the value of a formal model based analysis for risk-assessment and fault coverage analysis. However. wiring systems are complex and involve over 50,000 wire segments. Therefore, NASA commissioned this pilot study with Qualtech Systems. Inc. (QSI) to explore means of automatically extracting high fidelity multi-signal models from wiring information database for use with QSI's Testability Engineering and Maintenance System (TEAMS) tool.

Deb, Somnath↗
NASA NTRS2001

Evaporation/SST Sensitivity Over the Tropical Oceans During ENSO Events as Estimated from the da Silva, Young, Levitus Surface Marine Data Set

The da Silva, Young and Levitus Surface Marine Atlas, based on observations from the Comprehensive Ocean Atmosphere Data Set (COADS) Release 1, has been used to investigate the relationship between evaporation and sea-surface temperature (SST) over the global oceans. For the period 1950 to 1987 SST, surface latent heat flux, and other related variables have been filtered to minimize data uncertainties and to focus upon interannual variations associated with warm (El Nino) and cold (La Nina) ENSO events. Compositing procedures have enabled identification of systematic variations in latent heat fluxes accompanying these events and the relationship to spatial anomalies in ocean surface wind speed and humidity. The evaporation response associated with ENSO sea surface temperature (SST) variability is systematic in nature and composed of offsetting contributions from the surface wind and humidity variations. During warm events exceeding 1.0 S.D. delta SST, increases in the surface humidity deficit, delta(qs-qa), between the surface and 2m height dominate regions of positive SST anomalies and lead to increases in evaporation of almost 2 Wm (exp -2) at deltaSST = 0.23 K. Despite the increases in specific humidity, relative humidity decreases slightly in regions of elevated SSTs. For the most part, variations in wind speed are consistent with previous investigations. Weakening of the equatorial easterlies (and generation of westerlies) between 160 degrees E and 140 degrees W dominates during the early phases of warm events. Elevated wind speeds in adjacent subtropical regions and in the eastern equatorial Pacific subsequently develop too. The net contribution of these winds, which reflect adjustments in Hadley and Walker circulation components is toward reduced evaporation. Results for cold periods are approximately similar, but opposite in sign to warm events, though evidence of different temporal evolution is noted.

Robertson, F. R.↗
NASA NTRS2002

MODIS Snow-Cover Products

On December 18, 1999, the Terra satellite was launched with a complement of five instruments including the Moderate Resolution Imaging Spectroradiometer (MODIS). Many geophysical products are derived from MODIS data including global snow-cover products. MODIS snow and ice products have been available through the National Snow and Ice Data Center (NSIDC) Distributed Active Archive Center (DAAC) since September 13, 2000. MODIS snow-cover products represent potential improvement to or enhancement of the currently-available operational products mainly because the MODIS products are global and 500-m resolution, and have the capability to separate most snow and clouds. Also the snow-mapping algorithms are automated which means that a consistent data set may be generated for long-term climate studies that require snow-cover information. Extensive quality assurance (QA) information is stored with the products. The MODIS snow product suite begins with a 500-m resolution, 2330-km swath snow-cover map which is then gridded to an integerized sinusoidal grid to produce daily and 8-day composite tile products. The sequence proceeds to a climate-modeling grid (CMG) product at about 5.6-km spatial resolution, with both daily and 8-day composite products. Each pixel of the CMG contains fraction of snow cover from 40 - 100%. Measured errors of commission in the CMG are low, for example, on the continent of Australia in the spring, they vary from 0.02 - 0.10%. Near-term enhancements include daily snow albedo and fractional snow cover. A case study from March 6, 2000, involving MODIS data and field and aircraft measurements, is presented to show some early validation work.

Hall, Dorothy K.↗
NASA NTRS2002

A Study of Uncertainties for MODIS Cloud Retrievals of Optical Thickness and Effective Radius

The investigation spanned four linked components as summarized in section III, each relating to some aspect of uncertainty assessment in the retrieval of cloud optical and microphysical properties using solar reflectance algorithms such as the MODIS operational cloud product (product IDS MOD06, MDY06 for Terra and Aqua, respectively). As discussed, three of these components have been fully completed (items (l), (2), and (3) while item (4) has been partially completed. These efforts have resulted in peer-reviewed publications and/or information delivered to the MODIS P.I. (M. D. King) for inclusion in the cloud product Quality Assessment (QA) output, a portion of the product output used, in part, for retrieval error assignments. This final report begins with a synopsis of the proposed investigation (section III) followed by a summary of work performed up through the last report including updates (section IV). Section V describes new activities. Publications from the efforts are listed in section VI. Figures (available in powerpoint format) are found in section VII.

Platnick, Steven↗
NASA NTRS2002

Integrating Formal Methods and Testing 2002

Traditionally, qualitative program verification methodologies and program testing are studied in separate research communities. None of them alone is powerful and practical enough to provide sufficient confidence in ultra-high reliability assessment when used exclusively. Significant advances can be made by accounting not only tho formal verification and program testing. but also the impact of many other standard V&V techniques, in a unified software reliability assessment framework. The first year of this research resulted in the statistical framework that, given the assumptions on the success of the qualitative V&V and QA procedures, significantly reduces the amount of testing needed to confidently assess reliability at so-called high and ultra-high levels (10-4 or higher). The coming years shall address the methodologies to realistically estimate the impacts of various V&V techniques to system reliability and include the impact of operational risk to reliability assessment. Combine formal correctness verification, process and product metrics, and other standard qualitative software assurance methods with statistical testing with the aim of gaining higher confidence in software reliability assessment for high-assurance applications. B) Quantify the impact of these methods on software reliability. C) Demonstrate that accounting for the effectiveness of these methods reduces the number of tests needed to attain certain confidence level. D) Quantify and justify the reliability estimate for systems developed using various methods.

Cukic, Bojan↗
NASA NTRS2004

Archive and Analysis of Data Collected Aboard the University of Washington's Convair-580 Research Aircraft in CLAMS

Work under this grant has been concerned with: (a) quality-assurance (QA) checking of the data collected on the University of Washington s (UW) Convair- 580 in the Chesapeake Lighthouse and Measurements for Satellites (CLAMS) field study in the Summer of 2001, (b) providing these data to the Langley DAAC, (c) providing specific data to users as requested, (d) analysis of portions of the data and publication of results, and (e) presentation of CLAMS results at workshop and conferences.

Hobbs, Peter V.↗
NASA NTRS2004

Random Matrix Approach to Quantum Adiabatic Evolution Algorithms

We analyze the power of quantum adiabatic evolution algorithms (Q-QA) for solving random NP-hard optimization problems within a theoretical framework based on the random matrix theory (RMT). We present two types of the driven RMT models. In the first model, the driving Hamiltonian is represented by Brownian motion in the matrix space. We use the Brownian motion model to obtain a description of multiple avoided crossing phenomena. We show that the failure mechanism of the QAA is due to the interaction of the ground state with the "cloud" formed by all the excited states, confirming that in the driven RMT models. the Landau-Zener mechanism of dissipation is not important. We show that the QAEA has a finite probability of success in a certain range of parameters. implying the polynomial complexity of the algorithm. The second model corresponds to the standard QAEA with the problem Hamiltonian taken from the Gaussian Unitary RMT ensemble (GUE). We show that the level dynamics in this model can be mapped onto the dynamics in the Brownian motion model. However, the driven RMT model always leads to the exponential complexity of the algorithm due to the presence of the long-range intertemporal correlations of the eigenvalues. Our results indicate that the weakness of effective transitions is the leading effect that can make the Markovian type QAEA successful.

Boulatov, Alexei↗
NASA NTRS2005

The Second SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-2)

Eight international laboratories specializing in the determination of marine pigment concentrations using high performance liquid chromatography (HPLC) were intercompared using in situ samples and a variety of laboratory standards. The field samples were collected primarily from eutrophic waters, although mesotrophic waters were also sampled to create a dynamic range in chlorophyll concentration spanning approximately two orders of magnitude (0.3 25.8 mg m-3). The intercomparisons were used to establish the following: a) the uncertainties in quantitating individual pigments and higher-order variables (sums, ratios, and indices); b) an evaluation of spectrophotometric versus HPLC uncertainties in the determination of total chlorophyll a; and c) the reduction in uncertainties as a result of applying quality assurance (QA) procedures associated with extraction, separation, injection, degradation, detection, calibration, and reporting (particularly limits of detection and quantitation). In addition, the remote sensing requirements for the in situ determination of total chlorophyll a were investigated to determine whether or not the average uncertainty for this measurement is being satisfied. The culmination of the activity was a validation of the round-robin methodology plus the development of the requirements for validating an individual HPLC method. The validation process includes the measurements required to initially demonstrate a pigment is validated, and the measurements that must be made during sample analysis to confirm a method remains validated. The so-called performance-based metrics developed here describe a set of thresholds for a variety of easily-measured parameters with a corresponding set of performance categories. The aggregate set of performance parameters and categories establish a) the overall performance capability of the method, and b) whether or not the capability is consistent with the required accuracy objectives.

Source record↗
NASA NTRS2007

Generating a Long-Term Land Data Record from the AVHRR and MODIS Instruments

The goal of NASA's Land Long Term Iiata Record (LTDR) project is to produce a consistent long term data set from the AVHRR and MODIS instruments for land climate studies. The project will create daily surface reflectance and normalized difference vegetation index (NDVI) products at a resolution of 0.05 deg., which is identical to the Climate Modeling Grid (CMG) used for MODIS products from EOS Terra and Aqua. Higher order products such as burned area, land surface temperature, albedo, bidirectional reflectance distribution function (BRDF) correction, leaf area index (LAI), and fraction of photosyntheticalIy active radiation absorbed by vegetation (fPAR), will be created. The LTDR project will reprocess Global Area Coverage (GAC) data from AVHRR sensors onboard NOAA satellites by applying the preprocessing improvements identified in the AVHRR Pathfinder Il project and atmospheric and BRDF corrections used in MODIS processing. The preprocessing improvements include radiometric in-flight vicarious calibration for the visible and near infrared channels and inverse navigation to relate an Earth location to each sensor instantaneous field of view (IFOV). Atmospheric corrections for Rayleigh scattering, ozone, and water vapor are undertaken, with aerosol correction being implemented. The LTDR also produces a surface reflectance product for channel 3 (3.75 micrometers). Quality assessment (QA) is an integral part of the LTDR production system, which is monitoring temporal trands in the AVHRR products using time-series approaches developed for MODIS land product quality assessment. The land surface reflectance products have been evaluated at AERONET sites. The AVHRR data record from LTDR is also being compared to products from the PAL (Pathfinder AVHRR Land) and GIMMS (Global Inventory Modeling and Mapping Studies) systems to assess the relative merits of this reprocessing vis-a-vis these existing data products. The LTDR products and associated information can be found at http://ltdr.nascom.nasa.gov/ltdr/ltdr.html.

Pedelty, Jeffrey↗
NASA NTRS2008

Lunar RFC Reliability Testing for Assured Mission Success

NASA's Constellation program has selected the closed cycle hydrogen oxygen Polymer Electrolyte Membrane (PEM) regenerative Fuel Cell (RFC) as its baseline solar energy storage system for the lunar outpost and manned rover vehicles. Since the outpost and manned rovers are "human-rated", these energy storage systems will have to be of proven reliability exceeding 99 percent over the length of the mission. Because of the low (TRL=5) development state of the closed cycle hydrogen oxygen PEM RFC at present, and because there is no equivalent technology base in the commercial sector from which to draw or infer reliability information from, NASA will have to spend significant resources developing this technology from TRL 5 to TRL 9, and will have to embark upon an ambitious reliability development program to make this technology ready for a manned mission. Because NASA would be the first user of this new technology, NASA will likely have to bear all the costs associated with its development. When well-known reliability estimation techniques are applied to the hydrogen oxygen RFC to determine the amount of testing that will be required to assure RFC unit reliability over life of the mission, the analysis indicates the reliability testing phase by itself will take at least 2 yr, and could take up to 6 yr depending on the number of QA units that are built and tested and the individual unit reliability that is desired. The cost and schedule impacts of reliability development need to be considered in NASA's Exploration Technology Development Program (ETDP) plans, since life cycle testing to build meaningful reliability data is the only way to assure "return to the moon, this time to stay, then on to Mars" mission success.

Bents, David J.↗
NASA NTRS2009

Lunar Regenerative Fuel Cell (RFC) Reliability Testing for Assured Mission Success

NASA's Constellation program has selected the closed cycle hydrogen oxygen Polymer Electrolyte Membrane (PEM) Regenerative Fuel Cell (RFC) as its baseline solar energy storage system for the lunar outpost and manned rover vehicles. Since the outpost and manned rovers are "human-rated," these energy storage systems will have to be of proven reliability exceeding 99 percent over the length of the mission. Because of the low (TRL=5) development state of the closed cycle hydrogen oxygen PEM RFC at present, and because there is no equivalent technology base in the commercial sector from which to draw or infer reliability information from, NASA will have to spend significant resources developing this technology from TRL 5 to TRL 9, and will have to embark upon an ambitious reliability development program to make this technology ready for a manned mission. Because NASA would be the first user of this new technology, NASA will likely have to bear all the costs associated with its development.When well-known reliability estimation techniques are applied to the hydrogen oxygen RFC to determine the amount of testing that will be required to assure RFC unit reliability over life of the mission, the analysis indicates the reliability testing phase by itself will take at least 2 yr, and could take up to 6 yr depending on the number of QA units that are built and tested and the individual unit reliability that is desired. The cost and schedule impacts of reliability development need to be considered in NASA's Exploration Technology Development Program (ETDP) plans, since life cycle testing to build meaningful reliability data is the only way to assure "return to the moon, this time to stay, then on to Mars" mission success.

Bents, David J.↗
NASA NTRS2008

Problem Reporting System

The Problem Reporting System (PRS) is a Web application, running on two Web servers (load-balanced) and two database servers (RAID-5), which establishes a system for submission, editing, and sharing of reports to manage risk assessment of anomalies identified in NASA's flight projects. PRS consolidates diverse anomaly-reporting systems, maintains a rich database set, and incorporates a robust engine, which allows tracking of any hardware, software, or paper process by configuring an appropriate life cycle. Global and specific project administration and setup tools allow lifecycle tailoring, along with customizable controls for user, e-mail, notifications, and more. PRS is accessible via the World Wide Web for authorized user at most any location. Upon successful log-in, the user receives a customizable window, which displays time-critical 'To Do' items (anomalies requiring the user s input before the system moves the anomaly to the next phase of the lifecycle), anomalies originated by the user, anomalies the user has addressed, and custom queries that can be saved for future use. Access controls exist depending on a user's role as system administrator, project administrator, user, or developer, and then, further by association with user, project, subsystem, company, or item with provisions for business-to-business exclusions, limitations on access according to the covert or overt nature of a given project, all with multiple layers of filtration, as needed. Reporting of metrics is built in. There is a provision for proxy access (in which the user may choose to grant one or more other users to view screens and perform actions as though they were the user, during any part of a tracking life cycle - especially useful during tight build schedules and vacations to keep things moving). The system also provides users the ability to have an anomaly link to or notify other systems, including QA Inspection Reports, Safety, GIDEP (Government-Industry Data Exchange Program) Alert, Corrective Actions, and Lessons Learned. The PRS tracking engine was designed as a very extensible and scalable system, able to support additional applications, with future development possibilities already discussed, including Incident Surprise Anomalies (for anomalies occurring during Operations phases of NASA Flight projects), GIDEP and NASA Alerts, and others.

Potter, Don↗