Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “QA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Method and Apparatus for Non-Destructive Evaluation of Materials

Methods and apparatus for characterizing composite materials for manufacturing quality assurance (QA), periodic inspection during the useful life, or for forensic analysis/material testing. System are provided that relate eddy-current sensor responses to the fiber layup of a composite structure, the presence of impact damage on a composite structure with or without a metal liner, volumetric stress within the composite, fiber tow density, and other NDE inspection requirements. Also provided are systems that determine electromagnetic material properties and material dimensions of composite materials from capacitive sensor inspection measurements. These properties are related to the presence of buried defects in non-conductive composite materials, moisture ingress, aging of the material due to service or environmental/thermal exposure, or changes in manufacturing quality.

Goldfine, Neil J.↗

GEONEX: Land Monitoring From a New Generation of Geostationary Satellite Sensors

The latest generation of geostationary satellites carry sensors such as ABI (Advanced Baseline Imager on GOES-16) and the AHI (Advanced Himawari Imager on Himawari) that closely mimic the spatial and spectral characteristics of Earth Observing System flagship MODIS for monitoring land surface conditions. More importantly they provide observations at 5-15 minute intervals. Such high frequency data offer exciting possibilities for producing robust estimates of land surface conditions by overcoming cloud cover, enabling studies of diurnally varying local-to-regional biosphere-atmosphere interactions, and operational decision-making in agriculture, forestry and disaster management. But the data come with challenges that need special attention. For instance, geostationary data feature changing sun angle at constant view for each pixel, which is reciprocal to sun-synchronous observations, and thus require careful adaptation of EOS algorithms. Our goal is to produce a set of land surface products from geostationary sensors by leveraging NASA's investments in EOS algorithms and in the data/compute facility NEX. The land surface variables of interest include atmospherically corrected surface reflectances, snow cover, vegetation indices and leaf area index (LAI)/fraction of photosynthetically absorbed radiation (FPAR), as well as land surface temperature and fires. In order to get ready to produce operational products over the US from GOES-16 starting 2018, we have utilized 18 months of data from Himawari AHI over Australia to test the production pipeline and the performance of various algorithms for our initial tests. The end-to-end processing pipeline consists of a suite of modules to (a) perform calibration and automatic georeference correction of the AHI L1b data, (b) adopt the Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm to produce surface spectral reflectances along with compositing schemes and QA, and (c) modify relevant EOS retrieval algorithms (e.g., LAI and FPAR, GPP, etc.) for subsequent science product generation. Initial evaluation of Himawari AHI products against standard MODIS products indicate general agreement, suggesting that data from geostationary sensors can augment low earth orbit (LEO) satellite observations.

geostationary↗

Overview of NASA's MODIS and Visible Infrared Imaging Radiometer Suite (VIIRS) snow-cover Earth System Data Records

Knowledge of the distribution, extent, duration and timing of snowmelt is critical for characterizing the Earth's climate system and its changes. As a result, snow cover is one of the Global Climate Observing System (GCOS) essential climate variables (ECVs). Consistent, long-term datasets of snow cover are needed to study interannual variability and snow climatology. The NASA snow-cover datasets generated from the Moderate Resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua spacecraft and the Suomi National Polar-orbiting Partnership (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) are NASA Earth System Data Records (ESDR). The objective of the snow-cover detection algorithms is to optimize the accuracy of mapping snow-cover extent (SCE) and to minimize snow-cover detection errors of omission and commission using automated, globally applied algorithms to produce SCE data products. Advancements in snow-cover mapping have been made with each of the four major reprocessings of the MODIS data record, which extends from 2000 to the present. MODIS Collection 6 (C6) and VIIRS Collection 1 (C1) represent the state-of-the-art global snow cover mapping algorithms and products for NASA Earth science. There were many revisions made in the C6 algorithms which improved snow-cover detection accuracy and information content of the data products. These improvements have also been incorporated into the NASA VIIRS snow cover algorithms for C1. Both information content and usability were improved by including the Normalized Snow Difference Index (NDSI) and a quality assurance (QA) data array of algorithm processing flags in the data product, along with the SCE map.The increased data content allows flexibility in using the datasets for specific regions and end-user applications.Though there are important differences between the MODIS and VIIRS instruments (e.g., the VIIRS 375m native resolution compared to MODIS 500 m), the snow detection algorithms and data products are designed to be as similar as possible so that the 16C year MODIS ESDR of global SCE can be extended into the future with the S-NPP VIIRS snow products and with products from future Joint Polar Satellite System (JPSS) platforms.These NASA datasets are archived and accessible through the NASA Distributed Active Archive Center at the National Snow and Ice Data Center in Boulder, Colorado.

Earth System Data Record↗

Harmonized Landsat/Sentinel-2 Reflectance Products for Land Monitoring (Invited)

Many land applications require more frequent observations than can be obtained from a single 'Landsat class' sensor. Agricultural monitoring, inland water quality assessment, stand-scale phenology, and numerous other applications all require near-daily imagery at better than 1ha resolution. Thus the land science community has begun expressing a desire for a '30-meter MODIS' global monitoring capability. One cost-effective way to achieve this goal is via merging data from multiple, international observatories into a single virtual constellation. The Harmonized Landsat/Sentinel-2 (HLS) project has been working to generate a seamless surface reflectance product by combining observations from USGS/NASA Landsat-8 and ESA Sentinel-2. Harmonization in this context requires a series of radiometric and geometric transforms to create a single surface reflectance time series agnostic to sensor origin. Radiometric corrections include a common atmospheric correction using the Landsat-8 LaSRC/6S approach, a simple BRDF adjustment to constant solar and nadir view angle, and spectral bandpass adjustments to fit the Landsat-8 OLI reference. Data are then resampled to a consistent 30m UTM grid, using the Sentinel-2 global tile system. Cloud and shadow masking are also implemented. Quality assurance (QA) involves comparison of the output 30m HLS products with near-simultaneous MODIS nadir-adjusted observations. Prototoype HLS products have been processed for approximately 7% of the global land area using the NASA Earth Exchange (NEX) compute environment at NASA Ames, and can be downloaded from the HLS web site (https://hls.gsfc.nasa.gov). A wall-to-wall North America data set is being prepared for 2018. This talk will review the objectives and status of the HLS project, and illustrate applications of high-density optical time series data for agriculture and ecology. We also discuss lessons learned from HLS in the general context of implementing virtual constellations.

Reflectance↗

Evaluation of the VIIRS BRDF, Albedo and NBAR Products Suite and an Assessment of Continuity with the Long Term MODIS Record

Bidirectional Reflectance Distribution Function (BRDF) model parameters, Albedo quantities, and Nadir BRDF Adjusted Reflectance (NBAR) products derived from the Visible Infrared Imaging Radiometer Suite (VIIRS), on the Suomi-NPP (National Polar-orbiting Partnership) satellite are evaluated with spatially representative in situ tower albedometer measurements and through comparison with the MODerate Resolution Imaging Spectroradiometer (MODIS) long term record. White Sky Albedo (WSA), Black Sky Albedo (BSA), NBAR, and Quality Assurance (QA) results show that the VIIRS algorithm is performing well at the global scale and is able to provide global data products comparable with the heritage MODIS (with an absolute bias of 0.0069 for shortwave broadband WSA) despite the spectral, angular, and effective spatial resolution differences between the two sensors. Both VIIRS and MODIS albedo are shown to agree well with in situ albedo measurements at a number of spatially representative sites. This evaluation provides confidence that the high quality, daily VIIRS BRDF model parameters, Albedo, and NBAR products will be able to provide the long term continuity required by the modeling and monitoring communities.

VIIRS↗

NC Space Grant Report

During the summer of 2018 I supported the Safety & Mission Assurance Directorate (SMA) and Operations Support Division (QA-20) at Stennis Space Center. The mission of the SMA team is to prove safety, risk, reliability, independent assessments, configuration management and quality assurance guidance, and services for all NASA Stennis Space Center (SSC) programs, facilities, and supporting infrastructure. The office actively participates and contributes to the Agency-level Safety & Mission Assurance (S&MA) effort. Over the course of the Summer I participated in three projects. Two of them were focused around Fault Tree Analysis (FTA) and the third focused on relief valves for their E-1 engine test stand.

Torres, David↗

MODIS Collection 6 MAIAC Algorithm

This paper describes the latest version of the algorithm MAIAC (Multi-Angle Implementation of Atmospheric Correction) used for processing the MODIS (Moderate-resolution Imaging Spectroradiometer) Collection6 data record. Since initial publication in 2011-2012, MAIAC has changed considerably to adapt to global processing and improve cloud/snow detection, aerosol retrievals and atmospheric correction of MODIS data. The main changes include (1) transition from a 25 to 1 km scale for retrieval of the spectral regression coefficient (SRC) which helped to remove occasional blockiness at 25 km scale in the aerosol optical depth (AOD) and in the surface reflectance, (2) continuous improvements of cloud detection, (3) introduction of smoke and dust tests to discriminate absorbing fine- and coarse mode aerosols, (4) adding over-water processing, (5) general optimization of the LUT (LookUp-Table)-based radiative transfer for the global processing, and others. MAIAC provides an interdisciplinary suite of atmospheric and land products, including cloud mask (CM), column water vapor (CWV), AOD at 0.47 and 0.55 m, aerosol type (background, smoke or dust) and fine-mode fraction over water; spectral bidirectional reflectance factors (BRF), parameters of Ross-thick Lisparse (RTLS) bidirectional reflectance distribution function (BRDF) model and instantaneous albedo. For snow-covered surfaces, we provide subpixel snow fraction and snow grain size. All products come in standard HDF4 (software library) format at 1 km resolution, except for BRF, which is also provided at 500 m resolution on a sinusoidal grid adopted by the MODIS Land team. All products are provided on per-observation basis in daily files except for the BRDF/Albedo product, which is reported every 8 days. Because MAIAC uses a time series approach, BRDF/Albedo is naturally gap-filled over land where missing values are filled-in with results from the previous retrieval. While the BRDF model is reported for MODIS Land bands 1-7 and ocean band 8, BRF is reported for both land and ocean bands 1-12. This paper focuses on MAIAC cloud detection, aerosol retrievals and atmospheric correction and describes MCD19 data products and quality assurance (QA) flags.

MAIAC Algorithm↗

IDN Update

The objective of this presentation is to provide IDN (International Directory Network) updates on features and activities to the Committee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) and provider community. The following topics will be discussed during the presentation: IDN Activities (since WGISS-46); Registration of services with granules stored outside NASA CMR (Common Metadata Repository; Setting up CEOS 2-Step OpenSearch in the IDN (CMR); Update on efforts to provide consistent Quality Assurance (QA) Rule messaging.

WGISS↗

Mutual Orbit Orientations of Transneptunian Binaries

We present Keplerian orbit solutions for the mutual orbits of 17 transneptunian binary systems (TNBs). For ten of them, the orbit had not previously been known: 60458 2000 CM (sub 114), 119979 2002 WC (sub 19), 160091 2000 OL (sub 67), 160256 2002 PD (sub 149), 469514 2003 QA (sub 91), 469705 ǂKagara, 508788 2000 CQ (sub 114), 508869 2002 VT (sub 130), 1999 RT (sub 214), and 2002 XH (sub 91). Seven more are systems where the size, shape, and period of the orbit had been published, but new observations have now eliminated the sky plane mirror ambiguity in its orientation: 90482 Orcus, 120347 Salacia-Actaea, 1998 WW (sub 31), 1999 OJ (sub 4), 2000 QL (sub 251), 2001 XR (sub 254), and 2003 TJ (sub 58). The dynamical masses we obtain from TNB mutual orbits can be combined with estimates of the objects' sizes from thermal observations or stellar occultations to estimate their bulk densities. The ǂKagara system is currently undergoing mutual events in which one component casts its shadow upon the other and/or obstructs the view of the other. Such events provide valuable opportunities for further characterization of the system. Combining our new orbits with previously published orbits yields a sample of 35 binary orbits with known orientations that can provide important clues about the environment in which outer solar system planetesimals formed, as well as their subsequent evolutionary history. Among the relatively tight binaries, with semimajor axes less than about 5 percent of their Hill radii, prograde mutual orbits vastly outnumber retrograde orbits. This imbalance is not attributable to any known observational bias. We suggest that this distribution could be the signature of planetesimal formation through gravitational collapse of local density enhancements such as caused by the streaming instability. Wider binaries, with semimajor axes greater than 5 percent of their Hill radii, are somewhat more evenly distributed between prograde and retrograde orbits, but with mutual orbits that are aligned or anti-aligned with their heliocentric orbits. This pattern could perhaps result from Kozai-Lidov cycles coupled with tidal evolution eliminating high inclination wide binaries.

Grundy, W. M.↗

Mission Operations and Command Assurance: Automating an Operations TQM Task

A long-term program is in progress at JPL to reduce cost and risk of mission operations through defect prevention and error management. A major element of this program, Mission Operations and Command Assurance (MO&QA), provides a system level function on flight projects to instill quality in mission operations. MO&CA embodies the Total Quality Management (TQM) principle of Continuous Process Inprovement (CPI) and uses CPI in applying automation to mission operations to reduce risk and costs. MO&CA has led efforts to apply and has implemented automation in areas that impact the daily flight project environment including Incident Surprise Anomoly tracking and reporting; command data verification, tracking, and reporting; and command support data usage. MO&CA's future work in automation will take into account that future missions systems must be designed to avoid increasing error through the introduction of automation, while adapting to the demands of smaller flight teams.

automation↗

Quantifying Uncertainties in Nighttime Light Retrievals From Suomi-NPP and NOAA-20 VIIRS Day/Night Band Data

Satellite observations of nighttime lights (NTL) from Suomi-NPP and NOAA-20 VIIRS Day/Night Band data have been widely used to estimate human activities. Long-term changes such as urban development and abrupt short-term changes such as power outages have been monitored from temporal NTL acquired by satellites. While high temporal NTL variation has been found across NTL data of varying temporal scale (e.g., daily, monthly, and annual composites), the sources of measurement error and uncertainty are poorly understood. This paper quantifies the sources of VIIRS-derived NTL uncertainty due to view-illumination geometry, surface Bidirectional Reflectance Distribution Function (BRDF)/albedo, and the effects of snow cover, lunar irradiance, aerosol loading, cloud mask, vegetation, geometry, and ephemeral artifacts (e.g., the Aurora Borealis). Based on this current assessment of NASA Black Marble retrievals (VNP46, Collection V001), we found that angular and atmospheric effects dominate retrieval uncertainty. Errors introduced by upstream data inputs (e.g., a coarser nighttime snow cover flag and misclassification errors in the existing VIIRS nighttime cloud mask) were also found to impact retrieval quality. Despite these challenges, a consistent daily NTL time series record can be routinely generated from top-of-atmosphere VNP46 radiances. Key recommendations include: (1) the use of lunar-BRDF adjusted and atmospherically corrected NTL (i.e., as identified as high-quality retrievals in the VNP46 QA fields), (2) development and improvement to the VIIRS snow cover and cloud masks algorithms to accurately reflect NTL retrieval conditions, (3) characterizing seasonal variations in NTL due to vegetation and snow, (4) reducing geometric effects due to the spatial mismatch of gridded pixel and observation footprint, (5) employing angularly-consistent NTL observations from multiple VIIRS instruments (i.e., Suomi-NPP and NOAA-20) to reduce pixel-based uncertainties and address persistent data gaps, and (6) being mindful of surface-reflected radiance from aurora events at mid-to-high latitudes.

Zhuosen Wang↗

Genesis Solar Wind Sample Curation Documentation

Introduction: A scientist with experience as a sample science analyst, provider of flight hardware for multiple missions, and senior engineer in an ISO 2000-rated manufacturing plant has described the timeline of key participants in any PI-led sample return mission, the breadth of the organizations involved [1,2], and, of interest to this meeting, choosing the types of data to preserve and issues of future data accessibility. This work broadens that perspective by giving similar lessons from Genesis sample curation point-of-view. Curation participation regarding data gathering was part of the mission review process from the beginning. Genesis’ story illustrates outcome of several choices about types of data to record and preserve. Precision analysis of solar wind atoms captured in pure, ultraclean substrates is the driving science goal; therefore, detailed documentation was captured from all mission and curation phases and from investigator laboratories because these processes affect the final analytical results [3]. Pre-flight: Design and fabrication of the spacecraft. Like many modern small sample return missions, Genesis was a tightly managed team integrated across science, engineering and curation. Communication across the team was excellent, and, for the most part, the hands-on engineering technicians understood the impacts of “small choices” they routinely make, and the eyes-on oversight of manufacturing processes by scientists was mindful of details. The payload was designed by the Jet Propulsion Laboratory and the spacecraft by Lockheed Martin. Solar wind collectors and instruments were fabricated by multiple vendors and laboratories. The main portion of the payload was assembled at JSC. Fabrication procedures and contamination-control data (with witness coupons) were stored primarily at JSC. The original composition, dimensions and configuration of components, results of thermal testing, etc. are still needed for interpretation of analytical data. At times, these must be estimated from secondary information acquired pre-flight. Moreover, some files (e.g., original 3-D models and early Powerpoint) cannot be opened using software. Archived curation data includes 2-D drawings, material usage lists, QA documentation and analyses of consumables used during fabrication. Important chemical information still resides in archived hardware, paints and lubricants, material coupons, cleaning coupons, environmental witness plates and reference materials from manufacturing facilities. Purity and cleanliness of collector substrates. Semi-conductor vendors provided surface cleanliness data and some purity data. Purity for specific elements of interest was verified by science team members in their laboratories [4]. Curation archived procurement and shipping records, analysis reports, and non-proprietary fabrication data. A physical archive of flight collector reference materials is maintained for future use so additional data can be collected as analytical techniques improve. These are of increased value due to the hard landing upon re-entry. Cleaning and cleanliness assessments of flight hardware. Cleaning of the science canister payload was performed at JSC in a dedicated ISO 4 cleanroom using ultrapure water (UPW). The cleanliness of this UPW was monitored throughout processing. The archive for the clean lab also includes airborne particle counts, airborne molecular and inorganic contamination measurements as well as cleanroom construction material coupons and witness coupons. Hardware cleanliness was assessed by particle counts in rinse water batches. This information is recorded in batch cleaning forms and logbooks, and are, perhaps, of decreased value due to the hard landing. Post-flight: Curation-generated data. The curation handling history of each Genesis sample is documented in a typical astromaterials sample database which captures sample location, physical description and characterization data. Samples have a “shelf life”. Crucial to the preservation of samples is ongoing documentation of the sample environment, initially under curatorial control but is now a separate facility function with requires coordination. PI-generated data. Data on sample characterization and cleaning techniques continues to be generated by sample users [5]. These are often captured in LPSC abstracts, but these “engineering” results often are not publishable as stand-alone papers. We are actively looking for ways to make this information more accessible to users. Ion implants into samples have aided science return and can be shared among investigators. These (and similar) materials should be added to the curatorial collection with appropriate process and characterization data generated externally. Summary: Complete data archives for returned astromaterial samples must be broad in types and formats, and inclusive of environmental monitoring.

Genesis↗

NASA Quality Assurance in an MBSE world

Over the past decade or so, the emergence of Model Based Systems Engineering (MBSE) has demonstrated its desirability and value in terms of 1) being a single source of truth, 2) unambiguous definitions and relationships, and 3) after representation, the ability to explore/extract any sets of data on demand. While much work has been done in showing the value to the system engineering discipline in these areas, how does that value translate to the Safety and Mission Assurance (S&MA) world? This paper provides a vision of a very desirable future of NASA S&MA after it is fully integrated into the MBSE framework. We explore the impact and consequences of the MBSE Value items discussed above and how they impact the disciplines of quality assurance, reliability and maintainability, system safety, and software assurance. We provide insight into how the MBSE modeling tools can be used to define S&MA processes (ideally as a result of Use Case [1] elaboration of processes represented in MagicDraw®), produce S&MA products (ViewEditor output of various items), and represent S&MA disciplines (S&MA inside of MagicDraw). We also provide insight into the degree to which some elements can be directly integrated into a SysML® model and when, as often happens, an interface to some external source must be provided. The desirability of this future is part of the reason for the NASA Office of Safety and Mission Assurance’s (OSMA) recent creation of a Model Based Mission Assurance (MBMA) Program [2] and the MBMA annual workshops. We briefly summarize the efforts to date to generate S&MA Use Cases for eventual deployment into pilot and project efforts. Even simple use of the SysML modeling tools can be used to capture quality assurance tasks and integrate them with the systems engineering and produce products that are easy to use by quality practitioners that are unfamiliar with these methods. We anticipate finding opportunities to pilot and implement various Quality Assurance (QA) Use Cases in FY20. The MBMA Program is focused on implementation; the NASA Office of the Chief Engineer's Community of Practice, as well as the SmallSat communities, are very interested in the integration of S&MA. Finally, as projects move forward utilizing whatever efficiency increases they can find in a cost-constrained environment, the S&MA community cannot be caught unawares and needs to continue preparing for the ever-growing implementation of MBSE across NASA and our government and commercial partners.

Evans, John W↗

Optimization Algorithms as Quantum Performance Benchmarks

Combinatorial optimization is anticipated to be one of the primary use cases for quantum computation in the coming years. The Quantum Approximate Optimization Algorithm (QAOA) and Quantum Annealing (QA) have the potential to demonstrate significant run-time performance benefits over current state-of-the-art solutions. Using existing methods for characterizing classical optimization algorithms, we analyze solution quality obtained by solving Max-Cut problems using a quantum annealing device and gate-model quantum simulators and devices. This is used to guide the development of an advanced benchmarking framework for quantum computers designed to evaluate the trade-off between run-time execution performance and the solution quality for iterative hybrid quantum-classical applications. The framework generates performance profiles through effective visualizations that show performance progression as a function of time for various problem sizes and illustrates algorithm limitations uncovered by the benchmarking approach. The framework is an enhancement to the existing open-source QED-C Application-Oriented Benchmark suite and can connect to the open-source analysis libraries. The suite can be executed on various quantum simulators and quantum hardware systems.

benchmarking↗

SAGE III/ISS v5.3 Level 2 Data Product Changes and Improvements

The Stratospheric Aerosol and Gas Experiment on the International Space Station (SAGE III/ISS) is an occultation instrument that acquires measurements of aerosols and gases within the Earth’s stratosphere and upper troposphere. SAGE III/ISS provides level 2 solar species products for aerosol extinction (9 channels), nitrogen dioxide (NO2), ozone (O3), and water vapor (H2O). The level 2 products currently provide three O3 profiles based on differing retrievals. The first O3 profile is based on measurements at short wavelengths within the Hartley-Huggins band (MesO3), the second O3 profile is based on measurements made at visible wavelengths within the Chappius band (MLR O3), and the final profile is found using a more SAGE II like approach (AO3). The SAGE III/ISS also provides level 2 lunar species products for ozone (O3), nitrogen dioxide (NO2), and nitrogen trioxide (NO3). Version 5.3 of the SAGE III/ISS retrieval algorithm introduces improvements that affect the level 2 data products. The largest change to the solar algorithm is the implementation of disturbance monitoring package (DMP) corrections to improve pointing accuracy. The DMP is comprised of a miniature inertial measurement unit that measures rotation in inertial space using ring laser gyroscopes oriented about three orthogonal axes which can be used to correct pointing errors caused by mechanical disturbances. A major change common to solar and lunar algorithms is meteorological input from the coarser 42 level Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) model data to the 72 level MERRA-2 model data. The final major change involves improving the automated quality assurance (QA) algorithm to recover events that were withheld from the public release because differences between the AO3 and MLR O3 for some events after the eruption of Tonga–Hunga Haʻapai. Other changes for v5.3 include minor bug fixes as well as restoration of some data quality flags that were removed in v5.21. This presentation presents the impacts of these changes as well as overall observations of interest from v5.3 level 2 data products.

Carter Hulsey↗

SAGE III/ISS v5.3 Level 2 Data Product Changes and Improvements

The Stratospheric Aerosol and Gas Experiment on the International Space Station (SAGE III/ISS) is an occultation instrument that acquires measurements of aerosols and gases within the Earth’s stratosphere and upper troposphere. SAGE III/ISS provides level 2 solar species products for aerosol extinction (9 channels), nitrogen dioxide (NO2), ozone (O3), and water vapor (H2O). The level 2 products currently provide three O3 profiles based on differing retrievals. The first O3 profile is based on measurements at short wavelengths within the Hartley-Huggins band (MesO3), the second O3 profile is based on measurements made at visible wavelengths within the Chappius band (MLR O3), and the final profile is found using a more SAGE II like approach (AO3). The SAGE III/ISS also provides level 2 lunar species products for ozone (O3), nitrogen dioxide (NO2), and nitrogen trioxide (NO3). Version 5.3 of the SAGE III/ISS retrieval algorithm introduces improvements that affect the level 2 data products. The largest change to the solar algorithm is the implementation of disturbance monitoring package (DMP) corrections to improve pointing accuracy. The DMP is comprised of a miniature inertial measurement unit that measures rotation in inertial space using ring laser gyroscopes oriented about three orthogonal axes which can be used to correct pointing errors caused by mechanical disturbances. A major change common to solar and lunar algorithms is meteorological input from the coarser 42 level Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) model data to the 72 level MERRA-2 model data. The final major change involves improving the automated quality assurance (QA) algorithm to recover events that were withheld from the public release because differences between the AO3 and MLR O3 for some events after the eruption of Tonga–Hunga Haʻapai. Other changes for v5.3 include minor bug fixes as well as restoration of some data quality flags that were removed in v5.21. This presentation presents the impacts of these changes as well as overall observations of interest from v5.3 level 2 data products.

Carter Hulsey↗

Assurance Equations: A Cost and Criticality Model for Optimizing Quality Assurance Surveillance

The cost of quality vs cost of failure correction has been a long-running topic of discussion within the Aerospace community. It leads directly to concepts of “risk tolerance”, and risk-based decision-making. It would be valuable if there was a way to compute the optimal investment in customer-executed quality assurance activities using defect significance with respect to performance objectives, the activities’ defect detection effectiveness, and the cost-penalty for late discovery of impactful defects. This optimization is particularly of interest to projects whose budget constraints significantly limit their risk management options.The cost to fix defects (i.e., failure correction) escalates as the project matures. There have been studies attempting to determine the relative cost of fixing defects discovered during various phases of a project life cycle with important implications, all of which suggest growth factors are large. The commonly referred to 1:10:100 rule represents a cost multiplier for repair/rework across the Design to Fab to Test hardware development phases. Cost premiums for QA activities also accumulate when they are treated as mandatory (due to schedule drag) or are performed later than their assigned phase.This paper describes the modeling of development phase -dependencies in the conduct of typical customer-executed quality assurance activities. Our initial modeling encompasses:• Distinct phases of the production lifecycle• Multiple kinds of Defects, each with some a-priori likelihood of being present• Each defect’s impact on performance Objectives for a type of hardware• The cost and efficacy of assurance techniques at detecting such Defects• The costs of fixing those Defects detected in a given phase of the production lifecycleThe model captures assurance activities’ abilities to Detect defects. Upon detection it is assumed that the Defect is immediately fixed. Defects that “escape” detection by some activity may thereafter be detected by a later activity, but by then the cost of fixing the Defect may have escalated. Defects are related to the performance Objectives they would detract from, were those Defects to remain present in the operating system.We have constructed and are exploring, a model that relates the importance of hardware system elements to mission objectives, the impact of types of Defects on those hardware types, the cost of customer-executed assurance activities (i.e., supplier controls) and their effectiveness towards reducing an impactful quality escape, and the cost of Defect correction across production phase. We describe the approach taken to select the key model aspects, why they are relevant to our NASA mission, and our efforts to populate it with relevant and contemporary data. We use a notional example to illustrate model design and function.

Plante, Jeannette↗

Jefferson County Ecological Conservation: Quantifying the Effects of Hydrologic Restoration in the Camas National Wildlife Refuge and Mud Lake Wildlife Management Area

Wetlands in the Camas National Wildlife Refuge and Mud Lake Wildlife Management Area, a rare landscape feature in the Intermountain West, are crucial for migratory birds along the Pacific Flyway, yet these wetlands have experienced a noticeable decline in extent and inundation over the last 40+ years. Partners at the U.S. Fish and Wildlife Service and Idaho Department of Fish and Game have ongoing restoration efforts that are yet to be quantified. To assist these partners, we used NASA Earth observations to quantify change in wetland extent and determine if the restoration projects met the intended impact. The QA_PIXEL band from Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) was used to identify water. Landsat 8 OLI imagery was also used for classifying landcover in ArcGIS Pro for 2016 and 2020 and to forecast landcover in 2060 using TerrSet’s Land Change Modeler. We also compared lidar data from 2011 and 2019 to detect changes in vegetation height, ground elevation, and surface water levels, and Sentinel-2 Multispectral Instrument (MSI) imagery to detect changes in vegetation health. Classification results indicated overall accuracies over 84% and Kappa indices above 0.80, well surpassing random classification performance. From 2016 to 2020 our classifications showed an 825 acre increase in wetland extent, and our forecasted 2060 model showed a 2795 acre decrease. Combining our partners’ knowledge of the area with our analyses, we created a remote sensing workflow to enhance future monitoring and decision-making. This study demonstrated the feasibility of NASA Earth observations in quantifying wetlands, informing restoration projects, and supporting avian conservation.

Cassidy Bromka↗