Results for “system validation” — Page 63

NASA NTRS2017

Exploration Medical System Technical Development

The Exploration Medical Capability (ExMC) Element systems engineering goals include defining the technical system needed to implement exploration medical capabilities for Mars. This past year, scenarios captured in the medical system concept of operations laid the foundation for systems engineering technical development work. The systems engineering team analyzed scenario content to identify interactions between the medical system, crewmembers, the exploration vehicle, and the ground system. This enabled the definition of functions the medical system must provide and interfaces to crewmembers and other systems. These analyses additionally lead to the development of a conceptual medical system architecture. The work supports the ExMC community-wide understanding of the functional exploration needs to be met by the medical system, the subsequent development of medical system requirements, and the system verification and validation approach utilizing terrestrial analogs and precursor exploration missions.

McGuire, K.↗

NASA NTRS2017

Understanding Human Autonomy Teaming Through Applications

This presentation describes the development and demonstration of human autonomy teaming technologies for improving aviation safety and efficiency during nominal and off-nominal operations by developing and validating increasingly autonomous systems concepts, technologies, and procedures.

Aponso, B.↗

NASA NTRS2018

In Flight MiRNA Isolation and Recovery on the ISS Using the Wetlab-2 System

Due to advancements in RNA research, mi (micro) RNAs and other small nucleotide RNAs have become a major research field in biology including spaceflight research. The regulation of RNA transcription and processing by miRNAs makes miRNAs an appealing topic for genetics and molecular research. It has been estimated that over 60% of human gene transcripts are targets of miRNA regulation. In fact, this is true for all organisms, including plants and insects. Small nucleotide RNAs can also play a role in regulating gene expression, meaning that gene expression alone is not a complete picture of the potential genetic changes that occur in an organism during spaceflight. The goal of the WetLab-2 project is to isolate and recover miRNAs from various tissue sources on the International Space Station (ISS). No system currently exists that can isolate and recover small nucleotide RNA in space. However, the WetLab-2 system that was validated on the ISS in 2016 can be adapted to fit this purpose. We are currently testing the new modified protocols by running plant and mouse blood experiments in parallel, allowing us to demonstrate the effectiveness of the procedure on different sample types. We expect to be able to optimize and implement the modified miRNA protocols for use on future ISS flights.

miRNA↗

NASA NTRS2018

In Flight miRNA Isolation and Recovery on the ISS

Due to advancements in RNA research, mi (micro) RNAs and other small nucleotide RNAs have become a major research field in biology including spaceflight research. The regulation of RNA transcription and processing by miRNAs makes miRNAs an appealing topic for genetics and molecular research. It has been estimated that over 60% of human gene transcripts are targets of miRNA regulation. In fact, this is true for all organisms, including plants and insects. Small nucleotide RNAs can also play a role in regulating gene expression, meaning that gene expression alone is not a complete picture of the potential genetic changes that occur in an organism during spaceflight. The goal of the WetLab-2 project is to isolate and recover miRNAs from various tissue sources on the International Space Station (ISS). No system currently exists that can isolate and recover small nucleotide RNA in space. However, the WetLab-2 system that was validated on the ISS in 2016 can be adapted to fit this purpose. We are currently testing the new modified protocols by running plant and mouse blood experiments in parallel, allowing us to demonstrate the effectiveness of the procedure on different sample types. We expect to be able to optimize and implement the modified miRNA protocols for use on future ISS flights.

miRNA↗

NASA NTRS2020

Characterization and Commissioning of a Ka-Band Ground Station for Cognitive Algorithm Development

In 2018, the Cognitive Communications and Propagation projects completed installation and checkout testing of a new Ka-Band ground station at the NASA Glenn Research Center in Cleveland, Ohio. The Cognitive Algorithms Demonstration Testbed (CADeT) was developed to provide a fully characterized and controllable dynamic link environment to researchers looking to demonstrate hardware and software aligned with atmospheric sensing and cognitive algorithms. CADeT integrates a host of precision control and measurement systems in addition to repurposing a 5.5 meter beam-waveguide dish platform previously used with the Advanced Communications Technology Satellite (ACTS). This paper will discuss the laboratory testing of ground station components with a emphasis on elements vital to achieving link budget requirements including characterization of the new Gallium Nitride (GaN) Solid State Power Amplifier (SSPA) and far-field measurements of the new antenna feed. Finally, the paper discusses in-situ tests conducted with CADeT and the Tracking and Data Relay Satellite System (TDRSS) to validate laboratory results and make necessary link budget adjustments before reviewing the lessons learned.

Cameron M Seidl↗

NASA NTRS2011

Mars Science Laboratory interplanetary navigaton analysis

The Mars Science Laboratory (MSL) is a NASA rover mission that will be launched in late 2011 and will land on Mars in August of 2012. This paper describes the analyses performed to validate the navigation system for launch, interplanetary cruise, and approach. MSL will use guidance during its descent into Mars in order to minimize landing dispersions, and therefore will be able to use smaller landing zones that are closer to terrain of high scientific interest. This will require a more accurate delivery of the spacecraft to the atmospheric entry interface, and a late update of the state of the spacecraft at entry. During cruise and approach the spacecraft may perform up to six trajectory correction maneuvers (TCMs), to target to the desired landing site with the required flight path angle at entry. Approach orbit determination covariance analyses have been performed to evaluate the accuracy that can be achieved in delivering the spacecraft to the entry interface point, and to determine how accurately the state of the spacecraft can be predicted to initialize the guidance algorithm. In addition, a sensitivity analysis has been performed to evaluate which factors most contribute to the improvement or degradation of the navigation performance, for both entry flight path angle delivery and entry state knowledge.

Wong, Mau C.↗

NASA NTRS2022

What would it take to manufacture perovskite solar cells in space?

Imagine, astronauts land on the moon. They verify their arrival with mission control, and perform system checks and validations. After the dust settles, they open the airlock of the landing vehicle and venture outside. A side hatch opens, and a flexible substrate slowly unfurls on a boom. A series of printer heads raster, hovering over the substrate and sequentially vapor-depositing the constituent layers of a perovskite solar module (Figure 1). In time, a 1-megawatt array has been manufactured on the moon and can now be connected to supply power to the Artemis Base Camp. This ambitious vision could someday become a reality. On August 29, 2021, a SpaceX Falcon 9 rocket launched a commercial resupply payload from Kennedy Space Center en route to the International Space Station (ISS). On board were perovskite solar cells that will fly for 6 months outside the ISS in low earth orbit (LEO) on the 15th Materials International Space Station Experiment (MISSE-15). This will be the first long duration flight of perovskite solar cell devices in LEO and a major step toward realizing the in-space operation and, potentially, manufacture of perovskite solar cells.

Lyndsey McMillon-Brown↗

NASA NTRSDate not supplied

Validation of the Corcos Model for the Space Launch System using Unsteady Pressure Sensitive Paint

During atmospheric ascent launch vehicles (LVs) experience large dynamic loads at transonic conditions where aerodynamic buffet is most critical. To estimate buffet loads, coupled loads analyses typically utilize suitable forcing functions, called buffet forcing functions (BFFs). One of the key buffet environment contributors is the turbulent boundary layer (TBL) on the LV outer skin. The TBL-induced fluctuating pressures can be estimated using the widely-accepted Corcos model. In the context of transonic buffet, the performance of this model is not well established, partly because of lack of data. To fill this gap, NASA recently acquired extremely high-spatial-density data for the Space Launch System (SLS) vehicle, using the unsteady pressure sensitive paint (uPSP) optical measurement technique. A methodology is developed for validation of the Corcos model using these unique data, with a focus on the LV-design application. The model hypotheses are verified and the model parameters are empirically tuned. For selected panels on the vehicle, BFF coherence factors are derived based on the Corcos model and the associated panel BFFs are compared to uPSP data. It is shown that the modeled BFFs are in agreement with direct integration of uPSP data, except for regions where pressure fluctuations are spatially nonuniform. In those regions, the Corcos-based BFFs exhibit inherent limitations of BFF estimation methods that rely on discrete pressure measurements.

buffet↗

NASA NTRSDate not supplied

Validation of the Corcos Model for the Space Launch System using Unsteady Pressure Sensitive Paint

During atmospheric ascent launch vehicles (LVs) experience large dynamic loads at transonic conditions where aerodynamic buffet is most critical. To estimate buffet loads, coupled loads analyses typically utilize suitable forcing functions, called buffet forcing functions (BFFs). One of the key buffet environment contributors is the turbulent boundary layer (TBL) on the LV outer skin. The TBL-induced fluctuating pressures can be estimated using the widely-accepted Corcos model. In the context of transonic buffet, the performance of this model is not well established, partly because of lack of data. To fill this gap, NASA recently acquired extremely high-spatial-density data for the Space Launch System (SLS) vehicle, using the unsteady pressure sensitive paint (uPSP) optical measurement technique. A methodology is developed for validation of the Corcos model using these unique data, with a focus on the LV-design application. The model hypotheses are verified and the model parameters are empirically tuned. For selected panels on the vehicle, BFF coherence factors are derived based on the Corcos model and the associated panel BFFs are compared to uPSP data. It is shown that the modeled BFFs are in agreement with direct integration of uPSP data, except for regions where pressure fluctuations are spatially nonuniform. In those regions, the Corcos-based BFFs exhibit inherent limitations of BFF estimation methods that rely on discrete pressure measurements.

buffet↗

NASA NTRSDate not supplied

Towards a more realistic representation of NASA CERES-derived surface radiative fluxes during polar night: a comparison with the MOSAiC field campaign

The Arctic is one of the most sensitive regions of Earth to climate change, and yet remains one of the more difficult regions to both observe and simulate. The high latitude of the Arctic gives it some unusual features compared with much of Earth, such as large and variable sea ice cover, extensive mixed phase cloud cover, and the polar day/night cycle. These features significantly influence the radiative environment of the Arctic as well as the ability to observe it. The remoteness of the Arctic from most of civilization makes large volumes of in situ observations difficult to collect, and so satellite observations are a critical tool for observing the region, such as those from Clouds and the Earth’s Radiant Energy System (CERES). But validating the satellite radiative flux estimates is difficult because of the lack of in situ measurements. A useful remedy is utilizing measurements from field campaigns, such as the year-long Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition during 2019-2020. The extensive high-quality surface radiative flux and meteorological measurements collected from MOSAiC provide a useful check on flux retrievals from CERES instruments. Previous work compared MOSAiC and CERES surface radiative fluxes during the 2020 melt season (April-September). Errors in CERES fluxes were related to errors in estimated atmospheric optical depth and surface albedo. We conduct a similar assessment of CERES surface flux retrievals using MOSAiC data, but for the months of October through March instead. As this time period is mostly during polar night and twilight, the focus of the study is on longwave surface fluxes. To better understand the reasons for errors in CERES fluxes, we use the large set of meteorological measurements also collected by MOSAiC, including surface temperature, thermodynamic vertical profiles, surface turbulent fluxes, and cloud properties. For example, one notable possible source of error in the CERES estimate of surface downwelling longwave flux is the estimate of cloud base height when compared with MOSAiC W-band radar measurements – an overestimate of cloud base height yields an underestimate of the downwelling flux on the order of tens of W m2.

J. Brant Dodson↗

NASA NTRSDate not supplied

Towards a More Realistic Representation of NASA CERES-derived Surface Radiative Fluxes during Polar Night: A Comparison with the MOSAiC Field Campaign

The Arctic is one of the most sensitive regions of Earth to climate change, and yet remains one of the more difficult regions to both observe and simulate. The remoteness of the Arctic from most of civilization makes large volumes of in situ observations difficult to collect, and so satellite observations are a critical tool for observing the region, such as those from Clouds and the Earth’s Radiant Energy System (CERES). But validating the satellite radiative flux estimates is difficult because of the lack of in situ measurements. A useful remedy is utilizing measurements from field campaigns, such as the year-long Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition during 2019-2020. The extensive high-quality surface radiative flux and meteorological measurements collected from MOSAiC provide a useful check on flux retrievals from CERES instruments. We compare MOSAiC and CERES surface radiative fluxes during October through March of 2019-2020. As this time period is mostly during polar night and twilight, the focus of the study is on longwave surface fluxes. To better understand the reasons for errors in CERES fluxes, we use the large set of meteorological measurements also collected by MOSAiC, including surface temperature, thermodynamic vertical profiles, surface turbulent fluxes, and cloud properties. Previous work identified a significant source of error in the CERES estimate of surface downwelling longwave flux as the estimate of low level cloud amount when compared with MOSAiC W-band radar measurements. An overestimate of low cloud amount yielded an underestimate of the downwelling flux on the order of tens of W m2. Continuing this work, we test other meteorological properties such as the vertical thermodynamic profile and surface turbulent fluxes. In addition, we examine different estimates of surface fluxes derived from CERES measurements. Previous work used the SYN1deg product, which had the limitation of having a 1º x 1 º horizontal resolution. A newer product estimates the surface fluxes at the CERES footprint resolution, which allows a more precise colocation, and thus a representative flux estimate, with the MOSAiC site.

J Brant Dodson↗

NASA NTRSDate not supplied

Towards A More Realistic Representation of Nasa Ceres-Derived Surface Radiative Fluxes During Polar Night: A Comparison With the Mosaic Field Campaign

The Arctic remains one of the more difficult regions observe, and so satellite observations are a critical tool for observing the region, such as those from Clouds and the Earth’s Radiant Energy System (CERES). But validating the satellite surface radiative flux estimates is difficult because of the lack of in situ measurements. The extensive high-quality surface radiative flux and meteorological measurements collected from MOSAiC provide a useful check on flux retrievals from CERES instruments. We compare MOSAiC and CERES surface radiative fluxes during October through March of 2019-2020 using the large set of meteorological measurements also collected by MOSAiC, specifically cloud properties. Previous work identified a significant source of error in the CERES estimate of surface downwelling longwave flux as the estimate of low level cloud amount when compared with MOSAiC W-band radar measurements. Continuing this work, we examine the effects of errors in cloud water path on surface radiative fluxes. When using all cloud conditions, errors in cloud water are also significantly correlated with surface radiative flux errors, though the size off the effect is only about half that of cloud amount. But when considering low cloud conditions only, the effects of cloud water and cloud amount are comparable.

J. Brant Dodson↗

NASA NTRSDate not supplied

Guiding Integration of Formal Verification in Assurance Cases

Assurance cases are being increasingly acknowledged as away to build trust in complex systems with autonomous capabilities. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for a specific mission and operating environment. Formal verification is often reserved for the most critical components of such systems. However, formal verification tools are often complex, and their usage is subject to many constraints and contextual dependencies. This can raise challenges both for performing the verification as well as reflecting the verification results appropriately in the assurance case, especially for non-expert users of the verification tool. To address these challenges, we present a tool-supported methodology for integrating formal verification results in an assurance case by capturing key verification method information in a rigorously constructed assurance case. In particular, we capture the tool specification in terms of its inputs, outputs, and assurance constraints as assumptions over inputs and guarantees provided over its outputs. The tool specification is parametrized over the inputs and outputs to both guide the intended application of the tool, as well as to check that the tool has been applied following the stated assumptions and that the guarantees hold. We define a generic tool assurance argument pattern that enables integration of the verification results in the assurance case by allowing custom refinement and automated instantiation for each tool use. We demonstrate our methodology on two formal verification tools and their applications to the verification of neural network properties for the aircraft domain.

Assurance Cases↗

NASA NTRSDate not supplied

Towards a More Realistic Representation of NASA CERES-derived Surface Radiative Fluxes during Polar Night: A Comparison with the MOSAiC Field Campaign

The Arctic remains one of the more difficult regions observe, and so satellite observations are a critical tool for observing the region, such as those from Clouds and the Earth’s Radiant Energy System (CERES). But validating the satellite surface radiative flux estimates is difficult because of the lack of in situ measurements. The extensive high-quality surface radiative flux and meteorological measurements collected from MOSAiC provide a useful check on flux retrievals from CERES instruments. We compare MOSAiC and CERES surface radiative fluxes during October through March of 2019-2020 using the large set of meteorological measurements also collected by MOSAiC, specifically cloud properties. Previous work identified a significant source of error in the CERES estimate of surface downwelling longwave flux as the estimate of low level cloud amount when compared with MOSAiC W-band radar measurements. Continuing this work, we examine the effects of errors in cloud water path on surface radiative fluxes. When using all cloud conditions, errors in cloud water are also significantly correlated with surface radiative flux errors, though the size off the effect is only about half that of cloud amount. But when considering low cloud conditions only, the effects of cloud water and cloud amount are comparable. We compare MOSAiC and CERES surface radiative fluxes during October through March of 2019-2020 using the large set of meteorological measurements also collected by MOSAiC, specifically cloud properties. Previous work identified a significant source of error in the CERES estimate of surface downwelling longwave flux as the estimate of low level cloud amount when compared with MOSAiC W-band radar measurements. We further examine this source of error by examining selected case studies in which the disagreements in radiative fluxes and clouds are large.

J Brant Dodson↗

NASA NTRS2023

Level-1 Calibration Assessment of Spire’s LEMUR-2 GNSS-R Ocean Normalized Bistatic Radar Cross Section Estimates

An assessment of the ocean surface Level-1 Normalized Bistatic Radar Cross Section products provided by the two batch 1 ‘LEMUR-2’ GNSS-R receivers of Spire, Inc. is reported. The analysis uses datasets extending from DOY 345, 2020 to DOY 329, 2021. Initial assessments indicate a highly consistent overall inter-channel response with mean NBRCS differences estimated to be at the 1.00% level over a 7-12 m/s ECMWF reference wind speed range. Efforts to validate the observation systems’ aggregate response relative to ≈3 million co-located CYGNSS measurements suggest a highly complementary behavior with an overall NBRCS correlation of 79.03% highlighting the potential utility of ‘LEMUR-2’ measurements for ocean surface wind sensing and related applications. Non-physical NBRCS dependencies on various Level-1 calibration variables, also observed with GNSS-R previous systems, are nonetheless noted and are explored in detail.

Mohammad M. Al-Khaldi↗

NASA NTRSDate not supplied

The Troupe System: an Autonomous Multi-Agent Rover Swarm

Autonomous cooperative robotic systems are the future of space exploration. The complexity of such systems makes their development, verification and assurance challenging. The Robust Software Engineering group at NASA Ames has developed the Troupe project that aims to explore the design and development of a swarm of autonomous rovers tasked to perform autonomous exploration and mapping of an unknown terrain. In this paper, we showcase the system design, and accompanying verification and validation tools integrated in the Troupe system development life-cycle.

TROUPE↗

NASA NTRS1988

The LANDSAT/global positioning system project

A GPSPAC/LANDSAT-D Interface (GLI) Ground Support System was built to validate the performance and to calibrate the accuracy of the experimental navigation package, GPSPAC, flown on the LANDSAT-4 and 5 spacecraft. Although the GLI system operated successfully to give the orbit information needed to validate the GPSPAC, it also detected two anomalies: one is characteristic of the GLI system and the other is characteristic of the pre-operational phase of GPS. Several methods were applied to resolve or reduce the anomalies. This paper presents a description of the problems, the methods applied to resolve or reduce them, and the results.

Wood, Terri↗

NASA NTRS2013

Distilling the Verification Process for Prognostics Algorithms

The goal of prognostics and health management (PHM) systems is to ensure system safety, and reduce downtime and maintenance costs. It is important that a PHM system is verified and validated before it can be successfully deployed. Prognostics algorithms are integral parts of PHM systems. This paper investigates a systematic process of verification of such prognostics algorithms. To this end, first, this paper distinguishes between technology maturation and product development. Then, the paper describes the verification process for a prognostics algorithm as it moves up to higher maturity levels. This process is shown to be an iterative process where verification activities are interleaved with validation activities at each maturation level. In this work, we adopt the concept of technology readiness levels (TRLs) to represent the different maturity levels of a prognostics algorithm. It is shown that at each TRL, the verification of a prognostics algorithm depends on verifying the different components of the algorithm according to the requirements laid out by the PHM system that adopts this prognostics algorithm. Finally, using simplified examples, the systematic process for verifying a prognostics algorithm is demonstrated as the prognostics algorithm moves up TRLs.

verification↗