SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

NASA NTRS2019

The NASA Orbital Debris Engineering Model 3.1: Development, Verification, and Validation

The NASA Orbital Debris Program Office has developed the Orbital Debris Engineering Model (ORDEM) primarily as a tool for spacecraft designers and other users to understand the long-term risk of collisions with orbital debris. The newest version, ORDEM 3.1, incorporates the latest and highest fidelity datasets available to build and validate representative orbital debris populations encompassing low Earth orbit (LEO) to geosynchronous orbit (GEO) altitudes for the years 2016-2050. ORDEM 3.1 models fluxes for object sizes > 10 μm within or transiting LEO and > 10 cm in GEO. The deterministic portion of the populations in ORDEM 3.1 is based on the U.S. Space Surveillance Network (SSN) catalog, which provides coverage down to approximately 10 cm in LEO and 1 m in GEO. Observational datasets from radar, in situ, and optical sources provide a foundation from which the model populations are statistically extrapolated to smaller sizes and orbit regions that are not well-covered by the SSN catalog, yet may pose the greatest threat to operational spacecraft. Objects in LEO ranging from approximately 5 mm to 10 cm are modeled using observational data from ground-based radar, namely the Haystack Ultrawideband Satellite Imaging Radar (HUSIR – formerly known as Haystack). The LEO population smaller than approximately 3 mm in size is characterized based on a reanalysis of in situ data from impacts to the windows and radiators of the U.S. Space Transportation System orbiter vehicle, i.e., the Space Shuttle. Data from impacts on the Hubble Space Telescope are also used to validate the sub-millimeter model populations in LEO. Debris in GEO with sizes ranging from 10 cm to 1 m is modeled using optical measurement data from the Michigan Orbital DEbris Survey Telescope (MODEST). Specific, major debris-producing events, including the Fengyun-1C, Iridium 33, and Cosmos 2251 debris clouds, and unique populations, such as sodium-potassium droplets, have been re-examined and are modeled and added to the ORDEM environment separately. The debris environment greater than 1 mm is forecast using NASA’s LEO-to- GEO ENvironment Debris model (LEGEND). Future explosions of intact objects and collisions involving objects greater than 10 cm are assessed statistically, and the NASA Standard Satellite Breakup Model is used to generate fragments from these events. Fragments smaller than 10 cm are further differentiated based on material density categories, i.e., high-, medium-, and low-density, to better characterize the potential debris risk posed to spacecraft. The future projection of the sub-millimeter environment is computed using a special small-particle degradation model where small particles are created from intact spacecraft and rocket bodies. This work discusses the development, features, and capabilities of the ORDEM 3.1 model; the ne new data analyses used to build the model populations; and sample verification and validation results.

Matney, M.↗

NASA NTRS2020

Subscale Demonstration and Validation of the Hercules Ascent, Descent, and Entry Vehicle

This paper presents the results of a ten-week student led effort to build and test subscale models demonstrating and validating key capabilities for a space transportation system concept developed over the past 5 years at NASA Langley. This reusable concept, known as the Hercules Transportation System (HTS), is designed to support cislunar, lunar surface, and Mars surface missions or campaigns and offers unique operational capabilities. Until recently, much of the work on Hercules has been conceptual and has not been tested or validated by physical models. Our team, the 2019 NASA Academy at Langley Research Center, investigated and demonstrated the feasibility of the conceptual design by developing two unique scaled models. The goal of the first model was to collect six-component experimental wind tunnel data to validate theoretical predictions and inform future design iterations. Test results provided valuable insights on control surface effectiveness and static stability. The second model was designed to demonstrate the operational flexibility of Hercules by consistently executing vertical takeoff, horizontal translation, and landing. This paper describes the development and testing of both models.

Eytan Adler↗

NASA NTRSDate not supplied

Requirements and Challenges for CFD Validation within the High-Lift Common Research Model Ecosystem

The High-Lift Common Research Model (CRM-HL) ecosystem is envisioned to become an industry standard set of test cases for high-lift aerodynamics prediction, with data generated providing a strong foundation for CFD validation. Since its original development, preliminary wind tunnel tests have been conducted to further understand and configure the geometry, and several more are in the planning phases. It is anticipated that the data generated in these tests will be used extensively by the CFD community for research, development, and validation of new techniques that yield more accurate results. To derive the maximum benefit from planned wind tunnel testing, data acquisition will be focused in several key areas to address specific shortcomings in CFD predictive capabilities. Significant challenges currently exist in areas including, but not limited to, characterizing high-lift flow phenomena, quantifying effects due to configuration changes, understanding wind tunnel and model installation effects, and establishing data uncertainty. This paper will discuss the current state-of-the-art in high-lift CFD prediction, key limitations of current CFD methods and tools, establishing a validation dialog between test and CFD practitioners, and the flow phenomena of highest interest, in an effort to begin to address these challenges. To this end, it is expected that the data generated from CRM-HL tests will form a strong foundation for future predictive capability.

Adam M Clark↗

NASA NTRS2020

Validation Practices for Satellite Soil Moisture retrievals: What are (the) errors?

This paper presents a community effort to develop good practice guidelines for the validation of global coarse-scale satellite soil moisture products. We provide theoretical background, a review of state-of-the-art methodologies for estimating errors in soil moisture data sets, practical recommendations on data pre-processing and presentation of statistical results, and a recommended validation protocol that is supplemented with an example validation exercise focused on microwave-based surface soil moisture products. We conclude by identifying research gaps that should be addressed in the near future.

A. Gruber↗

NASA NTRS2021

A Study into Validating a Coupled Method of Characteristics and Direct Simulation Monte Carlo Method Against Empirical Data

The following will outline the methodology and results of validating a coupled Method of Characteristics (MOC) and Direct Simulation Monte Carlo (DSMC) method. This research focused specifically on modeling plume impingement, induced by Reaction Control System (RCS) thrusters that flew on the National Aeronautics and Space Administration’s (NASA’s) space shuttle Discovery. For each simulation, the continuum portion of the RCS thruster was simulated using MOC for solving hyperbolic Partial Differential Equations (PDEs) and computed with the NASA code, Reacting and Multi-phase Program (RAMP). The solution was then implemented as a starting condition into the NASA DSMC code, Direct Simulation and Monte Carlo Analysis Code (DAC). Typically, DSMC models rely on code-to-code validation for fidelity. The significance of this research is in its ability to validate its models against empirical data. Prior to computing solutions for these simulations, the mesh size and structure were optimized and many variants of DSMC input parameters were iterated on in order to acquire a reliable, mesh-independent, fully optimized numerical solution. This research will discuss the mathematical formulation of MOC for nozzle flow and DSMC for rarefied gases. Additionally, it will provide an explanation of how to implement these mathematical concepts into the two solvers: RAMP and DAC. Ultimately, this research will demonstrate that the overall process illustrated produces results in good agreement with empirical data. As a consequence, the methodology presented is granted an increased level of confidence and will greatly contribute to the aerospace industry and its effort in understanding and predicting rarefied flow fields.

Direct Simulation Monte Carlo Analysis Code↗

NASA NTRS2021

A Study into Validating A Coupled Method of Characteristics And Direct Simulation Monte Carlo Method Against Empirical Data

DAC↗

NASA NTRS2020

Model Validation for Bigelow Expandable Activity Module (BEAM) with Stowage

The Bigelow Expandable Activity Module (BEAM) was a collaboration between NASA and Bigelow Aerospace to develop an expandable habitat technology that could be used for future space exploration missions such as the Artemis program. On April 26, 2016, the BEAM was launched and berthed to the International Space Station (ISS) on the aft port of Node 3. After the originally planned two-year mission life, BEAM was approved for use as a stowage module for a 109-cargotransfer bag equivalent (CTBE) to alleviate stowage limitations onboard the ISS. The present work builds on the previous 2017 model validation to flight data that demonstrated that BEAM could generally accommodate cargo stowage without adversely affecting BEAM thermal control, primarily for condensation management. Once the stowage was configured in early 2019, model validation efforts resumed. The thermal model revisions included the CTBE stowage and updated CFD-derived heat transfer coefficients for various intra-module ventilation (IMV) flow rates. The coefficients were provided by the Crew and Thermal Systems Division (EC) at NASA JSC and Jacobs Technology. The model is now revalidated and able to predict minimum temperatures with good agreement to flight temperatures (within 1 °C) for both historic and recurring minimum values. Additionally, the model is partially validated for reduced flow rates. With this model, the team was able to provide new flight rule recommendations for condensation and IMV operations management.

Sydney Taylor↗

NASA NTRSDate not supplied

Multidisciplinary Dynamic Testing Challenges in Validating the NASA Artemis Architecture

NASA is in the midst of bold and exciting next steps in human exploration and spaceflight. The designs of the new Space Launch System (SLS), the Orion spacecraft and the Exploration Ground Systems (EGS) for vehicle processing and launch are essentially complete and there has been significant progress in manufacturing and assembly of specific hardware for the Artemis I and Artemis II missions. Equally as important, the program level and integrated system level testing and analyses are also well underway to support integrated verification, validation, and certificate of flight readiness (CoFR) for the first Artemis mission. Testing and analysis are key to addressing technical challenges that the Artemis missions offer. Building block approaches are required that provide the right balance between component, system, and/or element level testing that satisfies verification and validation objectives and where, uncertainties are quantified and minimized. Artemis I is a system of systems that requires a fusion of test and analysis that adeptly characterizes critical interfaces between major program elements. NASA is implementing new in-situ testing that fuse traditional aerospace structures with civil structures, such as the Integrated Modal Test for the Artemis I vehicle where the Mobile Launcher and Crawler Transporter serve as a support structure whose dynamics couple with that of the Artemis I vehicle. This new paradigm requires a closer inspection of structural behavior of the Crawler Transporter and the Mobile Launcher as they now serve multiple purposes. This requires a paradigm shift to look beyond experimental modal techniques and incorporates operational modal analysis techniques to validate dynamic models from data collected during rollout to the launch pad. A further complicating factor is the Crawler Transporter generated ground forces have numerous harmonics making extracting dynamic responses of the Artemis I, Mobile Launcher, and Crawler Transporter coupled system challenging. This discussion explores all these challenges with and attempts to understand how we best build confidence in systems and system-of-systems performance capabilities and margins and understand uncertainties.

Joel W Sills↗

NASA NTRS1997

Ground-based Validation of the EOS Multi-angle Imaging SpectroRadiometer (MISR) Aerosol Retrieval Algorithms and Science Data Products

A plan for the ground-based validation of MISR aerosol retrieval is outlined. Activities occur in two phases: (1) pre-launch, work is focused on technique development and MISR algorithm validation using conventional ground-base methods and a MISR simulator (AirMISR) operating from the ER-2 aircraft to simulate MISR on-orbit observations. (2) Post-launch, the validation program relies on ground campaigns, underflights wit the MISR simulator and the use of local measurements fo aerosol loading and properties and irradiance measurements derived from the AERONET and ISIS networks.

algorithm↗

NASA NTRS2004

Model validation of SIM external metrology at the sub-nanometer level

In order to achieve micro-arcsecond astrometry, SIM must make measurements of various optical path lengths at the picometer level. In this regime of precision, nearly every simplifying assumption in optics must be reexamined as a potential source of systematic error. SIM makes extensive use of physics-based models to predict the form and level of systematic errors affecting instrument performance. Since many of the modeling areas represent new frontiers in optical modeling, the validation of these physical models is a significant challenge that SIM must meet. In the case of the external metrology truss, the model must account for the imperfections in the corner cubes as well as the distance measuring interferometers ("beam launchers"). This model is being validated using the Kite testbed, a 2-D metrology truss with picometer-level accuracy in displacement measurements. We present the model and the results of the model validation tests on the Kite testbed.

Kuan, Gary M.↗

NASA NTRS2018

ST7 Disturbance Reduction System (DRS) Colloid Micronewton Thruster Performance and Control Algorithm Model Simulation Validation in Flight

Colloid Micronewton Thrusters (CMNT) were flight demonstrated for the first time on the ST7Disturbance Reduction System (DRS) payload on the European Space Agency (ESA) Laser Interferometer Space Antenna (LISA) Pathfinder spacecraft for attitude and drag-free spacecraft control. LISA Pathfinder was a technology demonstration mission for ESA’s LISA gravitational wave observatory, currently in Phase A with a launch date of 2034. The DRS included the Integrated Avionics Unit (IAU), eight Colloid Micronewton Thrusters (CMNT), Dynamic Control Software (DCS) and Flight Software (FSW). The CMNT technology met performance requirements operating at 5-30 µN of thrust with ≤0.1 µN resolution and ≤0.1 µN/Hz thrust noise to deliver the required nanometer-level precision spacecraft control measured by the gravitational reference sensor (GRS) in the ESA LISA Technology Package (LTP). The performance of seven of the CMNT in flight was consistent with ground test results. The colloid thruster performance model of thrust and thrust noise as a function of operational parameters (i.e. beam current, voltage, temperature, etc.) was validated in flight over a wide range of conditions. A model and simulation of the thruster control algorithm was developed and validated with flight data to predict thrust noise. This capability is important because it is considered to be a significant source of position noise on the spacecraft and, therefore, the acceleration noise on the test masses, which provide the gravity wave measurements. The CMNT thruster model data and validation with LISA Pathfinder/ST7-DRS flight experiments are discussed in this paper.

Hruby, Vlad↗

NASA NTRS2018

Validation of Fault-Tolerant Plans for Europa Clipper

The Europa Clipper mission will explore that icy moon in a series of brief ﬂybys through the Jovian radiation belts. A single event upset in the spacecraft ﬂight computer during these critical scientiﬁc periods could jeopardize the success of the mission. Rather than saﬁng and awaiting operator intervention, the Clipper mission envisions limited onboard autonomy that can restore spacecraft state suﬃciently to resume the encounter observation plan as rapidly as possible. The contingency plan is contained in an Activity Restart Timeline (ART) that is transmitted in parallel with the nominal plan, which must be co-validated jointly against all spacecraft state and resource constraints amid unpredictable fault timing. A prototype validation tool was built that leverages declarative spacecraft models and automated search techniques to ﬁnd such potential inconsistencies in the uniﬁed contingent mission plan. Early validation results within motivating scenarios are presented.

Ferguson, Eric↗

NASA NTRS2018

In-Flight Verification and Validation of Colloid Microthruster Performance

Colloid Micronewton Thrusters (CMNTs) use an electrospray to provide precision spacecraft position and pointing control. They were demonstrated in space for the first time as part of NASA’s Space Technology 7 (ST7) payload hosted by the European Space Agency’s (ESA’s) LISA Pathfinder (LPF) technology demonstration mission in January, 2016. CMNTs were the actuator in the disturbance reduction system (DRS) that provided drag-free operation of the LPF spacecraft, which will be necessary for future gravity wave observatories such as ESA’s Laser Interferometer Space Antenna (LISA) mission, currently in Phase A and scheduled for launch in 2034. The CMNT technology met performance requirements operating at 5-30 µN of thrust with 0.1 µN resolution and ≤0.1 µN/ÖHz thrust noise to deliver the required nanometer-level precision spacecraft control measured by the gravitational reference sensor (GRS) in the ESA LISA Technology Package (LTP). The performance of seven of the eight CMNTs in flight was consistent with ground test results, and as a system, all eight thrusters met mission-level performance requirements. The colloid microthruster performance model of thrust and thrust noise as a function of operational parameters (i.e. beam current, voltage, temperature, etc.) was validated in flight over a wide range of conditions. A model and simulation of the thruster control algorithm was developed and validated with flight data to predict thrust noise. This capability is important for future missions because it relates directly to the acceleration noise on the test masses, which provide the gravity wave measurements. The CMNT thruster model data and validation with LISA Pathfinder/ST7-DRS flight experiments are presented in this paper.

"O'Donnell, James"↗

NASA NTRS2020

The First Habitable-zone Earth-sized Planet from TESS. I. Validation of the TOI-700 System

We present the discovery and validation of a three-planet system orbiting the nearby (31.1 pc) M2 dwarf star TOI-700 (TIC 150428135). TOI-700 lies in the TESS continuous viewing zone in the Southern Ecliptic Hemisphere; observations spanning 11 sectors reveal three planets with radii ranging from 1 R⊕ to 2.6 R⊕ and orbital periods ranging from 9.98 to 37.43 days. Ground-based follow-up combined with diagnostic vetting and validation tests enables us to rule out common astrophysical false-positive scenarios and validate the system of planets. The outermost planet, TOI-700 d, has a radius of 1.19 ± 0.11 R⊕ and resides within a conservative estimate of the host star's habitable zone, where it receives a flux from its star that is approximately 86% of Earth's insolation. In contrast to some other low-mass stars that host Earth-sized planets in their habitable zones, TOI-700 exhibits low levels of stellar activity, presenting a valuable opportunity to study potentially rocky planets over a wide range of conditions affecting atmospheric escape. While atmospheric characterization of TOI-700 d with the James Webb Space Telescope (JWST) will be challenging, the larger sub-Neptune, TOI-700 c (R = 2.63 R⊕), will be an excellent target for JWST and future space-based observatories. TESS is scheduled to once again observe the Southern Hemisphere, and it will monitor TOI-700 for an additional 11 sectors in its extended mission. These observations should allow further constraints on the known planet parameters and searches for additional planets and transit timing variations in the system.

Emily A. Gilbert↗

NASA NTRS2021

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗

NASA NTRSDate not supplied

Pilot Assessment of Immune Dysregulation, Stress and Latent Herpesvirus Reactivation at Palmer, Antarctica - Platform for validation of Immune Countermeasures?

Recent studieshave characterized adverse health events potentially relatedto immune system dysregulation, latent herpesvirus reactivation, and clinical incidence for crewmembers onboard ISS. Both areview article describing potential spaceflight countermeasures related to immunityand a specific countermeasures protocol for deep space missions were recently published. An appropriate ground analogto enable spaceflight countermeasures has yet to be validated, although winterover in Antarctica (AWO) seems a highly relevant mission parallel to spaceflight. AWO consists of prolonged deployment, extreme environment, circadian misalignment, personal isolation, station lifestyle (varies by base), and personal risk. Through several studies, AWO at several European bases has beencharacterized, and to date the data has revealed that (immunologically) deployment to interior bases at elevation and with persistent hypobaric hypoxia possesses certaindissimilarities to spaceflight. This proposal seeks to collect low cost pilot data assessing stress, immunity and viral reactivation during AWOat thecoastalU.S. Palmer Station. Even among coastal bases, lifestyle, available crew time/workload and logistical access can vary considerably. Considering all factors, if validated, Palmer may be the most feasible location to evaluate NASA countermeasures. The goal of this pilot study is to ascertain if Palmer may serve as a spaceflight analog option for ground validation of immune countermeasures.The study initiatedwith the crew deployed for winterover at Palmer in 2020.A second crew participated in the recently concluded WO2021 season.All participatingcrew havecollectedand preservedsaliva, plasma and hair samples. On location, the crewmembers alsoperformeda fingerstick blood collection for immediate analysis of basic peripheral leukocyte subsets. Preserved biosamples have beenreturned for analysis, with the WO2020 samples received, and the WO2021 samples currently en-route to Houston. It should be noted that COVID-19 had significant impacts on operations, including training and the collection of pre-mission baseline samples. Preliminary data from the 2020 crewmembers indicate that a relatively mild but detectable immune dysregulation persists at Palmer Station, including alterations in concentration of some plasma cytokines and consistent increases in the incidence of EBV reactivation. Final study data will be tabulated upon receipt of the 2021 crew samples.

Stephanie Krieger↗

NASA NTRSDate not supplied

Development and Initial Validation of HFBP-EM Short-Form Surveys

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite includes self-report surveys designed to assess Behavioral Medicine (BMed) and Team risks for future exploration class missions. Survey data was collected during the Human Exploration Research Analog (HERA) Campaign 4 (C4), HERA Campaign 5 (C5), and during SIRIUS19 missions in the Russian Ground Based Experiment Complex, NEK. Crew time in spaceflight analogs and in spaceflight is typically limited. Extensive self-report surveys can be a significant burden to participants and are not operationally acceptable for spaceflight. The purpose of this project was to comprehensively assess the reliability and validity of the standard-length HFBP-EM surveys, identify acceptable short forms to administer during HERA C6, examine initial validation evidence for the proposed short form measures, and identify key measurement gaps in HFBP-EM coverage. In this presentation, we will report reliability and validity metrics of standard form data, describe the proposed new short forms, and present initial psychometric analyses supporting the use of these short forms.

S T Bell↗

NASA NTRS2019

Psyche Early Project Verification & Validation Planning Development

The Psyche mission to the asteroid (16) Psyche was selected as the fourteenth mission in the Discovery program in January 2017. The Psyche mission will determine if (16) Psyche is the core of a larger differentiated body. As part of the development of this mission a Verification and Validation (V&V) engineer was assigned early in the project’s design Phase B. This paper will discuss some of the strategies that the Psyche team is using to take full advantage of the early planning for V&V on flight projects and specifically how the Psyche mission is approaching these tasks. This paper will discuss the effects of having a V&V mindset on: 1) The Psyche requirements development process, and how focusing not only on how the team will verify these requirements but also on developing the tools necessary to track and monitor that verification feeds back into the requirement development process. 2) The Psyche testbed development, and how using a verification mindset is useful for identifying holes in the testbed development process, including the required testbed speed and how to think about testbed certification early in the process while encouraging trades and developing relationships with the testbed team. 3) Developing new V&V Tools for Psyche, and how developing tools early in the project development process means that they can influence the development of other requirement and scheduling tools. 4) Verification Activity Planning, which is typically done to a preliminary level during Phase B of the project, and is important for understanding the major testing that is needed to ensure that the system as built represents the design. On Psyche we are not only focused on bringing this planning to a preliminary level, we are also developing a V&V focused schedule to help us de-conflict V&V activities that may require similar resources early on in the program’s development. 5) Validation Planning, for which we are working with the testbed and model development teams to ensure that their models can be effectively validated and that the plans to do so are in place. In this paper we will describe how the Psyche mission is approaching each of these V&V areas and identify lessons that can be taken by other space missions trying to decide how much effort should be put into V&V early in the project lifecycle.

Solish, Benjamin↗