Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Model Validation and its Crucial Roles in Connecting Space Weather Research, Operations, and End-User Needs

Model validation is indispensable to transitioning a model from research to operations. In this presentation, we focus on the performance of models for specific operational purposes/user needs, which include careful selection of the corresponding specific Essential Space Environment Quantity (ESEQ) and a proper set of metrics. Initial results of our community-wide validation efforts under the COSPAR ISWAT Initiative with relevance to surface charging and internal charging will be shown. We will highlight processes involved in performing such tasks, such as setting up unified guidelines, data preparation, assessment using different metrics, etc. We will also present setbacks and challenges associated with such efforts so further progress can be made.

Yihua Zheng↗

Application of the BSRN Data in Validating the GEWEX SRB Data: Quality-Control and Resulting Available Monthly Means

The BSRN data have been used in validation of the satellite-based GEWEX SRB data, and the recent Release 4.0-IP data cover the 34-year period from July 1983 to June 2017. Here we focus on the validation of the shortwave monthly means from 1992 to 2017 against the BSRN Global 1. We first perform the BSRN-recommended quality-control on the original data. We then calculate the monthly-hourly means from which we calculate the monthly means. Twenty-four (24) monthly-hourly means are required to calculate a monthly mean. To guarantee the quality of the monthly mean, we also require that 95% or more hourly means be available in order for a monthly-hourly mean to be calculated. Since the above quality-control significantly reduces the number of available monthly means, we are curious how many monthly means we would get if we relax the quality-control, and how the resulting monthly means would compare with the GEWEX SRB data. In a version we experimented, only constant upper and lower bounds are imposed on various fluxes, and the original data are largely retained. We found that many more monthly means would be available, and the overall bias and RMS would not be significantly different from that of the strict quality-control. With the strict quality-control, if we let Avail (minimum percentage of available hourly means required for a monthly-hourly mean to be computed) change from 3.2% to 95%, the Bias/RMS/N change from -2.77/20.56/9756 to -0.35/13.41/4581, where N is the number of available monthly means, and Bias and RMS are in the unit of W/sq. m. On the other hand, with the lax quality-control, when Avail changes from 3.2% to 95%, the Bias/RMS/N change from -0.82/19.53/9819 to -0.21/14.41/5875. South Pole (SPO) is one of the sites we are particularly interested in. With the strict quality-control, and when Avail changes from 3.2% to 95%, the Bias/RMS/N change from 5.89/15.85/283 to 1.23/5.52/133; with the lax quality-control, the Bias/RMS/N change from 1.17/11.21/284 to 1.88/7.9/177.

Taiping Zhang↗

Design of Rigid-Flex PCB Robotics Leveraging Validated Finite Element Simulations

The use of rigid-flex printed circuit board (PCB) as primary structure has the potential to reduce the weight and volume of robotic systems. In the case of robotics for interplanetary exploration, these systems can leverage origami-inspired folding for increased mobility options and reduced storage volume. Folding rigid-flex PCB robotics can be constructed with rigid PCB connected by short Nomex fabric hinges coupled with flex PCB ribbon cables that permits enhanced system flexibility and energy dissipation to promote impact survivability. This paper presents a design methodology of rigid-flex PCB systems with an emphasis on impact resistance. The design process considers solder joint adequacy, panel bending, and fracture using a finite element (FE) model. The proposed design methodology is developed using a case study with NASA JPL's Pop-Up Folding Flat Explorer Robot (PUFFER). First, the finite-element (FE) modeling methodology is presented with consideration to both frequency and time-domain modeling applications, which include operational self-contact analysis and high impact scenarios. The time-domain impact modeling methodology utilizes hyperelastic material properties for the Nomex hinges. This modeling method is validated using image correlation of PUFFER drop tests. A flowchart is presented to guide users through a validated Abaqus modeling procedure for highly flexible rigid-flex systems. Next, a case study is presented in which PUFFER is subject to drop heights representative of falls into Lunar pits and then the design is refined for a more optimum impact performance. Finally, the results of the case study are used to inform a generalized design methodology for rigid-flex PCB robotics subject to high-impact loads with the considerations presented.

John Bell↗

Extension and Validation of the Pendulum Model for Longitudinal Solar Prominence Oscillations

Context. Longitudinal oscillations in prominences are common phenomena on the Sun. These oscillations can be used to infer the geometry and intensity of the filament magnetic field. Previous theoretical studies of longitudinal oscillations made two simplifying assumptions: uniform gravity and semicircular dips on the supporting flux tubes. However, the gravity is not uniform and realistic dips are not semicircular. Aims. Our aim is to understand the effects of including the nonuniform solar gravity on longitudinal oscillations and explore the validity of the pendulum model with different flux-tube geometries. Methods. We first derived the equation describing the motion of the plasma along the flux tube including the effects of nonuniform gravity, yielding corrections to the original pendulum model. We also computed the full numerical solutions for the normal modes and compared them with the new pendulum approximation. Results. We find that the nonuniform gravity introduces a significant modification in the pendulum model. We also found a cut-off period; i.e., the longitudinal oscillations cannot have a period longer than 167 min. In addition, considering different tube geometries, the period depends almost exclusively on the radius of curvature at the bottom of the dip. Conclusions. We conclude that nonuniform gravity significantly modifies the pendulum model. These corrections are important for prominence seismology, because the inferred values of the radius of curvature and minimum magnetic-field strength differ substantially from those of the old model. However, we find that the corrected pendulum model is quite robust and is still valid for noncircular dips.

Sun: corona↗

Isolation Standard Measures: A Set of Validated and Feasible Measurements Ensuring Comparability Across Isolation and Confinement Studies

Isolation and confinement studies have been essential to the preparation of crewed long-duration space missions, acting as analogues that facilitate the study of psychological and physiological responses to isolation and confinement. They also serve as opportunities for the development, testing, and validation of countermeasures and coping methods to handle the challenges that arise in such scenarios. Due to the small sample sizes in combination with high inter-individual variability, single isolation campaigns are not always sufficient for obtaining statistically significant scientific findings. To address this issue and improve comparability between different studies, the need for standardized measures to be collected in all future isolation and confinement studies was identified. Additionally, these measures should also be shown to be generally valid, reliable, feasible and acceptable in analogue and spaceflight environments. Standard measures in isolation and confinement studies allow for more direct comparisons of results and synthesis of data across isolation and confinement studies as well as provide an important step toward standard measures in spaceflight. An international expert group with representatives from different space agencies worldwide was brought together to define a core set of standard measures for isolation and confinement studies. This paper provides an overview of the expert group’s recommendations for international standard measures for future isolation and confinement studies, along with subsequent updates coordinated by the International Countermeasures Working Group (ICMWG), which was established as a sub-Working Group under the International Space Life Sciences Working Group (ISLSWG). Additional experts were consulted by the ICMWG partner agencies as required. The collection of the described set of isolation standard measures will provide data on the following parameters: sleep, mood, psychological state, psychophysiology, cognitive performance, stress and the immune system, general health and well-being, team measures, nutritional measures, and environmental conditions. For each measure, recommendations were made about duration and frequency of administration, along with specific implementation recommendations in relation to the duration of the isolation study. The set of isolation standard measures will be reassessed every two years at a minimum to ensure they are up to date and reflect the current state-of-the-art.

Isolation↗

Analysis of the Value Added When Deploying a Model-Based Approach for the Validation and Verification of the Medical Database Software

The Medical Database (MD) is a virtual repository consisting of two software components: Medical Item Database (MedID) and the Evidence Library (EL). MedID consists of engineering data and associated information for specific medical resource items (e.g., pharmaceutical, medical devices, and supporting components), while the EL is a tool which provides all of the medical evidence necessary. The MD will 1) serve as the single “source of truth” for the Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool suite for both medical evidence and medical resource engineering data and 2) will be used in conjunction with the IMPACT tool suite to inform research prioritizations and perform systematic trade study evaluations to aid stakeholders in making informed decisions regarding simulated human spaceflight missions. The MD project used a Model-Based Systems Engineering (MBSE) approach to support all life cycles of the software development, while in parallel the human factors engineering team used modeling to support Human Centered Design (HCD) strategies in an effort to improve software usability. HCD is a frequently used approach in design frameworks that develops resolutions to complexities and challenges by involving the human perspective in all steps of the problem-solving process. By integrating the model-based approaches used for systems engineering and human factors activities, the project is able to leverage the model-based artifacts originally created for HCD activities for system level and human factors validation. In this presentation, our team highlights the value added when leveraging these model-based artifacts to support the on-going verification and validation activities.

C. Laing↗

Validation of Cryogenic Propellant Tank Self-Pressurization by Leveraging Reduced Order Modeling within Computational Fluid Dynamics Simulation

Validation of cryogenic propellant tank self-pressurization was performed using a hybrid Computational Fluid Dynamics (CFD) and reduced order modeling methodology. Data from a liquid hydrogen ground test conducted at the K-site facility at the National Aeronautics and Space Administration (NASA) Glenn Research Center was used for the validation effort. Liquid phase dynamics were explicitly resolved with a CFD tool. Vapor phase dynamics were modeled as a point mass that communicated heat from the tank wall to the liquid phase via a boundary condition used at the gas-liquid interface. The method proved to be more accurate, robust, and efficient than explicit resolution of the dynamics using a standard Volume of Fluid (VOF) methodology. The subject pressurization process was found to be heavily dependent upon both the relatively high liquid temperature gradient near the gas-liquid interface and the natural convection flow path. Modeling the gas-liquid interface as an immovable surface eliminated temperature gradient destroying gas-liquid interface velocities observed in VOF simulations, and correspondingly enabled more rapid simulation since interface advection was not allowed. The single phase computational domain also facilitated the ability to demonstrate spatial resolution convergence of natural convection cells within the liquid which significantly impacted the tank pressurization rate. This work was used to demonstrate the critical physics for tank self-pressurization and numerical methodologies that may be used to best resolve those physics. The findings informed development and operation of production level CFD tools used in the Fluid Dynamics Branch at NASA Marshall Space Flight Center.

J. M. Brodnick↗

Preparations for Quesst Acoustics Validation

- Acoustic Validation Goals & Objectives - Overview and Concept of Operations - New Ground Systems Development - State-of-the sonic boom ground recording system - Unattended recording system trigger - X-59 sonic boom flight path planning tool - Real-time sonic boom prediction display - New Airborne Systems Development - Airborne near field probing system - In-flight, full-scale shockwave imagery systems - Real-time relative position pilot display - Acoustic Validation Test Approach

Larry J. Cliatt, II↗

Validation of Noise Propagation for Lined Inlets

Commercial finite element modeling tools are validated for use on inlet radiated noise predictions for an acoustically lined subsonic aircraft inlet tested in the NASA Glenn 9-foot by 15-foot low-speed wind tunnel. An in-depth review and prediction of the acoustic liner properties on the Advanced Ducted Propulsor were conducted for use in the noise predictions. Agreement between the inlet radiated noise predictions to the measured tones at approach was used as the validation for the prediction tools. Similar follow-up predictions were conducted for an acoustically lined supersonic inlet. A follow-up investigation on the effect of the acoustic liner placement within the supersonic inlet was undertaken.

Acoustics↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗

Validation of a High-Fidelity Supersonic Parachute Inflation Dynamics Model and Best Practice

The parachute inflation dynamics (PID) of a Disk-Gap-Band (DGB) parachute system travelling at supersonic velocities in the high-altitude Earth atmosphere is simulated using a high-fidelity, multiphysics, massively-parallel computational framework. The sensitivity of the simulation results with respect to critical modelling and simulation parameters, including the fluid mechanical governing equations (Euler vs Navier-Stokes with RANS turbulence closure vs Navier-Stokes with LES turbulence closer), the interaction between the flow and the suspension lines (accounted for vs not accounted for), the dynamics of the payload (restrained vs free), and the material model of the heterogeneous fabric canopy (Saint-Venant Kirchoff vs mechanics-informed multiscale neural network), is extensively investigated. The parameter investigation is enabled by advancements to the state-of-the-art in the modelling and simulation of the supersonic parachute inflation process, which are presented as part of the computational framework. The predictive quality of the computational framework in the context of supersonic PID is validated by comparison of the simulation results with the experimental results from NASA’s Advanced Supersonic Parachute Research (ASPIRE) project. Through the validation, best practices for the modelling and simulation of supersonic PID are developed and proposed.

Rabinovitch, Jason↗

Optial Experiments and Model Validation of Perturbed Starshade Designs

Starshades are a leading technology to enable the direct detection and spectroscopic characterization of Earth- like exoplanets. Critical starshade technologies are currently being advanced through the S5 Project and at the Princeton starshade testbed. We report on the status of Milestone 2 of the S5 Project, optical model validation. We present results from optical experiments of starshades with intentional perturbations built into their design. These perturbations are representative of the type of perturbations possible in a flight design and serve as points of validation for dffraction models and error budgets. We show experimental results for two perturbed shapes, a mask with all petals shifted radially outward by 5 um and a mask with shallow sine waves built into two petals. We compare these data to outputs of the optical model and demonstrate better than 25% agreement. We also present images taken in crossed polarized light and use those data to constrain physical parameters of the optical edge. Bringing in previously obtained results for other perturbed shapes, we show an agreement between experiment and model of better than 25% and argue that this satisfies the Milestone 2 criteria.

Galvin, Michael↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the turbulence simulation overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura White↗

Design of Rigid-Flex PCB Robotics Leveraging Validated Finite Element Simulations

The use of rigid-flex printed circuit board (PCB) as primary structure has the potential to reduce the weight and volume of robotic systems. In the case of robotics for interplanetary exploration, these systems can leverage origamiinspired folding for increased mobility options and reduced storage volume. Folding rigid-flex PCB robotics can be constructed with rigid PCB connected by short Nomex fabric hinges coupled with flex PCB ribbon cables that permits enhanced system flexibility and energy dissipation to promote impact survivability. This paper presents a design methodology of rigidflex PCB systems with an emphasis on impact resistance. The design process considers solder joint adequacy, panel bending, and fracture using a finite element (FE) model. The proposed design methodology is developed using a case study with NASA JPL’s Pop-Up Folding Flat Explorer Robot (PUFFER). First, the finite-element (FE) modeling methodology is presented with consideration to both frequency and time-domain modeling applications, which include operational self-contact analysis and high impact scenarios. The time-domain impact modeling methodology utilizes hyperelastic material properties for the Nomex hinges. This modeling method is validated using image correlation of PUFFER drop tests. A flowchart is presented to guide users through a validated Abaqus modeling procedure for highly flexible rigid-flex systems. Next, a case study is presented in which PUFFER is subject to drop heights representative of falls into Lunar pits and then the design is refined for a more optimum impact performance. Finally, the results of the case study are used to inform a generalized design methodology for rigid-flex PCB robotics subject to high-impact loads with the considerations presented.

de la Croix, Jean-Pierre↗

Europa Clipper Payload Verification and Validation: Test and Analysis Program Design

NASA’s Europa Clipper mission – which is planned to launch in the mid-2020s – is designed to investigate the habitability of the jovian moon Europa with a state-of-the-art suite of over 10 sensors and instruments. Now past its project critical design review, Europa Clipper is starting the execution of its verification and validation (V&V) program. The payload V&V function in particular is responsible for designing and coordinating a thorough test and analysis program that will confirm the proper functioning and performance of our payload instruments. Given the large number of instruments to manage, we have developed a suite of standardized tests and analyses that are designed to cover all of the common interfaces across instruments, while allowing for flexibility to support the unique needs of individual instruments. This suite of activities, coordinated and/or performed by the payload team, forms the bulk of our payload verification and validation campaign. This paper provides a detailed summary of the full set of V&V activities in that suite, covering the four categories of activities: analysis of lower-level evidence, analysis via simulation, testing in the system testbeds, and testing in assembly, test, and launch operations (ATLO). We will describe the purpose of each activity type, how the activities are developed, and the review process for each type of activity. We then define the complete list of activities written for each instrument and how subtleties specific to certain instruments are managed. The discussion will provide a comprehensive understanding of the activities in the payload V&V purview and how various interfaces with different levels of the project are managed. This paper also describes key metrics the payload team uses to track V&V progress and some insights into the teaming design and division of labor we use to ensure consistency and completeness across the entire payload suite. Finally, the paper will offer a snapshot of the status of the Payload V&V program prior to instrument delivery and offer insights into the upcoming phase of instrument delivery and the start of ATLO.

Lee, Dennis↗

Europa Clipper Payload Verification and Validation: Avionics-Instrument Interface Test Campaign

NASA's Europa Clipper mission will investigate Jupiter's icy moon Europa using a payload suite consisting of nine instruments to address a range of scientific objectives concerning Europa's habitability. As the project proceeds past its Critical Design Review, confidence is being built in the system's ability to achieve mission objectives through the implementation of a rigorous payload verification and validation (V&V) program. As part of this payload V&V program, instrument box-level testing was performed by the payload team to verify select instrument-avionics interface requirements. This testing was performed at JPL using the avionics testbed's Bulk Data Storage Emulator (BDSEM) with visiting instrument Test Models. This paper summarizes the Data Link test campaign involving roughly four days of functional testing per instrument, including planning, testing methods, types of issues found, and the requirement closure process. Detail is also provided on the development, deployment, and validation of a standardized analysis tool used in data reviews. This testing verified requirements related to commanding rates, loss of link, packet format, clock counters, loopback test capability, and SpaceWire jitter and skew margins. Additional risk reduction testing of basic commanding, counter behavior, science data collection and transfer, and interface swapping was also performed. Because the BDSEM venue was not originally designed to be a run for record venue, the process of characterizing venue fidelity and establishing suitability for requirement closure using data collected in this venue will also be addressed.In order to close requirements, an extensible tool was developed to post-process instrument command and telemetry data from their original binary to a human-readable format and give visibility to errors detected within the data, such as packets with Cyclic Redundancy Check errors. This tool, called payload-packet-parser, is a Python 3.9 command line tool built using a variety of open-source Python libraries. Payload-packet-parser was designed to support parsing command and telemetry packets for all Europa Clipper instruments and additional analysis tools were developed for verification of specific information interface requirements. This test campaign, including post-processing using a single parsing and verification toolset, allowed for early interface testing, alleviating testing burdens on instrument teams and buying down risk on the instrument-avionics interface by finding hardware and software issues and idiosyncrasies prior to integration with system test venues. Over twenty issues were discovered across the payload, resulting in software updates and instrument rework well in advance of any system impacts. This paper concludes with an assessment of benefits and costs of this type of testing and lessons learned.

Montanez, Leticia↗

Validation of Universal Cryogenic Flow Boiling Correlations in Thermal Desktop for Liquid Helium

Understanding two-phase cryogenic propellant behavior is key to enabling technologies for future spaceflight missions. Developing accurate models of two-phase flow phenomena, particularly flow boiling in the heating configuration is relevant to the propellant transfer process both in microgravity and on other planetary surfaces. Currently there is a need for more accurate, direct cryogenic data anchored models for various boiling phenomena. Recently, universal correlations for cryogens flowing in heated tubes have been developed for a wide variety of fluids, thermodynamic conditions, and various regimes across the boiling curve, and have been patched to provide a smooth, continuous predictive curve. This paper demonstrates how these correlations have been ported into Thermal Desktop to improve predictive performance. To test the validity of the new correlations, Thermal Desktop is validated against a historical dataset of flow boiling experiments in the heating configuration using liquid helium. Based on results, the new correlations show a substantial improvement over the original built-in flow boiling correlations in Thermal Desktop in predicting the wall temperature as a function of preponderant parameters for this quantum fluid.

cryogenic propellant transfer↗

Validation of Universal Cryogenic Flow Boiling Correlations in Thermal Desktop for Liquid Helium

Understanding two-phase cryogenic propellant behavior is key to enabling technologies for future spaceflight missions. Developing accurate models of two-phase flow phenomena, particularly in the current work, flow boiling in the heating configuration, is relevant to the propellant transfer process both in 1-g and microgravity. Currently there is a need for more accurate, direct cryogenic data anchored models for various boiling phenomena. Recently, universal correlations for cryogens flowing in heated tubes have been developed for a wide variety of fluids, thermodynamic conditions, and various regimes across the boiling curve, and have been patched to provide a smooth, continuous predictive curve. This paper describes implementation and validation of these correlations into Thermal Desktop to improve predictive performance, with a focus on liquid helium. Results from Thermal Desktop using both the built-in and new correlations are validated against a historical dataset of flow boiling experiments in the heating configuration using liquid helium. Based on results, the new correlations show a substantial improvement over the original built-in flow boiling correlations in Thermal Desktop in predicting the wall temperature as a function of preponderant parameters for this quantum fluid at temperatures greater than the lambda temperature, T λ = 2.17K.

cryogenic propellant transfer↗