SEARCH · Engineering Papers

Results for “VERIFICATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Verification and Validation of Progressive Damage and Failure Analysis Methods for Intralaminar Failure Modes in Thermoplastic Composites

Current progressive damage and failure analysis (PDFA) methods were developed around thermoset material systems and their physical behavior. However, the applicability of these analysis methods has not been evaluated for use in modeling thermoplastic material systems. As part of the Hi-Rate Composite Aircraft Manufacturing (HiCAM) Project sponsored by NASA, intralaminar failure characterization was completed on a thermoplastic material system, AS4D/PEKK-FC, with off-axis tension (OAT) and off-axis compression (OAC) testing. The experiments were able to capture matrix non-linear shear behavior and the failure envelope of the material system. Two PDFA methods, LS-DYNA MAT299 and NASA’s CompDam-DGD, were then employed to simulate individual coupon behavior and simulation results were compared to published verification and validation guidelines from the CMH-17 crashworthiness working group. The results found that the two modeling methods provided suitable representation of material behavior of thermoplastics.

PDFA↗

NASA NTRSDate not supplied

Verification and Calibration of Spectroscopy and Polarization modes for the Roman Coronagraph Instrument

As part of its technology demonstration, the Nancy Grace Roman Space Telescope Coronagraph Instrument (CGI) will demonstrate point source spectroscopy and polarization measurements of disks. The spectroscopy mode is a zero-deviation Amici prism and slit to a confirmed planet after an imaging detection. The Wollaston prism polarization optics allow for imaging two orthogonal polarization states simultaneously. The CGI spectral characterization modes, designed and built at Goddard Space Flight Center (GSFC), have a spectral resolution of R50 in two 15% bandpass centered at 660nm and 730nm intended to capture key methane absorption features. There are duplicate Wollaston prism channels, clocked 45 degrees with respect to one another covering 10% bandpasses at 575 and 825nm, but the optics meet performance requirements across the full CGI bandpass. The Wollaston design and optical elements are a contribution by the Japanese Aerospace Exploration Agency, with final alignment and testing being done at GSFC. We highlight the requirements for these modes, the ground-to-orbit calibration process, and the operations required to use a deployable slit on a CGI point source in the presence of pointing error. We also provide further detail on the optomechanical design, testing results from the final as-built flight units, verification process, and performance of the as-built flight assemblies.

Tyler D. Groff↗

NASA NTRS2024

Looking to the Future: A Call to Action for Advanced GNC Algorithm Verification and Validation

Future space systems will rely on autonomous Guidance, Navigation, and Control (GNC) functions to efficiently manage safe and precise self-directed operations in uncertain complex environments. Fundamentally, the GNC system plays a key role in mission performance and safety because it computes the ideal trajectory (Guidance), determines the actual trajectory (Navigation), and executes the ideal trajectory (Control) of a vehicle’s position and attitude. Our current GNC systems are highly automated and already have a high degree of complexity. As missions become more ambitious, GNC systems for launch vehicles and space platforms (e.g., spacecraft, probes, and landers) will require higher levels of performance and autonomous operation than previously encountered, for example, this includes GNC for optimizing aerodynamic and/or propulsion performance during planetary entry. This GNC Verification and Validation (V&V) paper highlights concerns with what undoubtedly will be a trend towards increased complexity as fully autonomous GNC systems are developed for future space missions. Clearly, complex GNC systems pose challenges in the prelaunch V&V phase, which is a relatively expensive part of a mission’s life cycle. Essentially the V&V phase is focused on checking that the system effectively meets all the design and operational requirements for the mission. The authors of this paper (i.e., the Inter-Agency Working Group of GNC subject matter experts) focused on this fundamental question over the past few years: Will the GNC engineering community of practice be sufficiently prepared to perform the necessary V&V on evolving GNC architectures that are driven by very demanding requirements for autonomy, resiliency, reconfigurability, adaptability, and mission cost-benefit balance? It is the viewpoint of our Inter-Agency team that the GNC V&V approaches and processes needed to address the next generation of complex GNC systems, which likely will employ various forms of modern GNC technology, are not currently established to the level the community will need in the future. While researchers and practitioners have made some progress in developing new GNC V&V methods for modern GNC systems, a good deal of work remains to be done to codify such methods in a comprehensive and systematic manner. Thus, the Inter-Agency team’s partner organizations [the National Aeronautics and Space Administration (NASA), the European Space Agency (ESA), the National Centre for Space Studies (CNES), the German Aerospace Center (DLR), the French Aerospace Lab (ONERA), and ISAE-SUPAERO] have conducted preliminary investigations into advancing GNC V&V techniques, which resulted in the identification of the need for education, new V&V tools, and benchmark problems for the GNC community. The necessary proactive steps to be taken to meet the challenges and fill the gaps in GNC V&V are summarized in this paper. The first steps include identifying advanced analysis tools, developing a GNC V&V roadmap, and expanding education and training programs for GNC practitioners. This paper is a call to action and proposes a comprehensive set of recommended actions for all our stakeholders: space agencies, researchers, and industry.

Samir Bennani↗

NASA NTRS2024

Validation & Verification of CFD Models for Cryogenic Fluid Management of Propellant Tanks in Space

This article describes the need and the strategy for CFD model development, validation, and verification for Cryogenic Fluid Management (CFM) of Propellant Tanks in Space. It describes the type of CFD models that must be developed to address the future needs of Space CFM. It also discusses the two classes of experiments currently used to validate the fidelity of the CFD models. These two experiment classes are: (a) the small-scale simulant fluid science experiments that are equipped with scientific diagnostics to elucidate the underlying two-phase fluid physics of the CFM processes; and (b) the large-scale cryogenic experiments that assess the engineering performance of the propellant tank for storage and transfer. The current status of the CFD model development and validation is briefly assessed by presenting examples of segregated two-phase flow problems that have been successfully modeled. The future model development directions for CFM situations involving more complex interpenetrating phases are also defined.

Cryogenic Fluid Management↗

NASA NTRS2024

The Roman Space Telescope Observatory Build, Test and Verification Status

The Nancy Grace Roman Space Telescope (“Roman”) was prioritized by the 2010 Decadal Survey in Astronomy and Astrophysics and is NASA’s next astrophysics flagship observatory. Launching no earlier than 2026, it will conduct several wide field and time domain surveys, as well as conduct an exoplanet census. Roman’s large field of view, agile survey capabilities, and excellent stability enable these objectives, yet present unique engineering and test challenges. The Roman Observatory comprises a Spacecraft and the Integrated Payload Assembly (IPA), the latter of which includes the Optical Telescope Assembly (OTA), the primary science Wide Field Instrument, a technology demonstration Coronagraph Instrument, and the Instrument Carrier, which meters the OTA to each instrument. The Spacecraft supports the IPA and includes the Bus, Solar Array Sun Shield, Outer Barrel Assembly, and Deployable Aperture Cover. It provides all required power, command handling, attitude control, communications, data storage, and stable thermal control functions as well as shading and straylight protection across the entire field of regard. This paper presents the Observatory as it begins integration and test, as well as describes key test and verification activities.

Infrared Missions↗

NASA NTRS2024

Runtime Verification of Hard Realtime Systems With Copilot: A Tutorial

This presentation is a tutorial on RV using Copilot, a runtime verification framework for real-time embedded systems. Copilot monitors are written in a compositional, stream-based language with support for a variety of Temporal Logics (TL), which results in robust, high-level specifications that are easier to understand than their traditional counterparts. The framework translates monitor specifications into C code with static memory requirements, which can be compiled to run on embedded hardware.

runtime monitoring↗

NASA NTRSDate not supplied

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Payload offloading↗

NASA NTRSDate not supplied

Independent Verification and Validation for Artemis I Ascent Integrated Flight Performance Simulation

The NASA Engineering and Safety Center (NESC) has performed independent model development to support cross-model verification for the Space Launch System (SLS) Program since 2012 which culminated, for Artemis I, in a postflight reconciliation analysis of the Artemis I ascent trajectory (validation). This post-flight analysis was completed by both the NESC and the SLS Program. Upon successful completion of the Artemis I mission, multiple preflight simulations of the nominal ascent trajectory were updated with Day of Launch (DOL) conditions and simulated results were compared to reconstructed flight data derived from telemetry measurements. Dispersed trajectories were also produced using a combination of DOL conditions and preflight uncertainties, which ideally should bound the Artemis I flight data. Finally, multibody dynamics were simulated for some of the separation events to support clearance analyses. This paper focuses on validating and understanding the accuracy of the models by comparing simulated results against the Artemis I flight data. In addition, discrepancies uncovered between simulations led to opportunities to investigate areas for potential model improvement to refine preflight simulations for future Artemis missions. Included in this paper is background on the flight performance simulation tools, the postflight analysis approach, and a comparison of simulation results against the Artemis I flight data. Simulated results were found to generally be in close agreement with each other and the Artemis I flight data.

Jacob Fleck↗

NASA NTRS2026

In-suit CO2 Washout Test System (ICWTS) for CO2 Washout Verification in Spacesuits

Since the time of Mercury, Gemini, and Apollo, NASA has been performing CO 2 washout verification of spacesuits with Human in the Loop (HITL) test methods. Classically, the only instrumentation both with the accuracy and response time necessary was that of external mass spectrometers or medical gas analyzers fed by a long capillary line from the oro-nasal region within the suit. The helmet CO 2 washout configuration including the challenges posed by variation of a suited human subject frequently created difficulty in capturing adequate breath by breath data. For example, a nasal cannula could be worn with reasonable comfort however it posed the following challenges: (1) impeded the test subject’s ability to do a proper Valsalva maneuver; (2) frequently provided a corrupted waveform with relative movement; (3) precluded the ability to evaluate the Flow Weighted Average (FWA) at subject interface. A mouthpiece could be used in lieu of a cannula but posed challenges as well: (1) created potential disturbances of the flow field; (2) precluded the test subject from speaking during usage; and (3) presented comfort issues limiting the duration of test points. These challenges made it impractical to use a mouthpiece for anything other than short lab ambient environment tests. Technology development and NASA investment have afforded new capabilities to address some of these measurements providing improved data collection and are implemented in the In-suit CO 2 Washout Test System (ICWTS) which provides suit inlet/outlet pressure, temperature, relative humidity, partial pressure of oxygen, partial pressure of CO 2 , and flow measurement coupled with the acquisition of the inspired PPCO 2 including the ability for FWA measurement. This test system, coupled with use of the In-suit Respiration Mannequin Assembly (IRMA) and Computational Fluid Dynamics (CFD) combine to provide a full picture of the in-suit oro-nasal flow field and effectiveness of CO 2 washout in a spacesuit design.

Colin Campbell↗

NASA NTRS2026

In-suit CO 2 Washout Test System (ICWTS) for CO 2 Washout Verification in Spacesuits

Colin Campbell↗

DOE OSTI2021

VERIFICATION MEASUREMENTS OF THE MASS AND ENRICHMENT OF URANIUM OXIDE CARD SOURCES

Measurements were performed to determine the mass and enrichment of 10 uranium oxide (U3O8) card sources. The measurements and analysis were completed as a verification of the card sources in support of Oak Ridge National Laboratory’s nuclear material control and accountability program. Although these cards are not nationally accredited as a nuclear standard, they are used as a working reference for measurements, such as holdup. The uranium card source measurements were taken with a broad energy germanium detector and the Genie 2000 Gamma Acquisition and Analysis software. A complete characterization of each of the 10 uranium card sources was performed using the 4 characteristic full energy peaks of 235U. Using the In Situ Object Counting System software to determine the mathematical efficiency of the measurement, the mass of 235U in each card was determined. The 235U mass in each card ranged from 10.42 to 12.63 g with a systematic error between 0.76 and 0.95 g and a random error of 0.01 g for each card source. The Multi-Group Analysis for Uranium (MGAU) software and the Fixed-Energy, Response Function Analysis with Multiple Efficiency (FRAM) isotopic analysis software were used to determine the isotopic composition of the uranium cards. The measured enrichment was compared to the declared enrichment for each card, with uncertainties ranging from 2.7% to 4.3% for the MGAU analysis and 2.3% to 4.1% for the FRAM analysis. This is a good example of how a well-benchmarked mathematical calibration method can be useful in characterizing uranium sources.

Hunneke, Rachel↗

DOE OSTI2022

Baseline Characterization Database Verification Report – 2114 Billet A20568

This ECAR provides the results of a validity evaluation of the physical and mechanical property data collected on a billet of nuclear-grade graphite (i.e., 2114 Billet A20568) in support of the ART Baseline Graphite Characterization Program.1,2 Millions of raw data points have been collected during testing and quantification analyses for these billets. The summary scalar property values and supplementary traceability data are collected into comprehensive spreadsheets. Data sets are composed of single billets of graphite for any given grade, organized by mechanical test-specimen type, and further subdivided into individual spreadsheet tabs according to the specific test or evaluation being performed. A direct analysis of properties was not conducted, and this report does not provide information on the validity or performance characteristics of the graphite itself. Rather, this report is intended as a verification of the completeness of actual data collected in accordance with PLN-3467, “Baseline Graphite Characterization Plan: Electromechanical Testing,”3 and their representation of the measurement and test results with sole regard to the graphite billets under evaluation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Improved Verification and Validation Testing and Tools including Nuclear Criticality Safety Applications with the MCNP6.3® Code [Abstract]

A new Python-based framework has been developed to enable a more consistent layout with automatable setup, execution, and documentation of all verification and validation (V&V) test suites previously established for use with the MCNP code. In this paper, the new general framework for the V&V test suites is discussed, including information on all of the current capabilities and plans for future capabilities. For nuclear criticality safety applications, the existing V&V benchmark problems within the criticality, extended criticality, and analytic k-effective test suites have been ported into this new framework. In addition, the status and updates to the Rossi-alpha and subcritical multiplicationtest suites will be discussed. Some V&V results exercising new MCNP6.3 capabilities will be demonstrated.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Safety Compliance Verification of Fuel Cell Electric Vehicle Exhaust

NREL has been developing compliance verification tools for allowable hydrogen levels prescribed by the Global Technical Regulation Number 13 (GTR-13) for hydrogen fuel cell electric vehicles (FCEVs). As per GTR-13, FCEV exhaust is to remain below 4 vol% H2 over a 3-second moving average and shall not at any time exceed 8 vol% H2 and that this requirement is to be verified with an analyzer that has a response time of less than 300 ms. To be enforceable, a means to verify regulatory requirements must exist. In response to this need, NREL developed a prototype analyzer that meets the GTR metrological requirements for FCEV exhaust analysis. The analyzer was tested on a commercial fuel cell electric vehicle (FCEV) under simulated driving conditions using a chassis dynamometer at the Emissions Research and Measurement Section of Environment and Climate Change Canada and FCEV exhaust was successfully profiled. Although the prototype FCEV Exhaust Analyzer met the metrological requirements of GTR-13, the stability of the hydrogen sensor was adversely impacted by condensed water in the sample gas. FCEV exhaust is at an elevated temperature and nearly saturated with water vapor. Furthermore, condensed water is present in the form of droplets. Condensed water in the sample gas can collect on the hydrogen sensing element, which would not only block access of hydrogen to the sensor but can also permanently damage the sensor. In the past year, the design of the gas sampling system was modified to mitigate against the transport of liquid water to the sensing element. Laboratory testing confirmed the effectiveness of the modified sampling system water removal strategy while maintaining the measurement range and response time required by GTR-13. Testing of the upgraded analyzer design on an FCEV operating on a chassis dynamometer is scheduled for the summer of 2021.

DIRECT ENERGY CONVERSION,HYDROGEN↗

DOE OSTI2022

Verification and Validation of START: A Spent Nuclear Fuel Routing and Decision Support Tool

The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based geospatial decision-support tool being developed by the US Department of Energy’s Office of Integrated Waste Management (IWM) to support federal interim storage for spent nuclear fuel (SNF) and associated transportation. START provides many functions for the IWM program including: serving as a communications tool for conveying geospatial data and information, an options analysis tool for exploring potential transport modes and routes for transporting SNF from nuclear power plants to future federal interim storage facilities, an emergency response planning tool for Tribes and States to identify training needs along potential SNF transport corridors, an environmental analysis tool for estimating potential radiation dose exposure from incident-free and incident-case SNF transport conditions, and a systems analysis support tool providing route-related inputs for system throughput analysis. As part of the START development process, a verification and validation (V&V) effort is being undertaken. In the initial V&V phase, several outputs of the START tool were checked such as the total distance, population and population densities within the buffer zone, and incident free dose. The V&V process is fluid as it will be utilized after each version change to ensure that the core functionalities of the tool are maintained and the results are consistent with the previous versions. Efforts have also been put into developing scripts to aid in the process of automating certain sections of the V&V work. As some of the V&V efforts use Environmental Systems Research Institute’s (ESRI) tools upon which the START framework is built, the START data were compared against outputs from tools like Quantum Geographic Information System (QGIS) for buffer zone populations and route lengths to ensure independence of the V&V process. Good agreement was observed between the START results and the independent V&V studies with the majority of the differences falling between 1% and 5% for populations within the buffer zone and route distance. This presentation describes the development and design of the START tool, V&V methods employed for various metrics of interest and their respective results, and future plans.

START, transportation, GIS, V&V↗

DOE OSTI2022

Assessing the Impact of Increased Verification Measurements of Category III/IV Material Receipts

Revisions to the US Department of Energy (DOE) regulations for material control and accountability are expected to dramatically increase the number of verification measurements required upon receipt of nuclear material transfers. Material categories and types that were not routinely quantitatively measured upon receipt (Category III and IV) have been added to the more detailed regulations on shipments and receipts of nuclear materials. In anticipation of this change to the regulations, this project was initiated to identify measurement needs in the DOE complex with respect to performing these additional quantitative measurements. The results of surveying multiple DOE facilities to understand the scope of the impact and the potential measurement capability needs are presented.

Bean, Robert↗

DOE OSTI2022

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗

DOE OSTI2023

Trepanning Graphite Samples at a Shutdown Magnox Reactor: A US-UK Joint Exercise for Nuclear Verification

In April 2022, a team sponsored by the US DOE Office of Nuclear Verification (ONV) shipped trepanning equipment to the nuclear power station at Trawsfynydd, Wales, UK to collect samples from the graphite moderator of Reactor 1. The sampling campaign to collect 48 graphite samples was completed in five weeks beginning July 11. Half the samples will be analyzed in the US to determine the total energy production of the facility. The other half will be analyzed by Magnox Ltd. to support decisions for options for the ultimate decommissioning path for the facility. This paper provides a description of the equipment and the operations required to trepan, collect, and package the samples while controlling the small amounts of radioactive graphite dust entrained on and within the tool. The most important sample parameter needed is the precise location of the sample, to within ±6 mm in a fuel channel, while the tool is deployed to between 12 and 20 meters below the operations floor; our means of achieving this precision is given.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗