Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Verification of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Unconservatism of Linear-Elastic Fracture Mechanics (LEFM) Analysis Post Autofrettage

The scope of the NASA Engineering and Safety Center (NESC) Unconservatism of Linear-Elastic Fracture Mechanics (LEFM) Analysis Post Autofrettage assessment was to evaluate the influence of the elastic-plastic autofrettage cycle on elastic cycles post autofrettage and generate data to support damage tolerance life analysis verification approach. The decision to include an elastic-plastic autofrettage cycle is informed by other factors beyond damage tolerance, including manufacturing and fatigue crack initiation. The results of the NESC assessment are contained in this report.

Linear-Elastic Fracture Mechanics↗
NASA NTRSDate not supplied

NASA’s Developments in Cryogenic Fluid Management Technology

NASA has been pursuing the development and demonstration of enabling and enhancing technologies for Cryogenic Fluid Management (CFM) in collaboration with the US industry. NASA’s vision for current and future space exploration requires high-performance chemical and nuclear propulsion solutions that utilize cryogens. The Agency will use cryogenic fluids for Earth-to-orbit transportation, human missions to the Moon and Mars, planetary exploration, and in-situ resource utilization (ISRU) production. All these architectures will require state-of-the-art long-duration storage on the surface and in-space transfer for refueling. This paper focuses on key CFM technology developments completed or ongoing by the Cryogenic Fluid Management Portfolio Office within NASA’s Space Technology Mission Directorate. The CFM Portfolio Office, partnered with US aerospace industry, has invested in CFM technology ground and flight demonstrations, focused on maturing CFM hardware and operations for Artemis and Moon to Mars activities. These demonstrations additionally provide NASA with data to inform numerical modeling activities for verification and validation of design tools and approaches for future missions. This paper includes discussion on remaining high-priority open CFM technology gaps for Mar-forward architectures and initiatives for closure.

Cryogenic Fluid Management↗
DOE OSTI2024

Quantifying Investment Risk: Analysis of the Purchase Decision of a Nuclear Power Plant

Cost overruns are an ill-fated part of the deployment history of nuclear power plants (NPPs) in the United States, and yet studies increasingly show the important role nuclear technologies must play in decarbonizing the U.S. economy. Paradoxically, then, a key piece of a coherent decarbonization strategy depends on attracting investor action to a purchase where historical cost overruns have been sizeable. To address this challenge, this study aims to develop a financial model that quantifies risk of cost overruns in the decision-making process for purchasing advanced reactor concepts. Using the concept of Value at Risk (VaR), the model is built to evaluate financial risk nuclear construction with the aim to identify risk mitigation strategies. The objective is to identify strategies to mitigate cost-risk challenges and to assess the potential reduction in investor risk exposure. The paper presents the initial development and preliminary verification of the financial risk analysis model. The development of this model involved a comprehensive approach to estimating financial risk over the operating life of NPP that stems from construction uncertainties. By utilizing net present value (NPV) with discounted cash flows, the model captures the complex interconnections of project costs, construction timelines, revenue, and uncertainties. Verification of the model involved testing historical data from previous reactor construction projects against the construction project of Vogtle 3 and 4. The results of this paper present the comparison of the preconstruction cost overrun prediction with the current cost estimates from a nearly complete Vogtle 3 and 4.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗
NASA NTRS1991

Software reliability report

There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Unfortunately, the models appear to be unable to account for the random nature of the data. If the same code is debugged multiple times and one of the models is used to make predictions, intolerable variance is observed in the resulting reliability predictions. It is believed that data replication can remove this variance in lab type situations and that it is less than scientific to talk about validating a software reliability model without considering replication. It is also believed that data replication may prove to be cost effective in the real world, thus the research centered on verification of the need for replication and on methodologies for generating replicated data in a cost effective manner. The context of the debugging graph was pursued by simulation and experimentation. Simulation was done for the Basic model and the Log-Poisson model. Reasonable values of the parameters were assigned and used to generate simulated data which is then processed by the models in order to determine limitations on their accuracy. These experiments exploit the existing software and program specimens which are in AIR-LAB to measure the performance of reliability models.

Wilson, Larry↗
NASA NTRS2010

Development of a Response Surface Thermal Model for Orion Mated to the International Space Station

A study was performed to determine if a Design of Experiments (DOE)/Response Surface Methodology could be applied to on-orbit thermal analysis and produce a set of Response Surface Equations (RSE) that accurately predict vehicle temperatures. The study used an integrated thermal model of the International Space Station and the Orion Outer mold line model. Five separate factors were identified for study: yaw, pitch, roll, beta angle, and the environmental parameters. Twenty external Orion temperatures were selected as the responses. A DOE case matrix of 110 runs was developed. The data from these cases were analyzed to produce an RSE for each of the temperature responses. The initial agreement between the engineering data and the RSE predictions was encouraging, although many RSEs had large uncertainties on their predictions. Fourteen verification cases were developed to test the predictive powers of the RSEs. The verification showed mixed results with some RSE predicting temperatures matching the engineering data within the uncertainty bands, while others had very large errors. While this study to not irrefutably prove that the DOE/RSM approach can be applied to on-orbit thermal analysis, it does demonstrate that technique has the potential to predict temperatures. Additional work is needed to better identify the cases needed to produce the RSEs

Miller, Stephen W.↗
NASA NTRS2001

High Speed PC Based Data Acquisition and Instrumentation for Measurement of Simulated Low Earth Orbit Thermally Induced Disturbances

The Hubble Space Telescope (HST) Disturbance Verification Test (DVT) was conducted to characterize responses of the Observatory's new set of rigid solar array's (SA3) to thermally induced 'creak' or stiction releases. The data acquired in the DVT were used in verification of the HST Pointing Control System on-orbit performance, post-Servicing Mission 3B (SM3B). The test simulated the on-orbit environment on a deployed SA3 flight wing. Instrumentation for this test required pretest simulations in order to select the correct sensitivities. Vacuum compatible, highly accurate accelerometers and force gages were used for this test. The complexity of the test, as well as a short planning schedule, required a data acquisition system that was easy to configure, highly flexible, and extremely robust. A PC Windows oriented data acquisition system meets these requirements, allowing the test engineers to minimize the time required to plan and perform complex environmental test. The SA3 DVT provided a direct practical and complex demonstration of the versatility that PC based data acquisition systems provide. Two PC based data acquisition systems were assembled to acquire, process, distribute, and provide real time processing for several types of transducers used in the SA3 DVT. A high sample rate digital tape recorder was used to archive the sensor signals. The two systems provided multi-channel hardware and software architecture and were selected based on the test requirements. How these systems acquire and processes multiple data rates from different transducer types is discussed, along with the system hardware and software architecture.

Sills, Joel W., Jr.↗
NASA NTRS1994

Simplifying Operations with an Uplink/Downlink Integration Toolkit

The Operations Engineering Lab (OEL) at JPL has developed a simple, generic toolkit to integrate the uplink/downlink processes (often called closing the loop) in JPL's Multimission Ground Data System. This toolkit provides capabilities for integrating telemetry verification points with predicted spacecraft commands and ground events in the Mission Sequence of Events (SOE) document. This toolkit is designed to greatly simplify the user's ability to access and view telemetry data, and also provide a means to view this data in a context of the commands and ground events that are used to interpret it. This paper will discuss the toolkit implementation, including design trade-offs and future for enhancing the automated capabilities.

ground↗
DOE OSTI2024

A Causal Approach to Model Validation and Calibration

This poster presents a novel method for validation and verification that focuses on identifying causal relationships between data elements, moving beyond traditional statistical and machine learning approaches. These methods employ causal discovery techniques to reveal the underlying mechanisms of data generation. The research utilizes structural causal models and directed acyclic graphs to depict causal relationships. This approach assists in achieving alignment between simulation models and reality.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2010

Ignition-and-Growth Modeling of NASA Standard Detonator and a Linear Shaped Charge

The main objective of this study is to quantitatively investigate the ignition and shock sensitivity of NASA Standard Detonator (NSD) and the shock wave propagation of a linear shaped charge (LSC) after being shocked by NSD flyer plate. This combined explosive train was modeled as a coupled Arbitrary Lagrangian-Eulerian (ALE) model with LS-DYNA hydro code. An ignition-and-growth (I&G) reactive model based on unreacted and reacted Jones-Wilkins-Lee (JWL) equations of state was used to simulate the shock initiation. Various NSD-to-LSC stand-off distances were analyzed to calculate the shock initiation (or failure to initiate) and detonation wave propagation along the shaped charge. Simulation results were verified by experimental data which included VISAR tests for NSD flyer plate velocity measurement and an aluminum target severance test for LSC performance verification. Parameters used for the analysis were obtained from various published data or by using CHEETAH thermo-chemical code.

Oguz, Sirri↗
DOE OSTI2026

RTN-117: Image Calibration and Instrument Signal Removal for the First Year of the LSST

The NSF-DOE Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) requires calibration products that provide uniform, stable, and accurate photometric and astrometric performance across the 3.2 gigapixel focal plane and throughout the 10-year survey. This paper details the algorithms and workflows used to produce instrument calibrations and remove instrumental artifacts for Data Preview 2 (DP2)---the first end-to-end processing demonstration using on-sky data with the LSST Camera (LSSTCam). We describe the verification, acceptance, and certification framework used to assess calibration quality and quantify residual systematics. We show baseline metrics on calibrated science images to evaluate the robustness of the calibration and instrument signature removal (ISR) data processing pipelines for DP2. Finally, we summarize the known limitations observed in DP2 production and outline expected algorithmic improvements for the first public LSST data release (Data Release~1, DR1).

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2006

Convective Weather Forecast Quality Metrics for Air Traffic Management Decision-Making

Since numerical weather prediction models are unable to accurately forecast the severity and the location of the storm cells several hours into the future when compared with observation data, there has been a growing interest in probabilistic description of convective weather. The classical approach for generating uncertainty bounds consists of integrating the state equations and covariance propagation equations forward in time. This step is readily recognized as the process update step of the Kalman Filter algorithm. The second well known method, known as the Monte Carlo method, consists of generating output samples by driving the forecast algorithm with input samples selected from distributions. The statistical properties of the distributions of the output samples are then used for defining the uncertainty bounds of the output variables. This method is computationally expensive for a complex model compared to the covariance propagation method. The main advantage of the Monte Carlo method is that a complex non-linear model can be easily handled. Recently, a few different methods for probabilistic forecasting have appeared in the literature. A method for computing probability of convection in a region using forecast data is described in Ref. 5. Probability at a grid location is computed as the fraction of grid points, within a box of specified dimensions around the grid location, with forecast convection precipitation exceeding a specified threshold. The main limitation of this method is that the results are dependent on the chosen dimensions of the box. The examples presented Ref. 5 show that this process is equivalent to low-pass filtering of the forecast data with a finite support spatial filter. References 6 and 7 describe the technique for computing percentage coverage within a 92 x 92 square-kilometer box and assigning the value to the center 4 x 4 square-kilometer box. This technique is same as that described in Ref. 5. Characterizing the forecast, following the process described in Refs. 5 through 7, in terms of percentage coverage or confidence level is notionally sound compared to characterizing in terms of probabilities because the probability of the forecast being correct can only be determined using actual observations. References 5 through 7 only use the forecast data and not the observations. The method for computing the probability of detection, false alarm ratio and several forecast quality metrics (Skill Scores) using both the forecast and observation data are given in Ref. 2. This paper extends the statistical verification method in Ref. 2 to determine co-occurrence probabilities. The method consists of computing the probability that a severe weather cell (grid location) is detected in the observation data in the neighborhood of the severe weather cell in the forecast data. Probabilities of occurrence at the grid location and in its neighborhood with higher severity, and with lower severity in the observation data compared to that in the forecast data are examined. The method proposed in Refs. 5 through 7 is used for computing the probability that a certain number of cells in the neighborhood of severe weather cells in the forecast data are seen as severe weather cells in the observation data. Finally, the probability of existence of gaps in the observation data in the neighborhood of severe weather cells in forecast data is computed. Gaps are defined as openings between severe weather cells through which an aircraft can safely fly to its intended destination. The rest of the paper is organized as follows. Section II summarizes the statistical verification method described in Ref. 2. The extension of this method for computing the co-occurrence probabilities in discussed in Section HI. Numerical examples using NCWF forecast data and NCWD observation data are presented in Section III to elucidate the characteristics of the co-occurrence probabilities. This section also discusses the procedure for computing throbabilities that the severity of convection in the observation data will be higher or lower in the neighborhood of grid locations compared to that indicated at the grid locations in the forecast data. The probability of coverage of neighborhood grid cells is also described via examples in this section. Section IV discusses the gap detection algorithm and presents a numerical example to illustrate the method. The locations of the detected gaps in the observation data are used along with the locations of convective weather cells in the forecast data to determine the probability of existence of gaps in the neighborhood of these cells. Finally, the paper is concluded in Section V.

Chatterji, Gano B.↗
NASA NTRS1976

Computer program for design and performance analysis of navigation-aid power systems

The paper examines the requirements, design rationale, operation, and verification of a computer program designated as design synthesis/performance analysis (DSPA) computer program, which is capable of performing all the calculations necessary to understand the overall characteristics of solar array/battery power systems for navigation-aid applications. Despite the uncertainties in the erratic solar array degradation data and the potential impact on actual battery behavior, verification of the DSPA is considered successful. The program is shown to have the capability of simulating the performance of solar array/battery navigation-aid power systems. It can also be used to synthesize power system designs and provide essential design and cost data.

Weiner, H.↗
NASA NTRS1978

Spacelab development and its operational verification

This paper gives a brief status report on the current Spacelab program and describes how the results of ground and flight tests will be combined to provide the operational verification of the system. For the on-going project, data on design, testing and fabrication plans are presented. In particular, recent changes to meet the constraints of a 'build-to-cost' project are described. In the operational verification of Spacelab, ground and flight tests which ESA and NASA will perform are addressed. The installation of test instrumentation and the performance of integrated tests will be accomplished in the US. Experiments for the first flight will be integrated into Spacelab racks and pallets and simulated mission tests performed. On-orbit, system thermal surveys are planned and stress data will be obtained during launch and re-entry.

Bignier, M.↗
NASA NTRS2024

Anthropometric Measurement Procedures at the Anthropometry and Biomechanics Facility

The Anthropometry and Biomechanics Facility (ABF) at NASA Johnson Space Center (JSC) is the centralized source of anthropometry data at NASA for use in requirement development, engineering design, and verification of human-system integrations such as spacesuits and vehicles. To ensure the collection of consistent, accurate, and valid anthropometry data, ABF has defined anthropometric measurements and anatomical landmarks which are generally based on the Anthropometric Survey for US Army Personnel (ANSUR), but with additional measurements which have been uniquely designed for spacesuit and hardware accommodation purposes. Unlike ANSUR, NASA anthropometry measurements primarily rely on 3D body scanning, a method which allows for explicitly defining the process of collecting measurements and the quality control methods used to ensure measurement reliability. In addition to ABF’s anthropometry measurement definitions and procedures, this presentation will also compare specifics of different measurement techniques ABF uses, for example, laser scanning versus manual measurement methods (e.g., tape measure or anthropometer-based), and the benefits and considerations of each method. The evolution of ABF’s measurement process will also be addressed, as new spaceflight programs have been introduced which have required unique measurements and the need to capture body shape changes over time was identified to be critical for spacesuit fit in some instances.

Garima Gupta↗
NASA NTRS2024

Anthropometric Measurement Procedures at the Anthropometry and Biomechanics Facility

The Anthropometry and Biomechanics Facility (ABF) at NASA Johnson Space Center (JSC) is the centralized source of anthropometry data at NASA for use in requirement development, engineering design, and verification of human-system integrations such as spacesuits and vehicles. To ensure the collection of consistent, accurate, and valid anthropometry data, ABF has defined anthropometric measurements and anatomical landmarks which are generally based on the Anthropometric Survey for US Army Personnel (ANSUR), but with additional measurements which have been uniquely designed for spacesuit and hardware accommodation purposes. Unlike ANSUR, NASA anthropometry measurements primarily rely on 3D body scanning, a method which allows for explicitly defining the process of collecting measurements and the quality control methods used to ensure measurement reliability. In addition to ABF’s anthropometry measurement definitions and procedures, this presentation will also compare specifics of different measurement techniques ABF uses, for example, laser scanning versus manual measurement methods (e.g., tape measure or anthropometer-based), and the benefits and considerations of each method. The evolution of ABF’s measurement process will also be addressed, as new spaceflight programs have been introduced which have required unique measurements and the need to capture body shape changes over time was identified to be critical for spacesuit fit in some instances.

Garima Gupta↗
NASA NTRS1983

The absolute amplitude calibration of the SEASAT synthetic aperture radar - An intercomparison with other L-band radar systems

The absolute amplitude calibration of the spaceborne Seasat SAR data set is presented based on previous relative calibration studies. A scale factor making it possible to express the perceived radar brightness of a scene in units of sigma-zero is established. The system components are analyzed for error contribution, and the calibration techniques are introduced for each stage. These include: A/D converter saturation tests; prevention of clipping in the processing step; and converting the digital image into the units of received power. Experimental verification was performed by screening and processing the data of the lava flow surrounding the Pisgah Crater in Southern California, for which previous C-130 airborne scatterometer data were available. The average backscatter difference between the two data sets is estimated to be 2 dB in the brighter, and 4 dB in the dimmer regions. For the SAR a calculated uncertainty of 3 dB is expected.

Held, D.↗
DOE OSTI2023

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗