Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “code validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Longitudinal Aerodynamic Characteristics and Wing Pressure Distributions of a Blended-Wing-Body Configuration at Low and High Reynolds Numbers

Force balance and wing pressure data were obtained on a 0.017-Scale Model of a blended-wing-body configuration (without a simulated propulsion system installation) to validate the capability of computational fluid dynamic codes to predict the performance of such thick sectioned subsonic transport configurations. The tests were conducted in the National Transonic Facility of the Langley Research Center at Reynolds numbers from 3.5 to 25.0 million at Mach numbers from 0.25 to 0.86. Data were obtained in the pitch plane only at angles of attack from -1 to 8 deg at Mach numbers greater than 0.25. A configuration with winglets was tested at a Reynolds number of 25.0 million at Mach numbers from 0.83 to 0.86.

Re, Richard J.↗

Theoretical and Experimental Unsteady Aerodynamics Compared for a Linear Oscillating Cascade With a Supersonic Leading-Edge Locus

Experimental data were obtained to help validate analytical and computational fluid dynamics (CFD) codes used to compute unsteady cascade aerodynamics in a supersonicaxial- flow regime. Results from two analytical codes and one CFD code were compared with experimental data. One analytical code did not account for airfoil thickness or camber; another, using piston theory (piston code), accounted for thickness and camber upstream of the first shockwave/airfoil impingement locations. The Euler CFD code accounted fully for airfoil shape.

Ramsey, John K.↗

Modeling of Fixed-Exit Porous Bleed Systems

A model has been developed to simulate a fixed-exit porous bleed system for supersonic inlets. The fixed-exit model allows the amount of bleed flow to vary according to local flow conditions and fixed-exit characteristics of the bleed system. This variation is important for the control of shock-wave/boundary-layer interactions within the inlet. The model computes the bleed plenum static pressure rather than requiring its specification. The model was implemented in the Wind-US computational fluid dynamics code. The model was then verified and validated against experimental data for bleed on a flat plate with and without an impinging oblique shock and for bleed in a Mach 3.0 axisymmetric, mixed-compression inlet. The model was able to accurately correlate the plenum pressures with bleed rates and simulate the effect of the bleed on the downstream boundary layer. Further, the model provided a realistic simulation of the initiation of inlet unstart. The results provide the most in-depth examination to date of bleed models for use in the simulation of supersonic inlets. The results also highlight the limitations of the models and aspects that require further research.

Slater, John W.↗

X-Ray Computed Tomography Inspection of the Stardust Heat Shield

The "Stardust" heat shield, composed of a PICA (Phenolic Impregnated Carbon Ablator) Thermal Protection System (TPS), bonded to a composite aeroshell, contains important features which chronicle its time in space as well as re-entry. To guide the further study of the Stardust heat shield, NASA reviewed a number of techniques for inspection of the article. The goals of the inspection were: 1) to establish the material characteristics of the shield and shield components, 2) record the dimensions of shield components and assembly as compared with the pre-flight condition, 3) provide flight infonnation for validation and verification of the FIAT ablation code and PICA material property model and 4) through the evaluation of the shield material provide input to future missions which employ similar materials. Industrial X-Ray Computed Tomography (CT) is a 3D inspection technology which can provide infonnation on material integrity, material properties (density) and dimensional measurements of the heat shield components. Computed tomographic volumetric inspections can generate a dimensionally correct, quantitatively accurate volume of the shield assembly. Because of the capabilities offered by X-ray CT, NASA chose to use this method to evaluate the Stardust heat shield. Personnel at NASA Johnson Space Center (JSC) and Lawrence Livermore National Labs (LLNL) recently performed a full scan of the Stardust heat shield using a newly installed X-ray CT system at JSC. This paper briefly discusses the technology used and then presents the following results: 1. CT scans derived dimensions and their comparisons with as-built dimensions anchored with data obtained from samples cut from the heat shield; 2. Measured density variation, char layer thickness, recession and bond line (the adhesive layer between the PICA and the aeroshell) integrity; 3. FIAT predicted recession, density and char layer profiles as well as bondline temperatures Finally suggestions are made as to future uses of this technology as a tool for non-destructively inspecting and verifying both pre and post flight heat shields.

McNamara, Karen M.↗

Twenty Years of Radiation Measurements in Low-Earth Orbit - What Have We Learned Space Radiation Environment?

The advent of the Space Shuttle program has made possible space radiation environment measurements spanning a wide range of altitudes and orbital inclinations over multiple solar cycles. These measurements range from routine integral dose measurements with thermoluminescent dosimeters to particle energy spectra measurements made with a charged particle telescope. This paper will review the new understanding about the space radiation environment gained from this diverse data set. Major findings from these measurements include: estimations of the westward drift rate of the South Atlantic Anomaly (SAA) of 0.28-0.49/y; evidence for a northward component to the SAA drift of 0.08-0.12/y; observation of the formation and decay of the pseudo-stable additional radiation belt following the Mar 1991 SPE and geomagnetic storm with an estimated decay e-folding time of 9-10 months; observation of a local geomagnetic east-west trapped proton exposure anisotropy with an estimated magnitude of 1.6-3.3; demonstration that the trapped proton exposure in low-Earth orbit (LEO) can be reasonably modeled as a power law function of atmospheric density in the SAA region, with best correlations obtained when the exospheric temperature saturates at 938-975 K; the actual solar cycle modulation of trapped proton exposure in LEO is less than predicted by the AP8 model; and the testing and validation of GCR flux models, radiation transport codes, and dynamic geomagnetic cutoff models. Long-term, time-resolved proportional counter measurements made aboard the Mir during the same period provides further demonstration of the solar cycle modulation of the trapped protons at low altitudes - the observed modulation is also well described as power law function of atmospheric density. These data and findings have helped to improve the overall accuracy of pre-mission crew exposure projections using various semi-empirical space environment models, radiation transport codes, and spacecraft radiation shielding models. During the rise phase of solar cycle 22 (1987-1991), the RMS error between preflight exposure projections and measured crew exposure was 73%. For the rise phase of cycle 23 (1997-2001), the preflight exposure projection RMS error has decreased to 23%. The launch and assembly of the Space Station has begun a new era of long-term LEO space environment monitoring. The radiation environment at the Space Station will be monitored with three external charged particle telescopes oriented in the velocity vector, anti-velocity vector, and zenith directions. Data from the telescopes will provide charge, mass, energy, and arrival direction for incident particles with energy to mass ratios of 13- 450 MeV/amu and Z of 1-24. The external environment data will be complimented by measurements from a portable charged particle telescope and proportional counter located inside the vehicle.

Golightly, Michael J.↗

Development and Validation of a Computational Model for Predicting the Behavior of Plumes from Large Solid Rocket Motors

Exhaust plumes from large solid rocket motors fired at ATK's Promontory test site carry particulates to high altitudes and typically produce deposits that fall on regions downwind of the test area. As populations and communities near the test facility grow, ATK has become increasingly concerned about the impact of motor testing on those surrounding communities. To assess the potential impact of motor testing on the community and to identify feasible mitigation strategies, it is essential to have a tool capable of predicting plume behavior downrange of the test stand. A software package, called PlumeTracker, has been developed and validated at ATK for this purpose. The code is a point model that offers a time-dependent, physics-based description of plume transport and precipitation. The code can utilize either measured or forecasted weather data to generate plume predictions. Next-Generation Radar (NEXRAD) data and field observations from twenty-three historical motor test fires at Promontory were collected to test the predictive capability of PlumeTracker. Model predictions for plume trajectories and deposition fields were found to correlate well with the collected dataset.

Wells, Jason E.↗

Development and Overview of CPAS Sasquatch Airdrop Landing Location Predictor Software

The Capsule Parachute Assembly System (CPAS) is the parachute system for NASA's Orion spacecraft. CPAS is currently in the Engineering Development Unit (EDU) phase of testing. The test program consists of numerous drop tests, wherein a test article rigged with parachutes is extracted from an aircraft. During such tests, range safety is paramount, as is the recoverability of the parachutes and test article. It is crucial to establish a release point from the aircraft that will ensure that the article and all items released from it during flight will land in a designated safe area. The Sasquatch footprint tool was developed to determine this safe release point and to predict the probable landing locations (footprints) of the payload and all released objects. In 2012, a new version of Sasquatch, called Sasquatch Polygons, was developed that significantly upgraded the capabilities of the footprint tool. Key improvements were an increase in the accuracy of the predictions, and the addition of an interface with the Debris Tool (DT), an in-flight debris avoidance tool for use on the test observation helicopter. Additional enhancements include improved data presentation for communication with test personnel and a streamlined code structure. This paper discusses the development, validation, and performance of Sasquatch Polygons, as well as its differences from the original Sasquatch footprint tool.

Bledsoe, Kristin J.↗

Assessments of Hollow Cathode Wear in the Xenon Ion Propulsion System (XIPs(c)) by Numerical Analyses and Wear Tests

The standard approach presently followed by NASA to qualify electric propulsion for the required mission throughput has been based largely on life tests, which can be costly and time consuming. Revised electric propulsion lifequalification approaches are being formulated that combine analytical and/or computational methods with (shorter-duration) wear tests. As a model case, a wear test is being performed at JPL to assess the lifetime of the discharge hollow cathode in the Xenon Ion Propulsion System (XIPS(c)), a 25-cm ion engine developed by L-3 Communications Electron Technologies, Inc. for commercial applications. Wear and plasma data accumulated throughout this life-assessment program are being used to validate the existing 2-D hollow cathode code OrCa2D. We find that the OrCa2D steady-state solution predicts very well the time-averaged plasma data and the keeper voltage after 5500 hrs of operation in high-power mode. When the wave motion that occurs naturally in these devices is accounted for, based on an estimate of the maximum wave amplitude, the molybdenum-keeper erosion profile observed in the XIPS(c) discharge cathode is also reproduced within a factor of two of the observation. When the same model is applied to predict the erosion of a tantalum keeper we find that erosion is reduced by more than two orders of magnitude compared to the molybdenum keeper due the significantly lower sputtering yield of tantalum. A tantalum keeper would therefore allow keeper lifetimes that greatly exceed the present requirements for deep-space robotic missions considered by NASA. Moreover, such large reduction of the erosion renders the largest uncertainties in the models, which are associated with the wave amplitude estimates and the electron transport model, negligible.

plasma simulations↗

Using GPS Receivers 1PPS Output to Verify Time Stamp Accuracy and Measure Propagation Delay

A simple Pulse Overlay (PO) circuit using a logic OR gate was developed to overlay a precise leading edge 1 Pulse Per Second (1PPS) time reference marker from a GPS receiver onto a Non-Return -to- Zero-Level (NRZ-L) Pulse Code Modulation (PCM) telemetry data stream to validate time stamp accuracy and measure propagation delay (PD) in telemetry equipment.

telemetry↗

Modeling Validation and Its Design Relevance for NTP Fuel Elements

The development of Nuclear Thermal Propulsion engines depends heavily on modeling and simulation of a number of disciplines—neutronic / fluid / thermal / structural are only a start. Further, rockets involve extreme conditions, particularly high material temperatures in the nuclear fuel. This paper considers validation of the underling physical models and codes and how their accuracy influences several design challenges. Several issues are identified, where models, material data, could enable design solutions. In particular, thermal and CTE mismatch stresses are a concern, and stress predictions would benefit from improved mechanical property data at high temperatures. Nuclear inter-element heating causes propellant flow maldistribution and performance risks, but a simple model provides insights. High temperature chemical diffusion should be modeled to understand fuel element mass loss.

Nuclear Propulsion↗

Modeling Validation and Its Design Relevance for NTP Fuel Elements

The development of Nuclear Thermal Propulsion engines depends heavily on modeling and simulation of a number of disciplines—neutronic / fluid / thermal / structural are only a start. Further, rockets involve extreme conditions, particularly high material temperatures in the nuclear fuel. This paper considers validation of the underling physical models and codes and how their accuracy influences several design challenges. Several issues are identified, where models, material data, could enable design solutions. In particular, thermal and CTE mismatch stresses are a concern, and stress predictions would benefit from improved mechanical property data at high temperatures. Nuclear inter-element heating causes propellant flow maldistribution and performance risks, but a simple model provides insights. High temperature chemical diffusion should be modeled to understand fuel element mass loss.

Nuclear Propulsion↗

Open Science Practices at the Community Coordinated Modeling Center

Open Science is defined as “the principle and practice of making research products and processes available to all, while respecting diverse cultures, maintaining security and privacy, and fostering collaborations, reproducibility, and equity” by Federal Agencies. The CCMC has been practicing open science based on FAIR (Findable, Accessible, Interoperable and Reusable) principle by providing access to the state-of -the art space science and space weather models to users around the world through various simulation services such as Runs-on-Request, Instant Runs, Real time runs on iSWA system. The CCMC also provides a wide range of tools and framework to help users easily utilize modeled data. One of the tools is the official NASA open-sourced software called Kamodo. Kamodo allows users to work with complex space weather models and data with little or no coding experience. Additionally, to support transparent model validation efforts, the CCMC is providing an integrated and flexible framework called CAMEL. CAMEL allows users to seamlessly compare model outputs with observational data sets. Currently, we are working on a user-friendly database of the papers and research that used CCMC services, so that the future users will have open access to previously performed research by other users and its details. In this presentation, we will show the open tools and resources provided by the CCMC. Furthermore, we will share our new efforts to support open data and open science results.

Ja Soon Shim↗

Consistency, Verification, and Validation of Turbulence Models for Reynolds-Averaged Navier-Stokes Applications

In current practice, it is often difficult to draw firm conclusions about turbulence model accuracy when performing multi-code CFD studies ostensibly using the same model because of inconsistencies in model formulation or implementation in different codes. This paper describes an effort to improve the consistency, verification, and validation of turbulence models within the aerospace community through a website database of verification and validation cases. Some of the variants of two widely-used turbulence models are described, and two independent computer codes (one structured and one unstructured) are used in conjunction with two specific versions of these models to demonstrate consistency with grid refinement for several representative problems. Naming conventions, implementation consistency, and thorough grid resolution studies are key factors necessary for success.

Rumsey, Christopher L.↗

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

Algorithm and code development for unsteady three-dimensional Navier-Stokes equations

Aeroelastic tests require extensive cost and risk. An aeroelastic wind-tunnel experiment is an order of magnitude more expensive than a parallel experiment involving only aerodynamics. By complementing the wind-tunnel experiments with numerical simulations, the overall cost of the development of aircraft can be considerably reduced. In order to accurately compute aeroelastic phenomenon it is necessary to solve the unsteady Euler/Navier-Stokes equations simultaneously with the structural equations of motion. These equations accurately describe the flow phenomena for aeroelastic applications. At ARC a code, ENSAERO, is being developed for computing the unsteady aerodynamics and aeroelasticity of aircraft, and it solves the Euler/Navier-Stokes equations. The purpose of this cooperative agreement was to enhance ENSAERO in both algorithm and geometric capabilities. During the last five years, the algorithms of the code have been enhanced extensively by using high-resolution upwind algorithms and efficient implicit solvers. The zonal capability of the code has been extended from a one-to-one grid interface to a mismatching unsteady zonal interface. The geometric capability of the code has been extended from a single oscillating wing case to a full-span wing-body configuration with oscillating control surfaces. Each time a new capability was added, a proper validation case was simulated, and the capability of the code was demonstrated.

Obayashi, Shigeru↗

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

Development and validation of CNS (compressible Navier-Stokes) for hypersonic external flows

CNS, a new computational fluid dynamics procedure, has been developed to aid in hypersonic vehicle design. The code can be used to model the entire external flow around hypersonic vehicle shapes, from the captured shock at the nose to the beginning of the wake. Unlike space-marching codes, the technique allows axially separated flow regions to be modeled. Validation trials using sphere-cone data reveal good solution accuracy for the surface pressure and flowfield temperature.

Flores, Jolen↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗