SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This paper presents a validation study of a specific integrated modeling methodology which is a candidate tool for modeling complex opto-mechanical systems such as spaceborne interferometers.
Copernicus is the European Union's Earth Observation and Monitoring programme, delivering free access to operational and historical environmental data to support applications in a wide range of societal benefit areas. To allow meaningful long-term environmental monitoring and robust decision-making, it is essential to ensure that satellite-retrieved products are of high quality and consistency. This paper describes the outputs of an international workshop on the radiometric calibration validation of the Copernicus Sentinel-2A and Sentinel-2B Multi-Spectral Instrument. A wide range of vicarious methodologies have been applied independently and then compared per type of target. All methods agree on the good radiometric performance of both Sentinel-2A and Sentinel-2B with respect to the mission requirements as well as on evidence of a slight bias between the two instruments. Comparisons of all these results are discussed to highlight the benefits and advantages of the methods as well as to propose potential improvements either for the methods themselves and/or for the comparison exercise.
Physics-based simulation of nondestructive evaluation (NDE) inspection can help to advance the inspectability and reliability of mechanical systems. However, NDE simulations applicable to non-idealized mechanical components often require large compute domains and long run times. This has prompted development of custom NDE simulation software tailored to high performance computing (HPC) hardware. Verification and validation (V&V) is an integral part of developing this software to ensure implementations are robust and applicable to inspection problems, producing tools and simulations suitable for computational NDE research. This presentation addresses factors common to V&V of several elastodynamic simulation codes applicable to ultrasonic NDE. Examples are drawn from in-house simulation software at NASA Langley Research Center, ranging from ensuring reliability in a 1D heterogeneous media wave equation solver to the V&V needs of 3D cluster-parallel elastodynamic software. Factors specific to a research environment are addressed, where individual simulation results can be as relevant as the software product itself. Distinct facets of V&V are discussed including testing to establish software reliability, employing systematic approaches for consistency with fundamental conservation laws, establishing the numerical stability of algorithms, and demonstrating concurrence with empirical data. This talk also addresses V&V practices for small groups of researchers. This includes establishing resources (e.g. time and personnel) for V&V during project planning to mitigate and control the risk of setbacks. Similarly, we identify ways for individual researchers to use V&V during simulation software development itself to both speed up the development process and reduce incurred technical debt.
In this study, we validate precipitation estimates remotely sensed by the Tropical Rainfall Measuring Mission (TRMM) at monthly and seasonal timescales, during the period 1998–2015, by calculating and analyzing diverse error metrics between the 3B43 V7 product and in situ measurements from 1,180 rain gauges over Colombia, of which at least 987 are fully independent of TRMM. We explore the existence of spatiotemporal patterns to assess the performance of 3B43 V7 over the five major natural regions of Colombia: Caribbean, Pacific, Andes, Orinoco and Amazon. The results show that 3B43 V7 product is able to capture the phase of the annual cycle of monthly mean precipitation, but the performance is not good for the amplitude, in particular over the Andes and Pacific regions owing to complex climatic and topographic conditions. In general, 3B43 V7 exhibits good performance in the low‐lying and plain Amazon, Orinoco and Caribbean regions. Over the Andes region, characterized by complex topography, overestimation errors are identified [root mean squared error (RMSE) ≥83.59 mm·month−1 and relative bias (BIAS) ≥4.69%], whereas the extremely wet rainfall regime of the Pacific region is largely underestimated (RMSE ≥253.52 mm ·month−1 and BIAS ≤−11.75%). These errors are greater during the wet seasons when the metrics reach worse scores than those reported in similar studies worldwide. Occurrence analyses showed that 3B43 V7 misses very frequent light rainfall events and less frequent but very heavy storms, which contribute to the overall underestimation (overestimation) observed over the Pacific (Andes) region. The error characteristics identified and quantified in this study confirm the well‐documented limitations of remote precipitation sensing and constitute a warning about major challenges that complex climatic and physiographic features can impose on satellite rainfall missions.
Since the NASA Global Energy Water Exchanges (GEWEX) Surface Radiation Budget (SRB) project released its 3rd version of products in 2010, the GEWEX Data Assessments Panel (GDAP) has been working on integrating various data products to address issues in the closing of the global energy and water cycles. The 4th version of the SRB products, Rel. 4.0-IP, has integrated data products from the cloud, aerosol, atmosphere, ocean surface, and land surface projects, coordinating within GDAP, to produce a long-term time series of TOA and surface radiative estimates. The Rel. 4-IP shortwave products span 34 years continuously from July 1983 to June 2017 on a quasi-equal-area 1degree longitude by 1degree latitude grid system. The longwave products are for land only from 1983-07 to 1987-12; for both land and ocean from 1988-01 to 2009-12; and ocean only from 2010-01 to 2017-06. The data are provided at 3 hourly, 3-hourly-monthly, daily and monthly means. The ISCCP HXS clouds and radiances are the key cloud input of the current GEWEX SRB algorithms. In addition, the longwave algorithm has also made changes in cloud microphysical property, surface skin temperature input, surface emissivity, atmospheric profile, adding longwave aerosol optical properties, revising cloud overlap procedure, and so on. Details of changes in both inputs and algorithms are documented in a NASA Algorithm Theoretical Basis Document (ATBD). We have validated the surface longwave downward fluxes against the surface-based Baseline Surface Radiation Network (BSRN) and the Pacific Marine Environmental Laboratory (PMEL) buoy data. As of 2020, the BSRN archive has 12,116 site-months of observed records from 73 stations on all seven continents, and as of 2017, PMEL archive has 4389 buoy months of observed records from 64 buoys deployed in the tropics of Pacific, Atlantic and Indian Oceans. This paper presents how the SRB Rel. 4.0-IP surface longwave downward fluxes compare with these surface-based measurements and how the comparison statistics differ from that of Rel. 3.0.
This paper presents an overview of the state-of-the-art two-phase CFD models that have been developed for various propellant tank storage and transfer operations in 1g, partial gravity and microgravity. The models are developed in the framework of the industry standard ANSYS/Fluent CFD code, the capabilities of which have been significantly enhanced and customized through incorporation of unique submodels via User Defined Functions (UDF)s to satisfy the requirements of its intended variable gravity Cryogenic Fluid Management (CFM) applications. These models/submodels have been validated against experimental data that cross spatial scales, fluid types, and gravity levels in order to properly anchor the models’ physical and numerical fidelity. The CFM application/processes that have been modeled include tank self-pressurization, tank autogenous pressurization, tank pressure control using both subcooled jet mixing and droplet spray injection mechanisms, tank chilldown/filling, tank drainage, tank slosh for both volatile and non-volatile fluids. The strength and shortcomings of the two-phase models for each application is highlighted and discussed briefly.
NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will launch in January 2024 and continue and improve upon satellite data records in its eponymous domains. PACE will carry a broad-swath hyperspectral imager, OCI, which will provide MODIS/VIIRS-type cloud data products (i.e. a cloud mask, top height, visible optical thickness, droplet effective radius, phase, and derived water path). It will also carry two multi-angle polarimeters (HARP2 and SPEXone) which will not only provide the above but also enable retrievals of additional cloud properties (e.g. droplet effective variance, ice crystal asymmetry parameter). Validating satellite-based cloud retrievals is challenging. We plan to use several ARM data streams to evaluate PACE cloud data products and are prototyping our analyses using retrievals from MODIS on the Aqua satellite and OLCI on the Sentinel-3A satellite. This poster shows how we plan to use ARM data to evaluate liquid water path (via MWRRET) and cloud top height retrievals (via KARZASRCL), with example results from these proxy sensors and ARM data from the SGP, ENA, and NSA sites. We seek comments from and collaborations with the ARM community to get the most out of our respective data streams.
Careful consideration should be given to placement and orientation of RCS jet thrusters on hypersonic entry vehicles in order to minimize adverse RCS JI. Modern state-of-the-art computational fluid dynamics (CFD) tools should be able to predict the RCS effectiveness and JI accurately when coupled with verification and validation studies, including the use of appropriately designed experimental wind tunnel testing.
A fixed-pitch speed-controlled coaxial rotor system was tested in the NASA Langley Transonic Dynamics Tunnel in September 2022. The rotors have a diameter of 1.35 meters and an inter-rotor spacing of 25% of the diameter. Though this test was focused on the NASA New Frontiers Dragonfly mission, the resulting dataset is relevant to a wide array of applications of multirotor vehicles, especially those using fixed-pitch variable-speed rotors. Most notably beyond Dragonfly, perhaps, is the application of coaxial rotor pair configurations for eVTOL and Urban Air Mobility (UAM) aircraft. This work provides a thorough CFD validation study quantifying coaxial rotor performance estimation with accuracy on order 5-10% using an efficient hybrid BEMT-URANS flow solver over a wide range of operating conditions. This accuracy was achieved using novel approaches for the construction of both the C81 airfoil performance lookup tables and the BEMT rotor model. These novel approaches are combined with advanced scripting to further accelerate the commercial off-the-shelf CFD solver on GPU accelerated machines. Finally, the development of machine learning surrogate models is presented to produce highly efficient and accurate rotor performance predictions for fixed-pitch variable-speed multirotor aircraft over the complete flight regime including scout, cruise, climb, descent, as well as limiting cases of vortex-ring and windmill-brake states.
Research Objectives and Conceptual Design of the NASA RVLT Project Tiltwing Validation Test.
With NASA’s goal to land the next humans on the lunar surface in the next few years, it is vitally important to have a better understanding of the plume surface interaction (PSI) between the landing vehicles and the lunar regolith. The Fluid Dynamics Branch at NASA/MSFC has previously used the gas-granular flow solver Loci/GGFS to qualitatively predict crater formation due to PSI effects in a lunar (near vacuum) ambient environment. In this paper, validation of Loci/GGFS crater width and depth predictions in ambient near-lunar conditions are provided using experimental data collected at MSFC during the Physics-Focused Ground Test 1 (PFGT-1) campaign in 2022. To observe sensitivity to soil models, simulations were conducted with both monodisperse glass bead (MGB) and BP-1 lunar regolith simulant soil models in Loci/GGFS. Crater depth and width comparisons are made with PFGT-1 Run 56, which used BP-1 soil. The Loci/GGFS BP-1 soil model performed slightly better with a mean predicted crater depth within 10% of the experiment. Both soil models predicted crater width within 10%. Cratering occurred more quickly with the MGB soil model. Mesh and spatial order sensitivity are also examined for the BP-1 soil model.
A simulation of NASA Ames Research Center was developed to provide a common testbed for multiple areas of research within the Intelligent Systems Division, primarily related to verification and validation of autonomous technologies, machine learning, and digital twin systems. AmesSim corresponds a physical rover that is capable of navigation in the real-world environment; in this way, the same experiments can be run in both settings, with the same software and hardware stacks in the loop. The simulation is built in Unreal Engine 4 and uses the AirSim plugin for API convenience. Several custom modifications allow deterministic, faster-than-realtime execution, which enables consistent testing of on-line algorithms and large-scale data collection. This paper describes the architecture and capabilities of the simulation and discusses development challenge.
This poster provides an overview of the sensitivity analysis of validation strategies for the National Solar Radiation Database.
The seismic load case has a significant impact on the design and cost of nuclear power plants. Given the need to substantially reduce cost, advanced reactor designers are looking to leverage numerical tools that enable seismic analysis of an integrated vessel/support/structure/soil system. Modern nonlinear analysis tools provide a solution, capturing dynamic coupling between components (including soil-structure interaction (SSI)) concurrent with nonlinear behavior in one or more parts of the system. Although these methods have a rich history of technical development and implementation, software quality assurance (SQA) following nuclear industry standards remains a significant burden for those wishing to adopt such methods for advanced reactor design and licensing. To reduce the SQA burden, this project will develop the guidance for SQA verification and validation (V&V) of coupled nonlinear SSI analysis tools, to include a test matrix of software features and test problems to support commercial grade dedication (CGD). The guidance is intended to be technology-neutral: supporting designers of all advanced reactors. To maximize the value of the project to reactor designers, the project team performed focused surveys of and interviews with advanced reactor designers. Additionally, the project surveyed members of the broader industry involved in reactor design and licensing. The aggregated industry feedback consists of written survey responses, live polling responses, focused interviews, and informal feedback provided after outreach presentations, collectively referred to as “survey results”. Herein, the survey results are reported, reviewed, and assessed to inform follow-on project activities. The survey results confirmed the familiarity of the industry with the coupled nonlinear SSI analysis. They also affirm the project need based upon the expressed intent to (1) incorporate nonlinear features and (2) pursue the coupled nonlinear SSI analysis to reduce seismic demands and construction costs. All reactor designers indicated their intent to incorporate two or more nonlinear features, and all reactor designer respondents opined that the coupled nonlinear SSI analysis would allow for the optimization of the reactor design and construction. However, the programmatic challenges, whether real or perceived, present a significant barrier to reactor designers. The barrier most commonly identified by the reactor designer population was regulatory risk, with 70% citing this as a reason not to pursue the approach. The perceived regulatory risk identified by the reactor designers underscores the importance of regulator engagement and dialogue in this project. Additionally, half of the reactor designers identified cost and lack of guidance as a deterrent. The survey results also provide insights to tailor specific aspects of the guidance document and test matrix. The project plans to prepare both a formal referenceable guidance document and a collaborative, web-based test matrix and problem set. The project will focus on more complete test problem definitions for the prioritized nonlinear features over shallower problem descriptions for a larger set of features. The nonlinearities prioritized as high based upon survey feedback include fluid-structure interaction and seismic isolation and energy dissipation devices. The nonlinearities prioritized as intermediate include nonlinear geomaterials, nonlinear concrete, nonlinear steel, and interface/contact nonlinearity. Deep embedment and the associated nonlinear phenomena are assigned the lowest priority based upon survey feedback.
The fundamental understanding of the boiling-associated heat transfer, including sliding bubble effect, is still challenging despite the intensive research for decades in both experimental and computational boiling research communities. One of the main difficulties of boiling experiment come from the fact that direct observation of the underlying principle through experiment is very difficult due to the high complexity of the boiling phenomenon. Also, since the heat transfer characteristics associated with boiling is the result of non-linear interaction of various physical parameters coupled to each other, it is challenging to find the relationship between the parameters for modeling. This paper discusses the authors’ past and ongoing boiling research under CASL (Consortium for Advanced Simulation of Light Water Reactors) program, including the efforts to overcome the difficulties of boiling measurement and model development. In particular, we focus on describing the major achievements, lessons learnt, and ongoing challenges for the CFD boiling closure model development based on the high-fidelity subcooled flow boiling experiment at Texas A&M University (TAMU). The major research achievements discussed through this paper include (i) novel boiling measurement strategy and high-fidelity validation data production, (ii) dedicated effort to identify the critical measurement issues in boiling experiment, (iii) new physical insight into sliding bubble heat transfer mechanisms, and (iv) new boiling closure model development. Discussion is also made on the ongoing challenges for the boiling closure model development and the future research plan based on the lessons learnt.
The architecture presentation discusses the requirement grid architecture design to integrate AES capabilities. Three NREL projects that cover control, communication, and operation architectures are discussed as reference AES implementations. Testing platforms and capabilities such as ADMS test bed are introduced to validate AES solutions and developed architectures.
Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation. This study examines five cases from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) selected as application models: IEU-MET- FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM-004-001, MIX-COMP- THERM-001-001, and U233-SOL-THERM-001-001. This is a continuation of a previous study to examine Pu and HEU cases: HEU-MET-FAST-013-001, HEU-SOL-THERM-001-008, PU-MET- FAST-022-001, and PU-SOL-THERM-001-001. Ultimately, comparison is made between Upper Subcritical Limits (USLs) obtained using each code package for each application case. Since differences exist in whether packages take into account margin of subcriticality (MOS), the USL is computed using only bias and bias uncertainty, also known as the calculational margin (CM) in ANSI/ANS-8.24. Results comparison appears to show that benchmark selection has a greater influence on the USL than the method used for calculation of bias and bias uncertainty.
Resources and tools for the modeling and simulation of low-temperature plasma (LTP) discharges are increasingly vital to progress in the field in order to properly characterize and study complex source designs and plasma chemistries beyond the scope of traditional diagnostics. Open-source software provides powerful platforms for this work and can enable community-driven LTP R&D. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open-source framework [1], capabilities have been demonstrated in the areas of plasma fluids (Zapdos [2]), plasma chemistry (CRANE [3]), and general electromagnetic wave theory (Electromagnetic Library for Kinetics & fluids [ELK] [4]). ELK has since been coupled to Zapdos/CRANE to enable fully coupled electromagnetic plasma simulations. This talk will detail the continued validation efforts and discuss Zapdos-ELK-CRANE code coupling with various-low temperature plasma sources. The impact of fully coupled electromagnetics on process parameters (e.g., temperature and electron/ion energy) versus an electrostatic description will also be discussed. [1] Permann et al., SoftwareX, 11 (2020) 100430. [2] Lindsay et al., J. Phys. D: Appl. Phys. 49 (2016) 235204. [3] Keniley et al., Talk, GEC Session DT3.00002 (2019). [4] Icenhour et al., Talk, GEC Session RR1.00006 (2019). Acknowledgements: INL Graduate Fellowship Program, NSF SI2 Grant 1740300, U.S. Dept. of Energy Office of Science Graduate Student Research Program