SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Estimates of Future Numerical Weather Prediction Impacts from Hyperspectral Sounders

The United States’ satellite programs are currently in the process of evaluating the future of satellite observations of the Earth’s atmosphere, both as an individual nation and within the context of international partnerships. In an effort to better understand the impacts of various alternatives, the Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework has been utilized to evaluate several configurations of the international hyperspectral infrared sounder constellation from the perspective of global numerical weather prediction (NWP). This was done with an emphasis on the proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) Sounder (GXS), planned to launch in the mid-2030s, and similar planned missions from international partners. GXS, in addition to contributions from EUMETSAT and JMA, will form a global ring of geostationary sounders consistent with the WMO’s 2040 vision. In addition to a novel geostationary IR sounder program, considerations extend to the future of the Low Earth Orbit (LEO) sounder program with the upcoming demise of several existing instruments and plans for future missions ongoing. The GMAO OSSE framework has examined the potential roles of GEO and LEO sounders in weather prediction improvement. Overall, the inclusion of both GEO sounders in a global ring and LEO sounders produces the most beneficial observation impact and the most accurate global weather forecasts as evaluated using several metrics, including hurricanes and the FSOI.

Erica Mcgrath-Spangler↗

NASA NTRS2020

Evaluating Precipitation Features and Rainfall Characteristics in a Multi‐Scale Modeling Framework

Cloud and precipitation systems are simulated with a multi‐scale modeling framework (MMF) and compared over the Tropics and Subtropics against the Tropical Rainfall Measuring Mission (TRMM) Radar‐defined Precipitation Features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to produce simulated precipitation features (PFs) from the output of the embedded two‐dimensional (2D) cloud‐resolving models (CRMs) within an MMF. Despite the limitations of 2D CRMs, the simulated population distribution, horizontal and vertical structure of PFs, and the geographical location and local rainfall contribution of mesoscale convective systems (MCSs) are in good agreement with the TRMM observations. However, some model discrepancies are found and can be identified and quantified within the PF distributions. Using model biases in relative population and rainfall contributions, PFs can be characterized into four size categories: small, medium to large, very large, and extremely large. Four different major mechanisms might account for the model biases in each different category: (1) the two‐dimensionality of the CRMs, (2) a positive convection‐wind‐evaporation feedback loop, (3) an artificial dynamic constraint in a bounded CRM domain with cyclic boundaries, and (4) the limited CRM domain size. The second and fourth mechanisms tend to contribute to the excessive tropical precipitation biases commonly found in most MMFs, whereas the other mechanisms reduce rainfall contributions from small and very large PFs. MMF sensitivity experiments with various CRM domain sizes and grid spacings showed that larger domains (higher resolutions) tend to shift PF populations toward larger (smaller) sizes.

Jiun-Dar Chern↗

NASA NTRSDate not supplied

Evaluation of Precision Landing Performance Using A Generalized Aerospace Simulation in Simulink Framework

NASA’s science and exploration goals to return to the Moon and beyond will need to perform precision landings to place humans and cargo supplies near places of scientific interest, surface resources, or pre-established basecamps. With the maturation of new navigation technology, such as terrain relative navigation, precision landing is now feasible, enabling new exploration sites, such as the lunar poles. However, verification of precision landing performance becomes crucial since not reaching the designated landing site would have a high risk of loss of mission. Therefore, having a high-fidelity simulation platform to evaluate six degrees of freedom vehicle performance during high-risk phases of flight such landing is a fundamental part of the system verification and risk reduction. The NASA Marshall Space Flight Center has developed the GeneraLized Aerospace Simulation in Simulink® (GLASS) tool which incorporates guidance, navigation, and control algorithms, as well as vehicle and environmental models, such as gravity, vehicle mass properties, navigation sensors, propulsion, and terrain models. GLASS uses the MathWorks® Simulink® environment which provides a model-based design framework that allows the incorporation of vehicle models in a modular architecture. The Simulink® environment provides seamless integration with all the MathWorks® capabilities and toolboxes, such as control design toolboxes and Simscape™ Multibody™ dynamics toolbox. The MathWorks® environment also allows for guidance, navigation, and control algorithms to be auto coded in C language, enabling quick software and hardware in the loop testing. This paper provides an overview of GLASS capabilities for analyzing precision landing performance, including navigation trades applied to a NASA human lander reference design architecture.

Guidance↗

NASA NTRS2017

Cause and Cure - Deterioration in Accuracy of CFD Simulations With Use of High-Aspect-Ratio Triangular Tetrahedral Grids

Traditionally high-aspect ratio triangular/tetrahedral meshes are avoided by CFD re-searchers in the vicinity of a solid wall, as it is known to reduce the accuracy of gradient computations in those regions and also cause numerical instability. Although for certain complex geometries, the use of high-aspect ratio triangular/tetrahedral elements in the vicinity of a solid wall can be replaced by quadrilateral/prismatic elements, ability to use triangular/tetrahedral elements in such regions without any degradation in accuracy can be beneficial from a mesh generation point of view. The benefits also carry over to numerical frameworks such as the space-time conservation element and solution element (CESE), where triangular/tetrahedral elements are the mandatory building blocks. With the requirement of the CESE method in mind, a rigorous mathematical framework that clearly identities the reason behind the difficulties in use of such high-aspect ratio triangular/tetrahedral elements is presented here. As will be shown, it turns out that the degree of accuracy deterioration of gradient computation involving a triangular element is hinged on the value of its shape factor Gamma def = sq sin Alpha1 + sq sin Alpha2 + sq sin Alpha3, where Alpha1; Alpha2 and Alpha3 are the internal angles of the element. In fact, it is shown that the degree of accuracy deterioration increases monotonically as the value of Gamma decreases monotonically from its maximal value 9/4 (attained by an equilateral triangle only) to a value much less than 1 (associated with a highly obtuse triangle). By taking advantage of the fact that a high-aspect ratio triangle is not necessarily highly obtuse, and in fact it can have a shape factor whose value is close to the maximal value 9/4, a potential solution to avoid accuracy deterioration of gradient computation associated with a high-aspect ratio triangular grid is given. Also a brief discussion on the extension of the current mathematical framework to the tetrahedral-grid case along with some of the practical results of this extension is also provided. Furthermore, through the use of numerical simulations of practical viscous problems involving high-Reynolds number flows, the effectiveness of the gradient evaluation procedures within the CESE framework (that have their basis on the analysis presented here) to produce accurate and stable results on such high-aspect ratio meshes is also showcased.

CESE Method↗

NASA NTRSDate not supplied

Evaluation of Low-Energy Hydrogen Separation Method Using Metal-Organic Frameworks (MOFs) for Closed-Loop ECLSS Air Revitalization (CLEAR)

The State-of-the-Art (SOA) air revitalization architecture onboard the International Space Station (ISS) recovered approximately 50% of the oxygen (O 2 ) from metabolic carbon dioxide (CO 2 ) via the Sabatier process from 2011 to 2017. O 2 recovery is currently constrained by the limited availability of reactant hydrogen (H 2 ) preventing complete conversion of CO 2 to H 2 O. Increasing O 2 recovery within Closed-Loop ECLSS is essential to reducing resupply mass for long-duration manned missions; specifically focusing on water (H 2 O) which supplies H 2 for Sabatier via water electrolysis. Past ground test endeavors at Marshall Space Flight Center (MSFC) have attempted to recover H 2 from Sabatier-produced CH 4 using technologies such as carbon vapor deposition (CVD) and plasma pyrolysis. The byproducts of these technologies can act as a catalyst poison or reactor deadload to the Sabatier reactor. Hydrogen separation techniques must be utilized to maintain the Sabatier catalyst during gas recycling and must be scalable, non-energy intensive, and safe to operate in a habitation setting. Research indicated that metal-organic frameworks (MOFs) could meet these criteria and were tested for their capability to capture the various carbon-based gaseous products of CVD and plasma pyrolysis such as acetylene (C 2 H 2 ), ethylene (C 2 H 4 ), ethane (C 2 H 6 ), and carbon monoxide (CO) which would purify the hydrogen gas stream passing through the MOF. A sub-scale adsorption column was developed by Marshall Space Flight Center to test three MOF candidates against a synthetic gas mixture comprised of process-relevant carbonous gases and hydrogen to evaluate the separation capability of the MOFs. The results of the hydrogen separation capability, isothermal desorption capability, and demonstrated cyclic reuse of the MOF are presented in this paper.

Kagen Crawford↗

NASA NTRS2017

Cause and Cure - Deterioration in Accuracy of CFD Simulations with Use of High-Aspect-Ratio Triangular/Tetrahedral Grids

Traditionally high-aspect ratio triangular/tetrahedral meshes are avoided by CFD researchers in the vicinity of a solid wall, as it is known to reduce the accuracy of gradient computations in those regions. Although for certain complex geometries, the use of high-aspect ratio triangular/tetrahedral elements in the vicinity of a solid wall can be replaced by quadrilateral/prismatic elements, ability to use triangular/tetrahedral elements in such regions without any degradation in accuracy can be beneficial from a mesh generation point of view. The benefits also carry over to numerical frameworks such as the space-time conservation element and solution element (CESE), where simplex elements are the mandatory building blocks. With the requirement of the CESE method in mind, a rigorous mathematical framework that clearly identifies the reason behind the difficulties in use of such high-aspect ratio simplex elements is formulated using two different approaches and presented here. Drawing insights from the analysis, a potential solution to avoid that pitfall is also provided as part of this work. Furthermore, through the use of numerical simulations of practical viscous problems involving high-Reynolds number flows, how the gradient evaluation procedures of the CESE framework can be effectively used to produce accurate and stable results on such high-aspect ratio simplex meshes is also showcased.

CESE Method↗

NASA NTRS2022

Sharing Operational Intent with Containment Confidence Level for Negotiating Deconfliction in Upper Class E Airspace

Community-based Cooperative Separation Management (CSM) is expected to provide separation services in Upper Class E airspace (near and above FL600). Under CSM, operators are responsible for maintaining separation. The CSM concept is enabled by sharing Operational Intent (OI) among the operators to ensure common situation awareness. The OI is represented as four-dimensional (time and space) information that indicates where an aircraft would be contained within the space and time, with a known level of confidence. However, each vehicle’s ability to stay within its region of OI may differ based on each vehicle’s performance characteristics, resulting in varying OI sizes among the vehicles. Such varying OI size could adversely affect efficient and fair access to the airspace. In this paper, an OI-generation algorithm under varying OI size restriction with Containment Confidence Level (CCL) is presented. High-Altitude Long Endurance (HALE) balloon operations are used as an example application. A framework is presented by which CCL information is used in the deconfliction process. A fast-time simulation experiment is conducted to evaluate the feasibility of the proposed framework. The simulation results show a reduced number of unnecessary deconfliction actions.

Upper Class E Traffic Management↗

NASA NTRS2022

Sharing Operational Intent with Containment Confidence Level for Negotiating Deconfliction in Upper Class E Airspace

Upper Class E Traffic Management, ETM, Cooperative↗

NASA NTRSDate not supplied

An Analysis of Extended Reality Mockups for Use in Verification: Phase 2

NASA commercial providers are increasing their use of Virtual Reality (VR) and Hybrid Reality (HR) technologies in their system development process. The use of these technologies, collectively referred to as Extended Reality (XR) technologies, has been limited to the development phase, but there have been requests to integrate VR and HR mockups into verifications. Verifications require, at minimum, a high-fidelity mockup for activities involving human participation (tests, demonstrations, inspections). HR technology shares many of the strengths but may not share some of the critical shortcomings of VR. Specifically, HR allows for integrating physical objects, such as a suit, which may be critical to evaluating a system. Adopting HR technology still has many of the same challenges as VR. Namely, there is little to no data about the validity of evaluations conducted with HR mockups, an established process, or criteria for evaluating the appropriateness of HR mockups. Because verifications are final and only need to happen once, HR mockups must be adequately vetted before being approved for use in verifications. Further hindering the adoption of these technologies is the lack of consensus on what constitutes a high-fidelity XR mockup. Even for physical mockups, there are guidelines and common criteria, but nothing has been formalized. Discussion about when an XR mockup can be used would be greatly helped by clearly defining what a high-fidelity XR mockup is and how it might be measured. The team will engage with relevant stakeholders to learn more about the benefits and challenges of adopting hybrid reality mockups for verification. The team will build upon work from Phase 1 by maturing a framework to guide decisions for evaluating XR mockups for use in verifications. The team will also conduct experimental studies to evaluate advantages and tradeoffs of hybrid/mixed reality relative to physical and virtual reality mockups. Finally, data from Phase 1 and Phase 2 will be synthesized into a set of best practices for developing and validating XR mockups for verification. We will highlight the work conducted to date in Phase 2. We will present the status of the XR for Verification Framework, a summary of best practices identified thus far, and give a synopsis of future work.

verification testing↗

NASA NTRS2023

Robustness of Gridded Precipitation Products for Vietnam Basins using the Comprehensive Assessment Framework of Rainfall

The use of satellite–based precipitation products (SPPs) have become increasingly prevalent as key inputs to provide regional rainfall for improving hydrological simulations in data–spare regions. This study introduces a new approach – Comprehensive Assessment Framework of Rainfall (CAFR) to evaluate six satellite–based precipitation products (SPPs) for eleven basins with different sizes across Vietnam (2007–2015). These SPPs include the Global Precipitation Mission (GPM) Integrated Multi-satellitE Retrievals for Global Precipitation Measurement Final run Version 6 (GPM IMERGF V6), Multi–Source Weighted–Ensemble Precipitation (MSWEP) V2.2, Soil Moisture to Rain (SM2RAIN) – Advanced SCATterometer (ASCAT) V1.5, Asian Precipitation–Highly–Resolved Observational Data Integration Towards Evaluation (APHRODITE) V1901, Climate Hazards group Infrared Precipitation with Stations (CHIRPS) V2.0, and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) – Climate Data Record (CDR) V1.0. With the proposed CAFR: (1) IMERGF is suggested to have the best performance overall, especially when simulating flood peaks; (2) SM2RAIN–ASCAT demonstrates the best skills in metrics related to the dry season; (3) For streamflow simulations, SPPs' performance is sensitive to basin size, with larger basins showing better performance skills. In this study, we demonstrate the capability of our proposed framework to better understand SPP applications in hydrological modeling.

Comprehensive Assessment Framework of Rainfall (CA↗

NASA NTRSDate not supplied

Optimization Algorithms as Quantum Performance Benchmarks

Combinatorial optimization is anticipated to be one of the primary use cases for quantum computation in the coming years. The Quantum Approximate Optimization Algorithm (QAOA) and Quantum Annealing (QA) have the potential to demonstrate significant run-time performance benefits over current state-of-the-art solutions. Using existing methods for characterizing classical optimization algorithms, we analyze solution quality obtained by solving Max-Cut problems using a quantum annealing device and gate-model quantum simulators and devices. This is used to guide the development of an advanced benchmarking framework for quantum computers designed to evaluate the trade-off between run-time execution performance and the solution quality for iterative hybrid quantum-classical applications. The framework generates performance profiles through effective visualizations that show performance progression as a function of time for various problem sizes and illustrates algorithm limitations uncovered by the benchmarking approach. The framework is an enhancement to the existing open-source QED-C Application-Oriented Benchmark suite and can connect to the open-source analysis libraries. The suite can be executed on various quantum simulators and quantum hardware systems.

benchmarking↗

NASA NTRS2019

Evaluating Precipitation Features and Rainfall Characteristics in a Multi-scale Modeling Framework

Cloud and precipitation systems over the tropics and subtropics are simulated with a multi-scale modeling framework (MMF) and compared against the TRMM radar precipitation features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to analyze simulated cloud precipitating structures from the embedded two-dimensional cloud-resolving models (CRMs) within an MMF. Despite the two-dimensionality of the CRMs, the simulated RPFs population distribution, and horizontal and vertical structure are in good agreement with TRMM observations. However, some deficits are also found in the model simulations. The model tends to overestimate mean convective precipitation rates for RPFs with a size less than 100 km, contributing to the excessive precipitation biases in the warm pool and western Pacific, western and northern India Ocean, and eastern Pacific commonly found in most MMFs. For large features with a size greater than 150 km, both convective and stratiform rain rates are underestimated. The distribution of maximum radar echo top heights as a function of RPF size is well simulated except the model tends to underestimate the occurrence frequency of maximum heights greater than 15 km. The maximum echo top heights for convective cells embedded within large RPFs with a size greater than 150 km are also underestimated. The cyclic lateral boundary with a limited model domain generates artificial occurrences for RPFs with a size close to the model domain size, producing a significant contribution to the total rainfall due to their sizes. This cyclic lateral boundary effect can be easily identified and quantified in both probability and cumulative distribution functions of RPFs. The geophysical distribution of the population of the largest RPFs in the control experiment shows they are mainly located in the Subtropics but also partially contribute to the common MMF biases of excessive precipitation in the Tropics. Sensitivity experiments using CRMs with different domain sizes and different grid spacings show larger domains (higher resolution) tend to shift the RPFs distribution to large (small) sizes. The cyclic lateral boundary biases increase as CRM domain size decreases. The impacts of model horizontal and vertical resolution on simulated convective systems are also investigated.

Chern, Jiun-Dar↗

NASA NTRS2019

Evaluation of a Multi-mOdel, Multi-cOnstituent CHEMical data assimilation framework (MOMO-Chem) for tropospheric chemical reanalysis: new GEOS-Chem-EnKF system!

UNKNOWN

Sudo, Kendo↗

NASA NTRS2001

Dynamic Response Assessment for the MEMS Accelerometer Under Severe Shock Loads

NASA Goddard Space Flight Center (GSFC) has evaluated the dynamic response of a commercial-off-the-shelf (COTS) microelectromechanical systems (MEMS) device made by Analog Device, Inc. The device is designated as ADXL250 and is designed mainly for sensing dynamic acceleration. It is also used to measure the tilting angle of any system or component from its original level position. The device has been in commercial use (e.g., in automobile airbag deployment system as a dual-axial accelerometer and in the electronic game play-station as a tilting sensor) with success, but NASA needs an in-depth assessment of its performance under severe dynamic shock environments. It was realized while planning this evaluation task that two assessments would be beneficial to NASA's missions: (1) severe dynamic shock response under nominal thermal environments; and (2) general dynamic performance under cryogenic environments. The first evaluation aims at obtaining a good understanding of its micromachined structure within a framework of brittle fracture dynamics, while the second evaluation focuses on the structure integrity under cryogenic temperature conditions. The information we gathered from the manufacturer indicated that the environmental stresses under NASA's evaluation program have been far beyond what the device has experienced with commercial applications, for which the device was designed. Thus NASA needs the outcome of this evaluation in order to make the selection for possible use for its missions. This paper provides details of the first evaluation the dynamic response under severe multi-axial single-pulse shock load. It was performed using finite element tools with nonlinear dynamics procedures.

Fan, Mark S.↗

NASA NTRS1989

Probabilistic structural analysis methods of hot engine structures

Development of probabilistic structural analysis methods for hot engine structures at Lewis Research Center is presented. Three elements of the research program are: (1) composite load spectra methodology; (2) probabilistic structural analysis methodology; and (3) probabilistic structural analysis application. Recent progress includes: (1) quantification of the effects of uncertainties for several variables on high pressure fuel turbopump (HPFT) turbine blade temperature, pressure, and torque of the space shuttle main engine (SSME); (2) the evaluation of the cumulative distribution function for various structural response variables based on assumed uncertainties in primitive structural variables; and (3) evaluation of the failure probability. Collectively, the results demonstrate that the structural durability of hot engine structural components can be effectively evaluated in a formal probabilistic/reliability framework.

Chamis, C. C.↗

NASA NTRS1990

Users manual for the Automated Performance Test System (APTS)

The characteristics of and the user information for the Essex Automated Performance Test System (APTS) computer-based portable performance assessment battery are given. The battery was developed to provide a menu of performance test tapping the widest possible variety of human cognitive and motor functions, implemented on a portable computer system suitable for use in both laboratory and field settings for studying the effects of toxic agents and other stressors. The manual gives guidance in selecting, administering and scoring tests from the battery, and reviews the data and studies underlying the development of the battery. Its main emphasis is on the users of the battery - the scientists, researchers and technicians who wish to examine changes in human performance across time or as a function of changes in the conditions under which test data are obtained. First the how to information needed to make decisions about where and how to use the battery is given, followed by the research background supporting the battery development. Further, the development history of the battery focuses largely on the logical framework within which tests were evaluated.

Lane, N. E.↗

NASA NTRS1990

Probabilistic simulation of uncertainties in thermal structures

Development of probabilistic structural analysis methods for hot structures is a major activity at Lewis Research Center. It consists of five program elements: (1) probabilistic loads; (2) probabilistic finite element analysis; (3) probabilistic material behavior; (4) assessment of reliability and risk; and (5) probabilistic structural performance evaluation. Recent progress includes: (1) quantification of the effects of uncertainties for several variables on high pressure fuel turbopump (HPFT) blade temperature, pressure, and torque of the Space Shuttle Main Engine (SSME); (2) the evaluation of the cumulative distribution function for various structural response variables based on assumed uncertainties in primitive structural variables; (3) evaluation of the failure probability; (4) reliability and risk-cost assessment, and (5) an outline of an emerging approach for eventual hot structures certification. Collectively, the results demonstrate that the structural durability/reliability of hot structural components can be effectively evaluated in a formal probabilistic framework. In addition, the approach can be readily extended to computationally simulate certification of hot structures for aerospace environments.

Chamis, Christos C.↗

NASA NTRS1989

Probabilistic structural analysis: Introductory remarks

The development of probabilistic structural analysis methodology consists of the following program elements: (1) composite load spectra models, (2) computational probabilistic structural analysis methods, and (3) probabilistic constitutive relationships. The development of the probabilistic structural analysis methodology is a joint program of NASA Lewis in-house and sponsored research. The objective of this session is to illustrate recent progress on the application of this methodology to determine the reliability of structural components for rocket propulsion systems. The session contains descriptions of and progress reports on the following specific activities: (1) The NESSUS computer code, (2) approximate methods, (3) advanced methods, (4) composite load spectra applications, (5) probabilistic fracture mechanisms, and (6) probability of failure and risk analysis. Collectively, the progress to date demonstrates that the structural durability of hot engine structural components can be effectively evaluated in a formal probabilistic/reliability framework.

Chamis, Christos C.↗