SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

NASA NTRS2026

Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing

As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.

composite reliability↗

NASA NTRS2005

Toward a Benchmark for Multi-Threaded Testing Tools

Looking for intermittent bugs is a problem that has been getting prominence in testing. Multi-threaded code is becoming very common, mostly on the server side. As there is no silver bullet solution, research focuses on a variety of partial solutions. We outline a road map for combining the research on the different disciplines of testing multi-threaded programs and on evaluating its quality. The project goals are to create a benchmark that can be used to evaluate different solutions, to create a framework with open API's that enables combining techniques in the multithreading domain, and to create a focus for the research in this area around which a community of people who try to solve similar problems with different techniques, could congregate. The benchmark, apart from containing programs with documented bugs, includes other artifacts, such as traces, that are used for evaluating some of the technologies. We have started creating such a bench mrk and detail the lesson learned in the process. The framework will enable technology developers, for example, race detectors, to concentrate on their components and use other ready made components, (e.g., instrumentor) to create a testing solution.

Eytani, Yaniv↗

NASA NTRSDate not supplied

Analysis of Alternative Architectures for a 2024 Lunar Sortie

This study focused on performing a broad analysis of lunar architectures to identify key alternatives capable of performing a 2024 human lunar landing mission. The goal of the study was to identify architecture alternatives which exhibit robustness, as measured by launch vehicle payload margin, to absorb the natural growth that occurs during design maturation. The study consisted of up to three element architectures which perform the mission from cis-lunar aggregation, through the surface sortie, and return to cis-lunar space. More than 600,000 data points were evaluated utilizing a novel architecture synthesis framework currently being developed by NASA/MSFC. Key findings from the study indicate that architecture complexity can be reduced by minimizing the number of discrete, unique architecture elements, which in turn translates into reduced design, development, test, and evaluation (DDT&E) complexity. It was identified that heavy lift launch vehicles enable such architectures while also providing significant increases to launch vehicle margin over existing and near-term commercial launch vehicle (CLV) performance expected in the 2024 time frame. Additionally, the study identified storable propellant based lander architectures as leading alternatives in achieving a 2024 human lunar landing by providing reduced technology needs and development schedules.

Architecture Analysis↗

NASA NTRS2011

Generic, Extensible, Configurable Push-Pull Framework for Large-Scale Science Missions

The push-pull framework was developed in hopes that an infrastructure would be created that could literally connect to any given remote site, and (given a set of restrictions) download files from that remote site based on those restrictions. The Cataloging and Archiving Service (CAS) has recently been re-architected and re-factored in its canonical services, including file management, workflow management, and resource management. Additionally, a generic CAS Crawling Framework was built based on motivation from Apache s open-source search engine project called Nutch. Nutch is an Apache effort to provide search engine services (akin to Google), including crawling, parsing, content analysis, and indexing. It has produced several stable software releases, and is currently used in production services at companies such as Yahoo, and at NASA's Planetary Data System. The CAS Crawling Framework supports many of the Nutch Crawler's generic services, including metadata extraction, crawling, and ingestion. However, one service that was not ported over from Nutch is a generic protocol layer service that allows the Nutch crawler to obtain content using protocol plug-ins that download content using implementations of remote protocols, such as HTTP, FTP, WinNT file system, HTTPS, etc. Such a generic protocol layer would greatly aid in the CAS Crawling Framework, as the layer would allow the framework to generically obtain content (i.e., data products) from remote sites using protocols such as FTP and others. Augmented with this capability, the Orbiting Carbon Observatory (OCO) and NPP (NPOESS Preparatory Project) Sounder PEATE (Product Evaluation and Analysis Tools Elements) would be provided with an infrastructure to support generic FTP-based pull access to remote data products, obviating the need for any specialized software outside of the context of their existing process control systems. This extensible configurable framework was created in Java, and allows the use of different underlying communication middleware (at present, both XMLRPC, and RMI). In addition, the framework is entirely suitable in a multi-mission environment and is supporting both NPP Sounder PEATE and the OCO Mission. Both systems involve tasks such as high-throughput job processing, terabyte-scale data management, and science computing facilities. NPP Sounder PEATE is already using the push-pull framework to accept hundreds of gigabytes of IASI (infrared atmospheric sounding interferometer) data, and is in preparation to accept CRIMS (Cross-track Infrared Microwave Sounding Suite) data. OCO will leverage the framework to download MODIS, CloudSat, and other ancillary data products for use in the high-performance Level 2 Science Algorithm. The National Cancer Institute is also evaluating the framework for use in sharing and disseminating cancer research data through its Early Detection Research Network (EDRN).

Foster, Brian M.↗

NASA NTRS1991

Reusable rocket engine intelligent control system framework design, phase 2

Elements of an advanced functional framework for reusable rocket engine propulsion system control are presented for the Space Shuttle Main Engine (SSME) demonstration case. Functional elements of the baseline functional framework are defined in detail. The SSME failure modes are evaluated and specific failure modes identified for inclusion in the advanced functional framework diagnostic system. Active control of the SSME start transient is investigated, leading to the identification of a promising approach to mitigating start transient excursions. Key elements of the functional framework are simulated and demonstration cases are provided. Finally, the advanced function framework for control of reusable rocket engines is presented.

Nemeth, ED↗

NASA NTRSDate not supplied

Sirius: Simulation and Evaluation of Tactical Conflict Management in an Urban Environment

This presentation provides an overview of the SIRIUS framework, updates to the ICAROUS core modules, and highlights the results of recent simulation and evaluation of tactical deconfliction in an urban environment. The SIRIUS simulation framework provides a fast time method for simulation a large number of aircraft in parallel. Updates to the ICAROUS core modules highlighted in the presentation include the evaluation of the encounter type geometry and changes to the resolution type selection based on the encounter type and following right of way (ROW) rules. The main objective of the simulation was to evaluate the use of strategic and tactical conflict management strategies using a set of simulated UAM scenarios.

Andrew Peters↗

NASA NTRS1994

Office of Space Science: Integrated technology strategy

This document outlines the strategy by which the Office of Space Science, in collaboration with the Office of Advanced Concepts and Technology and the Office of Space Communications, will meet the challenge of the national technology thrust. The document: highlights the legislative framework within which OSS must operate; evaluates the relationship between OSS and its principal stakeholders; outlines a vision of a successful OSS integrated technology strategy; establishes four goals in support of this vision; provides an assessment of how OSS is currently positioned to respond to the goals; formulates strategic objectives to meet the goals; introduces policies for implementing the strategy; and identifies metrics for measuring success. The OSS Integrated Technology Strategy establishes the framework through which OSS will satisfy stakeholder expectations by teaming with partners in NASA and industry to develop the critical technologies required to: enhance space exploration, expand our knowledge of the universe, and ensure continued national scientific, technical and economic leadership.

Huntress, Wesley T., Jr.↗

NASA NTRS2020

Partially Observable Games for Secure Autonomy

Technology development efforts in autonomy and cyber-defense have been evolving independently of each other, over the past decade. In this paper, we report our ongoing effort to integrate these two presently distinct areas into a single framework. To this end, we propose the two-player partially observable stochastic game formalism to capture both high-level autonomous mission planning under uncertainty and adversarial decision making subject to imperfect information. We show that synthesizing sub-optimal strategies for such games is possible under finite-memory assumptions for both the autonomous decision maker and the cyber-adversary. We then describe an experimental testbed to evaluate the efficacy of the proposed framework.

Ames, Aaron D.↗

NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

Benjamin N Kelley↗

NASA NTRS1989

Performance evaluation of automated manufacturing systems using generalized stochastic Petri Nets

The main objective of this research is to develop a generic modeling methodology with a flexible and modular framework to aid in the design and performance evaluation of integrated manufacturing systems using a unified model. After a thorough examination of the available modeling methods, the Petri Net approach was adopted. The concurrent and asynchronous nature of manufacturing systems are easily captured by Petri Net models. Three basic modules were developed: machine, buffer, and Decision Making Unit. The machine and buffer modules are used for modeling transfer lines and production networks. The Decision Making Unit models the functions of a computer node in a complex Decision Making Unit Architecture. The underlying model is a Generalized Stochastic Petri Net (GSPN) that can be used for performance evaluation and structural analysis. GSPN's were chosen because they help manage the complexity of modeling large manufacturing systems. There is no need to enumerate all the possible states of the Markov Chain since they are automatically generated from the GSPN model.

Al-Jaar, Robert Y.↗

NASA NTRS2010

A Computational Framework to Control Verification and Robustness Analysis

This paper presents a methodology for evaluating the robustness of a controller based on its ability to satisfy the design requirements. The framework proposed is generic since it allows for high-fidelity models, arbitrary control structures and arbitrary functional dependencies between the requirements and the uncertain parameters. The cornerstone of this contribution is the ability to bound the region of the uncertain parameter space where the degradation in closed-loop performance remains acceptable. The size of this bounding set, whose geometry can be prescribed according to deterministic or probabilistic uncertainty models, is a measure of robustness. The robustness metrics proposed herein are the parametric safety margin, the reliability index, the failure probability and upper bounds to this probability. The performance observed at the control verification setting, where the assumptions and approximations used for control design may no longer hold, will fully determine the proposed control assessment.

Crespo, Luis G.↗

NASA NTRSDate not supplied

Leveraging Observing System Simulation Experiments for Satellite Instrument Design: Advancements and Challenges

This abstract highlights NASA's OSSE framework, developed at the Global Modeling and Assimilation Office, which has become a widely adopted tool for evaluating the impact of new observations on weather forecasts. The framework involves simulating realistic observations by introducing errors to mimic real-world scenarios. By utilizing advanced radiative transfer modeling, the accuracy of simulated observations is significantly improved, enhancing the reliability of experimental outcomes. The talk focuses on recent progress and challenges in three key areas. Firstly, it explores the techniques used to simulate synthetic observations, a crucial aspect of OSSE experiments. Secondly, the presentation also discusses the challenges of examining the observation errors that need to be added to the perfect observations to generate realistic simulated observations. Lastly, the assimilation of synthetic observations and their impact on forecast skills is evaluated, providing valuable insights for optimizing current and future observing systems for improving the weather forecasts. By sharing recent advancements and acknowledging challenges, this presentation seeks to inspire researchers to leverage the OSSE framework in weather forecasting. NASA's OSSE techniques hold promise for a better understanding of the atmosphere and the development of more accurate and reliable weather predictions.

Isaac Moradi↗

NASA NTRS1985

Transport processes and ozone perturbations

Current understanding of stratospheric transport in the meridional plane is reviewed, and the implications of that conceptual framework for the ozone response to chlorofluorocarbon increases are considered. The possibility of seasonal and latitudinal variations in that response is stressed. Calculations of the changes in ozone that may have occurred between the period before widespread chlorofluorocarbon usage and the present day, and the changes that would be expected to occur at steady state for 1980 chlorofluorocarbon production levels, are presented. Finally, some of the uncertainties in the adopted transport framework and its applicability to the evaluation of future perturbations are explored.

Solomon, S.↗

NASA NTRS1995

Integrated performance and reliability specification for digital avionics systems

This paper describes an automated tool for performance and reliability assessment of digital avionics systems, called the Automated Design Tool Set (ADTS). ADTS is based on an integrated approach to design assessment that unifies traditional performance and reliability views of system designs, and that addresses interdependencies between performance and reliability behavior via exchange of parameters and result between mathematical models of each type. A multi-layer tool set architecture has been developed for ADTS that separates the concerns of system specification, model generation, and model solution. Performance and reliability models are generated automatically as a function of candidate system designs, and model results are expressed within the system specification. The layered approach helps deal with the inherent complexity of the design assessment process, and preserves long-term flexibility to accommodate a wide range of models and solution techniques within the tool set structure. ADTS research and development to date has focused on development of a language for specification of system designs as a basis for performance and reliability evaluation. A model generation and solution framework has also been developed for ADTS, that will ultimately encompass an integrated set of analytic and simulated based techniques for performance, reliability, and combined design assessment.

Brehm, Eric W.↗

NASA NTRS1999

Flight-Determined Subsonic Lift and Drag Characteristics of Seven Lifting-Body and Wing-Body Reentry Vehicle Configurations With Truncated Bases

This paper examines flight-measured subsonic lift and drag characteristics of seven lifting-body and wing-body reentry vehicle configurations with truncated bases. The seven vehicles are the full-scale M2-F1, M2-F2, HL-10, X-24A, X-24B, and X-15 vehicles and the Space Shuttle prototype. Lift and drag data of the various vehicles are assembled under aerodynamic performance parameters and presented in several analytical and graphical formats. These formats unify the data and allow a greater understanding than studying the vehicles individually allows. Lift-curve slope data are studied with respect to aspect ratio and related to generic wind-tunnel model data and to theory for low-aspect-ratio planforms. The proper definition of reference area was critical for understanding and comparing the lift data. The drag components studied include minimum drag coefficient, lift-related drag, maximum lift-to-drag ratio, and, where available, base pressure coefficients. The effects of fineness ratio on forebody drag were also considered. The influence of forebody drag on afterbody (base) drag at low lift is shown to be related to Hoerner's compilation for body, airfoil, nacelle, and canopy drag. These analyses are intended to provide a useful analytical framework with which to compare and evaluate new vehicle configurations of the same generic family.

Saltzman, Edwin J.↗

NASA NTRS2002

Aerodynamic Assessment of Flight-Determined Subsonic Lift and Drag Characteristics of Seven Lifting-Body and Wing-Body Reentry Vehicle Configurations

This report examines subsonic flight-measured lift and drag characteristics of seven lifting-body and wing-body reentry vehicle configurations with truncated bases. The seven vehicles are the full-scale M2-F1, M2-F2, HL-10, X-24A, X-24B, and X-15 vehicles and the Space Shuttle Enterprise. Subsonic flight lift and drag data of the various vehicles are assembled under aerodynamic performance parameters and presented in several analytical and graphical formats. These formats are intended to unify the data and allow a greater understanding than individually studying the vehicles allows. Lift-curve slope data are studied with respect to aspect ratio and related to generic wind-tunnel model data and to theory for low-aspect-ratio platforms. The definition of reference area is critical for understanding and comparing the lift data. The drag components studied include minimum drag coefficient, lift-related drag, maximum lift-to drag ratio, and, where available, base pressure coefficients. The influence of forebody drag on afterbody and base drag at low lift is shown to be related to Hoerner's compilation for body, airfoil, nacelle, and canopy drag. This feature may result in a reduced need of surface smoothness for vehicles with a large ratio of base area to wetted area. These analyses are intended to provide a useful analytical framework with which to compare and evaluate new vehicle configurations of the same generic family.

Saltzman, Edwin J.↗

NASA NTRS2009

Theorem Proving in Intel Hardware Design

For the past decade, a framework combining model checking (symbolic trajectory evaluation) and higher-order logic theorem proving has been in production use at Intel. Our tools and methodology have been used to formally verify execution cluster functionality (including floating-point operations) for a number of Intel products, including the Pentium(Registered TradeMark)4 and Core(TradeMark)i7 processors. Hardware verification in 2009 is much more challenging than it was in 1999 - today s CPU chip designs contain many processor cores and significant firmware content. This talk will attempt to distill the lessons learned over the past ten years, discuss how they apply to today s problems, outline some future directions.

O'Leary, John↗